Thursday, 2018-04-12

*** tosky has quit IRC00:23
*** tellesnobrega has quit IRC01:16
*** dave-mccowan has quit IRC03:18
*** links has joined #openstack-sahara05:09
*** openstackgerrit has quit IRC05:48
*** caowei has quit IRC05:56
*** caowei has joined #openstack-sahara05:58
*** rtsisyk has joined #openstack-sahara05:58
*** rtsisyk has joined #openstack-sahara05:58
*** caowei has quit IRC06:02
*** tosky has joined #openstack-sahara07:38
*** tesseract has joined #openstack-sahara07:39
*** pcaruana has joined #openstack-sahara08:12
*** amoralej has joined #openstack-sahara10:31
amoralejhi10:31
amoraleji'm hitting issues with sahara and latest update of oslo.config10:31
amoralejwhere's the proper site to report bugs to sahara?10:31
amoralejtosky, ^10:31
amoralejbtw it's strange you are not hitting it in upstream gate, have you seen any issue10:32
amoralejrecently?10:32
toskyamoralej: no10:32
toskythere was a change in puppet-sahara though recently10:32
toskyand iirc that's not used in the gates, right? We use the devstack plugin10:32
amoralejtosky, what i've found is that value_list format is different in https://github.com/openstack/sahara/blob/master/sahara/utils/openstack/keystone.py#L43 after latest oslo.config10:33
toskybut when I checked that puppet-sahara change, it looked like there would not be any impact10:33
amoralejmaybe in devstack it's not entering there for some reason10:33
toskyamoralej: oh10:33
amoralejsome configuration difference10:33
toskyamoralej: is the oslo.config version a major bump?10:34
amoralejyes10:34
amoralejit is10:34
amoralejfrom 5 to 610:34
toskyargh10:34
toskyso I guess we would also need to raise lower-contraints?10:34
toskyif we fix the issue10:34
amoralejand fix10:34
amoralejyeap10:34
amoralejtosky, do you use LP to report issues?10:34
toskyamoralej: I was going to ask you to start the report - and storyboard, no more LP10:35
amoralejok10:35
amoralejtosky, https://storyboard.openstack.org/#!/story/200183510:46
amoralejtosky, definetively oslo config changed return from _get_file_value10:47
amoralejbut is that public api method?10:47
toskyamoralej: we have some magic there10:48
toskythe sahara weekly meeting is in few hours, I will ping the person who knows that code10:48
amoralejack10:49
amoraleji'll check what's the differences with devstack configuration10:49
amoralejbut note this will block oslo.config promotion in RDO10:49
amoralejwhich at some point may be a blocker for others10:49
toskyit will be solved soon, but please give us some timezone buffer time :)10:50
amoralejtosky, sure :)10:51
amoralejtosky, btw, if i add config options in [trustee], it works10:52
amoralejthat's why it works in devstack10:52
amoralejare those options mandatory?10:52
amoralejyeah, _get_keystoneauth_cfg is only used if some option in trustee is empty10:54
*** tellesnobrega has joined #openstack-sahara11:18
*** tellesnobrega has quit IRC11:19
*** tellesnobrega has joined #openstack-sahara11:19
*** rcernin has quit IRC11:35
tellesnobregatosky, how about this? https://review.openstack.org/#/c/558518/11:38
tellesnobregais this ready to merge from your tests?11:38
*** Guest94774 is now known as gokhan_11:41
*** amoralej is now known as amoralej|lunch11:53
toskytellesnobrega: I can't have a proper run, but at least the failure in my environment is now consistent between sie and pack images12:10
tellesnobregacool12:10
tellesnobregaI'm working on ntp and scala12:10
tellesnobregaa patch is coming up soon12:10
toskyso I'm going to ack it, unless you want to include the fix for the other two issues12:11
toskybut yeah, probably they deserve a separate patch12:11
tellesnobregathey are on a separated patch12:19
toskytellesnobrega: about scala, the logic may end up being different: an optional parameter requires a default value currently; unless sahara/plugins/image.py is changed, of course12:31
*** dave-mccowan has joined #openstack-sahara12:31
toskythe problem is that the code does not distinguish between a default not specified and an "empty string is the default"12:31
tellesnobregahmm12:32
tellesnobregathe current implementation we have a default set to 2.11.612:33
tellesnobregaeven if the user doesn't pass any value12:33
tellesnobregahttps://github.com/openstack/sahara/blob/master/sahara/plugins/mapr/resources/images/image.yaml#L13-L1712:33
tellesnobregathis is from a run now12:36
tellesnobregaNo Presto metadata available for rhel-7-server-rpms12:36
tellesnobregaRetrieving http://downloads.lightbend.com/scala/2.11.6/scala-2.11.6.rpm12:36
tellesnobregaPreparing...                          ########################################12:36
tellesnobregaUpdating / installing...12:36
tellesnobregascala-2.11.6-012:36
*** gokhan_ has quit IRC12:37
*** gokhan_ has joined #openstack-sahara12:38
toskytellesnobrega: and the old logic was forcing that value only for trusty, while getting the last version when openjdk 8 can be used (so centos)12:49
toskynow, we could pin the old version, sure; that logic was originally set by mapr people iirc12:49
*** knylander has joined #openstack-sahara12:50
toskyin fact it was not possible to force a specific version of scala; that option was added by me (!)12:50
toskyI already forgot that12:50
tellesnobregalol12:51
toskyin the meantime: bugs.launchpad.net/bugs/176336112:54
toskytoday is bug filing day12:54
tosky>.<12:54
toskywell, at least it means that I did something, not just pretended to :D12:55
tellesnobregalaunchpad? oh puppet-sahara12:55
toskyand openstack-ansible (because we are ecumenical)12:57
*** amoralej|lunch is now known as amoralej13:24
*** links has quit IRC13:27
*** shuyingya has joined #openstack-sahara13:32
*** jeremyfreudberg has joined #openstack-sahara13:52
*** openstackgerrit has joined #openstack-sahara14:11
openstackgerritShu Yingya proposed openstack/sahara master: Remove step upload package to oozie/sharelib  https://review.openstack.org/53872814:11
openstackgerritShu Yingya proposed openstack/sahara master: Remove step upload package to oozie/sharelib  https://review.openstack.org/53872814:24
*** jeremyfreudberg has quit IRC14:48
*** SergeyLukjanov has quit IRC15:00
*** ruhe has quit IRC15:00
*** dmitryme has quit IRC15:00
*** NikitaKonovalov has quit IRC15:00
*** aignatov has quit IRC15:00
*** aignatov has joined #openstack-sahara15:15
*** dmitryme has joined #openstack-sahara15:16
*** NikitaKonovalov has joined #openstack-sahara15:16
*** ruhe has joined #openstack-sahara15:16
*** SergeyLukjanov has joined #openstack-sahara15:17
*** l4yerffej has quit IRC15:59
*** l4yerffej has joined #openstack-sahara16:07
*** shuyingya has quit IRC16:14
*** shuyingya has joined #openstack-sahara16:15
*** shuyingya has quit IRC16:15
*** shuyingya has joined #openstack-sahara16:16
*** shuyingya has quit IRC16:34
*** amoralej is now known as amoralej|off17:45
openstackgerritTelles Mota Vidal Nóbrega proposed openstack/sahara master: Adding NTP and Scala to mapr image  https://review.openstack.org/56098517:48
openstackgerritTelles Mota Vidal Nóbrega proposed openstack/sahara master: Adding NTP and Scala to mapr image  https://review.openstack.org/56098517:52
*** tesseract has quit IRC17:55
tellesnobregaon scala we want the discovery version as default?17:56
tellesnobregais that correct?17:56
toskyit's the current behavior17:56
toskyright now:17:57
tosky- on centos/rhel, the last version is discovered and used17:57
tosky- on ubuntu trusty, 2.11.6 is hardcoded (with future fallback to the discovered version)17:57
tellesnobregaoh ok, so I'm going to remove the default option from the main script17:57
tellesnobregaand set locally on the file the 2.11.617:57
toskyI suspect that it's not going to work - you need a default option or the validator bails out17:58
toskythat's what I hit from a quick test17:58
tellesnobregalet me try17:58
*** pcaruana has quit IRC18:09
openstackgerritTelles Mota Vidal Nóbrega proposed openstack/sahara master: Adding ntpdate and Scala to mapr image  https://review.openstack.org/56098518:11
tellesnobregatosky, take a look now, it looks better, and it actually cleaned previous version of scala and updated to newest one18:12
toskylet me see18:12
toskytellesnobrega: so now there is no way to override a version18:14
toskyand the wrong version is installed on ubuntu18:15
tellesnobregaoh, ok, so we want the option to override to an specific version18:15
tellesnobregalet me get back18:15
tellesnobregato using default_value18:15
toskytake your time :) it's almost dinner time for me18:15
tellesnobregaso, what we want is to have a default value, but check for new value when that default is not set correct?18:17
*** openstackgerrit has quit IRC18:19
*** openstackgerrit has joined #openstack-sahara18:24
openstackgerritMerged openstack/sahara master: Remove step upload package to oozie/sharelib  https://review.openstack.org/53872818:24
toskymy idea would be more: if the default is not set, autodetect the version (but we need a value for the default field, hence my suggestion of using 'autodetect')18:27
toskyin case of ubuntu (trusty), autodetect means 2.11.6 right now (mapr 6.0.1 supports xenial)18:28
toskyin case of centos, autodetect means whatever is the last version (so real autodetect)18:28
toskyif the default value is specified, use it18:28
tellesnobregathat is what I'm trying now, to remove the default version to 2.11.618:30
tellesnobregaso it will try to detect in case it is not explicitly set18:30
tellesnobregabut I'm not sure that it is possible now18:30
*** links has joined #openstack-sahara18:31
tellesnobregaseems like every argument has to have a default value set18:32
toskyyeah, that's what I noticed18:33
tellesnobregaif that is not what we want18:33
tellesnobregawe can change that for sure18:33
toskyI think that the logic was to make sure that a default value exists, because an empty value may not be good for every case18:34
tellesnobregahttps://github.com/openstack/sahara/blob/master/sahara/plugins/images.py#L131-L13418:34
tellesnobregathis is the issue18:34
toskybut now we have the usual problem to distinguish between an None value and an empty string18:34
tellesnobregayou mena if we remove this check?18:37
toskyif we simply remove this check, yes18:40
toskythat's where I stopped investigating waiting for discussiong18:40
toskyand then I thought about using a special value for the default field18:41
tellesnobregathat is a simpler option18:41
tellesnobregause default to 118:42
toskythe value does not matter much, as long as it's clearly not a valid version18:42
tellesnobregathat sounds like a safer solution for now18:44
tellesnobregaI will work on it now18:44
toskywith that, the original code will be mostly untouched18:44
tellesnobregayes18:47
tellesnobregathe fallback should be 2.11.6 in both cases?18:52
openstackgerritTelles Mota Vidal Nóbrega proposed openstack/sahara master: Adding ntpdate and Scala to mapr image  https://review.openstack.org/56098519:09
toskytellesnobrega: only for trusty19:27
toskyotherwise the autodetect would not make sense19:27
tellesnobregafallback I mean in case autodetect fails19:28
toskyoh, uhm19:29
toskywhat do we do right now?19:29
tellesnobregafallback to default_version19:29
toskyin sie19:29
tellesnobregabut since default_version is "1"19:29
tellesnobregasame19:29
tellesnobregafalls back to 2.11.619:29
tellesnobregahttps://github.com/openstack/sahara-image-elements/blob/83c3011f69389e5e1459e5005134a0ff52e8bfcd/elements/hadoop-mapr/install.d/41-scala#L28-L3019:30
*** links has quit IRC19:46
*** tosky___ has joined #openstack-sahara20:44
*** tosky has quit IRC20:45
*** tosky___ is now known as tosky20:45
*** openstackstatus has quit IRC21:27
*** openstack has joined #openstack-sahara21:30
*** ChanServ sets mode: +o openstack21:30
*** rcernin has joined #openstack-sahara22:30
-openstackstatus- NOTICE: The Etherpad service at https://etherpad.openstack.org/ is being restarted to pick up the latest release version; browsers should see only a brief ~1min blip before reconnecting automatically to active pads23:40
*** tosky has quit IRC23:49

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!