Wednesday, 2017-07-05

*** limao has quit IRC00:02
*** dmacpher has joined #tripleo00:03
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016700:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170225700:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Ben Nemec (bnemec)00:10
openstackLaunchpad bug 1702257 in tripleo "VM's cannot have ssh key injected because can't access metadata service" [Critical,Triaged]00:10
*** dmacpher_ has joined #tripleo00:10
*** dmacpher_ has quit IRC00:13
*** japestinho has joined #tripleo00:13
*** dmacpher_ has joined #tripleo00:13
*** dmacpher has quit IRC00:17
*** noslzzp has quit IRC00:27
openstackgerritJamie Lennox proposed openstack/diskimage-builder master: Don't use du -x to calculate image size  https://review.openstack.org/47673200:33
openstackgerritMerged openstack/tripleo-heat-templates master: New environment file to configure containers.  https://review.openstack.org/47862500:35
*** limao has joined #tripleo00:39
openstackgerritMerged openstack/tripleo-heat-templates master: Convert role templates to consume roles_data map  https://review.openstack.org/46985300:41
*** noslzzp has joined #tripleo00:43
*** jkilpatr has quit IRC00:47
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016701:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170225701:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Ben Nemec (bnemec)01:10
openstackLaunchpad bug 1702257 in tripleo "VM's cannot have ssh key injected because can't access metadata service" [Critical,Triaged]01:10
openstackgerritMerged openstack/tripleo-quickstart master: don't make ssh_config files executable  https://review.openstack.org/44156501:23
*** liupe__ has joined #tripleo01:30
*** bkopilov has quit IRC01:59
*** atoth has quit IRC02:02
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016702:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Ben Nemec (bnemec)02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170225702:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1702257 in tripleo "VM's cannot have ssh key injected because can't access metadata service" [Critical,Triaged]02:10
*** dmacpher has joined #tripleo02:15
*** dmacpher_ has quit IRC02:15
*** japestinho has quit IRC02:43
*** dixiaoli has joined #tripleo02:52
*** ipsecguy has quit IRC03:07
openstackgerritNuman Siddique proposed openstack/tripleo-heat-templates master: Support deploying OVN as container services  https://review.openstack.org/46886003:10
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016703:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Ben Nemec (bnemec)03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170225703:10
*** ooolpbot has quit IRC03:10
openstackLaunchpad bug 1702257 in tripleo "VM's cannot have ssh key injected because can't access metadata service" [Critical,Triaged]03:10
*** ipsecguy has joined #tripleo03:11
*** bkopilov has joined #tripleo03:13
*** dsariel has quit IRC03:22
*** ykarel has joined #tripleo03:22
*** gkadam has joined #tripleo03:24
*** gkadam has quit IRC03:26
*** gkadam has joined #tripleo03:27
*** noslzzp has quit IRC03:28
*** dsariel has joined #tripleo03:35
*** mdnadeem has joined #tripleo03:40
*** links has joined #tripleo03:44
*** liupe__ has quit IRC03:46
*** chhavi has joined #tripleo04:04
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016704:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170225704:10
*** ooolpbot has quit IRC04:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Ben Nemec (bnemec)04:10
openstackLaunchpad bug 1702257 in tripleo "VM's cannot have ssh key injected because can't access metadata service" [Critical,Triaged]04:10
*** ykarel has quit IRC04:14
*** dmacpher_ has joined #tripleo04:19
*** dmacpher has quit IRC04:20
*** janki has joined #tripleo04:31
*** chhavi has quit IRC04:38
*** ykarel has joined #tripleo04:40
*** chhavi has joined #tripleo04:41
*** chhavi has quit IRC04:44
*** dixiaoli has quit IRC05:00
*** prateek has joined #tripleo05:07
*** ratailor has joined #tripleo05:08
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016705:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Ben Nemec (bnemec)05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170225705:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1702257 in tripleo "VM's cannot have ssh key injected because can't access metadata service" [Critical,Triaged]05:10
*** marios has joined #tripleo05:19
*** skramaja has joined #tripleo05:21
*** lmiccini has joined #tripleo05:21
*** dixiaoli has joined #tripleo05:27
openstackgerritPrateek Arora proposed openstack/tripleo-common master: Run tempest containers  https://review.openstack.org/48035305:37
openstackgerritNuman Siddique proposed openstack/tripleo-heat-templates stable/ocata: ocata: Enable OVN services for scenario 4 CI job  https://review.openstack.org/48035505:42
*** udesale has joined #tripleo05:46
*** dpawar has joined #tripleo05:48
*** dmacpher_ has quit IRC05:55
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/47260706:00
*** jprovazn has joined #tripleo06:03
*** jprovazn has quit IRC06:04
*** limao has quit IRC06:05
*** limao has joined #tripleo06:06
*** dmacpher_ has joined #tripleo06:08
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016706:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Ben Nemec (bnemec)06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170225706:10
*** ooolpbot has quit IRC06:10
openstackLaunchpad bug 1702257 in tripleo "VM's cannot have ssh key injected because can't access metadata service" [Critical,Triaged]06:10
*** agurenko has joined #tripleo06:13
*** sshnaidm has quit IRC06:16
*** dmacpher_ has quit IRC06:20
*** karthiks_afk is now known as karthiks06:23
*** jaganathan has joined #tripleo06:24
*** cschwede has joined #tripleo06:25
*** jfrancoa has joined #tripleo06:26
*** jfrancoa has joined #tripleo06:27
*** fzdarsky has joined #tripleo06:28
*** hjensas has joined #tripleo06:29
*** hjensas has quit IRC06:29
*** hjensas has joined #tripleo06:29
*** jaganathan has quit IRC06:29
*** dparkes has joined #tripleo06:31
*** dmacpher_ has joined #tripleo06:33
*** fzdarsky has quit IRC06:34
*** dparkes has quit IRC06:36
*** pgadiya has joined #tripleo06:43
*** ffiore has joined #tripleo06:45
*** ratailor has quit IRC06:46
*** ratailor has joined #tripleo06:46
*** lmiccini has quit IRC06:47
*** ykarel_ has joined #tripleo06:47
*** udesale__ has joined #tripleo06:49
*** udesale has quit IRC06:49
openstackgerritFlorian Fuchs proposed openstack/tripleo-validations master: Port the network environment validation  https://review.openstack.org/34158606:49
*** ykarel has quit IRC06:50
*** lmiccini has joined #tripleo06:59
*** jaganathan has joined #tripleo07:00
*** rwsu has joined #tripleo07:00
*** yolanda_ has joined #tripleo07:01
*** ebarrera_ has joined #tripleo07:02
*** tesseract has joined #tripleo07:02
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016707:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170225707:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Ben Nemec (bnemec)07:10
openstackLaunchpad bug 1702257 in tripleo "VM's cannot have ssh key injected because can't access metadata service" [Critical,Triaged]07:10
*** jpena|off is now known as jpena07:12
*** bogdando has joined #tripleo07:13
*** jpich has joined #tripleo07:13
*** pliu has joined #tripleo07:14
*** shardy has joined #tripleo07:16
*** rcernin has joined #tripleo07:19
*** sshnaidm has joined #tripleo07:19
*** ebarrera_ has quit IRC07:20
*** ebarrera has joined #tripleo07:20
*** dparkes has joined #tripleo07:20
openstackgerritmathieu bultel proposed openstack/tripleo-common master: Implement upgrade workflow  https://review.openstack.org/46376507:25
*** amoralej|off is now known as amoralej07:25
*** fzdarsky has joined #tripleo07:30
*** liupe__ has joined #tripleo07:31
*** pliu has joined #tripleo07:32
*** ykarel__ has joined #tripleo07:36
shardyMorning all - simple review if anyone has a moment https://review.openstack.org/#/c/480210/07:36
*** oanson has quit IRC07:38
*** oanson has joined #tripleo07:38
*** egonzalez has joined #tripleo07:39
*** ykarel_ has quit IRC07:39
openstackgerritJaganathan Palanisamy proposed openstack/python-tripleoclient master: Invokes specified workflows in plan env file  https://review.openstack.org/46959607:40
yolanda_hi, good morning. Can i get reviews for https://review.openstack.org/#/c/480036/ ? it's an urgent fix for python-tripleoclient07:42
*** florianf has joined #tripleo07:42
shardyyolanda_: isn't that backwards incompatible?07:43
shardye.g perhaps we should only change the environ.get?07:44
yolanda_shardy, that has been broken at least since newton07:44
yolanda_os-image cannot be used right now07:44
*** anshul has joined #tripleo07:45
shardyyolanda_: Ok, perhaps we could add a release note to mention the interface has changed though?07:46
yolanda_that makes sense, yes07:46
shardyyolanda_: do we know how this ever worked?  I'm wondering why this didn't previously conflict with glance07:46
*** d0ugal has joined #tripleo07:46
*** d0ugal has quit IRC07:46
*** d0ugal has joined #tripleo07:46
yolanda_shardy, don't know, i just discovered this problem on a deploy on newton, and i tested in newer versions, and always failed07:46
shardyyolanda_: ack, OK - would you mind pushing a release note, then I'll +2?07:47
*** ykarel__ is now known as ykarel07:47
yolanda_it's not a problem with glance actually, but with os-client-config07:47
yolanda_ok, i can amend and add a reno07:47
shardyyolanda_: thanks!07:47
yolanda_after that, backports are needed, i can do07:48
yolanda_i actually tested this patch against newton, and applied cleanly07:49
openstackgerrityolanda.robla proposed openstack/python-tripleoclient master: Modified --os-image option in overcloud image upload  https://review.openstack.org/48003607:51
cschwedeGood Morning! we have a strange issue where a minor update on mitaka raises an error like this: "os-collect-config: 401 Client Error: Unauthorized for url: ... cdf25/ov-c2eilu26i44-0-cqagkp52e7h2-Controller-ps435ucfboxv/294b". However, the only containers that exist on the undercloud are "overcloud" and "overcloud-swift-rings". Any idea how to fix this? It seems like this is not a Swift issue...07:51
*** salmankhan has joined #tripleo07:52
*** hjensas has quit IRC07:53
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: Implement Upgrade workflow via the tripleo cli  https://review.openstack.org/46372807:53
openstackgerritSteven Hardy proposed openstack-infra/tripleo-ci master: Replace references to deprecated controllerExtraConfig  https://review.openstack.org/48039507:54
*** yamahata has quit IRC07:55
shardyd0ugal: Hey, good morning!07:57
shardyd0ugal: I wanted to chat about if/how we might wire in warnings during plan creation07:57
shardyd0ugal: tl;dr I'd like to replace a few parameters that are inconsistently named for historical reasons07:58
shardytrying to figure out a way to do that without breaking users, but also without maintaining a hacky translation forever in tripleo-commoon07:58
*** dmacpher_ has quit IRC07:58
*** zzzeek has quit IRC08:00
*** zzzeek has joined #tripleo08:01
d0ugalshardy: sounds good - so the warnings would come from the workflow?08:03
shardyd0ugal: yeah, I'm just wondering how we might do that08:04
d0ugalshardy: do you have a particular example you'd like to rename?08:04
shardyI know skramaja has been looking at something similar for tripleoclient08:04
*** iranzo has joined #tripleo08:04
*** iranzo has joined #tripleo08:04
shardyto warn re deprecated parameters08:04
d0ugalIt is much easier in tripleoclient :)08:04
shardybut in this case, I'd like to actually remove the deprecated parameters, and put a temporary translation table into tripleo-common08:05
d0ugalRight08:05
shardye.g controllerImage: ControllerImage08:05
shardyOvercloudControlFlavor: OvercloudControllerFlavor08:05
shardyetc08:05
*** dbecker has joined #tripleo08:05
*** salmankhan has quit IRC08:05
d0ugalshardy: The translation table is easy - warning users is less easy.08:05
d0ugalHow would a REST API do this? out of interest08:06
d0ugalWe could log something, but nobody would read that :)08:06
*** psachin has joined #tripleo08:06
*** ffiore has quit IRC08:06
shardyd0ugal: yeah, that is exactly my question :)08:08
shardye.g can we add something to the zaqar payload that includes a warning string/list?08:08
shardyor some field in the response to synchronous validation requests?08:09
d0ugalshardy: Yup, that could work - I think it might be better to send it as a individual zaqar message tho'08:09
shardyd0ugal: I think in general it's got to be some extra field as there's no general rest pattern for this AFAIK08:09
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016708:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Ben Nemec (bnemec)08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170225708:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1702257 in tripleo "VM's cannot have ssh key injected because can't access metadata service" [Critical,Triaged]08:10
*** ffiore has joined #tripleo08:11
d0ugalshardy: at the moment zaqar message a type that matches the workflow08:11
d0ugalshardy: we could add a new type, something like "tripleo.warnins"08:11
d0ugalbut without the typo :)08:11
d0ugalhttps://github.com/openstack/tripleo-common/blob/master/workbooks/baremetal.yaml#L30308:11
mandremarios, shardy, or any other core around: good morning! can I get a review for https://review.openstack.org/#/c/478215/?08:11
*** suuuper has joined #tripleo08:11
shardyd0ugal: Ok so it sounds like, right now, there's no easy way to do this, but we could look at adding something?08:12
d0ugalor it could be an "informational" type, which could carry more than just warnings.08:12
*** ramishra has quit IRC08:12
d0ugalshardy: Yeah, there is no pattern for it now, but I think we could establish one fairly easily08:12
d0ugalshardy: we just need to make sure the CLI and GUI know how to handle these new messages.08:12
shardyd0ugal: any idea if anyone has some time to look into it by any chance? ;)08:12
d0ugalshardy: ... and hope external consumers can figure it out later?08:13
d0ugalshardy: well, I might actually have time.08:13
shardyYeah it'd be good to chat with jpich jtomasek and jrist about it08:13
shardyd0ugal: if you have time that would be great! :)08:13
d0ugalshardy: I think the GUI has a better setup for this already, as they use the type to handle messages different (the introspection workflow sends progress messages in the middle)08:13
*** ramishra has joined #tripleo08:14
d0ugalshardy: are you looking for somebody to establish the pattern or also do the translation map work?08:14
shardyd0ugal: the idea I had was to add a deprecated_parameters.yaml to t-h-t, which we could read and translate/warn during plan creation or validation08:14
d0ugalright08:14
shardyd0ugal: ideally both since they are related, but I can probably do the translation part if necesary08:14
mariosmandre: o/ voted i think we can merge it?08:15
psachinHi marios any hints regarding cschwede question?08:16
bogdando\o folks08:16
bogdandoPTAL https://review.openstack.org/#/c/474269/08:16
bogdandologs logs logs08:16
d0ugalshardy: okay, cool - I'll give it a shot. You happened to catch me in a bit of a lull08:16
mariospsachin: o/ which question where (I may have missed some discussion?)08:17
bogdandohm, what is http://logs.openstack.org/69/474269/9/check/gate-tripleo-ci-centos-7-undercloud-containers/5f86afa/console.html#_2017-07-04_15_34_25_542060 ?..08:17
d0ugalshardy: is there a bug? or would you mind opening one?08:17
psachinmarios: "Good Morning! we have a strange issue where a minor update on mitaka raises an error like this: "os-collect-config: 401 Client Error: Unauthorized for url: ... cdf25/ov-c2eilu26i44-0-cqagkp52e7h2-Controller-ps435ucfboxv/294b". However, the only containers that exist on the undercloud are "overcloud" and "overcloud-swift-rings". Any idea how to fix this? It seems like this is not a Swift issue..."08:17
shardypsachin, cschwede: need more info, e.g heat/swift logs - sounds like we failed to push the deployment metadata to swift,08:17
shardyare all the swift services running?  Can you create a container/object manually?08:18
shardyIs there a backtrace in heat-engine.log?08:18
cschwedeshardy: yes, we checked that; also created a tempurl to ensure  that it is working correctly08:18
shardycschwede: interesting, but curl of the tempurl in the o-c-c config fails (from the node and the undercloud?)08:19
mandremarios, shardy: thanks! this is unblocking the change that's required to deploy containers with ssl08:19
cschwedeshardy: yes - the "ov-*" containers are completely missing08:19
mariospsachin: not come across that one as shardy said yeah we would need bug and logs .. it could be an environmental issue for example.08:19
mariospsachin: so does the minor update fail i guess/sounds like?08:20
shardycschwede: weird - I wonder how heat created the tempurl if the container is missing08:20
mariospsachin: and is swift itself working OK? like if you do swift list or swift list overcloud for example08:20
psachinshardy: services are running fine08:20
psachinmarios: ^^08:20
cschwedeshardy: the tempurls can be created even if swift is down08:20
shardyaha08:20
*** cshastri has joined #tripleo08:20
mariosack psachin08:21
psachinshardy: marios:  We checked `swift auth` `swift temurl...` commands. They run fine. We do not find any problem with swift08:23
florianfmandre, shadower: There are a couple of +1's on the network-environment patch (finally :-) ...) Would you mind having a look as well? https://review.openstack.org/#/c/341586/ (and maybe have a look at this one too: https://review.openstack.org/#/c/477006/) Thanks!08:23
mandreshadower: I'll take the second, you take the first, ok?08:24
*** msreddy has quit IRC08:24
mandre:P08:24
cshastrimarios: the minor update gets stuck and time out eventually after 4 hours08:25
florianf:-)08:25
shardyflorianf: Hey, while we're asking for reviews... :)08:25
florianfshadower: already on it! :-)08:26
florianfshardy: ^^08:26
shardyflorianf: can you check https://review.openstack.org/#/c/478623 and https://review.openstack.org/#/c/478944 today please? :)08:26
shardythanks! :)08:26
florianfshadower: sorry, wrong username autocomplete again... :-(08:26
*** shardy is now known as shtab08:27
*** shtab is now known as shardy08:27
*** pbandark has joined #tripleo08:28
*** iranzo has quit IRC08:28
psachinpbandark: Welcome08:29
pbandarkpsachin:  :)08:29
*** pliu has quit IRC08:29
*** pliu has joined #tripleo08:29
*** jtomasek has joined #tripleo08:29
psachinpbandark: we are discussing minor update issue. Summary: "we have a strange issue where a minor update on mitaka raises an error like this: "os-collect-config: 401 Client Error: Unauthorized for url: ... cdf25/ov-c2eilu26i44-0-cqagkp52e7h2-Controller-ps435ucfboxv/294b". However, the only containers that exist on the undercloud are "overcloud" and "overcloud-swift-rings". Any idea how to fix this? It seems08:30
psachinlike this is not a Swift issue..."08:30
*** lucas-afk is now known as lucasagomes08:32
psachincshastri: You referred that yum failed right?08:32
psachinmarios: Does yum collects information from ov-* containers for update?08:33
pbandarkpsachin: never faced such error in minor update. but, you can check if there is issue with keystone. or any pointers from heat logs.08:33
cshastripsachin: we have not got to that stage yet.. It'll be afterwards I guess08:34
*** gfidente has joined #tripleo08:34
*** gfidente has quit IRC08:34
*** gfidente has joined #tripleo08:34
*** oidgar has joined #tripleo08:35
openstackgerritCarlos Camacho proposed openstack/tripleo-quickstart-extras master: Enable the HA deployment by default  https://review.openstack.org/47644808:36
*** salmankhan has joined #tripleo08:36
*** iranzo has joined #tripleo08:36
*** iranzo has joined #tripleo08:36
*** links has quit IRC08:37
openstackgerritCarlos Camacho proposed openstack-infra/tripleo-ci master: Enable the HA deployment by default  https://review.openstack.org/41517908:37
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates master: Enable the HA deployment by default  https://review.openstack.org/35906008:38
chandankumararxcruz: sshnaidm https://review.openstack.org/#/c/480429/08:41
*** dmacpher has joined #tripleo08:42
arxcruzchandankumar: have you seen my comments yesterday?08:43
sshnaidmchandankumar, nice08:43
sshnaidmchandankumar, do you check ping or ssh there?08:43
chandankumararxcruz: seen right now08:43
chandankumarsshnaidm: i am current checking networking connectivity08:44
chandankumari will extend it to ssh08:44
openstackgerritMartin André proposed openstack/tripleo-heat-templates master: Copy only generated puppet files into the container  https://review.openstack.org/47615308:44
sshnaidmchandankumar, is network connectivity a ping?08:44
chandankumararxcruz: yes08:44
chandankumarsshnaidm: yes08:45
*** ffiore has quit IRC08:45
sshnaidmchandankumar, ok, saw private_key there, thought it's ssh..08:45
*** ffiore has joined #tripleo08:49
arxcruzchandankumar: okay, why not :)08:51
arxcruzchandankumar: I would change on line 240 "As a operator I..." because for me it became personal, but english isn't my main language, so..08:52
*** links has joined #tripleo08:53
*** hjensas has joined #tripleo08:53
*** hewbrocca_afk is now known as hewbrocca08:54
*** tvignaud has quit IRC08:57
*** tosky has joined #tripleo09:04
*** tvignaud has joined #tripleo09:09
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016709:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170225709:10
*** ooolpbot has quit IRC09:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Ben Nemec (bnemec)09:10
openstackLaunchpad bug 1702257 in tripleo "VM's cannot have ssh key injected because can't access metadata service" [Critical,Triaged]09:10
openstackgerritmathieu bultel proposed openstack/tripleo-quickstart master: Remove hardcoded overcloud_release value  https://review.openstack.org/48046109:14
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: WIP: Support initramfs images in modify-image role  https://review.openstack.org/47989609:15
skramajashardy: d0ugal https://review.openstack.org/#/c/479277/09:16
skramajashardy: d0ugal this is the tripleoclient patch for warning. it gets the output from the workflow and warns if user has defined it.09:17
sshnaidmdo we gate anything in openstack/ironic-python-agent ?09:20
chandankumararxcruz: i will wait for comments till tomorrow then update it09:22
*** dmacpher has quit IRC09:23
skramajashardy: rather than internal translation, i would prefer we force users to modify it. may be we can deprecate now and force the change next cycle.09:24
*** limao has quit IRC09:24
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT REVIEW: test python agent update  https://review.openstack.org/48046809:24
*** limao has joined #tripleo09:24
*** jtomasek has quit IRC09:26
*** limao has quit IRC09:29
chandankumarsshnaidm: arxcruz i am dropping a mail to -dev mailing list related to my discussion around improving tempest tests debugging in tripleo ci gates09:30
chandankumarhttps://review.rdoproject.org/etherpad/p/tripleo_tempest_tests09:30
chandankumararxcruz: sshnaidm ^^09:30
*** dmacpher has joined #tripleo09:35
shardyskramaja: yeah that's the other option, the issue is some parameters can't be deprecated because I need to rename them09:37
shardye.g OvercloudControlImage vs OvercloudControllerImage09:38
*** dixiaoli has quit IRC09:38
shardymaybe I can work around it with heat conditionals, but it'd mean removing the contraints in role.role.j2.yaml09:38
shardyperhaps that's a reasonable compromise09:38
shardybut translation would avoid that template getting really ugly and hard(er) to maintain :)09:38
*** pbandark has quit IRC09:38
skramajashardy: yes. i agree with maintaining part. the only issue with translation is if it will look like magic - providing a parameter but reflected as another.09:40
bogdandodo we have a bug for http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-ha-oooq/63eeda4/logs/undercloud/home/jenkins/undercloud_install.log.txt.gz ?09:41
skramajashardy: may be a warning msg would do for now.09:41
skramajashardy: in case of DPDK also we need to rename it because of supporting odl. we deprecated old names and added newer ones. the template is ugly (for sure).09:43
bogdandolooks like periodic jobs blocked by openstack-kolla installation conflicts09:44
*** pbandark has joined #tripleo09:46
*** dsariel has quit IRC09:47
*** links has quit IRC09:49
*** dmacpher has quit IRC09:54
*** links has joined #tripleo10:02
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart master: Add support for openstack provider  https://review.openstack.org/46370110:03
bogdandoPTAL folks, https://review.openstack.org/#/c/463701/5..6/roles/tripleo-inventory/tasks/openstack.yml10:05
openstackgerritMerged openstack/tripleo-heat-templates master: Allow volumes in puppet_config containers spec  https://review.openstack.org/47821510:08
*** dmacpher has joined #tripleo10:08
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart master: Add support for openstack inventory provider  https://review.openstack.org/46370110:08
openstackgerritMerged openstack/tripleo-heat-templates master: Bind mount needed cert for haproxy  https://review.openstack.org/47385410:09
openstackgerritMerged openstack/tripleo-heat-templates stable/newton: [newton only] Ensure cinder services are cleanup during upgrade.  https://review.openstack.org/47892210:09
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016710:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170225710:10
*** ooolpbot has quit IRC10:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Ben Nemec (bnemec)10:10
openstackLaunchpad bug 1702257 in tripleo "VM's cannot have ssh key injected because can't access metadata service" [Critical,Triaged]10:10
prateekping mandre, all patches added a single line as the name of the image they wanted, however this patch fails https://review.openstack.org/#/c/480353/, can you help me reason why ?10:10
prateekmandre, i see some folks making changes to jinja templates but am not sure of the reason10:13
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart master: Add support for openstack inventory provider  https://review.openstack.org/46370110:14
*** sri_ has joined #tripleo10:17
bogdandoplease merge https://review.openstack.org/#/c/474269/10:22
bogdandoshardy, mandre: ^^10:22
shardybogdando: have we moved to ansible 2.4 now?  Last time I checked it was 2.3 and --modulepath didn't work10:24
shardyoh wait, you've moved to command10:24
bogdandoshardy: I'm using the command10:24
shardynm10:24
bogdandoI think it improves logging UX, we could follow up changes it needed10:25
shardybogdando: looks good, I'm just going to pull and test it locally10:25
bogdandoshardy: thanks!10:25
*** ckyriakidou has joined #tripleo10:25
bogdandokeep in mind, puppet logs will go to journalctl shardy10:25
*** cshastri has quit IRC10:26
bogdandoreworked openstack dynamic inventory for pre-provisioned nodes, now it uses shade https://review.openstack.org/#/c/463701/ PTAL10:28
bogdandoslagle: ^^ improves UX with traas and oooq :)10:28
sri_shardy: Hi I am trying to deploy overcloud with HA it's stable ocata release , getting into errors , here is output of openstack stack failures list --long overcloud - https://pastebin.com/A06tBTNJ10:29
*** udesale__ has quit IRC10:31
*** dsariel has joined #tripleo10:37
florianfHi all, I'd be more than grateful if anyone with a tiny bit of network foo (and core privileges ;-) ) could have a look at this patch today: https://review.openstack.org/#/c/341586/10:41
openstackgerritPrateek Arora proposed openstack/tripleo-common master: Run tempest containers  https://review.openstack.org/48035310:43
openstackgerritNuman Siddique proposed openstack/tripleo-heat-templates master: Support deploying OVN as container services  https://review.openstack.org/46886010:45
yolanda_hi shardy , can you review https://review.openstack.org/#/c/480137/ ? the dependency has merged10:48
*** bfournie has joined #tripleo10:51
*** bfournie has quit IRC10:52
*** bfournie has joined #tripleo10:52
gfidenteyolanda_ the failure in ha-oooq seems related, commented on the submission10:54
*** bkopilov has quit IRC10:59
prateekping numans, did you follow any set of pointers whule containerizing OVN ?11:01
numansprateek, hi11:01
prateeknumans, Hi !, i am asking because i need to containerize some thing myself11:02
yolanda_checking, the console log doesn't look very descriptive11:02
numansprateek, i basically looked into the existing containerized services and followed the same pattern11:02
prateeknumans, ok, thanks11:02
yolanda_gfidente, that's taking the latest tripleo-image-elements?11:03
numansprateek, also looked into the documents available11:03
numansprateek, let me know if you need more info11:03
prateeknumans, sure, ok11:03
prateekthanks11:03
yolanda_gfidente, shall i ask for a new package of tripleo-image-elements for newton? this job seems to be consuming that from package11:05
*** mburned_out is now known as mburned11:06
*** lucasagomes is now known as lucas-afk11:06
*** shardy is now known as shardy_lunch11:08
yolanda_gfidente, anyway, going to test in a vm to ensure that it fails as well, or is a problem with job or dependencies11:10
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016711:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Ben Nemec (bnemec)11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170225711:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1702257 in tripleo "VM's cannot have ssh key injected because can't access metadata service" [Critical,Triaged]11:10
gfidenteyolanda_ it is trying to install the package as expected11:11
gfidentebut for some reason it is failing11:11
yolanda_gfidente, but error may be that this element is not yet on the package, right?11:11
gfidentedid we have that package in rdo/newton?11:11
yolanda_this change was merged yesterday, what's the process for producing a new package for newton?11:11
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart master: Add support for openstack inventory provider  https://review.openstack.org/46370111:12
*** fzdarsky is now known as fzdarsky|lunch11:14
openstackgerritJaganathan Palanisamy proposed openstack/tripleo-heat-templates master: Workflow input parameter update in plan-environment  https://review.openstack.org/48052511:15
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart master: Add support for openstack inventory provider  https://review.openstack.org/46370111:16
gfidenteyolanda_ yeah it looks as if the version of tripleo-image-elements didn't include the newly added element yet11:17
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart master: Add support for openstack inventory provider  https://review.openstack.org/46370111:18
yolanda_gfidente, but latest package seems to be from today right? https://trunk.rdoproject.org/centos7-newton/current/openstack-tripleo-image-elements-5.3.1-0.20170705102249.e61376c.el7.centos.noarch.rpm11:18
yolanda_how can i get it refreshed?11:19
openstackgerritPrateek Arora proposed openstack/tripleo-common master: Run tempest containers  https://review.openstack.org/48035311:19
gfidenteyolanda_ I think the problem is that CI runned before the dependency was merged11:19
gfidentelet's just try a recheck11:19
*** jkilpatr has joined #tripleo11:19
yolanda_yep, hoping it's that11:19
gfidentein theory depends-on should have done that11:20
yolanda_well, depending on how the job is built. If that consumes just the package, and not building from source, depends won't help...11:20
*** dmacpher has quit IRC11:22
openstackgerritPrateek Arora proposed openstack/tripleo-common master: Run tempest containers  https://review.openstack.org/48035311:28
mandrehi prateek, I was about to comment on your change but I see you already fixed it yourself11:30
prateekmandre, thanks for looking into it11:30
sri_ hey all  Hi I am trying to deploy overcloud with HA it's stable ocata release , getting into errors , here is output of openstack stack failures list --long overcloud - https://pastebin.com/A06tBTNJ11:30
prateekmandre, is the purpose of the jinja file only comparing while testing or something else ?11:30
mandreprateek: btw, you're going to have a merge conflict very soon with that patch. Maybe the safer for you would be to rebase on top of Id15f7d95640c47640215edf09e7b99d2fd87325111:31
prateekmandre, sure , would do11:31
mandreprateek: this one https://review.openstack.org/#/c/47775211:31
*** atoth has joined #tripleo11:32
prateekmandre, i have some questions , do you have some bandwidth ?11:33
mandreprateek: not so much right now, will you still be around in 2 hours?11:34
prateeksure mandre , lets meet in 2 hours, i would send an invite11:34
*** dmacpher has joined #tripleo11:35
prateekmandre, we can have a Bluejeans if you are okay with it so that we are quickly done with it11:35
mandreprateek: sure!11:35
prateekthanks mandre11:35
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart master: Add support for openstack inventory provider  https://review.openstack.org/46370111:36
*** Guest7130 is now known as rook11:37
*** pgadiya has quit IRC11:38
owalshmandre: err any idea whats up with https://review.openstack.org/476153?11:41
mandreowalsh: that's a lot of red, that's what it is11:43
mandreowalsh: idk what's going on, I was about to look into it11:43
owalshmandre: http://logs.openstack.org/53/476153/11/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/cbe4400/logs/undercloud/home/jenkins/undercloud_install.log.txt.gz#_2017-07-05_09_15_4011:43
mhenkelshardy: would you mind taking a look into https://review.openstack.org/#/c/475048/ and https://review.openstack.org/#/c/475045/8 ?11:43
mandreowalsh: oh, so this may be a transient issue while rdo folks were working on the kolla packaging?11:45
owalshmandre: yea, I've a recheck running that isn't all red11:46
*** abishop has joined #tripleo11:46
mandreI've seen most recent jobs were green11:46
owalshmandre: OT are all of the docker images recent? I'm getting an error in CI that I think was resolved with new images in my local env11:51
*** ratailor has quit IRC11:52
mandreowalsh: I pushed a new batch of images this morning11:52
owalshmandre: hmm, ok, thanks, I'll keep digging, I must have modified something in my local env...11:53
openstackgerritKarthik S proposed openstack/os-net-config master: OvS 2.7 support - dpdk-devargs needs to provided for DPDK devices  https://review.openstack.org/48054011:54
*** pgadiya has joined #tripleo11:54
openstackgerritFlorian Fuchs proposed openstack/tripleo-validations master: Port the network environment validation  https://review.openstack.org/34158611:55
*** rlandy has joined #tripleo11:56
*** jpena is now known as jpena|lunch11:57
EmilienMgood morning11:57
mwhahahahi2u11:57
openstackgerritJaganathan Palanisamy proposed openstack/tripleo-heat-templates master: Workflow input parameter update in plan-environment  https://review.openstack.org/48052511:58
atotho/11:58
mandreowalsh: it's possible the new images are bad, let me know if you find something interesting11:59
*** bfournie has quit IRC12:00
sri_EmilienM: good morning , I am trying to deploy overcloud with HA I've running into some error can you please suggest me how to debug this, here is output of openstack stack failures list --long overcloud - https://pastebin.com/A06tBTNJ12:00
owalshmandre: I just found the problem - https://review.openstack.org/478919, must have forgotten to push the latest changes12:01
*** sbrzozow has joined #tripleo12:02
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates master: WIP: add service crontab containers  https://review.openstack.org/47891912:02
EmilienMsri_: I can't look now, in mtg12:03
*** morazi has joined #tripleo12:03
sri_EmilienM: understood12:04
*** lucas-afk is now known as lucasagomes12:08
*** liverpooler has joined #tripleo12:09
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016712:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Ben Nemec (bnemec)12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170225712:10
*** ooolpbot has quit IRC12:10
openstackLaunchpad bug 1702257 in tripleo "VM's cannot have ssh key injected because can't access metadata service" [Critical,Triaged]12:10
*** nyechiel has joined #tripleo12:11
*** pgadiya has quit IRC12:11
*** trown|pto is now known as trown12:13
skramajashardy_lunch: d0ugal: could you take a look at https://review.openstack.org/#/c/469596/. this patch invokes the derived parameters workflow. sample file at - https://github.com/openstack/tripleo-heat-templates/blob/master/plan-samples/plan-environment-derived-params.yaml#L1012:13
openstackgerritOr Idgar proposed openstack/tripleo-docs master: Post deployment installation instructions for Octavia  https://review.openstack.org/44749612:14
openstackgerritAlan Bishop proposed openstack/tripleo-common master: Derive deployment parameters for HCI  https://review.openstack.org/47146212:15
gfidenteany volunteer for https://review.openstack.org/#/c/467665/ ? relatively simple and all green12:15
*** noslzzp has joined #tripleo12:16
mwhahahasri_: it looks like the ordering is bad on that error, discover hosts is running before nova-db-sync so the columns are wrong12:17
*** fzdarsky|lunch is now known as fzdarsky12:18
sri_mwhahaha: ok is there anything I can do to fix that ?12:18
mwhahahasri_: it's probably a bug but we'd have to know the deployment configuration to be able to look into it further12:19
owalshmwhahaha: don't we change the order for upgrade?12:19
* owalsh forgets a lot of the gorey details12:20
mwhahahaowalsh: i don't think so, not for dbsync?12:20
mwhahahasri_: is this an upgrade?12:20
sri_mwhahaha: no it's fresh deploy12:20
*** toure|gone is now known as toure12:21
mwhahahasri_:     Error: /Stage[main]/Nova::Db::Sync/Exec[nova-db-sync]: Command exceeded timeout12:21
mwhahahasri_: i think the discover hosts still runs even if db-sync fails, try running with... (sec let me find the command)12:22
owalshmwhahaha: sigh, I just looked for that and missed it12:22
*** lmiccini has quit IRC12:22
mwhahahasri_: -e /usr/share/openstack-tripleo-heat-templates/environments/low-memory-usage.yaml12:22
mwhahahasri_: if you have slow disks (ie sata), the sync command can take a bit so that environment file will raise the timeout12:23
*** pgadiya has joined #tripleo12:23
*** ffiore has quit IRC12:23
* mwhahaha wanders off for a bit12:23
*** thrash|g0ne is now known as thrash12:23
sri_mwhahaha: in my setup all overcloud nodes are kvm virtual machine's with 3 controller 12 ram  and 3 compute 6gb ram12:23
mwhahahasri_: yea it has to do with the disk speed12:24
mwhahahasri_: what's the harddrive type?12:24
mwhahahaon the underlying hypervisor12:24
sri_mwhahaha: yes it's regular harddisks12:25
*** dprince has joined #tripleo12:26
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Add new role for tripleo-validations  https://review.openstack.org/40357612:26
mwhahahayea that's usually the problem, the quality of the disk does matter so if it's not server class you need to bump the timeout. it's a dev environment problem as real production should be on higher quality disks12:26
mwhahahasri_: try that environment file and see if that fixes it12:26
mwhahahasri_: alternatively you just need this set, https://github.com/openstack/tripleo-heat-templates/blob/master/environments/low-memory-usage.yaml#L2012:27
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart master: Add ability to run tripleo-validations tests  https://review.openstack.org/40373112:27
sri_mwhahaha: got it , thanks , I will try this12:27
*** vpickard has joined #tripleo12:29
gfidenteslagle :D12:30
gfidentewhile you're at it, this is its counter-part in puppet-tripleo https://review.openstack.org/#/c/46735912:30
gfidentethanks :D12:32
*** pgadiya has quit IRC12:33
*** rhallisey has joined #tripleo12:33
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: WIP: Support initramfs images in modify-image role  https://review.openstack.org/47989612:34
*** ansmith has joined #tripleo12:34
*** mdnadeem has quit IRC12:35
*** lmiccini has joined #tripleo12:35
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT REVIEW: test python agent update  https://review.openstack.org/48046812:36
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: WIP: Add support for updating initramfs images in CI  https://review.openstack.org/47990012:36
*** bfournie has joined #tripleo12:36
openstackgerritKarthik S proposed openstack/os-net-config master: OvS 2.7 support - dpdk-devargs needs to provided for DPDK devices  https://review.openstack.org/48054012:37
*** jayg|g0n3 is now known as jayg12:38
*** bkopilov has joined #tripleo12:40
*** shardy_lunch is now known as shardy12:41
*** sshnaidm has quit IRC12:44
*** chem`` is now known as chem12:44
*** jmelvin has joined #tripleo12:46
*** jpena|lunch is now known as jpena12:49
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Add new role for tripleo-validations  https://review.openstack.org/40357612:49
*** trown is now known as trown|brb12:55
*** amoralej is now known as amoralej|lunch12:57
*** Goneri has joined #tripleo12:58
*** skramaja has quit IRC12:59
openstackgerritiswarya vakati proposed openstack/tripleo-common master: Replaces uuid.uuid4 with uuidutils.generate_uuid()  https://review.openstack.org/48057113:00
jristbfournie: can you look at this? https://review.openstack.org/#/c/341586/13:02
bfourniejrist: yes, I'm currently reviewing13:03
jristbfournie++13:03
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: DO NOT MERGE: Test gathering facts on all steps in bm playbook  https://review.openstack.org/48057513:03
*** trown|brb is now known as trown13:05
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016713:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Ben Nemec (bnemec)13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170225713:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1702257 in tripleo "VM's cannot have ssh key injected because can't access metadata service" [Critical,Triaged]13:10
*** jkilpatr has quit IRC13:11
*** iranzo has quit IRC13:11
*** jkilpatr has joined #tripleo13:11
*** jayg is now known as jayg|g0n313:15
*** jayg|g0n3 is now known as jayg13:15
*** tzumainn has joined #tripleo13:16
*** jkilpatr has quit IRC13:17
numansEmilienM, Hi, regarding the scenario 4 OVN test job, we are hitting the same issue i.e ovs 2.6. We need ovs 2.7 for ocata repos. I will check with Alan pavec on this.13:18
EmilienMnumans: ack, thx for the update.13:18
*** salmankhan has quit IRC13:19
*** links has quit IRC13:24
*** agopi has joined #tripleo13:24
*** ffiore has joined #tripleo13:27
mhenkelshardy: thanks for the review13:28
*** eck`gone is now known as eck`13:28
*** zaneb has joined #tripleo13:29
shardymhenkel: np, will try to get to the other one shortly13:29
mhenkelone question: If you do that, you also don't need the AuthPortSSL -- does the same apply for AuthPortSSLPublic ?13:29
*** dsavineau has quit IRC13:29
mhenkele.g. if I get the protocol from endpointmap the public ssl port will be set automatically to 13000?13:29
prateekping mandre , can i please PM me your email id for the hangout ?13:30
*** jkilpatr has joined #tripleo13:30
mhenkelor does it only apply to the admin port?13:30
prateekmandre, s/i/you13:30
shardymhenkel: we have separate endpoints for KeystoneAdmin, KeystoneInternal and KeystonePublic13:30
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/network/endpoints/endpoint_map.yaml#L634313:30
*** dsavineau has joined #tripleo13:30
shardymhenkel: so you can pick the one you need, they might have ports/protocol configured differently13:31
*** ecerquei has joined #tripleo13:31
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/environments/ssl/tls-endpoints-public-dns.yaml13:32
shardymhenkel: e.g ^^13:32
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/environments/tls-everywhere-endpoints-dns.yaml13:32
*** gkadam has quit IRC13:33
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: Dump all deployment role_data files to a config dir  https://review.openstack.org/44422413:33
trownEmilienM: I see you +2 the patch for https://bugs.launchpad.net/tripleo/+bug/1701236 but mitaka is EOL... should we be adding conditionals for mitaka and liberty at this point?13:33
openstackLaunchpad bug 1701236 in tripleo "oooq pacameker config broken on mitaka" [Medium,In progress] - Assigned to Sofer Athlan-Guyot (sofer-athlan-guyot)13:33
shardymhenkel: if you refer to EndpointMap, you'll get the right value when any of the various *tls environments are enabled (at least for keystone and other services that are integrated with EndpointMap)13:33
EmilienMtrown: the thing is oooq is used downstream too, that's why my +213:33
EmilienMtrown: I agree we should set a limit13:34
trownEmilienM: right... but that is a slippery slope13:34
EmilienMlike do not implement complex conditionals13:34
trownEmilienM: that means we need to support every release ever in a single branch of oooq13:34
EmilienMtrown: yeah, I know :/13:34
trownEmilienM: that does not seem sustainable given we do not CI any of those releases13:34
mhenkelshardy: so it all depends on if tls  is enabled. Endpoint map will then deliver automatically the correct port and protocol values13:35
shardymhenkel: yup, that's the idea13:35
d0ugalshardy: is there a bug for the parameters thing? or would you mind opening one?13:35
shardyd0ugal: there isn't atm - I'm wondering if we should just go with the warn on deprecated patch from skramaja, although that's going to make a bit of a mess in the templates short term13:36
mhenkeli.e. by setting contrail::auth_port: {get_param: [EndpointMap, KeystoneAdmin, port] } I don't require contrail::auth_port_ssl: {get_param: AuthPortSSL } anymore13:36
shardyI can raise one though13:36
shardymhenkel: yes exactly13:36
d0ugalshardy: What about he GUI?13:36
shardyd0ugal: the patch already has a workflow to detect deprecated params13:37
d0ugalah13:37
d0ugalI guess I need to read it again more carefully13:37
EmilienMtrown: right13:37
shardymaybe that's enough, open to other ideas tho :)13:37
EmilienMchem: not sure you saw the discussion - would you be ok to abandon this patch regarding what we've said?13:38
gfidenteshardy so I can get the workflow to run taking config_settings13:38
gfidenteshardy but config_settings is per-role, while the workflows are not, on the assumption that ansible deals with the different roles from inventory13:39
trownEmilienM: chem I commented on the patch. I would be fine if it was just mitaka... need to do a last release which supports mitaka still for quickstart and extras13:39
trownEmilienM: chem but Liberty is too much13:39
EmilienMwfm13:40
*** atheurer has joined #tripleo13:40
shardygfidente: so we can pass a map of roles_data or config_settings for all roles?13:40
openstackgerritMerged openstack/tripleo-heat-templates master: Update NovaCompute to consume CephClientKey  https://review.openstack.org/46766513:40
gfidenteshardy "for all roles" >13:40
gfidenteI have that yes13:40
gfidentebut I might need to merge together ansible-related config settings emitted by different roles13:40
openstackgerritFlorian Fuchs proposed openstack/tripleo-validations master: Check repository availability  https://review.openstack.org/47700613:41
*** ffiore has quit IRC13:41
shardygfidente: merging per role data seems like something that should be handled by either the specific workflow or the playbook?13:41
shardyin general should we just pass all the data, then let the workflow do $whatever?13:42
gfidenteshardy so I thought about that, but then it means the workflow needs to get a list of enabled roles13:42
gfidenteand it's not built out ot the jinja tempaltes13:42
sri_@mwhahaha: I tried with low-memory-usage.yaml it seems I am still facing same issue this is the new logs https://pastebin.com/zupAFpCP13:42
shardygfidente: well it's the keys to the mapping we pass13:42
gfidenteshall I pass the roles as input to the workflow?13:42
gfidenteshardy ack, I can handle it in the workflow, that was my question13:43
gfidenteshardy I'll ping you when I have something ready13:43
shardygfidente: yup, sounds reasonable to me, thanks!13:43
gfidentetks13:43
mwhahahasri_: yea not sure what else to tell you, if that db sync takes >900 seconds that's really bad. on decent hardware it should take ~2013:44
sri_@mwhahaha: openstack overcloud deploy --templates --libvirt-type qemu --control-scale 3 --compute-scale 1 --compute-flavor compute --control-flavor control -e /usr/share/openstack-tripleo-heat-templates/environments/low-memory-usage.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/puppet-pacemaker.yaml --ntp-server 192.168.15.1613:45
EmilienMbnemec: when you get a chance, please look my last comment on https://bugs.launchpad.net/tripleo/+bug/170135713:45
openstackLaunchpad bug 1701357 in tripleo "No way to disable notifications from services" [High,Triaged]13:45
mwhahahasri_: yea it's an issue with your hardware setup, all you could try and do is raise the timeout to something like 1800 seconds but if it can't complete that sync i'm not sure how well the rest of the deploy is going to go13:46
openstackgerritJaganathan Palanisamy proposed openstack/tripleo-common master: CPU threads range format for derive parameters  https://review.openstack.org/48058713:46
sri_@mwhahaha: I tried without ha, it's works fine13:47
mwhahahasri_: i wonder if it's a galera problem13:47
* mwhahaha shrugs13:48
mwhahahawe don't hit this in CI which is why i point to it being a system config issue13:48
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Add role_data into workflow executions environment  https://review.openstack.org/47979013:49
*** sshnaidm has joined #tripleo13:49
sri_@mwhahaha: I understood I will try with 1800 seconds time out13:49
openstackgerritRob Crittenden proposed openstack/tripleo-common master: Add novajoin images  https://review.openstack.org/46707413:49
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Add featureset26 for scenario006  https://review.openstack.org/47851013:50
EmilienMflaper87: quick fyi: https://review.openstack.org/480590 - https://review.openstack.org/47851013:50
EmilienMsshnaidm: ^13:51
*** amoralej|lunch is now known as amoralej13:51
sri_@mwhahaha: I've also looked into all the undercloud I didn't find any error there13:51
bnemecEmilienM: Replied13:51
mwhahahasri_: are you just trying to do a pike deploy or do you have some custom stuff that you're trying to test?13:51
sri_@ I am using stable ocata release13:52
EmilienMbnemec: ok, I'll work on this bug this week and add an option to tripleo to disable notifications entirely13:53
mwhahahasri_: hmm ok i'm not aware of any changes to land around this issue other than providing the timeout config option. you might want to check the galera logs to see if there's anything pointing to some replication delays or something13:53
sshnaidmEmilienM, does 026 deploy ceph?13:53
EmilienMsshnaidm: no13:53
sshnaidmEmilienM, should be removed then from fs table13:54
bnemecEmilienM: Okay.  I'm happy to help with it too, but I wanted to get the bug opened ASAP since it's something we seem to be hitting in the field quite a bit.13:54
EmilienMsshnaidm: indeed13:54
bnemecAnd manually changing the configs is a terrible option.13:54
bnemec(which is what we did in rh1)13:54
sri_@mwhahaha: sure let me do that thank's13:54
flaper87EmilienM: will check soo, in a call :D13:56
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Add featureset26 for scenario006  https://review.openstack.org/47851013:56
EmilienMbnemec: I have an idea how to do it, I'll add you as reviewer13:57
flaper87EmilienM: jeeeeeez fs2613:57
EmilienMsshnaidm: ^ better?13:57
bnemecEmilienM: Sounds good.13:57
EmilienMflaper87: sorry if we have coverage :P13:57
openstackgerritMerged openstack/tripleo-heat-templates master: Adds docker OpenDaylight  https://review.openstack.org/46692013:57
ansiwenmandre: sorry, if I missed your answer to this question: how long does it take for the RDO rpm fix to land in the kolla images? are they rebuilt on a regular basis?13:57
*** udesale has joined #tripleo14:01
*** agurenko has quit IRC14:01
yolanda_gfidente, same failure... going to recheck and hold the node to see what's going on14:02
owalshansiwen: it was fixed when I ran a recheck earlier14:03
sshnaidmEmilienM, one more comment14:04
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates master: Add support for nova live/cold-migration with containers  https://review.openstack.org/47195614:08
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Add new role for tripleo-validations  https://review.openstack.org/40357614:10
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016714:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Ben Nemec (bnemec)14:10
*** pbandark1 has joined #tripleo14:10
*** limao has joined #tripleo14:10
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates master: WIP: add service crontab containers  https://review.openstack.org/47891914:11
openstackgerritMichael  Henkel proposed openstack/tripleo-heat-templates master: Contrail network realignement + DPDK enablement  https://review.openstack.org/47504814:12
*** pbandark has quit IRC14:12
*** pbandark1 is now known as pbandark14:12
mandreansiwen: hey! I've pushed new images this morning, the ec2-api image now has the oslo-cache package14:13
ansiwenmandre: cool, thanks14:13
ansiwenowalsh: thanks as well14:14
*** jaganathan has quit IRC14:14
*** eck` is now known as eck`gone14:15
sri_@mwhahaha: I didn't found anything in galera logs  [root@overcloud-controller-0 ~]# grep -i error /var/log/mariadb/mariadb.log  2017-07-05 13:10:35 139853883963584 [ERROR] mysqld: Server GSSAPI error (major 851968, minor 2529639093) : gss_acquire_cred failed -Unspecified GSS failure.  Minor code may provide more information. Keytab FILE:/etc/krb5.keytab is nonexistent or empty.14:16
openstackgerritJoe Talerico proposed openstack/tripleo-heat-templates master: Adding Tuned Service  https://review.openstack.org/45412314:16
mwhahahasri_: yea that's not related14:16
rookEmilienM shardy could I get eyes on ^^ ?14:17
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart-extras master: Change default libvirt-type to kvm  https://review.openstack.org/48060314:17
flaper87EmilienM: re http://logs.openstack.org/59/471759/11/experimental/gate-tripleo-ci-centos-7-scenario006-multinode-oooq-nv/e482034/logs/undercloud/home/jenkins/overcloud_deploy.log.txt.gz#_2017-07-04_16_39_4814:17
ansiwenmandre: so, that means it's a manual process for now?14:17
flaper87EmilienM: is there a way to see the value of service_ips in the gate?14:17
flaper87EmilienM: it's weird that kubernetes_master_... doesn't exist14:17
flaper87it might be that my role is wrong14:17
*** ckyriakidou has quit IRC14:18
sri_@mwhahaha: and this the logs in controller     sudo journalctl -u os-collect-config  -> 05 14:16:59 overcloud-controller-0 os-collect-config[2587]: /var/lib/os-collect-config/local-data not found. Skipping Jul 05 14:16:59 overcloud-controller-0 os-collect-config[2587]: No local metadata found (['/var/lib/os-collect-config/local-data'])14:18
*** ckyriakidou has joined #tripleo14:18
mwhahahasri_: also not related14:18
*** prateek has quit IRC14:18
*** eck`gone is now known as eck`14:18
honzarbrady: Hey, I added quite a bit of stuff to this patch since your last review.  Would you mind taking another look?  https://review.openstack.org/#/c/469196/14:20
*** karthiks has quit IRC14:20
*** iranzo has joined #tripleo14:21
*** iranzo has joined #tripleo14:21
sri_@mwhahaha: I will try with changing the  time out part , ControllerExtraConfig:       'nova::network::neutron::neutron_url_timeout': '120' is this where I updated the time out right ? in low-memory-usage.yaml !14:23
mwhahahasri_: no14:24
honzaflorianf: did you see the email about integration tests in the ui?  EmilienM suggested using tripleo-validations.  What do you think about that idea?  (surface level comments are fine)14:24
mwhahahasri_: DatabaseSyncTimeout: 90014:24
mwhahahasri_: thats the one to adjust14:24
sri_@mwhahaha: I can add DatabaseSyncTimeout: 900 under the ControllerExtraConfig: in ow-memory-usage.yaml ?14:26
mwhahahasri_: hmm let me see if that option got backported to ocata, forgot you're not on pike14:26
openstackgerritMichael  Henkel proposed openstack/puppet-tripleo master: Contrail: Fix controlplane/dataplane network asignments & enable optional dpdk  https://review.openstack.org/47504514:27
mhenkelshardy: I also adjusted the tripleo-puppet modules because of the port/protocol assignment change14:27
mwhahahasri_: so in ocata it didn't have that option. you can tweak the timeout by adding this custom hieradata for the contorller nodes https://github.com/openstack/tripleo-heat-templates/blob/2518394c2f45d5514946de962f8dfd13aa7c7377/puppet/services/nova-base.yaml#L222-L22314:28
mwhahahasri_: replacing {get_param: DatabaseSyncTimeout} with the appropriate value (900)14:28
mandreansiwen: yes, still manual14:28
yolanda_gfidente, i saw the problem... the environment.d directory for ironic-agent-multipath, ended in the wrong level... see http://git.openstack.org/cgit/openstack/tripleo-image-elements/tree/environment.d/10-ironic-agent-multipath.bash?h=stable/newton14:29
yolanda_going to fix it14:29
*** ratailor has joined #tripleo14:30
sri_@mwhahaha: ok let me do that14:30
*** chlong_ has joined #tripleo14:30
*** limao has quit IRC14:31
*** iranzo has quit IRC14:32
openstackgerrityolanda.robla proposed openstack/tripleo-image-elements stable/newton: Fix environment.d path for ironic-agent-multipath  https://review.openstack.org/48061414:32
*** prateek has joined #tripleo14:34
yolanda_gfidente, and others... https://review.openstack.org/#/c/480614/14:35
*** itzikb has joined #tripleo14:38
flaper87eck`: btw, taking tomorrow and Friday off. Feel free to hack on the featureset if you have time14:39
itzikbEmilienM: hi, regarding https://review.openstack.org/#/c/480527/1/manifests/plugins/ovs/opendaylight.pp. so you are suggesting to remove setting the variables odl_username and odl_password?14:40
florianfhonza: Just read it. I like the idea of using ansible. Just not sure the tests should live in the tripleo-validations repository. The would show up along the other validations (in the ui), which is a bit strange IMO, since that's pretty different to what the other validations do. That said, the ansible inventory in tripleo-validations lives in /usr/bin/tripleo-ansible-validations and is already being used by playbooks outside of14:41
florianf tripleo-validations. So we could use the tripleo-ansible-inventory (for things like looking up the service catalog etc), but host the playbooks inside of tripleo-ui or somewhere else. what do you think?14:41
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test  https://review.openstack.org/47574714:42
florianf*They would show up14:42
dmsimardsshnaidm: hey, I looked at your graphite stuff properly now14:46
sshnaidmdmsimard, hi14:46
dmsimardsshnaidm: first of all, great work14:46
dmsimardsshnaidm: I think it should be properly implemented in upstream ara -- but now that I think about it, it should be added as a native "publishing" driver14:47
*** dmacpher has quit IRC14:47
*** snecklifter has joined #tripleo14:47
sshnaidmdmsimard, yeah, agree it should be in ara..14:48
dmsimardsshnaidm: we're eventually going to add something like "drivers" for collection and publishing14:48
honzaflorianf: I think I like the idea of using tripleo-validations better than tempest since we (ie you) already have the expertise with ansible, and we (ie I) would have to learn how to use tempest :)14:48
dmsimardsshnaidm: for example, upstream zuul ansible will drop ansible tasks in mqtt and ara should be able to pick up things from there through a driver14:48
florianfhonza: both seem like good reasons! :-)14:48
chandankumarsorry honza anything i can help with tempest?14:49
florianfhonza: a third good reason: you'd have the opportunity to play with ansible (if you like to)14:49
florianf:-)14:49
honzaflorianf: so we'll need to create a new project which will be use ansible + tripleo-validations14:49
honzaflorianf: yes and yes :)14:49
honzachandankumar: thanks for the offer!14:50
honzaflorianf: but of course, there is this big problem now... the name14:50
florianfhonza: yeah, as soon as tripleo-validations are installed, the inventory is available as /usr/bin/tripleo-ansible-inventory. (In fact that inventory might end up being moved to tripleo-common at some point).14:51
florianfhonza: So once the undercloud has been installed, the playbooks to test the UI don't need to worry about tripleo-validations (or wherever the inventory might originate from in the future)14:52
flaper87eck`: that was for EmilienM14:53
flaper87EmilienM: btw, taking tomorrow and Friday off. Feel free to hack on the featureset if you have time14:53
eck`flaper87: i deciphered that ;)14:54
honzaflorianf: so, the inventory gives us access to the other openstack services?  sorry not too familiar14:57
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: Use repo-setup when injecting repos  https://review.openstack.org/46463614:57
*** samdoran has joined #tripleo14:59
florianfhonza: sorry, should have explained that better. yes, the inventory gives access to things like the auth url and token, current plan name, template files etc. Data that can be used in the playbooks.14:59
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Add featureset26 for scenario006  https://review.openstack.org/47851015:00
EmilienMsshnaidm: done^15:00
EmilienMflaper87: ack, I'll look at it when I can15:00
openstackgerritMichael Bayer proposed openstack/puppet-tripleo master: Add option for innodb_flush_log_at_trx_commit = 2 for Galera only  https://review.openstack.org/47984915:00
*** Goneri has quit IRC15:01
sri_@mwhahaha: I've added the two lines to nova-base.yml when run the deploy I got this error15:01
EmilienMflaper87: re: service_ips - maybe somewhere in the logs when showing heat resources15:01
sri_@mwhahaha:  Failed to validate: : resources.ComputeServiceChain: : Failed to validate nested template: Failed to validate: resources[7]: Error parsing template: while scanning for the next token\nfound character \'\\t\' that cannot start any token\n  in "<unicode string>", line 201, column 1:\n    \t  nova::db::sync::db_sync_timeo ... \n    ^',  u'status': u'FAILED'}15:01
openstackgerritMerged openstack/tripleo-quickstart-extras master: Install tempest plugins only for newton  https://review.openstack.org/47977215:01
mwhahahasri_: when you added it you used tabs15:01
honzaflorianf: ok, cool, this sounds like a good plan --- any ideas about a name?  how do we go about requesting github/gerrit/etc?15:01
*** dpivonka has quit IRC15:01
mwhahahasri_: you need to use only spaces15:01
honzaflorianf: maybe i should ask this on the mailing list15:02
sri_@mwhahaha: got it15:02
*** dmacpher has joined #tripleo15:02
florianfhonza: yeah, not sure how to set up a new project, tbh...15:03
florianfhonza: re the name: tripleo-ui-tests would be obvious, but also a bit boring15:03
florianfhonza: tripleo-scr-ui-tinizer ?15:04
honzaflorianf: LMAO15:04
florianf:-)15:04
EmilienMrook: ack, will look at it15:05
honzaflorianf: tripleo-ui-ci?  where else could this be used?15:05
EmilienMhonza: I would prefer to see some efforts arounds a tempest plugin, tbh15:05
honzaEmilienM: how come?15:05
EmilienMI would not like to see us writting tests for TripleO UI in a repo dedicated for CI15:06
EmilienMas a user, I would like to be able to run the tests outside CI15:06
EmilienMwe already have tests for OpenStack with Tempest (Horizon included), why not having a tempest plugin15:06
*** dpawar has quit IRC15:06
EmilienMif a Tempest plugin isn't possible for some reasons (python, etc) - we could have functional tests in tree, that we would run from a script for example15:07
honzaEmilienM: I agree about running tests outside CI.  In either scenario, it means a dedicated testing repo.15:08
EmilienMhonza: for sure15:08
EmilienMhonza: just don't call it -ci :)15:08
honzaEmilienM: We already have in-tree tests (javascript) but we need integration tests (to interact with undercloud)15:09
honzaEmilienM: sorry, that was a dumb name :)15:09
EmilienMitzikb: yes, make the params without default values like it's the case for some other modules already15:09
sri_@mwhahaha: thank you very much for your help  , if  it fails this time I will redo my environment :)15:09
honzaEmilienM: we have a resident expert on ansible on our team, and i don't know if anyone knows tempest15:09
sri_dev enviroment**15:10
honzaEmilienM: what does tempest give us over ansible?15:10
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016715:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Ben Nemec (bnemec)15:10
*** ooolpbot has quit IRC15:10
itzikbEmilienM: ok, thanks. I also will need to change the heat template , right?15:10
*** dmacpher has quit IRC15:10
*** anshul has quit IRC15:11
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test  https://review.openstack.org/47574715:11
EmilienMitzikb: in ODL templates, you'll have to override the username / password parameters that's all15:11
itzikbEmilienM: If I understand correcly I'll need to add neutron::plugins::ovs::opendaylight::odl_user {get_param: OpenDaylightUsername} and the same for password15:12
sshnaidmEmilienM, +215:12
EmilienMsshnaidm: thanks15:12
EmilienMitzikb: exactly15:13
openstackgerritCarlos Camacho proposed openstack-infra/tripleo-ci master: Enable the HA deployment by default  https://review.openstack.org/41517915:13
sshnaidmEmilienM, can you re-review it in your time? https://review.openstack.org/#/c/478924/15:13
itzikbEmilienM: great. thanks a lot for helping15:13
EmilienMsshnaidm: sure thing15:13
EmilienMitzikb: anytime15:13
EmilienMhonza: tempest is more designed for testing than ansible is. We use Ansible to validate things in TripleO but for real functional tests, I think Tempest is the real choice in OpenStack...15:14
*** bkopilov has quit IRC15:14
*** dpivonka has joined #tripleo15:14
EmilienMhonza: because we already use Tempest for functional tests in OpenStack I'm not convainced that using Ansible would really help for consistency15:14
*** pliu has quit IRC15:16
*** liupe__ has quit IRC15:16
*** iranzo has joined #tripleo15:17
*** iranzo has joined #tripleo15:17
*** yamahata has joined #tripleo15:18
*** udesale has quit IRC15:18
*** cylopez has joined #tripleo15:19
*** rcernin has quit IRC15:21
*** chlong has joined #tripleo15:23
*** dmacpher has joined #tripleo15:24
openstackgerritFrank A. Zdarsky proposed openstack/tripleo-validations master: Add jsonschema validation for os-net-config data  https://review.openstack.org/35134515:25
*** chlong has quit IRC15:26
*** ramishra has quit IRC15:28
*** ratailor has quit IRC15:31
*** janki has quit IRC15:31
*** oidgar has quit IRC15:32
*** dpivonka has quit IRC15:34
*** itzikb has quit IRC15:36
*** psachin has quit IRC15:37
EmilienMsshnaidm: tripleo CI promotion is broken15:38
EmilienMhttp://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-scenario001-multinode-oooq/4590f2f/logs/undercloud/home/jenkins/undercloud_install.log.txt.gz#_2017-07-05_06_16_0915:38
EmilienMit's kolla related15:38
EmilienMmandre: can you help please?15:38
*** dixiaoli has joined #tripleo15:39
mandreEmilienM: it's linked to the transition from python-docker-py to python-docker15:39
EmilienMand it broke us15:39
mandreEmilienM: they were discussing it in #rdo all day15:39
EmilienMI haven't seen a bug in Launchpad, I'll create it and alert here15:40
EmilienMunless it's fixed?15:40
*** bkopilov has joined #tripleo15:40
mandreEmilienM: it may be fixed already, because the latest jobs I've seen were green15:41
EmilienMmandre: it wasn't promotion pipeline15:42
EmilienMmandre: I'm not talking about the gate15:42
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates master: WIP: Remove package if service stopped and disabled  https://review.openstack.org/47988615:43
*** dixiaoli has quit IRC15:44
mandreEmilienM: in my understanding all the jobs were affected15:44
*** fragatina has joined #tripleo15:45
*** prateek has quit IRC15:45
EmilienMmandre: ok so the problem might be fixed now, good news15:46
EmilienMsshnaidm: can we manually run promotion jobs now?15:46
mariosEmilienM: o/ i answered your question on https://review.openstack.org/#/c/478920/ when you get a chance thanks15:47
*** jfrancoa has quit IRC15:47
*** dpivonka has joined #tripleo15:47
*** achadha has joined #tripleo15:47
EmilienMmarios: approved - thanks for the replies and I'm glad you guys have a plan15:48
EmilienMmarios: also I triaged https://blueprints.launchpad.net/tripleo/+spec/pre-upgrade-validations15:49
EmilienMflorianf, marios: really cool work15:49
florianfEmilienM: thanks! :-)15:50
*** ebarrera has quit IRC15:50
*** trown is now known as trown|lunch15:50
*** iranzo has quit IRC15:52
*** achadha has quit IRC15:53
chandankumarEmilienM: please have a look on https://review.openstack.org/#/c/480429/ ping test tempest scenario test, when you are free, Thanks :-)15:53
EmilienMchandankumar: woot. Looking now15:53
openstackgerritMerged openstack/tripleo-docs master: Adds docs about the pre-upgrade validations  https://review.openstack.org/47892015:53
mariosEmilienM: florianf thanks15:55
EmilienMchandankumar: in which CI job your code has been tested?15:55
*** funzo has joined #tripleo15:56
sri_@mwhahaha: it worked :)15:58
*** bfournie has quit IRC15:58
*** chlong_ has quit IRC15:58
mwhahahasri_: sounds good, might want to upgrade your harddrive in your environment at some point :D15:59
sri_mwhahaha: sure thanks, this is test/dev  environment16:00
EmilienMpanda, weshay, sshnaidm: it would be great to have an html page like http://logs.openstack.org/29/480429/1/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/76071e1/logs/ where we can easily click and go into the important directories like undercloud/home/jenkins/ etc16:01
weshayEmilienM, agree.. adarazs was suppose to have that done16:01
EmilienMchandankumar: I've checked all tempest jobs running in your patch and none of them is actually running the test you wrote, so how can we tell your code actually works?16:01
EmilienMweshay: where is it tracked?16:01
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test  https://review.openstack.org/47574716:02
*** egonzalez has quit IRC16:03
*** marios has quit IRC16:03
weshayEmilienM, the card was archived, bringing it back https://trello.com/c/tUPBXtdD/170-q-to-u-create-a-toc-for-the-logs-created-upstream-in-a-readmelogs16:03
*** Goneri has joined #tripleo16:04
*** dsariel has quit IRC16:04
*** fragatina has quit IRC16:04
EmilienMweshay: probably Medium in priorities - I honestly think we should work on it to increase the ease of debugging TripleO CI16:05
EmilienMweshay: quite often I hear folks asking where to look when things fail16:05
EmilienMhaving short guidelines in this web page would help a lot imho16:05
*** coolsvap has joined #tripleo16:06
ansiwenowalsh: you know puppet way better than me, can you tell me, if this problem is related to my patch? http://logs.openstack.org/89/480289/5/check/gate-puppet-nova-puppet-unit-latest-centos-7/184d28f/console.html16:06
weshayEmilienM, yes.. I think if folks knew to look at /home/stack/failed_list it would be easier for them16:06
*** ykarel has quit IRC16:06
weshayEmilienM, tracking requirements in that trello card16:07
ansiwenowalsh: weirdly unit-4.5-centos-7 succeeded16:07
owalshansiwen: that's non-voting so I assume it's flaky/broken. Did you ask on #puppet-openstack?16:08
*** hjensas has quit IRC16:09
*** dmacpher has quit IRC16:09
weshayarxcruz, ping any additional bugs coming for the remaining 8 failing tempest tests?16:09
ansiwenowalsh: ahh, right, wrong channel16:09
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016716:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Ben Nemec (bnemec)16:10
*** jprovazn has joined #tripleo16:12
*** lucasagomes is now known as lucas-afk16:12
mwhahahaansiwen: fyi, i have a feeling that's unrelated16:14
*** chlong_ has joined #tripleo16:14
ansiwenmwhahaha: ok, thanks for confirming16:14
openstackgerritOliver Walsh proposed openstack/puppet-tripleo master: Disable libvirtd polkit auth  https://review.openstack.org/47981616:19
arxcruzweshay: hey, no, not today on periodic job :)16:20
chandankumarEmilienM: i was afk, there is no such job in ci which tests it16:20
*** akrivoka has joined #tripleo16:20
chandankumarEmilienM: let me try with featureset if we can test it in tripleo ci16:21
EmilienMchandankumar: in tempest gate I meant16:21
*** athomas has quit IRC16:21
*** dmacpher has joined #tripleo16:23
*** achadha_ has joined #tripleo16:26
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Deploy Mistral with Keystone v3 options (authtoken)  https://review.openstack.org/46104016:26
openstackgerritOliver Walsh proposed openstack/puppet-tripleo master: Disable libvirtd polkit auth  https://review.openstack.org/47981616:27
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Remove deprecated controllerExtraConfig parameter  https://review.openstack.org/48027016:30
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Add NodeTLSData to generic role.role.j2.yaml  https://review.openstack.org/48027116:30
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Modify generic role template to support custom networks  https://review.openstack.org/46985416:30
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Convert controller-role.yaml to role.role.j2.yaml  https://review.openstack.org/48027216:30
shardyHey all can I get a second +2A on https://review.openstack.org/#/c/480210/ please?16:31
shardyfixes the Networker role16:31
pandaSlower: ping16:31
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Add NodeTLSData to generic role.role.j2.yaml  https://review.openstack.org/48027116:34
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Convert controller-role.yaml to role.role.j2.yaml  https://review.openstack.org/48027216:34
chandankumarEmilienM: http://logs.openstack.org/29/480429/1/check/gate-tempest-dsvm-neutron-scenario-multinode-lvm-multibackend-ubuntu-xenial-nv/3361e4f/logs/testr_results.html.gz16:34
*** bfournie has joined #tripleo16:34
chandankumarEmilienM: gate-tempest-dsvm-neutron-scenario-multinode-lvm-multibackend-ubuntu-xenial-nv this job is running the test.16:34
bnemecshardy: Done16:35
shardybnemec: thanks!16:35
*** achadha_ has quit IRC16:35
EmilienMchandankumar: indeed, test_boot_volume_network_connectivity[compute,id-308e4097-4083-4181-b2bd-ccce1b2bfe01,image,network,slow,volume]16:36
EmilienMchandankumar: good work, +116:36
*** achadha has joined #tripleo16:36
chandankumarEmilienM: my question is do we need to include ssh to instance also?16:36
*** fragatina has joined #tripleo16:38
EmilienMchandankumar: probably better, no?16:38
dhill_EmilienM, would you know if we can reuse an index value when removing/readding a compute node?16:38
chandankumarEmilienM: ok, Next question is how we are planning to extend ping test for other service so that we can run against each patchset? i mean increasing test coverage16:40
EmilienMdhill_: I never tried tbh16:41
EmilienMchandankumar: run other scenarios or/and api tests16:41
*** trown|lunch is now known as trown16:41
chandankumarEmilienM: but people say tempest takes time when runned against each review16:41
Slowerpanda: heya16:42
chandankumar*tempest=> i mean scenario and api tests16:43
pandaSlower: re: your script, https://github.com/imain/container-check/blob/master/container-check.py#L135 is hardcoding yum config dir.16:45
*** snecklifter has quit IRC16:45
*** dsariel has joined #tripleo16:45
chandankumarEmilienM: one more question, since ping test uses heat to do all the stuff but in this ported scenario test we are missing heat16:45
*** florianf has quit IRC16:45
bnemecdhill_: No, you can't.  You _can_ name the new node with the same index, but that requires you to be doing predictable hostnames.16:45
chandankumarso might be we need a new scenario test in heat plugin to replicate the same?16:45
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart-extras master: WIP: enable containers periodic job  https://review.openstack.org/47574516:46
*** akrivoka has quit IRC16:47
openstackgerritAna Krivokapic proposed openstack/tripleo-ui master: Add plan description to plan cards  https://review.openstack.org/47940416:49
*** akrivoka has joined #tripleo16:49
EmilienMchandankumar: not a problem, we have tempest tests for heat16:50
Slowerpanda: hrrm, lemme look16:50
EmilienMchandankumar: there are tempest coverage for all our needs even more... so no worries16:50
*** dpawar has joined #tripleo16:50
Slowerpanda: I thought htat's what you wanted?16:51
chandankumarEmilienM: so next plan is how to use these tests effectively in ci16:51
SlowerI'm only mounting repos.d/ I wonder if I need to mount more?16:51
EmilienMchandankumar: you got it16:51
* chandankumar has no clue how to do it.16:52
Slower /etc/yum.conf?16:52
pandaSlower: my local test fails with OSError: [Errno 2] No such file or directory: 'var/lib/rpm/Packages'16:52
Slowerpanda: this is inside the container?16:53
pandaSlower: this is on the undercloud ... maybe I don't know how to launch your script ?16:53
Slowerah ok16:54
Slowerno I see it16:54
*** achadha_ has joined #tripleo16:54
*** achadha_ has quit IRC16:54
*** itlinux has joined #tripleo16:54
Slowerpanda: I just pushed a change, try that16:55
itlinuxhello all.. I got a strange problem with IPMI when running the tool to check the overcloud http://paste.openstack.org/show/614479/16:55
itlinuxany anyone suggest a fix or how to get this passed?16:55
*** akrivoka has quit IRC16:55
*** achadha_ has joined #tripleo16:55
EmilienMchandankumar: you might want to get some help from arxcruz or sshnaidm on this side16:56
*** achadha has quit IRC16:57
pandaSlower: it's crunching rpms, I'll keep you posted.16:58
Slowerok16:58
*** achadha has joined #tripleo16:58
*** hjensas has joined #tripleo17:00
*** hjensas has quit IRC17:00
*** hjensas has joined #tripleo17:00
arxcruzweshay: EmilienM: chandankumar probably tomorrow we will have a good tempest result in the periodic job, I'll monitor and investigate all the tests. Once we have a stable environment, we can move to the next step :)17:01
*** achadha_ has quit IRC17:02
EmilienMarxcruz: wfm17:03
*** yamahata has quit IRC17:03
*** fragatin_ has joined #tripleo17:04
openstackgerritBen Nemec proposed openstack/tripleo-heat-templates master: Add environment for setting a custom domain name  https://review.openstack.org/47621917:06
*** fragatina has quit IRC17:07
*** ykarel has joined #tripleo17:08
*** akrivoka has joined #tripleo17:08
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016717:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Ben Nemec (bnemec)17:10
*** jpich has quit IRC17:12
*** jpena is now known as jpena|off17:17
*** amoralej is now known as amoralej|off17:20
*** chlong_ has quit IRC17:21
itlinuxhello all has anyone seen this "Exception registering nodes: Invalid node data: unknown pm_type (ironic driver to use): ipmi"17:26
itlinuxwhat could be the workaround.. TY17:27
cmysteritlinux: yes, you need to make sure that the instacenv.json is up to date17:27
cmysterssh was deprocated and such17:28
itlinuxI just build the insteacenv file..17:28
cmysterI can't remember what else you need to edit, I did it a few weeks a go17:28
*** lmiccini has quit IRC17:28
itlinuxhere it is.17:28
*** panda is now known as panda|bbl17:28
itlinuxhttp://paste.openstack.org/show/614485/17:29
*** dpawar has quit IRC17:29
itlinuxany suggestions cmyster:17:29
itlinuxthanks17:29
cmysteritlinux: try with  "pm_type": "pxe_ipmitool",17:30
itlinuxthat failed.. I will try again and see..17:30
*** fragatin_ has quit IRC17:31
openstackgerritBrad P. Crochet proposed openstack/instack-undercloud master: Enable mistral mod_wsgi in undercloud  https://review.openstack.org/45848217:31
itlinuxException registering nodes: unhashable type: 'list'17:31
*** fragatina has joined #tripleo17:32
*** bogdando has quit IRC17:32
*** chlong_ has joined #tripleo17:33
*** nyechiel has quit IRC17:33
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Revert "Revert "Blacklist support for ExtraConfig""  https://review.openstack.org/47754217:38
cmysteritlinux: no idea. here is something that workd for me when I test stuff http://paste.openstack.org/show/614488/17:38
*** dsariel has quit IRC17:39
itlinuxthanks17:39
itlinuxI think I need to change the mac to : instead of the full mac17:39
itlinuxthanks17:39
itlinuxthanks for sharing cmyster:17:39
cmysterNP hope it helps in any way17:40
*** yamahata has joined #tripleo17:40
cmysteritlinux: note that I am creating those pm_ports with vbmc if you wonder what those ports are17:40
cmysterand with that in mind, nn17:41
*** akrivoka has quit IRC17:44
itlinuxthanks I see that..17:44
openstackgerritJames Slagle proposed openstack/tripleo-docs master: Additional docs for using deployed servers  https://review.openstack.org/46065217:45
*** gkadam has joined #tripleo17:48
*** akrivoka has joined #tripleo17:54
rookEmilienM: Thanks!17:57
*** achadha has quit IRC18:04
*** achadha has joined #tripleo18:06
*** rwsu has quit IRC18:08
*** rwsu has joined #tripleo18:09
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016718:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Ben Nemec (bnemec)18:10
*** ooolpbot has quit IRC18:10
*** pliu has joined #tripleo18:12
*** liupe__ has joined #tripleo18:12
*** suuuper has quit IRC18:13
*** coolsvap has quit IRC18:15
*** liupe__ has quit IRC18:17
*** pliu has quit IRC18:17
*** gkadam has quit IRC18:19
*** achadha has quit IRC18:19
*** yamahata has quit IRC18:20
ykarelEmilienM, ping18:20
*** yamahata has joined #tripleo18:20
ykarelI Commented on https://review.openstack.org/#/c/48051218:20
*** dmacpher has quit IRC18:20
*** rlandy is now known as rlandy|brb18:21
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart-extras master: Use updated multi-nic configs in THT  https://review.openstack.org/48069718:27
*** ebarrera has joined #tripleo18:27
*** achadha has joined #tripleo18:28
EmilienMykarel: can't we backport a patch from master to solve the issue18:28
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: Change default network isolation type to multi-nic  https://review.openstack.org/47536318:28
*** jprovazn has quit IRC18:30
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: Test the example nic configs we actually ship  https://review.openstack.org/47670418:30
ykarelEmilienM, I think there is no single patch that would be work, may be multiple cherry-pick would work18:31
ykareli will look into it, one is: https://review.openstack.org/#/c/382861/18:31
EmilienMykarel: I wouldn't be against a git squash of cherry-picks18:31
EmilienMykarel: it makes things easier to understand when looking at git history18:31
EmilienMinstead of ninja patching stable branches.18:32
ykarelEmilienM, Ok18:32
*** dmacpher has joined #tripleo18:33
EmilienMykarel: thank you18:33
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Rename CongressApi to Congress (docker)  https://review.openstack.org/47669218:33
dhill_bnemec, thanks18:35
*** idlemind has quit IRC18:36
ykarelEmilienM, the second patch is https://review.openstack.org/#/c/382351/,18:36
ykarelbut this has some extra stuff that is not required in newton18:37
*** idlemind has joined #tripleo18:37
EmilienMykarel: you could squash and edit maybe?18:38
dhill_bnemec, can you switch from unpredicatable hostname to predictable hostname once it's deployed? :)18:38
ykarelEmilienM, Ok will do that tomorrow, Thanks18:38
*** rlandy|brb is now known as rlandy18:39
bnemecdhill_: You can, and I believe you can even map only the new node if you want (although then you'll end up with a discontinuity if you subsequently scale up without also adding entries for the new nodes).18:40
dhill_bnemec, but that'd be in heat only?18:41
bnemecdhill_: Oh, and depending on your node name format you may have issues with the mapping.  For example, a "compute-1" mapping matches both "compute-1" and "compute-11".18:42
dhill_bnemec, yeah18:42
dhill_bnemec, I think I've opened like 2 BZs for that ;)18:42
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Support configurable Zaqar backends  https://review.openstack.org/47755918:42
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Drop MongoDB from the undercloud  https://review.openstack.org/47756218:42
bnemecdhill_: No, new nodes would be assigned names based on the internal heat numbering.18:42
bnemecdhill_: So if you have compute-1, 2, and 3, and you replace 2, you'd have to map the new node 4 to 2.18:43
dhill_bnemec, yes but if you map the new node index name to -1 , you can keep your continuity albeit your heat names will never match the one on the nodes18:43
dhill_bnemec, exact18:43
bnemecdhill_: Yeah, that should work fine.18:43
dhill_and if you add 5, it'd be 6 instead18:43
bnemecRight.18:44
dhill_that blows18:44
dhill_:)18:44
openstackgerritJames Slagle proposed openstack/tripleo-docs master: Add documentation for split-stack  https://review.openstack.org/46187118:44
dhill_bnemec, and you could reuse the same IP for that node?18:46
bnemecdhill_: Yes18:46
bnemecdhill_: Although that requires you to go full predictable IPs for that role.18:47
dhill_bnemec, so basically, you'd leave the IP for node5 at rank 5 and add it to 6 ?18:47
dhill_bnemec, like 10.0.0.1 10.0.0.2 10.0.0.3 10.0.0.4 10.0.0.5 10.0.0.5 ?18:47
*** rcernin has joined #tripleo18:48
dhill_bnemec, or you simply remove it?18:48
bnemecdhill_: Yeah.  One useful thing I'm aware of is to add the sixth IP, but change the fifth one to a marker value like "UNUSED" so it's clear which have been replaced.18:48
dhill_bnemec, I think I saw that in a BZ ..18:48
dhill_hehe18:48
bnemecdhill_: No, it's index-based so you can only ever add to it.18:48
dhill_bnemec, ok18:48
bnemecYeah, I borrowed the idea from one of our field people who suggested it. :-)18:49
*** dmacpher has quit IRC18:49
dhill_bnemec, that's great ... I hope we won't blow their environment up18:49
bnemecdhill_: It should work.  I tested basically this exact process in OSP 8 not too long ago.18:50
bnemecAlthough for the IP thing it is a little tricky because you need to make sure the IP lists match exactly what was already deployed.18:50
*** trown is now known as trown|mtg18:51
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Add DeployedServerEnvironmentOutput  https://review.openstack.org/46139918:52
dhill_bnemec, yeah I'm used to "don't do any typos" sort of things18:53
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci master: Conditional nodepool logic  https://review.openstack.org/46339218:54
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci master: Support passing in $EXTRA_VARS  https://review.openstack.org/46339318:54
openstackgerritMichael Bayer proposed openstack/puppet-tripleo master: Add option for innodb_flush_log_at_trx_commit = 2 for Galera only  https://review.openstack.org/47984918:59
*** dmacpher has joined #tripleo19:02
panda|bblSlower: is there a way to specify the use of images from the local docker registry19:06
panda|bblSlower: the script pulled the images from dockerhub ...19:07
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Support configurable Zaqar backends  https://review.openstack.org/47755919:07
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Drop MongoDB from the undercloud  https://review.openstack.org/47756219:07
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016719:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Ben Nemec (bnemec)19:10
dhill_bnemec, thank ;you :)19:11
*** chlong_ has quit IRC19:14
*** dmacpher has quit IRC19:17
itlinuxhi guys I wonder about this status looks like it takes a while to do the introspect am I missing something? Waiting for introspection to finish..19:20
*** sai-pto is now known as sai19:20
*** ykarel has quit IRC19:21
*** gfidente is now known as gfidente|afk19:22
*** atoth has quit IRC19:27
*** chlong_ has joined #tripleo19:29
*** dmacpher has joined #tripleo19:30
*** ckyriakidou has quit IRC19:33
openstackgerritAna Krivokapic proposed openstack/tripleo-docs master: Document how to export deployment plans  https://review.openstack.org/48071119:38
honzabrace yourselves, the emails are coming19:39
Ngdprince: got a sec for a quick question?19:42
openstackgerritMerged openstack/tripleo-common master: Upgrade from docker-py to docker  https://review.openstack.org/47593519:43
openstackgerritMerged openstack/tripleo-common master: Updated from global requirements  https://review.openstack.org/47869919:43
Ngdprince: specifically about storage for docker - are we doing anything fancy in that area, or just using whatever the defaults are (so probably sparse files via loopback devices)?19:43
openstackgerritMerged openstack/tripleo-common master: Configure ceph clients with ceph-ansible  https://review.openstack.org/47992519:43
openstackgerritMerged openstack/puppet-tripleo master: Update puppet-tripleo libvirt to support docker deployments  https://review.openstack.org/46735919:43
Ngdprince: (like I know Atomic uses most of its disk space at install time to set up an LVM backend for docker, but I'm guessing that's not something that tripleo can reasonably be expected to take care of)19:44
openstackgerritMerged openstack/tripleo-image-elements master: Use /etc/os-net-config/element_config.json  https://review.openstack.org/47001419:44
*** nyechiel has joined #tripleo19:47
openstackgerritGonéri Le Bouder proposed openstack/tripleo-heat-templates stable/newton: cisco nexus: keep OVS on the Compute  https://review.openstack.org/48071419:48
*** panda|bbl is now known as panda19:51
openstackgerritGonéri Le Bouder proposed openstack/tripleo-heat-templates stable/ocata: cisco nexus: keep OVS on the Compute  https://review.openstack.org/48071719:52
*** snecklifter has joined #tripleo19:53
*** chlong_ has quit IRC19:55
*** tesseract has quit IRC19:56
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test  https://review.openstack.org/47574720:00
*** trown|mtg is now known as trown20:03
*** sbrzozow has quit IRC20:03
*** cylopez has quit IRC20:04
*** cylopez has joined #tripleo20:05
*** rcernin has quit IRC20:05
dprinceNg: we started using overlay2 a few months ago20:06
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016720:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Ben Nemec (bnemec)20:10
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci master: Set ssh_user for oooq mulitnode jobs  https://review.openstack.org/48072320:10
*** rcernin has joined #tripleo20:14
Ngdprince: aha, thanks20:15
openstackgerritJames Slagle proposed openstack/tripleo-docs master: Add documentation for split-stack  https://review.openstack.org/46187120:16
dprinceNg: in case you need it this is the source of our default setting http://git.openstack.org/cgit/openstack/puppet-tripleo/tree/manifests/profile/base/docker.pp#n6820:16
Ngdprince: awesome20:17
*** achadha has quit IRC20:19
*** achadha has joined #tripleo20:20
openstackgerritAna Krivokapic proposed openstack/tripleo-docs master: Document how to export deployment plans  https://review.openstack.org/48071120:22
*** ansmith has quit IRC20:26
openstackgerritMerged openstack/tripleo-heat-templates master: Fix typo in roles/Networker.yaml  https://review.openstack.org/48021020:28
*** shardy has quit IRC20:35
*** dsariel has joined #tripleo20:36
*** cylopez has left #tripleo20:37
*** snecklifter has quit IRC20:43
*** chlong_ has joined #tripleo20:44
openstackgerritBen Nemec proposed openstack/tripleo-heat-templates master: Disable network validation in multinode jobs  https://review.openstack.org/47940620:45
*** trown is now known as trown|outtypewww20:45
*** dciabrin has quit IRC20:49
*** dciabrin has joined #tripleo20:49
*** liverpooler has quit IRC20:49
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Run environment role to set variables for OS environment  https://review.openstack.org/48073520:50
openstackgerritMichael  Henkel proposed openstack/puppet-tripleo master: Contrail: Fix controlplane/dataplane network asignments & enable optional dpdk  https://review.openstack.org/47504520:53
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Switch from oslosphinx to openstackdocstheme  https://review.openstack.org/47826620:58
*** Goneri has quit IRC20:58
*** agopi has quit IRC21:01
openstackgerritMerged openstack/python-tripleoclient master: Modified --os-image option in overcloud image upload  https://review.openstack.org/48003621:02
*** rbrady is now known as rbrady-afk21:03
*** dprince has quit IRC21:06
*** gfidente|afk is now known as gfidente21:07
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016721:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Ben Nemec (bnemec)21:10
*** ooolpbot has quit IRC21:10
*** atheurer has quit IRC21:11
*** rhallisey has quit IRC21:15
slagleEmilienM: should undercloud containers really be a voting job given it is an experimental feature?21:16
*** thrash is now known as thrash|g0ne21:16
*** nyechiel has quit IRC21:18
*** chlong_ has quit IRC21:18
EmilienMslagle: we had mixed opinions here - if it's broken too often and affect our work, let's disable voting21:19
*** ecerquei has quit IRC21:20
slagleEmilienM: just seems wrong to me to block real features on experimental features21:21
EmilienMslagle: I get your point21:23
openstackgerritMerged openstack/tripleo-heat-templates master: Update cinder-netapp-config environment  https://review.openstack.org/47592321:23
EmilienMslagle: the job broke last week21:24
EmilienMslagle: that's why I proposed to make it voting21:24
EmilienMslagle: in my exp, when jobs are non voting, they break after a few days and never come back green21:25
EmilienMfolks ignore -nv jobs, it's a fact21:25
EmilienMso ok to disable voting on this job - but to me it's a step back in container work21:25
EmilienMslagle: feel free to propose a revert of https://review.openstack.org/#/c/478257/ - I would +1 it - but I would also let container folks to never complain is the feature is broken21:27
* EmilienM afk21:27
*** atheurer has joined #tripleo21:28
bnemecEmilienM: I really don't want to adopt that "no assigned but not in-progress bugs" rule.21:29
bnemecAt least not until somebody figures out how to make it time-aware so it doesn't immediately un-assign bugs.21:29
*** abishop has quit IRC21:30
*** ebarrera has quit IRC21:30
slagleEmilienM: it's all good as-is, was just trying to understand the logic behind the change21:31
stevebakerEmilienM, slagle: I think having undercloud containers voting is helpful for containers in general. fwiw since the last breakage I check the status of the container jobs daily21:32
slaglestevebaker: no doubt it is helpful21:33
slaglei was merely wondering as to the sense of blocking all TripleO patches on account of something experimental being broken21:34
slagleit seems it was more about individual behavior change than anything else21:34
slaglewe can use CI to force that change21:35
*** samdoran has quit IRC21:40
*** salmankhan has joined #tripleo21:40
*** eck` is now known as eck`gone21:40
itlinuxhi all.. does anyone know why I got a bad command about trying this out openstack overcloud deploy --templates --control-scale 1 --compute-scale 1 --neutron-tunnel-types vxlan --neutron-network-type vxlan21:41
itlinuxany suggestions?21:42
slaglestevebaker: where do I find the Heat logs for the "undercloud deploy" in a failed job?21:42
stevebakerslagle: try this http://logs.openstack.org/22/477722/2/check/gate-tripleo-ci-centos-7-undercloud-containers/77fa23f/logs/var/log/undercloud_install.txt.gz21:43
slaglestevebaker: i'm looking there, my job is: http://logs.openstack.org/99/461399/12/check/gate-tripleo-ci-centos-7-undercloud-containers/d9a282f/logs/var/log/undercloud_install.txt.gz21:44
slaglestevebaker: it says Log files at: /tmp/undercloud_deploy-oHKzTz21:44
slaglebut I dont think we actually capture that?21:44
*** salmankhan has quit IRC21:45
stevebakerslagle: I think that file captures everything. that error looks suspicious outputs.deployed_server_deployment_swift_data_map.value.map_replace21:46
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Add DeployedServerEnvironmentOutput  https://review.openstack.org/46139921:46
slaglestevebaker: it doesnt capture the Heat logs though from the heat "all-in-one"21:47
slaglebut i think i see the issue in the patch anyway21:47
*** jmelvin has quit IRC21:48
stevebakerslagle: I've generally not needed heat server logs in that environment. You will get the stack event list stream in undercloud_install.txt but this job didn't get that far because template rendering failed21:51
*** morazi has quit IRC21:52
slaglestevebaker: ok. the rendering actually passed though. it was Heat validation that failed21:52
slaglei was hoping that the Heat logs may have told me more info :)21:52
slagleat least, that's what I was trying to figure out21:53
slaglei was assuming it was the Heat validation, given the 8 second gap in the timestamps21:54
slaglewhich is why I went looking for the Heat logs :)21:54
slagleand the rendering passes for me locally21:54
slaglebut, I'm pretty sure I found the issue anyway21:55
*** dmacpher has quit IRC21:55
stevebakerslagle: ah, I was misled by the templates rendering in a different order on this other log I'm looking at. Anyhoo, /tmp/undercloud_deploy-oHKzTz may well have something useful, and we should capture it in the job21:55
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/47260722:00
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test  https://review.openstack.org/47574722:03
openstackgerritAlex Schultz proposed openstack/instack-undercloud master: Switch from oslosphinx to openstackdocstheme  https://review.openstack.org/47826322:03
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Run environment role to set variables for OS environment  https://review.openstack.org/48073522:04
*** ecerquei has joined #tripleo22:07
*** dmacpher has joined #tripleo22:08
*** dbecker has quit IRC22:09
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016722:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Ben Nemec (bnemec)22:10
*** ooolpbot has quit IRC22:10
*** bfournie has quit IRC22:16
*** ecerquei has quit IRC22:34
*** panda is now known as panda|Zz22:37
*** rcernin has quit IRC22:45
itlinuxhello guys. quick question on undercloud.conf I setup the dhcp_start to .100 and it sets it on my DNS as well.. is there an additional parameter to use for DNS? Thanks22:47
*** rlandy is now known as rlandy|bbl22:47
*** ecerquei has joined #tripleo22:48
itlinuxI guess it's my fault.. I did not update the DNS in the ctlplane ...22:49
itlinuxciao22:49
*** itlinux has quit IRC22:50
*** ansmith has joined #tripleo23:09
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016723:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Ben Nemec (bnemec)23:10
*** ooolpbot has quit IRC23:10
*** ecerquei has quit IRC23:17
*** bfournie has joined #tripleo23:33
openstackgerritGiulio Fidente proposed openstack/tripleo-common master: Consume ceph-ansible vars from the execution environment  https://review.openstack.org/48077123:35
*** achadha has quit IRC23:37
*** bfournie has quit IRC23:38
*** achadha has joined #tripleo23:38
*** achadha has quit IRC23:42
*** owalsh has quit IRC23:53
*** bfournie has joined #tripleo23:53

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!