Wednesday, 2017-10-25

openstackgerritRadomir Dopieralski proposed openstack/tripleo-heat-templates master: Enable all horizon plugins by default  https://review.openstack.org/51442100:00
openstackgerritMerged openstack/tripleo-ui master: Refactor MistralApiService to thunks  https://review.openstack.org/50666400:03
*** gvrangan has joined #tripleo00:05
*** trown is now known as trown|outtypewww00:05
openstackgerritMerged openstack/tripleo-ui master: Refactor HeatApiService to thunks  https://review.openstack.org/50666500:05
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements  https://review.openstack.org/51163300:09
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286400:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]00:10
*** pmannidi has joined #tripleo00:10
*** leitan has quit IRC00:12
*** gvrangan has quit IRC00:13
*** bobh has joined #tripleo00:15
*** bfournie has joined #tripleo00:15
*** gvrangan has joined #tripleo00:17
*** rcernin has joined #tripleo00:19
*** rcernin has quit IRC00:23
*** rcernin has joined #tripleo00:24
*** bobh has quit IRC00:28
*** chlong|lnch has quit IRC00:38
*** newmember has quit IRC00:42
*** chlong|lnch has joined #tripleo00:44
*** chlong|lnch has quit IRC00:48
*** psahoo has joined #tripleo00:50
*** artom_ has joined #tripleo00:56
*** pkovar has quit IRC00:56
*** stee_3_ has quit IRC00:58
*** bnemec has quit IRC00:58
*** ipsecguy has quit IRC00:58
*** ansmith has quit IRC00:58
*** gvrangan has quit IRC00:58
*** artom has quit IRC00:59
*** stee_3 has joined #tripleo00:59
*** gvrangan has joined #tripleo00:59
*** ipsecguy has joined #tripleo00:59
*** bnemec has joined #tripleo00:59
*** chlong|lnch has joined #tripleo01:00
*** ansmith has joined #tripleo01:00
*** jpena|off has quit IRC01:00
*** eck` has quit IRC01:03
*** amoralej|off has quit IRC01:04
*** radez has quit IRC01:04
*** dalvarez has quit IRC01:04
*** radez has joined #tripleo01:05
*** dalvarez has joined #tripleo01:06
*** eck`gone has joined #tripleo01:06
*** jpena|off has joined #tripleo01:06
*** chlong_ has joined #tripleo01:07
*** chlong|lnch has quit IRC01:08
*** amoralej has joined #tripleo01:08
*** bkopilov has joined #tripleo01:09
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286401:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]01:10
*** jpena|off has quit IRC01:11
*** eck`gone has quit IRC01:11
*** radez has quit IRC01:12
*** dalvarez has quit IRC01:12
*** amoralej has quit IRC01:13
*** ansiwen[q] has quit IRC01:13
*** vkhanna has quit IRC01:13
*** gvrangan has quit IRC01:17
*** noslzzp has quit IRC01:17
*** chlong_ has quit IRC01:18
*** noslzzp has joined #tripleo01:18
*** dalvarez has joined #tripleo01:20
*** radez has joined #tripleo01:20
*** eck` has joined #tripleo01:20
*** vkhanna has joined #tripleo01:20
*** jpena|off has joined #tripleo01:20
*** amoralej has joined #tripleo01:20
*** gvrangan has joined #tripleo01:20
*** ansiwen[q] has joined #tripleo01:21
*** bkopilov_ has joined #tripleo01:22
*** fzdarsky_ has joined #tripleo01:23
*** bkopilov has quit IRC01:24
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements  https://review.openstack.org/51163301:25
*** fzdarsky|afk has quit IRC01:27
*** leitan has joined #tripleo01:29
*** rcernin has quit IRC01:32
*** gvrangan has quit IRC01:32
*** rcernin has joined #tripleo01:32
*** rcernin has quit IRC01:33
*** leitan has quit IRC01:33
*** eck` is now known as eck`gone01:35
*** chlong_ has joined #tripleo01:36
*** gvrangan has joined #tripleo01:37
*** psachin has joined #tripleo01:37
openstackgerritRadomir Dopieralski proposed openstack/tripleo-heat-templates master: Enable all horizon plugins by default  https://review.openstack.org/51442101:38
*** gvrangan_odl has joined #tripleo01:39
*** gvrangan__odl has joined #tripleo01:41
*** gvrangan has quit IRC01:42
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements  https://review.openstack.org/51163301:43
*** gvrangan_odl has quit IRC01:44
*** rlandy has quit IRC01:46
*** rbrady-afk has quit IRC01:47
*** itlinux has joined #tripleo01:53
*** rcernin has joined #tripleo01:55
*** gvrangan_odl has joined #tripleo01:59
openstackgerritSteve Baker proposed openstack/python-tripleoclient master: Autodetect insecure registry in container image prepare  https://review.openstack.org/51447302:00
*** gvrangan__odl has quit IRC02:02
*** rbrady-afk has joined #tripleo02:02
*** chlong_ has quit IRC02:09
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286402:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]02:10
*** ooolpbot has quit IRC02:10
*** bobh has joined #tripleo02:10
*** dalvarez has quit IRC02:12
*** eck`gone has quit IRC02:12
*** radez has quit IRC02:12
*** amoralej has quit IRC02:12
*** jpena|off has quit IRC02:12
*** itlinux has quit IRC02:15
*** eck`gone has joined #tripleo02:15
*** bobh has quit IRC02:15
*** itlinux has joined #tripleo02:16
*** bkopilov_ has quit IRC02:16
openstackgerritSai Ram Peesapati proposed openstack/tripleo-heat-templates stable/newton: Include Lbaas agent in newton  https://review.openstack.org/51488702:24
*** dalvarez has joined #tripleo02:30
*** ramishra has joined #tripleo02:44
*** chlong_ has joined #tripleo02:50
*** gvrangan_odl has quit IRC02:52
openstackgerritMerged openstack/instack-undercloud master: Remove Pike-only migration step  https://review.openstack.org/51258402:54
EmilienMpabelanger: why jobs are reset in gate when one is failing on top?02:59
*** daidv has joined #tripleo02:59
*** itlinux has quit IRC03:00
pabelangerEmilienM: because gate is a dependent pipeline. Which means, the jobs behind the failed job are also running that code, so zuul kicks out the failed patch, and all dependent jobs reparent and start testing again03:06
pabelanger(minus bad patch)03:07
*** yamahata has quit IRC03:08
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286403:10
*** ooolpbot has quit IRC03:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]03:10
openstackgerritMerged openstack/tripleo-quickstart-extras master: Always pass docker-ha env when passing docker env  https://review.openstack.org/50960503:14
openstackgerritMerged openstack/tripleo-heat-templates master: Remove rsync from xinetd when upgrading to containerized deployment  https://review.openstack.org/50560603:14
*** achadha has joined #tripleo03:28
*** achadha has quit IRC03:28
*** achadha has joined #tripleo03:28
*** shreshtha has joined #tripleo03:31
EmilienMpabelanger: ok03:35
*** fragatina has quit IRC03:35
*** fragatina has joined #tripleo03:36
*** bkopilov_ has joined #tripleo03:36
*** fragatin_ has joined #tripleo03:37
*** gkadam has joined #tripleo03:38
*** fragatina has quit IRC03:40
*** fragatin_ has quit IRC03:41
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Move to a common lock-file directory  https://review.openstack.org/51407903:49
*** achadha has quit IRC03:51
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Move to a common lock-file directory  https://review.openstack.org/51407903:55
*** mdnadeem has joined #tripleo03:59
*** radez has joined #tripleo04:00
*** yamahata has joined #tripleo04:01
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286404:10
*** ooolpbot has quit IRC04:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]04:10
*** ykarel|away has joined #tripleo04:16
*** skramaja has joined #tripleo04:19
bandinimorning04:20
*** rcernin has quit IRC04:21
jaosoriorgood morning04:24
jaosoriorbandini: daaamn you're early04:24
bandinijaosorior: yo! yeah :)04:25
jaosoriorbandini: need any reviews?04:26
jaosoriornow that I just got my morning coffee and everything? :D04:26
*** pradk has quit IRC04:27
bandinijaosorior: eheh lemme check, I think I am mostly waiting on CI loving me04:28
jaosoriorbandini: CI loves no-one; it's a cruel mistress04:28
bandiniahahah04:29
bandinijaosorior: maybe this one https://review.openstack.org/#/c/514706/ just so that I can +A once CI passes04:29
bandiniit is needed for https://etherpad.openstack.org/p/tripleo-puppet-error-recap04:30
jaosoriorok04:30
*** gvrangan_odl has joined #tripleo04:30
jaosoriorbandini: aaand the gate queue is brutal :/04:35
jaosoriorsome commits were waiting for 17 hours04:35
*** rbrady-afk has quit IRC04:36
*** rbrady-afk has joined #tripleo04:36
openstackgerritMerged openstack/tripleo-common master: Adds --overcloud-user option to upgrade-non-controller.sh  https://review.openstack.org/51263804:37
openstackgerritMerged openstack/tripleo-common master: Get a static inventory for upgrade-non-controller ansible runs  https://review.openstack.org/51299904:37
openstackgerritMerged openstack/tripleo-common master: Remove references to the current task from task() in validations.yaml  https://review.openstack.org/51367604:37
Tenguhello jaosorior . you're earlier than me today ;)04:42
Tenguhello bandini :].04:42
Tenguoh. all is green \o/ https://review.openstack.org/#/c/513274/  anyone for some +2 and so on? Had to rebase against master due to some merge conflict yesterday :(04:43
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements  https://review.openstack.org/51163304:43
*** rcernin has joined #tripleo04:45
*** pradk has joined #tripleo04:47
Tenguthank you jaosorior :)04:47
Tenguhopefully no merge conflict once it's at the end of the process.04:47
*** masco has joined #tripleo04:52
*** udesale has joined #tripleo04:54
*** tzumainn has quit IRC04:55
*** pdeore has joined #tripleo04:55
*** ratailor has joined #tripleo04:59
*** dparkes has quit IRC05:00
jaosoriorpradk: still around?05:03
*** janki has joined #tripleo05:05
*** gvrangan_odl has quit IRC05:06
*** ykarel|away has quit IRC05:06
*** jaosorior has quit IRC05:07
*** fragatina has joined #tripleo05:08
*** chlong_ has quit IRC05:09
*** fragatina has quit IRC05:09
*** fragatina has joined #tripleo05:10
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286405:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]05:10
*** jprovazn has joined #tripleo05:15
*** dparkes has joined #tripleo05:16
*** dparkes has quit IRC05:20
*** ykarel|away has joined #tripleo05:23
*** jaosorior has joined #tripleo05:23
jaosoriormandre: hey! solved it!05:26
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for keystone containers to log to stdout/stderr  https://review.openstack.org/50851705:27
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for Glance API containers to log to stdout/stderr  https://review.openstack.org/51041105:27
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova containers to log to stdout/stderr  https://review.openstack.org/50915705:28
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Remove log-dir option from neutron-dhcp execution  https://review.openstack.org/51046305:28
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for Neutron containers to log to stdout/stderr  https://review.openstack.org/51046405:28
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova compute container to log to stdout/stderr  https://review.openstack.org/51053705:28
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: libvirt: Remove unnecessary binding of /var/log/containers/nova  https://review.openstack.org/51056105:28
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova-libvirt container to log to stdout/stderr  https://review.openstack.org/51056205:28
Tengu:]05:32
*** cshastri has joined #tripleo05:33
*** ludovic has joined #tripleo05:34
ludovicGood evening everybody from Paris05:36
jaosoriorgood morning!05:36
ludovicyes it's a joke , good morning of course05:37
jaosoriorlol no worries, it was understood :P05:37
Tengu:]05:39
ludovicI just arrived at work, and i'm trying to debug my update deployment of tripleo :-(05:39
Tenguludovic: btw, if you prefer some French speaking, I'm from Switzerland. the French part. but as said yesterday, I'm affraid I can't do more, even in French :/05:40
jaosoriorwhy would you want to do that to your morning?05:40
jaosorior:P05:40
jaosoriorwhat's the issue?05:40
ludovicIt was running but since few days it's broken after modifications of my IP range05:40
jaosorioruhm05:40
jaosoriorludovic: for networking the best folks to ask are in the States unfortunately :/ might wanna poke dsneddon or beagles05:41
jaosoriorludovic: of course, you could just write what the issue is here and maybe someone might know how to fix it.05:42
*** kbyrne has quit IRC05:42
*** kbyrne has joined #tripleo05:45
*** suuuper has joined #tripleo05:46
*** achadha has joined #tripleo05:51
*** agurenko has joined #tripleo05:51
*** gvrangan has joined #tripleo05:54
*** iranzo has joined #tripleo05:55
*** iranzo has joined #tripleo05:55
*** achadha has quit IRC05:56
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/47260706:00
*** dparkes has joined #tripleo06:02
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286406:10
*** ooolpbot has quit IRC06:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]06:10
*** yolanda_ has joined #tripleo06:12
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova containers to log to stdout/stderr  https://review.openstack.org/50915706:12
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Remove log-dir option from neutron-dhcp execution  https://review.openstack.org/51046306:12
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for Neutron containers to log to stdout/stderr  https://review.openstack.org/51046406:12
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova compute container to log to stdout/stderr  https://review.openstack.org/51053706:12
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: libvirt: Remove unnecessary binding of /var/log/containers/nova  https://review.openstack.org/51056106:12
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova-libvirt container to log to stdout/stderr  https://review.openstack.org/51056206:12
*** jchhatbar has joined #tripleo06:27
*** akane has joined #tripleo06:29
*** janki has quit IRC06:29
openstackgerritMichele Baldessari proposed openstack/puppet-pacemaker master: Allow multiple stonith declarations in one manifest  https://review.openstack.org/51425206:35
openstackgerritMichele Baldessari proposed openstack/puppet-pacemaker master: Use resource collectors for ordering in stonith manifests  https://review.openstack.org/51426606:35
*** tosky has joined #tripleo06:36
*** pcaruana has joined #tripleo06:39
*** yolanda_ has quit IRC06:40
*** ykarel|away is now known as ykarel06:40
*** agurenko has quit IRC06:42
*** rodolof has joined #tripleo06:43
*** jchhatbar is now known as janki06:47
*** agurenko has joined #tripleo06:48
*** gfidente has joined #tripleo06:50
*** gfidente has quit IRC06:50
*** gfidente has joined #tripleo06:50
*** cylopez has joined #tripleo06:51
*** florianf has joined #tripleo06:52
*** tesseract has joined #tripleo06:54
*** abregman has joined #tripleo06:54
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-ui stable/pike: Imported Translations from Zanata  https://review.openstack.org/51453306:55
*** ebarrera has joined #tripleo06:59
*** jlinkes has joined #tripleo06:59
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Update CephPools format in the docker templates to fit ceph-ansible  https://review.openstack.org/50885907:00
*** pgadiya has joined #tripleo07:02
*** cmyster_ has joined #tripleo07:04
*** cmyster has quit IRC07:05
*** cmyster_ is now known as cmyster07:05
*** cmyster has joined #tripleo07:05
*** oidgar has joined #tripleo07:06
*** namnh has joined #tripleo07:06
*** rodolof has quit IRC07:07
namnhlyarwood: i should bring my message to this chanel07:07
namnhlyarwood: hi lee, are you free?. could i ask you a question. i saw you have a spec in tripleo about fast-forward-upgrade. Basically, in my inderstanding, FFU in tripleo is offline-upgrade automatically (roles ansible will do this) instead of manual, is that right?07:07
*** rodolof has joined #tripleo07:08
*** jtomasek has joined #tripleo07:09
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286407:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]07:10
*** ooolpbot has quit IRC07:10
*** spectr has joined #tripleo07:13
*** yprokule has joined #tripleo07:21
jankibcafarel, hey07:23
*** ffiore has joined #tripleo07:23
*** athomas has joined #tripleo07:27
*** shreshtha has quit IRC07:28
*** marios has joined #tripleo07:31
*** jfrancoa has joined #tripleo07:31
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Speed up deployment by reusing facts  https://review.openstack.org/51494507:32
jaosoriord0ugal: hey, could you check this out https://review.openstack.org/#/c/514543/ ?07:33
*** anshul has joined #tripleo07:34
*** yolanda_ has joined #tripleo07:42
*** yolanda_ is now known as yolanda07:43
jistr|mtgsjaosorior: lgtm ^^. Didn't +A just yet in case d0ugal is looking too07:45
*** amoralej has joined #tripleo07:45
*** jpena has joined #tripleo07:46
jistr|mtgsi want to carve out some time to review the next log patches too but they're fairly large and i only have chunks of time during this week07:46
jaosoriorjistr|mtgs: if you have a bit of time today07:50
jaosoriorI could show you the resulting deployment07:50
jaosoriorjistr|mtgs, mandre: Actually, I have a deployment now if you guys wanna take a look07:53
*** ykarel is now known as ykarel|lunch07:53
*** ffiore has quit IRC07:54
*** Goneri has joined #tripleo07:54
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for keystone containers to log to stdout/stderr  https://review.openstack.org/50851707:54
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for Glance API containers to log to stdout/stderr  https://review.openstack.org/51041107:54
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova containers to log to stdout/stderr  https://review.openstack.org/50915707:54
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Remove log-dir option from neutron-dhcp execution  https://review.openstack.org/51046307:54
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for Neutron containers to log to stdout/stderr  https://review.openstack.org/51046407:54
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova compute container to log to stdout/stderr  https://review.openstack.org/51053707:54
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: libvirt: Remove unnecessary binding of /var/log/containers/nova  https://review.openstack.org/51056107:54
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova-libvirt container to log to stdout/stderr  https://review.openstack.org/51056207:54
*** ffiore has joined #tripleo07:54
jaosoriorjistr|mtgs, mandre ^^ but anyway, there's the code. Added relevant healthchecks for the side-car containers and made them a bit more robust and fixed some descriptions.07:55
openstackgerritJanki Chhatbar proposed openstack/tripleo-heat-templates master: Env files for ODL deployments  https://review.openstack.org/51250107:55
*** achadha has joined #tripleo07:59
*** achadha has quit IRC07:59
*** achadha has joined #tripleo08:00
*** ccamacho has joined #tripleo08:00
*** achadha_ has joined #tripleo08:04
*** achadha has quit IRC08:05
openstackgerritMarios Andreou proposed openstack/tripleo-common stable/pike: Adds --overcloud-user option to upgrade-non-controller.sh  https://review.openstack.org/51495008:07
lyarwoodnamnh: yeah correct, APIs are down, workloads are up, driven by Ansible.08:07
ccamachoHey folks morning!08:07
ccamachoquick question, we have a bug fix for puppet-glance  https://review.openstack.org/#/c/513403/ failing on some jobs08:07
ccamachoThis is the current error: http://logs.openstack.org/03/513403/4/check/puppet-openstack-integration-4-scenario001-tempest-ubuntu-xenial/b55f0cc/job-output.txt.gz#_2017-10-23_12_24_54_14454008:07
ccamachohere: u'message': u'Unable to associate floating IP 172.24.5.19 to fixed IP 10.100.0.8 for instance 64e2ee9a-4c12-48f4-8d74-9d17238ffd5a. Error: Request to https://127.0.0.1:9696/v2.0/ports?tenant_id=7829e38698b745208f98b9a040afac23&device_id=64e2ee9a-4c12-48f4-8d74-9d17238ffd5a timed out',08:07
ccamachodo you know anyone I can reach to check why this is failing?08:07
openstackgerritMarios Andreou proposed openstack/tripleo-common stable/pike: Get a static inventory for upgrade-non-controller ansible runs  https://review.openstack.org/51495108:09
*** cmyster has quit IRC08:10
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286408:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]08:10
*** ooolpbot has quit IRC08:10
*** morazi has joined #tripleo08:10
*** fzdarsky_ has quit IRC08:13
jaosoriorjistr|mtgs: soo... you available for a quick call?08:15
*** paramite has joined #tripleo08:17
*** dbecker has joined #tripleo08:18
*** dsariel has joined #tripleo08:19
*** bcafarel has quit IRC08:20
*** aufi has joined #tripleo08:20
*** namnh_ has joined #tripleo08:21
*** bcafarel has joined #tripleo08:21
*** namnh has quit IRC08:23
ccamachoamoralej https://review.openstack.org/#/c/513403/08:25
*** stendulker has joined #tripleo08:27
*** mcornea has joined #tripleo08:27
jistr|mtgsjaosorior: not now sorry08:28
jaosoriorjistr|mtgs: it's alright08:28
jaosoriorjistr|mtgs: just did a quick demo for mandre08:29
jaosoriormandre: by the way, I tried running run.sh from the undercloud_containers repo and am getting this http://paste.openstack.org/show/624571/ any idea what it could be?08:30
*** tosky has quit IRC08:31
*** cmyster has joined #tripleo08:31
*** cmyster has quit IRC08:31
*** cmyster has joined #tripleo08:31
mandrejaosorior: looks like you skipped https://github.com/dprince/undercloud_containers/blob/master/doit.sh#L25408:31
bcafareljanki: hi08:32
jaosoriormandre: oh08:32
jaosoriorok, will try it out08:32
jankibcafarel, I have question about sfc env file in tripleo. I understand you are the author08:32
jaosoriormandre: trying it again, thanks08:32
jaosoriormandre: tried running it again, got this now:08:33
jaosoriorChanging the local_ip is not allowed.  Existing IP: 192.168.25.106/24, Configured IP: 192.168.24.0/2408:33
jaosoriorAn error occurred during configuration validation, please check your host configuration and try again.08:34
jaosoriorError message: Changing the local_ip is not allowed.  Existing IP: 192.168.25.106/24, Configured IP: 192.168.24.0/2408:34
*** lucas-afk is now known as lucasagomes08:34
*** bogdando has joined #tripleo08:34
mandrejaosorior: yeah I got the same error, haven't yet looked into it08:35
jaosorioralrighty08:35
bcafareljanki: indeed, with trozet. Did it set your env on fire?08:35
jankibcafarel, not exactly. I have a question about plugin extension https://github.com/openstack/tripleo-heat-templates/blob/master/environments/neutron-opendaylight.yaml#L1508:39
jankibcafarel, I am moving it to docker folder https://review.openstack.org/#/c/512501/4/environments/services-docker/neutron-opendaylight-sfc.yaml and was wondering if we need any specific plugin extension?08:40
jaosoriorbogdando: hey, updated the logging patches a bit, if you have time to take a look. Basically I fixed some descriptions, added better healthchecks for the sidecar containers and made the sidecontainer script a bit more robust.08:42
bogdandojaosorior: ok will do08:42
bogdandojaosorior: could you review https://review.openstack.org/#/c/513774/ ?08:43
bogdandofolks, let's merge please https://review.openstack.org/#/c/514560/08:44
jaosoriorbogdando: I think there might be a bug in the symlink bit http://logs.openstack.org/74/513774/3/check/legacy-tripleo-ci-centos-7-undercloud-containers/a1fc621/job-output.txt.gz#_2017-10-24_09_30_49_05249508:45
bogdandojaosorior: that's odd, worked on my env :)08:45
bogdandoah, indeed08:45
bcafareljanki: great, container support was an open question when sfc support got merged08:45
bogdandoidempotency08:45
bcafareljanki: that looks good, sfc+odl is just the service plugins in neutron-server and the odl part, no other parts08:46
jaosoriorbogdando: right, so the call to os.symlink fails if it's already there, right?08:46
bogdandoseems so08:46
*** derekh has joined #tripleo08:46
jankibcafarel, cool, can you review it too?08:47
jankibcafarel, its not containarising the service, but moving it under correct path08:47
openstackgerritRadomir Dopieralski proposed openstack/tripleo-heat-templates master: Enable all horizon plugins by default  https://review.openstack.org/51442108:47
* Tengu needs a second +2 on this review : https://review.openstack.org/#/c/513274/ EmilienM mwhahaha or anyone else with that power ? :)08:49
bcafareljanki: sure, taking a look08:49
jankibcafarel, thanks08:49
openstackgerritMerged openstack/tripleo-docs master: Update containerized undercloud deployment guide  https://review.openstack.org/51308308:50
*** marios has quit IRC08:50
*** namnh has joined #tripleo08:51
*** namnh_ has quit IRC08:53
*** marios has joined #tripleo08:53
*** ykarel|lunch is now known as ykarel08:56
*** tosky has joined #tripleo08:57
*** yamahata has quit IRC08:58
*** pmannidi has quit IRC08:59
*** rcernin has quit IRC08:59
*** hewbrocca_afk is now known as hewbrocca09:00
openstackgerritDougal Matthews proposed openstack/tripleo-common master: Remove references to the current task from task() in ceph-ansible.yaml  https://review.openstack.org/51369209:02
*** achadha_ has quit IRC09:02
*** achadha has joined #tripleo09:03
*** achadha has quit IRC09:03
*** achadha_ has joined #tripleo09:03
*** achadha_ has quit IRC09:03
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286409:10
*** ooolpbot has quit IRC09:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]09:10
*** salmankhan has joined #tripleo09:11
openstackgerritAdriano Petrich proposed openstack/tripleo-common master: Validate parameters before updating  https://review.openstack.org/51124909:15
*** anshul has quit IRC09:18
*** jpena is now known as jpena|off09:20
*** jpena|off is now known as jpena09:21
*** anshul has joined #tripleo09:22
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: Fix static-inventory option for minor update  https://review.openstack.org/51497509:23
jaosoriordciabrin: what were the log files that mysql outputs?09:31
dciabrinjaosorior, /var/log/mariadb.log, var/log/mysqld.log and rsyncd currently logs into the journal09:32
jaosoriordciabrin: does mysql currently log anything to syslog?09:33
dciabrinjaosorior, nope09:33
jaosoriorcool cool09:33
dciabrinjaosorior, if you override env var WSREP_LOG_DIR in the mariadb container you might succeed diverting the rsyncd log into a log file rather than the journal09:34
dciabrinjaosorior, look at /usr/bin/wsrep_sst_rsync for more details09:34
jaosoriordciabrin: excellent.09:35
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Remove /dev/log mounting from mysql bundle resource  https://review.openstack.org/51498609:35
jaosoriorwill do09:35
jaosoriordciabrin: meanwhile I did that ^^09:35
*** rodolof has quit IRC09:35
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Remove /dev/log mounting from mysql bundle resource  https://review.openstack.org/51498609:36
*** psahoo has quit IRC09:38
jistr|mtgsbogdando: hi, would you have some time to give another look to https://review.openstack.org/#/c/511272/ ? aside from removing the mistral tasks completely, the changes since your last vote are fairly minimal09:38
jistr|mtgsi think the reviews have been addressed either in that patch directly, or in follow up ones09:39
jistr|mtgswould be nice to land this so that we can start iterating on the improvements in smaller patches, to prevent reviewer (and submitter ;) ) fatigue09:39
jistr|mtgsjaosorior: re call, i think i'd be available only next week... but regarding the logging i'm totally on board with it, both the spec and the patches i've been able to review so far.09:43
jaosoriorjistr|mtgs: next week could work too :D hopefully I'll have more services implemented by then09:44
jaosoriorjistr|mtgs: but yeah, really need reviews, mostly for the keystone patch, which would unblock everything else https://review.openstack.org/#/c/508517/2209:45
openstackgerritSaravanan KR proposed openstack/tripleo-heat-templates master: Added a new role definition for SR-IOV Compute role  https://review.openstack.org/50199909:46
*** ratailor is now known as rtailor09:47
derekhCan somebody take a look at this to enable some missing health checks please https://review.openstack.org/#/c/50612509:49
dciabrinjaosorior, hmmm, oh damned I wasn't clear. mysql doesn't log in the journal but pacemaker's resource agents do. so they need /dev/log :09:50
dciabrin:(09:50
jaosorioroh, ok09:50
jistr|mtgsjaosorior: the changes since my last review are small, so i reviewed, +1'd and asked about the while loop09:50
dciabrinjaosorior, well let me double check if they also log in pacemaker files, I'll keep you posted09:50
jaosoriorjistr|mtgs: so, if we restart the main container (lets say keystone), it issues an EOF, which cat catches and then exists. using the while loop catches the exit and just keeps outputting from the fifo again, which eventually keystone will write to when it restarts.09:51
jaosoriorjistr|mtgs: it used to be that restarting keystone would result in restarting all the logging containers; with the addition of the while loop, this is not the case anymore. They just keep doing their job :)09:52
jistr|mtgsjaosorior: right that makes sense, i just wonder if we should put `sleep 1` there to avoid the logging containers from consuming 100% CPU? I mean, the way i understand, if keystone is down, the cat would exit immediately and the logging containes would be busy waiting, right?09:54
*** fzdarsky has joined #tripleo09:55
jaosoriorjistr|mtgs: cat wouldn't exit, opening the fifo blocks until someone starts writing on it; and vice-versa.09:56
jistr|mtgsjaosorior: perfect, thanks, +2'd09:57
jaosoriorjistr|mtgs: yay thanks!10:00
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Add missing puppet configuration to undercloud deploy  https://review.openstack.org/51377410:00
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Add missing puppet configuration to undercloud deploy  https://review.openstack.org/51377410:01
openstackgerritDerek Higgins proposed openstack/tripleo-quickstart-extras master: WIP: Setup Ironic in Overcloud  https://review.openstack.org/50972810:01
*** stendulker is now known as stendulker_10:04
openstackgerritDerek Higgins proposed openstack/tripleo-heat-templates master: WIP: Add ironic config to scenario 004  https://review.openstack.org/48526110:04
*** stendulker_ is now known as stendulker10:05
*** stendulker has quit IRC10:06
*** stendulker has joined #tripleo10:07
namnhlyarwood: thanks for your reply, i saw on a thread mailling-list which you created, there is a problem is that how to avoid stoping instances when upgrading nova-compute10:07
namnhlyarwood: that is main problem we need to solve during FFU, right?10:09
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286410:10
*** ooolpbot has quit IRC10:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]10:10
jistr|mtgsbogdando: thanks for the review :)10:11
*** stendulker has quit IRC10:11
lyarwoodnamnh: well, the spec was written with the assumption that the env is using the libvirt virt driver for n-cpu10:11
*** stendulker has joined #tripleo10:11
lyarwoodnamnh: in which case instances don't need to be stopped during an n-cpu ffu upgrade10:11
lyarwoodnamnh: assuming the node has been updated prior to the start of the ffu upgrade10:12
lyarwoodnamnh: and obviously been rebooted if required to pull in new versions of the kernel, QEMU, OVS etc10:12
lyarwoodnamnh: that's written up in the prereqs section10:12
lyarwoodnamnh: stopping n-cpu and even libvirtd shouldn't impact the running instances in this case.10:13
*** udesale has quit IRC10:13
*** fzdarsky has quit IRC10:16
namnhlyarwood: I got it. thank you.10:17
namnhlyarwood: are you joining FFU section at sydney summit?10:18
lyarwoodnamnh: no I'm not unfortunately10:23
*** pdeore has quit IRC10:23
bogdandojistr|mtgs, flaper87: thanks for contributing to Kubespray! :)10:24
*** skramaja has quit IRC10:25
bandinigfidente: is this one known http://logs.openstack.org/06/514706/1/check/legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-container/95582b5/logs/undercloud/var/log/mistral/ceph-install-workflow.log.txt.gz#_2017-10-25_08_37_39_402 ?10:25
namnhlyarwood: ack, i have to leave our office for now, see you later.10:27
bandinigfidente: oh it is https://bugs.launchpad.net/tripleo/+bug/172522410:27
openstackLaunchpad bug 1725224 in tripleo "Deployment with ceph and ansible 2.4 fails with: "WorkflowTasks_Step2_Execution: ERROR" "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'. Host key verification failed."" [High,In progress] - Assigned to Marius Cornea (mcornea)10:27
*** fzdarsky has joined #tripleo10:30
*** pdeore has joined #tripleo10:30
gfidentebandini yean10:32
*** pcaruana has quit IRC10:37
*** namnh has quit IRC10:38
*** bkopilov_ has quit IRC10:42
openstackgerritMerged openstack-infra/tripleo-ci master: Do not rely on openstack-puppet-modules in Queens and beyond  https://review.openstack.org/51278310:43
openstackgerritMerged openstack/tripleo-quickstart master: Fix IP address for ssh-tunnel for UI  https://review.openstack.org/51114310:43
openstackgerritRadomir Dopieralski proposed openstack/tripleo-heat-templates master: Enable all horizon plugins by default  https://review.openstack.org/51442110:45
*** chem has joined #tripleo10:46
jaosoriord0ugal, gfidente: How do I debug an error in  resources.WorkflowTasks_Step2_Execution ?10:49
jaosoriord0ugal, gfidente: It doesn't seem to output anything http://logs.openstack.org/57/509157/21/check/legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-container/ab58ab0/logs/undercloud/var/log/postci.txt.gz10:49
d0ugaljaosorior: I've never tried :) but I am curious to learn10:50
*** salmankhan has quit IRC10:50
* d0ugal looks at logs10:50
gfidentejaosorior yeah it's https://bugs.launchpad.net/tripleo/+bug/172522410:50
openstackLaunchpad bug 1725224 in tripleo "Deployment with ceph and ansible 2.4 fails with: "WorkflowTasks_Step2_Execution: ERROR" "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'. Host key verification failed."" [Critical,In progress] - Assigned to Marius Cornea (mcornea)10:50
jaosoriorwell shit10:50
gfidentejaosorior you can check in mistral for the execution output10:50
gfidentejaosorior or go to the mistral logs10:50
jaosoriorgfidente: I'm seeing that in master now10:50
gfidentejaosorior yeah I know I flagged it critical but it's just that the newer version of ansible has a bug10:51
gfidenteand it doesn't use the ssh option passed with -o10:51
jaosoriorok10:51
jaosoriorgfidente: thanks for the info10:51
gfidentehttps://github.com/ansible/ansible/issues/3072010:51
gfidentethe fix is setting the option as an env variable instead10:51
*** salmankhan has joined #tripleo10:51
gfidentehttps://review.openstack.org/#/c/513701/10:52
gfidentehopefully it gets merged quickly10:52
openstackgerritMerged openstack/puppet-tripleo stable/pike: Add option to disable running mistral-api via wsgi  https://review.openstack.org/51472810:55
*** morazi has quit IRC10:57
*** gfidente[m] has joined #tripleo10:58
*** morazi has joined #tripleo10:59
openstackgerritAdriano Petrich proposed openstack/tripleo-common master: Validate parameters before updating  https://review.openstack.org/51124911:00
*** ramishra has quit IRC11:00
*** dtantsur|afk is now known as dtantsur11:01
*** pgadiya has quit IRC11:02
*** ramishra has joined #tripleo11:02
openstackgerritMerged openstack/python-tripleoclient stable/pike: Allow containerized undercloud deploy with SELinux  https://review.openstack.org/51374611:06
yolandahi, can i get second +2 on https://review.openstack.org/499588 ?11:06
yolandaEmilienM ^11:07
ansiwenjaosorior: hey, I wanted to finally integrate ec2-api tempest into scenario 002, and if I remember correctly we do that already for other services, but I couldn't find it quickly, can you give me a pointer?11:09
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286411:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172522411:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]11:10
openstackLaunchpad bug 1725224 in tripleo "Deployment with ceph and ansible 2.4 fails with: "WorkflowTasks_Step2_Execution: ERROR" "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'. Host key verification failed."" [Critical,In progress] - Assigned to Marius Cornea (mcornea)11:10
*** pgadiya has joined #tripleo11:10
*** jkilpatr has quit IRC11:11
*** rodolof has joined #tripleo11:12
*** dbecker has quit IRC11:19
*** yolanda has quit IRC11:19
*** atoth has joined #tripleo11:19
*** lucasagomes is now known as lucas-hungry11:20
*** bobh has joined #tripleo11:20
*** bobh has quit IRC11:23
*** pdeore has quit IRC11:24
jaosorioransiwen: chandankumar can help you :)11:25
* chandankumar is confused11:25
jaosoriorchandankumar: ansiwen wants to add ec2-api tempest testing to scenario 002. Got any pointers?11:25
*** bfournie has quit IRC11:25
*** bfournie has joined #tripleo11:26
chandankumaransiwen: looking for example11:29
chandankumaransiwen: https://review.openstack.org/#/c/499928/ it would be a good example11:30
*** bfournie has quit IRC11:30
chandankumaransiwen: you need to change params in featureset 6 and 1711:31
chandankumaransiwen: you can use tempest_whitelist, tempest_plugins: and tempest_extra_config params for running the tests11:32
chandankumaransiwen: i would suggest to send a patch against tripleo-quickstart to enable ec2api tests11:32
chandankumarfor scenario 2 and see what is failing then update the patch to add config11:34
chandankumarjaosorior: ^^11:35
jaosoriorchandankumar: thanks11:35
*** ffiore has quit IRC11:38
*** bobh has joined #tripleo11:38
*** bfournie has joined #tripleo11:39
*** bfournie has quit IRC11:39
*** rtailor has quit IRC11:40
*** ratailor has joined #tripleo11:42
*** ratailor has quit IRC11:42
*** stendulker has quit IRC11:42
*** pcaruana has joined #tripleo11:43
*** ebarrera has quit IRC11:44
*** ebarrera has joined #tripleo11:45
*** bobh has quit IRC11:45
*** ansmith has quit IRC11:46
ansiwenchandankumar: i don't understand the last part. why quickstart? ec2-api is already deployed in scenario002, I just want to additionally run the tempest tests against it.11:47
ansiwenchandankumar: and thanks!11:47
*** dciabrin has quit IRC11:50
*** bobh has joined #tripleo11:52
*** jkilpatr has joined #tripleo11:55
*** leitan has joined #tripleo11:55
*** leitan has quit IRC11:55
*** leitan has joined #tripleo11:56
chandankumaransiwen: https://github.com/openstack/tripleo-quickstart/blob/master/config/general_config/featureset006.yml#L67 uncomment this line11:56
ansiwenchandankumar: yes, so it looks like EmilienM already prepared everything, but there is something missing in python-tempestconf?11:57
ansiwenI guess I have to ask EmilienM what is the status there11:57
chandankumaransiwen: you have to enable ec2api service in tempest.conf11:58
chandankumaransiwen: use tempest_extra_config for the same11:58
ansiwenchandankumar: did you see the comment?11:58
openstackgerritLuke Hinds proposed openstack/tripleo-heat-templates master: [WIP] Implements AIDE Intrusion Detection System  https://review.openstack.org/48302811:59
jaosoriorjistr|mtgs, mandre: If I need to configure a service with a static template, what would be the best way to do it? Adding that static configuration in puppet seems a bit overkill.11:59
*** pgadiya has quit IRC12:00
EmilienMansiwen: me?12:01
*** jpena is now known as jpena|lunch12:01
EmilienMansiwen: I'm not, at all.12:01
*** dmacpher has joined #tripleo12:02
*** adarazs is now known as adarazs_brb12:02
ansiwenEmilienM: I need some background for this line: https://github.com/openstack/tripleo-quickstart/blob/master/config/general_config/featureset006.yml#L6612:02
EmilienMansiwen: afik tempestconf doesn't configure ec2api in tempest.conf12:02
ansiwenEmilienM: what is missing to enable the ec2-api tempest tests?12:02
EmilienMansiwen: the logic isn't here12:02
*** dprince has joined #tripleo12:03
*** pcaruana has quit IRC12:03
EmilienMansiwen: for ex, we tempestconf needs logic to detect the endpoint12:03
EmilienMansiwen: and if found, enable ec2api service in tempest.conf. etc etc12:04
*** raildo has joined #tripleo12:04
*** pcaruana has joined #tripleo12:04
EmilienMgfidente: hey, why https://review.openstack.org/#/c/514584/1 is not passing?12:04
EmilienMgfidente: it sounds like a timeout12:04
*** iranzo has quit IRC12:04
ansiwenEmilienM: ok, because chandankumar just proposed to enable it with tempest_extra_config, or did I misunderstand him?12:05
EmilienMtherve: https://review.openstack.org/#/c/514777/12:05
EmilienMchandankumar, ansiwen: it sounds like a workaround to me.12:05
*** iranzo has joined #tripleo12:06
*** iranzo has joined #tripleo12:06
ansiwenEmilienM: ok, for the stupid like me: I go to python-tempestconf and implement the ec2api parts there, correct?12:06
*** abishop has joined #tripleo12:06
socialtherve: around?12:07
EmilienMansiwen: yes12:07
thervesocial, Hey12:07
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for heat containers to log to stdout/stderr  https://review.openstack.org/51503812:08
ansiwenEmilienM: ok, thanks. chandankumar, if you don't agree please shout....12:08
gfidenteEmilienM yeah looks unrelated to me12:09
gfidenteI am just waiting for the master version to land first12:09
*** pgadiya has joined #tripleo12:09
EmilienMgfidente: that's fine if the other merges first12:10
*** thrash|g0ne is now known as thrash12:10
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286412:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172522412:10
*** ooolpbot has quit IRC12:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]12:10
openstackLaunchpad bug 1725224 in tripleo "Deployment with ceph and ansible 2.4 fails with: "WorkflowTasks_Step2_Execution: ERROR" "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'. Host key verification failed."" [Critical,In progress] - Assigned to Marius Cornea (mcornea)12:10
socialtherve: so extended TripleOAction with get_messaging_client and I get queue and I pass that to my ansible callback, question is now that in python-tripleoclient the wait_for_messages seems to check for execution id. should I just make that id up?12:10
openstackgerritRadomir Dopieralski proposed openstack/tripleo-heat-templates master: Enable horizon plugins by default in docker  https://review.openstack.org/51442112:10
EmilienMgfidente: but yeah we need master ASAP, it's blocking promotion12:10
EmilienMgfidente: we found it last night that it's blocking promotion with wes, can you confirm it will fix https://bugs.launchpad.net/tripleo/+bug/1725224 ?12:10
openstackgerritDougal Matthews proposed openstack/tripleo-common master: Remove references to the current task from task() in baremetal.yaml  https://review.openstack.org/51369312:11
*** pkovar has joined #tripleo12:12
gfidenteEmilienM yep we had the fix in place from a while as well12:13
gfidentebut it failed rechecks :(12:13
EmilienMgfidente: ok, good to know. It's our last blocker, afik12:13
*** adarazs_brb is now known as adarazs12:14
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DNM: test containers update  https://review.openstack.org/51117512:16
EmilienMgfidente: ethernal recheck don't really help, tbh. We need to understand the root causes, etc12:20
*** pgadiya has quit IRC12:21
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Validate roles data and network data  https://review.openstack.org/50856712:23
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Add a Get Networks workflow  https://review.openstack.org/50941912:23
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Add UpdateNetworks workflow  https://review.openstack.org/51346312:23
jaosoriorEmilienM: If I need to configure a service with a static configuration, what would be the best way to do it? Adding that static configuration in puppet seems a bit overkill.12:23
*** lucas-hungry is now known as lucasagomes12:24
EmilienMjaosorior: static file?12:25
*** bfournie has joined #tripleo12:25
jaosoriorEmilienM: right, a configuration file that doesn't really need any changes.12:25
EmilienMjaosorior: which service?12:25
thervesocial, Can you show some code, it's a bit abstract as-is12:26
socialtherve: maybe I should just update review with progress12:26
therveSure please do12:26
*** rlandy has joined #tripleo12:27
jaosoriorEmilienM: I'm gonna introduce rsyslog as a sidecar container. The configuration would look like this: https://github.com/larsks/ooo-syslog-example/blob/master/rsyslog-stdout/rsyslog.conf12:27
*** yolanda has joined #tripleo12:27
*** cmyster has quit IRC12:28
EmilienMjaosorior: in that case, puppet-tripleo I would say12:28
jaosoriorEmilienM: I could just introduce a small profile in puppet, which wouldn't really be a big deal. But I was just wondering if there's a more lightweight option.12:28
*** tzumainn has joined #tripleo12:29
EmilienMjaosorior: well, you could override the container in tripleo-common but it's not clean imho12:29
TenguEmilienM: hello! could you add the missing +2 on that (now old… -.-) review? https://review.openstack.org/#/c/513274/ - hopefully next time it will be able to merge properly.12:29
EmilienMTengu: sure12:29
Tenguthanks! and sorry for the inconvenient :(12:29
EmilienMTengu: thanks for the work! very appreciated.12:29
Tenguwell, not a big thing.12:30
openstackgerritLukas Bezdicka proposed openstack/tripleo-common master: WIP - POC on callback plugin for ansible to collect result  https://review.openstack.org/51125412:31
Tengubtw, I'm a bit stuck understanding the issue on the other review https://review.openstack.org/#/c/512978/ - I'm a bit lost with the way to (re)find logs in order to point the issue. This time it's not a 143 error code…12:31
Tenguthus it's not a timeout. At least I know that now :)12:32
fultonjjust got here, looks like we hit an issue from https://review.openstack.org/#/c/514584 not being merged last night12:32
socialtherve: still super ugly https://review.openstack.org/#/c/511254/12:32
thervesocial, Looking12:35
*** pgadiya has joined #tripleo12:35
Tenguoh my… apparently it's an issue with neutron-openvswitch-agent not being installed o_O12:35
jaosoriorTengu: I thought that was a transcient issue12:35
openstackgerritRyan Brady proposed openstack/tripleo-common master: [WIP] Adds UpdateRoles Workflow  https://review.openstack.org/51504512:36
Tengujaosorior: well… apparently not that transient :'(12:36
Tengualthough I can run a re-check just to be sure12:36
jaosorioruhm12:37
Tengubut there's something fishy12:37
jaosoriorTengu: can you show me the log?12:37
Tengujaosorior: http://logs.openstack.org/78/512978/4/gate/legacy-tripleo-ci-centos-7-nonha-multinode-oooq/a10d87f/logs/undercloud/home/zuul/vxlan_networking.sh.log.txt.gz#_2017-10-24_21_08_30 at least12:37
Tengudigging in the other logs in zuul home12:37
*** trown|outtypewww is now known as trown12:38
Tenguok, openmvswitch is installed at least, according to the package log12:38
Tenguas well as neutron-client12:38
Tengupython2-neutronclient and puppet-neutron12:38
Tengubut apparently, something's missing in order to install… well, I guess, neutron-agent or something like that? Although that should be done at least in puppet-neutron I guess12:39
*** bobh has quit IRC12:39
jaosoriorright... I thought it would have been there :/12:39
Tenguin the log I just passed you, we can see openvswitch occurrences12:40
Tengui.e. "Installing : 1:openvswitch-2.7.2-3.1fc27.el7.x86_64"12:40
*** rbrady-afk is now known as rbrady12:40
*** rbrady is now known as Guest3282612:41
*** pgadiya has quit IRC12:41
Tenguneutron-openvswitch-agent package is in puppet-neutron at least.12:41
Tenguin the params.12:41
*** Guest32826 is now known as rbrady_12:41
*** ansmith has joined #tripleo12:41
*** rbrady_ has quit IRC12:41
*** rbrady_ has joined #tripleo12:41
Tenguand is the name for ovs_agent_neutron - that seems pretty good. maybe it's an issue in some pre-built image, jaosorior ?12:42
jaosoriorTengu: right... I'm honestly not sure. And it seems to fail in a really weird step too :/12:42
thervesocial, So don't make it up, pass it as an argument to your action12:42
jaosoriorTengu: http://logs.openstack.org/78/512978/4/gate/legacy-tripleo-ci-centos-7-nonha-multinode-oooq/a10d87f/job-output.txt.gz#_2017-10-24_21_15_51_493896   wtf12:42
Tengujaosorior: what's that step?12:43
Tengudelorean ?12:43
Tengui.e. the package repository?12:43
jaosoriorTengu: right it's setting the repos12:44
Tenguo_O12:45
Tengub-b-but if it's setting up the repos, how comes it wants to start a service that might be installed FROM those repositories?12:45
Tenguchicken-and-egg issue somewhere in the pipe?12:45
jaosoriorI'm pretty confused12:46
Tenguwell. I should feel reassured, but in fact, I'm not :D12:46
jaosoriorTengu: does that issue appear every time you recheck?12:46
Tenguhmm, last rechecks were due to timeout (err 143)12:46
TenguI've commented the recheck reason on that purpose: know what were the causes.12:47
*** dbecker has joined #tripleo12:47
jaosoriorI kinda think it's transcient12:47
Tenguso maybe I can re-run a recheck in order to ensure it's a non-transient issue.12:47
Tengulet's check that then :)12:47
*** pchavva has joined #tripleo12:48
*** udesale has joined #tripleo12:48
Tengujaosorior: ordered the recheck12:48
Tenguwe'll see. maybe the CI will explode ? :)12:48
Tenguor we'll create some mighty black hole? :))12:49
jaosoriorwell12:49
jaosoriorwe had a good run12:49
Tengu:)12:49
*** pkovar has quit IRC12:50
EmilienMgfidente: I'm going to block the gate12:50
gfidente>12:50
gfidente?12:50
Tenguas long as my apache class in puppet-tripleo goes through, I'm happy. hopefully no more merge conflict.12:50
EmilienMgfidente: so https://review.openstack.org/#/c/513701/ is on top of the queue12:50
jaosoriorEmilienM: could you not abandon https://review.openstack.org/#/c/514543/ ? really need to fix that and backport it :/12:52
thervesocial, You haven't implemented queue_post too, right?12:52
EmilienMjaosorior: do you know we didn't have a promotion is almost 2 months?12:52
EmilienMjaosorior: everyone wants their code merged but we really need a promotion12:53
EmilienMjaosorior: so is more important than having a promotion?12:53
*** pgadiya has joined #tripleo12:53
socialtherve: no12:53
jaosoriorEmilienM: alright12:54
EmilienMjaosorior: like usual, I have to be sorry etc :-)12:54
EmilienMbut really we need support from the team12:54
*** EmilienM changes topic to "CI status: RED - do not approve or recheck or rebase any patch | http://tripleo.org/ | https://docs.openstack.org/tripleo-docs/latest/"12:54
*** bkopilov_ has joined #tripleo12:55
Tengunooooooo12:55
Tengu:'(12:55
Tengugimme a rope, please :'(12:55
jaosoriorTengu: beer works as well12:55
adarazsTengu: sorry, I can't +workflow that request.12:55
*** cmyster has joined #tripleo12:56
Tengujaosorior: well, tonight there's a whisky discovery. guess that'll do as well :)12:56
Tenguadarazs: :Þ12:56
*** pgadiya has quit IRC12:56
openstackgerritJanki Chhatbar proposed openstack/tripleo-heat-templates master: Env files for ODL deployments  https://review.openstack.org/51250112:57
*** pkovar has joined #tripleo12:58
EmilienMall: http://lists.openstack.org/pipermail/openstack-dev/2017-October/123979.html13:00
Tengufair enough13:01
*** jmelvin has joined #tripleo13:02
TenguEmilienM: needing some help, or is the gate/ci just dedicated for the validation/promotion of the patches?13:03
openstackgerritRadomir Dopieralski proposed openstack/tripleo-heat-templates master: Enable horizon plugins by default in docker  https://review.openstack.org/51442113:05
*** jcoufal has joined #tripleo13:07
*** jpena|lunch is now known as jpena13:08
*** gvrangan has quit IRC13:09
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286413:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172522413:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]13:10
trozetmwhahaha: how do i get jenkins to recheck for https://review.openstack.org/#/c/511862/ ?13:10
openstackLaunchpad bug 1725224 in tripleo "Deployment with ceph and ansible 2.4 fails with: "WorkflowTasks_Step2_Execution: ERROR" "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'. Host key verification failed."" [Critical,In progress] - Assigned to Marius Cornea (mcornea)13:10
trozeti tonly seems to recheck zuul13:10
mwhahahatrozet: ignore Jenkins. We only care about zuul13:12
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart master: Use the new containers tag name for master and pike  https://review.openstack.org/51505213:12
trozetmwhahaha: oh well in that case it is +1 :) can you set workflow please?13:12
*** dciabrin has joined #tripleo13:13
*** ykarel has quit IRC13:15
*** ykarel has joined #tripleo13:15
*** bobh has joined #tripleo13:17
*** mrch has joined #tripleo13:20
bandiniEmilienM: thanks!13:22
EmilienMbnemec, therve : do you think multinode jobs (even ovb) timeouts can be related to the switch of Heat Convergence?13:23
*** cdearborn has joined #tripleo13:24
therveEmilienM, I don't have strong evidence, but yeah13:24
therveIt'd be surprising if it didn't have an impact13:24
*** lblanchard has joined #tripleo13:24
EmilienMtherve: our gate is in bad status13:25
*** toure_biab is now known as toure13:25
EmilienMtherve: we should investigate that convergence thing13:25
*** lblanchard has quit IRC13:25
EmilienMthe last time I checked nobody seemed worried iiuc13:25
therveI'm worried13:30
EmilienMtherve: I'm busy on clearing the gate now, if someone (you if you have time) can investigate heat convergence13:34
EmilienMI know zaneb had numbers or at least a tool to provide them13:34
zanebEmilienM: not any more, all the gate jobs changed their names & I haven't rewritten it yet13:35
*** pradk has quit IRC13:36
owalshEmilienM: guess we should update the nova keymgr hiera too - https://review.openstack.org/#/c/513767/2/puppet/services/barbican-api.yaml@17313:37
*** dbecker has quit IRC13:37
*** mdnadeem has quit IRC13:38
thrashtrozet: in the future, if you have a patch like that, you can rebase, and it will wipe jenkins and not come back.13:38
EmilienMzaneb: just add legacy-13:38
thrashtrozet: but I would not suggest that now. :D13:38
EmilienMowalsh: yes, we need - can you send it?13:38
zanebEmilienM: I mean several months back13:39
owalshEmilienM: sure13:39
EmilienMowalsh: thanks13:39
EmilienMstatus: gate is cleared13:40
zanebEmilienM: I was using the tripleo-ci-centos-7-ovb-nonha job, but it no longer exists so historical comparisons are meaningless13:40
openstackgerritMerged openstack-infra/tripleo-ci master: Fix space character for bash command  https://review.openstack.org/51343513:40
*** lblanchard has joined #tripleo13:41
matbudprince: hey, one note/question about the https://review.openstack.org/#/c/511350/ , its really nice to have this transformation of the undercloud.conf to deploy command, im wondering, is it would be sane to imagine a such overcloud.conf for the overcloud deployment13:41
matbudprince: instead of building such crazy deploy command with a tons of -e -e -e13:41
*** mdnadeem has joined #tripleo13:42
*** mdnadeem has quit IRC13:44
jristwhat's Sergey's irc, does anyone know?13:44
thrashmatbu: fwiw I'd be +1 to that. :D13:44
*** yamahata has joined #tripleo13:44
jristsshnaidm: ah - this might be related to the change you made and the changes Wes and I are working through https://bugs.launchpad.net/tripleo/+bug/171949013:45
openstackLaunchpad bug 1719490 in tripleo "UI is not browsable by default in OVB" [Medium,In progress] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)13:45
matbuthrash: +2 even ?? ;)13:45
thrashmatbu: haha13:45
sshnaidmjrist, sorry, on mtg now13:46
jristsshnaidm: no problem, it already has a patch13:46
*** sshnaidm is now known as sshnaidm|mtg13:46
dprincematbu: could do it there too. That would sort of be a new feature though and likely not cover the much larger set of Overcloud options available13:47
*** ecerquei has joined #tripleo13:47
*** amodi has joined #tripleo13:48
matbudprince: well i think that could cover all (and everything we want actually) and we could store and save the overcloud.conf in swift, then we could have a really good knowledge of what it has been deployed13:48
dprincematbu: but sure, we could look at alternate config formats. Whatever we do we'll want to be mindful of API's around them so that that you can drive the installation on the UI and the CLI alike13:48
EmilienMtrown: https://review.openstack.org/515070 FYI - found a way to do what you asked.13:50
trownEmilienM++ awesome!13:51
trownEmilienM: I dont totally understand that, but guess infra folks said that will help13:51
EmilienMtrown: iiuc, it will stop to run THT / tripleo-common / oooq i nthe same queue13:52
EmilienMtrown: each project will have its own queue13:52
EmilienMI need to verify with pabelanger that it doesn't add more problems thatn we have not13:52
EmilienMnow*13:52
trownoh right13:52
trownnice13:52
*** jlinkes has quit IRC13:52
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates master: update nova keymgr parameter for Queens  https://review.openstack.org/51507313:53
EmilienMowalsh: thanks a lot13:54
*** rbowen has joined #tripleo13:55
*** yamahata has quit IRC13:55
*** jkilpatr has quit IRC13:56
*** mrch has quit IRC13:57
socialEmilienM: the ansible issue is ordering of generated inventory - first real hosts, than roles, than meta groups so [overcloud-controller1] <ip> [Controller] overcloud-controller1 [overcloud] Controller13:58
socialEmilienM: and overcloud misses vars13:58
EmilienMsocial: woot?13:59
matbuwoot woot13:59
EmilienMmissing context here13:59
socialEmilienM: ansible 2.4 issue where it skips all hosts? matbu do we have some bug?14:00
EmilienMhttps://bugs.launchpad.net/tripleo/+bug/1725224 ?14:00
openstackLaunchpad bug 1725224 in tripleo "Deployment with ceph and ansible 2.4 fails with: "WorkflowTasks_Step2_Execution: ERROR" "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'. Host key verification failed."" [Critical,In progress] - Assigned to Marius Cornea (mcornea)14:00
*** mdnadeem has joined #tripleo14:00
matbuBZ, not sure if we have something in LP14:00
socialthat is different one :)14:00
matbuEmilienM: this is not the same issue14:00
EmilienMok14:00
socialbut it's related :)14:00
EmilienMdang14:00
EmilienMwill it block promotion pipeline?14:00
EmilienMwhy don't we pin ansible 2.3 in that case14:01
socialEmilienM: /var/run/mistral as HOME env for mistral14:01
EmilienMI guess 2.4 is super cool and everyone wants it14:01
*** chlong_ has joined #tripleo14:01
socialEmilienM: I don't understand why we create mistral user with home set to /home/mistral ,)14:01
EmilienMgfidente: scenario001 failing on https://review.openstack.org/#/c/513701/ :(14:02
matbuEmilienM: hmm14:02
EmilienMsocial: I'm sorry but I don't get your context and why you ping me about that14:03
gfidenteEmilienM I see it passing?14:03
EmilienMgfidente: watch zuul14:03
EmilienMhttp://logs.openstack.org/01/513701/3/check/legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-container/0dfa4e7/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2017-10-25_13_51_2214:03
EmilienMtimeout14:03
thervezaneb, EmilienM: we can always revert and compare the timings/resources14:03
*** liverpooler has quit IRC14:03
EmilienMtherve: i'm all for it, tbh14:03
socialEmilienM: U thought you have this ansible issue, sorry14:03
therveOK let's do that then14:04
d0ugalsocial: I don't think the mistral user has the home directory for any particular reason14:04
EmilienMsocial: no worries14:04
d0ugalsocial: it was just done in the initial version of the rpm spec - copied from somewhere I guess?14:04
openstackgerritThomas Herve proposed openstack/instack-undercloud master: Revert "Enable convergence engine on the undercloud"  https://review.openstack.org/51507714:05
EmilienMtherve: we need to rebase it ^14:05
therveYeah let me abandon that one14:06
EmilienMgfidente: damn... we have to recheck :(14:06
*** yamahata has joined #tripleo14:07
EmilienMgfidente: i'm going to rebase https://review.openstack.org/#/c/513701/ so it runs again in check, and hope it pass this time.14:08
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: Use ANSIBLE_HOST_KEY_CHECKING var instead of ssh-common-args  https://review.openstack.org/51370114:08
EmilienMgfidente: any idea why it timeouts?14:09
openstackgerritThomas Herve proposed openstack/instack-undercloud master: Revert "Enable convergence engine on the undercloud"  https://review.openstack.org/51507814:10
*** masco has quit IRC14:10
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286414:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172522414:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]14:10
openstackLaunchpad bug 1725224 in tripleo "Deployment with ceph and ansible 2.4 fails with: "WorkflowTasks_Step2_Execution: ERROR" "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'. Host key verification failed."" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)14:10
*** abregman is now known as abregman|mtg14:10
trozetthanks thrash14:10
EmilienMgfidente: I'm abandoning a bunch of things in check as well, to have the tripleo-common patch testing again14:14
gfidenteEmilienM hmm have a link to the last run logs?14:14
trozetthrash can you set workflow on it please?14:15
EmilienMgfidente: a sec14:16
EmilienMgfidente: http://logs.openstack.org/01/513701/3/check/legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-container/0dfa4e7/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2017-10-25_13_51_2214:16
gfidenteEmilienM looks like it didn't even get to boot the nods14:18
EmilienMgfidente: ?14:18
EmilienMgfidente: it's a multinode jobs, which node are you talking about14:18
gfidentefrom the overcloud deploy log14:19
gfidenteit didn't even start step114:19
EmilienMgfidente: ouch14:19
EmilienMgfidente: I haven't looked deeper tbh14:19
*** dbecker has joined #tripleo14:20
EmilienMI'm trying to get the patch rechecked14:20
EmilienMbut still enqueued14:20
gfidenteyes so slagle is probably our guy here14:20
gfidenteslagle any clue what is happening here http://logs.openstack.org/01/513701/3/check/legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-container/0dfa4e7/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2017-10-25_13_51_22 ?14:20
EmilienMok it's enqueued14:20
EmilienMI mean, jobs are runnning again now14:20
EmilienMtherve: thx, +214:23
EmilienMtherve: hopefully we can get bnemec / slagle feedbacks as well14:23
owalshgfidente, EmilienM: AFAIK slagle is on PTO14:24
*** pblaho has quit IRC14:24
EmilienMah right, I always forgot about PTOs14:24
bnemecEmilienM: I will note that the timeouts started happening before we turned on convergence, so that's likely not a silver bullet here.14:24
*** yamahata has quit IRC14:25
bnemecIt may have no effect whatsoever, but I'm okay with trying it.14:25
therveEmilienM, Yeah I'd like to get some timings first14:25
* bnemec hopes nobody is CD'ing TripleO14:25
ansiwenEmilienM: another question, why did you choose "ec2api.tests.functional.api.test_key_pairs.KeyPairTest". Is it the idea, that we don't do full tempest tests, but just a few functional tests, that prove that the service is running?14:25
gfidentetherve so from http://logs.openstack.org/01/513701/3/check/legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-container/0dfa4e7/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2017-10-25_13_51_2214:25
bnemecAlthough I guess if they already deployed a convergence stack successfully that's okay.14:25
EmilienMansiwen: randomly14:26
EmilienMansiwen: just to test API14:26
openstackgerritPradeep Kilambi proposed openstack/python-tripleoclient master: Support to drive undercloud deploy via undercloud.conf  https://review.openstack.org/51135014:26
*** udesale has quit IRC14:26
*** rbowen has quit IRC14:26
EmilienMbnemec: I'll repeat what I commented in therve's review: anything that is "suspect" today is imho something we should consider, even if at the end it was not that.14:26
EmilienMbnemec: we're in a stage where we consider any option that can help or not14:27
EmilienMdisabling convergence is one of them14:27
*** pradk has joined #tripleo14:27
bnemecEmilienM: That's fine, but randomly reverting stuff without any evidence may just confuse things further.14:27
bnemecDoes anybody have numbers on how long overcloud deploys are taking with convergence vs. without?14:28
*** yolanda has quit IRC14:28
*** pblaho has joined #tripleo14:29
ansiwenEmilienM: I see14:29
EmilienMbnemec: we probably lost the data14:29
*** udesale has joined #tripleo14:30
ykarel#tripleo is featureset021 running somewhere, i need to verify something14:30
EmilienMykarel: not sure what jobname it is.14:31
*** liverpooler has joined #tripleo14:32
ykarelEmilienM, i mean is featureset021 running in any job?14:32
* EmilienM doesn't know14:32
* ykarel Ok14:33
*** dhill_ has quit IRC14:33
*** dhill_ has joined #tripleo14:38
zanebbnemec: afaik there isn't a job running without convergence against which to compare14:40
*** ykarel_ has joined #tripleo14:40
zanebbnemec: but I agree that we should look at the CI results from the revert patch before just merging it14:41
*** ykarel has quit IRC14:41
bnemeczaneb: Yeah, I've been trying to go back and find some old jobs from before we turned it on.14:41
bnemecBut even then, a lot has changed in the past month or so.14:41
*** abregman|mtg is now known as abregman14:42
zanebbnemec, EmilienM: maybe we should have a periodic job that runs with convergence disabled for the rest of Queens, so that we don't have to speculate?14:44
EmilienMzaneb: go for it14:44
ykarel_EmilienM, i found it featureset001  recently added as an experimental job: https://review.rdoproject.org/r/#/c/10248/14:45
ykarel_s/featureset001/featureset02114:46
*** dbecker has quit IRC14:50
*** akane has quit IRC14:50
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Validate roles data and network data  https://review.openstack.org/50856714:52
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Add a Get Networks workflow  https://review.openstack.org/50941914:52
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Add UpdateNetworks workflow  https://review.openstack.org/51346314:52
*** eggmaster has joined #tripleo14:53
*** oidgar has quit IRC14:54
*** yamahata has joined #tripleo14:54
*** ramishra has quit IRC14:56
*** raissa has joined #tripleo14:56
*** ykarel_ has quit IRC14:57
*** ykarel_ has joined #tripleo14:59
*** dmarlin has joined #tripleo15:00
*** ykarel_ is now known as ykarel15:01
*** dsariel has quit IRC15:03
*** cshastri has quit IRC15:04
*** sri_ has quit IRC15:07
TenguEmilienM: small question: one of my review was flagged as abandonned - is there a way to reactive it once the CI is free?15:08
*** psachin has quit IRC15:08
*** suuuper has quit IRC15:08
TenguEmilienM: ah, ok, you'll do it yourself. fine for me :).15:09
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286415:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172522415:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1725224 in tripleo "Deployment with ceph and ansible 2.4 fails with: "WorkflowTasks_Step2_Execution: ERROR" "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'. Host key verification failed."" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)15:10
gregworkdoes anyone have a working heat example of where br-ex (External bridge)'s northbound port is a vlan tagged interface ?15:10
EmilienMTengu: I'll take care of all of them15:14
gregworkive tried doing this but i believe its not sending tagged frames, doing an ip -d link show vlan200 doesnt report it is a vlan device , ive tried to use this to deploy https://paste.fedoraproject.org/paste/iHEYHcrFEwPt46shNmpTsQ15:15
*** achadha has joined #tripleo15:16
*** achadha has quit IRC15:16
*** dsariel has joined #tripleo15:18
TenguEmilienM: good luck :).15:18
*** achadha has joined #tripleo15:20
openstackgerritRadomir Dopieralski proposed openstack/tripleo-heat-templates stable/pike: Fix /etc/openstack-dashboard/ permissions for access to *policy.json  https://review.openstack.org/51510515:20
ludovicHello, is someone know what means when a overcloud deploy with the message  "The Resource ControllerConfig requires replacement"15:21
*** artom_ is now known as artom15:22
rookEmilienM isn't there a way to disable validations?15:24
rookI remember shardy mentioning it...15:24
rookbut I cannot remember how to do that.15:24
*** achadha has quit IRC15:24
EmilienM echo 'enable_validations = False' >> ~/undercloud.conf15:24
rookEmilienM++15:25
rookthanks15:25
*** achadha has joined #tripleo15:25
rookakrzos: ^15:26
openstackgerritRyan Brady proposed openstack/tripleo-common master: Adds Workflow to List Available Roles  https://review.openstack.org/50983215:29
akrzosEmilienM: no way to disable after install?15:30
*** chem has quit IRC15:32
*** hewbrocca is now known as hewbrocca_afk15:34
*** rodolof has quit IRC15:34
d0ugalthrash: Should we do something like this? or can I just use mistralclient from tempest tests? https://github.com/openstack/mistral/blob/master/mistral_tempest_tests/services/v2/mistral_client.py15:36
thrashd0ugal: We probably want to do it ourself. You wouldn't want to start having dependencies for tests.15:37
d0ugalthrash: I guess - althought we already depend on it normally and we have other test deps (test-requirements.txt)15:38
thrashd0ugal: I'm thinking more from an RPM perspective15:38
d0ugalbut I think it might be needed for tempest anyway15:39
thrashIdeally tempest plugins should be self-contained, IMHO15:39
d0ugalk15:40
toskythrash: well, it depends15:41
toskythrash: if you want to write a (let's say) a mistral test that use sahara, the sahara client for tempest is in the Sahara tempest plugin15:42
toskyso plugins could have dependencies on other plugins15:42
toskytempest plugins, in this context15:42
thrashtosky: is that dependency captured in the packaging?15:42
toskythrash: it can be captured in the requirements.txt, why can't it be captured in the packaging?15:42
bnemecgregwork: I'm not a vlan expert, but that looks right to me.  Is it possible that traffic isn't getting routed properly because the external interface doesn't have a default route configuration?15:44
thrashtosky: I'm not saying it's not possible... Just saying that it's not ideally.15:44
thrash*ideal15:44
toskythrash: why not?15:44
toskyit's like any other dependency on a library or a component15:45
thrashbut like I said, not a strong opinion. Just my opinion.15:45
toskythat's why I'd like to understand why it's not ideal; which complications do you foresee?15:45
*** pcaruana has quit IRC15:49
thrashtosky: Just not having to touch any other component.15:49
thrashand i include the packaging in that.15:50
thrashAnd it's not really that big of a deal to use a rest api.15:50
toskyas I mentioned, I don't see how it is different from the usual scenario of "program which depends on a set of libraries which depends on other libraries"15:51
*** yamahata has quit IRC15:51
toskythrash: although, rereading your discussion, it looks like a slightly different issue; you were assessing whether use the mistralclient or use the native tempest client in the Mistral Tempest plugin15:53
d0ugaltosky: well, that was my initial confusion :)15:54
toskyin that case, it is correct to *not* use the mistralclient; tempest tests should not use the official python clients15:54
*** bcafarel has quit IRC15:54
toskyI was talking in general about possible dependencies between tempest plugins15:54
toskywhich is a different use case15:54
d0ugaltosky: yeah, I figured that bit out eventually15:54
toskyok, so sorry for the confusion on my side15:54
*** bcafarel has joined #tripleo15:54
thrashtosky: no worries. You input is valued.15:54
thrash*Your15:55
d0ugaland at least a bit on my side :)15:55
*** abregman has quit IRC15:58
EmilienMtrown, adarazs: do we need https://review.openstack.org/#/c/515052/ urgently for getting promotion as well?15:59
*** dparkes has quit IRC15:59
*** thrash is now known as thrash|eatz16:00
*** itlinux has joined #tripleo16:01
*** achadha has quit IRC16:01
*** mcornea has quit IRC16:02
EmilienMpanda|rover|off: do you know ^16:02
*** benone has quit IRC16:04
adarazsEmilienM: for getting promotion: no. for using fresh images after a successful master promotion: yes16:04
adarazs*container images16:04
EmilienMok so the answer is yes we need it asap16:05
EmilienMbut I guess it can wait a few more hours since we need to actually promote first16:06
adarazsEmilienM: but after somebody makes the "current-tripleo" tags on images like https://hub.docker.com/r/tripleomaster/centos-binary-nova-scheduler/tags/ -- otherwise container jobs will break.16:06
adarazsfor master.16:06
*** benone has joined #tripleo16:06
*** iranzo has quit IRC16:07
EmilienMadarazs: who is "somebody"? we need to identify who and when now16:07
EmilienMso we're ready to take this action.16:07
adarazspanda|rover|off: said he will do it, but we're after a marathon meeting (still on it) and I'm not sure he'll be able to do it today.16:08
*** janki has quit IRC16:09
adarazsEmilienM: I'd wait until we get a master promotion and then submit https://review.openstack.org/#/c/515052/ -- probably easier.16:10
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286416:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172522416:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]16:10
openstackLaunchpad bug 1725224 in tripleo "Deployment with ceph and ansible 2.4 fails with: "WorkflowTasks_Step2_Execution: ERROR" "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'. Host key verification failed."" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)16:10
ansiwenEmilienM: so puppet-tempest is not involved there right? so whatever I implemented there to create the right testing environment, I would have to reimplement in ansible/python/whatever again, right?16:10
EmilienMansiwen: it's not.16:10
EmilienMadarazs: ok16:11
ansiwenEmilienM: because I implemented providers there for credentials and stuff... I wonder how to realize that in quickstart now16:11
*** benone has quit IRC16:13
itlinuxhello all... any tips about ControllerDeployment_Step3 failed?16:14
panda|rover|offI'll do it this evening16:15
*** panda|rover|off is now known as panda|ruck16:15
itlinuxit gives me this code status_reason | deploy_status_code : Deployment exited with non-zero status code: 116:15
*** benone has joined #tripleo16:15
*** ebarrera has quit IRC16:16
*** ebarrera has joined #tripleo16:16
openstackgerritThomas Herve proposed openstack/instack-undercloud master: Set notification_bind on zaqar websocket  https://review.openstack.org/51512316:18
therveEmilienM, ^^^should fix the zaqar issue16:18
EmilienMtherve: thank you16:19
therveI found that was indeed a source of timeout, though relatively (?) rare, ie ipv6 only envs that are out there16:19
* adarazs logs off for today, see ya16:20
EmilienMtherve: I agree it was rare, when we investigate with Alex, we had 10 hits per week on average16:20
EmilienMtherve: a weird race16:20
EmilienMtherve: I'm glad you found the fix, thx again16:20
therveEmilienM, Yeah not race, just host sets as IPv616:21
therveSee http://logs.openstack.org/11/510411/16/check/legacy-tripleo-ci-centos-7-scenario003-multinode-oooq/71794dd/logs/undercloud/etc/hosts.txt.gz for example16:21
thervecentos-7-vexxhost-ca-ymq-1-0000443478 will only resolve as IPv616:21
therveThat confuses zaqar unfortunately16:21
EmilienMtherve: oh,you mean when infra providers have ipv6 ok16:21
EmilienMso we have ipv6 jobs :D16:21
EmilienM(in some sort)16:22
therveYeah...16:22
therveThat don't work :D16:22
*** aufi has quit IRC16:22
*** ykarel has quit IRC16:23
*** tesseract has quit IRC16:25
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: RHSM: when using proxy, test its connectivity first  https://review.openstack.org/51353016:27
*** trown is now known as trown|lunch16:27
*** anshul has quit IRC16:30
*** daidv has quit IRC16:32
*** Goneri has quit IRC16:33
*** jpena is now known as jpena|brb16:34
*** udesale has quit IRC16:35
*** chlong_ has quit IRC16:37
*** lucasagomes is now known as lucas-afk16:38
*** sshnaidm|mtg is now known as sshnaidm16:40
*** yprokule has quit IRC16:42
*** Goneri has joined #tripleo16:44
EmilienMtherve: https://review.openstack.org/515123 is backportable I think (to pike at least?)16:50
EmilienMbut maybe ocata as well16:51
pabelangerEmilienM: you are no longer sharing a queue with openstack/mistral, possible something you may or may not want to fix. In v2 you did16:53
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo stable/newton: Prepare puppet-tripleo 5.6.5  https://review.openstack.org/51513216:54
EmilienMpabelanger: we don't want.16:54
*** marios has quit IRC16:55
pabelangerEmilienM: okay, they look to be running tripleo jobs, keep in mind they could land code that break you now16:55
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo stable/ocata: Prepare puppet-tripleo 6.5.4  https://review.openstack.org/51513416:56
*** derekh has quit IRC16:56
*** ccamacho has quit IRC16:57
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo stable/pike: Prepare puppet-tripleo 7.4.3  https://review.openstack.org/51513516:57
EmilienMpaok16:57
EmilienMpabelanger: ok16:57
*** panda|ruck is now known as panda|ruck|bbl16:58
*** dmacpher has quit IRC16:58
*** jfrancoa has quit IRC17:00
*** sri_ has joined #tripleo17:00
*** gfidente is now known as gfidente|afk17:00
*** amodi has quit IRC17:00
*** dtantsur is now known as dtantsur|afk17:01
*** morazi has quit IRC17:01
openstackgerritEmilien Macchi proposed openstack/tripleo-ui stable/pike: Prepare tripleo-ui 7.4.3  https://review.openstack.org/51513717:02
*** benone has quit IRC17:05
*** fragatina has quit IRC17:05
*** salmankhan has quit IRC17:06
*** achadha has joined #tripleo17:08
*** benone has joined #tripleo17:09
*** salmankhan has joined #tripleo17:09
openstackgerritSven Anderson proposed openstack/tripleo-quickstart master: TEST DON'T MERGE - Enabling EC2-API Tempest tests.  https://review.openstack.org/51513917:10
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286417:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172522417:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]17:10
openstackLaunchpad bug 1725224 in tripleo "Deployment with ceph and ansible 2.4 fails with: "WorkflowTasks_Step2_Execution: ERROR" "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'. Host key verification failed."" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)17:10
*** achadha_ has joined #tripleo17:12
*** achadha has quit IRC17:12
honzadprince: I was able to create a containerized undercloud with containers-rdo.yaml.  Otherwise, I'd get 'docker pull' errors (connection refused)17:13
honzadprince: Is there any downside to using rdo?17:13
*** achadha_ has quit IRC17:13
*** achadha has joined #tripleo17:13
*** achadha has quit IRC17:15
*** achadha has joined #tripleo17:15
*** achadha has quit IRC17:16
EmilienMI need to step up for 40min, if someone can monitor 513701 in zuul and notify pabelanger if it failed again, so we retry. Or keep looking why it failed. We need this patch merged asap. Thanks17:20
*** achadha has joined #tripleo17:23
*** achadha has quit IRC17:23
*** achadha has joined #tripleo17:23
*** dmsimard is now known as dmsimard|afk17:23
*** cylopez has quit IRC17:24
*** ebarrera has quit IRC17:24
openstackgerritMerged openstack/instack-undercloud stable/pike: Provide LOCAL_IP_WRAPPED as a instack env variable  https://review.openstack.org/51375817:26
*** rmascena has joined #tripleo17:28
*** fragatina has joined #tripleo17:30
*** bobh has quit IRC17:30
*** raildo has quit IRC17:30
*** trown|lunch is now known as trown17:34
*** thrash|eatz is now known as thrash17:36
*** Goneri has quit IRC17:38
*** rwsu has quit IRC17:40
amoralejovb jobs are failing because overcloudrd is using keystone v2, is that known issue https://review.rdoproject.org/jenkins/job/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/260/console?17:41
*** mdnadeem has quit IRC17:41
*** Goneri has joined #tripleo17:43
dprincehonza: no downside to using RDO. we should perhaps make it the default I think17:44
*** dsariel has quit IRC17:45
*** dparkes has joined #tripleo17:47
*** jpena|brb is now known as jpena17:48
*** tosky has quit IRC17:50
*** amodi has joined #tripleo17:51
*** gkadam has quit IRC17:54
EmilienMamoralej: it should be fixed17:54
EmilienMamoralej: let me check the failure17:54
amoralejhttps://bugs.launchpad.net/tripleo/+bug/172745417:54
openstackLaunchpad bug 1727454 in tripleo "OS_AUTH_URL in overcloudrc points to keystone API v2.0" [Undecided,Triaged]17:54
amoralejEmilienM, ^17:54
amoraleji filled a LP17:54
amoralejjobs are failing as we talk and i couldn't fine a review for that17:54
amoralejmaybe i didn't look for it in the right project17:55
EmilienMlet me check, I thought we fixed all blockers on that regard17:55
EmilienMhttps://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/3042841/undercloud/home/jenkins/overcloud_deploy_post.log.txt.gz#_2017-10-25_17_32_5217:56
EmilienMis it the pingtest?17:56
amoralejit's before ping test17:57
EmilienMamoralej: we need to patch https://git.openstack.org/cgit/openstack/tripleo-common/tree/tripleo_common/utils/overcloudrc.py maybe17:57
amoralejbut for some reason is not happening in multinode17:57
amoralejonly ovb17:57
EmilienMok17:57
*** ludovic has quit IRC17:58
EmilienMinstead of sourcing /home/jenkins/overcloudrc we should source overcloudrcv317:58
EmilienMand also remove /home/jenkins/overcloudrc17:58
openstackgerritToure Dunnon proposed openstack/python-tripleoclient master: Tripleoclient unified queue name.  https://review.openstack.org/50990217:59
fultonjit looks like https://review.openstack.org/#/c/513701 is blocked by rdo-kolla-build-integration, which failed because ERROR:kolla.image.build:opendaylight Failed : https://review.rdoproject.org/jenkins/job/rdo-kolla-build-integration/858/console17:59
amoralejwe are keeping separated overcloudrc for v2 and v3 ?17:59
amoralejthat's tricky imho17:59
EmilienMyeah17:59
EmilienMI want to first see where we source overcloudrc17:59
EmilienMI think it's in quickstart-extras: roles/validate-sanity-checks/templates/validate-sanity-checks.sh.j2:18:00
amoralejhttps://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/overcloud-deploy/templates/overcloud-deploy-post.sh.j2#L4118:00
amoralejEmilienM, ^18:00
EmilienMnice18:01
EmilienMamoralej: well not nice18:01
amoralejwouldn't be easier to have a valid overcloudrc ?18:01
EmilienMamoralej: I'm afraid we source overcloudrc somewhere else18:01
EmilienMamoralej: yes18:01
EmilienMamoralej: I'm looking at tripleo-common now18:02
*** artom has quit IRC18:04
EmilienMamoralej: the change in tripleo-common isn't as easy and might require some work18:05
amoralejEmilienM, i'm leaving, so multinode jobs are passing, ovb are failing because of this18:05
amoralejand container build is still running, but looks in good shape18:06
EmilienMbut we need to change tripleo.deployment.overcloudrc18:06
*** jpena is now known as jpena|off18:06
EmilienMok18:06
EmilienMamoralej: thx..18:06
*** pkovar has quit IRC18:07
fultonjEmilienM: regarding https://review.openstack.org/#/c/513701, do you think my assesment ^ is correct?18:08
EmilienMfultonj: rdo-kolla-build-integration isn't voting18:09
EmilienMfultonj: I don't know much about this job18:09
EmilienMfultonj: dmsimard|afk knows and can maybe help on this one18:09
fultonjit doesn't have non-voting next to it18:09
EmilienMit's third party right?18:09
EmilienMso it's not voting18:09
fultonjok18:09
*** amoralej is now known as amoralej|off18:09
fultonjso we're still waiting for the rest of the test since you workflowed it then18:10
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286418:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172522418:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]18:10
openstackLaunchpad bug 1725224 in tripleo "Deployment with ceph and ansible 2.4 fails with: "WorkflowTasks_Step2_Execution: ERROR" "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'. Host key verification failed."" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)18:10
EmilienMfultonj: yeah i'm watching it in gate18:10
fultonjok, thanks18:10
EmilienMd0ugal, thrash, rbrady_ : you guys can help on https://bugs.launchpad.net/tripleo/+bug/1727454 ? Otherwise I'll take a look18:11
openstackLaunchpad bug 1727454 in tripleo "OS_AUTH_URL in overcloudrc points to keystone API v2.0" [Critical,Triaged]18:11
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates master: Set metric procssing delay for metricd  https://review.openstack.org/51123618:12
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DNM: test playbook with ansible debug  https://review.openstack.org/51515718:13
therveEmilienM, Would need to check puppet-zaqar for the backport18:13
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DNM: test playbook with ansible debug  https://review.openstack.org/51515718:14
*** paramite has quit IRC18:14
EmilienMtherve: let me know, I'll approve it in puppet18:15
*** jprovazn has quit IRC18:16
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart-extras master: Provide a quick workaround for 1727454  https://review.openstack.org/51516118:16
EmilienMamoralej|off: ^18:17
*** artom has joined #tripleo18:17
rbrady_Emilien: I'm about to go afk, but is it a timing issue between lines 109-112 and 114-119 in https://github.com/openstack/tripleo-common/blob/master/tripleo_common/utils/overcloudrc.py18:18
*** bogdando has quit IRC18:19
rbrady_Emilien: disregard, it sets v3 a little further below those lines18:19
*** tosky has joined #tripleo18:22
trownEmilienM: just one job left ...18:24
itlinuxdoes anyone know how I can implement Mistral?18:24
itlinuxthanks..18:24
*** Goneri has quit IRC18:25
d0ugalEmilienM: I can look tomorrow if you don't have any luck.18:28
d0ugalitlinux: what do you mean by implement Mistral?18:28
*** rbrady_ is now known as rbrady-afk18:30
itlinuxthe dev team wants to use Mistral on the project.. so I wonder on how they can consume that service..18:34
itlinuxI trying to understand on how they want to use it.. looks like AWS has something similar.. so I am trying to move them to OS on premis..18:35
*** catintheroof has joined #tripleo18:35
d0ugalitlinux: so you want to know how to deploy Mistral?18:35
*** Goneri has joined #tripleo18:36
*** fzdarsky is now known as fzdarsky|afk18:39
*** yolanda has joined #tripleo18:40
itlinuxyes18:40
itlinuxfor the overcloud not under..18:40
*** catintheroof has quit IRC18:41
*** catintheroof has joined #tripleo18:41
*** rlandy is now known as rlandy|brb18:44
*** atoth has quit IRC18:46
*** brian83 has quit IRC18:48
EmilienMtrown: yeah i'm also watching it like a movie18:48
EmilienMd0ugal: ok thank you very much18:48
EmilienMd0ugal: in the meantime, https://review.openstack.org/#/c/515161/18:49
EmilienMtrown: if you can take a look at ^ when you have 2 min18:49
trownEmilienM: not exactly a fall blockbuster18:49
*** catintheroof has quit IRC18:49
EmilienMtrown: sorry what?18:49
*** catintheroof has joined #tripleo18:50
*** newmember has joined #tripleo18:50
* EmilienM google that18:50
trownEmilienM: just continuing your movie joke :P18:50
EmilienMok I google it :D18:50
trownzuul console is not going to win an academy award is all I was saying18:50
EmilienMtrown: I feel like it's going to timeout :(18:51
trownthough at least we have a web console again... thats pretty nice18:51
EmilienMbut i don't want to be pessimist18:51
EmilienMtrown: it failed18:54
EmilienM143, it's timeout...18:54
* EmilienM takes lunch break...18:54
EmilienMtrown: maybe we could investigate where it failed and ask pabelanger to promote again in the gate18:54
EmilienMI'm out 15 min18:54
openstackgerritVincent S. Cojot proposed openstack/tripleo-heat-templates master: Adds checking proxy server before using it.  https://review.openstack.org/51517218:56
openstackgerritChristian Schwede proposed openstack/tripleo-heat-templates master: Fix networking settings for ObjectStorage role  https://review.openstack.org/51517518:58
itlinuxwhat's the best way to set fernet as a token provider since ocata has UUID as default..18:59
itlinuxI have this now http://paste.openstack.org/show/624639/19:00
*** benone has quit IRC19:06
* EmilienM back19:08
trownEmilienM: not much to go on :(19:08
trownEmilienM: http://logs.openstack.org/01/513701/4/gate/legacy-tripleo-ci-centos-7-scenario001-multinode-oooq/f1261a0/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz19:09
EmilienMpabelanger: could we please recheck https://review.openstack.org/#/c/513701 a last time and promote in the gate. Next step if that fails again is disabling voting.19:09
EmilienMtrown: yeah it's odd19:09
*** benone has joined #tripleo19:09
* trown goes to catch the bus, brb19:09
*** trown is now known as trown|brb19:09
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286419:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172522419:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172745419:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]19:10
fultonjhttps://review.openstack.org/#/c/513701 just failed scenario001-multinode-oooq19:10
openstackLaunchpad bug 1725224 in tripleo "Deployment with ceph and ansible 2.4 fails with: "WorkflowTasks_Step2_Execution: ERROR" "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'. Host key verification failed."" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)19:10
openstackLaunchpad bug 1727454 in tripleo "OS_AUTH_URL in overcloudrc points to keystone API v2.0" [Critical,Triaged]19:10
EmilienMfultonj: yeah that's what we said with trown|brb :(19:11
EmilienMfultonj: I'm looking at logs now19:11
*** cdearborn has quit IRC19:13
EmilienMbnemec: I confirm your comment about convergence, I haven't seen any improvement by disabling it19:13
EmilienMbnemec: I looked at multinode-container19:13
EmilienMthe timeout could be related to http://logs.openstack.org/01/513701/4/gate/legacy-tripleo-ci-centos-7-scenario001-multinode-oooq/f1261a0/logs/undercloud/var/log/zaqar/zaqar.log.txt.gz#_2017-10-25_17_14_48_33519:14
EmilienMwhat therve is fixing right now19:14
fultonji'm in ara looking at that failed task http://logs.openstack.org/01/513701/4/gate/legacy-tripleo-ci-centos-7-scenario001-multinode-oooq/f1261a0/ara/19:14
EmilienMhttps://review.openstack.org/#/c/515123/ might help19:14
EmilienMfultonj: you want to look at ara-oooq then19:15
EmilienMara is ansible from zuul v3 iiuc19:15
EmilienMand ara-oooq is from tripleo quickstart (the actual tripleo things)19:15
fultonjthanks EmilienM19:17
*** dtrainor has quit IRC19:19
*** cdearborn has joined #tripleo19:19
*** trown|brb is now known as trown19:20
*** dtrainor has joined #tripleo19:21
EmilienMcan someone review https://review.openstack.org/#/c/515161/1 please19:24
EmilienMtrown, fultonj: 513701 was enqueued in the gate (thanks pabelanger) - we said that if that fails again, we'll disable voting on the 2 jobs that timeout. Unless we have a better solution.19:26
trownpanda|ruck|bbl: sshnaidm could you look at https://review.openstack.org/#/c/515161/119:28
trownEmilienM: cool, it is always the same jobs?19:28
EmilienMtrown: sounds like scenario001 yeah19:28
trownodd19:28
fultonjEmilienM: ack, thanks19:28
EmilienMlet me look cistatus19:28
EmilienMlegacy-tripleo-ci-centos-7-scenario001-multinode-oooq-container has 92% of failure today !!!!!!!!!!19:29
EmilienMsorry for the !!! but well19:29
EmilienMlegacy-tripleo-ci-centos-7-containers-multinode has 86%19:29
EmilienMtrown, fultonj : I'm preparing a patch to disable voting on this job. So we're ready19:30
fultonjEmilienM: would you want to use the same strategy for the pike backport https://review.openstack.org/#/c/514584 ?19:30
EmilienMlegacy-tripleo-ci-centos-7-scenario001-multinode-oooq-container  doesn't timeout on pike19:31
EmilienMright?19:31
EmilienMlegacy-tripleo-ci-centos-7-scenario004-multinode-oooq-container  did though19:32
fultonji see, so the same strategy, even if you did it would have no effect19:33
EmilienMi'm disabling voting on both19:33
*** benone has quit IRC19:34
EmilienMhttps://review.openstack.org/51518319:35
*** benone has joined #tripleo19:38
*** cylopez has joined #tripleo19:38
*** rwsu has joined #tripleo19:38
*** thrash is now known as thrash|bbl19:39
*** rlandy|brb is now known as rlandy19:40
*** atoth has joined #tripleo19:41
trownEmilienM: https://review.openstack.org/#/c/513701/ timed out on the non-container one19:42
EmilienMtrue19:43
fultonjis the goal here to get 513701 in or reduce the high demand to get it in by making it non-voting until 513701 gets in?19:43
EmilienMshould we disable voting on scenario001 and 004 on both container and non container?19:43
EmilienMfultonj: goal is to get 51370119:43
EmilienMand the backport at some point19:44
EmilienMbut I'm more concerned by master now19:44
EmilienMwe got pike promotion 1 day ago19:44
trownEmilienM: seems safest to do both, so we can get what we need for promotion (before something else breaks)19:45
fultonjso to get 513701 in, by unvoting the jobs blocking it, it should be scenario001-multinode-oooq which is diabled, right?19:45
*** Goneri has quit IRC19:46
EmilienMI'm looking at http://cistatus.tripleo.org/19:46
EmilienMlegacy-tripleo-ci-centos-7-scenario001-multinode-oooq is pretty solid19:46
EmilienMlegacy-tripleo-ci-centos-7-scenario001-multinode-oooq-puppet a bit less19:47
EmilienMbut still good19:47
EmilienMthough legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-container is killing us19:47
EmilienM legacy-tripleo-ci-centos-7-scenario004-multinode-oooq-container is bad as well19:47
EmilienMfor now, i'll just disable on non containers19:48
EmilienMbased on numbers from http://cistatus.tripleo.org/19:48
EmilienMsuggestions are welcome19:48
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: Create root ssh folder if not existing  https://review.openstack.org/51518519:48
fultonji figured scenario001-multinode-oooq-container would stop killing us once 513701 was in19:48
sshnaidmtrown, I think this will solve your issue with rdo cloud and playbook, try to depend on it: https://review.openstack.org/51518519:49
*** jmelvin has quit IRC19:49
fultonji mispoke19:50
trownsshnaidm: k I moved that in my patch series... I will make the same change though in the patch that moves it19:50
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart-extras master: Add steps needed when using OVB with a testenv broker  https://review.openstack.org/51279819:51
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DNM: test playbook with ansible debug  https://review.openstack.org/51515719:51
EmilienMfultonj: why?19:52
EmilienMfultonj: oh ok19:52
*** Goneri has joined #tripleo19:53
*** ecerquei_ has joined #tripleo19:54
*** dciabrin has quit IRC19:54
*** ecerquei has quit IRC19:54
EmilienMhttps://review.openstack.org/51518819:55
trownsshnaidm: made that change here https://review.openstack.org/#/c/512798/7/playbooks/prepare-slave.yml lots of the patches are abandoned now to get promote patches through, will hopefully check it tommorrow19:55
stevebakerdprince: hey!19:55
dprincestevebaker: hey19:55
stevebakerdprince: I'm just thinking of whether we should do auto detection of insecure registry https://bugs.launchpad.net/tripleo/+bug/172263219:57
openstackLaunchpad bug 1722632 in tripleo "Prepare command to detect need to set DockerInsecureRegistryAddress" [High,In progress] - Assigned to Steve Baker (steve-stevebaker)19:57
stevebakerdprince: https://review.openstack.org/#/c/514473/19:57
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DNM: test  https://review.openstack.org/51518919:58
dprincestevebaker: looking now19:58
*** achadha has quit IRC19:58
*** achadha has joined #tripleo19:58
*** achadha has quit IRC19:59
*** achadha has joined #tripleo20:00
*** Goneri has quit IRC20:01
fultonjEmilienM: regarding https://review.openstack.org/#/c/51518820:04
fultonjWe see scenario001-multinode-oooq-container failing and I think it's beacuse the ansible 2.4 upgrade, and the fix to deal with it is 513701, right?20:04
EmilienMwe don't have ansible 2.4 in gate or do we?20:04
EmilienMlet me check20:04
EmilienMwe do have20:05
trownya in packages we have ansible 2.420:05
EmilienMso 513701 is needed anyway, right20:05
fultonjyes20:05
trownquickstart uses older version via virtualenv, but for actual deploy ansible we have 2.420:05
fultonjlegacy-tripleo-ci-centos-7-scenario001-multinode-oooq, without container, passed for 513701, but failed for it at the gate.20:06
EmilienMyeah things like mistral and stuff use 2.4 I guess20:06
dprincestevebaker: commented on the patch. In general I think what you are doing is a nice workflow improvement.20:07
fultonji guess 515188 can be used to take the pressure off20:07
*** toure is now known as toure_biab20:07
EmilienMfultonj: yes, unless non container jobs also faile20:07
EmilienMfail*20:08
dprincestevebaker: aside from my -1, my question would be should we make it explicit, similar to disabling certificate checks for SSL with some CLI tools like curl/wget20:08
*** dciabrin has joined #tripleo20:09
fultonjbut w.r.t. getting 513701 in, do we just recheck since legacy-tripleo-ci-centos-7-scenario001-multinode-oooq passed earlier, but just failed at the gate on its way to merge?20:09
stevebakerdprince: I think once the undercloud registry is tls we should make it explicit20:09
dprincestevebaker: okay, I can go for that20:09
dprincestevebaker: what do you think of my comment regarding DockerInsecureRegistryAddress being a comma_delimited_list...20:10
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286420:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172522420:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172745420:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]20:10
openstackLaunchpad bug 1725224 in tripleo "Deployment with ceph and ansible 2.4 fails with: "WorkflowTasks_Step2_Execution: ERROR" "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'. Host key verification failed."" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)20:10
openstackLaunchpad bug 1727454 in tripleo "OS_AUTH_URL in overcloudrc points to keystone API v2.0" [Critical,Triaged]20:10
stevebakerdprince: damn, I didn't realise DockerInsecureRegistryAddress was already a comma_delimited_list20:10
dprincestevebaker: like if you were to pull some containers from a local registry, and some from RDO, and some elsewhere20:10
EmilienMfultonj, trown: project-config patch approved, non voting will be in place in ~5min I guess20:10
dprincestevebaker: yeah, the approach you are taking looks okay I think though regarding the GET request20:11
fultonjEmilienM: OK, I think 001 can be voting again, after 513701 merges but we'll have the tests to prove it when that time comes20:12
stevebakerdprince: it would be good to tell the difference between an http registry and an https registry with invalid certificate. Maybe the test should do an http get instead20:12
dprincestevebaker: yes20:13
*** jmelvin has joined #tripleo20:13
*** salmankhan has quit IRC20:13
fultonjEmilienM: so recheck for https://review.openstack.org/#/c/513701 just for zuul gate scenario001-multinode-oooq ?20:13
fultonjzuul check of same job was green20:14
fultonjor are there other things i'm overlooking?20:14
stevebakerdprince: ok, thanks. btw I have a local change which uses skopeo for image transfers20:14
dprincestevebaker: nice, thats a huge space saver man20:15
EmilienMfultonj: 513701 is in gate now20:15
fultonjoh20:16
EmilienMso if it fails, we'll recheck again20:16
EmilienMand it'll apply new rules20:16
fultonjEmilienM: thanks, i overlooked that it was already there20:16
* fultonj should have used http://zuulv3.openstack.org/20:16
*** pchavva has quit IRC20:17
EmilienMfultonj: what did you use?20:18
EmilienMfultonj: UIs are redirected to zuul v320:18
fultonji thought it was done with the gate sitting there failed20:18
fultonji.e. the block buster movie was over for now20:19
fultonjand we weren't sure if we'd watch it again20:19
EmilienMfultonj: I asked for a recheck and enqueue20:20
EmilienMpaul did it20:20
fultonjack, thanks20:20
*** ansmith has quit IRC20:30
EmilienMbnemec: can you please review https://review.openstack.org/#/c/515123/ ?20:42
openstackgerritVincent S. Cojot proposed openstack/tripleo-heat-templates master: Adds checking proxy server before using it.  https://review.openstack.org/51517220:42
*** PagliaccisCloud has quit IRC20:45
EmilienMI'm going to go ahead and approve https://review.openstack.org/#/c/515123 with the hope we can stabilize our CI20:48
bnemecEmilienM: Are we just ignoring the ovb-ha job now?20:49
EmilienMbnemec: timeouting on 2h5220:49
EmilienMlet's look the logs20:49
EmilienMI can still block the patch while in gate anyway20:49
bnemecEmilienM: I guess the RDO job that I assume is ovb-ha passed.20:50
EmilienMit fails on overcloud http://logs.openstack.org/23/515123/1/check-tripleo/legacy-tripleo-ci-centos-7-ovb-ha-oooq/c30868f/job-output.txt.gz#_2017-10-25_19_06_13_39014620:51
*** abishop has quit IRC20:51
EmilienMbut the overcloud was deployed :20:51
EmilienMhttp://logs.openstack.org/23/515123/1/check-tripleo/legacy-tripleo-ci-centos-7-ovb-ha-oooq/c30868f/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2017-10-25_19_09_3320:51
*** PagliaccisCloud has joined #tripleo20:51
openstackgerritVincent S. Cojot proposed openstack/tripleo-heat-templates master: Adds checking proxy server before using it.  https://review.openstack.org/51517220:51
EmilienMand it worked fine in RDO CI :/20:52
openstackgerritVincent S. Cojot proposed openstack/tripleo-heat-templates master: Adds checking proxy server before using it.  https://review.openstack.org/51517220:53
EmilienMbnemec: look RDO CI jobs, 1h faster than our friends on OVB20:53
EmilienMwth20:53
*** yolanda has quit IRC20:56
bnemecEmilienM: rh1 is old. :-)20:57
*** lblanchard has quit IRC20:57
*** benone has quit IRC21:07
larsksWhere are image name parameters (like DockerHAProxyImage) set?21:08
*** dmsimard|afk is now known as dmsimard21:08
*** benone has joined #tripleo21:08
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286421:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172522421:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172745421:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]21:10
openstackLaunchpad bug 1725224 in tripleo "Deployment with ceph and ansible 2.4 fails with: "WorkflowTasks_Step2_Execution: ERROR" "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'. Host key verification failed."" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)21:10
openstackLaunchpad bug 1727454 in tripleo "OS_AUTH_URL in overcloudrc points to keystone API v2.0" [Critical,Triaged] - Assigned to Dougal Matthews (d0ugal)21:10
zanebEmilienM, bnemec: if I were to resurrect the magic data scraping script... which job is the one we want to start tracking?21:14
*** artom_ has joined #tripleo21:15
*** artom_ has quit IRC21:15
*** artom_ has joined #tripleo21:16
*** rcernin has joined #tripleo21:16
openstackgerritJames E. Blair proposed openstack/puppet-tripleo stable/pike: Prepare puppet-tripleo 7.4.3  https://review.openstack.org/51513521:16
*** artom has quit IRC21:17
*** dparkes has quit IRC21:17
*** dparkes has joined #tripleo21:18
*** cylopez has quit IRC21:21
*** dprince has quit IRC21:23
*** ecerquei_ has quit IRC21:26
openstackgerritMerged openstack/tripleo-ui stable/pike: Prepare tripleo-ui 7.4.3  https://review.openstack.org/51513721:30
openstackgerritVincent S. Cojot proposed openstack/tripleo-heat-templates master: RHSM: when using proxy, test its connectivity first  https://review.openstack.org/51353021:34
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements  https://review.openstack.org/51163321:35
*** panda|ruck|bbl is now known as panda|ruck21:35
EmilienMzaneb: legacy-tripleo-ci-centos-7-ovb-ha-oooq I would say21:35
zanebok21:35
itlinuxI assume that Pike can still be use in BM instead of Containerized version..21:39
openstackgerritVincent S. Cojot proposed openstack/tripleo-heat-templates master: RHSM: when using proxy, test its connectivity first  https://review.openstack.org/51353021:41
*** jcoufal has quit IRC21:43
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: RHSM: when using proxy, test its connectivity first  https://review.openstack.org/51353021:43
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: RHSM: when using proxy, test its connectivity first  https://review.openstack.org/51353021:43
openstackgerritJames E. Blair proposed openstack/puppet-tripleo stable/pike: Prepare puppet-tripleo 7.4.3  https://review.openstack.org/51513521:44
EmilienMitlinux: yes, although upgrades aren't tested from ocata to pike when pike is on baremetal21:45
itlinuxok .. I want to make sure it's still ok to use BM on PIKE in case..21:45
EmilienMbnemec: could the ovb failures related to the number of overcloud deployed?21:46
*** cdearborn has quit IRC21:46
EmilienMbnemec: like, do we overcommit?21:46
*** fragatina has quit IRC21:50
EmilienMfultonj: tempest is about to run on legacy-tripleo-ci-centos-7-scenario001-multinode-oooq for 51370121:52
EmilienMwhich is very good21:52
fultonjEmilienM: awesome!21:52
EmilienMother are green21:52
EmilienMthe backport is in gate as well21:52
fultonjso hopefuly scenario001-multinode-oooq will vote again21:52
EmilienMyeah21:53
EmilienMfultonj: I would ask to everyone (in the ml) to not approve patches not passing scenario001 or scenario004 unless checking with ceph team21:53
EmilienMwe need to be careful when jobs aren't voting21:53
fultonjthey can ping me anytime21:53
fultonjor gfidente of course21:53
*** rwsu has quit IRC21:54
*** rwsu has joined #tripleo21:54
EmilienMok21:55
*** rwsu has quit IRC21:56
fultonjhttps://review.openstack.org/#/c/50752621:56
fultonjshould be close21:57
*** owalsh has quit IRC22:00
*** owalsh has joined #tripleo22:00
*** jmelvin has quit IRC22:02
EmilienMok it passed22:05
EmilienMthe patch in master will land \o/22:05
EmilienMpanda|ruck: when you're back tomorrow, I updated https://etherpad.openstack.org/p/tripleo-promotion-blockers-october-2017 with the 3 patches that we need to get promotion22:07
EmilienMpanda|ruck: there is probably more? but that's what I know22:07
openstackgerritMerged openstack/tripleo-common master: Use ANSIBLE_HOST_KEY_CHECKING var instead of ssh-common-args  https://review.openstack.org/51370122:09
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286422:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172745422:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1727454 in tripleo "OS_AUTH_URL in overcloudrc points to keystone API v2.0" [Critical,Triaged] - Assigned to Dougal Matthews (d0ugal)22:10
fultonjw00t!22:11
fultonjthanks EmilienM !22:11
EmilienMwoot22:11
*** itlinux has quit IRC22:14
*** fragatina has joined #tripleo22:14
*** amodi has quit IRC22:15
*** catintheroof has quit IRC22:18
panda|ruck EmilienM: I'm pushing containers with the current-tripleo tag, I'll update you when it's finished.22:22
*** artom_ has quit IRC22:25
EmilienMpanda|ruck: ok I'm now out for some hours, I guess i'll see you in my morning22:26
EmilienMpanda|ruck: tonight I'll come back and make sure our 2 remaining blockers are landed22:26
EmilienMhttps://review.openstack.org/#/c/515161/ and https://review.openstack.org/#/c/515123/22:26
EmilienMpanda|ruck: good night & thanks!22:27
EmilienMpanda|ruck: I'm unsure about what you mean exactly, maybe you can explain more with details I'll read later.22:28
*** dciabrin has quit IRC22:28
panda|ruckEmilienM: ok22:29
panda|ruckEmilienM: I'm talinkg about https://review.openstack.org/51505222:30
panda|ruckEmilienM: now containers have the new tag https://hub.docker.com/r/tripleomaster/centos-binary-ceilometer-central/tags/22:31
panda|ruckso we can merge that22:31
panda|ruckeven if there's no new promotion, at least some work can progress22:32
*** pradk has quit IRC22:33
*** dmarlin has quit IRC22:34
*** panda|ruck is now known as panda|ruck|off22:35
*** ansmith has joined #tripleo22:39
*** rmascena has quit IRC22:41
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements  https://review.openstack.org/51163322:45
*** salmankhan has joined #tripleo22:50
*** pmannidi has joined #tripleo22:50
openstackgerritMerged openstack/tripleo-common master: Action to always populate container image parameters  https://review.openstack.org/50329622:52
*** achadha has quit IRC22:54
*** achadha has joined #tripleo22:55
*** achadha has quit IRC22:57
*** achadha has joined #tripleo22:57
*** achadha has quit IRC22:59
*** achadha has joined #tripleo22:59
*** tosky has quit IRC23:02
*** achadha has quit IRC23:02
*** achadha_ has joined #tripleo23:03
*** achadha_ has quit IRC23:04
*** achadha has joined #tripleo23:04
*** achadha has quit IRC23:05
openstackgerritJohn Fulton proposed openstack/tripleo-heat-templates master: Set file mode permission for Ceph keyrings in containers  https://review.openstack.org/50897523:06
*** achadha has joined #tripleo23:06
openstackgerritJohn Fulton proposed openstack/tripleo-heat-templates master: Set file mode permission for Ceph keyrings in containers  https://review.openstack.org/50897523:08
openstackgerritJohn Fulton proposed openstack/tripleo-heat-templates master: Set file mode permission for Ceph keyrings in containers  https://review.openstack.org/50897523:10
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286423:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172745423:10
*** ooolpbot has quit IRC23:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]23:10
openstackLaunchpad bug 1727454 in tripleo "OS_AUTH_URL in overcloudrc points to keystone API v2.0" [Critical,Triaged] - Assigned to Dougal Matthews (d0ugal)23:10
*** achadha has quit IRC23:10
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements  https://review.openstack.org/51163323:15
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements  https://review.openstack.org/51163323:20
*** salmankhan has quit IRC23:25
*** yamahata has joined #tripleo23:27
*** yamahata has quit IRC23:32
*** liverpooler has quit IRC23:47
*** achadha_ has joined #tripleo23:50
*** achadha_ has quit IRC23:52
*** achadha_ has joined #tripleo23:53
*** rlandy has quit IRC23:54

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!