Thursday, 2017-11-16

*** almondjoy has quit IRC00:01
*** chlong|lnch has quit IRC00:02
openstackgerritKeith Schincke proposed openstack/tripleo-heat-templates master: Add ceph-rbdmirror ansible container service  https://review.openstack.org/52024400:03
*** dxiri has joined #tripleo00:03
dxirihi everyone, I just used tripleo to install openstack and have a few questions!00:04
dxiriwhat variable do I have to set so that br-ex goes trough the correct interface? I can't seem to make my external network work00:05
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172432800:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173103200:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173106300:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173214000:10
openstackLaunchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel)00:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged]00:10
openstackLaunchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged]00:10
openstackLaunchpad bug 1732140 in tripleo "Kolla tests failing for tripleo-common master" [Critical,In progress] - Assigned to Adriano Petrich (apetrich)00:10
mwhahahadxiri: i'm not completely sure, I think that's in the network config part along with configuring NeutronExternalNetworkBridge00:11
mwhahahaof course that appears to be deprecated00:11
mwhahahahttps://github.com/openstack/tripleo-heat-templates/commit/21d2afd4bf9f57fd0fb3709d87acb452f13912df00:11
*** dxiri_ has joined #tripleo00:12
mwhahahaand you probably didn't se my reply00:12
*** dxiri has quit IRC00:14
*** jrist is now known as jrist-afk00:21
*** jrist-afk is now known as jrist00:21
*** zshi has joined #tripleo00:26
dxiri_mwhahaha: was that directed at me? all I see is "and you probably didn't see my reply"00:26
*** yolanda has quit IRC00:27
*** zshi has quit IRC00:30
*** etingof has joined #tripleo00:30
*** ansmith has joined #tripleo00:37
*** tzumainn has quit IRC00:38
*** tosky has quit IRC00:43
*** zshi_ has joined #tripleo00:44
*** ramishra has joined #tripleo00:44
*** etingof has quit IRC00:46
*** dxiri_ has quit IRC00:47
*** dxiri has joined #tripleo00:47
*** lblanchard has quit IRC00:47
*** dxiri has quit IRC00:52
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DNM: debug unbound queries  https://review.openstack.org/52005501:00
*** cshastri has joined #tripleo01:01
*** dougbtv_ has joined #tripleo01:03
*** itlinux has joined #tripleo01:08
*** etingof has joined #tripleo01:08
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172432801:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173103201:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173106301:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173214001:10
openstackLaunchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel)01:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged]01:10
openstackLaunchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged]01:10
openstackLaunchpad bug 1732140 in tripleo "Kolla tests failing for tripleo-common master" [Critical,In progress] - Assigned to Adriano Petrich (apetrich)01:10
*** dciabrin_ has joined #tripleo01:17
*** dciabrin has quit IRC01:21
*** itlinux has quit IRC01:21
*** yamahata has quit IRC01:21
*** safchain has quit IRC01:21
*** safchain has joined #tripleo01:21
*** percevalbot has quit IRC01:22
*** sdake has quit IRC01:22
*** NobodyCam has quit IRC01:22
*** bryan_att has quit IRC01:22
*** gregwork has quit IRC01:22
*** jidar has quit IRC01:22
*** lvdombrkr has quit IRC01:22
*** aputtur has quit IRC01:22
*** amoralej|off has quit IRC01:22
*** vkhanna has quit IRC01:22
*** radez has quit IRC01:22
*** akrzos has quit IRC01:22
*** saneax has quit IRC01:22
*** tonyb has quit IRC01:22
*** gchamoul has quit IRC01:22
*** zul has quit IRC01:22
*** d0ugal has quit IRC01:22
*** Hazelesque_ has quit IRC01:22
*** Tyrantelf_ has quit IRC01:22
*** fultonj has quit IRC01:22
*** migi has quit IRC01:22
*** mhenkel has quit IRC01:22
*** vineet has quit IRC01:22
*** michchap has quit IRC01:22
*** dansmith has quit IRC01:22
*** mnaser has quit IRC01:22
*** jwb has quit IRC01:22
*** rajinir has quit IRC01:22
*** SlickNik has quit IRC01:22
*** japestinho has quit IRC01:22
*** zaneb has quit IRC01:22
*** gfidente[m] has quit IRC01:22
*** dr_gogeta86 has quit IRC01:22
*** panda has quit IRC01:22
*** patrickeast has quit IRC01:22
*** mgkwill has quit IRC01:22
*** trozet has quit IRC01:22
*** zzzeek has quit IRC01:22
*** numans has quit IRC01:22
*** matbu_ has quit IRC01:22
*** EmilienM has quit IRC01:22
*** apetrich has quit IRC01:22
*** arxcruz_ has quit IRC01:22
*** dtantsur|afk has quit IRC01:22
*** jistr has quit IRC01:22
*** jpena|off has quit IRC01:22
*** tdasilva has quit IRC01:22
*** honza has quit IRC01:22
*** tbarron has quit IRC01:22
*** sdoran has quit IRC01:22
*** chandankumar has quit IRC01:22
*** dougbtv_ has quit IRC01:22
*** marrusl has quit IRC01:22
*** artom has quit IRC01:22
*** daidv has quit IRC01:22
*** raissa has quit IRC01:22
*** dtrainor has quit IRC01:22
*** mmedvede has quit IRC01:22
*** fzdarsky|afk has quit IRC01:22
*** jjoyce has quit IRC01:22
*** zoli has quit IRC01:22
*** sshnaidm has quit IRC01:22
*** ipsecguy has quit IRC01:22
*** bugzy has quit IRC01:22
*** mjblack has quit IRC01:22
*** ed_b has quit IRC01:22
*** hewbrocca_afk has quit IRC01:22
*** openstackgerrit has quit IRC01:22
*** rodrigods has quit IRC01:22
*** ianw has quit IRC01:22
*** mwhahaha has quit IRC01:22
*** fungi has quit IRC01:22
*** trown|outtypewww has quit IRC01:22
*** rbrady has quit IRC01:22
*** portdirect has quit IRC01:22
*** v1k0d3n has quit IRC01:22
*** qwebirc77837 has quit IRC01:22
*** ChanServ has quit IRC01:22
*** larsks has quit IRC01:22
*** fabbione has quit IRC01:22
*** homeski has quit IRC01:22
*** Tengu has quit IRC01:22
*** mgagne has quit IRC01:22
*** karthiks has quit IRC01:22
*** bandini has quit IRC01:22
*** owalsh has quit IRC01:22
*** toure_biab has quit IRC01:22
*** dpeacock has quit IRC01:22
*** rakhmerov has quit IRC01:22
*** sai has quit IRC01:22
*** jokke_ has quit IRC01:22
*** isq_ has quit IRC01:22
*** rnoriega has quit IRC01:22
*** faceman has quit IRC01:22
*** tristanC has quit IRC01:22
*** verdurin has quit IRC01:22
*** kambiz has quit IRC01:22
*** dobson has quit IRC01:22
*** ansmith has quit IRC01:22
*** gbarros has quit IRC01:22
*** atoth has quit IRC01:22
*** anilvenkata has quit IRC01:22
*** tvignaud has quit IRC01:22
*** brault has quit IRC01:22
*** cmyster has quit IRC01:22
*** mandre has quit IRC01:22
*** Dinesh_Bhor has quit IRC01:22
*** timothyb89 has quit IRC01:22
*** lifeless has quit IRC01:22
*** leifmadsen has quit IRC01:22
*** jrist has quit IRC01:22
*** afazekas has quit IRC01:22
*** sc has quit IRC01:22
*** cshastri has quit IRC01:22
*** zshi_ has quit IRC01:22
*** rcernin has quit IRC01:22
*** jbadiapa_ has quit IRC01:22
*** nguyentrihai has quit IRC01:22
*** dbecker has quit IRC01:22
*** myoung has quit IRC01:22
*** adarazs|ruck has quit IRC01:22
*** pmannidi has quit IRC01:22
*** bkopilov has quit IRC01:22
*** vpickard_ has quit IRC01:22
*** cinerama has quit IRC01:22
*** colonwq has quit IRC01:22
*** athomas has quit IRC01:22
*** slagle has quit IRC01:22
*** leseb_ has quit IRC01:22
*** dalvarez has quit IRC01:22
*** eck` has quit IRC01:22
*** StevenK has quit IRC01:22
*** hrybacki has quit IRC01:22
*** therve has quit IRC01:22
*** safchain has quit IRC01:22
*** etingof has quit IRC01:22
*** leitan has quit IRC01:22
*** liverpooler has quit IRC01:22
*** mrunge has quit IRC01:22
*** morazi has quit IRC01:22
*** kbyrne has quit IRC01:22
*** dougbtv__ has quit IRC01:22
*** jkilpatr has quit IRC01:22
*** jlabarre has quit IRC01:22
*** oanson has quit IRC01:22
*** dmellado has quit IRC01:22
*** Ng has quit IRC01:22
*** mugsie has quit IRC01:22
*** vkmc has quit IRC01:22
*** melwitt has quit IRC01:22
*** dmanchad has quit IRC01:22
*** andreaf has quit IRC01:22
*** ramishra has quit IRC01:22
*** dsneddon has quit IRC01:22
*** threestrands has quit IRC01:22
*** dhill_ has quit IRC01:22
*** jmelvin has quit IRC01:22
*** rlandy|rover|bbl has quit IRC01:22
*** bcafarel has quit IRC01:22
*** jaosorior has quit IRC01:22
*** bfournie has quit IRC01:22
*** Vijayendra__ has quit IRC01:22
*** flaper87 has quit IRC01:22
*** stee_3 has quit IRC01:22
*** dmsimard has quit IRC01:22
*** fragatina has quit IRC01:22
*** hjensas has quit IRC01:22
*** noslzzp has quit IRC01:22
*** chem has quit IRC01:22
*** fpan has quit IRC01:22
*** markmc has quit IRC01:22
*** remix_tj has quit IRC01:22
*** lyarwood has quit IRC01:22
*** thrash|g0ne has quit IRC01:22
*** cschwede has quit IRC01:22
*** rdopiera has quit IRC01:22
*** ansiwen has quit IRC01:22
*** lhinds has quit IRC01:22
*** mburned has quit IRC01:22
*** rasca has quit IRC01:22
*** beagles has quit IRC01:22
*** bandini has joined #tripleo01:28
*** safchain has joined #tripleo01:28
*** etingof has joined #tripleo01:28
*** dougbtv_ has joined #tripleo01:28
*** cshastri has joined #tripleo01:28
*** ramishra has joined #tripleo01:28
*** zshi_ has joined #tripleo01:28
*** ansmith has joined #tripleo01:28
*** leitan has joined #tripleo01:28
*** dsneddon has joined #tripleo01:28
*** rcernin has joined #tripleo01:28
*** liverpooler has joined #tripleo01:28
*** threestrands has joined #tripleo01:28
*** dhill_ has joined #tripleo01:28
*** jmelvin has joined #tripleo01:28
*** gbarros has joined #tripleo01:28
*** jbadiapa_ has joined #tripleo01:28
*** marrusl has joined #tripleo01:28
*** atoth has joined #tripleo01:28
*** fragatina has joined #tripleo01:28
*** anilvenkata has joined #tripleo01:28
*** hjensas has joined #tripleo01:28
*** mrunge has joined #tripleo01:28
*** noslzzp has joined #tripleo01:28
*** tvignaud has joined #tripleo01:28
*** brault has joined #tripleo01:28
*** nguyentrihai has joined #tripleo01:28
*** rlandy|rover|bbl has joined #tripleo01:28
*** athomas has joined #tripleo01:28
*** karthiks has joined #tripleo01:28
*** artom has joined #tripleo01:28
*** jlabarre has joined #tripleo01:28
*** qwebirc77837 has joined #tripleo01:28
*** bcafarel has joined #tripleo01:28
*** daidv has joined #tripleo01:28
*** raissa has joined #tripleo01:28
*** cmyster has joined #tripleo01:28
*** chem has joined #tripleo01:28
*** dtrainor has joined #tripleo01:28
*** mmedvede has joined #tripleo01:28
*** mandre has joined #tripleo01:28
*** SlickNik has joined #tripleo01:28
*** jaosorior has joined #tripleo01:28
*** dbecker has joined #tripleo01:28
*** myoung has joined #tripleo01:28
*** japestinho has joined #tripleo01:28
*** fzdarsky|afk has joined #tripleo01:28
*** bfournie has joined #tripleo01:28
*** Vijayendra__ has joined #tripleo01:28
*** adarazs|ruck has joined #tripleo01:28
*** pmannidi has joined #tripleo01:28
*** jjoyce has joined #tripleo01:28
*** morazi has joined #tripleo01:28
*** kbyrne has joined #tripleo01:28
*** zoli has joined #tripleo01:28
*** owalsh has joined #tripleo01:28
*** dougbtv__ has joined #tripleo01:28
*** jkilpatr has joined #tripleo01:28
*** zaneb has joined #tripleo01:28
*** bkopilov has joined #tripleo01:28
*** dansmith has joined #tripleo01:28
*** percevalbot has joined #tripleo01:28
*** verdurin has joined #tripleo01:28
*** gfidente[m] has joined #tripleo01:28
*** mwhahaha has joined #tripleo01:28
*** dr_gogeta86 has joined #tripleo01:28
*** fungi has joined #tripleo01:28
*** panda has joined #tripleo01:28
*** Hazelesque_ has joined #tripleo01:28
*** patrickeast has joined #tripleo01:28
*** mgkwill has joined #tripleo01:28
*** vineet has joined #tripleo01:28
*** toure_biab has joined #tripleo01:28
*** vpickard_ has joined #tripleo01:28
*** flaper87 has joined #tripleo01:28
*** trozet has joined #tripleo01:28
*** Dinesh_Bhor has joined #tripleo01:28
*** sshnaidm has joined #tripleo01:28
*** dpeacock has joined #tripleo01:28
*** cinerama has joined #tripleo01:28
*** ipsecguy has joined #tripleo01:28
*** rakhmerov has joined #tripleo01:28
*** bugzy has joined #tripleo01:28
*** stee_3 has joined #tripleo01:28
*** zzzeek has joined #tripleo01:28
*** dmsimard has joined #tripleo01:28
*** numans has joined #tripleo01:28
*** tristanC has joined #tripleo01:28
*** fpan has joined #tripleo01:28
*** colonwq has joined #tripleo01:28
*** michchap has joined #tripleo01:28
*** matbu_ has joined #tripleo01:28
*** EmilienM has joined #tripleo01:28
*** barjavel.freenode.net sets mode: +ovv mwhahaha mwhahaha EmilienM01:28
*** mjblack has joined #tripleo01:28
*** apetrich has joined #tripleo01:28
*** Tyrantelf_ has joined #tripleo01:28
*** arxcruz_ has joined #tripleo01:28
*** ed_b has joined #tripleo01:28
*** timothyb89 has joined #tripleo01:28
*** trown|outtypewww has joined #tripleo01:28
*** oanson has joined #tripleo01:28
*** lifeless has joined #tripleo01:28
*** dmellado has joined #tripleo01:28
*** markmc has joined #tripleo01:28
*** leifmadsen has joined #tripleo01:28
*** fultonj has joined #tripleo01:28
*** remix_tj has joined #tripleo01:28
*** sai has joined #tripleo01:28
*** lyarwood has joined #tripleo01:28
*** migi has joined #tripleo01:28
*** hewbrocca_afk has joined #tripleo01:28
*** thrash|g0ne has joined #tripleo01:28
*** openstackgerrit has joined #tripleo01:28
*** rdopiera has joined #tripleo01:28
*** mhenkel has joined #tripleo01:28
*** zul has joined #tripleo01:28
*** gchamoul has joined #tripleo01:28
*** tonyb has joined #tripleo01:28
*** saneax has joined #tripleo01:28
*** akrzos has joined #tripleo01:28
*** radez has joined #tripleo01:28
*** vkhanna has joined #tripleo01:28
*** amoralej|off has joined #tripleo01:28
*** aputtur has joined #tripleo01:28
*** lvdombrkr has joined #tripleo01:28
*** jidar has joined #tripleo01:28
*** bryan_att has joined #tripleo01:28
*** NobodyCam has joined #tripleo01:28
*** gregwork has joined #tripleo01:28
*** sdake has joined #tripleo01:28
*** cschwede has joined #tripleo01:28
*** rodrigods has joined #tripleo01:28
*** ianw has joined #tripleo01:28
*** rbrady has joined #tripleo01:28
*** Ng has joined #tripleo01:28
*** dtantsur|afk has joined #tripleo01:28
*** mugsie has joined #tripleo01:28
*** vkmc has joined #tripleo01:28
*** jrist has joined #tripleo01:28
*** slagle has joined #tripleo01:28
*** barjavel.freenode.net sets mode: +v Ng01:28
*** jistr has joined #tripleo01:28
*** ansiwen has joined #tripleo01:28
*** jokke_ has joined #tripleo01:28
*** isq_ has joined #tripleo01:28
*** leseb_ has joined #tripleo01:28
*** jpena|off has joined #tripleo01:28
*** lhinds has joined #tripleo01:28
*** rnoriega has joined #tripleo01:28
*** faceman has joined #tripleo01:28
*** mburned has joined #tripleo01:28
*** mnaser has joined #tripleo01:28
*** eck` has joined #tripleo01:28
*** dalvarez has joined #tripleo01:28
*** StevenK has joined #tripleo01:28
*** larsks has joined #tripleo01:28
*** beagles has joined #tripleo01:28
*** kambiz has joined #tripleo01:28
*** fabbione has joined #tripleo01:28
*** homeski has joined #tripleo01:28
*** hrybacki has joined #tripleo01:28
*** afazekas has joined #tripleo01:28
*** Tengu has joined #tripleo01:28
*** mgagne has joined #tripleo01:28
*** dobson has joined #tripleo01:28
*** sc has joined #tripleo01:28
*** portdirect has joined #tripleo01:28
*** rasca has joined #tripleo01:28
*** v1k0d3n has joined #tripleo01:28
*** tdasilva has joined #tripleo01:28
*** honza has joined #tripleo01:28
*** jwb has joined #tripleo01:28
*** tbarron has joined #tripleo01:28
*** sdoran has joined #tripleo01:28
*** rajinir has joined #tripleo01:28
*** melwitt has joined #tripleo01:28
*** chandankumar has joined #tripleo01:28
*** dmanchad has joined #tripleo01:28
*** andreaf has joined #tripleo01:28
*** therve has joined #tripleo01:28
*** ChanServ has joined #tripleo01:28
*** barjavel.freenode.net sets mode: +o ChanServ01:28
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates master: Re-enabled libvirt TLS with SCRAM SHA-1 auth  https://review.openstack.org/52025401:30
*** bandini has quit IRC01:30
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates master: Re-enable libvirt TLS with SCRAM SHA-1 auth  https://review.openstack.org/52025401:31
*** bandini has joined #tripleo01:33
*** yamahata has joined #tripleo01:33
*** d0ugal has joined #tripleo01:38
*** daidv has quit IRC01:41
*** daidv has joined #tripleo01:41
*** leitan has quit IRC01:42
*** leitan has joined #tripleo01:42
*** yamahata has quit IRC01:43
*** leitan has quit IRC01:47
*** itlinux has joined #tripleo01:48
stevebakerjaosorior: hey, are you about?01:49
*** leitan has joined #tripleo01:54
EmilienMstevebaker: hey what's up01:56
stevebakerEmilienM, jaosorior: I'm just looking at this change that landed, and am concerned about jinja conditional blocks being used in overcloud_containers.yaml.j2 https://review.openstack.org/#/c/515282/7/container-images/overcloud_containers.yaml.j201:58
EmilienMstevebaker: I think Juan will be online in ~3h01:59
stevebakerok01:59
openstackgerritMerged openstack/tripleo-repos master: Update ceph and opstools repos  https://review.openstack.org/51772802:01
openstackgerritMerged openstack/tripleo-repos master: Implement Proxy Support  https://review.openstack.org/51812702:01
*** nguyentrihai has quit IRC02:04
*** rwsu has joined #tripleo02:07
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172432802:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173103202:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173106302:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173214002:10
openstackLaunchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel)02:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged]02:10
openstackLaunchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged]02:10
openstackLaunchpad bug 1732140 in tripleo "Kolla tests failing for tripleo-common master" [Critical,In progress] - Assigned to Adriano Petrich (apetrich)02:10
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: Migrate python-tripleoclient to zuul v3 jobs  https://review.openstack.org/52024102:15
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Migrate THT to zuul v3 jobs  https://review.openstack.org/51976102:16
*** itlinux has quit IRC02:17
*** jlabarre has quit IRC02:19
*** anilvenkata has quit IRC02:19
*** itlinux has joined #tripleo02:21
openstackgerritEmilien Macchi proposed openstack/instack-undercloud master: Migrate instack-undercloud to zuul v3 jobs  https://review.openstack.org/52026402:21
*** fragatina has quit IRC02:23
*** rwsu has quit IRC02:24
*** yamahata has joined #tripleo02:28
*** fragatina has joined #tripleo02:29
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo stable/pike: Switch to Zuul v3 testing  https://review.openstack.org/51989802:32
*** fragatina has quit IRC02:34
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: Don't try to start docker for the UC  https://review.openstack.org/51944102:37
*** itlinux has quit IRC02:40
*** yamahata has quit IRC02:45
*** ramishra has quit IRC02:47
*** leitan has quit IRC02:47
*** links has joined #tripleo02:48
*** ramishra has joined #tripleo02:49
*** fzdarsky_ has joined #tripleo02:53
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Import TripleO legacy zuul jobs  https://review.openstack.org/51479302:55
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Migrate tripleo-quickstart to zuul v3 jobs  https://review.openstack.org/52027002:56
*** fzdarsky|afk has quit IRC02:56
openstackgerritwes hayutin proposed openstack/tripleo-common master: Validate roles data and network data  https://review.openstack.org/50856702:59
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart-extras master: Migrate tripleo-quickstart-extras to zuul v3 jobs  https://review.openstack.org/52027202:59
EmilienMweshay: you around?03:01
weshayEmilienM, aye03:02
EmilienMweshay: hey03:02
EmilienMweshay: can you review oooq & oooq-e ^ plz03:02
EmilienMweshay: the layouts03:02
*** anilvenkata has joined #tripleo03:02
EmilienMweshay: on oooq, I only run scenarios when touching fs03:02
weshayhttps://review.openstack.org/514793 and https://review.openstack.org/52027003:02
EmilienMweshay: on oooq-e, all the time03:02
openstackgerritMerged openstack-infra/tripleo-ci master: Be more prescriptive in log collection  https://review.openstack.org/51152603:02
weshayyay!03:02
EmilienMweshay: https://review.openstack.org/52027203:02
weshaylook at that, patches landing in the same day03:03
EmilienMand https://review.openstack.org/52027003:03
EmilienMweshay: yeah03:03
EmilienMweshay: these 2 please ^03:03
weshayk.. in 2 shakes03:03
openstackgerritRajesh Tailor proposed openstack/tripleo-heat-templates stable/pike: Enable TLS for ec2api metadata service  https://review.openstack.org/52027303:03
EmilienMweshay: also, I had an idea, we could run the collect-logs playbooks in zuul instead of oooq03:03
openstackgerritRajesh Tailor proposed openstack/puppet-tripleo stable/pike: Add TLS for ec2api metadata service  https://review.openstack.org/52027403:03
EmilienMweshay: so we have more time for the actual job03:03
EmilienMdoes it make sense?03:03
*** dpawar has joined #tripleo03:06
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart-extras master: Migrate tripleo-quickstart-extras to zuul v3 jobs  https://review.openstack.org/52027603:06
weshayk.. /me looking03:07
*** dpawar has quit IRC03:08
weshayEmilienM, so is this WIP, or does it trigger on a change to any file in tqe?03:09
weshayhttps://review.openstack.org/#/c/520272/1/zuul.d/layout.yaml03:09
EmilienMweshay: nothing is wip now03:10
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172432803:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173103203:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173106303:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173214003:10
openstackLaunchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel)03:10
*** ooolpbot has quit IRC03:10
openstackLaunchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged]03:10
openstackLaunchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged]03:10
openstackLaunchpad bug 1732140 in tripleo "Kolla tests failing for tripleo-common master" [Critical,In progress] - Assigned to Adriano Petrich (apetrich)03:10
EmilienMweshay: I expect these patches to merge this week03:10
*** anilvenkata has quit IRC03:11
weshayEmilienM, so thanks for doing this03:11
weshayhttps://review.openstack.org/#/c/520270/1/zuul.d/layout.yaml03:11
EmilienMweshay: any03:11
weshaylooks good I would trigger a few jobs on the release configs as well03:12
*** dpawar has joined #tripleo03:12
EmilienMweshay: could you be more specific and let comments in gerrit please?03:12
EmilienMweshay: please -1 as well03:12
weshayya03:12
*** dxiri has joined #tripleo03:12
EmilienMweshay: I'm finishing other projects now and I'll look at reviews later03:12
openstackgerritMerged openstack/puppet-tripleo stable/pike: Fix libvirt exec deps for split-stack  https://review.openstack.org/51965203:13
*** bkopilov has quit IRC03:13
EmilienMweshay: I think I'm going to remove all tripleo projects in the layout for projects non-tripleo03:16
EmilienMweshay: and re-add them again in the zuul layout in-tree for projects03:17
EmilienMweshay: do you see what I mean?03:17
EmilienMreason: we're removing legacy jobs03:17
weshayEmilienM, so what happens there if we add a job to project when they don't want it?03:17
weshayseems possible now03:17
EmilienMweshay: well, we can tell we had it before03:18
EmilienMweshay: let me do that part :D03:18
weshayEmilienM, sure.. but this is interesting03:18
EmilienMyep03:18
EmilienMweshay: one of the argument is03:18
EmilienMif something breaks they can disable the job03:18
EmilienMand self approve03:18
EmilienMno need of us or infra folks03:18
EmilienM:)03:18
*** rlandy|rover|bbl is now known as rlandy|rover03:21
openstackgerritEmilien Macchi proposed openstack/puppet-pacemaker master: zuul: run ovb-ha-oooq  https://review.openstack.org/52027803:25
mwhahahaso yea i think there's a problem with the metadata services and i think scenario003 is also suffering from the problem03:25
*** itlinux has joined #tripleo03:25
EmilienMmwhahaha: neutron metadata proxy?03:27
openstackgerritMerged openstack/tripleo-heat-templates master: Revert "Revert "Tag workflows created by the templates""  https://review.openstack.org/50376203:27
openstackgerritMerged openstack/tripleo-quickstart master: Switch scenario007 to run Tempest  https://review.openstack.org/49429303:27
EmilienMcould you reproduce?03:28
mwhahahanot sure, but the network basic ops test is also failing03:28
mwhahahahttp://logs.openstack.org/17/499117/7/gate/legacy-tripleo-ci-centos-7-scenario003-multinode-oooq-puppet/0e01b75/logs/undercloud/home/zuul/tempest_output.log.txt.gz#_2017-11-16_03_12_5503:28
mwhahahasame thing where it tries to ssh but no auth key03:28
EmilienMis it consistent?03:29
mwhahahawhat do you mean03:29
mwhahahais it happening all the time? no03:29
EmilienMmetadata-agent looks good03:30
EmilienMmwhahaha: ok03:30
EmilienMit would help to have proxy logs03:30
EmilienMwhich is in /var/lib/neutron iirc03:30
mwhahahaHEH https://review.openstack.org/#/c/511364/03:30
mwhahahai wonder if qa was hitting the same problem :D03:31
EmilienMwell our metadata agent doesn't cry03:31
mwhahahait doesn't appear to be running debug03:31
EmilienMlet's enable it03:32
EmilienMwe should run debug in CI03:32
mwhahahahttp://logs.openstack.org/17/499117/7/gate/legacy-tripleo-ci-centos-7-scenario003-multinode-oooq-puppet/0e01b75/logs/subnode-2/etc/neutron/metadata_agent.ini.txt.gz03:32
mwhahahayea debug is false03:32
EmilienMbouh03:32
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart-extras master: Migrate tripleo-quickstart-extras to zuul v3 jobs  https://review.openstack.org/52027603:32
EmilienMmwhahaha: I go dinner now, I can take alook later how to enable debug03:34
mwhahahaEmilienM: i'll propose in a sec03:34
mwhahahait's missing from neutron-metadata03:34
EmilienMyes03:34
EmilienM:(03:34
EmilienMI'm back in 45 min03:34
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Debug configuration for neutron metadata agent  https://review.openstack.org/52028003:38
mwhahahaEmilienM: -^03:38
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Debug configuration for neutron metadata agent  https://review.openstack.org/52028003:41
*** Tripleo-user has joined #tripleo03:41
Tripleo-userhi03:42
openstackgerritKeith Schincke proposed openstack/puppet-tripleo master: Update cephx keys with ACLs for openstack services.  https://review.openstack.org/51953103:42
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Debug configuration for neutron metadata agent  https://review.openstack.org/52028003:45
openstackgerritMerged openstack/tripleo-docs master: Document use of tripleo-repos  https://review.openstack.org/51863103:47
openstackgerritMerged openstack/tripleo-common master: Skip hidden files in test_tags_are_set  https://review.openstack.org/51287503:49
*** dpawar has quit IRC03:52
*** skramaja has joined #tripleo03:53
EmilienMmwhahaha: +203:55
*** mdnadeem has joined #tripleo04:01
*** ykarel has joined #tripleo04:01
*** shreshtha has joined #tripleo04:05
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: DNM: Update quickstart extras with undercloud install for containers  https://review.openstack.org/51744404:07
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172432804:10
openstackLaunchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel)04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173103204:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173106304:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173214004:10
*** ooolpbot has quit IRC04:10
openstackLaunchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged]04:10
openstackLaunchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged]04:10
openstackLaunchpad bug 1732140 in tripleo "Kolla tests failing for tripleo-common master" [Critical,In progress] - Assigned to Adriano Petrich (apetrich)04:10
*** akane has joined #tripleo04:11
*** akane has quit IRC04:14
*** akane has joined #tripleo04:14
*** dxiri has quit IRC04:19
*** d0ugal has quit IRC04:24
*** dbecker has quit IRC04:24
*** dxiri has joined #tripleo04:28
*** links has quit IRC04:29
*** links has joined #tripleo04:29
*** psachin has joined #tripleo04:31
*** bkopilov has joined #tripleo04:32
*** skramaja_ has joined #tripleo04:35
*** d0ugal has joined #tripleo04:36
*** dbecker has joined #tripleo04:37
*** skramaja has quit IRC04:38
*** anilvenkata has joined #tripleo04:38
*** akane has quit IRC04:38
*** oanson has quit IRC04:44
*** oanson has joined #tripleo04:45
*** rlandy|rover has quit IRC04:51
*** dpawar has joined #tripleo04:58
*** ratailor has joined #tripleo05:04
*** udesale has joined #tripleo05:08
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172432805:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173103205:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173106305:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173214005:10
openstackLaunchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel)05:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged]05:10
openstackLaunchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged]05:10
openstackLaunchpad bug 1732140 in tripleo "Kolla tests failing for tripleo-common master" [Critical,In progress] - Assigned to Adriano Petrich (apetrich)05:10
*** jaganathan has joined #tripleo05:14
*** dougbtv_ has quit IRC05:14
jaosoriorstevebaker: around?05:16
*** ramishra has quit IRC05:19
EmilienMjaosorior: right on time :D05:20
*** pdeore has joined #tripleo05:21
*** ramishra has joined #tripleo05:21
jaosoriorlol05:22
jaosorioryeah, but I guess stevebaker isn't around anymore05:22
jaosoriordamn, my time difference with Australia/New Zealand is pretty rough :/05:23
jaosorioroh well05:23
jaosoriorEmilienM: need reviews?05:23
EmilienMjaosorior: I'm fine thanks05:24
jaosoriorEmilienM: oh, by the way, it seems that the IPSec stuff has been prioritized more than all the other stuff I was doing. So it seems I should even start to integrate it to TripleO... nowish :D05:24
EmilienMjaosorior: stevebaker was worried about something, but I'm missing context05:24
EmilienMjaosorior: that's awesome05:24
*** fragatina has joined #tripleo05:25
EmilienMjaosorior: it reminds me a guy who asked that recently :P05:25
*** fragatin_ has joined #tripleo05:25
jaosoriorEmilienM: well, the current codebase was meant to work with OSP10, so it might even be usable for OSP12 too (with default networks).05:25
Tenguhelo05:25
EmilienMallright05:25
*** ramishra has quit IRC05:25
* EmilienM off to bed05:25
Tengugood night EmilienM05:26
jaosoriorEmilienM: have a good one05:26
jaosoriorTengu: good morning!05:26
EmilienMjaosorior: if you have time, https://review.openstack.org/#/q/topic:tripleo/migrate-to-zuulv305:26
EmilienMTengu, jaosorior: have a great day, ttyl05:26
Tengu:)05:27
Tengujaosorior: how are you today? You get up early.05:27
*** ramishra has joined #tripleo05:27
jaosoriorI usually get up earlier. But this time breakfast was faster than usual.05:28
*** fragatina has quit IRC05:29
Tenguuhu05:29
Tenguworking from home today.05:29
Tengucould get up a bit later :D05:29
*** dsneddon has quit IRC05:29
*** dxiri has quit IRC05:29
jaosoriorhaha daaamn05:30
jaosorioryes, you could have05:30
Tenguwell, I actually did: 30 minutes later \o/05:30
*** mdnadeem has quit IRC05:30
Tenguas I don't need to take the 45minutes road.05:31
jaosoriorTengu: you drive 45 min to work?05:32
Tengumore or less, yes05:33
Tengu26 km for the least.05:33
jaosoriordamn05:33
jaosoriorweeeeell, pretty normal for a city now that I think about it05:33
Tenguwith people driving like drunk snails...05:33
jaosoriorI have no idea how the place you live looks like05:33
Tengujaosorior: https://goo.gl/maps/DQYGGS7SGWC2  more or less05:34
Tengugoogle announces 34 minutes - you can add 10 because of other people and red beams. Lots of red beams05:35
jaosoriordamn, that is a nice view by the lake though05:36
Tenguyup05:36
Tenguwell, since a few weeks I'm in the dark every morning ;)05:36
Tengubut in summer, it's really cool. and I take other roads, longer but nicer :)05:36
Tengujaosorior: ah, just saw you're back on the dynamic endpoints. cool. Sorry I couldn't give a shot, but without lab env, I'm a bit stuck :(.05:42
jaosoriornah, just gave it a recheck05:42
Tengu:)05:43
*** janki has joined #tripleo05:44
Tengujaosorior: btw, do you already have played with terraform?05:44
jaosoriorhavent'05:45
jaosorior*haven't05:45
*** dmellado has quit IRC05:46
jaosoriorTengu: are you checking that out?05:46
*** aditya_r has joined #tripleo05:46
Tengujaosorior: we're using it in fact. in order to deploy instances on different cloud providers05:46
*** abregman has joined #tripleo05:47
Tenguit has support for openstack. we're currently integrating terraform in a jenkins CI in order to do the validation tests for our code, being terraform modules or puppet receipts or even other departements code.05:47
Tengui.e. jenkins will be able to create terraform projects. a project is more or less like a heat stack.05:48
Tengupretty sure we can do the same with ansible - although I'm not sure ansible has a better support for openstack API :]05:49
jaosoriorTengu: not sure either; but I've heard that openstack support has gotten pretty damn good in ansible05:50
Tenguwell... bet so, seing who bought ansible and who has a pretty good hand on openstack ;)05:50
Tenguthat said, the terraform language is cool. a bit like puppet in fact.05:51
*** dmellado has joined #tripleo05:55
jaosoriorchecking it out05:55
*** mdnadeem has joined #tripleo05:57
*** akane has joined #tripleo05:59
*** yamahata has joined #tripleo06:01
*** jaosorior has quit IRC06:02
*** dpeacock has quit IRC06:05
*** dpeacock has joined #tripleo06:07
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172432806:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173103206:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173106306:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173214006:10
openstackLaunchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel)06:10
*** ooolpbot has quit IRC06:10
openstackLaunchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged]06:10
openstackLaunchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged]06:10
openstackLaunchpad bug 1732140 in tripleo "Kolla tests failing for tripleo-common master" [Critical,In progress] - Assigned to Adriano Petrich (apetrich)06:10
*** oanson has quit IRC06:12
*** oanson has joined #tripleo06:13
*** moshele has joined #tripleo06:14
*** aditya_r has quit IRC06:16
*** aditya_r has joined #tripleo06:17
*** dpawar has quit IRC06:22
*** aditya_r has quit IRC06:25
*** jaosorior has joined #tripleo06:32
*** jaosorior has quit IRC06:35
*** jaosorior has joined #tripleo06:35
*** jbadiapa_ has quit IRC06:39
*** dsariel has joined #tripleo06:40
*** jtomasek has joined #tripleo06:40
*** dpawar has joined #tripleo06:42
*** itlinux has quit IRC06:43
*** dxiri has joined #tripleo06:45
openstackgerritJuan Badia Payno proposed openstack/tripleo-heat-templates master: logging: merge fluentd-client and fluentd-base  https://review.openstack.org/50145706:45
*** moshele has quit IRC06:46
*** akane has quit IRC06:46
*** yolanda has joined #tripleo06:47
*** hjensas has quit IRC06:48
*** stevebaker has quit IRC06:49
*** akane has joined #tripleo06:49
*** stendulker has joined #tripleo06:50
*** stevebaker has joined #tripleo06:53
*** jbadiapa_ has joined #tripleo06:55
*** moshele has joined #tripleo06:55
*** dparkes has joined #tripleo06:55
*** pgadiya has joined #tripleo06:55
*** agurenko has joined #tripleo07:03
*** jaganathan has quit IRC07:09
*** moshele has quit IRC07:10
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172432807:10
openstackLaunchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel)07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173103207:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173106307:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173214007:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged]07:10
openstackLaunchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged]07:10
openstackLaunchpad bug 1732140 in tripleo "Kolla tests failing for tripleo-common master" [Critical,In progress] - Assigned to Adriano Petrich (apetrich)07:10
*** spectr has joined #tripleo07:12
*** hjensas has joined #tripleo07:12
*** spectr has quit IRC07:13
openstackgerritMerged openstack/tripleo-common master: Allow nfs-ganesha setup in ceph-ansible workbook  https://review.openstack.org/50512607:15
jaosoriorjbadiapa_: are all these logging commits meant to be backported?07:17
*** jprovazn has joined #tripleo07:19
*** yprokule has joined #tripleo07:21
*** hjensas has quit IRC07:21
*** marios has joined #tripleo07:22
*** sdoran has quit IRC07:22
*** masco has joined #tripleo07:22
*** stevebaker has quit IRC07:22
*** jpena|off has quit IRC07:24
*** jpena|off has joined #tripleo07:25
*** rcernin has quit IRC07:25
*** stevebaker has joined #tripleo07:26
jaosoriorstevebaker: around?07:27
*** threestrands has quit IRC07:30
openstackgerritMerged openstack/tripleo-heat-templates master: Define PGs for cephfs pools  https://review.openstack.org/51622407:31
openstackgerritMerged openstack/tripleo-heat-templates master: Start using nic-configs from THT repo instead of tripleo-ci  https://review.openstack.org/47670807:31
openstackgerritMerged openstack/tripleo-common master: Remove Pike-only migration steps  https://review.openstack.org/51258507:31
openstackgerritMerged openstack/python-tripleoclient master: Make heat container remove silent.  https://review.openstack.org/51024007:31
openstackgerritMerged openstack/instack-undercloud master: Make sure selinux permissions are correct on ~/.ssh.  https://review.openstack.org/49515707:31
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Dynamically generate FQDN hiera entries  https://review.openstack.org/52008207:32
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Dynamically generate VIP hiera entries  https://review.openstack.org/52033307:32
*** stevebaker has quit IRC07:32
*** stevebaker has joined #tripleo07:36
*** udesale has quit IRC07:37
*** udesale has joined #tripleo07:37
*** nyechiel has joined #tripleo07:38
jbadiapa_jaosorior, nope, as far as I know.07:39
*** jbadiapa_ is now known as jbadiapa07:39
jaosoriorjbadiapa: ok07:40
*** hjensas has joined #tripleo07:41
*** hjensas has quit IRC07:41
*** hjensas has joined #tripleo07:41
jaosoriorjbadiapa: So, if fluentd support is meant for OSP13, should I then not start working in the rsyslog forwarder?07:41
jbadiapajaosorior, I think eventually fluentd and rsyslog must be both optional at least in one release07:44
jaosoriorthat makes sense07:45
jaosoriorjbadiapa: is it on the backlog to get fluentd to read from the journal?07:45
*** ykarel is now known as ykarel|lunch07:45
*** paramite has joined #tripleo07:48
jaosoriorjistr: hey, when you have a chance could you check this out https://review.openstack.org/#/c/519577/ ?07:49
*** shardy has joined #tripleo07:52
Tengujaosorior: you can base rsyslog forwarder on the hiera values for fluentd. I did that in my infra07:52
jaosorior~mayhaps :D07:52
Tengujaosorior: the fluentd "sources" are exported as puppet fact, and on our puppet-server I've added a small code snippet that just create the rsyslog "readers" with im_file (or smth like that - rsyslog module)07:53
jbadiapajaosorior, nothing else on the fluentd backlog besides making easier maintenance07:54
jaosoriorok07:54
*** dmellado has quit IRC07:57
jaosoriorshardy: could you check this out https://review.openstack.org/#/c/520081/ >??07:57
jaosoriorshadower: and these two https://review.openstack.org/#/q/topic:bug/1732457+status:open07:57
*** dmellado has joined #tripleo07:58
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: WIP Make sure rabbitmq is fully up before creating any rabbitmq resources  https://review.openstack.org/52011907:58
*** hjensas has quit IRC07:59
openstackgerritMerged openstack/tripleo-common master: Add Barbican worker and keystone listener images  https://review.openstack.org/51707608:00
openstackgerritMerged openstack/tripleo-quickstart-extras master: Fix role name to validate-tempest in role files  https://review.openstack.org/47619008:00
jaosoriorshardy: : and these two https://review.openstack.org/#/q/topic:bug/1732457+status:open08:00
shardyjaosorior: ack will do08:00
*** tesseract has joined #tripleo08:02
shardyjaosorior: I think I spotted a problem with https://review.openstack.org/#/c/520082/08:04
*** ebarrera has joined #tripleo08:05
jaosoriorshardy: answered08:06
jaosoriorshardy: it's a bit confusing because we have name and name_lower08:06
jaosoriorshardy: and then, we have instances of name.lower(), which is not the same as name_lower08:06
*** rodolof has joined #tripleo08:08
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172432808:10
openstackLaunchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel)08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173103208:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173106308:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173214008:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged]08:10
openstackLaunchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged]08:10
openstackLaunchpad bug 1732140 in tripleo "Kolla tests failing for tripleo-common master" [Critical,In progress] - Assigned to Adriano Petrich (apetrich)08:10
shardyjaosorior: aha, thanks, I must need more coffee08:10
*** jmelvin has quit IRC08:11
jaosoriorshardy: or we need an easier to read code-base :)08:11
shardyjaosorior: comment on https://review.openstack.org/#/c/520333 - we have a boolean in network_data to determine if there's a vip, so perhaps use that?08:13
*** aufi has joined #tripleo08:13
jaosoriorshardy: I hadn't seen that boolean. Let me check that out08:14
shardyjaosorior: I think you can do something like if network.vip|default(false)08:14
jaosoriorshardy: thanks! that's better actually.08:14
*** pcaruana has joined #tripleo08:14
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Dynamically generate VIP hiera entries  https://review.openstack.org/52033308:15
*** moshele has joined #tripleo08:15
jaosoriorshardy: done. Thanks08:15
jaosoriorshardy: do we have a way currently to get the IPs for specific networks of other nodes?08:15
jaosoriorshardy: right now I see we have net_ip_map as part of the hieradata. Which is quite useful. But, would we have something similar for one node to know all the relevant IPs of other nodes by name?08:17
*** fragatin_ has quit IRC08:17
shardyjaosorior: Not atm but we calculate it per-service08:18
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/overcloud.j2.yaml#L66208:18
shardyIMO we should try to use that instead of putting assumptions about the network in use into puppet etc?08:18
shardyif you need it we could put {{role.name}}IpListMap, service_ips into the hieradata though, which is the list of IPs per network08:19
*** noslzzp has quit IRC08:19
*** noslzzp has joined #tripleo08:19
jaosoriorshardy: So, some months ago dsneddon and me did some work on an ansible role for enabling IPSEC in TripleO. What we did was parse the entries in /etc/hosts (which is not ideal), since we needed to set up tunnels for each network.08:19
openstackgerritSaravanan KR proposed openstack/tripleo-heat-templates master: Added NovaMigrationTarget service to OVS-DPDK role  https://review.openstack.org/51785708:19
jaosoriorshardy: I'd like to get rid of that, and get a hash that would be passed to the ansible role08:20
shardyjaosorior: Ok, how is the ansible role called?08:21
jaosoriorshardy: so, when we did it, it was part of a post-deployment step.08:21
shardywe already pass out RoleNetIpMap as an output, and that's consumed by the dynamic inventory08:21
jaosoriorshardy: now I'm looking into integrating that role as part of the TripleO deployment.08:21
jaosoriorshardy: I actually sent a mail about it today :D08:21
jaosoriorshardy: how does this RoleNetIpMap look like?08:22
shardyjaosorior: ack, well check https://review.openstack.org/#/c/517051/2/tripleo_validations/inventory.py - we could add the list for each network per role as well as the bind IP per node08:22
qwebirc77837i tested tripleo containerized overcloud have many docker service can't nomarl start.08:23
*** qwebirc77837 has quit IRC08:23
jaosoriorshardy: that sounds like what I need :O08:23
shardyjaosorior: http://paste.openstack.org/show/626476/08:23
jaosoriorshardy: thanks!08:23
*** mrch has joined #tripleo08:24
openstackgerritSaravanan KR proposed openstack/tripleo-heat-templates master: Added NovaMigrationTarget service to OVS-DPDK role  https://review.openstack.org/51785708:26
openstackgerritSaravanan KR proposed openstack/tripleo-heat-templates master: Add NovaMigrationTarget service to SR-IOV Compute role  https://review.openstack.org/52034208:26
Tripleo-user@jaosorior08:26
Tripleo-userjaosorior:08:27
Tripleo-useri use docker.io/hub tripleoupstream docker images08:27
*** pcaruana has quit IRC08:28
jaosoriorshardy: very nice! now, if we could pass a list of al the networks, to iterate that, it would be awesome :D08:29
*** oidgar has joined #tripleo08:29
*** agurenko has quit IRC08:29
jaosoriorTripleo-user: did that work for you?08:30
*** pcaruana has joined #tripleo08:32
*** yamahata has quit IRC08:33
*** agurenko has joined #tripleo08:33
Tripleo-useri use rdo overcloud-full.qcow2 .and docker.io/hub tripleoupstream docker images08:34
jaosoriorTripleo-user: did it work?08:34
Tripleo-userno08:35
Tripleo-usermany docker services can't start08:35
jaosoriorTripleo-user: is it the same issue as before?08:36
Tripleo-usernot ,and now i can deployment successed ,and tripleo web-ui appears login info,when i try to login dashboard ,it's report request 400 errors ,and i ssh ovsercloud node08:38
Tripleo-usercheck docker services , and many services exited08:38
*** ccamacho has joined #tripleo08:39
dpawarHi, where to check progress of "overcloud deploy" command ? where do we log it ?08:40
jaosoriorgfidente[m]: around?08:42
Tripleo-usertripleo web-ui have a Deploy progress  or  by the heat stack and nested stack08:42
*** jfrancoa has joined #tripleo08:44
*** ykarel|lunch is now known as ykarel08:46
*** amoralej|off is now known as amoralej08:46
*** yprokule_ has joined #tripleo08:46
jaosoriorTripleo-user: I'm honestly not very acquainted with the web-ui to be honest. jtomasek you around?08:46
* jtomasek reads back08:47
jaosoriorjtomasek: Tripleo-user needs help debugging a failed deployment, which he started through the web-ui08:48
*** yprokule has quit IRC08:49
*** yprokule_ is now known as yprokule08:49
jtomasekjaosorior: ok, Tripleo-user so do I understand correctly that you have deployment succeeded, but it appears that services are not running?08:50
*** ffiore has joined #tripleo08:50
*** pkovar has joined #tripleo08:50
jtomasekin any case, the debugging process should be the same as when you deploy via CLI08:51
*** cylopez has joined #tripleo08:51
Tripleo-useryes08:52
*** gfidente has joined #tripleo08:54
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-validations master: Add enabled networks in the role  as part of the inventory  https://review.openstack.org/52034608:55
jaosoriorshardy: something like that ^^08:55
*** ukalifon has joined #tripleo08:56
*** jpena|off is now known as jpena08:57
*** jaganathan has joined #tripleo08:57
*** gkadam has joined #tripleo09:01
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Fix path of cirros image for pingtest  https://review.openstack.org/52034909:03
shardyjaosorior: is that enough, as it'll show networks enabled even when they're mapped to the ctlplane?09:03
*** chem has quit IRC09:04
shardyI guess we could work that out with an ansible conditional09:04
jaosoriorshardy: what do you mean?09:05
jaosoriorshardy: oh, so you're thinking about the management network09:05
*** chem has joined #tripleo09:06
*** jpich has joined #tripleo09:06
shardyjaosorior: well all networks when network isolation is not enabled09:07
*** psachin has quit IRC09:08
jaosoriorshardy: uhm... well, what alternatives are there? Also, I don't think folks would do without network isolation in production.09:08
jaosoriorshardy: I'm fine restricting IPSEC to only be used with net-iso09:09
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172432809:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173103209:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173106309:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173214009:10
openstackLaunchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel)09:10
*** ooolpbot has quit IRC09:10
openstackLaunchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged]09:10
openstackLaunchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged]09:10
openstackLaunchpad bug 1732140 in tripleo "Kolla tests failing for tripleo-common master" [Critical,In progress] - Assigned to Adriano Petrich (apetrich)09:10
*** chem` has joined #tripleo09:11
*** chem has quit IRC09:13
openstackgerritAdriano Petrich proposed openstack/tripleo-common master: Validate parameters before updating  https://review.openstack.org/51124909:16
openstackgerritJose Luis Franco proposed openstack-infra/tripleo-ci master: WIP: Upgrade UC and OC using tripleo-upgrade role  https://review.openstack.org/51564309:17
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Layout components updates  https://review.openstack.org/51636109:18
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Modals with react-bootstrap  https://review.openstack.org/51636209:18
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Add/Update modal-related dependencies  https://review.openstack.org/51636309:18
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Rework ModalPanel to be based on react-overlays  https://review.openstack.org/51636409:18
*** sdoran has joined #tripleo09:18
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: ModalPanel vs Validations sidebar positioning  https://review.openstack.org/51636509:18
openstackgerritafazekas proposed openstack/tripleo-heat-templates stable/ocata: Enable ntp iburst  https://review.openstack.org/52035009:19
*** jaosorior has quit IRC09:20
*** lucas-afk is now known as lucasagomes09:23
*** udesale__ has joined #tripleo09:24
*** udesale has quit IRC09:25
openstackgerritCarlos Camacho proposed openstack/instack-undercloud master: Load undercloud DB password to a mistral environment  https://review.openstack.org/51829209:28
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Update roles listing  https://review.openstack.org/50941509:28
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Refactor ImportPlanCard into ActionCard  https://review.openstack.org/51226509:28
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: [WIP] Select Roles feature  https://review.openstack.org/51226609:28
*** holser has joined #tripleo09:30
*** suuuper has joined #tripleo09:30
*** fzdarsky_ is now known as fzdarsky09:32
*** sri__ has joined #tripleo09:34
*** sri__ has quit IRC09:35
*** sri__ has joined #tripleo09:35
*** athomas has quit IRC09:36
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates stable/pike: Tag workflows created by the templates  https://review.openstack.org/52035709:40
*** derekh has joined #tripleo09:41
openstackgerritGiulio Fidente proposed openstack/tripleo-common master: Add support for CephMgr in the ceph-ansible workflow  https://review.openstack.org/51163909:43
*** ipsecguy has quit IRC09:45
*** ipsecguy has joined #tripleo09:45
openstackgerritmathieu bultel proposed openstack/tripleo-common master: Add zaqarclient to TripleOAction  https://review.openstack.org/51634709:47
ccamachojaosorior, hey man, mind to check this simple cherrypick to pike ? https://review.openstack.org/#/c/519309/ the dependencies are merged, just missing this tht patch09:48
openstackgerrityatin proposed openstack/tripleo-quickstart master: Update default release to pike  https://review.openstack.org/52035809:49
openstackgerritGiulio Fidente proposed openstack/tripleo-common master: Switch the default Ceph container image from Jewel to Luminous  https://review.openstack.org/51896309:52
flaper87chandankumar: hey, around?09:57
flaper87chandankumar: wanted to ask you some things about tempest and containers :D09:57
*** athomas has joined #tripleo09:58
chandankumarflaper87: hello10:02
flaper87chandankumar: yoooooo :D10:02
flaper87chandankumar: hey, so, I was wondering if you have completed the work of putting tempest in containers and if you had some docs on how to run it :)10:02
chandankumarflaper87: nope i have not yet started,10:03
flaper87chandankumar: gotcha, np10:03
chandankumarflaper87: last time i tried when you were in Pune10:03
chandankumarflaper87: but i can start when i will be at home which is in my TODO10:03
*** yprokule_ has joined #tripleo10:04
chandankumarmay be next week10:04
flaper87chandankumar: I remember that! No rush, I was wondering if it was done already. I guess I can use plain tempest for now10:04
chandankumarflaper87: yup10:04
openstackgerritDerek Higgins proposed openstack/tripleo-docs master: Add details about boot baremetal from cinder volume  https://review.openstack.org/52005410:04
chandankumarflaper87: i think we can consuming plain containers in CI10:04
chandankumarflaper87: in featureset17 we are already running10:05
*** hjensas has joined #tripleo10:06
ratailoransiwen, you around ?10:06
chandankumarflaper87: https://github.com/openstack/tripleo-quickstart/blob/master/config/general_config/featureset017.yml#L7310:06
ratailorowalsh, let have discussion with sven here. ^10:06
*** yprokule has quit IRC10:07
*** yprokule_ is now known as yprokule10:07
flaper87chandankumar: so, that runs the entire tempest suite on the containers based deployment, right?10:07
ratailoransiwen, do we need to add ec2api in tls-everywhere env file. https://review.openstack.org/#/c/519599/10:07
chandankumarflaper87: one question, last time when i tried tempest in a container, we were not able to expose tempest and its family binary10:07
chandankumarflaper87: not full, a set of tests https://github.com/openstack/tripleo-quickstart/blob/master/config/general_config/featureset017.yml#L8810:08
flaper87chandankumar: why are we running just those 3?10:09
*** salmankhan has joined #tripleo10:10
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172432810:10
openstackLaunchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel)10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173103210:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173106310:10
*** ooolpbot has quit IRC10:10
openstackLaunchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged]10:10
openstackLaunchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged]10:10
openstackgerritMoshe Levi proposed openstack/tripleo-heat-templates master: Add ovs hardware Offload support to ovs mechansim driver  https://review.openstack.org/50740110:10
chandankumarflaper87: because those tests are a replacement of ping test and support for running tests related to other projects are not yet available in Tripleo and tempestconf it is a wip as well as if we run full tempest tests it is time consuming and more hardware is needed10:10
flaper87chandankumar: a-ha, clear now! thanks a bunch10:11
chandankumarflaper87: coming this question last time when i tried tempest in a container, we were not able to expose tempest and its family binary you were talking about some json file to modify for exposing10:11
*** florianf has joined #tripleo10:11
chandankumarflaper87: can you point me that example10:12
flaper87chandankumar: mmh, that was probably config.json ?10:12
chandankumarflaper87: where this file is ? may be10:12
flaper87chandankumar: have you tried using kolla's image for tempest? https://github.com/openstack/kolla/tree/master/docker/tempest10:13
chandankumarflaper87: last time we tried the same kolla image, i will check again10:13
flaper87chandankumar: coolio, let me know if I can help with anything10:14
flaper87brb10:14
chandankumarflaper87: yup sure :-)10:14
*** salmankhan1 has joined #tripleo10:15
*** hjensas has quit IRC10:15
openstackgerritChristian Schwede proposed openstack/puppet-tripleo master: Include swift base class in the proxy class  https://review.openstack.org/52036410:16
openstackgerritMerged openstack/puppet-tripleo stable/pike: Fix logrotate containers log  https://review.openstack.org/51956410:18
*** salmankhan has quit IRC10:18
*** salmankhan1 is now known as salmankhan10:18
openstackgerritChristian Schwede proposed openstack/tripleo-heat-templates master: Add swift_config puppet tag to the dockerized proxy service  https://review.openstack.org/52036510:21
*** jprovazn has quit IRC10:23
openstackgerritJuan Badia Payno proposed openstack/tripleo-common master: Fluentd: rename fluentd service  https://review.openstack.org/52001110:23
*** jprovazn has joined #tripleo10:23
*** jprovazn has quit IRC10:24
*** nguyentrihai has joined #tripleo10:25
*** salmankhan has quit IRC10:29
*** pkovar has quit IRC10:30
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Layout components updates  https://review.openstack.org/51636110:30
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Modals with react-bootstrap  https://review.openstack.org/51636210:30
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Add/Update modal-related dependencies  https://review.openstack.org/51636310:30
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Rework ModalPanel to be based on react-overlays  https://review.openstack.org/51636410:30
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: ModalPanel vs Validations sidebar positioning  https://review.openstack.org/51636510:30
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Add modal closing components  https://review.openstack.org/52036610:31
*** salmankhan has joined #tripleo10:36
*** jaganathan has quit IRC10:39
*** tosky has joined #tripleo10:41
*** jaganathan has joined #tripleo10:45
*** ffiore has quit IRC10:52
shardyflorianf: Hey when you get a moment could you please review https://review.openstack.org/#/c/517051/ ?10:54
shardyand/or mandre ^^10:55
*** leitan has joined #tripleo10:56
*** leitan has joined #tripleo10:57
*** hjensas has joined #tripleo11:01
*** ffiore has joined #tripleo11:06
jistrshardy, flaper87: hi, did you send or do you plan to send a talk proposal for DevConf about the Kubernetes work? I already pondered about this earlier with shardy but haven't followed up yet. I'll be definitely helping at the OpenStack booth but i could also do a talk (could be joint with someone else like we did updates/upgrades with gfidente and marios). If you already have something i'm happy to just do11:08
jistrthe booth work though :)11:08
*** ykarel is now known as ykarel|afk11:08
shardyjistr: Hey I think flaper87 has proposed an ansible/k8s talk, and I was considering a TripleO/containers one but not submitted anything yet11:09
*** stendulker has quit IRC11:10
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172432811:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173103211:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173106311:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel)11:10
openstackLaunchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged]11:10
openstackLaunchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged]11:10
*** dpawar has quit IRC11:10
*** jbadiapa has quit IRC11:12
*** marios has quit IRC11:13
*** ansmith has quit IRC11:13
*** cshastri has quit IRC11:17
*** psachin has joined #tripleo11:18
openstackgerritOpenStack Proposal Bot proposed openstack/os-apply-config master: Updated from global requirements  https://review.openstack.org/52047011:19
openstackgerritOpenStack Proposal Bot proposed openstack/os-collect-config master: Updated from global requirements  https://review.openstack.org/52047311:20
openstackgerritOpenStack Proposal Bot proposed openstack/os-refresh-config master: Updated from global requirements  https://review.openstack.org/52047411:20
*** bkopilov has quit IRC11:24
*** udesale__ has quit IRC11:25
openstackgerritLee Yarwood proposed openstack/tripleo-heat-templates master: WIP ffu: Introduce Fast Forward Upgrade tasks and playbooks  https://review.openstack.org/49922111:26
openstackgerritLee Yarwood proposed openstack/tripleo-heat-templates master: WIP ffu: tripleo-packages repo management  https://review.openstack.org/51542911:26
openstackgerritLee Yarwood proposed openstack/tripleo-heat-templates master: WIP ffu: Introduce keystone fast-forward upgrade tasks  https://review.openstack.org/51462111:26
openstackgerritLee Yarwood proposed openstack/tripleo-heat-templates master: DNM ffu: Workaround missing repo control when moving to Queens  https://review.openstack.org/51871911:26
openstackgerritOpenStack Proposal Bot proposed openstack/python-tripleoclient master: Updated from global requirements  https://review.openstack.org/52052311:27
*** jbadiapa has joined #tripleo11:28
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements  https://review.openstack.org/51918911:30
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-heat-templates master: Updated from global requirements  https://review.openstack.org/52054511:30
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-validations master: Updated from global requirements  https://review.openstack.org/52054611:30
openstackgerritRajesh Tailor proposed openstack/tripleo-heat-templates master: docker/internal TLS: spawn extra container for ec2api TLS proxy  https://review.openstack.org/52054711:30
*** ykarel|afk is now known as ykarel11:30
*** etingof has quit IRC11:32
*** dpawar has joined #tripleo11:33
*** shreshtha has quit IRC11:33
*** pblaho has joined #tripleo11:35
openstackgerritRajesh Tailor proposed openstack/tripleo-heat-templates master: docker/internal TLS: spawn extra container for ec2api TLS proxy  https://review.openstack.org/52054711:36
*** adarazs|ruck is now known as adarazs|ruck|lnc11:39
openstackgerritLee Yarwood proposed openstack/tripleo-heat-templates master: DNM: ffu: Remove yum update from upgrade_tasks  https://review.openstack.org/52055911:40
*** abregman is now known as abregman|pto11:42
*** pdeore has quit IRC11:43
florianfshardy: Looks like mandre was quicker. :-) But LGTM too.11:43
skramaja_beagles: around?11:47
*** jaosorior has joined #tripleo11:48
*** skramaja_ is now known as skramaja11:49
jaosoriorshardy: is this ready to merge https://review.openstack.org/#/c/520082/ ?11:51
*** pdeore has joined #tripleo11:51
jaosoriorshadower: also, can you revisit this https://review.openstack.org/#/c/520333/2 ?11:53
jaosorior* shardy11:54
*** morazi has quit IRC11:55
jaosoriormandre: any thoughts about https://review.openstack.org/#/c/520346/ ?11:57
*** Tripleo-user has quit IRC11:59
*** dpawar has quit IRC11:59
flaper87jistr: happy to co-present, fwiw12:00
beaglesjaosorior, would you consider a +A on https://review.openstack.org/#/c/490082/?12:00
jaosoriorbeagles: yep, lets have it pass CI and I'll +A12:01
beaglesjaosorior, actually I just rechecked due to a timeout on one of the jobs - I'll reping you once it passes12:01
beaglesjaosorior, yeah, what you said :)12:01
jaosoriorsure sure12:01
*** jpena is now known as jpena|lunch12:02
*** jprovazn has joined #tripleo12:03
*** etingof has joined #tripleo12:03
*** raildo has joined #tripleo12:07
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates stable/pike: Add missing host_prep_tasks for log dirs creation  https://review.openstack.org/52056812:07
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates stable/pike: Add missing host_prep_tasks for memcached  https://review.openstack.org/52056912:07
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates stable/pike: Write readme.txt into old log directories  https://review.openstack.org/52057012:07
*** marios has joined #tripleo12:09
jaosoriorjidar: those were clean cherry picks, right?12:09
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172432812:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173103212:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173106312:10
*** ooolpbot has quit IRC12:10
openstackLaunchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel)12:10
openstackLaunchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged]12:10
openstackLaunchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged]12:10
jaosorior* jistr those were clean cherry-picks, right?12:10
jistrjaosorior: the topmost one was dirty :D the small ones were clean12:11
jaosoriorjistr: ok12:11
jaosoriorreviewing that one12:12
jaosoriorjistr: can you review this one https://review.openstack.org/#/c/519577/ ? I really think ew should backport it too.12:12
jaosoriorjistr: cause right now /var/log/containers/swift will have nothing.12:12
jaosoriorjistr: commented on your patch. I think you missed a spot.12:15
*** dpawar has joined #tripleo12:19
*** ffiore has quit IRC12:22
*** cshastri has joined #tripleo12:22
openstackgerritMarios Andreou proposed openstack/tripleo-common stable/pike: Truncate the zaqar message to 512 kbytes  https://review.openstack.org/52057112:23
*** etingof has quit IRC12:23
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates stable/pike: Write readme.txt into old log directories  https://review.openstack.org/52057012:23
openstackgerritMarios Andreou proposed openstack/tripleo-common stable/pike: Truncate the zaqar message to 512 kbytes  https://review.openstack.org/52057112:25
jistrjaosorior: so the rsyslog rule takes effect on the host, IIUC? in other words, to have swift logs at the moment, we have to make sure we don't remove the swift packages from bare metal?12:26
jaosoriorjistr: correct12:27
jaosoriorjistr: so, I want to backport that to stable/pike12:27
jaosoriorjistr: then I'll try to get the rsyslog-base image to be built by RDO.12:27
jaosoriorjistr: once it's built, we can use a sidecar container to output those logs to the file12:28
jaosoriorthat way we wouldn't need to rely on the host anymore12:28
ratailorjaosorior, did you mean something like this for having containerized ec2api with tls: https://review.openstack.org/#/c/520547/12:28
jaosoriorratailor: yes, something exactly like that. Now, does ec2 contain httpd in the image?12:28
jistrjaosorior: thanks, makes sense, i sent it to gate12:28
jaosoriorratailor: you'll need something like this for the ec2 container images https://github.com/openstack/tripleo-common/blob/master/container-images/tripleo_kolla_template_overrides.j2#L5412:30
*** ramishra has quit IRC12:30
*** dpawar has quit IRC12:31
ratailorjaosorior, Thanks! will do that.  meanwhile could you pl review https://review.openstack.org/#/c/520274/    https://review.openstack.org/#/c/520273/12:31
openstackgerritJanki Chhatbar proposed openstack/tripleo-common master: Optimize opendaylight_api container healhcheck  https://review.openstack.org/52057312:31
*** lucasagomes is now known as lucas-hungry12:32
*** dprince has joined #tripleo12:33
openstackgerritOliver Walsh proposed openstack/puppet-tripleo master: Configure libvirt SASL SCRAM-SHA1 when TLS is enabled  https://review.openstack.org/52025312:34
*** pradk has joined #tripleo12:35
*** etingof has joined #tripleo12:35
jaosoriorowalsh: got some docs that I can read on the SASL configuration so I can review your patches better?12:35
*** pdeore has quit IRC12:36
owalshjaosorior: https://libvirt.org/auth.html#ACL_server_username12:36
owalshjaosorior: and https://libvirt.org/auth.html#Auth_client_config12:36
jaosoriorthanks12:36
ykarelHi, is it possible to run two tq environments(for example master and pike) on same VIRTHOST12:37
openstackgerritOr Idgar proposed openstack/tripleo-common master: Octavia post deployment mistral wrapper  https://review.openstack.org/51540212:39
*** rhallisey has joined #tripleo12:42
*** dmacpher has joined #tripleo12:43
*** masco has quit IRC12:44
*** adarazs|ruck|lnc is now known as adarazs|ruck12:45
*** abishop has joined #tripleo12:45
owalshjaosorior: worked for me (tm) although I've not tried TLS + containers yet12:46
*** hjensas has quit IRC12:46
jaosoriorowalsh: uhm, got a t-h-t patch?12:47
owalshjaosorior: yea, same topic12:47
jaosoriorcool cool12:47
jaosoriorI'll check it out12:47
owalshjaosorior: all red until I get updated images though12:48
jaosoriorunderstandable12:48
*** arxcruz is now known as arxcruz|brb12:48
openstackgerritYurii Prokulevych proposed openstack/tripleo-heat-templates master: Add HostnameFormatDefault parameter to Block/Object/Ceph roles.  https://review.openstack.org/51965812:49
openstackgerritGiulio Fidente proposed openstack/tripleo-common stable/pike: Fail ceph-ansible workflow if there is stale puppet-ceph hieradata  https://review.openstack.org/52057712:50
jaosoriorowalsh: reviewed.12:50
*** ansmith has joined #tripleo12:51
owalshjaosorior: need to push a new patch to fix indentation either way12:51
*** morazi has joined #tripleo12:52
jaosoriorhaha yeah12:52
*** dsariel has quit IRC12:53
owalshjaosorior: and missed a doc for a puppet-tripleo param. I can make it a boolean for this while I'm at IIRC I'll need another for the nova client side12:54
*** StevenK has quit IRC12:55
owalshjaosorior: can default to the libvirt value I guess12:55
*** morazi_ has joined #tripleo12:55
*** morazi has quit IRC12:55
*** StevenK has joined #tripleo12:55
jaosoriorright12:55
skramajabeagles: have few mins, wanted to discuss about https://review.openstack.org/#/c/507401/12:56
owalshjaosorior: actually, I think libvirt can configure it if we have a passwd, and the flag for the client config switches it on in nova12:56
beaglesskramaja, 1s on call12:58
*** dxiri has quit IRC12:58
*** dxiri has joined #tripleo12:58
skramajasure, ping me once done..12:58
openstackgerritMoshe Levi proposed openstack/tripleo-heat-templates master: Add ovs hardware Offload support to ovs mechansim driver  https://review.openstack.org/50740112:59
*** pgadiya has quit IRC12:59
owalshjaosorior: because it's nova::migration::libvirt in client.pp that enables TLS in libvirt.conf, so even if libvirt.pp configures the passwd it will not be used unless we have the tls flag set13:03
jaosorioruhm... right13:05
jaosoriorowalsh: well, I don't have a particularly strong opinion about it. It's fine if you leave it that way.13:05
jaosoriorshardy: hey, regarding https://review.openstack.org/#/c/520346/ uhm... what would be an alternative then?13:05
*** jaganathan has quit IRC13:05
*** liverpooler has quit IRC13:06
*** etingof has quit IRC13:07
*** jlabarre has joined #tripleo13:08
*** oidgar has quit IRC13:08
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172432813:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173103213:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173106313:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel)13:10
openstackLaunchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged]13:10
openstackLaunchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged]13:10
openstackgerritRajesh Tailor proposed openstack/tripleo-common master: Add httpd packages to ec2api image  https://review.openstack.org/52058113:10
*** rfolco has joined #tripleo13:10
skramajadprince: did you had a change to validate https://review.openstack.org/#/c/500475/? saneax is working on to bring up DPDK CI using quickstart, which requires this fix.13:11
slaglejistr: can u review https://review.openstack.org/#/c/514784/ and parents?13:11
*** brian83 has joined #tripleo13:13
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates master: Re-enable libvirt TLS with SCRAM SHA-1 auth  https://review.openstack.org/52025413:14
openstackgerritMerged openstack/tripleo-validations master: Updated from global requirements  https://review.openstack.org/52054613:14
*** links has quit IRC13:14
dprinceskramaja: looking again now13:15
skramajathanks dprince13:15
*** pgadiya has joined #tripleo13:16
jaosoriorslagle: commented on a couple of the patches.13:17
slaglejaosorior: replied13:17
shardyjaosorior: I guess we can either modify the RoleNetIpMap to only output enabled networks, or have another output that checks if network.enabled?13:18
shardyjaosorior: I guess it's fine to land the inventory change and iterate on the t-h-t part later13:18
fultonjmandre: would you mind reviewing https://review.openstack.org/#/c/508975 ? thanks13:18
openstackgerritOliver Walsh proposed openstack/puppet-tripleo master: Configure libvirt SASL SCRAM-SHA1 when TLS is enabled  https://review.openstack.org/52025313:19
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates master: WIP: Convert tags to when statements for Q major upgrade workflow  https://review.openstack.org/51090213:20
beaglesskramaja, I see that the openvswitch resource was only being used in the neutron-ovs-agent yaml for the upgrade tasks... given that. I'm okay with the parameter where it is for now.13:20
*** oidgar has joined #tripleo13:21
jaosoriorshardy: Whatever you think is best. This stuff is for OSP13, so we could first fix up t-h-t and then make the inventory additions13:21
*** jpena|lunch is now known as jpena13:21
*** ffiore has joined #tripleo13:21
openstackgerritRajesh Tailor proposed openstack/tripleo-heat-templates master: docker/internal TLS: spawn extra container for ec2api TLS proxy  https://review.openstack.org/52054713:21
skramajathanks beagles, plz honor the patch with your +2 :) moshele ^13:21
beaglesskramaja, ack13:22
dprinceskramaja: +2. Sorry to hold this up.13:22
skramajabeagles: i am planning to refactor by removing deprecated params , in which i will look if we can do something better with resepect to dpdk parameters on openvswithc.yaml13:22
beaglesskramaja, cool13:22
skramajadprince: thanks.13:22
dprinceskramaja: the missing peice for me (over a month ago) was the new file13:22
jaosoriorslagle: would it make sense to change the permissions of the log as part of that patch?13:22
*** pgadiya has quit IRC13:23
owalshjaosorior: is TLS + containers in good shape?13:23
jaosoriorowalsh: it was last time I checked :D it's been a while though13:23
*** trown|outtypewww is now known as trown13:23
slaglejaosorior: don't think so...i did it in packaging, https://review.rdoproject.org/r/1054313:24
owalshjaosorior: do we have a quickstart config for it or roll my own?13:25
jaosoriorowalsh: do you have a TLS deployment already?13:25
jaosoriorowalsh: It's pretty easy to reuse it13:25
dprinceskramaja: would be nice if there were perhaps a mechanism to align these in Kolla proper. But its okay, I get your approach now13:25
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart master: Docker file for running quickstart in container  https://review.openstack.org/52058313:25
jaosoriorslagle: that works for me13:26
*** bfournie has quit IRC13:26
owalshjaosorior: ah, of course. I need more coffee :-)13:26
*** bfournie has joined #tripleo13:26
*** ffiore has quit IRC13:26
*** bfournie has quit IRC13:26
*** thrash|g0ne is now known as thrash13:26
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates master: WIP: Convert tags to when statements for Q major upgrade workflow  https://review.openstack.org/51090213:26
jaosoriorowalsh: you would run ./overcloud-prep-containers.sh   and then do the overcloud deploy appending the docker.yaml environment13:26
skramajadprince: there are some changes in progress related to https://bugzilla.redhat.com/show_bug.cgi?id=147879113:27
openstackbugzilla.redhat.com bug 1478791 in rhosp-director "Fixing the permission mismatch for DPDK vhost user ports with openvswitch and qemu" [Medium,Assigned] - Assigned to skramaja13:27
owalshjaosorior: yup... didn't even occur to me!13:27
*** tzumainn has joined #tripleo13:27
skramajadprince: which requires the user-id to be changed from qemu to hugetlpfs.. i working on it. i will try if i can align it with kolla..13:27
jaosoriorslagle: but doesn't the ansible log end up in the temp directory?13:28
jaosoriorslagle: https://github.com/openstack/tripleo-common/blob/master/tripleo_common/actions/ansible.py#L8213:28
weshayadarazs|ruck, re: http://logs.openstack.org/25/446525/23/gate/legacy-tripleo-ci-centos-7-scenario002-multinode-oooq-puppet/5c0d206/logs/undercloud/home/zuul/tempest_output.log.txt.gz13:28
dprinceskramaja: sounds good. Again, sorry for the holdup on my -1. I had not realized you had split this out into a separate patch which added that other file13:28
*** lucas-hungry is now known as lucasagomes13:28
dprincethe .conf file13:28
weshaydoes that failure signature match the volumebootpattern bug on master?13:29
adarazs|ruckweshay: let me check13:29
mandrefultonj: have you looked at the job failure for scenario001? just making sure it's not related to your patch13:29
*** oidgar has quit IRC13:30
skramajadprince: no issues. i was not looking at it as the downstream approach was different. atleast now i got some cycles to clear it out..13:30
weshayadarazs|ruck, it would be interesting, because thus far we've only seen that on master13:30
*** rlandy has joined #tripleo13:30
fultonjmandre: yes, i have looked at those failures and there's a comment in my review linking the symptom of the failure to the relevant bug which made scenario001 non-voting13:30
fultonjwhere SSH failes to connect13:30
*** shreshtha has joined #tripleo13:31
*** rlandy is now known as rlandy|rover13:31
weshaydprince, we're still hanging in the same spot http://logs.openstack.org/41/519441/12/check/legacy-tripleo-ci-centos-7-undercloud-containers/ff01361/logs/undercloud/home/zuul/undercloud_install.log.txt.gz13:31
adarazs|ruckweshay: it does look like https://bugs.launchpad.net/tripleo/+bug/1731063 to me, yes.13:31
openstackLaunchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged]13:31
moshelebeagles: it will be great if can review this https://review.openstack.org/#/c/507100/13:32
weshayadarazs|ruck, interesting.... can you run that by mwhahaha I think he'd be interested in seeing that13:32
beaglesmoshele, ack13:32
*** ramishra has joined #tripleo13:32
fultonjmandre: so the VMs are running (they had privously failed but I fixed it) and the logs support that they are running. This issue is just in getting the key metadata to land before the SSH attempt.13:32
fultonjscenario001-multinode-oooq-container failed because it has been failing 20% of the time as per https://bugs.launchpad.net/tripleo/+bug/173106313:32
openstackLaunchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged]13:32
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Debug configuration for neutron metadata agent  https://review.openstack.org/52028013:32
*** ffiore has joined #tripleo13:34
mandrefultonj: oh right, I'm looking at the tempest log right now... always the same issue where it can't connect to the vm13:34
adarazs|ruckweshay: hmm, so where do you see that this job didn't run on master? I think it's on master.13:34
adarazs|ruckweshay: at least here I see "--release tripleo-ci/master" http://logs.openstack.org/25/446525/23/gate/legacy-tripleo-ci-centos-7-scenario002-multinode-oooq-puppet/5c0d206/job-output.txt.gz#_2017-11-16_10_55_01_87797913:34
*** dpawar has joined #tripleo13:35
weshayhrm.. too early ya.. that was a mistake13:36
fultonjthanks mandre, do you want to +w it?13:36
fultonj(has two +2's)13:36
*** dpawar has quit IRC13:36
mandrefultonj: absolutely :)13:36
fultonjthanks13:36
*** pgadiya has joined #tripleo13:36
*** dsariel has joined #tripleo13:37
slaglejaosorior: it doesn't end up in the tmp dir, b/c we pass an explicit work_dir13:37
slaglejaosorior: that's in the next patch13:37
jaosoriorslagle: that makes sense. Is that stuff that will be backported to pike? should probably move the fernet key rotation workflow to use that as well13:39
*** gfidente is now known as gfidente|afk13:40
slaglejaosorior: i have no immediate plan to do that as I'm doing this to support config-download13:40
slaglejaosorior: but that doesnt mean some parts of it couldn't be13:40
*** gfidente|afk has quit IRC13:40
slaglei think /tmp is inherently insecure, so i think a backport that changed that default would probably be ok13:41
*** sshnaidm is now known as sshnaidm|bbl13:41
*** akane has quit IRC13:41
mosheleskramaja: who should I add for the puppet-nova change https://review.openstack.org/#/c/520041/ ?13:41
jaosoriorslagle: I think it would be great to have that in pike.13:42
*** aditya_r has joined #tripleo13:44
*** ramishra has quit IRC13:44
weshayrlandy|rover, fyi https://bugs.launchpad.net/tripleo/+bug/173247713:45
openstackLaunchpad bug 1732477 in tripleo "Container deployment failing at overcloud-prep-containers" [High,Triaged]13:45
*** vpickard_ is now known as vpickard13:46
rlandy|roverwill look13:46
*** aputtur_ has joined #tripleo13:47
openstackgerritChristian Schwede proposed openstack/tripleo-heat-templates master: Format SwiftRawDisks before attempting to mount  https://review.openstack.org/51643613:47
*** ramishra has joined #tripleo13:49
*** etingof has joined #tripleo13:49
*** dxiri has quit IRC13:50
skramajamoshele: may be EmilienM and mwhahaha could look at https://review.openstack.org/#/c/520041/..13:50
*** dxiri has joined #tripleo13:50
*** skramaja has quit IRC13:51
openstackgerritRajesh Tailor proposed openstack/tripleo-heat-templates master: docker/internal TLS: spawn extra container for ec2api TLS proxy  https://review.openstack.org/52054713:51
jaosoriorratailor: can you add the depends-on to the tripleo-common patch?13:51
ratailorjaosorior, I have added on triploe-heat-template patch, I think that will need the container image.13:52
jaosoriorratailor: right, please add a depends-on on the t-h-t towards the tripleo-common patch that adds httpd and mod_ssl to the ec2 container images.13:53
ratailorjaosorior, sure,13:53
openstackgerritRajesh Tailor proposed openstack/tripleo-heat-templates master: docker/internal TLS: spawn extra container for ec2api TLS proxy  https://review.openstack.org/52054713:53
trownweshay: btw ... my consecutive tempest run on fs16 passed 100 times in a row... not reproducible on rdocloud13:54
*** jmelvin has joined #tripleo13:54
trownI am going to recycle that env13:54
*** etingof has quit IRC13:54
ratailorjaosorior, done. Thanks!13:54
jaosoriorthank you :D13:54
weshaytrown can you doc that in the bug?13:54
trownweshay: sure13:54
weshaytrown++13:54
ratailorhttps://review.openstack.org/#/c/520273/13:57
ratailorhttps://review.openstack.org/#/c/520274/13:57
ratailorEmilienM, shardy mandre adarazs|ruck  could you pl review these patches ^^ for enabling TLS for ec2api, needs those to be merged in pike ASAP.13:57
weshaydprince, do we need the latest heat packages from consistent for https://review.openstack.org/#/c/519441/13:57
*** ratailor has quit IRC13:58
*** jaosorior has quit IRC13:58
*** pgadiya has quit IRC13:58
dprinceweshay: I don't think so. The Heat part is all great.13:59
dprinceweshay: I spoke w/ eck` yesterday (one of our Rabbitmq experts) regarding the epmd error. Still thinking it might be hostname related. I'm still trying some hacks around that... but gotta say this all works for me locally so it is a bit perplexing still in CI13:59
*** bfournie has joined #tripleo14:00
weshaydprince, agree it worked for me locally a couple days ago, setting up a fresh env now14:00
weshaydprince, http://logs.openstack.org/41/519441/12/check/legacy-tripleo-ci-centos-7-undercloud-containers/ff01361/logs/undercloud/home/zuul/undercloud-install.sh.txt.gz has divered from doit.sh quite a bit though14:01
* weshay looking at that too14:01
*** ramishra has quit IRC14:01
*** Goneri has joined #tripleo14:01
*** amoralej is now known as amoralej|lunch14:02
*** adarazs|ruck is now known as adarazs|ruck|afk14:02
weshaydprince, the hostname should be something like centos-7-rax-ord-0000905771 ?14:04
*** ykarel is now known as ykarel|away14:04
*** etingof has joined #tripleo14:06
*** leitan has quit IRC14:06
*** shreshtha has quit IRC14:07
openstackgerritRonelle Landy proposed openstack/tripleo-docs master: Add documentation for TripleO/RDO/OSP Pipelines  https://review.openstack.org/51065714:07
eck`weshay: the sketchy thing i noticed was duplicate entries for the short hostname in /etc/hosts14:08
eck`one for a public interface and another one for 127.0.0.214:08
*** shreshtha has joined #tripleo14:08
*** dpawar has joined #tripleo14:08
eck`and epmd was configured explicitly to bind to 127.0.0.214:08
*** ramishra has joined #tripleo14:08
eck`but i think the resolver was probably returning the other one14:08
*** janki has quit IRC14:08
*** janki has joined #tripleo14:09
openstackgerritJustin Kilpatrick proposed openstack/tripleo-quickstart-extras master: Add disruption detector for Overcloud endpoint monitoring  https://review.openstack.org/52012614:09
eck`so when you'd try to hit epmd, you'd end up hitting the other interface that it isn't listening on14:09
shardyjistr: Hey running into another kubespray problem, it seems it now tries to install docker-engine from a docker repository, but this conflicts with the installed docker in the overcloud-full image14:09
*** cdearborn has joined #tripleo14:09
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172432814:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173103214:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173106314:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel)14:10
openstackLaunchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged]14:10
openstackLaunchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged]14:10
shardyjistr: I guess we can erase docker before running kubespray, but wondered if you'd already hit this14:10
*** almondjoy has joined #tripleo14:12
shardyIt also raises some questions around packaging kubespray I think, e.g how we can make it run without access to side repos14:12
*** liverpooler has joined #tripleo14:12
*** arxcruz|brb is now known as arxcruz14:14
*** d0ugal has quit IRC14:15
*** ramishra has quit IRC14:16
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: add config to set neutron mtu in undercloud/overcloud  https://review.openstack.org/50966014:16
*** toure_biab is now known as toure14:17
jistrshardy: we had that disabled i think, but maybe something changed14:18
*** chem` is now known as chem14:18
jistrshardy: https://github.com/openstack/tripleo-heat-templates/blob/master/extraconfig/services/kubernetes-master.yaml#L13914:18
jistrthe skip-tags used to prevent kubespray from trying to manage docker installation14:18
*** d0ugal has joined #tripleo14:18
shardyjistr: aha, my bad I ran it manually without the skip tags after hitting a different error, thanks!14:19
*** ramishra has joined #tripleo14:19
*** rodolof has quit IRC14:20
*** moshele has quit IRC14:21
*** moshele has joined #tripleo14:22
weshayeck`, it's good to see that EPMD has made it's way into tripleo https://en.wikipedia.org/wiki/EPMD14:26
eck`haha14:27
*** ramishra has quit IRC14:30
*** yamahata has joined #tripleo14:32
trownya tripleo is now strictly business14:32
*** lblanchard has joined #tripleo14:32
*** lblanchard has quit IRC14:32
*** aufi has quit IRC14:34
*** dsariel has quit IRC14:34
*** ramishra has joined #tripleo14:34
*** aufi has joined #tripleo14:34
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart-extras master: Migrate tripleo-quickstart-extras to zuul v3 jobs  https://review.openstack.org/52027614:35
*** mdnadeem has quit IRC14:35
weshaytrown :)14:36
*** dpawar has quit IRC14:36
weshayrlandy|rover, adarazs|ruck|afk FYI just filed https://bugs.launchpad.net/tripleo/+bug/173270614:37
openstackLaunchpad bug 1732706 in tripleo "tripleo ci / quickstart jobs have duplicate entries in /etc/hosts" [High,Triaged]14:37
*** nyechiel has quit IRC14:37
openstackgerritMerged openstack/tripleo-common master: Remove references to the current task from task() in baremetal.yaml  https://review.openstack.org/51625714:40
*** psachin has quit IRC14:41
*** itlinux has joined #tripleo14:43
openstackgerritMerged openstack/tripleo-ui master: Fix node count formatting on deployment page  https://review.openstack.org/51860714:43
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: WIP Make sure rabbitmq is fully up before creating any rabbitmq resources  https://review.openstack.org/52011914:44
*** gfidente has joined #tripleo14:45
*** gfidente has quit IRC14:45
*** gfidente has joined #tripleo14:45
*** dpawar has joined #tripleo14:45
openstackgerritHonza Pokorny proposed openstack/tripleo-ui stable/pike: Fix node count formatting on deployment page  https://review.openstack.org/52060614:46
*** cshastri has quit IRC14:49
*** adarazs|ruck|afk is now known as adarazs|ruck14:49
mwhahahalooks like the queue is fubar again, great14:50
*** ramishra has quit IRC14:51
*** leitan has joined #tripleo14:51
*** ramishra has joined #tripleo14:51
adarazs|ruckweshay: hmm, I'd be surprised if double entries in /etc/hosts would make some problems, but it's possible.14:52
EmilienMmwhahaha: fyi - when I removed legacy jobs from project-config, I also removed the tripleo legacy jobs from projects like nova, neutron, aodh, ceilometer, etc. Because we'll have to re-add them in-tree with the new job. I'll take care of that. Note it's better because projects can now quickly disable it if they find it broken etc14:55
mwhahahak14:56
*** ykarel|away has quit IRC14:57
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/47260715:00
*** ramishra has quit IRC15:01
*** ramishra has joined #tripleo15:02
*** amoralej|lunch is now known as amoralej15:03
*** oidgar has joined #tripleo15:04
*** jaosorior has joined #tripleo15:04
*** moshele has quit IRC15:05
*** lblanchard has joined #tripleo15:05
*** cylopez has quit IRC15:08
jistrslagle: sorry got to the reviews too late :) it's all merging though which is nice :))15:10
jpichflorianf: If your ~/.quickstart is old it's possible it got stale, there were some changes to quickstart-extras that might not have gotten pulled in. I had virt-customize related errors last week, related to https://review.openstack.org/#/c/518336/ - now merged... Perhaps deleting that directory and retrying would help?15:10
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172432815:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173103215:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173106315:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel)15:10
openstackLaunchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged]15:10
openstackLaunchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged]15:10
honzamwhahaha: would you mind sending an email to this thread to officially approve it?  http://lists.openstack.org/pipermail/openstack-dev/2017-November/124273.html15:10
adarazs|ruckmwhahaha: are we going to remove scenario001? we can't submit fixes for pike because scenario001 job is not letting it go through... :(15:10
adarazs|ruckmwhahaha: by remove I mean remove voting from it.15:10
mwhahahaadarazs|ruck: it is not voting already, but why is it blocking pike?15:11
*** almondjoy has quit IRC15:11
florianfjpich: thx! I already tried to delete ./quickstart which didn't help. But not sure if I'm using the most recent quickstart-extras tho. Will check that out next...15:11
honzaflorianf: what's the error?  I didn't see it in scrollback15:12
shardyjistr: did you have a kubespray PR to make the directory for credentials configurable?15:12
shardyWe fail atm trying to write to /usr/share/kubespray/credentials which I recall was discussed before15:13
florianfhonza: https://paste.fedoraproject.org/paste/UZnXk7XMWXBuI1DnheISvQ15:13
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Debug configuration for neutron metadata agent  https://review.openstack.org/52028015:13
jpichflorianf: I suppose yeah, might as well compare the files first to see if they included these changes15:13
jpichflorianf: That's about the extent to which I could help :-)15:13
adarazs|ruckmwhahaha: https://review.openstack.org/519770 -- here legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-puppet FAILURE in 2h 13m 26s15:14
mwhahahahrm i switched it to non-voting15:14
mwhahahaadarazs|ruck: i'll take a look in abit15:14
adarazs|ruckmwhahaha: zuul -1'd it because of that half an hour ago.15:14
florianfjpich: thanks a lot!15:15
jistrshardy: yes https://review.openstack.org/#/c/518376/15:15
mwhahahaadarazs|ruck: it seems that was a not defined like the rest when i removed it in https://review.openstack.org/#/c/520155/15:15
jistrshardy: you might have to delete it from the original location though15:15
shardyjistr: ah, thanks, thought I'd seen it somewhere15:15
shardyjistr: yeah I also noticed you have to delete it to get an updated tree, I had errors because the kubespray version was old15:16
openstackgerritOliver Walsh proposed openstack/puppet-tripleo master: Configure libvirt SASL SCRAM-SHA1 when TLS is enabled  https://review.openstack.org/52025315:16
shardyjistr: thanks I'll test with your patch15:16
jistrshardy: but that's not strictly for credentials, just general kubespray location. If we had kubespray packaged, it would still fail on the creds i think (i wasn't aware that it was writing there).15:16
shardyjistr: ah, so we may need to add a var to enable it to write somewhere else then, I'll take a look at that15:17
jistrshardy: cool, thanks15:17
openstackgerritMerged openstack/tripleo-puppet-elements master: Include required packages for libvirt SASL auth  https://review.openstack.org/52010815:17
honzaflorianf: I think it's fixed here https://review.openstack.org/#/c/518336/15:17
honzaflorianf: is this on rdo cloud?15:18
florianfhonza: thx! going to check this out next.15:18
*** spectr has joined #tripleo15:18
florianfhonza: nope, home dev box15:18
*** almondjoy has joined #tripleo15:18
florianfhonza: the oldfashioned way :-)15:18
mwhahahahonza: done, feel free to add them to the appropriate groups15:18
honzahaha15:18
honzamwhahaha: thanks!15:18
florianfhonza, jpich: thx for your help! gotta run now, will try later and let you know how it went!15:19
*** dsariel has joined #tripleo15:19
jpichflorianf: Good luck!15:19
*** bobh has joined #tripleo15:22
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Add ignore_errors for memcached readme.txt  https://review.openstack.org/52061615:23
jaosoriorcould I get a review for this https://review.openstack.org/#/c/520037/ ?15:23
jaosoriorjust cleaning up the environments15:24
*** bkopilov has joined #tripleo15:24
openstackgerritMerged openstack/tripleo-heat-templates master: Add Docker service to the undercloud roles  https://review.openstack.org/51845415:25
*** mrch has quit IRC15:28
*** gbarros has quit IRC15:28
*** gbarros has joined #tripleo15:30
*** spectr has quit IRC15:30
*** cshastri has joined #tripleo15:32
jistrjaosorior, marios: i checked whether removing the proxy/storage packages on upgrade could break the rsyslog logging, and it looks like python-swift (where the rsyslog rule is) will stay installed, so we should be in the clear15:33
jistrmarios: this is related to https://review.openstack.org/#/c/51957715:34
jaosoriorjistr: well, either way I think we should move towards relying less on the host.15:34
mariosjistr: thanks, checking15:35
jaosoriorjistr: I'll work on getting a sidecar container for swift.15:35
jistrjaosorior: yea definitely, i just wanted to gauge whether we need to act on this for Pike, and it looks to me like we don't need to15:35
*** agurenko has quit IRC15:36
jaosoriorcool cool15:37
openstackgerritJohn Fulton proposed openstack/tripleo-docs master: Add parameter_defaults to Ceph example snippets  https://review.openstack.org/52062315:37
fultonjgfidente: ^15:37
*** etingof has quit IRC15:40
*** gbarros has quit IRC15:40
*** etingof has joined #tripleo15:41
*** gbarros has joined #tripleo15:42
jtomasekshardy: hi, would it be ok if I introduced networks directory in t-h-t to include networks definitions so we get networks to match the roles implementation? the fact that this directory does not exist in t-h-t is currently blocking tripleo-common networks management work15:42
shardyjtomasek: Hi, sure please do, although we'll also need the tripleo-common/tripleoclient logic to combine them15:44
jtomasekshardy: I know that there is 'enabled' flag in network_data which we could potentially use, but I think making it equal to how we operate roles is better, considering that only change required is addition of networks dir15:44
shardyjtomasek: yeah agreed, aligning it with the roles/* approach would be good15:44
jtomasekshardy: yes, that is what tripleo-common work is about15:45
jtomasekshardy: ok, cool I am going to create the patch15:45
shardyjtomasek: ack, thanks!15:45
openstackgerritYurii Prokulevych proposed openstack/tripleo-heat-templates master: Add HostnameFormatDefault parameter to Block/Object/Ceph roles.  https://review.openstack.org/51965815:47
EmilienMsdoran: hey, I might need your help a bit today for ansible/tripleo/ci thing, if you have some time15:48
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: Don't try to start docker for the UC  https://review.openstack.org/51944115:48
sdoranEmilienM: Sure thing. I have a Dr. appt in about an hour. Will be around after that.15:49
*** ramishra has quit IRC15:49
*** fragatina has joined #tripleo15:49
EmilienMsdoran: ok, cool. Ping me when you have time, I don't move today15:49
sdoran👍15:49
mwhahahaah fiddle sticks the queue just reset15:50
jaosoriorflaper87, jistr: Are the ansible roles for keystone and mariadb for k8s under the tripleo umbrella?15:50
EmilienMmwhahaha: on which job?15:50
mwhahahanot sure it was teh top one15:51
mwhahahaand didn't catch it15:51
EmilienMmwhahaha: we can find out, let me see15:51
*** itlinux has joined #tripleo15:51
mwhahahaEmilienM: actually it might have been the project change that reset it15:52
EmilienMmwhahaha: damn I can't15:52
mwhahahagimme a few and i'll be able ot find it15:52
* mwhahaha has secret ways15:52
EmilienMmwhahaha: no it's not merged yet15:52
EmilienMit' sin gate now15:52
mwhahahaoh yea15:52
jaosoriorEmilienM, mwhahaha: We want to start using rsyslog for log forwarding (optionally) for TripleO. jkilpatr had some pretty cool configuration written down for browbeat (in ansible). If we want to separate it into it's own role, would it be appropriate to put that ansible role under the tripleo umbrella?15:53
mwhahahajaosorior: yes but likely not in ansible form15:53
jaosoriorEmilienM, mwhahaha: Eventually I want to use that role and configure rsyslog as composable service in tripleo15:53
jaosoriormwhahaha: what do you mean?15:53
jistrjaosorior: yes re ansible roles under tripleo umbrella https://github.com/openstack/governance/blob/master/reference/projects.yaml#L4563-L458815:53
*** aditya_ra has joined #tripleo15:53
mwhahahajaosorior: gimme a few15:54
jaosoriormwhahaha: I did a similar question on the mailing list regarding an IPSEC ansible role :D15:54
mwhahahaEmilienM: https://review.openstack.org/#/c/518650/ looks like job timeout15:55
*** aditya_ra has quit IRC15:55
flaper87jaosorior: they are15:55
*** aditya_ra has joined #tripleo15:55
mwhahahajaosorior: yea and my concern on that stuff is how it gets properly ordered in the deploy and that if it conflicts with existing configs the impact of the idempotency15:55
EmilienMmwhahaha: scenario002 :(15:55
EmilienMit's flaper87's fault15:55
*** aditya_ra has quit IRC15:55
mwhahahajaosorior: using ansible to configure stuff may be fine but it needs to be carefully evaluated on it's impact given the configurations15:55
jaosoriormwhahaha: well, we would put rsyslog in a container as well :/15:56
owalshjaosorior: just thinking https://review.openstack.org/520254 needs to wait for images & docker images but...15:56
jaosoriormwhahaha: IPSEC would be on the host though.15:56
owalshjaosorior: is anything in the gate or promotion enabling TLS?15:56
flaper87EmilienM: it's always my fault15:57
mwhahahajaosorior: right so we just need to evaulate it. we do have the k8s roles under the tripleo umbrella so i'm not against that15:57
*** ramishra has joined #tripleo15:57
jkilpatrmwhahaha, I can write it in whatever but I'm pretty attached to jinja templating and some ansible features to check that everything is working. Rsyslog is very finicky15:57
mwhahahajaosorior: it's the integration that needs to be carefully looked at15:57
jaosoriorowalsh: you can rnu check experimental. But that's timing out currently :/15:57
jkilpatrmwhahaha, so the alternative is what puppet or heat?15:57
*** aditya_r has quit IRC15:57
flaper87mwhahaha: jaosorior what's this discussion about?15:57
flaper87sorry, my brain is almost dead for the day15:57
owalshjaosorior: gonna fail due to the missing package15:57
jkilpatrflaper87, rsyslog as a tripleo deployable multi machine logging solution15:57
mwhahahajkilpatr: it might have to be a combination of ansible/puppet depending on what actually gets touched15:58
flaper87jkilpatr: thanks15:58
owalshjaosorior: wondering if it we can land it without waiting for new images with the required pkg15:58
jkilpatrforwarding to elasticsearch probably, or just a plain-text aggregator server, that works too RH already packages eveything required as of rhel 7.415:58
mwhahahajkilpatr: so we'll need more details and to take a look at what the ansible role does today to say what the impact on the deploy is15:58
*** aditya_r has joined #tripleo15:58
jaosoriormwhahaha, jkilpatr: So, the way I see it is that the ansible role could be modified to just generate the configuration at some specified point. And then we could just load that configuration in the container as we do with every other tripleo service.15:59
jkilpatrmwhahaha, right now on rhel you need to enable rhel 7.4 optional, on centos everything is already packaged, install a few rsyslog packages, template a python script, run the python script to find active servers on each machine, use that to template an rsyslog config then fix selinux rules to let rsyslog see the outside world15:59
jkilpatrfinally if you have forwarding enabled it tests the recieving server16:00
jkilpatrand runs some rsyslog config validation.16:00
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Update the Docker registry defaults to rdoproject  https://review.openstack.org/52020116:00
*** ccamacho has quit IRC16:00
jkilpatrjaosorior, that works, we can make a golden container for every version, that's fine. My big concern is when people up and move log files on you16:00
* jkilpatr grr16:00
EmilienMmwhahaha: scenario001 non voting for real, now.16:01
mwhahahaEmilienM: k, yea scenario002 was a timeout during deploy like it was just taking too long. probably the vm16:01
EmilienMok16:01
jaosoriorjkilpatr: so that's what I'm working on. Making the overcloud containers log to stdout, which gets picked up by journald, and then, what the rsyslog container would do is real the host's journald and parse that.16:01
*** ukalifon has quit IRC16:02
jaosoriorjkilpatr: I'm also trying to minimize the parsing, by enabling json outputs for the logs, which would help with stacktraces.16:02
jaosoriorthat would also give us the log's context (user, project, domain, request-id)16:02
*** pblaho has quit IRC16:02
mwhahahajaosorior: jkilpatr: yea don't get me wrong on wanting to improve teh logging (cause we definately need to). I'd just like to see some documenation/proposal around what exactly we're going to do before adding repos to the tripleo umbrella16:03
mwhahahaso please write something up for review16:03
jaosoriorok16:03
jkilpatrjaosorior, so the systemd plugin for rsyslog gives a ton of context16:03
jkilpatrit's great16:03
jaosoriorjkilpatr: what's your timezone? should we schedule something to talk about this?16:03
mwhahahajust saying oh look we have an ansible module, is not sufficient16:03
*** openstackgerrit has quit IRC16:03
jkilpatrjaosorior, that would be great, I'm in EST16:03
jaosoriorI'm in Finland (it's 6pm here)16:04
jkilpatrmwhahaha, sounds good, I'll submit a spec once jaosorior and I duke out exactly what we think is best.16:04
jaosoriorchecking what time is it in EST16:04
mwhahahajaosorior: noon16:04
jaosoriorjkilpatr: at what time do you usually log in?16:04
mwhahahasorry 1116:04
jkilpatrjaosorior, sounds like we can have a meeting in my early AM, I get started at 7am or 6am if I get up early16:04
*** ccamacho has joined #tripleo16:04
jaosoriorjkilpatr: that's awesome, lets do that16:04
* mwhahaha fails at the TZ conversion from mountain to eastern16:04
*** ramishra has quit IRC16:05
*** ffiore has quit IRC16:06
jaosoriormwhahaha: if you have time to check this out later, it would be appreciated --  http://lists.openstack.org/pipermail/openstack-dev/2017-November/124615.html16:08
mwhahahajaosorior: yea it's still unread :D16:08
jaosoriorno rush, somewhere in the day or tomorrow16:09
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172432816:10
openstackLaunchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel)16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173103216:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173106316:10
*** ooolpbot has quit IRC16:10
*** jaosorior has quit IRC16:10
openstackLaunchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged]16:10
openstackLaunchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged]16:10
*** janki has quit IRC16:10
*** openstackgerrit has joined #tripleo16:12
openstackgerritKeith Schincke proposed openstack/puppet-tripleo master: Update cephx keys with ACLs for openstack services.  https://review.openstack.org/51953116:12
*** pcaruana has quit IRC16:13
openstackgerritJiri Tomasek proposed openstack/tripleo-heat-templates master: [WIP] Add networks directory  https://review.openstack.org/52063416:15
*** ffiore has joined #tripleo16:17
*** aufi has quit IRC16:19
openstackgerritJose Luis Franco proposed openstack/tripleo-docs master: WIP: Fill in upgrades CI developer doc  https://review.openstack.org/52063616:20
*** ebarrera has quit IRC16:24
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Specify docker.io defaults for upstream config release files.  https://review.openstack.org/52063916:28
*** chem has quit IRC16:29
*** nyechiel has joined #tripleo16:29
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Specify docker.io defaults for upstream config release files.  https://review.openstack.org/52063916:29
*** chem has joined #tripleo16:29
*** salmankhan has quit IRC16:32
*** aditya_r has quit IRC16:33
*** sshnaidm|bbl is now known as sshnaidm16:34
*** salmankhan has joined #tripleo16:36
*** fragatina has quit IRC16:43
*** pradk has quit IRC16:45
openstackgerritRajesh Tailor proposed openstack/tripleo-heat-templates master: docker/internal TLS: spawn extra container for ec2api TLS proxy  https://review.openstack.org/52054716:46
*** weshay is now known as weshay_bbiab16:46
mwhahahatripleoclient patch failed out with dlrn http://logs.openstack.org/71/513871/5/gate/legacy-tripleo-ci-centos-7-nonha-multinode-oooq/c661261/logs/delorean_logs/28/3b/283b8a23ef9f6114e0829db267ca754a7809e217_dev/build.log.txt.gz16:49
EmilienMamoralej ^16:49
chandankumararxcruz: mwhahaha https://review.openstack.org/#/c/519305/16:49
mwhahahaso sorry, tripleo-quickstart-extras failure https://review.openstack.org/#/c/513871/16:49
mwhahahaso it looks like the tests might be writing out stuff and leaking files16:50
amoralejEmilienM, checking...16:50
arxcruzmwhahaha: chandankumar did it have the v2 fix? It was merged yesterday16:50
arxcruzdoes it*16:50
mwhahahaarxcruz: probaly not since it's specific versions16:51
EmilienMchandankumar: any progress on https://review.openstack.org/#/c/499928/ ?16:51
arxcruzhmmm, that is something that would be nice to have... but it will get in eventually16:51
*** pradk has joined #tripleo16:52
chandankumararxcruz: it is available check here https://trunk.rdoproject.org/centos7-master-head/report.html16:52
chandankumarin rpms16:53
beaglesanyone run into a task failure on "Install pip" form quickstart-extra's validate-tempest's stackviz.yml - can't see much in the way of details. Just wondering if it is something that we know can happen sporadically or its a proper issue16:54
beagless/form/from/16:54
EmilienMarxcruz: you can abandon https://review.openstack.org/#/c/520612/ please - I'm migrating all jobs to zuul v316:54
EmilienMarxcruz: I'll remove it in my patch, no worries16:55
arxcruzEmilienM: ok, thanks16:55
EmilienMcool16:55
openstackgerritMarkos Chandras (hwoarang) proposed openstack/diskimage-builder master: elements: zypper-minimal: Refresh repositories where necessary  https://review.openstack.org/52064916:55
arxcruzEmilienM: done16:55
EmilienMcool16:55
mwhahahahrm we really need that debugging patch for metadata agent wonder if it's passed ci yet16:56
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Debug configuration for neutron metadata agent  https://review.openstack.org/52028016:57
mwhahahanope16:57
*** gfidente has quit IRC16:57
mwhahaha6th times a charm16:58
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: DNM: Testing debug neutron metadata  https://review.openstack.org/51975617:00
pradkmwhahaha, so any thoughts regarding https://bugs.launchpad.net/tripleo/+bug/1724328 .. i'm wondering if we force a dep like this it might help -> https://review.openstack.org/#/c/520234/17:00
openstackLaunchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel)17:00
amoralejEmilienM, that's unit test failure17:00
*** marios has quit IRC17:01
EmilienMchandankumar: ?17:01
pradkmwhahaha, the retry seems to not help during upgrade17:01
amoralejit seems we hit that once in https://review.rdoproject.org/r/#/c/10440/17:01
mwhahahayea tripleoclient is doing some file stuff and it's causing problems17:01
chandankumarEmilienM: sorry i need to check currently stuck with neutron tempest plugin playing catch catch with zuul patches there17:01
mwhahahapradk: not sure, is the problem that gnocchi isn't started yet?17:01
amoralejthere may be some race condition?17:01
EmilienMchandankumar: I think we want to run this test asap, let me know how we can help.17:02
chandankumarEmilienM: let me rebase that and let see what zuul says17:02
EmilienMchandankumar: before that17:02
EmilienMchandankumar: have you checked failures?17:02
pradkmwhahaha, yea seems like an ordering issue.. but i dont have the logs from then yet to confirm17:02
*** yamahata has quit IRC17:03
mwhahahapradk: yea that would be one way to tackle it then17:03
mwhahahapradk: though it only covers the local use case17:03
chandankumarEmilienM: http://logs.openstack.org/28/499928/18/check/legacy-tripleo-ci-centos-7-scenario002-multinode-oooq/ab71156/logs/undercloud/home/zuul/tempest_output.log.txt.gz#_2017-11-04_08_07_41 request timout failure17:04
mwhahahapradk: the retry was for the other HA nodes17:04
mwhahahapradk: would need logs again to confirm17:04
chandankumarEmilienM: i will debug tomorrow on that17:04
EmilienMchandankumar: thanks. and again let me know if you need help on debug17:04
chandankumarEmilienM: sure :-)17:05
*** gbarros has quit IRC17:05
mwhahahaamoralej, EmilienM: i think it's python-tripleoclient doing bad stuff in the tests and not properly mocking out paths. I saw another one recently with a similar problem https://bugs.launchpad.net/tripleo/+bug/173201017:05
openstackLaunchpad bug 1732010 in tripleo "CI: tripleoclient package build fails because unit tests fail because tmp file exists" [Critical,Triaged]17:05
openstackgerritMerged openstack/tripleo-ui stable/pike: Fix node count formatting on deployment page  https://review.openstack.org/52060617:06
*** gbarros has joined #tripleo17:06
*** dparkes has quit IRC17:08
*** yprokule has quit IRC17:08
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172432817:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173103217:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173106317:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel)17:10
openstackgerritKeith Schincke proposed openstack/tripleo-common master: Add support for ceph_rbdmirror_ansible_vars from tht  https://review.openstack.org/52065817:10
openstackLaunchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged]17:10
openstackLaunchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged]17:10
*** adarazs|ruck is now known as adarazs17:12
amoralejmwhahaha, it's failing to create "~/.tripleo"17:14
amoralejthat may be because it already exists17:14
amoralejif it's created by other test17:14
amoralejas it's not mocked17:14
mwhahahaamoralej: right the tests in python-tripleoclient are not properly mocking file interactions17:14
amoralejyeah17:15
*** raildo has quit IRC17:15
*** jfrancoa has quit IRC17:16
*** ffiore has quit IRC17:17
mwhahahajrist: do you guys own python-tripleoclient?17:17
*** thrash is now known as thrash|eatz17:20
*** aditya_r has joined #tripleo17:20
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: Fix hardcoded dependency for ExtraConfigPost.  https://review.openstack.org/51894717:21
*** aditya_r has quit IRC17:22
pradkmwhahaha, can we merge this https://review.openstack.org/#/c/518595/17:27
EmilienMpradk: looking17:27
EmilienMpradk: who will maintain the  undercloud.conf.sample ?17:28
mwhahahapradk: I'm afraid given the queue that it may hit the above build problem17:28
jpichmwhahaha: We do what we can, what's the issue?17:28
EmilienMpradk: imho it should be generated in the instack-underclou-distgit17:28
EmilienMpradk: and shipped in the rpm17:28
EmilienMmwhahaha: ^ wdyt?17:28
mwhahahajpich: the unit tests need to get checked so it stops leaking files17:29
pradkEmilienM, we want to move to using undercloud deploy.. thats the whole point of this bp17:29
EmilienMpradk: I know17:29
mwhahahaEmilienM: this is to replace the instack undercloud17:29
pradkcorrect17:29
mwhahahaSo python-tripleoclient-dist git17:29
EmilienMI'm talking about shipping a .conf.sample in git versus rpm17:29
*** fragatina has joined #tripleo17:29
EmilienMerr sorry tripleoclient yeah17:29
*** rwsu has joined #tripleo17:30
mwhahahaEmilienM: we already ship the example in instack undercloud17:30
EmilienMpradk: do you know what I mean?17:30
EmilienMmwhahaha: do we generate it?17:30
mwhahahaEmilienM file tech-debt bug17:30
mwhahahaNo17:30
pradkyea we already do this in instack and generate this file17:30
EmilienMwe should ship it in the rpm17:30
EmilienMnot in git17:30
mwhahahaRight file tech debt bug17:30
EmilienMso we automate its generation and we don' thave to maintain it17:30
EmilienMmwhahaha: I will17:30
jpichmwhahaha: Right, is there a bug open for that one? I can try and have a look into it17:31
EmilienMpradk: because right now with your patch, we have to maintain it.17:31
pradkEmilienM, sure, but it doesnt have to be packaged from git..17:31
mwhahahajpich: see above17:31
EmilienMpradk: how the file is used?17:31
mwhahahajpich: https://bugs.launchpad.net/tripleo/+bug/173201017:31
openstackLaunchpad bug 1732010 in tripleo "CI: tripleoclient package build fails because unit tests fail because tmp file exists" [Critical,Triaged]17:31
EmilienMpradk: is there anything that actually use this file?17:31
jpichmwhahaha: Alright, thanks!17:31
mwhahahajpich: but the last failure was a different file17:31
pradkEmilienM, tripleoclient17:31
*** gkadam has quit IRC17:31
mwhahahajpich: so it's a larger issye17:32
pradkEmilienM, i guess you missed this patch -17:32
pradkhttps://review.openstack.org/#/c/511350/17:32
EmilienMlooking17:32
*** ccamacho has quit IRC17:32
EmilienMpradk: do you understand my worry?17:32
EmilienMpradk: I'm going to push a patch in tripleoclient distgit - I don't want to block your stuff17:33
jpichmwhahaha: I don't doubt it, let's open bugs as we find these issues17:33
EmilienMpradk: I just want to explain why it's bad to push a config file in git17:33
EmilienMbecause if someone adds new options, we have to manually update this file17:34
EmilienMand it will be missed for sure17:34
mwhahahajpich: k do you want me to open a different bug for this instance?17:34
EmilienMpradk: I'm creating a launchpad bug now to follow up this disucssion17:35
*** dougbtv_ has joined #tripleo17:35
jpichmwhahaha: That would be helpful, thank you17:36
EmilienMpradk: https://bugs.launchpad.net/tripleo/+bug/173275017:37
openstackLaunchpad bug 1732750 in tripleo "Do not generate undercloud.conf.sample in-tree" [High,Triaged] - Assigned to Emilien Macchi (emilienm)17:37
*** trown is now known as trown|lunch17:38
mwhahahajpich: https://bugs.launchpad.net/tripleo/+bug/173275117:39
openstackLaunchpad bug 1732751 in tripleo "python-tripleoclient package failed to build due to already existing ~/.tripleo" [Critical,Triaged]17:39
jpichmwhahaha: Cheers, will see what I can find out as well17:39
EmilienMpradk: I'll work on it17:40
*** nguyentrihai has quit IRC17:43
*** raildo has joined #tripleo17:45
*** moshele has joined #tripleo17:46
*** sshnaidm is now known as sshnaidm|off17:51
*** moshele has quit IRC17:53
pradkEmilienM, sorry was on call .. I understand, I'm fine with not keeping it in tree if thats preferred17:57
pradkthough from dev pov, it might be a pain to remember to generate it each time17:57
pradkbut no biggie17:57
EmilienMpradk: it's generated in the rpm17:57
EmilienMyou don't do it17:57
EmilienMpradk: like ceilometer for ex17:57
pradkEmilienM, yea currently we dont really use rpm based deploy for dev.. its from git using undercloud_containers repo17:58
pradkEmilienM, but yea as i said i'm fine with dropping it ..17:59
pradki can update doit.sh to run tox -e genconfig17:59
*** derekh has quit IRC18:01
*** lucasagomes is now known as lucas-afk18:01
*** suuuper has quit IRC18:01
EmilienMpradk: yeah, thx18:03
*** hjensas has joined #tripleo18:03
*** hjensas has quit IRC18:03
*** hjensas has joined #tripleo18:03
*** shreshtha_ has joined #tripleo18:04
*** shreshtha has quit IRC18:04
*** raildo has quit IRC18:05
*** raildo has joined #tripleo18:06
*** cshastri has quit IRC18:09
*** jpena is now known as jpena|off18:10
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172432818:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173103218:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173106318:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel)18:10
openstackLaunchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged]18:10
openstackLaunchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged]18:10
openstackgerritMerged openstack/tripleo-docs master: Add details about boot baremetal from cinder volume  https://review.openstack.org/52005418:11
*** salmankhan has quit IRC18:14
*** stendulker has joined #tripleo18:14
*** myoung is now known as myoung|biaf18:14
*** myoung|biaf is now known as myoung|bbiab18:15
*** dpawar has quit IRC18:15
*** stendulker has quit IRC18:17
*** holser has quit IRC18:21
*** amoralej is now known as amoralej|off18:23
*** gbarros has quit IRC18:24
*** dougbtv_ has quit IRC18:24
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Specify docker.io defaults for upstream config release files.  https://review.openstack.org/52063918:25
*** dsneddon has joined #tripleo18:27
*** tesseract has quit IRC18:27
*** tosky has quit IRC18:30
*** rodolof has joined #tripleo18:32
EmilienMpradk: where do you want to ship the file? in instack-undercloud code path?18:33
EmilienMpradk: or in /etc?18:33
pradkEmilienM, for backward compatibility.. it should be in $HOME/. like instac does18:34
EmilienMpradk: mhh ok18:36
EmilienMI'll check that out18:36
*** Lokesh_Jain__ has joined #tripleo18:37
openstackgerritDan Prince proposed openstack/python-tripleoclient master: Pre-run validations and verifications for the undercloud  https://review.openstack.org/51385618:39
mwhahahano the file gets shipped to /usr/share/instack-undercloud18:39
pradkEmilienM, are you just adding it in the rpm spec?18:40
mwhahahaso it should go to /usr/share/python-tripleoclient18:40
pradkmwhahaha, ah ok, does it get copied over to home then?18:40
mwhahahayes18:40
pradkgotcha18:40
mwhahahais part of teh install instructions that everyone here ignores18:40
mwhahahahttp://tripleo.org/install/installation/installation.html#installing-the-undercloud18:40
mwhahahaitem #418:40
openstackgerritPradeep Kilambi proposed openstack/python-tripleoclient master: Add support to generate a sample undercloud.conf  https://review.openstack.org/51859518:40
mwhahahacp /usr/share/instack-undercloud/undercloud.conf.sample ~/undercloud.conf18:41
pradkEmilienM, ok i removed the sample from the commit ^^18:41
pradkmwhahaha, EmilienM, if you can +2 and merge18:41
*** etingof has quit IRC18:41
EmilienMpradk: the gate is really busy anyway18:42
EmilienMpradk: it won't merge today18:42
pradkkk18:42
EmilienMpradk: done but that's all.18:43
pradki'll update the tripleoclient spec to generate it on build18:43
pradkcool18:43
honzaWhat can use as OS_MESSAGE_CLIENT_ID for zaqar commands (e.g. openstack messaging)?18:44
slagleEmilienM: i thought you said don't merge anything :)18:44
slaglestarting......18:44
slagleRIGHT NOW18:44
pradklol18:44
pradkmerge everything !18:45
EmilienMlol18:46
* EmilienM needs to stop being nice :P18:47
honzaor more broadly: how can list all messages in a zaqar queue?18:47
honzathe stats command seems unreliable18:47
*** thrash|eatz is now known as thrash18:55
EmilienMpradk: it's a bit more complex than I thought, we'll need a config-generator file, like https://github.com/openstack/ceilometer/blob/master/etc/ceilometer/ceilometer-config-generator.conf18:55
pradkEmilienM, we already do18:55
pradkEmilienM, see my commit :)18:55
EmilienMsigh18:56
EmilienMsorry18:56
pradkEmilienM, i can update the spec to generate it, if you are ok.18:57
EmilienMpradk: I was working on it18:57
pradkok go4it18:57
EmilienMpradk: thx. I was thinking where to ship it, we never shipped anything in $HOME before.18:57
pradkalso need oslo.config requires18:57
EmilienMpradk: yeah, I figured that18:57
pradkcool18:58
EmilienMpradk: I'm wondering if we can use /etc/tripleo/undercloud.conf for example18:58
EmilienMand for backward compat, we can symlink later in $HOME18:58
EmilienMhow does it sound?18:58
pradkyea or we can stick with /usr/share/ like instack .. either is fine with me.18:59
pradkdo we have anything in /etc/tripleo currently?19:00
*** trown|lunch is now known as trown19:01
EmilienMpradk: not afik19:02
EmilienMpradk: problem with /usr/share/ is if we want to modify the config19:02
EmilienMwe want that right?19:02
*** shardy has quit IRC19:03
pradkright, i guess what why the docs suggest use to copy to $HOME19:04
pradkuser*19:04
EmilienMok good then19:06
slaglethe only config read is either specified via --config-file or is ~/undercloud.conf19:06
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172432819:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173103219:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173106319:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel)19:10
openstackLaunchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged]19:10
openstackLaunchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged]19:10
*** itlinux has quit IRC19:12
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: zuul: run undercloud gate jobs in tripleo queue  https://review.openstack.org/52068919:13
*** jpich has quit IRC19:13
*** thrash is now known as thrash|biab19:15
openstackgerritHonza Pokorny proposed openstack/tripleo-common master: Cast content-length to an int when comparing sizes  https://review.openstack.org/52069219:16
*** beagles has left #tripleo19:19
EmilienMpradk, slagle: please review https://review.rdoproject.org/r/1055219:21
pradkk19:22
EmilienMit will fail in CI, since your patch isn't merged19:23
EmilienMbut at least you can provide early feedback19:23
pradkyou will need to include in files section19:24
*** gbarros has joined #tripleo19:27
EmilienMpradk: why?19:29
*** salmankhan has joined #tripleo19:29
pradkEmilienM, otherwise removing the package wont clean it up.. as it doesnt own it19:30
EmilienMpradk: nice catch19:31
openstackgerritChristian Schwede proposed openstack/tripleo-heat-templates master: Format SwiftRawDisks before attempting to mount  https://review.openstack.org/51643619:31
*** etingof has joined #tripleo19:32
*** raissa has quit IRC19:32
EmilienMpradk: just %config ? without path?19:32
EmilienMalso, %config(noreplace) probably19:33
*** salmankhan has quit IRC19:33
EmilienMpradk: I'm afk 30min, feel free to push over, or let a comment. thx19:34
pradkok19:38
stevebakermorning19:38
mwhahahapradk: EmilienM: it shouldn't be a config, it should still be undercloud.conf.sample19:42
pradkmwhahaha, but in this case, we're not leaving it as sample.. we are copying it over to undercloud.conf19:46
pradkso we should clean it up19:46
mwhahahait should still be .sample was my point19:47
pradkor may be make it a ghost file19:47
pradkright i'm fine with just keeping it sample, if so we can skip the config19:48
mwhahahayea to mirror what we do in instack-undercloud19:48
mwhahahato mirror the existing workflow for the operator19:48
mwhahahathey copy the sample to the home and modify that19:48
mwhahahaso we just need to leave it as undercloud.conf.sample19:48
pradki agree19:49
*** zshi_ has quit IRC19:50
*** ecerquei has joined #tripleo19:53
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: DNM: Testing debug neutron metadata  https://review.openstack.org/51975619:54
mwhahahapradk, stevebaker: https://review.openstack.org/#/c/520280/ if you have a second. trying to get more logs for Bug 173106319:56
openstackbug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] https://launchpad.net/bugs/173106319:56
*** myoung|bbiab is now known as myoung19:57
*** thrash|biab is now known as thrash19:59
pradkmwhahaha, done20:01
mwhahahathanks20:01
*** pcaruana has joined #tripleo20:06
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172432820:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173103220:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173106320:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel)20:10
openstackLaunchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged]20:10
openstackLaunchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged]20:10
openstackgerritMerged openstack/tripleo-heat-templates master: Enable httpd to request certificates for the "external" network  https://review.openstack.org/52008120:27
openstackgerritMerged openstack/tripleo-heat-templates master: Add yml extension to kubespray inventory  https://review.openstack.org/51968220:27
*** nyechiel has quit IRC20:29
*** holser has joined #tripleo20:33
*** pradk has quit IRC20:37
*** jprovazn has quit IRC20:39
*** raildo has quit IRC20:42
*** oidgar has quit IRC20:43
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: Fail on upgrade if legacy ceph::profile::params::osds hiera is found  https://review.openstack.org/52001720:50
openstackgerritMerged openstack/python-tripleoclient master: Add option for ceph ansible playbook  https://review.openstack.org/51543620:50
*** itlinux has joined #tripleo20:50
*** pradk has joined #tripleo20:52
openstackgerritSteve Baker proposed openstack/tripleo-common master: Finish deprecation of pull_source  https://review.openstack.org/51613820:52
openstackgerritSteve Baker proposed openstack/tripleo-common master: Memoize docker uploader and client  https://review.openstack.org/51920020:52
openstackgerritSteve Baker proposed openstack/tripleo-common master: Implement post-upload cleanup of docker images  https://review.openstack.org/51920120:52
*** akrzos has quit IRC20:55
*** lblanchard has quit IRC20:57
openstackgerritAlan Bishop proposed openstack/tripleo-heat-templates master: Update Iscsid puppet_config to reset host's IQN  https://review.openstack.org/52078720:58
* mwhahaha sighs at the gate21:01
mwhahahathe top change is failing out21:01
*** akrzos has joined #tripleo21:03
EmilienMmwhahaha: timeout again?21:05
*** holser has quit IRC21:06
mwhahahaNot sure yet. Deploy failed21:06
openstackgerritAndreas Jaeger proposed openstack/diskimage-builder master: Remove setting of version/release from releasenotes  https://review.openstack.org/52079221:07
*** holser has joined #tripleo21:07
*** aputtur_ has quit IRC21:09
mwhahahaEmilienM: http://logs.openstack.org/77/519577/5/gate/legacy-tripleo-ci-centos-7-scenario002-multinode-oooq-container/965b71e/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2017-11-16_21_00_2421:10
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172432821:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173103221:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173106321:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel)21:10
openstackLaunchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged]21:10
openstackLaunchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged]21:10
mwhahahaseems to be Bug 1731032 again21:10
*** yamahata has joined #tripleo21:10
*** chem` has joined #tripleo21:10
EmilienMwhat's this one?21:10
mwhahahaheat timeout21:11
mwhahahalooking into it further21:11
mwhahahaEmilienM: http://logs.openstack.org/77/519577/5/gate/legacy-tripleo-ci-centos-7-scenario002-multinode-oooq-container/965b71e/logs/subnode-2/var/log/journal.txt.gz#_Nov_16_19_44_24 that's the last subnode deploy action21:13
mwhahahait seems like it enver queries heat again or something21:13
mwhahahaoc-collect-config that is21:13
*** chem has quit IRC21:14
*** rhallisey has quit IRC21:15
*** weshay_bbiab is now known as weshay21:17
*** yamahata has quit IRC21:17
*** ansmith has quit IRC21:17
jristmwhahaha: yes more or less. jpich is the maintainer21:18
mwhahahajrist: yea we chatted, jpich is aware of the bugs21:18
jristcool thanks21:18
*** dprince has quit IRC21:23
*** pcaruana has quit IRC21:24
*** liverpooler has quit IRC21:25
itlinuxhello all.. I am looking into implementation of regions.. two dc .. any tips thanks21:25
*** chlong has joined #tripleo21:28
mwhahahazaneb, therve: we really need some help with this one as it's something in heat https://bugs.launchpad.net/tripleo/+bug/1731032 Is there anything we can enable to help with the debugging when it happens?21:38
openstackLaunchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged]21:38
openstackgerritmathieu bultel proposed openstack/tripleo-common master: Add zaqarclient to TripleOAction  https://review.openstack.org/51634721:45
*** holser has quit IRC21:53
*** leitan has quit IRC21:57
*** itlinux has quit IRC21:59
*** ecerquei has quit IRC22:04
*** trown is now known as trown|outtypewww22:04
*** colonwq has quit IRC22:05
*** colonwq has joined #tripleo22:05
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172432822:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173103222:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173106322:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel)22:10
openstackLaunchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged]22:10
openstackLaunchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged]22:10
mwhahahaEmilienM: so the last failure seems to befailing on ControllerUpgradeInitDeployment22:10
*** rcernin has joined #tripleo22:10
mwhahahai'm trying to figure out what of that would hang22:10
EmilienMon http://logs.openstack.org/77/519577/5/gate/legacy-tripleo-ci-centos-7-scenario002-multinode-oooq-container/965b71e/logs/subnode-2/var/log/journal.txt.gz#_Nov_16_19_44_24 ?22:10
mwhahahayea22:11
EmilienMk gimme a min22:11
mwhahahahttp://logs.openstack.org/77/519577/5/gate/legacy-tripleo-ci-centos-7-scenario002-multinode-oooq-container/965b71e/logs/undercloud/var/log/heat/heat-engine.log.txt.gz#_2017-11-16_19_44_07_81222:11
mwhahahait never finishes22:11
mwhahahafor whatever reason22:11
mwhahahawhere in in a successful run it does stop, http://logs.openstack.org/77/519577/5/check/legacy-tripleo-ci-centos-7-scenario002-multinode-oooq-container/5bbf7e7/logs/undercloud/var/log/heat/heat-engine.log.txt.gz#_2017-11-14_16_27_30_27022:12
mwhahahaso http://logs.openstack.org/77/519577/5/check/legacy-tripleo-ci-centos-7-scenario002-multinode-oooq-container/5bbf7e7/ OK, http://logs.openstack.org/77/519577/5/gate/legacy-tripleo-ci-centos-7-scenario002-multinode-oooq-container/965b71e/ FAIL22:13
EmilienMok22:14
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Check DeployedServerPortMap  https://review.openstack.org/52081622:15
slaglestevebaker: ^^. i think that'll work22:15
*** morazi_ has quit IRC22:15
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Check DeployedServerPortMap  https://review.openstack.org/52081622:16
*** rodolof has quit IRC22:16
EmilienMmwhahaha: it's ControllerUpgradeInitDeployment timing out right?22:18
mwhahahain this last case yea22:18
EmilienMok22:18
mwhahahain other times it's been UpdateDeployment22:18
mwhahahaso i'm not sure it's specific to our stuff but somewhere a status or signal seems to be getting lost22:19
EmilienMmwhahaha: I'm looking at UpgradeInitCommand22:19
EmilienMI'm wondering if it's a yum update that takes forever or something22:20
EmilienMbut no22:20
mwhahahano cause in os-collect-config it's done22:20
mwhahahaif you look in the journal22:20
mwhahahaEmilienM: http://logs.openstack.org/77/519577/5/gate/legacy-tripleo-ci-centos-7-scenario002-multinode-oooq-container/965b71e/logs/subnode-2/var/log/journal.txt.gz#_Nov_16_19_44_2422:21
mwhahahalike os-collect-config never runs again22:21
mwhahahano errors or anything22:21
mwhahahathe process itself is still running22:21
*** Goneri has quit IRC22:22
mwhahahabut nothing has changed with os-collect-config in like a year22:22
mwhahahaoh wait so the last thing it ran was UpdateDeployment22:23
mwhahahahttp://logs.openstack.org/77/519577/5/gate/legacy-tripleo-ci-centos-7-scenario002-multinode-oooq-container/965b71e/logs/subnode-2/var/log/journal.txt.gz#_Nov_16_19_44_2322:23
*** ansmith has joined #tripleo22:24
mwhahahawhich was a noop22:24
mwhahahaso that finished22:24
EmilienMit's doing yum update?22:25
mwhahahano22:25
mwhahaha{"deploy_stdout": "Started yum_update.sh on server a6c44bdd-e732-4279-abc9-11bf370050b8 at Thu Nov 16 19:44:23 UTC 2017\nNot running due to unset update_identifier\n", "deploy_stderr": "", "update_managed_packages": "false", "deploy_status_code": 0}22:25
mwhahahait ran and was done22:25
*** abishop has quit IRC22:26
*** florianf has quit IRC22:28
EmilienMtrying to see which other resources didn't finish22:29
EmilienMit's a mess22:30
mwhahahapretty much22:31
EmilienM[overcloud.Controller.0.ControllerUpgradeInitDeployment]: CREAHeat Stack create failed.22:31
EmilienMI like the truncate log22:31
EmilienMCREAHeat ?!?22:31
mwhahahaIO got mixed22:31
mwhahahahttp://logs.openstack.org/77/519577/5/gate/legacy-tripleo-ci-centos-7-scenario002-multinode-oooq-container/965b71e/logs/postci.txt.gz has the resources22:31
mwhahahaControllerUpgradeInitDeployment was in CREATE_IN_PROGRESS22:32
EmilienMyeah it's really ControllerUpgradeInitDeployment22:33
EmilienMwhich got stuck22:33
rlandy|rovercan anyone core workflow +1 https://review.openstack.org/#/c/519770/ - this skip list will unblock promotions - thank you. previous gate failure were checked22:33
mwhahaharlandy|rover: k22:33
EmilienMwhich executes UpgradeInitConfig22:33
EmilienMmwhahaha, rlandy|rover: https://bugs.launchpad.net/tripleo/+bug/1731988 should be tech debt22:34
openstackLaunchpad bug 1731988 in tripleo "TestNetworkBasicOps.test_mtu_sized_frames timing out on pike promotion jobs" [Critical,In progress] - Assigned to Ronelle Landy (rlandy)22:34
EmilienMwe're ignoring tests here...22:34
*** brian83 has quit IRC22:34
EmilienMI'm adding the tag.22:34
*** zshi has joined #tripleo22:34
weshay+122:34
rlandy|roverEmilienM: ok - good to know - we have a real in progress of being reviewed22:35
weshayreviews that will resolve the issue22:35
EmilienMwhat is the patch that actually fix the issue?22:35
EmilienMUpgradeInitCommand is running: rm /etc/resolv.conf.save and then UpgradeInitCommand22:36
EmilienMbut UpgradeInitCommand is '' by default22:36
EmilienMmwhahaha: ^22:36
mwhahaharight so wtf22:36
EmilienMOH WAIT22:37
EmilienMwe override it22:37
EmilienMhttps://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/scripts/tripleo.sh#n85622:37
rlandy|roverEmilienM: the three patch combination here: https://review.openstack.org/#/c/519486/22:37
EmilienMso that's overcloud upgrade, nvermind this link I guess22:37
EmilienMrlandy|rover: good. Once it merges, please revert https://review.openstack.org/#/c/519770/22:38
EmilienMmwhahaha: https://git.openstack.org/cgit/openstack/tripleo-quickstart-extras/tree/roles/overcloud-upgrade/templates/overcloud-repo.yaml.j2#n222:38
rlandy|roverEmilienM: ack - updating bug with the patch info22:38
mwhahahayea but this isn't an upgrade job22:38
mwhahahajust normal scenario00222:38
EmilienMyeah right22:38
EmilienMsoryr22:38
mwhahahaso it should jsut be a noop22:38
EmilienMit should be ''22:39
EmilienMI'm trying to reproduce it now22:39
mwhahahathis is flakey you can't reproduce it22:39
EmilienMmaybe I'm lucky22:39
mwhahahayou're not that lucky :D22:40
mwhahahaEmilienM or slagle: is there a command to show the list of resources and their ordering run our of heat?22:41
mwhahahaie the task graph22:42
EmilienMnot afil22:43
EmilienMafik*22:43
slagleyea, i dunno22:44
slagleyou could order by updated_time or something22:44
mwhahahalarsks wrote something from 3 years ago https://github.com/larsks/dotstack wonder if it still works22:44
* mwhahaha tries22:44
mwhahahaoh damn keystone v222:45
larsksmwhahaha: well, it *was* three years ago :)22:45
EmilienMlol22:45
*** cdearborn has quit IRC22:55
openstackgerritMerged openstack/tripleo-heat-templates master: Add CephAnsiblePlaybookVerbosity parameter to overcloud-ceph-ansible  https://review.openstack.org/51838323:02
*** jmelvin has quit IRC23:04
*** bfournie has quit IRC23:04
*** apetrich has quit IRC23:06
*** leitan has joined #tripleo23:07
*** dsariel has quit IRC23:09
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172432823:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173103223:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173106323:10
*** ooolpbot has quit IRC23:10
openstackLaunchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel)23:10
openstackLaunchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged]23:10
openstackLaunchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged]23:10
*** apetrich has joined #tripleo23:11
*** leitan has quit IRC23:12
*** dsariel has joined #tripleo23:16
*** dmacpher has quit IRC23:19
*** raildo has joined #tripleo23:20
*** rlandy|rover is now known as rlandy|rover|afk23:21
*** thrash is now known as thrash|g0ne23:21
*** itlinux has joined #tripleo23:23
*** raildo has quit IRC23:26
*** raildo has joined #tripleo23:26
*** salmankhan has joined #tripleo23:27
*** salmankhan has quit IRC23:32
*** dsariel has quit IRC23:38
openstackgerritMerged openstack/tripleo-common master: Fail ceph-ansible workflow if there is stale puppet-ceph hieradata  https://review.openstack.org/51147423:44
openstackgerritMerged openstack/tripleo-common master: Add support for CephMgr in the ceph-ansible workflow  https://review.openstack.org/51163923:44
openstackgerritMerged openstack/tripleo-common master: Add workflow for deployment via config-download  https://review.openstack.org/51287623:44
*** shreshtha_ has quit IRC23:50
*** bobh has quit IRC23:52
*** raildo has quit IRC23:58
*** raildo has joined #tripleo23:59
*** raildo has quit IRC23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!