Wednesday, 2017-09-27

*** dspano has quit IRC00:05
*** bfournie has joined #tripleo00:09
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171838700:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171937300:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171952500:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Marios Andreou (marios-b)00:10
openstackLaunchpad bug 1719373 in tripleo "tripleo ocata ceilometer-db-upgrade fails, as gnocchi cant reach swift" [Critical,Triaged] - Assigned to Pradeep Kilambi (pkilambi)00:10
openstackLaunchpad bug 1719525 in tripleo "CI: scenario002 job fails with Zaqar error "404 not found" in undercloud" [Critical,Triaged]00:10
openstackgerritMerged openstack/tripleo-heat-templates stable/newton: [newton only] Cinder services cleanup should happen when mysql is up  https://review.openstack.org/50718800:11
*** bfournie has quit IRC00:12
*** gfidente has joined #tripleo00:25
*** moshele has quit IRC00:27
*** ecerquei has joined #tripleo00:32
*** gkadam has joined #tripleo00:34
*** yamahata has quit IRC00:36
*** gfidente has quit IRC00:37
*** gfidente has joined #tripleo00:37
*** gfidente has quit IRC00:37
*** gfidente has joined #tripleo00:37
*** tongl has joined #tripleo00:49
*** ecerquei has quit IRC00:52
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: Fixes missing keystone authtoken pw for Tacker  https://review.openstack.org/50723800:52
openstackgerritMerged openstack/tripleo-puppet-elements stable/newton: Add remove-machine-id element  https://review.openstack.org/50530500:52
*** ecerquei has joined #tripleo00:54
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Config download support for standalone deployments  https://review.openstack.org/50582701:02
openstackgerritJames Slagle proposed openstack/python-tripleoclient master: Config download support for standalone deployments  https://review.openstack.org/50582801:02
*** pkovar has quit IRC01:05
*** dmarlin has joined #tripleo01:06
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171838701:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171937301:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171952501:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Marios Andreou (marios-b)01:10
openstackLaunchpad bug 1719373 in tripleo "tripleo ocata ceilometer-db-upgrade fails, as gnocchi cant reach swift" [Critical,Triaged] - Assigned to Pradeep Kilambi (pkilambi)01:10
openstackLaunchpad bug 1719525 in tripleo "CI: scenario002 job fails with Zaqar error "404 not found" in undercloud" [Critical,Triaged]01:10
*** stendulker has joined #tripleo01:12
*** brian83 has quit IRC01:32
*** myoung has joined #tripleo01:49
*** myoung has quit IRC01:49
*** morazi has joined #tripleo02:04
*** leitan has joined #tripleo02:06
*** colonwq has quit IRC02:06
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171838702:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171937302:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171952502:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Marios Andreou (marios-b)02:10
openstackLaunchpad bug 1719373 in tripleo "tripleo ocata ceilometer-db-upgrade fails, as gnocchi cant reach swift" [Critical,Triaged] - Assigned to Pradeep Kilambi (pkilambi)02:10
openstackLaunchpad bug 1719525 in tripleo "CI: scenario002 job fails with Zaqar error "404 not found" in undercloud" [Critical,Triaged]02:10
*** stendulker has quit IRC02:15
*** thrash is now known as thrash|g0ne02:26
*** gbarros has quit IRC02:28
openstackgerritMerged openstack/tripleo-quickstart-extras master: validate-simple: Fix template conditional  https://review.openstack.org/47694103:04
openstackgerritSteve Baker proposed openstack/tripleo-ui master: Container prepare in plan create/update workflows  https://review.openstack.org/50772003:06
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171838703:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171937303:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171952503:10
*** ooolpbot has quit IRC03:10
openstackLaunchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Marios Andreou (marios-b)03:10
openstackLaunchpad bug 1719373 in tripleo "tripleo ocata ceilometer-db-upgrade fails, as gnocchi cant reach swift" [Critical,Triaged] - Assigned to Pradeep Kilambi (pkilambi)03:10
openstackLaunchpad bug 1719525 in tripleo "CI: scenario002 job fails with Zaqar error "404 not found" in undercloud" [Critical,Triaged]03:10
*** itlinux has joined #tripleo03:12
*** dtrainor has quit IRC03:20
*** japestinho has joined #tripleo03:26
*** aditya_r has joined #tripleo03:29
itlinuxhello all.. I see the default for gnocchi is swift.. is there a way to have this changed to a file.. and how will I need to configured it  in a HA mode? Thanks03:31
*** achadha has joined #tripleo03:31
*** shreshtha_ has quit IRC03:39
*** stendulker has joined #tripleo03:39
*** shreshtha has joined #tripleo03:39
*** ecerquei has quit IRC03:39
*** itlinux has quit IRC03:41
*** owalsh_ has joined #tripleo03:52
*** dbecker has quit IRC03:53
*** owalsh has quit IRC03:56
*** ratailor has joined #tripleo04:08
*** dbecker has joined #tripleo04:08
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171838704:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171937304:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171952504:10
*** ooolpbot has quit IRC04:10
openstackLaunchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Marios Andreou (marios-b)04:10
openstackLaunchpad bug 1719373 in tripleo "tripleo ocata ceilometer-db-upgrade fails, as gnocchi cant reach swift" [Critical,Triaged] - Assigned to Pradeep Kilambi (pkilambi)04:10
openstackLaunchpad bug 1719525 in tripleo "CI: scenario002 job fails with Zaqar error "404 not found" in undercloud" [Critical,Triaged]04:10
*** ykarel|away has joined #tripleo04:17
*** jaosorior has joined #tripleo04:19
*** stendulker_ has joined #tripleo04:22
*** mhenkel_ has joined #tripleo04:23
*** rickflare2 has joined #tripleo04:23
*** ykarel|away is now known as ykarel|training04:23
*** chem` has joined #tripleo04:23
*** vkhanna1 has joined #tripleo04:24
*** social_ has joined #tripleo04:24
*** matbu_ has joined #tripleo04:25
*** axisys_ has joined #tripleo04:25
*** SlickNik- has joined #tripleo04:25
*** michapma_ has joined #tripleo04:25
*** migi_ has joined #tripleo04:26
*** bugzy_ has joined #tripleo04:26
*** mdnadeem has joined #tripleo04:26
*** stendulker has quit IRC04:29
*** bugzy has quit IRC04:29
*** chem has quit IRC04:29
*** social has quit IRC04:29
*** axisys has quit IRC04:29
*** yolanda has quit IRC04:29
*** jrist has quit IRC04:29
*** leifmadsen has quit IRC04:29
*** vkhanna has quit IRC04:29
*** rickflare has quit IRC04:29
*** flaper87 has quit IRC04:29
*** mhenkel has quit IRC04:29
*** lhinds has quit IRC04:29
*** leseb has quit IRC04:29
*** migi has quit IRC04:29
*** matbu has quit IRC04:29
*** honza has quit IRC04:29
*** dmsimard has quit IRC04:29
*** michapma has quit IRC04:29
*** safchain has quit IRC04:29
*** SlickNik has quit IRC04:29
*** SlickNik- is now known as SlickNik04:29
*** honza has joined #tripleo04:29
*** safchain has joined #tripleo04:30
*** leseb has joined #tripleo04:30
*** honza is now known as Guest8588804:30
*** lhinds has joined #tripleo04:30
*** leifmadsen has joined #tripleo04:32
*** radez has quit IRC04:33
*** vkhanna1 has quit IRC04:34
*** slagle has quit IRC04:34
*** ansiwen has quit IRC04:34
*** trown|outtypewww has quit IRC04:34
*** trown has joined #tripleo04:35
*** achadha_ has joined #tripleo04:35
*** jrist has joined #tripleo04:36
*** jrist has joined #tripleo04:36
*** udesale has joined #tripleo04:36
*** yolanda has joined #tripleo04:37
*** flaper87 has joined #tripleo04:37
*** dmsimard has joined #tripleo04:37
*** achadha has quit IRC04:38
*** dpawar has joined #tripleo04:39
*** radez has joined #tripleo04:39
*** slagle has joined #tripleo04:41
*** dpawar has quit IRC04:44
*** dpawar has joined #tripleo04:45
*** vkhanna1 has joined #tripleo04:47
*** psachin has joined #tripleo04:48
*** ansiwen has joined #tripleo04:48
*** jfrancoa has joined #tripleo05:04
*** shreshtha_ has joined #tripleo05:04
*** pdeore has joined #tripleo05:04
*** shreshtha_ has quit IRC05:05
*** shreshtha_ has joined #tripleo05:06
*** shreshtha has quit IRC05:06
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171838705:10
openstackLaunchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Marios Andreou (marios-b)05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171937305:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171952505:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1719373 in tripleo "tripleo ocata ceilometer-db-upgrade fails, as gnocchi cant reach swift" [Critical,Triaged] - Assigned to Pradeep Kilambi (pkilambi)05:10
openstackLaunchpad bug 1719525 in tripleo "CI: scenario002 job fails with Zaqar error "404 not found" in undercloud" [Critical,Triaged]05:10
*** janki has joined #tripleo05:11
*** leitan has quit IRC05:11
*** marios has joined #tripleo05:12
*** iranzo has joined #tripleo05:13
*** iranzo has joined #tripleo05:13
*** rlandy has quit IRC05:14
*** aditya_r has quit IRC05:22
*** aditya_r has joined #tripleo05:23
*** agurenko has joined #tripleo05:28
*** aufi has joined #tripleo05:29
*** aditya_ra has joined #tripleo05:32
*** aditya_r has quit IRC05:36
*** waleedm has joined #tripleo05:39
*** psahoo has joined #tripleo05:40
*** tzumainn has quit IRC05:42
*** iranzo has quit IRC05:44
*** iranzo has joined #tripleo05:47
*** iranzo has joined #tripleo05:47
*** achadha_ has quit IRC05:48
*** eck` is now known as eck`gone05:49
*** dalvarez has quit IRC05:49
*** eck`gone has quit IRC05:49
*** markmc has quit IRC05:50
*** radez has quit IRC05:52
*** jpena|off has quit IRC05:52
*** amoralej has quit IRC05:53
*** shreshtha_ has quit IRC05:54
*** hewbrocca_afk has quit IRC05:54
*** aditya_ra has quit IRC05:54
*** aditya_r has joined #tripleo05:54
*** radeks has joined #tripleo05:57
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/47260706:00
openstackgerritFlavio Percoco proposed openstack/tripleo-quickstart master: Add featureset33 for scenario009  https://review.openstack.org/49441806:02
*** mcornea has joined #tripleo06:04
*** shreshtha has joined #tripleo06:07
*** shreshtha has joined #tripleo06:08
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171838706:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171937306:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171952506:10
*** ooolpbot has quit IRC06:10
openstackLaunchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Marios Andreou (marios-b)06:10
openstackLaunchpad bug 1719373 in tripleo "tripleo ocata ceilometer-db-upgrade fails, as gnocchi cant reach swift" [Critical,Triaged] - Assigned to Pradeep Kilambi (pkilambi)06:10
openstackLaunchpad bug 1719525 in tripleo "CI: scenario002 job fails with Zaqar error "404 not found" in undercloud" [Critical,Triaged]06:10
*** eck`gone has joined #tripleo06:15
*** pgadiya has joined #tripleo06:16
*** jtomasek has quit IRC06:18
*** radeks has quit IRC06:21
openstackgerritMichael  Henkel proposed openstack/os-net-config master: Added driver option for Contrail DPDK  https://review.openstack.org/50722806:29
*** dalvarez has joined #tripleo06:30
openstackgerrityatin proposed openstack/tripleo-quickstart-extras master: Use latest RAW image for OVB Deployment on rdocloud  https://review.openstack.org/50775106:32
*** dpawar has quit IRC06:34
*** jprovazn has joined #tripleo06:34
*** markmc has joined #tripleo06:35
*** moshele has joined #tripleo06:36
*** hewbrocca_afk has joined #tripleo06:36
*** moshele has quit IRC06:38
Tenguhello! is there a way to get a hand on sshd configuration file with tripleO ? I'd like to forbid password access, allowing only keys.06:39
*** rcernin has joined #tripleo06:39
*** snecklifter has joined #tripleo06:40
*** hjensas has joined #tripleo06:40
*** hjensas has quit IRC06:40
*** hjensas has joined #tripleo06:40
Tenguah. maybe through tripleo/manifests/profile/base/sshd.pp06:41
*** hjensas has quit IRC06:41
jaosoriorTengu: you would need to use the parameters as exposed here https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/sshd.yaml06:42
openstackgerritMerged openstack/puppet-pacemaker master: Fix resource defaults class  https://review.openstack.org/50658406:43
Tengujaosorior: yup, just found it. but apparently… the configuration should already drop password accesses. weird. Maybe something to do with freeipa in the loop.06:45
Tengujaosorior: ah, speaking of that… I had some issues with the novajoin-server. apparently it's not that happy to get queries for more than 3-4 hosts.06:46
Tengujaosorior: I opened an issue on launchpad a few weeks ago, don't know if you already had time to check it? https://bugs.launchpad.net/tripleo/+bug/171589306:47
openstackLaunchpad bug 1715893 in tripleo "novajoin-server Timeout" [Medium,Triaged]06:47
jaosoriorTengu: is it  novajoin-server issue or is a nova-metadata isue?06:47
TenguI think it's novajoin-server, seeing the port in the log06:47
jaosoriorok06:47
jaosoriormight be that06:48
Tenguthe timeout is reported by nova-compute.log though06:48
jaosoriorI'll check it out06:48
Tengui.e. nova-<somth> does some request on novajoin-server, and crash. That prevented a full deploy with native freeipa support :(. Had to disable it, and launch a second ansible with manual record of the nodes (running ipa-install-client on each node)06:49
Tengujaosorior: thanks :)06:49
jaosoriorthat's a bummer06:50
Tenguhmm ?06:50
*** chem` has quit IRC06:50
jaosoriorwas there anything in the novajoin-server logs?06:51
Tengunope, not that I can recall. lemme check if I still have them at hand.06:51
jaosoriorok06:51
*** dpawar has joined #tripleo06:51
Tenguduh… no log-rotate apparently…06:51
Tengumeaning I should get them.06:52
*** achadha has joined #tripleo06:52
*** achadha has quit IRC06:52
Tengujaosorior: nothing else than 200 in the novajoin-server logs06:53
jaosoriorok06:53
jaosoriorfunky06:53
Tengumany POSTS, each one of them returning a 20006:53
Tenguyup06:53
TenguI remember having that same "conclusion".06:54
Tengujaosorior: maybe the "time" might be of some use?06:54
Tenguas we get that info with each request.06:54
*** pgadiya has quit IRC06:55
jaosoriorTengu: how many workers do you have configured for novajoin?06:58
Tengujaosorior: I let the default number… might be that?06:58
jaosoriorTengu: can you try bringing that number up?06:59
Tengujaosorior: where should I set that?06:59
Tenguunable to grep "worker" in join.coinf - maybe it's somewhere else?06:59
jaosoriorlet me check07:00
*** ebarrera has joined #tripleo07:00
jaosoriorTengu: I think it would be join_workers07:00
Tengujaosorior: also, we won't re-deploy the overcloud07:01
Tengujaosorior: where then? which config file?07:01
jaosoriorjoin.conf07:01
Tenguah, so an undocumented/absent configuration then?07:01
*** iranzo has quit IRC07:01
jaosoriorwhich is a bummer07:01
Tengu:)07:01
Tenguin what section shall I add it?07:02
Tenguprobably DEFAULT ?07:02
jaosorioryep07:02
jaosoriorDEFAULT07:02
Tenguany way to know the default amount?07:02
*** iranzo has joined #tripleo07:03
*** iranzo has joined #tripleo07:03
Tenguin order to ensure I set it to a higher number - also, how to configure that while deploying the undercloud?07:03
jaosoriorlet me verify that07:03
Tenguthank you :)07:03
jaosoriorTengu: dammit. Not currently possible to set that up.07:04
Tengu07:04
jaosoriorTengu: I basically browsed through the code and checked that that configuration parameter exists.07:04
jaosoriorTengu: and we use it to spawn the wsgi process07:05
Tenguok07:05
jaosoriorbut it seems we don't document or set it anywhere07:05
Tengu:/07:05
jaosoriorcurrently  I don't have an environment, but if I can manage to poke someone that has one, and can set that up07:05
*** florianf has joined #tripleo07:05
Tenguwhere are the sources?07:05
jaosoriorI'll then submit some patches to enable that07:05
TenguI might have a look as well.07:05
jaosoriorit's closed source07:05
jaosoriornah, just kidding07:05
Tengu:]07:05
jaosoriorhttps://github.com/openstack/novajoin07:06
jaosoriorand here07:06
jaosoriorhttps://github.com/openstack/novajoin/blob/master/novajoin/wsgi.py#L4807:06
Tenguah, so noivajoin on openstack gerrit I guess?07:06
jaosorioryep07:06
jaosoriorI just usually pass the github mirror cause it's easier to search for07:06
Tenguindeed.07:06
*** fzdarsky has joined #tripleo07:06
*** jlinkes has joined #tripleo07:07
*** agurenko has quit IRC07:07
Tengujaosorior: so it's a matter of: documenting the setting name/capability, and adding a way to set that in the undercloud deploy process, right?07:09
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171838707:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171937307:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171952507:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Marios Andreou (marios-b)07:10
openstackLaunchpad bug 1719373 in tripleo "tripleo ocata ceilometer-db-upgrade fails, as gnocchi cant reach swift" [Critical,Triaged] - Assigned to Pradeep Kilambi (pkilambi)07:10
openstackLaunchpad bug 1719525 in tripleo "CI: scenario002 job fails with Zaqar error "404 not found" in undercloud" [Critical,Triaged]07:10
*** anshulbehl has joined #tripleo07:12
*** tongl has quit IRC07:12
*** agurenko has joined #tripleo07:13
*** dparkes has quit IRC07:14
*** Dinesh_Bhor has quit IRC07:17
openstackgerritMerged openstack/tripleo-heat-templates master: Default Ceph pg_num and pgp_num to 128  https://review.openstack.org/50633007:18
*** tdasilva has quit IRC07:18
Tenguhumpf. apparently, something is preventing haproxy configuration to be updated with the "admin" socket access level…07:18
Tenguweird. I set the option in hiera. should work as expected -.-07:19
*** snecklifter has quit IRC07:19
openstackgerritMerged openstack/diskimage-builder master: Actually sort mount-point list  https://review.openstack.org/50481907:20
*** Dinesh_Bhor has joined #tripleo07:21
*** tesseract has joined #tripleo07:21
*** dparkes has joined #tripleo07:25
*** jpich has joined #tripleo07:29
*** ffiore has joined #tripleo07:29
openstackgerritMichele Baldessari proposed openstack/puppet-pacemaker master: Generate fence_ironic automatically  https://review.openstack.org/50723607:29
*** jaosorior has quit IRC07:31
openstackgerritHarald Jensås proposed openstack/tripleo-heat-templates master: Add subnet property to ctlplane network for server resources  https://review.openstack.org/47381707:32
*** oidgar has joined #tripleo07:33
*** hjensas has joined #tripleo07:33
*** hjensas has quit IRC07:33
*** hjensas has joined #tripleo07:33
*** shardy has joined #tripleo07:35
*** aditya_r has quit IRC07:37
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates master: docker: add logging(source & groups)  https://review.openstack.org/49952907:37
*** aditya_r has joined #tripleo07:37
*** moshele has joined #tripleo07:37
*** suuuper has joined #tripleo07:37
*** threestrands has quit IRC07:38
*** zshi has quit IRC07:39
*** zshi has joined #tripleo07:42
*** tdasilva has joined #tripleo07:42
*** mrch has joined #tripleo07:42
*** snecklifter has joined #tripleo07:42
*** chem has joined #tripleo07:44
*** ffiore has quit IRC07:45
*** ffiore has joined #tripleo07:45
*** amoralej has joined #tripleo07:46
*** snecklifter has quit IRC07:46
*** jaosorior has joined #tripleo07:47
*** jpena has joined #tripleo07:47
*** dsariel has joined #tripleo07:47
*** achadha has joined #tripleo07:47
openstackgerritArx Cruz proposed openstack/tripleo-quickstart master: Add compute-feature-enabled.attach_encrypted_volume to True  https://review.openstack.org/49992807:49
openstackgerritMartin André proposed openstack/tripleo-heat-templates master: Fix stackrc for containerized undercloud  https://review.openstack.org/50777507:51
*** achadha has quit IRC07:52
*** ykarel|training is now known as ykarel07:53
*** jaganathan has joined #tripleo07:57
*** ccamacho has joined #tripleo07:57
*** radeks has joined #tripleo07:58
mandrerdopiera: good morning! did you have a chance to try the latest fix in https://review.openstack.org/#/c/507408/? CI reports the horizon container is up and healthy but I doubt we exercise it...07:59
*** yamahata has joined #tripleo08:02
mandrejaosorior: around for two super quick reviews? https://review.openstack.org/#/c/506573/ and https://review.openstack.org/#/c/507572/08:03
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates stable/pike: Default Ceph pg_num and pgp_num to 128  https://review.openstack.org/50777708:03
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates stable/ocata: Default Ceph pg_num and pgp_num to 128  https://review.openstack.org/50777808:04
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates stable/newton: Default Ceph pg_num and pgp_num to 128  https://review.openstack.org/50777908:06
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: WIP DNR Add instance ha param  https://review.openstack.org/50635008:08
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: WIP DNR Instance HA POC  https://review.openstack.org/50692208:08
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates stable/ocata: Default Ceph pg_num and pgp_num to 128  https://review.openstack.org/50777808:08
*** dparkes has quit IRC08:08
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171838708:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171937308:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171952508:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Marios Andreou (marios-b)08:10
openstackLaunchpad bug 1719373 in tripleo "tripleo ocata ceilometer-db-upgrade fails, as gnocchi cant reach swift" [Critical,Triaged] - Assigned to Pradeep Kilambi (pkilambi)08:10
openstackLaunchpad bug 1719525 in tripleo "CI: scenario002 job fails with Zaqar error "404 not found" in undercloud" [Critical,Triaged]08:10
*** egonzalez has joined #tripleo08:12
*** hjensas has quit IRC08:12
*** hjensas has joined #tripleo08:21
*** athomas has quit IRC08:23
mandrejistr: should we swap the order of https://review.openstack.org/#/c/502545/ and https://review.openstack.org/#/c/500552/? I think we'll need the param swap from https://review.openstack.org/#/c/500546/08:23
*** owalsh_ is now known as owalsh08:24
*** dpawar has quit IRC08:24
*** brault has quit IRC08:24
*** athomas has joined #tripleo08:27
*** yamahata has quit IRC08:29
*** bogdando has joined #tripleo08:29
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: WIP DNR Add instance ha param  https://review.openstack.org/50635008:29
jistrmandre: i thought if we make the scenario004 complete w/ pacemaker, it won't matter that we don't have the param swap yet...08:30
* jistr looking why the job failed08:30
*** ffiore has quit IRC08:32
*** ffiore has joined #tripleo08:33
*** aditya_ra has joined #tripleo08:36
rdopieramandre: I didn't, I stumbled upon some bug in tripleo-quickstart again08:38
Tenguhello! apparently there's some subtility I didn't get when I modified tripleo::haproxy puppet class in order to add a new parameter. Setting the parameter through hiera doesn't seem to work as expected, at least not when I want to update the overcloud stack. Care to provide some advice on how to do that?08:38
Tengu(note: the modification has been successfully merged in stable/pike)08:39
*** aditya_r has quit IRC08:39
mandrejistr: if you look at the deploy command at http://logs.openstack.org/45/502545/6/check/gate-tripleo-ci-centos-7-scenario004-multinode-oooq-container/ac69fed/logs/undercloud/home/jenkins/overcloud-deploy.sh you'll see we restore the non pacemaker services by loading docker.yaml after the scenario file08:41
shardyTengu: Hi, can you pls link the change, how you're updating the hieradata and what isn't working as expected?08:41
Tengushardy: yup, 1s, gathering links08:41
jistrmandre: yea i'm just looking now, it's container_args, not pacemaker_args, which breaks it08:42
mandrejistr: yep, scenario args should come after container args if we want it to work08:42
jistrmandre: ack, we need the scenario004 first, then the param switch (hoping it won't break anything :) ) and then the removal of enable_pacemaker from featuresets08:43
shardyTengu: thanks, also the output of sudo hiera -c /etc/puppet/hiera.yaml tripleo::haproxy::$foo on one of the controller nodes08:43
Tengushardy: the change: https://review.openstack.org/#/c/504159/ - regarding configuration: I've passed a custom hiera configuration file to the undercloud, using undercloud 'hieradata_override' configuration key. The expected change is: the haproxy socket level should be "admin", not "user.08:44
Tengushardy: ah, "nil" for the hiera call. hmm. How should the hieradata be updated on the overcloud nodes then ?08:45
jistrmandre: problem is the switch will break the upgrade...08:45
shardyTengu: ah, hieradata_override only influences the puppet apply on the undercloud, not the overcloud nodes08:45
Tenguduh08:45
Tengu08:45
shardyTengu: for overcloud nodes there's a ControllerExtraConfig parameter, sec let me find the docs link08:45
* jistr double checks08:46
Tenguahh, I think I know about it already.08:46
Tenguthat names tickles some memories.08:46
shardyhttps://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/node_config.html08:46
shardyTengu: Ok, so you need a -e extraconfig_env.yaml08:46
Tengushardy: ok, I should be able to add the class param key in my default_params.08:47
shardywith08:47
shardyparameter_defaults:08:47
*** derekh has joined #tripleo08:47
shardy  ControllerExtraConfig: <hiera key to override>08:47
shardyTengu: yup that's right08:47
Tengui.e. ControllerExtraConfig: \n tripleo::haproxy::foo: admin08:47
shardyTengu: yes, sorry I missed the \n08:48
TenguOK, now I understand better the usage of that hieradata_override08:48
Tenguthanks!08:48
shardyTengu: there's an override per role, and an "all nodes" ExtraConfig parameter08:48
jistrmandre: hm maybe not if we remove this first - it's needed in Ocata but not in Pike or master. https://github.com/openstack/tripleo-heat-templates/blob/master/ci/environments/multinode-containers.yaml#L1508:48
shardyit takes precedence over any heat parameters that may be passed (we merge the hieradata maps basically08:49
*** chlong has quit IRC08:49
Tengushardy: ah, good to know :).08:49
jistrmandre: this is starting to get funny :D08:49
jistrmandre: i'll try to remove the Docker -> None mapping from all scenarios first then. I'll bake it together with the sc004 patch.08:49
mandrejistr: remove the Docker -> None mapping and roll dice :)08:50
jistror maybe on top of it, since sc004 is green in CI08:50
jistryea :)08:50
Tengushardy: after that, I just run a stack update, and Voilà, right?08:50
shardyTengu: yes :)08:51
mandrejistr: so in https://review.openstack.org/#/c/500546/ (which should be standalone) the upgrade job was red due to it unable to find the docker images, is that what you were looking at?08:52
shardywe'll run a puppet apply for all steps, including the updated hieradata08:52
Tengu\o/08:52
Tenguso, now, coffee.08:52
Tenguand aftet that I shall get an admin access on the socket, allowing me to go further with certodia - it needs to deactivate n-1 backends in haproxy - doing so via the socket is the most convenient way.08:53
jistrmandre: yea, but i'm not looking at the images fail (we may have to solve that too if that's broken still). But even if it did find the images, it would fail to upgrade, because if scenario args take priority over container args, they'd always map the Docker service to OS::Heat::None.08:53
mandrejistr: note the extra_args trick in https://review.openstack.org/#/c/500546/ to workaround the docker service mapping to None08:56
*** etingof has quit IRC08:57
*** udesale has quit IRC08:57
*** udesale has joined #tripleo08:57
*** jtomasek has joined #tripleo09:01
Tengushardy: hmm, is it still "NovaComputeExtraConfig", or is it ComputeExtraConfig?09:01
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Ceilometer]  https://review.openstack.org/50779609:02
shardyTengu: good point, the docs need updating - both will work but NovaComputeExtraConfig is now deprecated09:02
Tengu;)09:02
* Tengu has The Eye09:02
shardyTengu: thanks for spotting it - are you pushing a docs patch or shall I?09:03
jistrmandre: hm though if we include it on upgrade too, as it is now, it means all the docker services are already deployed before we start to upgrade, and we don't have a cont.->cont. upgrade procedure done yet09:03
Tengushardy: you may - I'm under water with work atm09:03
shardyTengu: ack, thanks09:03
Tenguthank you for the update :)09:03
oidgarhi, I was used to use docker-centos-tripleoupstream.yaml environment file and now I see that in the current master branch it is not available anymore. anyone knows how should I deploy containerized environment now?09:04
jistrmandre: so we'll either need to edit that patch still, or we can just try to fix the scenarios right now and try to remove the trick09:05
jistrmandre: IIUC, the only negative effect of fixing the scenarios should just be that the docker service is deployed before upgrading, which shouldn't break the upgrade09:06
mandrejistr: hmm ok... but even, I'm thinking the trick is not working because docker is enabled but not configured on upgrade09:06
shardyoidgar: https://review.openstack.org/#/c/487613/ shows the new command in the commit message09:07
shardyoidgar: there's an openstack overcloud container image prepare command which generates the environment now09:07
jistrmandre: what do you mean by configured?09:07
oidgarshardy: also for dockerhub registry?09:07
shardyhttps://review.openstack.org/#/c/475958/ is the docs patch09:08
oidgarshardy: no matter, understood now, thanks :)09:08
mandrejistr: looks like the puppet profile wasn't run, it doesn't have the insecure registry set... that's why it failed to pull the images09:08
jistrah09:08
jistrmandre: scenario args overriding it here again https://review.openstack.org/#/c/500546/12/roles/overcloud-upgrade/templates/major-upgrade-overcloud-containers.sh.j209:09
*** akrivoka has joined #tripleo09:09
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171838709:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171952509:10
*** ooolpbot has quit IRC09:10
openstackLaunchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Marios Andreou (marios-b)09:10
openstackLaunchpad bug 1719525 in tripleo "CI: scenario002 job fails with Zaqar error "404 not found" in undercloud" [Critical,Triaged]09:10
jistrmandre: i'm tempted to try fixing the scenarios right away then... If we can merge such a patch without breaking the jobs, then it will make things easier when switching the arguments order.09:11
*** etingof has joined #tripleo09:11
mandrejistr: jeez this is endless... alright for baby steps09:12
jistrmandre: LOL yes09:13
ratailorhrybacki, you around ?09:16
*** etingof has quit IRC09:19
openstackgerritSteven Hardy proposed openstack/tripleo-docs master: Update deprecated NovaCompute parameter names  https://review.openstack.org/50780009:19
*** radeks has quit IRC09:19
*** radeks has joined #tripleo09:20
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: Implement minor update workflow with config download  https://review.openstack.org/48748809:21
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Add all services to container scenarios  https://review.openstack.org/50187209:22
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Add all services to multinode-containers.yaml  https://review.openstack.org/50747109:22
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Switch scenario004-containers to use ceph-ansible  https://review.openstack.org/50752609:22
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Stop mapping docker to OS::Heat::None in scenarios  https://review.openstack.org/50780109:22
*** Guest85888 is now known as honza09:22
*** salmankhan has joined #tripleo09:23
*** tosky has joined #tripleo09:25
*** numans has quit IRC09:25
*** dpawar has joined #tripleo09:26
*** dpawar has quit IRC09:27
*** numans has joined #tripleo09:28
owalshmarios: hey, so for https://review.openstack.org/506594...09:28
mariosowalsh: o/09:29
owalshmarios: eval should be killed with fire IMO, it's just happens to work when the quoting in the command line is also wrong09:29
mariosowalsh: hah but sounds like there are some cases we still need it (or at least until we can change those invocations?)09:29
mariosowalsh: hence your latest revision with the two functions09:30
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Ceilometer]  https://review.openstack.org/50779609:30
*** radeks has quit IRC09:30
owalshmarios: yea, once it lands I'll follow up with a t-h-t patch to use exec everywhere on master/pike09:30
*** fzdarsky has quit IRC09:30
openstackgerritMichael  Henkel proposed openstack/os-net-config master: Added driver option for Contrail DPDK  https://review.openstack.org/50722809:30
owalshmarios: then remove the deprecated command from master, probably the eval command too09:30
owalshmarios: still think this needs a reno, comment etc..? I doubt it's of interest to end users09:31
*** etingof has joined #tripleo09:32
*** shreshtha has quit IRC09:32
*** radeks has joined #tripleo09:32
*** brault has joined #tripleo09:33
*** gkadam has quit IRC09:35
*** shreshtha has joined #tripleo09:35
mariosowalsh: ok fair enough. yeah it isn't a 'proper' interface I guess, we are exclusively using/invoking in the tripleo-heat-templates (I think?) so no strong push on the release note then, especially since it will be highlighted further (that you are going to eventually remove that function alltogether) in the subesquent changes to tripleo-heat-templates09:35
*** jtomasek has quit IRC09:38
owalshmarios: ok, maybe I'm just being a bit lazy with this one.... it has annoyed me a lot already with a circular dependency on the distgit... just want to see the back of it so I can land the patch that needs it :-)09:39
mariosowalsh: ack :) revoted thanks for looking/pinging09:39
owalshthanks :-)09:39
dciabrinjaosorior, ping09:40
*** jaganathan has quit IRC09:41
sri_shardy: quick question I have a couple of custom roles in my environment like CephOSD, CephMON, Galera for this custom roles if I want to enable network isolation I need to create network configuration files for this roles  in /templates/network/config ??09:42
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Heat]  https://review.openstack.org/49139909:45
jistrmandre: i'll also do a deeper review of the quickstart-extras patch and update it09:45
*** radeks has quit IRC09:48
*** afazekas is now known as afazekas|seek4fo09:48
shardysri_: yes you'll need to copy the example network/config/ template and create one for the custom role09:49
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Neutron]  https://review.openstack.org/48995709:49
shardysri_: we don't yet generate those via jinja2, but it's something we may do in the future09:49
mandrejistr: ack, I've just replied to the oooq-extra review09:49
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Aodh]  https://review.openstack.org/49141109:51
*** dpawar has joined #tripleo09:51
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Gnocchi]  https://review.openstack.org/49143309:53
sri_shardy: understood, for ceph-storage we required have 3 incs , for cinder we need 4 nics , but if i create custom roles do i need to plan those nics according to my setup ? exp I have Galera custom role for this role i think two nics  is enough !!09:55
*** nyechiel has joined #tripleo09:56
*** radeks has joined #tripleo09:58
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: Implement minor update workflow with config download  https://review.openstack.org/48748809:58
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Mistral]  https://review.openstack.org/49347109:59
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Mixed-1]  https://review.openstack.org/49519510:00
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Nova]  https://review.openstack.org/49910810:02
shardysri_: yes, you'll just update your copied network/config/*.yaml to suit the nic configuration you need, there is a config specified for each role10:03
shardysri_: and you'll need to add a reference to it in your network-environment.yaml (or another environment file)10:03
*** d0ugal has joined #tripleo10:03
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/environments/network-environment.yaml#L510:04
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Ironic]  https://review.openstack.org/50203710:04
shardysri_: e.g copy those mappings into an environment file you maintain, change the paths to wherever you copy the files, and add your custom roles10:04
sri_shardy: got it , thanks10:05
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Octavia]  https://review.openstack.org/50203810:08
*** ebarrera has quit IRC10:08
*** ebarrera has joined #tripleo10:09
matbu_hi all, quick question about CI and unit tests, if a review in cli needs a ooo_common change, is the depends_on statement will make the unit tests passed ?10:09
matbu_looks like tox ignore the depends-on10:10
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171838710:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171952510:10
*** ooolpbot has quit IRC10:10
openstackLaunchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Marios Andreou (marios-b)10:10
openstackLaunchpad bug 1719525 in tripleo "CI: scenario002 job fails with Zaqar error "404 not found" in undercloud" [Critical,Triaged]10:10
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Sahara]  https://review.openstack.org/50203910:11
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Manila]  https://review.openstack.org/50204010:12
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: Implement minor update workflow with config download  https://review.openstack.org/48748810:12
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Ovn]  https://review.openstack.org/50204110:14
mariosshardy: o/ hi can you please check this one when you next get some review time https://review.openstack.org/#/c/507524/10:16
mariosshardy: its for the thing we discussed on friday evening10:16
shardymarios: hey, sure looking10:17
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Swift]  https://review.openstack.org/50204210:17
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Mixed-2]  https://review.openstack.org/50558610:18
shardymarios: Hmm, won't we want the host_prep_tasks exposed so the operator driven upgrade runs them?10:19
shardyvs setting them to [] ?10:19
mariosshardy: so we are only settin ghem here in the playbook10:19
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Mixed-3]  https://review.openstack.org/50558710:20
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Mixed-3]  https://review.openstack.org/50558710:20
shardymarios: sorry I'm probably missing something, when will host_prep_tasks get run on upgrade, e.g for compute nodes?10:21
shardyat first glance it seems like they won't ever get run but do we invoke them already from the operator drive upgrade script?10:21
shardythose tasks do some things that are required for the upgrade to containers to work I think10:22
mariosshardy: yeah so they are going to get written to the outputs still here right? https://review.openstack.org/#/c/507524/3/common/deploy-steps.j2@337 (I hope :) )10:22
shardymarios: aha!10:22
mariosshardy: and then during the non-controller upgrade, we do the upgrade_tasks then the deploy_steps and those deploy_steps_playbook first does the host_prep_tasks10:23
shardymarios: thanks, I just forgot about that10:23
mariosshardy: heh, man, you wrote it10:23
mariosshardy: !10:23
* shardy needs more coffee :)10:23
mariosshardy: so in the block i changed, the rest of the host prep *does* happen10:23
mariosshardy: just specifically any service host_prep_tasks, like stopping libvirtd in this case, doesn't10:23
shardymarios: ack, thanks for clarifying, added a comment and +210:24
mariosshardy: right so wrt invocation we are then doing that https://github.com/openstack/tripleo-common/blob/b46a35a40e69ae639d2bff680eeb2c5e01898054/scripts/upgrade-non-controller.sh#L139-L14710:24
shardymarios: cool, thanks10:25
mariosshardy: thanks for your time shardy .. another one to add to your list whenever you get time please (not much detail yet, but tried to capture the direction for the move to all ansible upgrade for Q: https://review.openstack.org/507620 (i point to things like that ^^^ in the spec, hence the relevance )10:25
shardymarios: FYI I started looking at how we could also write the json files via the deploy_steps playbook, but ran into some issues with jsonquery reading the roles_data from the dynamic inventory10:25
shardythat may be worth revisiting at some point so we can consolidate on one playbook with the entire deploy workflow, including writing of json files etc10:26
mariosshardy: ack so we could remove that ansible invocation alltogether? well that would also line up with use moving the all the ansible things out of the tht10:27
*** yamahata has joined #tripleo10:27
shardymarios: Yeah, that's what I was thinking - I know slagle was also looking at it so we can sync up about it later10:27
mariosshardy: 'that ansible invocation' i mean on the review we were talking about the host_prep stuff https://review.openstack.org/#/c/507524/3/common/deploy-steps.j2@21010:27
mariosshardy: right10:28
shardymarios: thanks for the spec link, will review10:28
mariosshardy: thank you10:28
shardyI'm also interested in trying an "openstack overcloud config generate" command10:29
mariosshardy: right... to do that initial stack update?10:29
shardyit could use the same heat-all model (run heat in a container) and just do a transient transformation from heat->ansible10:29
*** salmankhan has quit IRC10:29
shardymarios: yeah possibly, although right now we kinda need the state persisted in the heat DB10:30
mariosshardy: 'dispasable' heat you mean? someone mentioned something along these lines at the ptg, possibly dprince or slagle10:30
paramitemandre, jaosorior: hey guys, can I get W+1 from one of you again? I had to rebase the patch to have it pass CI jobs10:30
mariosshardy: disposable i mean yeah no db10:30
shardyI'm just thinking ahead, it'd be potentially a useful tool when we comletely decouple the configuration workflow from heat10:30
paramitehttps://review.openstack.org/#/c/499529/10:30
paramitemarios, jaosorior ^10:30
mariosshardy: that would be very cool indeed10:30
paramitemeh mandre ^10:30
paramitemarios, sorry for the noise10:30
mariosparamite: np !10:30
shardymarios: I'll try to find some time to look into it :)10:31
*** egonzalez has quit IRC10:31
*** jkilpatr has quit IRC10:34
*** atoth has quit IRC10:35
openstackgerritFlorian Fuchs proposed openstack/tripleo-validations master: Fix repo-availabilita validation with Ansible 2.3  https://review.openstack.org/48339310:37
*** salmankhan has joined #tripleo10:39
*** fzdarsky has joined #tripleo10:42
*** pdeore is now known as pdeore|afk10:45
Tengushardy: hmm. weird. apparently, the ControllerExtraConfig doesn't update the controller_extraconfig.json on the controller nodes. Trying once more, but…10:47
Tengushardy: the command is `openstack overcloud update stack -i overcloud', or is it a `openstack overcloud deploy'  ? (with env file of course)10:48
*** d0ugal has quit IRC10:48
shardyTengu: ah, not it should be re-running overcloud deploy10:48
Tenguaahhh10:48
shardyTengu: the overcloud update is only for triggering minor package updates10:49
Tenguhmm. ok.10:49
Tenguah, yep, ok. "Updates packages on overcloud nodes"10:49
Tenguhumpf.10:49
shardyTengu: it's a little confusing because it accepts -e options for historical reasons, they're actually ignored/deprecated10:50
shardyhopefully we can remove them this cycle to make it clearer10:50
Tenguwould be good indeed10:51
Tengushardy: hmmm so the call for update is just openstack overcloud update stack overcloud -i  right?10:51
Tengu-i in order to get a hand on the breakpoints.10:51
*** stendulker has joined #tripleo10:51
*** udesale has quit IRC10:52
shardyTengu: yes, it'll do a rolling package update of the nodes, but note the process has been changing in very recent versions to a more ansible based approach to handle the new containerized deployments10:52
Tenguok. for now we're based on the packages10:52
TenguI'll update our script in order to drop the -e --templates.10:53
shardyTengu: Ok, the old approach just runs a script on each node, but https://review.openstack.org/#/c/487488/ moves to a more flexible ansible based appraoch10:53
shardyapproach10:53
Tenguok10:54
*** stendulker_ has quit IRC10:54
Tengushardy: small question: would the migration package ->> containers be possible later?10:54
shardyTengu: yes, it's being tested for ocata->pike upgrades10:54
Tenguasking, because we took the decision to install package-based instead of containers, mainly becauser we weren't confident with containers on pike10:54
Tengu(new feature, blah)10:54
*** milan has joined #tripleo10:54
Tengushardy: ok, so we might consider containers for Queens migration then :)10:55
*** morazi has quit IRC10:55
shardyTengu: ack, that should be possible, we'll just need to keep the upgrade_tasks in docker/services/* that stops/disables the service on the host10:55
*** stendulker has quit IRC10:56
Tengushardy: would be good - I'm pretty sure I won't be the only one with that issue :)10:56
openstackgerritMerged openstack/tripleo-common master: Fix healthchecks permissions  https://review.openstack.org/50657310:57
*** dparkes has joined #tripleo11:00
Tengushardy: ah, also, it would be great if we could add an option /env file to the update, in order to pass a script that will update the source-lists (i.e. when using trunk, there's a hash in the URL of the repository, and apparently it needs to be updated)11:00
Tenguor am I wrong regarding the hash usage?11:00
*** jkilpatr has joined #tripleo11:02
*** d0ugal has joined #tripleo11:02
*** aditya_ra has quit IRC11:03
shardyhttps://docs.openstack.org/tripleo-docs/latest/install/post_deployment/package_update.html11:03
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/puppet/role.role.j2.yaml#L19011:03
*** aditya_r has joined #tripleo11:03
shardyTengu: that is possible by a combination of overcloud deploy --update-plan-only and the UpgradeInitCommand parameter11:03
shardythat enables you do do a repository switch before any package updates happen11:04
shardyhowever11:04
shardyit may be easier to configure your repos to they point to one of the repo links, instead of a specific hash:11:04
*** dparkes has quit IRC11:04
shardyhttps://trunk.rdoproject.org/centos7-pike/current-tripleo/11:04
shardyfor example11:04
Tengushardy: hmm, we curl the .repo provided on the server11:04
Tengu(i.e. on tripleo.org server)11:05
shardyTengu: yeah we mostly do use the explicit hash .repo files for testing/CI as it's easier to debug what version is running11:06
TenguI like that as well :)11:06
shardybut it should also be possible to write the repo file with one of the links11:06
Tengufor now our update script just calls a simple ansible playbook that will fetch_url the new .repo file - after that it calls the openstack overcloud update -i11:06
shardyTengu: If you prefer the explicit repo files, you'll need a little script in UpgradeInitCommand that pulls the latest repos on update11:06
Tenguguess it's also good11:06
shardyTengu: yeah that will also work11:07
Tengumight even be faster than updating the plan :)11:07
*** adarazs is now known as adarazs_lunch11:07
*** jkilpatr has quit IRC11:07
shardyTengu: it may be, although that is quite fast as it doesn't update the heat stack. only the swift container11:07
shardyeither approach is valid I guess, provided you don't mix the ansible repo management with tripleo UpgradeInitCommand11:08
Tenguhmm. right, we did use that before in order to ensure the plan is OK11:08
Tenguso. update ended, I can now deploy in order to get my haproxy configuration :)11:08
shardyhttps://docs.openstack.org/tripleo-docs/latest/install/post_deployment/upgrade.html#upgrading-the-overcloud-to-ocata-and-beyond11:09
shardythat shows how to use UpgradeInitCommand, just FYI11:09
openstackgerritJiri Stransky proposed openstack/tripleo-quickstart-extras master: Use different variables for deploy and upgrade scenarios  https://review.openstack.org/50054611:09
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171838711:10
openstackLaunchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Marios Andreou (marios-b)11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171952511:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1719525 in tripleo "CI: scenario002 job fails with Zaqar error "404 not found" in undercloud" [Critical,Triaged]11:10
*** timothyb89 has quit IRC11:11
*** jaosorior is now known as jaosorior_sick11:12
openstackgerritJiri Stransky proposed openstack/tripleo-quickstart master: scenario templates deploy with pacemaker  https://review.openstack.org/50254511:12
*** shreshtha has quit IRC11:13
*** radeks has quit IRC11:15
Tengushardy: guess what… deploy complains because it doesn't find "available" hosts - of course, they are all already installed…11:17
Tengushardy: guess matching is, once again, broken at some point -.-.11:17
*** snecklifter has joined #tripleo11:18
shardyTengu: Hmm, that sounds wrong, I assume the *Count parameters have not been changed?11:19
Tengushardy: nothing has been changed regarding the count, indeed11:19
Tengufirst thing I checked11:19
shardyTengu: Ok, sounds like a bug, could you please raise one with details of the steps performed?11:20
shardyTengu: you can probably use --validation-errors-nonfatal as a workaround?11:20
*** jkilpatr has joined #tripleo11:20
*** bugzy_ is now known as bugzy11:20
Tengushardy: I start the deploy now with that option, I'll check the logs in the meanwhile in order to get some more information.11:21
shardyTengu: sounds good, thanks!11:21
Tengushardy: I updated the whole stuff yesterday.11:21
Tengujust so that you know11:21
*** egonzalez has joined #tripleo11:25
*** pcaruana has joined #tripleo11:27
*** udesale has joined #tripleo11:28
*** pradk has quit IRC11:28
openstackgerritRadomir Dopieralski proposed openstack/tripleo-heat-templates master: Fix permissions for dockerized horizon  https://review.openstack.org/50740811:29
*** atoth has joined #tripleo11:29
*** pdeore|afk is now known as pdeore11:29
rdopieramandre: I had to change your name in your the commit message to drop the accent on e, because it crashed the tripleo-quickstart devmode11:30
Tenguhmm. shardy what's the command in order to ensure nova-compute is running as expected?11:31
TenguI don't recall it11:31
Tengushardy: anyway, nothing in the nova-sched.log regarding some filter missing the target.11:33
Tenguweird.11:33
Tenguand un-cool.11:33
*** colonwq has joined #tripleo11:35
openstackgerritMerged openstack/tripleo-ui master: Listen for messages from internal introspect workflow  https://review.openstack.org/50403511:37
*** dparkes has joined #tripleo11:37
*** rbowen has quit IRC11:39
*** radeks has joined #tripleo11:40
*** jtomasek has joined #tripleo11:41
*** pkovar has joined #tripleo11:41
Tengusmall question regarding the host aggregate: is there a way to pin a flavor to a certain aggregation? I think I saw a doc about that, but I'm unable to find it back.11:44
jistrmandre: upgrade job still ongoing, other than that all expected jobs have passed on https://review.openstack.org/#/c/50780111:47
*** adarazs_lunch is now known as adarazs11:47
jistrUC containers job is red there but i don't think it uses the changed files11:47
* jistr double checks11:47
*** shreshtha has joined #tripleo11:48
jistrright it doesn't even use featuresets11:48
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Create tempest role Member and creater for barbican tempest tests  https://review.openstack.org/50782911:49
*** brian83 has joined #tripleo11:50
jistryea it doesn't use the files https://github.com/openstack-infra/tripleo-ci/blob/master/scripts/tripleo.sh#L621-L63011:50
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart master: Add compute-feature-enabled.attach_encrypted_volume to True  https://review.openstack.org/49992811:50
jistrshould be alright11:50
*** morazi has joined #tripleo11:50
*** shreshtha has quit IRC11:50
*** shreshtha has joined #tripleo11:51
*** snecklifter has quit IRC11:51
*** snecklifter has joined #tripleo11:51
mandrejistr: I have a fix for the UC failure, moment11:53
jistrmandre: perfect :) (i don't think we need to recheck the t-h-t patches tho)11:54
EmilienMhi11:54
*** jpena is now known as jpena|lunch11:54
*** abishop has joined #tripleo11:55
mandrejistr: hmm, fix not working... https://review.openstack.org/#/c/507775/11:55
*** dprince has joined #tripleo11:56
* jistr looks11:56
mandrerdopiera: for real? maybe I should consider legally changing my name to fix oooq11:56
*** chem has quit IRC11:56
*** dparkes has quit IRC11:59
*** ansmith has quit IRC11:59
jistrmandre: where do you look for info in the UC job aside from /var/log/undercloud_install.txt? not much info there12:00
*** ffiore has quit IRC12:01
rdopieramandre: yeah, silly12:02
rdopieraunicode is hard12:02
*** radeks has quit IRC12:03
*** bfournie has joined #tripleo12:03
mandrejistr: idk there is not much to see on the UC job :-/12:03
*** trown is now known as trown|outtypewww12:05
*** trown|outtypewww is now known as trown|afk12:05
atothEmilienM, o/12:06
mandrejistr: found the issue, we're still setting the auth_url to v2.0, new fix incoming12:08
*** afazekas|seek4fo is now known as afazekas12:09
rdopierawhere is the bug tracker for tripleo-qickstart? the launchpad doesn't have it configured12:09
*** thrash|g0ne is now known as thrash12:10
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171838712:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171952512:10
openstackLaunchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Marios Andreou (marios-b)12:10
*** ooolpbot has quit IRC12:10
openstackLaunchpad bug 1719525 in tripleo "CI: scenario002 job fails with Zaqar error "404 not found" in undercloud" [Critical,Triaged]12:10
*** dpawar has quit IRC12:10
*** cylopez has joined #tripleo12:11
*** jlabarre has joined #tripleo12:11
jistrmandre: nice :)12:11
openstackgerritMartin André proposed openstack/tripleo-heat-templates master: Fix stackrc for containerized undercloud  https://review.openstack.org/50777512:13
*** raildo has joined #tripleo12:13
jistrrdopiera: "unicode is hard" -- i only ever hear that with connection to Python though :D  Never really had unicode issues w/ Ruby for example.12:13
*** abregman has joined #tripleo12:15
rdopierajistr: or maybe you did, but you didn't get errors from it, just corrupted data12:15
*** dtantsur|afk is now known as dtantsur12:16
rdopierajistr: like I will often get letters addressed to Z&#252;rich12:17
ratailorHas anyone tried TLS enabled deployment successfully using quickstart ?12:17
*** pblaho has quit IRC12:18
*** lblanchard has joined #tripleo12:18
*** jprovazn has quit IRC12:18
*** threestrands has joined #tripleo12:18
*** threestrands has quit IRC12:18
*** threestrands has joined #tripleo12:18
jistrrdopiera: yea i get garbled stuff too occasionally from various sources, but really haven't noticed it with e.g. Ruby TBH12:19
*** pblaho has joined #tripleo12:19
jistrit's probably about defaults, i think Ruby defaults most things to UTF812:19
rdopierajistr: it's probably about you don't having any non-ascii characters in your name12:20
rdopieranot having12:20
jistri have říáý12:20
*** abregman is now known as abregman|afk12:20
rdopieraargh, I confused you guys again12:21
rdopierasorry12:21
*** abregman|afk is now known as abregman12:21
rdopierapython 3 defaults to utf8 too, I think12:22
rdopieraat least for text files12:22
rdopieraand source code12:22
jistryea i hope that should make things less likely to break12:23
jistrhaha no worries re nickname confusion, the nicks are to blame :) happens all the time12:23
*** pkovar has quit IRC12:24
*** moshele has quit IRC12:29
jistrmandre: the upgrade job timed out but was going well, all the way into validation step12:30
jistrso i think we're good to merge there12:30
*** abregman is now known as abregman|afk12:31
* jistr wondering if we need to cut things (pingtest?) away from the upgrade job. It's timing out pretty often.12:31
*** cylopez has quit IRC12:32
*** myoung|afk is now known as myoung12:33
EmilienMjistr: how to test an upgrade we we remove the only test?12:36
EmilienMwe added pingtest on purpose12:36
EmilienMnot sure dropping it will actually help12:36
jistrEmilienM: yea i totally agree. Though having a job that times out maybe 40% of the time isn't very helpful either.12:37
jistrpeople start ignoring it12:37
shardyIs there any way we can make the container images smaller?12:37
*** pchavva has joined #tripleo12:37
*** myoung is now known as myoung|biab12:37
EmilienMjistr: yeah, i feel the pain12:38
EmilienMjistr, mandre: I was away 2 weeks (almost 3) - do we have progress on making scenarios working on upgrades?12:39
ratailorshardy, EmilienM Do you have any idea how to deploy TLS enabled tripleo setup using quickstart ?12:39
jistrshardy: i usually make sure that the layers don't collect any unnecessary data. (e.g. running `yum clean all` *in the same layer* that installed packages). I'll try to check if kolla already does this.12:39
EmilienMgate-tripleo-ci-centos-7-containers-multinode-upgrades-nv is passing sometimes, but what about scenarios?12:39
EmilienMratailor: ask jaosorior_sick12:39
jistralso reusing parent images is a necessity in our case, but i think we also already do that12:39
EmilienMratailor: or hrybacki12:40
ratailorEmilienM, I tried, he suggested to ask hrybacki .12:40
EmilienMcool12:40
ratailorEmilienM, shardy Btw I am getting this error, https://bugs.launchpad.net/tripleo/+bug/171208112:40
openstackLaunchpad bug 1712081 in tripleo "SSH connection to supplemental ipa VM takes minutes" [Medium,In progress] - Assigned to Harry Rybacki (hrybacki-h)12:40
jistrEmilienM: scenario upgrades will be down until we merge a set of patches that mandre and me are working on12:40
jistri'll try to list them in an etherpad12:40
ratailorEmilienM https://bugs.launchpad.net/tripleo/+bug/171871212:41
openstackLaunchpad bug 1718712 in tripleo "cloud-init resets eth0 of supplemental node breaking networking" [High,In progress] - Assigned to Harry Rybacki (hrybacki-h)12:41
shardyjistr: yeah I just wonder if we can do any better, as IME the time to download the images is considerable12:41
ratailorhrybacki, you around ?12:41
hrybackiratailor: sort of -- people working on my house this morning12:41
EmilienMjistr: yeah I saw the patches a few weeks ago, I was just wondering the progress and if there is anything I can help12:42
*** aputtur has joined #tripleo12:42
ratailorhrybacki, do you have any workaround to deploy tls enabled setup ?12:42
ratailorhrybacki, I am getting https://bugs.launchpad.net/tripleo/+bug/1718712 error12:42
openstackLaunchpad bug 1718712 in tripleo "cloud-init resets eth0 of supplemental node breaking networking" [High,In progress] - Assigned to Harry Rybacki (hrybacki-h)12:42
hrybackiratailor: via oooq?12:42
ratailorhrybacki, yes.12:42
*** ffiore has joined #tripleo12:43
jistrEmilienM: we started hacking on it intensively this week, there was a bunch of chicken-and-egg issues to untangle but i think we're making progress... Still a bit worried that we might break something somewhere :) I think reviewing the patches that are ready would help. Let me create the EP :)12:44
*** rlandy has joined #tripleo12:44
EmilienMjistr: thx for the update :) ok i'll review12:44
hrybackiah yes. I've gotten around the networking issue in ^^. However, deployments are now hitting the infamous 'no valid hosts available.' error during the overcloud deploy. Hoping to resolve that his afternoon12:44
*** ansmith has joined #tripleo12:44
*** tzumainn has joined #tripleo12:44
jistrEmilienM: these two can are ready right away: https://review.openstack.org/#/c/507623   https://review.openstack.org/#/c/50780112:45
*** ansmith has quit IRC12:45
EmilienMjistr: ack, I'll at them today for sure12:46
jistrEmilienM: thanks12:46
ratailorhrybacki, cool. Thanks!12:47
*** amoralej is now known as amoralej|lunch12:48
hrybackiratailor: I will ping you when I have an update!12:48
EmilienMjistr: both +2, good work12:48
jistr^ mandre :)12:49
ratailorhrybacki, sure, since its EOD here. I will be back in IST timezone.12:49
hrybackiratailor: ack12:49
ratailorhrybacki, I will ping you tomorrow for any update, btw which TZ you are in ?12:50
*** eck`gone is now known as eck`12:50
*** jcoufal has joined #tripleo12:51
openstackgerritMichele Baldessari proposed openstack/tripleo-common master: Add CorosyncAuthkeySecret for the corosync encryption  https://review.openstack.org/50784412:51
openstackgerritOpenStack Proposal Bot proposed openstack/os-refresh-config master: Updated from global requirements  https://review.openstack.org/50471012:51
*** snecklifter has quit IRC12:53
*** ansmith has joined #tripleo12:54
*** leitan has joined #tripleo12:56
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements  https://review.openstack.org/50367912:56
*** pabelanger_ is now known as pabelanger12:56
jistrEmilienM, mandre: here it is (check out the title!!) https://etherpad.openstack.org/p/tripleo-containers-ha-ci12:56
*** dpawar has joined #tripleo12:56
EmilienMwouhouu12:57
*** jpena|lunch is now known as jpena12:57
EmilienMjistr: I like this title :D12:57
* EmilienM bookmarks12:57
*** oidgar has quit IRC12:58
weshayjistr++12:59
*** anshulbehl has quit IRC12:59
*** ratailor has quit IRC13:01
*** fzdarsky has quit IRC13:02
jistrhaha13:02
*** cylopez has joined #tripleo13:03
*** liverpooler has joined #tripleo13:03
*** jmelvin has joined #tripleo13:04
*** pkovar has joined #tripleo13:04
*** ecerquei has joined #tripleo13:05
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Heat]  https://review.openstack.org/49139913:06
gfidenteguys13:07
openstackgerritOpenStack Proposal Bot proposed openstack/os-refresh-config master: Updated from global requirements  https://review.openstack.org/50471013:08
openstackgerritDamien Ciabrini proposed openstack/puppet-tripleo master: WIP Galera: add support for encrypted SST  https://review.openstack.org/50785213:08
*** morazi has quit IRC13:09
*** pdeore has quit IRC13:09
*** vkhanna1 is now known as vkhanna13:09
*** morazi has joined #tripleo13:10
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171838713:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171952513:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Marios Andreou (marios-b)13:10
*** morazi is now known as morazi-vmm13:10
openstackLaunchpad bug 1719525 in tripleo "CI: scenario002 job fails with Zaqar error "404 not found" in undercloud" [Critical,Triaged]13:10
*** anshulbehl has joined #tripleo13:11
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements  https://review.openstack.org/50367913:12
*** jistr is now known as jistr|call13:12
*** moshele has joined #tripleo13:13
gfidenteare we installing any optional dependency on the openstack infra nodes?13:14
gfidenteor better, how are we doing that?13:14
gfidente(additional RPMs I mean)13:14
gfidenteplease :D13:14
*** oidgar has joined #tripleo13:15
*** MVenesio has joined #tripleo13:16
shardygfidente: you mean the subnode in the multinode jobs?13:17
gfidenteshardy yes13:17
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/deployed-server/deployed-server-bootstrap-centos.sh13:17
gfidenteyou guys13:17
shardywe bootstrap them with that, then EnablePackageInstall: true13:17
shardyso that puppet installs things on deploy13:17
gfidenteright yeah13:17
gfidenteso I think we have a complicated situation where13:17
gfidentecinder-volumes doesn't pull in python/rbd libs because ceph is an optional driver13:18
*** cdearborn_ has joined #tripleo13:18
gfidenteand while the kolla image for the volume container installs them just so that it works13:18
gfidenteon the subnode we don't have it installed13:18
*** trown|afk is now known as trown13:18
gfidenteso the non-containerized version of volume fails13:18
gfidentenow we could make ceph-ansible install the packages but why should it even care about a cinder dependency, on the baremetal, when deploying a containerized cluster? :D13:19
gfidentewhich goes back to ... how do we install it? :D13:19
gfidentehave suggestions?13:19
*** cdearborn__ has joined #tripleo13:19
shardygfidente: so it was installed previously because we configured ceph with puppet, but now it's not because we use ceph-ansible?13:19
gfidenteshardy ok yes we can also put it that way :D13:20
*** achadha has joined #tripleo13:20
shardygfidente: I guess perhaps the cleanest solution is a boolean for the cinder puppet module that enables installing the ceph deps?13:20
gfidenteshardy ah13:21
gfidenteshardy true13:21
gfidentemaybe it already has a parameter to customize the list of packages13:21
gfidentelet me check13:21
gfidentethanks13:21
*** cdearborn_ has quit IRC13:22
*** amoralej|lunch is now known as amoralej13:23
*** waleedm has quit IRC13:24
*** achadha has quit IRC13:25
*** anshulbehl has quit IRC13:26
*** chlong has joined #tripleo13:29
*** chlong has quit IRC13:31
openstackgerritOpenStack Proposal Bot proposed openstack/os-refresh-config master: Updated from global requirements  https://review.openstack.org/50471013:31
cmyster.213:34
*** janki has quit IRC13:34
*** gbarros has joined #tripleo13:34
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements  https://review.openstack.org/50367913:35
*** myoung|biab is now known as myoung13:37
*** anshulbehl has joined #tripleo13:38
*** eck` is now known as eck`gone13:40
*** jprovazn has joined #tripleo13:46
*** lifeless has quit IRC13:46
*** dparkes has joined #tripleo13:46
lvdombrkfolks, my overcloud deploy stuck on overcloud.ComputeIpListMap]: CREATE_COMPLETE  state changed13:47
lvdombrkfor a while13:47
openstackgerritOpenStack Proposal Bot proposed openstack/os-refresh-config master: Updated from global requirements  https://review.openstack.org/50471013:47
lvdombrkwhere to start discover issue?13:48
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements  https://review.openstack.org/50367913:51
*** dpawar has quit IRC13:52
*** dpawar has joined #tripleo13:52
*** lifeless has joined #tripleo13:54
*** ecerquei has quit IRC13:54
mandrecool title jistr|call :)13:54
*** ecerquei has joined #tripleo13:54
*** udesale__ has joined #tripleo13:55
*** dpawar_ has joined #tripleo13:55
*** gkadam has joined #tripleo13:56
*** udesale has quit IRC13:56
*** dpawar has quit IRC13:57
*** cylopez has quit IRC13:57
openstackgerritMerged openstack/tripleo-quickstart-extras master: Use tempest cli for listing tempest tests  https://review.openstack.org/50719913:58
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/47260714:00
*** dpawar_ has quit IRC14:00
*** cdearborn__ is now known as cdearborn14:01
*** pkovar has quit IRC14:01
jaosorior_sickEmilienM: can you check this out https://review.openstack.org/#/c/506008/ ?14:03
EmilienMjaosorior_sick: sure, after my call14:03
EmilienMjaosorior_sick: actually done, it was easy14:03
*** pblaho has quit IRC14:05
*** pkovar has joined #tripleo14:08
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171838714:10
openstackLaunchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Marios Andreou (marios-b)14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171952514:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1719525 in tripleo "CI: scenario002 job fails with Zaqar error "404 not found" in undercloud" [Critical,Triaged]14:10
*** oidgar has quit IRC14:12
*** ipsecguy_ has joined #tripleo14:13
openstackgerritAttila Darazs proposed openstack-infra/tripleo-ci master: Remove promotion logic from the toci scripts  https://review.openstack.org/50707614:13
*** ipsecguy has quit IRC14:14
*** dtrainor has joined #tripleo14:15
*** Goneri has joined #tripleo14:15
*** eck`gone is now known as eck`14:17
*** mdnadeem has quit IRC14:18
*** dparkes has quit IRC14:18
*** waleedm has joined #tripleo14:20
*** cylopez has joined #tripleo14:22
openstackgerritAttila Darazs proposed openstack-infra/tripleo-ci master: Remove promotion logic from the toci scripts  https://review.openstack.org/50707614:24
*** anshulbehl has quit IRC14:25
*** oidgar has joined #tripleo14:26
*** tongl has joined #tripleo14:27
*** jistr|call is now known as jistr14:27
jistrmandre, weshay: the failures are pretty much the same as what rdopiera said a while earlier... unicode :( is it worth amending the commit msg and rerunning the jobs, or can we merge?14:30
EmilienMshardy: do you have any thoughts on re: stable policy tag?14:30
jistrmandre, weshay: https://review.openstack.org/#/c/500546/14:30
*** tongl has quit IRC14:30
beaglesbandini, is there a flowchart or something that describes the steps of upgrades in HA deployments in liberty/mitaka somewhere? I'm trying to refresh my memory as to where "ExtraConfig" is applied relative to service restart on the controllers during an upgrade14:31
* jistr note to self to not use intl chars in commit messages to OOOQ14:31
weshayjistr, let's get input from sshnaidm, trown, panda and adarazs14:31
bandinibeagles: nothing outside the tht code I'm afraid :/14:31
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Create tempest role Member and creator for barbican tempest tests  https://review.openstack.org/50782914:31
jistrinteresting that the normal jobs also do a delorean build but don't have a problem with the characters14:31
beaglesbandini, cool thanks14:31
shardyEmilienM: I'm not sure - I guess we could apply for it, but for Heat it had some negative impact because we had difficulty getting folks added to a separate stable-maint team14:32
openstackgerritMerged openstack/tripleo-heat-templates master: docker: add logging(source & groups)  https://review.openstack.org/49952914:32
shardyEmilienM: If TripleO is required to build a new team of reviewers I don't think it's worth it, based on the Heat experience14:32
adarazsjistr: what gets broken by unicode? :)14:33
jistradarazs: https://ci.centos.org/artifacts/rdo/jenkins-tqe-containers-gate-master-tripleo-ci-delorean-full-containers_minimal-1658/console.txt.gz14:33
EmilienMshardy: we have the tag FYI14:33
EmilienMshardy: I'm advocating to remove it actually14:33
jistradarazs: rdopiera reported it https://bugs.launchpad.net/tripleo/+bug/171990114:33
openstackLaunchpad bug 1719901 in tripleo "Unicode handling error in tripleo-quickstart devmode" [Undecided,New]14:33
*** psahoo has quit IRC14:34
adarazsjistr: eh, yeah, we're most likely missing a decode call on a byte string from gerrit :S14:34
shardyEmilienM: Ah, Ok sec let me check the ml thread14:35
EmilienMmwhahaha, shardy: jfyi i'm about to propose the tag removal in openstack/governance - you're free to comment / vote14:35
mwhahahak14:35
mwhahahaat this point i don't think it make sense for THT14:36
mwhahahaother things like tripleo-common is probably fine14:36
mwhahahabut THT we can't honestly not allow some form of features after the release14:36
*** aditya_ra has joined #tripleo14:36
gchamouladarazsm jistr: https://bugs.launchpad.net/tripleo/+bug/166692914:37
openstackLaunchpad bug 1666929 in tripleo "jenkins-dep library fails in non-ascii characters in commit mesages" [Low,Triaged]14:37
EmilienMmwhahaha: ok so maybe remove it for tht and puppet-tripleo as well?14:37
EmilienM(they are tight)14:37
mwhahahaEmilienM: yea14:37
*** aditya_ra has quit IRC14:38
*** udesale__ has quit IRC14:38
mwhahahathose two need to be a bit more flexible for 3rd party integrations14:38
*** aditya_ra has joined #tripleo14:38
mwhahahacause you know all those operators are following master </eyeroll>14:38
*** aditya_ra has joined #tripleo14:39
*** aditya_ra has quit IRC14:39
*** aditya_r has quit IRC14:39
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Make CephConfigOverrides append to ceph.conf[global]  https://review.openstack.org/50788014:40
gfidenteshardy ^^ can you check the above seems like I misplace a map_merge :(14:40
*** threestrands has quit IRC14:40
*** mrch has quit IRC14:41
*** radeks has joined #tripleo14:43
openstackgerritGiulio Fidente proposed openstack/tripleo-docs master: Fix use of CephAnsibleExtraConfig and CephConfigOverrides  https://review.openstack.org/50788214:44
shardymwhahaha: I don't think it's so much about feature backports (we tried that before and IMO we should not do it again), but e.g blocking a bugfix backport because the priority is only Medium isn't super helpful IMHO14:44
*** rasca has quit IRC14:44
shardylike, if it's a bug and it's significantly user impacting I think a backport should be allowed, provided it's not a risky or invasive change14:44
mwhahahashardy: it's not so much features as merging (and testing) integration additions14:45
*** aditya_r has joined #tripleo14:45
shardymwhahaha: Yeah, perhaps there could be some exception for vendor integrations that aren't enabled by default14:45
mwhahahashardy: ie nuage changed their stuff and we backported it and it seems to be raising issues this time14:45
shardybut I'm wary because last time we tried that it turned into a backport-everything fest14:45
mwhahahashardy: I agree that we should probably come up with some better rules around the backport policy14:46
shardymwhahaha: ack, OK I missed that discussion re nuage14:46
mwhahahashardy: but i think for us it needs to be more flexible than the traditional stable policy from upstream14:46
mwhahahabut only in the sense of THT/puppet-tripleo14:46
mwhahahathe other bits should be fairly static14:46
shardymwhahaha: yeah, well we did try that, but as I said it got abused so we decided it was easier to just stick to the stable-maint policy of bugfixes only14:46
mwhahahawe shouldnt' be backporting features into tripleo-common/instack-undercloud14:46
shardybe happy to to discuss it again but just sharing the historical context14:47
mwhahahasure14:47
chandankumararxcruz: EmilienM: mwhahaha https://review.openstack.org/#/c/507353/ and https://review.openstack.org/#/c/507114/14:47
jistradarazs: fwiw we already have non-ascii chars in merged patches in t-h-t. So once merged, it shouldn't be a problem. The question is whether i should amend the otherwise all-green patch because of this, and re-run the CI on those changes, or if we're good.14:48
jistradarazs: they are https://review.openstack.org/#/c/500546 and https://review.openstack.org/#/c/502545/14:48
jistrthere's an 'é' patch here https://github.com/openstack/tripleo-heat-templates/commit/47cbe2f85d64e7beb0e37798e9efef67f7f3762314:49
jistrcc trown, panda, sshnaidm ^14:51
*** waleedm has quit IRC14:52
*** waleedm has joined #tripleo14:52
*** dmarlin has quit IRC14:52
*** marrusl has joined #tripleo14:54
*** radeks has quit IRC14:56
mwhahahado we have a bug/anyone looking at the timeouts for gate-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset02414:56
*** aditya_r has quit IRC14:57
*** brian83 has quit IRC14:57
*** waleedm has quit IRC14:57
*** waleedm has joined #tripleo14:57
*** rbowen has joined #tripleo15:00
*** waleedm has quit IRC15:01
*** waleedm has joined #tripleo15:01
Tenguhellow again :). Small question regarding host aggregation and flavor: is there anything to do with the aggregation itself like metadata or else? Apparently, adding a "aggretate-name=True" to the flavor and activating the filter in nova aren't sufficient15:02
*** waleedm has quit IRC15:02
openstackgerritGiulio Fidente proposed openstack/tripleo-docs master: Fix use of CephAnsibleExtraConfig and CephConfigOverrides  https://review.openstack.org/50788215:03
openstackgerritGonéri Le Bouder proposed openstack/tripleo-quickstart-extras master: validate-tempest: use local_working_dir var  https://review.openstack.org/50788915:03
*** pkovar has quit IRC15:03
TenguI think I saw a doc saying a metadata must be added to the aggregation as well, but I'm unable to find it back :(15:03
*** waleedm has joined #tripleo15:03
shardylyarwood: Hey any idea re the ^^ question?15:05
*** waleedm has quit IRC15:05
*** waleedm has joined #tripleo15:05
*** ykarel has quit IRC15:05
*** pkovar has joined #tripleo15:05
*** waleedm has quit IRC15:06
adarazsjistr: I'd say we can merge it if everything else passes.15:07
Tenguah, I think I have something that looks a lot like what I had in mind : http://kimizhang.com/openstack-zoning-regionavailability-zonehost-aggregate/15:08
beaglesbandini, quick question from the pacemaker-HA days. If someone "redeployed" to apply a configuration change, is there anything that would restart the services that had their config changed?15:08
Tenguand especially the nova aggregate-set-metadata 5 ssd=true (to be transformed to openstack CLI cmd).15:08
bandinibeagles: so jistr may remember better, but iirc when we do that we set maintenance-mode=true, do the puppet magic including restarts, set maintenance-mode=false in the cluster15:09
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171838715:10
openstackLaunchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Marios Andreou (marios-b)15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171952515:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1719525 in tripleo "CI: scenario002 job fails with Zaqar error "404 not found" in undercloud" [Critical,Triaged]15:10
jistrbandini, beagles: yup that's right15:10
openstackgerritGonéri Le Bouder proposed openstack/tripleo-quickstart-extras master: validate-tempest: use local_working_dir var  https://review.openstack.org/50788915:11
beaglesjistr, bandini : thanks!15:11
*** alee has joined #tripleo15:12
jistrbeagles: it might not have work well with some of the services managed by resource agents, but IIRC the "normal" services were restarted this way15:12
jistrs/work/worked/15:12
aleeEmilienM, jaosorior_sick ping re: https://bugs.launchpad.net/puppet-oslo/+bug/171992915:12
openstackLaunchpad bug 1719929 in tripleo "Debug paramter using wrong type" [High,Triaged] - Assigned to Ade Lee (alee-3)15:12
jaosorior_sickmwhahaha: ^^15:13
*** rasca has joined #tripleo15:14
jaosorior_sickmwhahaha, EmilienM: We were thinking of moving the Debug parameter in t-h-t for all services to be a boolean and default to false. What do you guys think about that? The current type and default value breaks :(15:14
mwhahahajaosorior_sick: or just Boolean($debug) in puppet-oslo15:14
mwhahaha(you can do type casting)15:14
jaosorior_sickmwhahaha: but, wouldn't an empty string default to true?15:14
jaosorior_sickmwhahaha: which is the opposite of the behavior we used to have.15:15
mwhahahanot sure i never tried15:15
mwhahahabut we blank it in THT because of being able to enable debug per service15:15
jaosorior_sickmwhahaha: we can get a similar functionality with booleans15:15
mwhahahaok15:15
jaosorior_sickpinky promise :P15:15
mwhahahawhy is this only a barbican problem15:16
mwhahahawhat are they doing differently than the other services15:16
jaosorior_sickmwhahaha: it's described in the bug report15:16
* mwhahaha ignores the fact that he asked about an inconsistency between openstack services15:16
aleemwhahaha, some of the older services like keystone end up using pick() in the puppet manifests for backwards compatibility15:16
mwhahahaseems like oslo.log should handle empty vars15:16
mwhahahaand fixing it in puppet is hiding that15:17
jaosorior_sickmwhahaha: but basically keystone sets that value with:   $debug_real = pick($::keystone::debug,$debug))15:17
*** chlong has joined #tripleo15:17
mwhahahajaosorior_sick: right but oslo.log should handle an empty ini setting correctly15:17
jaosorior_sickmwhahaha: but pick ignores empty strings15:17
jaosorior_sickmwhahaha: that's correct :D that's why I set that bug for puppet-oslo as well15:17
mwhahahano olso.log15:17
mwhahahanot puppet-oslo15:17
jaosorior_sickuhm15:17
mwhahahathis can be fixed for everyone in oslo.log15:18
jaosorior_sickok15:18
jaosorior_sickwell15:18
mwhahahathere is a bug in puppet-oslo around the empty string15:18
mwhahahabut oslo.log should properly handle debug=15:18
jaosorior_sickfor some damn strange reason, the value ended as "debug="15:18
*** dparkes has joined #tripleo15:18
jaosorior_sickmwhahaha: I'm not sure how that works or should work to be honest.15:18
jistradarazs: thanks15:18
jaosorior_sickmwhahaha: does the standard python ini parser handle those?15:19
mwhahahai have no idea but an empty value should probably be handed in a consistent way in oslo15:20
jistradarazs, weshay, mandre: I'm just double checking on things that might go wrong, and i'm thinking we should backport this and the parent patch to Pike first: https://review.openstack.org/#/c/507623  https://review.openstack.org/#/c/50780115:20
jaosorior_sickbnemec: ^^15:20
jistradarazs, weshay, mandre: it's nothing that CI will help us verify though. We don't run Pike container jobs on patches to OOOQ master...15:20
jistredge case...15:21
mwhahahajaosorior_sick: this is a UX thing around invalid values. in this case it's a boolean getting an empty so i guess what should be the correct way to handle this15:21
jistronce we propose the pike backport, the depends-on will automatically prevent the OOOQ-E patch from landing first15:21
jaosorior_sickbnemec: talking about oslo.log. Seems that a boolean option breaks if you set it as an empty value.   so, for instance, if debug is empty    "debug="   it doesn't take it. mwhahaha suggests this should be handled in oslo.log, though we set a wrong value (IMO) in puppet. Any suggestions?15:22
weshayI'm in management meetings, not really in a position to contribute in a meaningful way15:22
jistrack sorry :)15:22
weshaynp15:22
mwhahahajaosorior_sick: we should fix all the place :D15:22
weshaytrown, sshnaidm, panda please assist jistr15:22
openstackgerritDougal Matthews proposed openstack/tripleo-common master: Handle nodes that failed to start introspection  https://review.openstack.org/50490715:22
bnemecjaosorior_sick: You mean in a config file?15:22
mwhahahaso we can add validation in puppet-oslo, but THT should get switched to boolean you say?15:22
*** gvrangan has joined #tripleo15:23
jaosorior_sickbnemec: yeah15:23
jaosorior_sickbnemec: see https://bugs.launchpad.net/puppet-oslo/+bug/171992915:23
openstackLaunchpad bug 1719929 in tripleo "Debug paramter using wrong type" [High,Triaged] - Assigned to Ade Lee (alee-3)15:23
bnemecjaosorior_sick: So I think that's because oslo.config validates that option values are of the appropriate type.15:24
bnemecTechnically None is not a boolean.15:24
bnemec(which is what you get when you set debug=)15:24
jaosorior_sickmwhahaha: yeah15:24
bnemecI guess we could discuss whether to allow None for boolean options though.15:25
mwhahahaisn't None techincally false?15:25
openstackgerritMerged openstack/tripleo-heat-templates master: Start sequence at 1 for deploy steps playbook  https://review.openstack.org/50408615:25
*** moshele has quit IRC15:25
trownweshay: jistr ... seems those are both workflowed... what do I need to do?15:25
bnemecIt evaluates as false, but None is its own thing.15:25
jaosorior_sickmwhahaha: uhm... seems like a puppet-oslo issue too. Cause we are passing '', not undef or None.15:26
bnemecAn empty string also evaluates as false, but it's also not a boolean.15:26
mwhahahajaosorior_sick: /me repeats self, yes we need to fix all the places15:26
jaosorior_sickbnemec: not in puppet :D15:26
mwhahaha'' is false in puppet when you str2bool15:26
*** aufi has quit IRC15:26
mwhahahaheat -> puppet booleans are always awkward15:27
jaosorior_sickmwhahaha: not with any2bool15:27
hrybackihey all, need help troubleshooting a 'No valid hosts found' error during overcloud deployment.  Nova logs show it's getting hung up on a 'ComputeCapabilitiesFilter' return. I've poked at the nova instances, baremetal nodes, and flavors and everything looks like it should be operating. Any pointers for where next to look?15:27
jaosorior_sickmwhahaha: and it's true in a standard if statement.15:27
mwhahahadat consistency15:27
jaosorior_sickhaha yep!15:27
bnemecheat -> puppet -> python booleans :-)15:28
bnemecIt's a giant game of boolean telephone.15:28
jistrtrown: another +2 here would be nice since i'm co-author https://review.openstack.org/#/c/500546/ :) Though i was mostly trying to sync up with others what the situation is, and what i think we should do next. In general the set of patches to keep an eye on for enabling HA containers CI is here https://etherpad.openstack.org/p/tripleo-containers-ha-ci.15:29
openstackgerritMerged openstack/tripleo-heat-templates master: Add all services to scenario004-containers  https://review.openstack.org/50762315:29
*** rasca has quit IRC15:29
mwhahahajaosorior_sick: any2bool says '' is false15:29
mwhahahapuppet apply -e "notice(any2bool(''))"15:29
mwhahahaNotice: Scope(Class[main]): false15:29
*** rasca has joined #tripleo15:30
jaosorior_sickdafuq15:30
jaosorior_sickfucking docks15:30
jaosorior_sick*docs15:30
jaosorior_sickhttps://forge.puppet.com/puppetlabs/stdlib#any2bool15:30
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates stable/pike: Add all services to scenario004-containers  https://review.openstack.org/50789615:30
jaosorior_sick"Anything else returns true."15:30
jaosorior_sickok15:30
jaosorior_sickI guess the empty string is missing from the docs15:31
jaosorior_sickbut that makes life easier then15:31
mwhahahanot really15:31
jaosorior_sickwhy not?15:31
mwhahahacause $::os_service_default is not True :D15:31
jaosorior_sickwe just do any2bool  on debug, and pass that15:31
jaosorior_sickaskldjfklasjfkasjfdsak15:31
jaosorior_sickuhm15:32
mwhahahajust makes it uglier15:32
* mwhahaha creates patch15:32
jaosorior_sickthanks15:32
* bnemec reads that as jaosorior_sick headkeyboarding15:32
mwhahahaalso any2bool was created later15:33
mwhahahaneed to find what version that was added into to ensure we have it15:33
aleemwhahaha, jaosorior_sick , bnemec - I'll create the patch for t-h-t then15:33
mwhahahaalee: sounds good15:34
jaosorior_sickalee: thanks15:34
chandankumaralee: regarding this patch https://review.openstack.org/#/c/507829/ if tests will work then we can think about how to handle that15:34
chandankumarsorry15:34
chandankumararxcruz: ^^15:34
*** dprince has quit IRC15:34
trownjistr: ah right I have previously reviewed that, and the jobs failing on unicode parsing dont even test any of that15:34
jistrtrown: right yea15:35
*** dtantsur is now known as dtantsur|afk15:35
*** dprince has joined #tripleo15:35
jistrtrown: thanks, though please remove the +A for a while just yet, i think we'd break Pike by merging15:35
arxcruzchandankumar: we had this situation before, as I commented, see the discussion in https://review.openstack.org/#/c/486574/ EmilienM was right, we should not create a role to test barbican, if barbican needs that role, barbican should create it15:36
jistrtrown: that's what i was trying to say earlier, we need to backport this to pike first i think https://review.openstack.org/#/c/50780115:36
jistri'll propose the backport as soon as it merges15:36
arxcruzchandankumar: plus, you didn't follow my sugestion to use _member_ role, that's already being created automatically by tempest, as I said, if it's just a role, with no special permissions, you can use that15:36
trownjistr: oh whoops, I removed +A ... sorry was confused15:37
*** suuuper has quit IRC15:37
*** dmarlin has joined #tripleo15:37
chandankumararxcruz: i will wait till ci finish and then switch back to that15:37
arxcruzchandankumar: cool :)15:37
*** tongl has joined #tripleo15:37
dsneddonCan I get a quick review of this backport? https://review.openstack.org/#/c/50680615:39
jaosorior_sickbnemec: have you had a chance to look into getting the extra node in ovb?15:40
jaosorior_sickhrybacki, alee ^^15:40
*** psachin has quit IRC15:40
*** gkadam has quit IRC15:40
hrybackitrown: maybe you have a thought regarding my issue? https://paste.fedoraproject.org/paste/yMNqdd5UwB5gAdwZap5IxQ is some debugging work. Not sure why the capabilities filter is returning 0 or if that is a red herring15:41
openstackgerritMichele Baldessari proposed openstack/tripleo-common master: Add CorosyncAuthkeySecret for the corosync encryption  https://review.openstack.org/50784415:42
*** rcernin has quit IRC15:43
trownhrybacki: hmm is there a filter above that returning 0? also did the ironic deploy fail in the ironic conductor log?15:43
bnemecjaosorior_sick: Yes, OVB supports it now: https://github.com/cybertron/openstack-virtual-baremetal/commit/c288a1ae973f3b32e9e4481f6604204386cbae9c15:44
hrybackitrown: checking15:44
openstackgerritMichele Baldessari proposed openstack/tripleo-common master: Add CorosyncUpgradeAuthkeySecret for the corosync encryption  https://review.openstack.org/50784415:44
bnemec(although note that I forgot to add a new file to that commit, so don't try to cherry-pick just that commit)15:44
bnemecjaosorior_sick: I just need to write the te-broker patch to use it now.15:44
trownhrybacki: or did it never try to deploy in ironic... if there was never a request to ironic, then there has to be some filter that is filtering all the nodes out15:44
hrybackitrown: I'm not sure how to tell how far it made tbh15:45
*** yamahata has quit IRC15:45
trownhrybacki: well if ironic failed there is pretty sure to be some ERROR so you could just try `grep ERROR /var/log/ironic/ironic-conductor.log` to start15:46
openstackgerritMerged openstack/tripleo-heat-templates master: Stop mapping docker to OS::Heat::None in scenarios  https://review.openstack.org/50780115:48
hrybackitrown: nothing odd in the ironic logs15:48
hrybackilooking into nova-scheduler/conductor logs now15:48
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates stable/pike: Stop mapping docker to OS::Heat::None in scenarios  https://review.openstack.org/50790715:48
openstackgerritMichele Baldessari proposed openstack/tripleo-common master: Add CorosyncUpgradeAuthkeySecret for the corosync encryption  https://review.openstack.org/50784415:50
*** mcornea has quit IRC15:50
trownhrybacki: you can `grep get_filtered_objects` to just get all the filter calls15:50
jaosorior_sickbnemec: yay! thanks!15:50
trownhrybacki: that makes it easy to find the first filter that returns 0... which is the important one15:50
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates stable/pike: Stop mapping docker to OS::Heat::None in scenarios  https://review.openstack.org/50790715:51
*** ecerquei has quit IRC15:52
*** trown is now known as trown|afk15:53
*** oidgar has quit IRC15:54
*** stendulker has joined #tripleo15:54
hrybackitrown|afk: aside from the computecpabilities and retry filters I'm seeing a ram filter returning 0 hosts15:55
jfrancoashardy: may I ask one question about this BZ https://bugzilla.redhat.com/show_bug.cgi?id=1496485 ?15:56
openstackbugzilla.redhat.com bug 1496485 in openstack-tripleo-heat-templates "OSP11 -> OSP12 upgrade: heat-api-cloudwatch service running after upgrade" [Medium,New] - Assigned to emacchi15:56
*** egonzalez has quit IRC15:57
*** iranzo has quit IRC15:57
*** bswartz has joined #tripleo16:01
*** yamahata has joined #tripleo16:01
*** jlinkes has quit IRC16:02
*** timothyb89 has joined #tripleo16:03
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: Print status of playbook run in console  https://review.openstack.org/50791216:03
*** atoth has quit IRC16:03
shardyjfrancoa: sure!16:04
*** gvrangan has quit IRC16:05
jfrancoashardy: my doubt is if you know the reason why heat-api-cloudwatch is not containerized, if it is because we don't support it anymore in Pike (so the service should be stopped after upgrading) or because it has been missed16:05
*** ffiore has quit IRC16:05
openstackgerritAna Krivokapic proposed openstack/python-tripleoclient master: Fix error handling for actions  https://review.openstack.org/50791316:07
jfrancoashardy: or maybe this is more a question for therve ^^^16:08
shardyjfrancoa: It's just been missed I think16:08
shardyjfrancoa: but in general I think the services is fairly deprecated, so we might consider dropping support for it in future16:08
shardyI wrote it $many years ago but it never really became a full cloudwatch-compatible API, and really those sorts of functions should be handled by the telemetry projects anyway16:09
openstackgerritAna Krivokapic proposed openstack/python-tripleoclient master: Fix error handling for actions  https://review.openstack.org/50791316:09
shardyjfrancoa: the tricky thing is we don't have a good way to know if folks are using it16:10
jfrancoajfrancoa: I was thinking about trying to add it, as a good learning exercise..but I wanted to be sure it's not deprecated before doing nothing16:10
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171838716:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171952516:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Marios Andreou (marios-b)16:10
openstackLaunchpad bug 1719525 in tripleo "CI: scenario002 job fails with Zaqar error "404 not found" in undercloud" [Critical,Triaged]16:10
jfrancoashardy ^^^16:10
shardyjfrancoa: yeah I'd probably say add it if it's not too much work, but we should have the discussion about deprecation for Queens16:11
shardyIt's probably a pretty simple service to add16:11
dsneddonmhenkel_, I merged https://review.openstack.org/#/c/507228. Thanks for that. Does it need to be backported to any previous branches?16:11
jfrancoashardy: ok, thanks! I will go for it16:11
openstackgerritPradeep Kilambi proposed openstack/instack-undercloud master: Drop legacy ceilometer collector  https://review.openstack.org/50791716:12
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: WIP Handle using encryption by default for pacemaker in upgrade  https://review.openstack.org/48913216:13
*** stendulker has quit IRC16:13
*** stendulker has joined #tripleo16:14
jistrmandre: i'm off tomorrow beause of public holiday, i'll be back on Friday16:14
jistrtoday's status is that we have 4 patches ready to land, provided the pike backports will pass CI https://etherpad.openstack.org/p/tripleo-containers-ha-ci16:15
mandrejistr: enjoy your holiday, i'll work on the patches tomorrow, thanks a lot for all your hard work16:15
mandrejistr: I'll be off half of the day on Fri16:16
*** jpich has quit IRC16:16
jistrmandre: thanks!16:16
jistrack re Friday16:16
openstackgerritPradeep Kilambi proposed openstack/instack-undercloud master: Drop legacy ceilometer collector  https://review.openstack.org/50791716:17
*** trown|afk has quit IRC16:18
openstackgerritmathieu bultel proposed openstack/tripleo-common master: Execute minor update via ansible on mistral  https://review.openstack.org/48749616:19
openstackgerritMerged openstack/puppet-pacemaker master: Generate fence_ironic automatically  https://review.openstack.org/50723616:23
Tenguanyone can help me a bit with the host aggregate, nova filters and flavor? I'm having a hard time trying to make that work - apparently, there are some issues with incomplete doc, or maybe even wrong doc…16:23
*** tesseract has quit IRC16:24
*** marios has quit IRC16:25
*** myoung is now known as myoung|bbl16:25
*** hjensas has quit IRC16:26
*** rbowen has quit IRC16:26
*** yamahata has quit IRC16:30
*** florianf has quit IRC16:34
openstackgerritMichele Baldessari proposed openstack/puppet-pacemaker master: Add meta attribute support to stonith manifests  https://review.openstack.org/50691916:39
*** bogdando has quit IRC16:40
openstackgerritmathieu bultel proposed openstack/tripleo-common master: Execute minor update via ansible on mistral  https://review.openstack.org/48749616:40
derekhslagle: would you mind taking another look at https://review.openstack.org/#/c/490512/  and anybody else out there16:41
derekhalso if anybody is interested in health checks this should add two that are missing https://review.openstack.org/#/c/506125/16:41
EmilienMshardy, mwhahaha : https://review.openstack.org/50792416:42
openstackgerritMichele Baldessari proposed openstack/puppet-pacemaker master: Add meta attribute support to stonith manifests  https://review.openstack.org/50691916:42
openstackgerritMichele Baldessari proposed openstack/puppet-pacemaker master: WIP Add fence_compute stonith manifest  https://review.openstack.org/50691616:42
EmilienMtell me if I'm drunk16:42
slaglederekh: ack16:43
*** rbrady has quit IRC16:43
derekhmwhahaha: slagle thanks16:43
*** stendulker has quit IRC16:44
*** milan has quit IRC16:45
openstackgerritMichele Baldessari proposed openstack/puppet-pacemaker master: Add meta attribute support to stonith manifests  https://review.openstack.org/50691916:46
openstackgerritMichele Baldessari proposed openstack/puppet-pacemaker master: WIP Add fence_compute stonith manifest  https://review.openstack.org/50691616:46
*** derekh has quit IRC16:49
*** d0ugal has quit IRC16:50
*** achadha has joined #tripleo16:58
*** dparkes has quit IRC16:59
EmilienMshardy, mwhahaha: thanks for your comments, I like both of them17:01
*** cylopez has quit IRC17:01
*** achadha has quit IRC17:02
*** oidgar has joined #tripleo17:03
*** cylopez has joined #tripleo17:03
openstackgerritmathieu bultel proposed openstack/tripleo-common master: Execute minor update via ansible on mistral  https://review.openstack.org/48749617:03
*** ecerquei has joined #tripleo17:04
*** jpena is now known as jpena|off17:05
*** tosky has quit IRC17:10
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171838717:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171952517:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Marios Andreou (marios-b)17:10
openstackLaunchpad bug 1719525 in tripleo "CI: scenario002 job fails with Zaqar error "404 not found" in undercloud" [Critical,Triaged]17:10
openstackgerritPradeep Kilambi proposed openstack/instack-undercloud master: Drop legacy ceilometer collector  https://review.openstack.org/50791717:10
*** gvrangan has joined #tripleo17:12
*** rbowen has joined #tripleo17:13
*** pcaruana has quit IRC17:14
*** gfidente is now known as gfidente|afk17:14
openstackgerritJames Slagle proposed openstack/python-tripleoclient master: Config download support for standalone deployments  https://review.openstack.org/50582817:16
*** itlinux has joined #tripleo17:17
*** gvrangan has quit IRC17:17
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Use "become: true" in deploy steps tasks  https://review.openstack.org/50410317:17
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Config download support for standalone deployments  https://review.openstack.org/50582717:17
*** cylopez has quit IRC17:17
honzaAnyone know what the deal is with this minitar error message in the puppet-tripleo gate? http://logs.openstack.org/21/502521/2/check/gate-puppet-tripleo-puppet-lint/cb8fc21/console.html#_2017-09-27_12_06_15_46279617:18
openstackgerritOpenStack Proposal Bot proposed openstack/os-refresh-config master: Updated from global requirements  https://review.openstack.org/50471017:18
*** cylopez has joined #tripleo17:18
*** gvrangan has joined #tripleo17:19
*** gvrangan has quit IRC17:20
*** trown has joined #tripleo17:21
*** gvrangan has joined #tripleo17:21
*** dparkes has joined #tripleo17:21
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements  https://review.openstack.org/50367917:22
openstackgerritAde Lee proposed openstack/tripleo-heat-templates master: Ensure Debug is a boolean  https://review.openstack.org/50793517:22
mwhahahahonza: puppet-lint released a new version and it's broken, we merged the fix for master17:23
mwhahahahonza: should be able to recheck if master, pike still broken17:23
openstackgerritPradeep Kilambi proposed openstack/instack-undercloud master: Remove legacy ceilometer api from undercloud  https://review.openstack.org/50793617:25
Tenguno one for my host aggregate question ? :(17:26
shardyTengu: seems our nova experts aren't around today, you might want to try the general #openstack channel or perhaps #openstack-nova?17:27
shardyas it seems the question isn't specific to TripleO?17:28
shardysorry I'm not familiar enough with host aggregates to answer17:28
Tengushardy: hmmm, right. as I found how to configure the filters in nova in tripleo, the issue is related to nova itself. I'll poke in openstack-nova :)17:28
*** shardy has quit IRC17:29
*** ed_b has joined #tripleo17:31
*** markmc has quit IRC17:32
*** markmc has joined #tripleo17:33
*** dpawar has joined #tripleo17:33
honzamwhahaha: thanks!17:35
*** achadha has joined #tripleo17:35
*** dpawar has quit IRC17:35
openstackgerritMerged openstack/tripleo-quickstart-extras master: Switch to keystone V3 API from Queens onwards  https://review.openstack.org/50711417:37
openstackgerritMerged openstack/tripleo-quickstart-extras master: Remove dependency on identity credentials with keystone v3  https://review.openstack.org/50735317:37
*** achadha has quit IRC17:40
*** gvrangan has quit IRC17:40
*** gvrangan has joined #tripleo17:41
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: Fix upgrades that use Management network  https://review.openstack.org/50680617:42
*** dparkes has quit IRC17:45
*** trown has quit IRC17:46
hrybackitrown: the issue looks to have replicated with master-tripleo-ci as well =/17:46
*** oidgar has quit IRC17:47
*** amoralej is now known as amoralej|off17:51
*** itlinux has quit IRC17:51
hrybackitrown interestingly this time there is no RamFilter failure. It is /just/ ComputeCapabilitiesFilter17:52
*** dpawar has joined #tripleo17:52
*** jtomasek has quit IRC17:53
*** myoung|bbl is now known as myoung17:55
*** jfrancoa has quit IRC17:55
*** achadha has joined #tripleo18:04
*** oidgar has joined #tripleo18:06
*** pkovar has quit IRC18:06
*** achadha_ has joined #tripleo18:07
*** achadha_ has quit IRC18:08
*** achadha_ has joined #tripleo18:08
*** achadha has quit IRC18:09
*** achadha_ has quit IRC18:09
*** jkilpatr has quit IRC18:10
*** achadha has joined #tripleo18:10
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171838718:10
openstackLaunchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Marios Andreou (marios-b)18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171952518:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1719525 in tripleo "CI: scenario002 job fails with Zaqar error "404 not found" in undercloud" [Critical,Triaged]18:10
*** achadha has quit IRC18:11
*** achadha has joined #tripleo18:12
*** rbrady has joined #tripleo18:12
*** rbrady has joined #tripleo18:12
EmilienMmwhahaha: not sure someone is working on the alerts (reply to your question)18:15
*** pcaruana has joined #tripleo18:15
*** salmankhan has quit IRC18:15
*** shreshtha has quit IRC18:16
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: Add a lightweight UC template/role data for deployed-servers  https://review.openstack.org/49963718:17
openstackgerritMerged openstack/os-net-config master: Added driver option for Contrail DPDK  https://review.openstack.org/50722818:17
*** rbowen has quit IRC18:17
openstackgerritMerged openstack/tripleo-heat-templates master: Add IronicPxe to the default controller  https://review.openstack.org/49051218:17
*** hjensas has joined #tripleo18:18
*** yamahata has joined #tripleo18:23
*** jkilpatr has joined #tripleo18:23
*** radez has joined #tripleo18:29
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart-extras master: Use different variables for deploy and upgrade scenarios  https://review.openstack.org/50054618:33
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: scenario templates deploy with pacemaker  https://review.openstack.org/50254518:34
EmilienMjistr: everything rebased + approved18:34
EmilienMjistr: nice progress guys18:34
*** hjensas has quit IRC18:37
*** rwsu has quit IRC18:38
*** aputtur has quit IRC18:46
*** rbowen has joined #tripleo18:54
*** tosky has joined #tripleo18:55
*** moshele has joined #tripleo18:55
*** dprince has quit IRC18:56
*** jlinkes has joined #tripleo18:57
*** pcaruana has quit IRC19:00
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Save console files with timestamps  https://review.openstack.org/48736219:01
*** mrunge_ has joined #tripleo19:04
*** mrunge has quit IRC19:06
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates stable/pike: docker: add logging(source & groups)  https://review.openstack.org/50795219:06
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates master: Allow Sensu to connect to RabbitMQ cluster  https://review.openstack.org/49514919:08
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/newton: Keep floating ip reachability during pacemaker migration.  https://review.openstack.org/47496719:09
*** rbrady is now known as rbrady-afk19:09
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171838719:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171952519:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Marios Andreou (marios-b)19:10
openstackLaunchpad bug 1719525 in tripleo "CI: scenario002 job fails with Zaqar error "404 not found" in undercloud" [Critical,Triaged]19:10
*** paramite has quit IRC19:10
*** pkovar has joined #tripleo19:11
openstackgerritMerged openstack/tripleo-puppet-elements stable/newton: Set remove-machine-id to executable  https://review.openstack.org/50756119:17
*** dbecker has quit IRC19:17
*** jcoufal has quit IRC19:17
*** dprince has joined #tripleo19:20
*** thrash is now known as thrash|g0ne19:21
*** liverpooler has quit IRC19:23
*** liverpooler has joined #tripleo19:23
*** dpawar has quit IRC19:26
*** rwsu has joined #tripleo19:32
openstackgerritAndy Smith proposed openstack/tripleo-heat-templates master: WIP Separate rpc and notify messaging backends  https://review.openstack.org/50796319:33
weshayEmilienM, I think the tempest notification work is done, updated the card.  I'd like to now send out emails to the various lists and follow up w/ it from that angle. Can you think of anything else?19:34
EmilienMweshay: adding more tests to target specific dfgs19:35
*** rbowen has quit IRC19:35
weshayEmilienM, yes agree.. that is new work though19:35
weshayand should the email wait on that?19:36
EmilienMwell someone has to do it :D19:36
*** liverpooler has quit IRC19:36
EmilienMweshay: we don't have custom tests right now, so yes19:36
EmilienMexcept encrypted volume which is skipped now19:36
weshayk.. fair enough.. I'll write the cards for scenario02-5 right?19:36
EmilienMweshay: 2 to 4 is good19:36
weshayEmilienM, ok.. I'm out of sync then, probably need your assistance in defining the new work19:37
EmilienMweshay: well, look all featuresets and see what tests we're running19:37
EmilienMwe run one scenario at best19:37
EmilienMit's all in fs19:38
*** gvrangan has quit IRC19:38
EmilienMfor ex: run swift tests, notify the swift dfg19:38
EmilienMsame for mistral etc19:38
*** gvrangan has joined #tripleo19:38
*** liverpooler has joined #tripleo19:38
*** pradk has joined #tripleo19:39
EmilienMweshay: but I'm happy to help19:41
EmilienMweshay: how would I be useful? sending a patch for an example? mentor someone19:41
EmilienM?19:41
weshayEmilienM, sorry was looking through the tests19:42
weshayEmilienM, afaict the thing you want to see is the other dfg's getting signed up for tempest feedback.  What I'm not 100% clear on is if the tempest tests themselves also need to be changed19:44
weshaythis looks good afaict http://logs.openstack.org/49/489749/6/check/gate-tripleo-ci-centos-7-scenario002-multinode-oooq-container/f89bcff/logs/undercloud/home/jenkins/tempest_output.log.txt.gz19:44
*** liverpooler has quit IRC19:45
openstackgerritMerged openstack/tripleo-heat-templates master: Fix stackrc for containerized undercloud  https://review.openstack.org/50777519:45
stevebakermorning19:46
weshayEmilienM, sorry reread you do want further customization19:46
*** jprovazn has quit IRC19:48
*** gvrangan has quit IRC19:49
*** gvrangan has joined #tripleo19:50
EmilienMweshay: what would change?19:51
weshayEmilienM, ya I think we need to get feedback on that for the other scenarios.19:52
weshayI can do the following ...19:52
*** gvrangan has quit IRC19:52
weshay1. send an email to lists explaining how the tempest config is deterimined, and start a patch for each featureset we want to review.19:53
weshay2. ask the dfg's to submit patches to the reviews19:53
openstackgerritBen Nemec proposed openstack/instack-undercloud master: Enable convergence engine on the undercloud  https://review.openstack.org/49928319:53
*** dbecker has joined #tripleo19:53
weshay3. explain how to get setup for email notifications19:53
*** gvrangan has joined #tripleo19:54
*** sri__ has joined #tripleo19:56
*** moshele has quit IRC19:56
*** gvrangan has quit IRC19:58
sri__@EmilienM: quick question can I enable DVR and l3 HA in tripleo ?19:58
sri__@mwhahaha: ^^19:59
mwhahahayes19:59
mwhahahawe expose it via vars20:00
*** gvrangan has joined #tripleo20:00
openstackgerritSteve Baker proposed openstack/tripleo-quickstart-extras master: Sudo fix overcloud-custom-tht-script.sh.j2  https://review.openstack.org/49901820:00
openstackgerritSteve Baker proposed openstack/tripleo-quickstart-extras master: Use os_keypair for key upload  https://review.openstack.org/44522420:01
openstackgerritSteve Baker proposed openstack/tripleo-quickstart-extras master: Allow OVB to attach undercloud to existing floating IP  https://review.openstack.org/50639720:01
openstackgerritSteve Baker proposed openstack/tripleo-quickstart-extras master: Make UI accessable by default on OVB  https://review.openstack.org/50796920:01
sri__@mwhahaha: by default tripleo enable l3 ha right ? but when we enable DVR it's didn't use l3 ha !!20:01
mwhahahasri__: hmm maybe not https://github.com/openstack/tripleo-heat-templates/blob/37099cce3df8a1e86c7ecd79a76354c199a9719e/puppet/services/neutron-api.yaml#L8220:01
*** gvrangan has quit IRC20:02
mwhahahasri__ beagles might be the better person to answer your question20:02
*** gvrangan has joined #tripleo20:02
sri__@mwhahaha: I do remember beagles saying we can use either l3 or DVR we can't use both at the same time :)20:03
mwhahahasri__: yea that's most likely a neutron limitation and not a tripleo one20:04
EmilienMwe should have an env to enable it20:04
EmilienMyeah we have environments/neutron-ovs-dvr.yaml20:04
EmilienMweshay: that would be awesome20:05
weshayEmilienM, your threshold for awesome is weird :)20:05
EmilienMfor l3 HA, it's enabled by default unless I missed something20:05
openstackgerritIan Main proposed openstack/tripleo-heat-templates master: Fix logging for docker-puppet  https://review.openstack.org/50797020:05
EmilienMweshay: i'm trying to be MMMerican20:05
EmilienMweshay: everything is awesome :D20:05
weshayLOLZ20:06
weshayEmilienM++20:06
weshayEmilien had a joke everybody!!! AND it was good!20:06
sri__@mwhahaha: I think in openstack we can use both l3 and dvr side by side with VRRP https://docs.openstack.org/mitaka/networking-guide/config-dvr-ha-snat.html20:06
EmilienMsri__: yes we can20:06
EmilienMsri__: have you used environments/neutron-ovs-dvr.yaml ?20:06
sri__@EmilienM: Yes it disable the l3 ha20:07
sri__If don't use dvr then l3 ha enable by default20:07
EmilienMah so we need another env20:09
EmilienMenvironments/neutron-ovs-dvr-with-l3-ha.yaml20:09
EmilienM#problemsolved20:09
EmilienMsri__: patches welcome!20:09
*** akrivoka has quit IRC20:09
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171838720:10
openstackLaunchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Marios Andreou (marios-b)20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171952520:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1719525 in tripleo "CI: scenario002 job fails with Zaqar error "404 not found" in undercloud" [Critical,Triaged]20:10
*** ffiore has joined #tripleo20:11
sri__@EmilienM: I am new here , buy I will try anyway :)20:11
*** dbecker has quit IRC20:11
*** dbecker has joined #tripleo20:11
*** gvrangan has quit IRC20:12
sri__@EmilienM: can I hard code that value in here https://github.com/openstack/tripleo-heat-templates/blob/37099cce3df8a1e86c7ecd79a76354c199a9719e/puppet/services/neutron-api.yaml#L8220:12
sri__jest for monkey patch20:12
*** gvrangan has joined #tripleo20:12
mwhahahaso if i recall there was a bug around this very var where it was magically getting overridden somewhere20:12
*** cylopez has quit IRC20:12
*** jkilpatr has quit IRC20:14
EmilienMsri__: I think we just need a new env with the right parameters20:16
openstackgerritJames Slagle proposed openstack/python-tripleoclient master: Config download support for standalone deployments  https://review.openstack.org/50582820:17
EmilienMsri__: i'm happy to help if beagles isn't around20:18
sri__@EmilienM : ok, thanks I will try to get in touch with beagles20:21
*** ebarrera has quit IRC20:23
openstackgerritmathieu bultel proposed openstack/tripleo-common master: Execute minor update via ansible on mistral  https://review.openstack.org/48749620:24
openstackgerritIan Main proposed openstack/tripleo-heat-templates master: Explicitly set healthcheck command.  https://review.openstack.org/50284320:24
*** ffiore has quit IRC20:26
*** ffiore_ has joined #tripleo20:26
sri__@EmilienM: any clues where can I start !!20:27
weshaypradk, hey I see your telemetry mailing list is getting tempest emails20:27
weshaypradk, any feedback on if that is working as you would expect?20:28
*** cdearborn has quit IRC20:28
honzayay, gate is finally working, so this patch is ready for your reviewing pleasure https://review.openstack.org/#/c/502521/20:29
pradkweshay, I like them, the last couple were due to nova and other issues causing tempest to fail.. but at least we knew something was up.20:29
weshaypradk, ya.. the root cause is always up for grabs20:30
EmilienMsri__: I'm afk for lunch now, bbl20:30
pradkweshay, yea we're happy to see this in action.. Thank you for making this happen!20:30
openstackgerritIan Main proposed openstack/tripleo-docs master: 3rd party integration document.  https://review.openstack.org/50583620:32
*** ansmith has quit IRC20:33
*** ffiore has joined #tripleo20:33
*** jpena|off has quit IRC20:33
*** ffiore_ has quit IRC20:34
*** dbecker has quit IRC20:34
honzamwhahaha: thanks for the quick review20:35
*** eck` has quit IRC20:35
*** radez has quit IRC20:35
*** amoralej|off has quit IRC20:35
*** dalvarez has quit IRC20:35
sri__@EmilienM: ack   :)20:36
*** ecerquei has quit IRC20:37
*** radez has joined #tripleo20:37
*** dalvarez has joined #tripleo20:37
*** eck` has joined #tripleo20:37
*** jpena|off has joined #tripleo20:38
*** amoralej has joined #tripleo20:38
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: Add all services to scenario004-containers  https://review.openstack.org/50789620:38
openstackgerritDerek Higgins proposed openstack/tripleo-heat-templates stable/pike: Add IronicPxe to the default controller  https://review.openstack.org/50798120:41
*** ffiore has quit IRC20:42
*** eck` is now known as eck`gone20:42
*** ffiore has joined #tripleo20:43
*** achadha has quit IRC20:45
*** achadha has joined #tripleo20:45
*** morazi-vmm has quit IRC20:46
openstackgerritIan Main proposed openstack/tripleo-docs master: New Developer Docs  https://review.openstack.org/50670220:48
*** achadha has quit IRC20:50
EmilienMsri__: ok I'm back - how can I help? are you familiar with templates?20:52
*** rwsu has quit IRC20:52
sri__EmilienM: heat , yes20:52
EmilienMgood20:53
EmilienMsri__: have you sent a patch to OpenStack already?20:53
sri__no20:53
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: Stop mapping docker to OS::Heat::None in scenarios  https://review.openstack.org/50790720:54
EmilienMsri__: this is the most useful guide to get started: https://docs.openstack.org/infra/manual/developers.html#getting-started20:55
EmilienMsri__: let me know if you're stuck in a step20:55
sri__@EmilienM: sure, thanks20:56
*** oidgar has quit IRC20:57
*** pchavva has quit IRC20:58
sri__@EmilienM: I think it's overriding l3 env here https://github.com/openstack/tripleo-heat-templates/blob/37099cce3df8a1e86c7ecd79a76354c199a9719e/puppet/services/neutron-api.yaml#L19821:00
*** gvrangan has quit IRC21:01
EmilienMsri__: what do you mean by "it" ?21:01
sri__EmilienM: we know l3 ha enable by default ,  but when I enable the ovs-dvr option l3 ha disabled21:05
rookshardy/et-all I thought we needed to remove NovaComputeExtraConfig : https://gist.github.com/jtaleric/153fd30e5a31d47dee95362c231e7b4621:06
sri__EmilienM: maybe there is  good reasons why l3 ha disabled when dvr enabled21:06
EmilienMsri__: probably. I think we won't know today (too late I guess) but ping beagles tomorrow21:07
*** jlinkes has quit IRC21:07
sri__@EmilienM: understood21:07
openstackgerritMerged openstack/tripleo-heat-templates master: Make CephConfigOverrides append to ceph.conf[global]  https://review.openstack.org/50788021:08
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171838721:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171952521:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Marios Andreou (marios-b)21:10
openstackLaunchpad bug 1719525 in tripleo "CI: scenario002 job fails with Zaqar error "404 not found" in undercloud" [Critical,Triaged]21:10
*** sri__ has quit IRC21:11
*** rwsu has joined #tripleo21:12
*** MVenesio has quit IRC21:13
*** MVenesio has joined #tripleo21:13
*** bnemec has quit IRC21:14
EmilienMmatbu_: I was reviewing your code for update workflow and I think you missed the release notes that explain changes for users21:15
EmilienMdid you plan to add it afterward?21:15
*** jpena|off has quit IRC21:16
*** leitan has quit IRC21:16
*** radez has quit IRC21:16
*** amoralej has quit IRC21:16
*** dalvarez has quit IRC21:16
*** eck`gone has quit IRC21:16
*** MVenesio has quit IRC21:17
*** eck`gone has joined #tripleo21:18
*** radez has joined #tripleo21:18
*** dalvarez has joined #tripleo21:18
*** jpena|off has joined #tripleo21:18
*** amoralej has joined #tripleo21:18
openstackgerritMerged openstack/os-refresh-config master: Updated from global requirements  https://review.openstack.org/50471021:18
weshaymwhahaha, updated the overcloud as undercloud bug.. let me know if you still disagree21:19
weshayhttps://bugs.launchpad.net/tripleo/+bug/171990221:19
openstackLaunchpad bug 1719902 in tripleo "build the osp undercloud images from the images provided by the rhospimages rpm." [High,Triaged] - Assigned to John Trowbridge (trown)21:19
mwhahahaweshay: i replied21:19
weshaybah.. note to self, refresh.21:20
weshaythanks21:20
mwhahahaweshay: IMHO i don't think we should do it at all but short of coming up with a decent way to prep an undercloud to test overcloud stuff it might shave some time21:20
EmilienMmwhahaha: is https://bugs.launchpad.net/tripleo/+bug/1719525 really for scenario002? I spent some time today on this one and I reproduced on a classic scenario, not 00221:20
openstackLaunchpad bug 1719525 in tripleo "CI: scenario002 job fails with Zaqar error "404 not found" in undercloud" [Critical,Triaged]21:20
mwhahahaweshay: i understand why,i just think it's going to be dangerous21:20
mwhahahaEmilienM: no it's not scenario specifric21:21
mwhahahaEmilienM: it's jsut a resurfacing of https://bugs.launchpad.net/bugs/1713832 which i guess wasn't fully fixed21:21
openstackLaunchpad bug 1713832 in tripleo "Object PUT failed for zaqar_subscription" [Critical,Fix released] - Assigned to Thomas Herve (therve)21:21
mwhahahaEmilienM: there's an issue with the zaqar/swift interaction and most likely it's a bug in swift itself21:21
EmilienMok I renamed it21:23
*** raildo has quit IRC21:23
EmilienMmwhahaha: should we set https://bugs.launchpad.net/tripleo/+bug/1719525 as dup of https://bugs.launchpad.net/tripleo/+bug/1713832 ?21:23
openstackLaunchpad bug 1719525 in tripleo "CI: Zaqar error "404 not found" in undercloud" [Critical,Triaged]21:23
openstackLaunchpad bug 1713832 in tripleo "Object PUT failed for zaqar_subscription" [Critical,Fix released] - Assigned to Thomas Herve (therve)21:23
EmilienMnot sure at this point21:23
* mwhahaha shrugs21:23
mwhahahapossibly but that's really up to the experts (not me)21:23
*** dparkes has joined #tripleo21:24
*** abishop has quit IRC21:25
EmilienMtherve: when you can on your Thursday, can you look at 1719525 please?21:26
EmilienMweshay, mwhahaha : do we have a CI job that run a stack update like we had before quickstart?21:29
EmilienMbecause I looked at http://logs.openstack.org/21/502521/2/check-tripleo/gate-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024/61453d1/logs/undercloud/home/jenkins/21:29
EmilienMand there is no log for stack update21:29
openstackgerritPradeep Kilambi proposed openstack/instack-undercloud master: Remove legacy ceilometer api from undercloud  https://review.openstack.org/50793621:29
EmilienMI also looked at quickstart logs and it doesn't seem to run this action21:30
EmilienMsshnaidm: ^21:30
mwhahahai don't think so21:30
weshaymatbu_, ^21:30
*** etingof has quit IRC21:31
EmilienMbouu21:31
EmilienMso we are landing code that change the way we do stack-update... without CI coverage?21:31
mwhahahawe land a lot of things with out coverage21:31
EmilienMmwhahaha: stack-update is very critical IMHO21:32
EmilienMit's not just yet another plugin or service21:33
EmilienMit's a common-to-all-deployments feature21:33
* mwhahaha doesn't disagree21:33
mwhahahajust saying it as it is21:33
mwhahahapretty sure we lost it to a containers job21:33
mwhahahahttps://review.openstack.org/#/c/478924/2/jenkins/jobs/projects.yaml21:36
*** yamahata has quit IRC21:36
mwhahahaoh no it's supposed tyo be featureset02421:36
*** yamahata has joined #tripleo21:36
*** itlinux has joined #tripleo21:36
mwhahahawell it was renamed cause it didn't update21:37
*** achadha has joined #tripleo21:39
*** ffiore has quit IRC21:39
*** achadha has quit IRC21:39
*** ffiore has joined #tripleo21:39
*** achadha has joined #tripleo21:39
EmilienMmwhahaha: I checked fs24 and it doesn't run stack-update21:40
EmilienMweshay: do you know any WIP because I start looking at code?21:40
mwhahahaEmilienM: that review seems to indicate that ovb-updates didn't update anymore so thats why they changed the name21:41
mwhahahaEmilienM: so we lost the functionality at somepoint in CI and it's not related to fs024 specifically21:41
tdasilvaweshay: hi, I just noticed that on this matrix: https://github.com/openstack/tripleo-heat-templates/blob/master/README.rst#service-testing-matrix21:41
tdasilvafor scenario 2, it lists both swift and rgw, i'm not sure that's possible....21:41
EmilienMmwhahaha: what the hell we let this thing happen?21:41
weshayEmilienM, sorry guys I don't. I'm debugging newton bm deployments. I need a few more minutes and then can jump back in here21:41
EmilienMmwhahaha: who did that?21:42
mwhahahaEmilienM: you approved that patch21:42
mwhahahaor at least +1'd the rename21:42
*** dprince has quit IRC21:42
mwhahahaEmilienM: see commit message https://review.openstack.org/#/c/478924/221:42
EmilienMmwhahaha: it was supposed to be WIP and work soon (tm)21:43
* mwhahaha shrugs21:43
mwhahahaif only we had a way of tracking work21:43
mwhahahathat we could all use21:43
mwhahahaso things don't get lost21:43
mwhahahaperhaps we could use a tag like tech-debt21:44
* mwhahaha trolls his way out21:44
openstackgerritTom Barron proposed openstack/tripleo-quickstart-extras master: Add rhos-manila to email users  https://review.openstack.org/50799221:45
EmilienMmwhahaha: slagle reminded me that we never had "minor package update" coverage - but my -2 remains as we need coverage for that before we keep blinding merging code21:45
trozetmwhahaha, EmilienM: i have an issue where im providing nova::nova_private_key as extra config to my env file for OOO, but the new lines in the string get translated to spaces in json for hte hierdata21:45
trozetany ideas?21:45
mwhahahatrozet: you using | or > in your yaml21:45
*** lblanchard has quit IRC21:45
EmilienMthat ^21:45
mwhahahatrozet: one nukes the spaces and the other doesn't21:45
* mwhahaha doesn't recall which21:46
mwhahahai think > is the one you want21:46
*** jlabarre has quit IRC21:46
slagle> ignores newlines21:46
trozetmwhahaha: ah.  No I'm simply doing key: '<key>' and its over multiple lines21:46
slagleEmilienM just made me look this up on stackoverflow earlier today21:46
*** etingof has joined #tripleo21:46
trozetslagle: ignores parsing new lines?21:47
mwhahahaso yea >21:47
trozetthis is what i have now: https://paste.fedoraproject.org/paste/Hf~JZVxOTf2F7SxKGC7Npw/raw21:47
trozetmwhahaha, slagle: ah ok  I will give that a try.  Thanks!21:47
mwhahahatrozet: you'd do key: > <linebreak>21:47
mwhahahathen tab over unquited blob21:47
trozetright will try it21:47
trozetthanks  again21:48
EmilienMslagle: stack overflow is life21:48
*** dparkes has quit IRC21:50
*** jkilpatr has joined #tripleo21:56
*** jmelvin has quit IRC21:59
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/47260722:00
*** pkovar has quit IRC22:00
*** kbyrne has quit IRC22:00
*** kbyrne has joined #tripleo22:03
*** cdearborn has joined #tripleo22:06
*** rwsu has quit IRC22:07
*** Goneri has quit IRC22:08
openstackgerritMerged openstack/tripleo-heat-templates stable/ocata: manila: set "host" to "hostgroup"  https://review.openstack.org/49911122:09
openstackgerritMerged openstack/puppet-tripleo master: Use saltedsignal user for puppet-certmonger  https://review.openstack.org/50600822:09
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171838722:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171952522:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Marios Andreou (marios-b)22:10
openstackLaunchpad bug 1719525 in tripleo "CI: Zaqar error "404 not found" in undercloud" [Critical,Triaged]22:10
*** nyechiel has quit IRC22:12
*** gbarros has quit IRC22:22
*** gbarros has joined #tripleo22:23
*** rlandy is now known as rlandy|afk22:26
*** dmarlin has quit IRC22:33
openstackgerritAndy Smith proposed openstack/puppet-tripleo master: WIP: Updates to separate messaging backends  https://review.openstack.org/50800722:36
*** oidgar has joined #tripleo22:36
*** ansmith has joined #tripleo22:39
*** pradk has quit IRC22:44
*** oidgar has quit IRC22:46
*** achadha_ has joined #tripleo22:46
*** leitan has joined #tripleo22:48
*** achadha__ has joined #tripleo22:49
*** achadha has quit IRC22:49
*** gbarros has quit IRC22:50
*** achadha_ has quit IRC22:50
*** achadha__ has quit IRC22:51
*** achadha has joined #tripleo22:51
*** achadha has quit IRC22:55
*** ffiore has quit IRC23:00
*** threestrands has joined #tripleo23:00
*** threestrands has joined #tripleo23:00
*** bcafarel has quit IRC23:03
*** myoung is now known as myoung|afk23:03
*** myoung|afk is now known as myoung23:04
*** achadha has joined #tripleo23:04
*** achadha_ has joined #tripleo23:06
*** achadha has quit IRC23:06
*** tongl has quit IRC23:09
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171838723:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171952523:10
*** ooolpbot has quit IRC23:10
openstackLaunchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Marios Andreou (marios-b)23:10
openstackLaunchpad bug 1719525 in tripleo "CI: Zaqar error "404 not found" in undercloud" [Critical,Triaged]23:10
*** achadha_ has quit IRC23:11
openstackgerritMerged openstack/tripleo-quickstart-extras master: Use different variables for deploy and upgrade scenarios  https://review.openstack.org/50054623:11
*** myoung is now known as myoung|afk23:14
*** myoung|afk is now known as myoung23:14
*** bcafarel has joined #tripleo23:16
*** achadha has joined #tripleo23:19
*** achadha has quit IRC23:23
*** rbowen has joined #tripleo23:28
*** achadha has joined #tripleo23:30
openstackgerritMerged openstack/tripleo-quickstart master: scenario templates deploy with pacemaker  https://review.openstack.org/50254523:31
*** rbowen has quit IRC23:33
*** achadha has quit IRC23:34
*** dciabrin has quit IRC23:37
*** dciabrin has joined #tripleo23:38
*** moshele has joined #tripleo23:44
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: App config and I18n selectors refactor  https://review.openstack.org/49414123:45
*** bnemec has joined #tripleo23:52
*** lblanchard has joined #tripleo23:58
*** yamahata has quit IRC23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!