Tuesday, 2018-03-13

*** dparkes has quit IRC00:02
*** holser__ has quit IRC00:04
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403600:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175516800:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]00:10
openstackLaunchpad bug 1755168 in tripleo "Error: Package: openstack-heat-agents-1.5.4-0.20180301153730.ecf43c7.el7.centos.noarch fails to install" [Critical,Triaged] - Assigned to John Trowbridge (trown)00:10
*** itlinux has quit IRC00:14
*** yamahata_ has quit IRC00:37
*** rbrady has quit IRC00:41
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: New featureset for fast forward upgrade testing.  https://review.openstack.org/52568600:56
*** cshastri_ has joined #tripleo01:01
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403601:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175516801:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]01:10
openstackLaunchpad bug 1755168 in tripleo "Error: Package: openstack-heat-agents-1.5.4-0.20180301153730.ecf43c7.el7.centos.noarch fails to install" [Critical,Triaged] - Assigned to John Trowbridge (trown)01:10
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade master: New major upgrade workflow implementation.  https://review.openstack.org/54833601:12
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade master: [DNM]: Apply workaround for P->Q upgrades.  https://review.openstack.org/54922001:12
*** gvrangan has joined #tripleo01:22
*** gvrangan has quit IRC01:27
*** gvrangan has joined #tripleo01:43
*** gvrangan has quit IRC01:47
*** wolverineav has quit IRC01:51
*** yamahata_ has joined #tripleo01:51
*** wolverineav has joined #tripleo01:51
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: WIP: Add Ceph upgrade steps for FFU  https://review.openstack.org/55211401:51
*** zaneb has quit IRC01:54
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: WIP: Add Ceph upgrade steps for FFU  https://review.openstack.org/55211401:55
*** wolverineav has quit IRC01:55
*** zaneb has joined #tripleo01:57
*** wolverineav has joined #tripleo01:57
*** wolverineav has quit IRC02:01
*** nyechiel has joined #tripleo02:02
*** rcernin has quit IRC02:04
*** gvrangan has joined #tripleo02:04
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: WIP: Add Ceph upgrade steps for FFU  https://review.openstack.org/55211402:04
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: New featureset for fast forward upgrade testing.  https://review.openstack.org/52568602:06
*** khyr0n has quit IRC02:07
*** rdopiera has quit IRC02:07
*** rdopiera has joined #tripleo02:08
*** rlandy|bbl is now known as rlandy02:09
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403602:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175516802:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1755168 in tripleo "Error: Package: openstack-heat-agents-1.5.4-0.20180301153730.ecf43c7.el7.centos.noarch fails to install" [Critical,Triaged] - Assigned to John Trowbridge (trown)02:10
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: WIP: Add Ceph upgrade steps for FFU  https://review.openstack.org/55211402:12
*** nyechiel has quit IRC02:14
*** ihrachys has quit IRC02:22
zshidsneddon, hi, do you have a minute to review this os-net-config patch ?  https://review.openstack.org/#/c/548006/02:30
*** itlinux has joined #tripleo02:30
*** wolverineav has joined #tripleo02:31
*** gvrangan has quit IRC02:31
*** wolverineav has quit IRC02:35
*** etingof|afk has quit IRC02:36
*** fzdarsky__ has joined #tripleo02:43
*** chlong has joined #tripleo02:46
*** fzdarsky_ has quit IRC02:46
*** psachin has joined #tripleo02:48
*** etingof|afk has joined #tripleo02:48
*** myoung|bbl is now known as myoung02:52
itlinuxhello all..02:54
itlinuxI have this settings for the NTP on the deploy script but it fails.. --ntp-server 172.24.0.81,172.24.0.82,172.24.0.83,172.24.0.84,172.24.0.85 can anyone suggest a way to get this set up correctly? Do I need to create a yaml env? Thanks02:55
*** yolanda has quit IRC03:05
*** bkopilov has quit IRC03:05
*** wolverineav has joined #tripleo03:06
*** rcernin has joined #tripleo03:07
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403603:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175516803:10
*** ooolpbot has quit IRC03:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]03:10
openstackLaunchpad bug 1755168 in tripleo "Error: Package: openstack-heat-agents-1.5.4-0.20180301153730.ecf43c7.el7.centos.noarch fails to install" [Critical,Triaged] - Assigned to John Trowbridge (trown)03:10
*** wolverineav has quit IRC03:11
*** myoung is now known as myoung|afk03:22
*** rlandy has quit IRC03:22
*** gvrangan has joined #tripleo03:28
*** gvrangan has quit IRC03:33
*** ramishra has joined #tripleo03:38
*** wolverineav has joined #tripleo03:45
*** links has joined #tripleo03:50
*** fragatina has quit IRC03:52
*** ykarel|afk has joined #tripleo03:57
*** daidv has joined #tripleo04:01
*** udesale has joined #tripleo04:03
*** yolanda has joined #tripleo04:05
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403604:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175516804:10
*** ooolpbot has quit IRC04:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]04:10
openstackLaunchpad bug 1755168 in tripleo "Error: Package: openstack-heat-agents-1.5.4-0.20180301153730.ecf43c7.el7.centos.noarch fails to install" [Critical,Triaged] - Assigned to John Trowbridge (trown)04:10
openstackgerritMerged openstack/instack-undercloud master: Fix the url for TripleO documentation page  https://review.openstack.org/54813204:13
*** fragatina has joined #tripleo04:14
*** ykarel|afk is now known as ykarel04:16
*** fragatin_ has joined #tripleo04:17
*** fragatina has quit IRC04:18
openstackgerritzenghui.shi proposed openstack/tripleo-common master: Defaults to parent_resource name correctly  https://review.openstack.org/55227404:20
*** skramaja has joined #tripleo04:22
*** daidv has quit IRC04:22
*** daidv has joined #tripleo04:22
openstackgerritzenghui.shi proposed openstack/tripleo-common master: Defaults to parent_resource name correctly  https://review.openstack.org/55227404:25
*** skramaja_ has joined #tripleo04:29
*** skramaja has quit IRC04:30
*** bkopilov has joined #tripleo04:36
*** skramaja_ is now known as skramaja04:44
*** anilvenkata has joined #tripleo04:45
*** gvrangan has joined #tripleo04:48
*** fragatin_ has quit IRC04:50
*** fragatina has joined #tripleo04:50
*** moshele has joined #tripleo04:51
*** sri_ has quit IRC04:53
*** chlong has quit IRC04:55
*** ratailor has joined #tripleo04:59
*** ratailor has quit IRC04:59
*** tzumainn has quit IRC05:06
*** ratailor has joined #tripleo05:08
*** gvrangan has quit IRC05:09
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403605:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175516805:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]05:10
openstackLaunchpad bug 1755168 in tripleo "Error: Package: openstack-heat-agents-1.5.4-0.20180301153730.ecf43c7.el7.centos.noarch fails to install" [Critical,Triaged] - Assigned to John Trowbridge (trown)05:10
*** liverpooler has quit IRC05:12
*** pdeore has joined #tripleo05:14
*** sri_ has joined #tripleo05:14
*** gvrangan has joined #tripleo05:17
*** gvrangan has quit IRC05:18
*** gvrangan has joined #tripleo05:18
*** gvrangan has quit IRC05:21
*** gvrangan has joined #tripleo05:22
*** jaosorior has quit IRC05:22
*** dpawar has joined #tripleo05:24
*** itlinux has quit IRC05:26
*** masco has joined #tripleo05:26
*** mdnadeem has joined #tripleo05:26
*** wolverineav has quit IRC05:26
*** gvrangan has quit IRC05:26
*** wolverineav has joined #tripleo05:27
*** shreshtha has joined #tripleo05:27
*** pgadiya has joined #tripleo05:29
*** janki has joined #tripleo05:30
*** wolverineav has quit IRC05:32
Tenguhello there!05:49
Tengusmall question: apparently, the container centos-binary-tacker isn't present in tripleopike "user" - I can find it only in tripleoupstream… any reason?05:50
Tengualthough apparently I don't really need it - just an ugly error in satellite :(.05:51
openstackgerritMerged openstack/instack-undercloud stable/ocata: Zuul: Remove project name  https://review.openstack.org/54228905:53
*** daidv has quit IRC06:04
*** jfrancoa has joined #tripleo06:05
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403606:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175516806:10
*** ooolpbot has quit IRC06:10
openstackLaunchpad bug 1755168 in tripleo "Error: Package: openstack-heat-agents-1.5.4-0.20180301153730.ecf43c7.el7.centos.noarch fails to install" [Critical,Triaged] - Assigned to John Trowbridge (trown)06:10
*** ccamacho has quit IRC06:15
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: New major upgrade workflow implementation.  https://review.openstack.org/54833606:16
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: [DNM]: Apply workaround for P->Q upgrades.  https://review.openstack.org/54922006:16
*** apetrich has joined #tripleo06:19
*** waleedm has joined #tripleo06:21
*** marios has joined #tripleo06:23
*** yprokule has joined #tripleo06:23
openstackgerritMerged openstack/tripleo-heat-templates master: Replacing the count with loop.index for indexing  https://review.openstack.org/55177606:25
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: Re-use undercloud upgrades tasks.  https://review.openstack.org/55230306:29
*** anilvenkata has quit IRC06:32
openstackgerritJose Luis Franco proposed openstack-infra/tripleo-ci master: Use tripleo-upgrade role in undercloud upgrades job.  https://review.openstack.org/54897406:32
ykarelTengu, centos-binary-tacker is not in other namespaces because of https://review.openstack.org/#/c/526099/.06:33
Tenguykarel: oh :). OK. so no real problem then.06:33
*** pblaho has joined #tripleo06:34
Tenguykarel: hmm, I don't match kolla in the generated docker_registry file. weird.06:34
ykarelTengu, you mean overcloud_containers.yaml?06:39
openstackgerritMerged openstack/tripleo-heat-templates master: DPDK deployment fails when there is no deprecated parameters  https://review.openstack.org/55111006:40
openstackgerritSaravanan KR proposed openstack/tripleo-heat-templates stable/queens: DPDK deployment fails when there is no deprecated parameters  https://review.openstack.org/55230406:44
*** pblaho has quit IRC06:44
*** anilvenkata has joined #tripleo06:45
Tenguykarel: in the output of openstack overcloud container image prepare06:47
*** d0ugal has joined #tripleo06:49
ykarelTengu, Ok06:49
openstackgerritOpenStack Proposal Bot proposed openstack/diskimage-builder master: Updated from global requirements  https://review.openstack.org/55231606:50
bandinimwhahaha: done06:52
*** dsariel has joined #tripleo06:55
*** jaosorior has joined #tripleo07:02
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Add flag to enable SELinux in docker profile  https://review.openstack.org/55198507:05
*** pblaho has joined #tripleo07:08
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403607:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]07:10
*** ooolpbot has quit IRC07:10
*** fragatina has quit IRC07:13
*** fragatina has joined #tripleo07:14
*** pdeore_ has joined #tripleo07:17
*** pdeore__ has joined #tripleo07:17
openstackgerritOpenStack Proposal Bot proposed openstack/os-apply-config master: Updated from global requirements  https://review.openstack.org/55236707:19
openstackgerritOpenStack Proposal Bot proposed openstack/os-collect-config master: Updated from global requirements  https://review.openstack.org/55236907:19
openstackgerritOpenStack Proposal Bot proposed openstack/os-refresh-config master: Updated from global requirements  https://review.openstack.org/55237007:19
*** pdeore has quit IRC07:20
*** agurenko has joined #tripleo07:22
*** pdeore has joined #tripleo07:23
*** pdeore_ has quit IRC07:24
*** rcernin has quit IRC07:24
*** pdeore__ has quit IRC07:24
*** pdeore_ has joined #tripleo07:25
*** mdnadeem has quit IRC07:25
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud master: Make user-provided cert take priority over autogenerated one  https://review.openstack.org/55238107:27
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud master: Enable TLS by default  https://review.openstack.org/55238207:27
openstackgerritOpenStack Proposal Bot proposed openstack/python-tripleoclient master: Updated from global requirements  https://review.openstack.org/55239207:30
*** jcoufal has joined #tripleo07:31
*** mdnadeem has joined #tripleo07:35
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common-tempest-plugin master: Updated from global requirements  https://review.openstack.org/55240607:36
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-heat-templates master: Updated from global requirements  https://review.openstack.org/55240707:36
openstackgerritMoshe Levi proposed openstack/tripleo-heat-templates master: Add environment file for Mellanox SDN  https://review.openstack.org/55050707:36
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-validations master: Updated from global requirements  https://review.openstack.org/55240807:36
openstackgerritMoshe Levi proposed openstack/puppet-tripleo master: Enable networking-mlnx ml2 drivers  https://review.openstack.org/55050507:36
*** radeks has joined #tripleo07:42
*** pcaruana has joined #tripleo07:42
openstackgerritwaleed mousa proposed openstack/tripleo-heat-templates stable/queens: Replacing the count with loop.index for indexing  https://review.openstack.org/55242107:45
*** links has quit IRC07:52
openstackgerritdongwenjuan proposed openstack/tripleo-specs master: support Vitrage(RCA) service in TripleO  https://review.openstack.org/55242507:54
openstackgerritMoshe Levi proposed openstack/tripleo-heat-templates master: Assignning a value to NeutronServiceName propertiy in neutron-ovs-dpdk-agent.yaml  https://review.openstack.org/55082407:57
*** links has joined #tripleo07:59
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: Re-use undercloud upgrades tasks.  https://review.openstack.org/55230308:00
*** cylopez has joined #tripleo08:00
*** aufi has joined #tripleo08:00
*** paramite has joined #tripleo08:05
*** ccamacho has joined #tripleo08:05
*** ccamacho has quit IRC08:05
*** ccamacho has joined #tripleo08:06
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403608:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]08:10
*** quiquell has joined #tripleo08:10
*** gkadam has joined #tripleo08:11
*** ebarrera has joined #tripleo08:12
*** quiquell has quit IRC08:12
*** quiquell has joined #tripleo08:13
*** ebarrera has quit IRC08:14
*** ebarrera has joined #tripleo08:15
*** hjensas has joined #tripleo08:15
*** hjensas has quit IRC08:15
*** hjensas has joined #tripleo08:15
*** zoli is now known as zoli|wfh08:16
*** pblaho has quit IRC08:16
*** jpena|off is now known as jpena08:16
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart master: Explicitly specify if to run validation in undercloud  https://review.openstack.org/55243308:18
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Add undercloud-validate tag for tempest role  https://review.openstack.org/55198308:19
*** tesseract has joined #tripleo08:19
*** tesseract-RH has joined #tripleo08:20
*** egallen has joined #tripleo08:21
openstackgerritdongwenjuan proposed openstack/tripleo-specs master: support Vitrage(RCA) service in TripleO  https://review.openstack.org/55242508:22
openstackgerritOpenStack Proposal Bot proposed openstack/python-tripleoclient master: Updated from global requirements  https://review.openstack.org/55239208:25
*** florianf has joined #tripleo08:27
*** jtomasek has joined #tripleo08:30
*** chem|eod is now known as chem08:33
*** pmannidi has joined #tripleo08:34
*** pmannidi has quit IRC08:34
*** yolanda has quit IRC08:35
*** yolanda_ has joined #tripleo08:35
*** dparkes has joined #tripleo08:37
*** holser__ has joined #tripleo08:41
*** Neo_ has joined #tripleo08:41
*** gkadam is now known as gkadam-brb08:44
*** holser__ has quit IRC08:47
*** holser__ has joined #tripleo08:47
*** gkadam-brb is now known as gkdam08:52
*** gkdam is now known as gkadam08:52
*** bogdando has joined #tripleo08:52
*** guits__ has joined #tripleo08:52
*** tosky has joined #tripleo08:54
*** sshnaidm|afk is now known as sshnaidm08:55
*** aufi_ has joined #tripleo08:55
*** aufi has quit IRC08:57
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates master: Add purge to Nova cleanup cron.  https://review.openstack.org/55196608:58
openstackgerritmathieu bultel proposed openstack/tripleo-heat-templates stable/queens: Fix typo in network templates  https://review.openstack.org/55244908:59
*** jpich has joined #tripleo08:59
*** lucas-afk is now known as lucasagomes08:59
*** amoralej|off is now known as amoralej09:01
*** ffiore has joined #tripleo09:03
*** ccamacho has quit IRC09:04
*** ykarel is now known as ykarel|afk09:09
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403609:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]09:10
*** ooolpbot has quit IRC09:10
openstackgerritThomas Herve proposed openstack/tripleo-common stable/queens: Don't notify zaqar in publish_ui_logs_to_swift  https://review.openstack.org/55245209:11
*** quiquell has quit IRC09:12
*** royal_screwup21 has joined #tripleo09:14
*** quiquell has joined #tripleo09:14
*** sri_ has quit IRC09:15
*** ykarel|afk has quit IRC09:15
EmilienMbandini: thanks for the reviews09:16
EmilienM(good morning folks)09:16
bandiniEmilienM: morning!09:17
*** suuuper has joined #tripleo09:17
*** apetrich has quit IRC09:18
*** royal_screwup21 has left #tripleo09:19
*** ccamacho has joined #tripleo09:21
EmilienMcan someone review https://review.openstack.org/#/c/551700/ please09:22
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: [CVE-2018-1000115] memcached: restrict to TCP & internal_api network  https://review.openstack.org/55129209:24
EmilienMalso some CVE: https://review.openstack.org/#/c/551385/ https://review.openstack.org/#/c/551382/ https://review.openstack.org/#/c/551380/09:24
*** guits__ has quit IRC09:26
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: ironic/undercloud: align configuration with instack-undercloud  https://review.openstack.org/55063809:26
*** derekh has joined #tripleo09:26
*** pblaho has joined #tripleo09:26
EmilienMbogdando: hey, I did recheck last night on https://review.openstack.org/#/c/542556/09:27
*** sri_ has joined #tripleo09:28
EmilienMit fails here now: TASK [overcloud-prep-network : Prepare the network-isolation required networks on the undercloud] ***09:28
EmilienMhttps://logs.rdoproject.org/56/542556/63/openstack-check/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/Z3960331ae939462fb26a90c97c6ad043/undercloud/home/jenkins/overcloud_prep_network.log.txt.gz#_2018-03-13_04_23_0109:29
*** hnmn3 has joined #tripleo09:31
*** dbecker has joined #tripleo09:31
*** gfidente has joined #tripleo09:33
*** gfidente has quit IRC09:33
*** gfidente has joined #tripleo09:33
*** hnmn3 has quit IRC09:36
openstackgerritJose Luis Franco proposed openstack/tripleo-quickstart master: Add featureset for upgrade undercloud.  https://review.openstack.org/54896909:36
*** quiquell has quit IRC09:38
*** quiquell has joined #tripleo09:38
*** ratailor is now known as rtailor09:39
*** quiquell has quit IRC09:39
*** pblaho has quit IRC09:39
*** pblaho has joined #tripleo09:40
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Add flag to enable SELinux in docker profile  https://review.openstack.org/55198509:40
*** quiquell has joined #tripleo09:41
*** sshnaidm has quit IRC09:42
*** dparkes has quit IRC09:44
*** guits__ has joined #tripleo09:44
*** quiquell has quit IRC09:45
*** ykarel|afk has joined #tripleo09:46
*** dmellado has joined #tripleo09:47
*** quiquell has joined #tripleo09:47
*** ffiore has quit IRC09:48
*** ffiore has joined #tripleo09:48
*** pdeore has quit IRC09:52
*** pdeore_ is now known as pdeore09:52
*** quiquell has left #tripleo09:56
*** ssbarnea has joined #tripleo09:56
*** yamahata_ has quit IRC09:56
*** quiquell has joined #tripleo09:56
*** dtantsur|afk is now known as dtantsur09:59
*** anilvenkata has quit IRC09:59
*** anilvenkata has joined #tripleo10:00
openstackgerritDougal Matthews proposed openstack/tripleo-common master: Standardise the Workflow messaging and persist the last message  https://review.openstack.org/42506010:00
openstackgerritDougal Matthews proposed openstack/tripleo-common master: Refactor the Baremetal workflows to use the new messaging workflows  https://review.openstack.org/55246010:00
openstackgerritMerged openstack/puppet-tripleo master: Disallow TLS v1.0 from HAProxy  https://review.openstack.org/55087210:02
jaosoriorshardy: I wasn't actually planning to backport 55238110:03
jaosoriorshardy: in queens, the cert autogeneration is turned off by default, so it usually is not a problem. should I backport it?10:03
*** cylopez has left #tripleo10:04
shardyjaosorior: I just wanted to ask the question really, if you think it's not necessary to backport that's fine with me10:04
openstackgerritDougal Matthews proposed openstack/tripleo-common master: Standardise the Workflow messaging and persist the last message  https://review.openstack.org/42506010:04
openstackgerritDougal Matthews proposed openstack/tripleo-common master: Refactor the Baremetal workflows to use the new messaging workflows  https://review.openstack.org/55246010:04
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo stable/queens: Disallow TLS v1.0 from HAProxy  https://review.openstack.org/55246110:04
d0ugalshardy, jtomasek: How does this look? https://review.openstack.org/#/c/425060/10:04
*** dparkes has joined #tripleo10:05
shardyd0ugal: thanks, was just about to ping you about that :)10:05
shardyd0ugal: looks good, but to clarify is the plan to gradually move all zaqar.queue.post actions over to this interface?10:05
d0ugalshardy: btw, untested at this point. I have no env as I think there are still rdocloud issues.10:05
shardyd0ugal: OK I can probably help with testing10:06
d0ugalshardy: yes, I think so. I wanted to reduce the scale of this patch so we could land it sooner.10:06
shardyd0ugal: ack yeah a series of smaller patches sounds like a good idea10:06
bogdandoEmilienM: hm, interesting10:06
bogdandoEmilienM: how did you manage to squeeze through RDO cloud? :)10:07
shardyd0ugal: I think for the UI config-download case we'll at least have to also convert the run_ansible messages10:07
d0ugalshardy: right, to tidy up the ansible output?10:08
shardye.g config_download_deploy10:08
shardyd0ugal: well that's one part, but with this patch we still don't have any way to write a status file after the config download ansible configuration runs10:08
shardywhich is the problem I need to solve to enable the UI to deploy with config_download instead of only heat10:09
d0ugalRight10:09
shardytotally fine to do that in a follow up patch, just pointing out that could be the next step perhaps10:09
d0ugalshardy: so this is where we need to extract specific information from the ansible output?10:09
shardythen I can test and add writing the payload to swift, and the UI should be good to go wrt config download, I think10:09
shardyd0ugal: No, we just need to write the status e.g the exact same payload we sent to zaqar to swift somewhere10:10
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403610:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]10:10
*** ooolpbot has quit IRC10:10
*** Neo_ has quit IRC10:10
shardyso the UI when it starts or is refreshed has somewhere to poll for status10:10
shardyvs a potentially empty queue10:10
shardythe actual ansible task output can come later10:10
d0ugalshardy: my latest update does write to swift10:10
d0ugalMaybe I am missing something :)10:10
d0ugalhttps://review.openstack.org/#/c/425060/9/workbooks/messaging.yaml10:10
d0ugalLine 6810:11
shardyd0ugal: ah great!  I hadn't got to that file yet :)10:11
shardybut yeah we need the plan name as that is definitely different when we deploy openshift10:11
EmilienMbogdando: RDO cloud is back10:11
EmilienMsince yesterday night10:11
shardyis the queue name related to the plan?10:11
*** dparkes has quit IRC10:11
d0ugalshardy: no, the queue_name is either "tripleo" or a UUID. We could do that.10:12
shardyd0ugal: Ah, hmm, so what happens if two plans are deployed concurrently?10:12
d0ugalshardy: but actually, I think the UI uses the same queue for all plans.10:12
*** salmankhan has joined #tripleo10:12
d0ugalshardy: Good question :) I have never tried that. I guess the UI gets confused10:13
shardyd0ugal: ack, sounds like we might want to reconsider that, since plan deploy is asynchronous it's completely possible (even if not currently via the UI) to deploy multiple plans at once10:13
shardyeven if we know it may not be a great idea :)10:13
shardyI'm just wondering if having a queue per plan would avoid changing a bunch of interfaces to also pass the plan name10:14
*** ykarel|afk is now known as ykarel10:14
d0ugalshardy: we would still need to change interfaces. For example, baremetal workflows don't know the plan name. Meaning we would need to add it to tripleoclient etc. if we wanted to use it10:17
d0ugaltripleoclient uses the queue "tripleo" now, I forgot it switched. So it should never be a UUID10:17
d0ugalIn theory, if you run a CLI command the GUI should update in real time - I don't know if anyone has tested this.10:18
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: oooq transformation, make sure to use the same deployed server file.  https://review.openstack.org/55206110:18
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: DNM: Add debug and don't fail on validation for ffu.  https://review.openstack.org/55206310:18
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: DNM: Testing FFU from queens branch.  https://review.openstack.org/55206410:18
shardyd0ugal: Ok, yeah it's tricky for baremetal workflows because they aren't necessarily associated with any plan10:19
shardyd0ugal: I added a few comments, thanks for the help with this!10:19
d0ugalnp10:19
shardyI'll pull and test it shortly10:19
d0ugalI think rdocloud might be back, so I'll try and bring up an env to test.10:20
*** rtailor has quit IRC10:22
*** brault_ has quit IRC10:23
*** ratailor has joined #tripleo10:24
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart-extras master: Do not record host identification for reproducer ssh commands.  https://review.openstack.org/55043710:27
*** dparkes has joined #tripleo10:28
*** panda|off is now known as panda10:32
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: FFU upgrade issue with the release loop var.  https://review.openstack.org/55205110:33
*** ffiore has quit IRC10:34
*** guits__ has quit IRC10:34
*** ffiore has joined #tripleo10:35
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade master: oooq transformation, make sure to use the same deployed server file.  https://review.openstack.org/55084110:36
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade master: DNM: Add debug and don't fail on validation for ffu.  https://review.openstack.org/54926910:36
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: oooq transformation, make sure to use the same deployed server file.  https://review.openstack.org/55206110:37
*** cshastri_ has quit IRC10:38
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: oooq transformation, make sure to use the same deployed server file.  https://review.openstack.org/55206110:38
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: DNM: Add debug and don't fail on validation for ffu.  https://review.openstack.org/55206310:39
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: DNM: Testing FFU from queens branch.  https://review.openstack.org/55206410:39
*** jcoufal_ has joined #tripleo10:41
openstackgerritJanki Chhatbar proposed openstack/tripleo-heat-templates master: Add flag to enable QoS DSCP marking in ODL  https://review.openstack.org/55247410:43
*** jcoufal has quit IRC10:44
jankiHi, Can I please get reviews for https://review.openstack.org/#/c/531322/ and https://review.openstack.org/#/c/547961/10:44
*** pcaruana has quit IRC10:45
*** mrunge has quit IRC10:47
*** brault has joined #tripleo10:47
EmilienMd0ugal: I confirm RDO cloud is back and functional10:48
d0ugalEmilienM: Great. I am waiting for my reproducer script to do its thing10:49
*** dpawar has quit IRC10:49
EmilienMbogdando: did we go that far before?10:50
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart-extras master: Ensure gated packages are installed during upgrade.  https://review.openstack.org/54941410:50
*** sshnaidm has joined #tripleo10:51
*** chlong has joined #tripleo10:51
*** brault has quit IRC10:52
*** assassin has joined #tripleo10:54
*** mrunge has joined #tripleo10:54
*** jcoufal has joined #tripleo10:55
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: [DNM]: Apply workaround for P->Q upgrades.  https://review.openstack.org/54922010:56
*** jcoufal_ has quit IRC10:57
*** nyechiel has joined #tripleo10:57
gunixcan you use tripleo undercloud to PXE boot normal linux servers, instead of deploying an overcloud ?10:58
gunixhow does undercloud compare to a normal openstack ironic deploymnet ?10:58
*** rcernin has joined #tripleo11:02
*** brault has joined #tripleo11:03
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: Refactor some common code between overcloud_upgrade and update  https://review.openstack.org/55079911:03
*** ratailor has quit IRC11:04
openstackgerritDougal Matthews proposed openstack/tripleo-common master: Standardise the Workflow messaging and persist the last message  https://review.openstack.org/42506011:05
openstackgerritDougal Matthews proposed openstack/tripleo-common master: Refactor the Baremetal workflows to use the new messaging workflows  https://review.openstack.org/55246011:05
*** ratailor has joined #tripleo11:05
d0ugaljtomasek: Some small updates and a few ideas in YAML comments: https://review.openstack.org/#/c/425060/10..11/workbooks/messaging.yaml11:06
*** sshnaidm has quit IRC11:06
*** anilvenkata has quit IRC11:07
*** anilvenkata has joined #tripleo11:09
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403611:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]11:10
*** brault has quit IRC11:10
bogdandoEmilienM: hard to say. I cannot recall anything similar to that error. Or what was the question?.. Anyway, I'm gonna deploy ovb on rdo cloud with export ZUUL_CHANGES="openstack/tripleo-quickstart-extras:master:refs/changes/28/545628/20^openstack/tripleo-quickstart:master:refs/changes/56/542556/63^openstack/tripleo-heat-templates:master:refs/changes/40/551240/4"11:10
jaosoriorcould I get some reviews for this backport https://review.openstack.org/#/c/551433/ ?11:10
shardygunix: yes you can, you can pass a roles_data.yaml file without any services in it, but the tripleo heat templates do still do some configuration, e.g of network-interfaces11:11
gunixshardy: so if i just want to test ironic, i should just install it with openstack-ansible or something to learn it a bit11:11
shardygunix: which in practice means using an image with some of the tripleo agents, or using the tripleo overcloud-full image and accepting there are some things installed there you may not need11:12
gunixso i don't get the overhead from undercloud11:12
shardygunix: No you can deploy with ironic/nova directly via the undercloud too11:12
shardyand not use the heat layer at all11:12
shardygunix: the undercloud is a pretty easy way to bootstrap a working ironic env IME11:12
shardyobviously there are other tools but you can use the undercloud if you want11:12
*** nyechiel has quit IRC11:12
gunixshardy: the project requirement is tripleo but i want to get to learn a bit of ironic and heat before starting with undercloud11:14
shardygunix: ack, so yes you can interact with ironic directly on the undercloud, we don't really have much documentation around it though11:14
gunixyea :D11:15
gunixshardy: i have for example an undercloud. i shut it down, powered it back up and the br-ctlplane doesn't have an Ip now so nothing works :D11:15
gunixi have no idea how to troubleshoot that :D11:15
*** florianf has quit IRC11:15
shardygunix: I've never seen that before, perhaps you can raise a bug?11:16
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: [DNM]: Apply workaround for P->Q upgrades.  https://review.openstack.org/54922011:17
shardyI guess it could be related to your environment or network configuration11:17
gunixshardy: i am not sure i can reproduce and follow suggestions from the bug11:17
EmilienMbogdando: ok, I did recheck as I checked the commands and they use to run correctly on other jobs11:17
*** dhill_ has quit IRC11:19
EmilienMbogdando: https://review.openstack.org/#/c/552124/ can be reviewed11:19
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: mistral/api: include cron_trigger  https://review.openstack.org/55169611:21
*** sshnaidm has joined #tripleo11:21
*** adarazs is now known as adarazs_lunch11:22
openstackgerritMarios Andreou proposed openstack/python-tripleoclient master: Refactor some common code between overcloud_upgrade and update  https://review.openstack.org/55079911:23
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: New major upgrade workflow implementation.  https://review.openstack.org/55208211:26
*** bkopilov has quit IRC11:30
*** florianf has joined #tripleo11:30
EmilienMshardy: hey, I'm trying to backport the memcached CVE to newton but it fails in CI with http://logs.openstack.org/87/551387/2/check/tripleo-ci-centos-7-nonha-multinode-oooq/36ad816/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-03-13_10_39_3911:30
EmilienMshardy: it says that "conditions" isn't a valid template section but we already use that for other services like SNMP and it works11:31
*** shreshtha has quit IRC11:34
shardyEmilienM: ack sec looking11:35
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade stable/queens: [DNM]: Apply workaround for P->Q upgrades.  https://review.openstack.org/55208411:37
EmilienMshardy: the SNMP was bad example, I checked and for some reasons the firewall rules aren't created for this one on stable/newton CI11:37
shardyhttps://review.openstack.org/#/c/551387/2/puppet/services/memcached.yaml11:37
EmilienMif "conditions" isn't working on newotn, I'll just remove it11:37
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade stable/queens: [DNM]: Apply workaround for P->Q upgrades.  https://review.openstack.org/55208411:38
shardyEmilienM: I think the heat_template_version needs updating?11:38
EmilienMahhh11:38
EmilienMshardy: would "newton" take the latest?11:38
EmilienMor I can just use 2016-10-1411:38
shardyEmilienM: let me check when the aliases were introduced, you have a mitaka version in there specified by date11:38
EmilienMshardy: thanks!11:39
shardyEmilienM: yes newton or 2016-10-14 should work I think11:39
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/newton: [CVE-2018-1000115] memcached: restrict to TCP & internal_api network  https://review.openstack.org/55138711:39
*** udesale_ has joined #tripleo11:39
EmilienMok11:40
*** fzdarsky__ has quit IRC11:42
*** udesale has quit IRC11:42
*** dpawar has joined #tripleo11:43
*** udesale_ has quit IRC11:44
*** pkovar has joined #tripleo11:46
openstackgerritMartin Mágr proposed openstack/tripleo-common master: Add healthcheck script for Nova metadata  https://review.openstack.org/55044111:47
*** brault has joined #tripleo11:48
*** dpawar has quit IRC11:50
*** assassin has quit IRC11:51
*** kopecmartin has joined #tripleo11:51
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: [DNM]: Apply workaround for P->Q upgrades.  https://review.openstack.org/55208411:53
*** egallen has quit IRC11:53
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: DNM: Testing P->Q from queens branch.  https://review.openstack.org/55208011:54
*** vpickard_ is now known as vpickard11:57
*** assassin has joined #tripleo11:58
*** nyechiel has joined #tripleo11:59
*** rcernin has quit IRC12:00
*** ratailor has quit IRC12:00
*** pkovar has quit IRC12:00
*** noslzzp has joined #tripleo12:00
*** cdearborn has joined #tripleo12:01
*** pkovar has joined #tripleo12:02
*** colonwq has joined #tripleo12:04
*** liverpooler has joined #tripleo12:04
*** raildo has joined #tripleo12:04
bogdandoEmilienM: to sum up https://trello.com/c/xkyfUGST/34-identify-all-blockers-for-ovb-fs001#comment-5aa7be5781a51e4d27f24e5112:05
EmilienMbogdando: do we have that in CI as well?12:06
EmilienMI'm not sure12:06
bogdandoEmilienM: nope12:06
EmilienMhave you tried with a fresh environment?12:06
bogdandothat's a very early blocker, setup packages step12:06
EmilienMmhh12:07
bogdandoEmilienM: it is a fresh one, reproduce script always create a fresh one12:07
EmilienMok12:07
bogdandocreates*12:07
*** guits__ has joined #tripleo12:07
EmilienMI'll look after lunch if I can reproduce it12:08
*** amoralej is now known as amoralej|lunch12:09
bogdandoEmilienM: I'll update my repro script, this might help12:09
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403612:10
*** ooolpbot has quit IRC12:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]12:10
*** jpena is now known as jpena|lunch12:10
*** lucasagomes is now known as lucas-hungry12:10
*** athomas has quit IRC12:11
*** pkovar has quit IRC12:11
*** morazi has quit IRC12:11
*** trown|outtypewww is now known as trown|ruck12:11
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Add flag to enable SELinux in docker profile  https://review.openstack.org/55198512:12
*** salmankhan has quit IRC12:12
openstackgerritMartin Mágr proposed openstack/tripleo-common master: Add healthcheck script for ceilometer-agent-compute  https://review.openstack.org/55249612:13
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Prepare t-h-t for undercloud in a work dir  https://review.openstack.org/54287512:15
jankiHi, Can I please get reviews for https://review.openstack.org/#/c/531322/ and https://review.openstack.org/#/c/547961/12:15
openstackgerritMartin Mágr proposed openstack/tripleo-common master: [WIP] Activate another set of healthchecks  https://review.openstack.org/55050812:22
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates master: Enable ceilometer-agent-compute health check  https://review.openstack.org/55250112:22
*** janki has quit IRC12:25
*** salmankhan has joined #tripleo12:27
*** tzumainn has joined #tripleo12:27
*** myoung|afk is now known as myoung|rover12:28
*** atoth has joined #tripleo12:29
*** zoli|wfh is now known as zoli|lunch12:29
*** zoli|lunch is now known as zli12:29
*** zli is now known as zoli12:29
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Support SshKnownHostsDeployment with config-download  https://review.openstack.org/53931512:30
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Add spacing for readability  https://review.openstack.org/53938212:30
*** guits__ has quit IRC12:30
*** guits__ has joined #tripleo12:30
*** panda is now known as panda|lunch12:35
*** rlandy has joined #tripleo12:35
*** pchavva has joined #tripleo12:38
*** lblanchard has joined #tripleo12:38
*** oscar___ has joined #tripleo12:40
*** jcoufal_ has joined #tripleo12:40
*** skramaja has quit IRC12:41
*** jcoufal has quit IRC12:41
*** egallen has joined #tripleo12:43
*** pdeore has quit IRC12:43
openstackgerritMerged openstack/tripleo-heat-templates master: Added t-h-t for tempest container  https://review.openstack.org/54832512:43
openstackgerritMerged openstack/puppet-tripleo stable/queens: Pin puppet-systemd  https://review.openstack.org/55216512:43
openstackgerritMerged openstack/puppet-tripleo stable/ocata: Pin puppet-systemd  https://review.openstack.org/55216812:43
openstackgerritMerged openstack/puppet-tripleo stable/pike: Pin puppet-systemd  https://review.openstack.org/55216712:43
openstackgerritMerged openstack/tripleo-common master: Add file type check to upload-swift-artifacts  https://review.openstack.org/54441212:43
*** maufart__ has joined #tripleo12:46
*** dparkes has quit IRC12:46
*** adarazs_lunch is now known as adarazs12:47
*** aufi_ has quit IRC12:48
*** pdeore has joined #tripleo12:49
*** dprince has joined #tripleo12:49
EmilienMtripleo meeting starts in 10 min, feel free to add items to our agenda: https://etherpad.openstack.org/p/tripleo-meeting-items12:49
openstackgerritBrent Eagles proposed openstack/puppet-tripleo master: Adding wrapper scripts for neutron agent subprocesses  https://review.openstack.org/55022412:50
slagleEmilienM: your calendar has been infected with DST12:51
*** pkovar has joined #tripleo12:51
slaglethe meeting is now in 1h10m12:51
EmilienMslagle: I'm in Europe, we haven't switched yet12:51
EmilienMah ok12:51
EmilienMdamn12:51
slagleit's 1400UTC right?12:52
EmilienMyes12:52
EmilienMyou're right...12:52
*** ebarrera has quit IRC12:53
*** ebarrera has joined #tripleo12:54
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: Remove non used tripleo_root variable  https://review.openstack.org/55250712:55
*** udesale has joined #tripleo12:57
*** rbowen has left #tripleo12:58
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: firewall: don't reload IPtables after cleanup  https://review.openstack.org/55174713:00
*** morazi has joined #tripleo13:01
*** etingof|afk is now known as etingof13:01
*** jpena|lunch is now known as jpena13:02
*** mmethot has joined #tripleo13:03
EmilienMd0ugal: thanks, TIL13:05
EmilienM(you know why ;-))13:05
myoung|rover63523213:05
myoung|roverdoh13:06
*** psachin has quit IRC13:07
openstackgerritmathieu bultel proposed openstack/tripleo-common master: Remove the noop deploystep for upgrade converge step  https://review.openstack.org/55250913:07
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403613:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]13:10
*** lucas-hungry is now known as lucasagomes13:11
*** panda|lunch is now known as panda13:12
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Add EnablePuppet (defaults to true)  https://review.openstack.org/55019213:14
*** dhill_ has joined #tripleo13:15
jaosoriorEmilienM: the puppet-systemd got fixed by pinning in master, right?13:16
EmilienMd0ugal, thrash : I found the issue with cron/trigger not created13:16
jaosoriorEmilienM: seems we're hitting it in stable.queens too13:16
EmilienMjaosorior: yes and stables13:16
EmilienMjaosorior: it's in gate13:16
thrashEmilienM: what?13:16
jaosorioraah ok13:16
EmilienMd0ugal, thrash : yeah it's auth_url / auth_uri. I'll fix it. thanks for help anyway13:16
EmilienMjaosorior: it's merged. Rebase or recheck13:16
jaosoriorcool cool13:17
thrashEmilienM: ack. Was just bringing up an env to test. :D13:17
EmilienMthrash: you're sweet.13:17
*** jmelvin has joined #tripleo13:17
*** jaosorior has quit IRC13:19
*** jmelvin has quit IRC13:20
*** jmelvin has joined #tripleo13:24
*** Goneri has joined #tripleo13:25
*** jcoufal has joined #tripleo13:25
*** jcoufal_ has quit IRC13:28
d0ugalEmilienM: aha, thanks. Glad you got it sorted.13:31
EmilienMd0ugal: yeah.. thanks again for looking13:31
*** amoralej|lunch is now known as amoralej13:32
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: mistral/undercloud: align configuration with instack-undercloud  https://review.openstack.org/55170013:33
*** zoli is now known as zoli|wfh13:34
*** zoli|wfh is now known as zoli13:34
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: undercloud_post: manage post mistral config  https://review.openstack.org/55100913:35
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: ironic/undercloud: align configuration with instack-undercloud  https://review.openstack.org/55063813:42
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: ironic/undercloud: align configuration with instack-undercloud  https://review.openstack.org/55063813:42
*** bkopilov has joined #tripleo13:42
*** mcornea has joined #tripleo13:44
*** dtantsur is now known as dtantsur|brb13:45
*** myoung|rover is now known as myoung|rover|brb13:45
*** pgadiya has quit IRC13:45
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade master: oooq transformation, make sure to use the same deployed server file.  https://review.openstack.org/55084113:45
*** myoung|rover|brb is now known as myoung|rover13:49
*** ubijtsa has joined #tripleo13:50
EmilienMtripleo meeting starts in 10 min, feel free to add items to our agenda: https://etherpad.openstack.org/p/tripleo-meeting-items13:50
EmilienMslagle: is that good now? :)13:50
*** jmelvin_ has joined #tripleo13:51
*** jmelvin has quit IRC13:51
*** ubijtsa_ has joined #tripleo13:52
*** assassin has quit IRC13:53
trown|ruckEmilienM: we had it 50 min ago13:53
trown|ruckwhere where you?13:53
mwhahaha:o13:53
trown|ruckwere13:53
EmilienMlol13:53
EmilienMtrown|ruck: i've been online for 7 hours. Where were YOU?!13:54
*** assassin has joined #tripleo13:54
*** ubijtsa has quit IRC13:54
EmilienMmandre: why just +1 on https://review.openstack.org/#/c/515490/ ?13:55
trown|rucknot sure13:55
*** jaosorior has joined #tripleo13:55
*** athomas has joined #tripleo13:56
openstackgerritMarios Andreou proposed openstack/tripleo-common master: Wire up --skip-tags to the overcloud upgrade cli  https://review.openstack.org/55197713:57
*** ubijtsa_ has quit IRC13:57
*** pradk has joined #tripleo13:59
*** pdeore has quit IRC14:00
mwhahaha#startmeeting tripleo14:00
mwhahaha#topic agenda14:00
mwhahaha* Review past action items14:00
mwhahaha* One off agenda items14:00
mwhahaha* Squad status14:00
mwhahaha* Bugs & Blueprints14:00
mwhahaha* Projects releases or stable backports14:00
openstackMeeting started Tue Mar 13 14:00:17 2018 UTC and is due to finish in 60 minutes.  The chair is mwhahaha. Information about MeetBot at http://wiki.debian.org/MeetBot.14:00
mwhahaha* Specs14:00
mwhahaha* open discussion14:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.14:00
mwhahahaAnyone can use the #link, #action and #info commands, not just the moderatorǃ14:00
mwhahahaHi everyone! who is around today?14:00
*** openstack changes topic to " (Meeting topic: tripleo)"14:00
openstackThe meeting name has been set to 'tripleo'14:00
*** openstack changes topic to "agenda (Meeting topic: tripleo)"14:00
trown|rucko/14:00
shardyo/14:00
rascao/14:00
jpicho/14:00
myoung|rovero/14:00
ccamachoo/ hey14:00
EmilienMo/14:00
cdearborn\o14:01
fultonjo/14:01
dpeacocko/14:01
*** lblanchard has quit IRC14:01
weshayo/14:01
matbuo/14:01
chemo/14:01
jfrancoao/14:02
gfidenteo/14:02
mwhahahaok looks like we've got a decent number of people14:02
mwhahahalet's begin14:02
beagleso/14:02
mwhahaha#topic review past action items14:02
*** openstack changes topic to "review past action items (Meeting topic: tripleo)"14:02
mwhahahasshnaidm to raise ML post about reducing risk with quickstart and quickstart-extras patches14:02
bogdandoo/14:02
marioso/14:02
holser__\o14:02
mwhahahawould be nice to get that on the CI squad agenda maybe14:02
sshnaidmmwhahaha, let's cancel it for now14:03
mwhahahak14:03
pradko/14:03
mwhahahaEmilienM & mwhahaha to sync with ccamacho about patch missing from queens? - DONE was figured out last meeting as tripleoclient had been branched earlier than everything else. I believe the patches have been backported.14:03
EmilienMyes14:03
mwhahahaccamacho: are we missing anymore patches or have they all merged?14:03
ccamachomwhahaha I think most of them are +2 +A14:04
mwhahahak14:04
ccamachojust pending for merge14:04
mariosmwhahaha: i was doing that and there a re still a few to go as ccamacho said14:04
mariosmwhahaha: sec14:04
pandao/14:04
ccamachomarios jistr matbu, any other14:04
marioshttps://review.openstack.org/#/q/branch:stable/queens+topic:update/workflow-stable/queens mwhahaha here14:04
mariosmwhahaha: (also linked in upgrade squad status fyi)14:05
mwhahahamarios: cool thanks14:05
radekso/14:05
mwhahahaEmilienM to release stable tripleo this week - DONE14:05
mwhahahamwhahaha to send a note about blueprints & owners to the ML - DONE14:05
mwhahaha#link http://lists.openstack.org/pipermail/openstack-dev/2018-March/128217.html14:05
mwhahahaPlease note that there is a due date on blueprints14:05
mwhahahaApril 3, 201814:06
mwhahahaany blueprint not updated with an assignee and not approved will be moved out14:06
EmilienM++14:06
EmilienMsounds reasonable14:06
mwhahahathat's ~3 weeks before Rocky-114:06
mwhahahaso we should have a good idea  what we're working on14:06
mwhahahaEmilienM & and others to send ML posts about PTG14:07
mwhahahaSeen some notes about the sessions. Please make sure that if you have some notes that you send them to the ML.14:07
*** dparkes has joined #tripleo14:07
pandais the due date for policies too ?14:07
EmilienMpanda: no14:08
mwhahahapanda: not specs, just blueprints14:08
pandaok14:08
mwhahahapanda: no specific due date on policies14:08
mwhahahamoving on to the one off items which it appears we have some this week14:08
mwhahaha#topic one off agenda items14:08
mwhahaha#link https://etherpad.openstack.org/p/tripleo-meeting-items14:08
*** openstack changes topic to "one off agenda items (Meeting topic: tripleo)"14:08
mwhahaha(gfidente) can we enable Ceph testing in OVB? featureset001?14:09
EmilienMno14:09
EmilienMwe try to keep OVB jobs strictly minimum14:09
EmilienMso they are fast and test what we actually need14:09
mwhahahagfidente: what's the reasoning behind it?14:09
EmilienMceph is already well tested on scenario001 and scenario00414:09
mwhahahaEmilienM: i wouldn't call it well tested14:10
gfidenteEmilienM yeah but to answer mwhahaha's question14:10
EmilienMOVB is useful to test ironic/mistral/nova14:10
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403614:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]14:10
mwhahahait's tested, but not that well14:10
gfidenteEmilienM exactly, the access.yaml workflow, we only test the codepath which uses "deployed server" right now (multinode)14:10
EmilienMmwhahaha: well, it's not that bad14:10
EmilienMwe test autoscaling on scenario001 with ceph backend for gnocchi, it was a lot of work14:10
slaglegfidente: we do test that path on 001 with --config-download14:10
gfidenteEmilienM mwhahaha in OVB we could test the other part of the workflow enable_ssh_via_nova14:11
EmilienMand we test Ceph Radow GW on scenario004 to replace swift, and use it as image backend in glance, same thing, lot of work14:11
gfidenteslagle yeah what I am saying is that we test only that in scenarios14:11
weshaywhat is the gap you are trying to cover w/ ceph + ovb?14:11
gfidenteEmilienM mwhahaha slagle yes guys I am pretty happy about scenarios, I am just proposing OVB to extend coverage of access.yaml14:11
gfidentelet me find a link to the specific piece of code14:12
EmilienMyou could do like Juan and create another OVB jobs (new featureset) maybe14:12
gfidentehttps://github.com/openstack/tripleo-common/blob/master/workbooks/access.yaml#L89-L14414:12
EmilienMbut I'm not in favor of adding things on fs001/035. We've spent crazy time on reducing their runtime.14:12
EmilienMJuan created an OVB job for testing IPsec, and it's running only when some files are touched, iiuc14:13
mwhahahaso maybe a new ovb fs for ceph-anisble & access.yaml?14:13
openstackgerritJose Luis Franco proposed openstack-infra/tripleo-ci master: Add multinode-overcloud-update playbook to run list  https://review.openstack.org/54705814:13
slaglegfidente: tripleoclient calls enable-ssh-admin already, even with ovb14:13
mwhahahagfidente: would that work fo ryou?14:13
slaglegfidente: that uses access.yaml14:13
weshaygfidente, https://etherpad.openstack.org/p/quickstart-featuresets fyi14:14
slaglejust saying, that is already tested, what you're missing is ovb+ceph14:14
gfidenteslagle I know it does, but in access.yaml there are two codepaths for deployed server vs regular nodes https://github.com/openstack/tripleo-common/blob/master/workbooks/access.yaml#L3714:14
slaglegfidente: yes. and they're both already tested14:14
fultonjcreate_admin_via_nova vs create_admin_via_ssh14:14
jristo/14:14
gfidenteslagle oh wait let's go back to this after the meeting then14:14
openstackgerritMarios Andreou proposed openstack/python-tripleoclient master: Wire up a --skip-tags option for the overcloud upgrade run cli  https://review.openstack.org/55197614:14
openstackgerritMarios Andreou proposed openstack/python-tripleoclient master: Remove nargs="+" from --nodes and --roles expect "comma, string"  https://review.openstack.org/55252814:14
gfidenteif you say both are tested maybe this happens in another configuration and it's still good enough14:14
gfidentemaybe add as action item for next meeting?14:15
slaglegfidente: what you want is ceph+ovb+config-download, in a new fetureset14:15
gfidenteslagle oh I was thinking to use scenarios for config-download14:15
gfidentenot ovb14:16
slagleovb featureset001 already uses config-download14:16
EmilienMI think we'll switch scenarios to run config-download very soon, isn't?14:16
slaglewhich is why access.yaml is already covered for create_admin_via_nova14:16
gfidenteEmilienMyeah so again I am happy about that and scenarios coverage14:16
gfidentemy goal was extend coverage for the workflows in access.yaml14:17
*** gbarros has joined #tripleo14:17
* EmilienM has to disappear 2 min14:17
gfidenteslagle oh so you're saying _via_nova is called in featureset001 because it's OVB14:17
gfidente?14:18
gfidente(from queens, given the tripleoclient change)14:18
gfidente?14:18
slaglethis is what i'm saying14:18
gfidenteok not worth the effort of another featureset just to cover pike then14:18
gfidenteworks for me14:18
mwhahahaok sounds like we answered that one14:19
mwhahahathanks gfidente14:19
gfidentethank you! :D14:19
mwhahahaHA on two controllers, any plans to support that by TripleO ? (repeating question)14:19
mwhahahafrom unknown contributor14:19
radeksso yes this is from me14:19
radeksI keep seeing that question from customers14:19
mwhahahabandini, rasca, Ng: 2 node HA?14:19
radeksand I wonder if there are any plans to implement it14:20
*** dhill_ has quit IRC14:20
*** dhill__ has joined #tripleo14:20
radeksyes I know how it sounds, 2 node HA14:20
rascamwhahaha, there's no HA with 2 nodes14:20
mwhahahait's not weird, i've seen it done :D but usually active-passive14:20
radeksbut maybe some extra monitor on compute ?14:20
radeksrasca: I know14:20
radeks:)14:20
openstackgerritMerged openstack/instack-undercloud stable/newton: [CVE-2018-1000115] memcached: restrict to TCP & localhost  https://review.openstack.org/55139314:20
*** kirankt has joined #tripleo14:20
openstackgerritMerged openstack/instack-undercloud stable/ocata: [CVE-2018-1000115] memcached: restrict to TCP & localhost  https://review.openstack.org/55139014:20
mwhahaharadeks: so sounds like currently no plans14:21
radeksunderstood14:21
radeksthanks!14:21
mwhahaha(beagles) Neutron agent "side car containers" patches up for review - while the related bug (https://bugs.launchpad.net/tripleo/+bug/1749209) isn't marked as critical this is a pretty major issue. I want to amp up the visibility here in case others are affected (upgrades, other networking related projects, etc).14:21
openstackLaunchpad bug 1749209 in tripleo "Stopping neutron agent containers also brings down dataplane services" [High,In progress] - Assigned to Brent Eagles (beagles)14:21
rascamwhahaha, radeks, we've spent some time about that topic, and the outcomes of the discussion needs to be discussed more14:21
mwhahahahttps://review.openstack.org/549855 Add docker packages to dhcp and l3 agent containers - tripleo-common14:22
mwhahahahttps://review.openstack.org/550224 Adding wrapper scripts for neutron agent subprocesses - puppet-tripleo14:22
mwhahahahttps://review.openstack.org/550823 Generate and mount wrappers for dnsmasq and keepalived​ - tripleo-heat-templates​14:22
beaglesso for those that are interested, this is a case of an openstack component launching it's own containers14:22
radeksrasca: I am happy to discuss :)14:22
beaglesneutron needs to do this to maintain the dataplane14:22
beaglesit's weird so I'd like any interested/curious to have a look and provide comments14:22
radeksrasca: we could probably put Galera monitor and Pacmeaker agent on one of the computes14:22
rascaradeks, wow14:23
radeksrasca: with the composable roles this is possible14:23
radeksjust an idea14:23
rascaradeks, yes, but let's bring the popcorns then :D14:23
radeks:)14:23
beaglesbut seriously the related bug is a pretty big deal so any help with expertise and reviews is definitely welcome14:23
rascaradeks, there are a lot of things that a 2 node cluster implies14:24
openstackgerritHamdy Khader proposed openstack/tripleo-heat-templates master: Add environment file for Mellanox SDN  https://review.openstack.org/55050714:24
openstackgerritHamdy Khader proposed openstack/puppet-tripleo master: Enable networking-mlnx ml2 drivers  https://review.openstack.org/55050514:24
rascaradeks, starting for example on the fence aspect14:24
*** dtantsur|brb is now known as dtantsur14:24
mwhahahabeagles: ok is this something we'll need to backport to queens when it lands?14:24
* mwhahaha assumes yes14:24
radeksrasca: I am not going to argue, I know what are the problems14:24
beaglesmwhahaha, yup14:24
jistrbeagles: fyi as promised we're exploring the rolling pre-upgrade tasks here https://review.openstack.org/#/c/55207314:24
beaglesjistr, ack thanks!14:25
radeksrasca: but you probably see the same kind of question popping up from time to time14:25
* jistr testing it right now14:25
rascaradeks, sure. My point is: there are plenty of workaround you can use to have it, but then when it comes to production we need to be careful14:25
*** shreshtha has joined #tripleo14:25
mwhahahabeagles: what cleans up the containers that get launched?14:26
rascaradeks, so if we want to call it HA we need 3 nodes, otherwise it's a workaround HA solution. IMHO unsupportable (too many variables)14:26
radeksrasca: I know but if customers are willing to take a risk and there are customer who are willing to take it14:26
tbarronbeagles: very interested in this: so far this dynamic launch of containers for services is scoped only to controller nodes?14:26
beaglestbarron, at the moment14:26
rascaradeks, risk == no support?14:26
radeksrasca: yeahh it's a good question14:27
beaglesmwhahaha, ummm... crap that's a good point. Just because the container gets killed doesn't mean it goes away14:27
radeksdon't know14:27
*** shreshtha has quit IRC14:27
openstackgerritMatt Young proposed openstack/tripleo-quickstart-extras master: queens: Add failing barbican tempest test to skip list  https://review.openstack.org/55252914:27
beaglesmwhahaha, I'll see what can be done14:27
shardybeagles: we should ensure that any implementation is not tied to the controller role(s), composable roles and composable HA enable a lot of flexibility in that regard so it'd be good to maintain it14:27
*** shreshtha has joined #tripleo14:27
tbarronbeagles: for manila we're looking to scale out services (ganesha gateways, ceph mds daemons) per tenant rather than sharing them among all tenants14:27
tbarronbeagles: but that means scale *out* -- can't just pile them up on controllers14:28
mwhahahai don't necessarily think it's a good idea to have containers launching more containers14:28
beaglesshardy, right.. I don't think this will get in the way there but we can test it14:28
rascaradeks, I agree. The central discussion is about two questions. Does it works? It can. Should we support? I guess no.14:29
beaglestbarron, that's a bigger architectural type consideration - this is just getting the processes out of the agent's so things continue to function as expected14:29
jistrbeagles, shardy: fwiw the pre_upgrade_rolling_tasks part should support such composable approach. We should probably take the approach of "run these actions on whichever roles have L3 agent".14:29
beaglestbarron, when i see that I think "kubernetes?" :)14:29
tbarronbeagles: ack, and that's what we're thinking too14:29
shardyjistr: ack I think with per-service groups in tripleo-ansible-inventory we can already do that pretty easily?14:30
mariosjistr: we should get that with your https://review.openstack.org/#/c/552073/  and then add the tasks to the specific files14:30
mariosjistr: i mean for l3agent in this case14:30
jistrshardy: yes it's quite a small change as far as the upgrade framework is concerned. Depends how well will that fit on the Neutron side of things.14:30
jistrmarios: yea14:31
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud master: Enable TLS by default  https://review.openstack.org/55238214:31
mwhahahaany other thoughts on the neutron container fun? :D14:32
*** leanderthal has joined #tripleo14:32
mariosmwhahaha: link to etherpad with discussion on upgrade status14:32
mwhahaha#link https://etherpad.openstack.org/p/tripleo-upgrade-squad-status14:32
mwhahahathat one?14:32
marios    Last community call Mar 09 https://bugs.launchpad.net/neutron/+bug/1738768 Dataplane downtime when containers are stopped/restarted https://etherpad.openstack.org/p/tripleo-upgrade-squad-meeting14:33
openstackLaunchpad bug 1738768 in tripleo "Dataplane downtime when containers are stopped/restarted" [High,In progress] - Assigned to Brent Eagles (beagles)14:33
mariosmwhahaha: yeah14:33
jistr#link https://etherpad.openstack.org/p/tripleo-upgrade-squad-meeting14:33
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud master: Make user-provided cert take priority over autogenerated one  https://review.openstack.org/55238114:33
jistr(meeting vs. status)14:33
*** janki has joined #tripleo14:33
mariosjistr: ;)14:33
mwhahahaok anything else?14:34
dpeacockmwhahaha: Can we recheck yet?14:34
* mwhahaha is unsure14:34
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud master: Enable TLS by default  https://review.openstack.org/55238214:35
mwhahahadpeacock: i think so, will check after the meeting and let you know14:35
mwhahahalast item from the one offs14:35
mwhahaha(gcerami) Request for feedback http://lists.openstack.org/pipermail/openstack-dev/2018-March/128181.html  https://review.openstack.org/54800514:35
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Refactor RolesActions to use startWorkflow  https://review.openstack.org/55253214:35
pandayep, just wanted to draw attention to the devmode replacement proposal here http://lists.openstack.org/pipermail/openstack-dev/2018-March/128181.html  , since it's something most of the developers are asking, please understand if this would work for you.14:36
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Fix overcloud_nodes check failing branch FF  https://review.openstack.org/55136914:37
mwhahahapanda: thanks for raising this14:37
mwhahahaany questions on the devmode improvements?14:38
mwhahahasounds like nope, ok moving on14:39
pandafor any question or feedback there's the CI community meeting schedule right after this meeting14:39
pandaI'll be there, thanks.14:39
mwhahaha#topic Squad status14:39
mwhahahaci14:39
mwhahaha#link https://etherpad.openstack.org/p/tripleo-ci-squad-meeting14:39
mwhahahaupgrade14:39
mwhahaha#link https://etherpad.openstack.org/p/tripleo-upgrade-squad-status14:39
mwhahahacontainers14:39
mwhahaha#link https://etherpad.openstack.org/p/tripleo-containers-squad-status14:39
mwhahahaconfig-download14:39
mwhahaha#link https://etherpad.openstack.org/p/tripleo-config-download-squad-status14:39
*** openstack changes topic to "Squad status (Meeting topic: tripleo)"14:39
mwhahahaintegration14:39
mwhahaha#link https://etherpad.openstack.org/p/tripleo-integration-squad-status14:39
mwhahahaui/cli14:39
mwhahaha#link https://etherpad.openstack.org/p/tripleo-ui-cli-squad-status14:39
mwhahahavalidations14:39
mwhahaha#link https://etherpad.openstack.org/p/tripleo-validations-squad-status14:39
mwhahahanetworking14:39
mwhahaha#link https://etherpad.openstack.org/p/tripleo-networking-squad-status14:39
mwhahahaworkflows14:39
mwhahaha#link https://etherpad.openstack.org/p/tripleo-workflows-squad-status14:39
mwhahahathanks everyone for updating the status etherpads14:40
mwhahahalooks like there's some good info in there, please take a look14:41
mwhahaha#topic bugs & blueprints14:41
mwhahaha#link https://launchpad.net/tripleo/+milestone/rocky-114:41
mwhahahaFor Rocky we currently have 63 (+1) blueprints and about 605 (+19) open bugs.  601 rocky-1, 1 rocky-2, 3 rocky-3.14:41
*** openstack changes topic to "bugs & blueprints (Meeting topic: tripleo)"14:41
mwhahahaso we appear to continue to be adding more bugs. I know last week was a bit weird due to rdo cloud issues14:41
mwhahahaas a reminder about the blueprints from earlier, please see my note about making sure you've properly updated any blueprints you plan on landing14:42
mwhahahaWe've got 63 right now and we probably can't land them all14:42
mwhahahaI'll add in a placeholder for the s cycle since I don't think the name has been decided yet14:42
mwhahahaany bugs or blueprints that need attention?14:43
fultonjmwhahaha: i have two blueprints we can discuss now or after the meeting if you like14:43
mwhahahafultonj: now should be fine, what's up?14:43
fultonjhttps://blueprints.launchpad.net/tripleo/+spec/bluestore https://blueprints.launchpad.net/tripleo/+spec/osds-by-rule14:44
fultonjmwhahaha: i talked to EmilienM about them14:44
fultonji basically wanted to get them approved14:44
mwhahahafultonj: ok are they just some basic changes to expose support via ceph-ansible?14:45
fultonjthey're somewhat simple as it's a matter of enabling tripleo to use a ceph-ansible feature14:45
fultonjmwhahaha: yes14:45
fultonjbut those changes to expose that support would reference the blueprints and we'd know why14:45
fultonje.g. new tht params14:45
mwhahahafultonj: fair enough, i don't see any reason not to approve these14:45
mwhahahafultonj: i'll update them after the meeting14:45
fultonjmwhahaha: ok, thanks14:46
*** oscar___ has quit IRC14:46
mwhahahafultonj: speaking of ceph ansible have we moved it to an external task yet?14:46
fultonjmwhahaha: not yet14:46
fultonjthere's a review up that we're debugging14:46
* fultonj gets review14:46
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: New major upgrade workflow implementation.  https://review.openstack.org/54833614:47
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: [DNM]: Apply workaround for P->Q upgrades.  https://review.openstack.org/54922014:47
fultonjhttps://review.openstack.org/#/c/546966/14:47
mwhahahaok if i remember correctly that's an issue for switching to config-download by default14:47
mwhahahaplease let us know if you need any help14:47
fultonji think we're pretty close might be done in a week or two depending in interupts14:47
mwhahahasounds good14:47
fultonjmwhahaha: thanks we want to land it asap14:47
mwhahahacool moving on14:48
mwhahaha#topic projects releases or stable backports14:48
*** openstack changes topic to "projects releases or stable backports (Meeting topic: tripleo)"14:48
mwhahahaany backports people need eyes on?14:48
mwhahahawe just did a stable release last week so we're not due for one yet14:48
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade stable/queens: New major upgrade workflow implementation.  https://review.openstack.org/55208214:48
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade stable/queens: [DNM]: Apply workaround for P->Q upgrades.  https://review.openstack.org/55208414:48
openstackgerritBrent Eagles proposed openstack/puppet-tripleo master: Adding wrapper scripts for neutron agent subprocesses  https://review.openstack.org/55022414:48
fultonjhttps://review.openstack.org/#/c/552018/14:49
fultonjqueens backport ^14:49
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Configure firewall rules for Congress  https://review.openstack.org/55253514:49
* mwhahaha adds to the list14:49
mwhahahai'll take a look when the recheck comes back14:50
fultonjthanks14:50
mwhahahamoving on14:50
mwhahaha#topic specs14:50
mwhahaha#link https://review.openstack.org/#/q/project:openstack/tripleo-specs+status:open14:50
*** openstack changes topic to "specs (Meeting topic: tripleo)"14:50
mwhahahaprobably a similar thing to the blueprints, we need to review/land them14:50
mwhahahaplease take a look at the open ones when you have time14:51
mwhahahaanyone have any spec questions/issues?14:51
*** guits__ has quit IRC14:51
mwhahahasounds like nope14:52
mwhahaha#topic open discussion14:52
*** openstack changes topic to "open discussion (Meeting topic: tripleo)"14:52
mwhahahaany other business?14:52
Ngmwhahaha: radeks: </lag> (and apologies if someone answered in the mean time) - 2 node HA has some solutions, but it's likely >1yr away given our current roadmap14:52
arxcruzmwhahaha: we will have a tripleo community meeting today in 7 minutes14:53
mwhahahaNg thanks. sounds like radeks , rasca & company should chat about some options14:53
arxcruzhttps://bluejeans.com/707186672814:53
arxcruzfor whoever is interested14:53
* mwhahaha can make it today, yay daylight savings14:53
mwhahahaalright thanks everyone14:53
mwhahaha#endmeeting14:53
*** openstack changes topic to "Welcome to Rocky. CI status: Promotions - Yellow; check/gate - RDO CI jobs Green | http://tripleo.org/ | https://docs.openstack.org/tripleo-docs/latest/"14:53
openstackMeeting ended Tue Mar 13 14:53:59 2018 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)14:54
openstackMinutes:        http://eavesdrop.openstack.org/meetings/tripleo/2018/tripleo.2018-03-13-14.00.html14:54
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/tripleo/2018/tripleo.2018-03-13-14.00.txt14:54
openstackLog:            http://eavesdrop.openstack.org/meetings/tripleo/2018/tripleo.2018-03-13-14.00.log.html14:54
mwhahahadpeacock: topic says yea ci should be green, recheck should be ok14:54
dpeacockAwesome - thanks mwhahaha14:54
fultonjyay14:55
jristhonza: why is https://review.openstack.org/#/c/552532/ just partial-bug ?14:57
*** guits__ has joined #tripleo15:01
arxcruzALL: We are having our community meeting now at https://bluejeans.com/707186672815:04
arxcruzfeel free to join us15:04
honzajrist: because there are many patches needed to fulfill it; i'm working on converting the rest of the actions to use startWorkflow15:04
*** ykarel is now known as ykarel|afk15:04
jristhonza: ah cool thanks15:04
honzajrist: you can see the other patches in the related changes list15:04
shardyfultonj, gfidente: Hey, I just took another look at my local branch re splt-controlplane, and I realized some of the patches already landed15:05
shardyfultonj, gfidente: https://review.openstack.org/#/c/521928/ and https://review.openstack.org/#/c/521929/15:06
openstackgerritMarc Methot proposed openstack/tripleo-heat-templates master: Add nfs as a cinder backup driver option to CinderBackupBackend  https://review.openstack.org/55254215:06
shardythe next step was going to be reworking all-nodes-config to output the "all nodes" hieradata and vip details, such that they could span stacks15:06
shardybut I'm not certain that is needed or if just overriding EndpointMap will be enough for separate ceph clusters in each stack15:07
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: New major upgrade workflow implementation.  https://review.openstack.org/55208215:07
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Refactor LoggerActions to use startWorkflow  https://review.openstack.org/55254515:08
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: [DNM]: Apply workaround for P->Q upgrades.  https://review.openstack.org/55208415:08
fultonjshardy: so you think that we could POC using the already landed patches provided we override the endpoint map15:08
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: DNM: Testing P->Q from queens branch.  https://review.openstack.org/55208015:08
shardyfultonj: yes I think it may be enough to get started15:08
Tengumarios: heya! for information: I should be able to (hopefully) validate the pkie baremetal -> pike container migration by the end of the week. I have all the containers in satellite as well as all the packages - should be fine like that :).15:08
shardyfultonj: the way I did it was I had two roles_data files, one for controlplane and one for compute15:08
shardythen I did e.g openstack overcloud deploy --templates --stack controlplane -r roles_data_controlplane.yaml15:09
shardyand the same for compute15:09
shardyyou could do the same for ceph and figure out what data we're missing in each stack15:10
Tengushardy: hmmm, creating one stack per "role"? That's interesting.15:10
*** waleedm has quit IRC15:10
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403615:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]15:10
fultonjshardy: i see, so then we start updating the compute role to include ceph parameters15:10
shardyfultonj: note in the compute deploy I also had an environment file with the extra hosts entries and endpoint map overrides, per those commits (see commit message)15:10
shardyfultonj: yes, or you could start with a ceph-only roles data to simplify things15:10
shardyas I didn't get the split compute services fully working15:11
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Refactor LoggerActions to use startWorkflow  https://review.openstack.org/55254515:11
bogdandoEmilienM: https://trello.com/c/xkyfUGST/34-identify-all-blockers-for-ovb-fs001#comment-5aa7be5781a51e4d27f24e5115:11
shardyTengu: it's related to https://review.openstack.org/#/c/523459/ - we may want to enable multiple "Compute" stacks for scale, or potentially deploy different cells/az's as distinct stacks again for scale and simplifying lifecycle operations15:12
shardysimilar story for some of the storage components where there are benefits to keeping data local to each DC15:12
jaosoriorshardy: how does networking work in those type of deployments?15:13
*** hjensas has quit IRC15:13
Tengushardy: having already managed big AWS Cloudformation stack, I can only approve the split in smaller stacks :). that would help a lot15:13
shardyjaosorior: that's an open question - we'd at least need better validation to enable net-iso to be sanely configured15:13
Tenguthe monolitic "overcloud" stack frighten me as hell, as if we break it for some reason, all the related services might cramble.15:14
shardymy assumption is you'd need to carefuly design the network setup to enable some networks to be separate and some to be shared15:14
Tengushardy: what about a network-dedicated stack built with the others? i.e. taking info (outputs) from the compute, controller, ceph and other parts?15:15
shardyTengu: that is one possibility, but currently the network model isn't very decoupled from the nodes etc15:15
Tengu~> meaning "compute" stack, "controller" stack, "ceph" stack, "network" stack - note that "ceph" might be generic "storage"15:15
Tengushardy: true15:15
*** artom has joined #tripleo15:16
shardyTengu: in general heat works best when you group related things, e.g a bunch of ports for each node fit best into a nested stack per node15:16
*** mdnadeem has quit IRC15:16
shardythat said using statically configured networks/ports may be a requirement to make this work15:16
Tenguhmm ok.15:16
*** ykarel|afk is now known as ykarel15:16
shardyand/or careful validation of the pools assigned to each network15:16
shardyI suppose neutron gives us some of that validation when using it for ipam15:17
Tengu:) in two months I'll be probably able to help a bit more. 2 months and a day. That's pretty soon \o/15:17
shardyTengu: good news! :)15:17
jaosoriorshardy: we could split the network/subnet creation to its own stack; and then node creation would just create ports from the already existing networks (ports which would be rendered by jinja)15:17
fultonjshardy: thanks for the links, i'll have to add this to my list to try it out and ping you on the way with updates15:17
shardyjaosorior: yeah that's certainly something we could try15:18
shardyfultonj: ack, np - sorry it's not a complete solution but hopefully something to help you start prototyping15:18
fultonjshardy: it's definitely something to get started with15:18
fultonjlooks like fun15:18
fultonji'm probably going to try getting config-download to default first15:19
fultonjthanks shardy15:19
EmilienMmwhahaha: will do stable release next week15:21
openstackgerritMarc Methot proposed openstack/tripleo-heat-templates master: Add nfs as a cinder backup driver option to CinderBackupBackend  https://review.openstack.org/53577615:22
openstackgerritDmitry Tantsur proposed openstack/tripleo-common master: Fail enroll workflow early on invalid power credentials  https://review.openstack.org/55255415:26
*** wolverineav has joined #tripleo15:27
*** cshastri_ has joined #tripleo15:28
*** hjensas has joined #tripleo15:28
shardyfultonj: note that --config-download doesn't currently work with non-default stack/plan names (e.g --stack foo), I'm fixing that right now15:29
fultonjshardy: ok15:31
*** hjensas has quit IRC15:31
mariosack Tengu15:31
dtantsurd0ugal: hey! if you have a minute, do you have a quick idea what I am doing wrong with https://review.openstack.org/#/c/552554/ ?15:32
*** wolverineav has quit IRC15:32
dtantsurI cannot make this workflow fail properly...15:32
paramiteguys, did anybody hit the issue that ControllerAllNodesValidationDeployment fails with default gateway not pingable_15:33
d0ugaldtantsur: looking15:33
*** jaosorior has quit IRC15:34
mwhahahaEmilienM: do you want to do the final queens release thingy or shall I?15:34
mwhahahaEmilienM: see https://review.openstack.org/#/c/550678/15:34
EmilienMmwhahaha: I'm on it15:35
mwhahahak15:35
*** beagles is now known as beagles_food15:36
*** quiquell has quit IRC15:38
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Add pre_upgrade_rolling_tasks  https://review.openstack.org/55207315:39
d0ugaldtantsur: I have never tried break-on, but that looks correct (or how I imagined you'd use it)15:40
d0ugaldtantsur: give me a few mins, I'll try loading this into my env.15:42
*** wolverineav has joined #tripleo15:43
*** jcoufal_ has joined #tripleo15:44
*** itlinux has joined #tripleo15:45
*** yprokule has quit IRC15:45
*** quiquell has joined #tripleo15:45
dtantsurthanks!15:46
*** jcoufal has quit IRC15:46
*** yamahata_ has joined #tripleo15:47
*** pdeore has joined #tripleo15:47
*** hjensas has joined #tripleo15:48
*** hjensas has quit IRC15:48
*** hjensas has joined #tripleo15:48
*** moshele has quit IRC15:48
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/newton: WIP: Make deployed-server resource upward comptatible.  https://review.openstack.org/55256115:51
*** zshi has quit IRC15:53
mwhahahaanyone who thinks it would be cool to have a cat that plays fetch, let me tell you it's annoying15:53
dtantsurheh :)15:53
mwhahahaat least a dog gets tired15:54
mwhahahacat just decided to murder your leg because you aren't cooperating15:54
mmethotlol15:54
openstackgerritSteven Hardy proposed openstack/tripleo-common master: Pass plan_name into get_config action  https://review.openstack.org/55256315:55
*** links has quit IRC15:55
*** quiquell has quit IRC15:55
openstackgerritSteven Hardy proposed openstack/python-tripleoclient master: Pass plan/stack name into config_download workflow  https://review.openstack.org/55256415:57
*** ihrachys has joined #tripleo15:58
jpichcats++15:58
EmilienMlol15:59
*** jcoufal has joined #tripleo15:59
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: DNM: Testing newton deployed-server mechanism hack.  https://review.openstack.org/55256516:00
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: DNM: Testing FFU from queens branch.  https://review.openstack.org/55206416:01
*** jcoufal_ has quit IRC16:01
*** ffiore has quit IRC16:01
*** pblaho has quit IRC16:04
*** brault has quit IRC16:04
*** brault has joined #tripleo16:04
*** zshi has joined #tripleo16:05
*** moshele has joined #tripleo16:07
openstackgerritmathieu bultel proposed openstack/tripleo-common master: Remove the noop deploystep for upgrade converge step  https://review.openstack.org/55250916:07
*** links has joined #tripleo16:07
dtantsurd0ugal: essentially, wait_for_provision_state is quite broken :( it does not handle errors, and it does not fail on timeout16:08
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: Fail more gracefully when passed an empty ip  https://review.openstack.org/54678016:09
*** ykarel is now known as ykarel|afk16:09
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403616:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]16:10
*** jcoufal has quit IRC16:10
*** moshele has quit IRC16:11
*** jcoufal has joined #tripleo16:11
*** jcoufal has quit IRC16:12
*** cdearborn_ has joined #tripleo16:13
*** wolverineav has quit IRC16:13
*** maufart__ has quit IRC16:13
*** wolverineav has joined #tripleo16:13
openstackgerritChris Jones proposed openstack/tripleo-common master: Remove fence_action parameter from GenerateFencingParametersAction  https://review.openstack.org/55002816:14
*** beagles_food is now known as beagles16:16
d0ugaldtantsur: yeah, that is nasty :(16:17
d0ugaldtantsur: it seems to me like continue-on/break-on etc. are a bit weird.16:17
d0ugalMaybe guessing how they should work isn't enough16:17
*** wolverineav has quit IRC16:18
*** agopi has joined #tripleo16:19
*** kirankt has quit IRC16:20
*** dparkes has quit IRC16:21
*** udesale has quit IRC16:21
*** gbarros has quit IRC16:22
openstackgerritmathieu bultel proposed openstack/tripleo-common master: Remove the noop deploystep for upgrade converge step  https://review.openstack.org/55250916:25
shardyslagle: Hey when you get time I'm interested in your opinion re my comment on https://review.openstack.org/#/c/552563/16:25
shardybasically I'm wondering how we handle --timeout for the --config-download case16:25
*** assassin has quit IRC16:27
*** radeks has quit IRC16:27
*** cdearborn has quit IRC16:27
shardyd0ugal: can you specifiy a workflow execution timeout?16:28
shardyI don't see it in the openstack client options16:28
d0ugalshardy: you can timeout a task, not a full workflow execution16:29
*** ihrachys has quit IRC16:29
trozethey guys, has anyone else seen this issue in master deployments where NetworkDeployment gets stuck and never runs os-net-config on the nodes?16:30
shardyd0ugal: Ok, that presents a problem as the CLI timeout is for the entire workflow16:30
shardypreviously we'd have heat just handle the timeout, but now we wrap heat+ansible I'm trying to work out how to sanely handle the timeout provided by the user16:30
*** links has quit IRC16:30
EmilienMhjensas: hey, do you have plans to port _generate_masquerade_networks from instack-undercloud to tripleoclient or somewhere else ? (context: containerized undercloud)16:30
*** marios has quit IRC16:31
d0ugalshardy: Workflow A could be a single task with a timeout that calls Workflow B16:31
openstackgerritmathieu bultel proposed openstack/tripleo-common master: Remove the noop deploystep for upgrade converge step  https://review.openstack.org/55250916:31
shardyd0ugal: aha, we've gone from nesting stacks to nesting workflows :D16:31
shardybut yeah that could work16:31
shardythanks16:31
d0ugalshardy: haha, yeah :/16:31
d0ugalshardy: I have not tried the timeout feature, let me know how you get on with it.16:32
*** noslzzp has quit IRC16:33
*** gbarros has joined #tripleo16:35
trozetdsneddon: maybe you know the answer to my question ^^^^^^^^16:36
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Fix DeploymentInfo in DeploymentSuccess  https://review.openstack.org/55257416:37
*** leanderthal has quit IRC16:37
*** nyechiel has quit IRC16:38
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Add nova to appConfig immutable record  https://review.openstack.org/55257716:41
jtomasekmandre: ^16:41
jtomasekI am going to create launchpad bug for it also16:42
slagleshardy: can't we just set the timeout on the task, and then on-error will be triggered if it times out?16:44
*** fragatina has quit IRC16:44
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart master: Add chrooted to the common vars  https://review.openstack.org/55257916:45
dsneddontrozet, Do you know if /etc/os-net-config/config.json ever got written to the hosts?16:45
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Add nova to appConfig immutable record  https://review.openstack.org/55257716:45
trozetdsneddon: no it did not16:46
dsneddontrozet, There is a failure mode where NetworkDeployment gets stuck because there was an error parsing config.json.16:46
dsneddontrozet, OK, so we aren't hitting that, something is happening before.16:46
trozetdsneddon: yeah im not sure how to debug this16:46
*** myoung|rover is now known as myoung|rover|brb16:47
trozetdsneddon: i just did config download on the udnercloud to look at all the templates16:47
shardyslagle: yes we could, but it changes the meaning of timeout potentially16:47
shardyslagle: e.g if you pass --timeout 240, it can now potentially take way longer than that to actually time out16:47
dsneddontrozet, Are these templates you've used before? Or built-in network templates?16:47
shardyI guess passing it is better than nothing though16:48
*** trown|ruck is now known as trown|lunch16:48
trozetdsneddon: same ones we always pre-generate.  They worked about a month ago16:48
slagleshardy: was that ever properly handled? i thought we just passed the cli's timeout value to Heat16:48
trozetdsneddon: how do you go about debugging that heat stack for NetworkConfig or NetworkDeployment?16:48
shardyslagle: yes, but when heat did everything it was more or less correctly handled16:48
dsneddontrozet, Have a look and make sure you don't see anything about os-apply-config in the network templates. Instead, there should be a run-os-net-config.sh script.16:49
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Do not attempt install kernel when chrooted  https://review.openstack.org/55258416:49
shardywhereas now heat could take 239 minutes and ansible could take the same16:49
shardyand we still wouldn't time out16:49
shardybefore it was just the time to set up the plan I suppose16:49
shardynot a huge issue, just wanted to discuss it16:49
slagleand validations16:49
shardyugh oh yeah16:50
*** myoung|rover|brb is now known as myoung|rover16:50
slagleit would be easy to fix in the client anyway to pass a new timeout value to config_download_deploy with the right amount already deducted16:50
shardyOk I guess we just pass the timeout around and accept that in some cases it might be wildly more than the user specified16:50
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart master: Add chrooted to the common vars  https://review.openstack.org/55257916:51
dsneddontrozet, I usually debug when I get a CREATE_FAILED for a resource, and look at what specific error was generated.16:51
shardyslagle: yeah I was ideally looking for a workflow way to do it so the UI would also be fixed16:51
dsneddontrozet, It's a bit harder when something hangs and nothing has failed.16:51
shardybut either could work16:51
trozetdsneddon: well the stack was "cancelled" and says Failure, but the NetworkDeployment is still running16:51
openstackgerritRadoslaw Smigielski proposed openstack/instack-undercloud master: remove workaround for tuskar* packages  https://review.openstack.org/55260616:52
slagleshardy: don't really see a way. the abstraction is not sufficent around the workflow logic in the api16:52
shardyslagle: yeah, unless each workflow returned the elapsed time or something16:52
*** ihrachys has joined #tripleo16:52
openstackgerritJavier Peña proposed openstack-infra/tripleo-ci master: Replace call to map-project-name script with rdopkg  https://review.openstack.org/55261216:52
shardyto make it easier for each client16:52
openstackgerritRadoslaw Smigielski proposed openstack/instack-undercloud master: remove workaround for tuskar* packages  https://review.openstack.org/55260616:53
shardytrozet: did /etc/os-net-config/config.json get written?16:53
trozetshardy: no16:53
shardytrozet: did any metadata at all get collected by os-collect-config?16:54
openstackgerritwangqi proposed openstack/python-tripleoclient master: treat doc build warnings as errors  https://review.openstack.org/55261816:54
dsneddontrozet, "cancelled" sounds like a timeout was hit16:54
shardye.g can you reach the undercloud from the node?16:54
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Fix DeploymentInfo in DeploymentSuccess  https://review.openstack.org/55257416:54
trozetshardy, dsneddon: yeah i can ssh from the udnercloud into the overcloud nodes16:54
trozetshardy, dsneddon: if either of you have a minute this may be easier over a tmux16:54
*** gkadam has quit IRC16:54
*** pchavva has quit IRC16:55
shardytrozet: I'd ensure that metadata_url is set in the [request] section of /etc/os-collect-config.conf, then try curling it to ensure you can reach swift on the undercloud from the overcloud nodes16:56
shardythat's not quite the same as being able to ssh the other way16:56
trozetshardy: i see let me check16:56
shardytrozet: happy to help but about to start a meeting16:56
trozetshardy: i can reach it, it just says 401 unauthorized iwth temp url invalid16:57
*** wolverineav has joined #tripleo16:57
shardytrozet: just to confirm, you quoted the entire URL to avoid the "&" right?16:58
bnemecSon of a...delorean missed the fix for https://bugs.launchpad.net/tripleo/+bug/1754679 due to the cloud outage.16:59
openstackLaunchpad bug 1754679 in tripleo "Duplicate declaration: Keepalived::Instance[55]" [High,Fix released] - Assigned to waleed mousa (waleedm)16:59
bnemecAll that time rebuilding my environments wasted. :-(16:59
trozetshardy: nope :) let me try that.  I started os-collect-config16:59
*** shardy is now known as shardy_mtg16:59
trozetshardy_mtg: that works with quotes17:00
*** wolverineav has quit IRC17:00
*** wolverineav has joined #tripleo17:00
trozetdsneddon: so i see this now: https://paste.fedoraproject.org/paste/aEIPHrBpE6oav3qrfQFzJw/raw17:01
*** ffiore has joined #tripleo17:02
*** guits__ has quit IRC17:03
dsneddontrozet, Checking...17:03
*** myoung|rover is now known as myoung|food17:04
dsneddontrozet, Your NIC config templates are ancient. We deprecated the os-apply-config in Newton. There is a script in tripleo-validations that will convert to the script-based os-net-config scripts.17:05
dsneddontrozet, We removed the ability to use os-apply-config toward the end of Queens.17:05
trozetdsneddon: so how is os-net-config triggered now if os-apply-config isnt used?17:05
dsneddontrozet, Sorry, the script is in tripleo-heat-templates.17:05
dsneddontrozet, There is a script in THT/network/scripts/run-os-net-config.sh17:06
*** fragatina has joined #tripleo17:06
dsneddontrozet, If you run the script ./tools/yaml-nic-config-2-script.py on each of your NIC config templates, it will convert them to the new format.17:07
*** pchavva has joined #tripleo17:07
*** pchavva has quit IRC17:07
trozetdsneddon: hmm, ok i guess i need to do that and compare the difference17:07
dsneddontrozet, The difference is in the header, where group: os-apply-config gets replaced with group: script, and there is a value of the script name to run (scripts/run-os-net-config.sh)17:07
dsneddontrozet, And instead of get_input: bridge_name or get_input: dns_servers, we tokenize the strings "bridge_name" and "dns_servers" without making it a get_input.17:08
dsneddontrozet, Run that script, it will create a backup file, and you can run a diff.17:08
trozetdsneddon: great, will try it.  Thanks for your help17:09
*** d0ugal has quit IRC17:09
*** lucasagomes is now known as lucas-afk17:09
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403617:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]17:10
*** ooolpbot has quit IRC17:10
*** pchavva has joined #tripleo17:11
*** cshastri_ has quit IRC17:14
*** egallen has quit IRC17:14
*** sshnaidm has quit IRC17:16
*** jcoufal has joined #tripleo17:16
*** kopecmartin has quit IRC17:17
*** dtantsur is now known as dtantsur|afk17:18
openstackgerritGiulio Fidente proposed openstack/tripleo-common master: Force ANSIBLE_CALLBACK_WHITELIST to empty list for collect_nodes_uuid  https://review.openstack.org/55263617:18
*** jcoufal_ has joined #tripleo17:19
*** jcoufal has quit IRC17:22
fpandsneddon: could you review this when you get a chance, https://review.openstack.org/#/c/548006/17:22
*** jcoufal_ has quit IRC17:23
*** athomas has quit IRC17:25
EmilienMhjensas: I was about to port _generate_masquerade_networks but I'm not sure about your plans17:25
*** thrash is now known as thrash|17:25
*** thrash| is now known as thrash|biab17:25
EmilienMif you could help on this one17:25
openstackgerritMerged openstack/instack-undercloud stable/pike: [CVE-2018-1000115] memcached: restrict to TCP & localhost  https://review.openstack.org/55138917:26
dsneddonfpan, Will review shortly17:26
fpandsneddon: thanks17:26
*** ffiore_ has joined #tripleo17:27
*** ffiore has quit IRC17:27
*** panda is now known as panda|off17:28
*** jcoufal has joined #tripleo17:29
*** nyechiel has joined #tripleo17:34
dsneddonfpan, +1 workflow, thanks17:34
fpandsneddon: thanks for the review17:34
*** jcoufal_ has joined #tripleo17:37
*** jpena is now known as jpena|off17:38
openstackgerritChris Jones proposed openstack/python-tripleoclient master: Deprecate the action parameter for fencing generation.  https://review.openstack.org/55002917:39
*** noslzzp has joined #tripleo17:39
*** agopi has quit IRC17:39
*** jcoufal has quit IRC17:40
*** apetrich has joined #tripleo17:40
*** suuuper has quit IRC17:41
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Refactor PlansActions to use startWorkflow  https://review.openstack.org/55263817:41
openstackgerritGiulio Fidente proposed openstack/tripleo-common master: Force ANSIBLE_CALLBACK_WHITELIST to empty list for collect_nodes_uuid  https://review.openstack.org/55263617:42
*** ccamacho has quit IRC17:44
*** jfrancoa has quit IRC17:45
*** holser__ has quit IRC17:46
*** ykarel|afk has quit IRC17:47
*** jcoufal has joined #tripleo17:48
*** ebarrera has quit IRC17:49
jtomasekdtrainor, honza: Hi, where is the apache proxy defined for undercloud endpoints? (I mean which repo), we need to add nova there17:50
honzajtomasek: puppet-tripleo17:51
honzajtomasek: and puppet-tripleo is configured from instack-undercloud17:51
*** jcoufal_ has quit IRC17:51
honzajtomasek: i can do it if you want17:51
honza(not sure how urgent)17:51
jtomasekhonza: thanks, that would be great, add me as a reviewer please17:52
honzajtomasek: will do17:52
honzaflorianf: how do i run a validation group?17:53
jtomasekhonza: I am trying to fix it for mandre, do you know which file it is in in undercloud?17:53
dtrainorbeat me to it.  add me as well please if it's not too much trouble?17:54
*** bogdando has quit IRC17:54
honzajtomasek: somewhere in /etc/httpd/conf.d i think17:55
dtrainorjtomasek, https://github.com/openstack/instack-undercloud/blob/master/elements/puppet-stack-config/puppet-stack-config.yaml.template#L82317:55
*** jbadiapa_ has joined #tripleo17:55
*** sshnaidm has joined #tripleo17:56
*** thrash|biab is now known as thrash17:56
jtomasekhonza:  thanks /etc/httpd/conf.d/25-tripleo-ui.conf17:56
dtrainorjtomasek, here's an example of a previous commit https://review.openstack.org/#/c/470057/17:57
*** fragatina has quit IRC17:57
honzajtomasek: is there a bug for this?17:57
*** fragatina has joined #tripleo17:57
jtomasekhonza: not yet17:58
*** jbadiapa has quit IRC17:58
jtomasekhonza: so we need to update instack-undercloud, puppet-tripleo, how about tripleo-quickstart, maybe?17:58
honzajtomasek: yep17:58
honzajtomasek: this is fun, isn't it?17:58
dtrainorheh17:59
jtomasekhonza: :D17:59
honzajtomasek: dtrainor: i'll create the bug17:59
dtrainorcool17:59
*** myoung|food is now known as myoung18:00
honzahttps://bugs.launchpad.net/tripleo/+bug/175556018:00
openstackLaunchpad bug 1755560 in tripleo "Nova is missing in list of httpd proxy endpoints" [High,Triaged] - Assigned to Honza Pokorny (hpokorny)18:00
*** myoung is now known as myoung|rover18:00
jtomasekhonza: that leads me to thinking what would it take if we changed tripleo_ui_config.js to include 'endpoints' key rather than explicitly define individual endpoints in root of that file, would any other repos except for UI itself be affected?18:00
*** wolverineav has quit IRC18:01
*** derekh has quit IRC18:01
honzajtomasek: only puppet-tripleo, easy to do18:01
*** wolverineav has joined #tripleo18:01
jtomasekhonza: that would help us avoid bugs such as this: https://review.openstack.org/#/c/552577/18:02
mandrejtomasek, honza: this now works after I edited my /etc/httpd/conf.d/25-tripleo-ui.conf file18:02
jpichjtomasek: honza: FWIW I was working on the instack and puppet parts after seeing jtomasek's bug on nova config, attempting to update my dev env to test them now... Happy to leave you guys to it if you're on top of it / about to refactor it all though :P18:02
*** wolverineav has quit IRC18:02
*** wolverineav has joined #tripleo18:02
florianfhonza: though mistral (tripleo.validations.v1.run_groups)18:03
florianf*through18:03
openstackgerritHonza Pokorny proposed openstack/puppet-tripleo master: Add configuration for the Nova proxy endpoint  https://review.openstack.org/55264718:03
jpichwell then18:03
openstackgerritBob Fournier proposed openstack/tripleo-heat-templates master: Add check for old-style nic config files  https://review.openstack.org/55020118:03
honzajtomasek: dtrainor: ^^18:03
jtomasekjpich: ouch:)18:03
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: WIP DNR add cinder_listen_options  https://review.openstack.org/55264818:03
dtrainorawesome thanks18:03
honzadtrainor: do we need both proxy and config?18:04
jpichhonza: Doesn't it need to depend on the instack-undercloud change, or it does nothing?18:04
*** gbarros has quit IRC18:04
honzajpich: it defaults to undef, i believe18:04
dtrainoryes18:05
dtrainori posted an example of a previous change i made for ironic-inspector.  your new addition should basically follow the same flow18:06
honzadtrainor: ok18:06
honzaflorianf: sorry --- i mean in the gui itself18:07
honzaflorianf: with clicking :)18:07
*** jpich has quit IRC18:07
florianfhonza: clicking? you mean with a mouse?18:08
honzaflorianf: yes :)18:08
*** salmankhan has quit IRC18:08
honzaflorianf: how does it work? :D18:08
florianfhonza: It doesn't :-)18:08
jtomaseklol18:08
florianfhonza: you can filter by a validation group and then do the clicking18:08
florianfhonza: moar clicking!18:08
jtomasekhonza: what clicking does not work?18:09
honzaflorianf: after filtering and clicking, only one validation is run...?18:09
jtomasekhonza: clicking the tag?18:10
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403618:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]18:10
honzajtomasek: nope18:10
honzaflorianf: jtomasek: only on the screen after clicking to start the deployment maybe?18:10
openstackgerritHonza Pokorny proposed openstack/puppet-tripleo master: Add configuration for the Nova proxy endpoint  https://review.openstack.org/55264718:12
florianfhonza: you can filter the list by clicking on the tag. but you still have to start every validation by hand.18:14
honzaflorianf: ok --- but we have a function called runValidationGroup18:14
honzawhat's that for?18:14
*** jcoufal has quit IRC18:14
honzai'll hunt it down, sorry for the noise18:14
openstackgerritHonza Pokorny proposed openstack/instack-undercloud master: Add configuration for the Nova proxy endpoint  https://review.openstack.org/55264918:17
florianfhonza: to auto-run some groups from the UI. but that's not based on a user click, but implicit18:18
florianfhonza: like when the deployment start confirm dialog is opened18:18
florianfhonza: or when the nodes registration is done18:19
honzaflorianf: see?  no clicking after all18:19
*** yamahata_ has quit IRC18:19
honzaflorianf: thanks18:19
*** pchavva has quit IRC18:19
honzadtrainor: jpich suggested that instack-undercloud gets those values from oooq but i don't see those env vars anywhere --- do you know where they come from?18:20
dtrainori do not, no.  i don't know of any changes that were made to oooq to support additional apache proxy endpoints like this18:20
honzadtrainor: ok, np18:21
dtrainori know i don't have the whole picture but from what i understand, changes to oooq for the purposes of supporting this proxy may not be necessary, since the changes are included just in puppet-tripleo and instack-undercloud18:21
dtrainori mean, i can't see a connection there18:21
honzai'm just trying to understand where the template in instack-undercloud gets its values18:22
honzae.g. UNDERCLOUD_ENDPOINT_PROXY_NOVA18:22
dtrainorhttps://github.com/openstack/instack-undercloud/blob/master/elements/puppet-stack-config/puppet-stack-config.yaml.template#L82318:22
dtrainoris generated by......18:22
honza(the suspense)18:23
*** gvrangan has joined #tripleo18:23
dtrainorhttps://github.com/openstack/instack-undercloud/blob/master/instack_undercloud/undercloud.py#L90618:24
dtrainorman my brain hurts thinking back to all of this18:24
*** egallen has joined #tripleo18:25
*** jaosorior has joined #tripleo18:25
honzaah-ha!18:25
honzadtrainor: so yeah, you're right, we probably don't need anything else18:26
mwhahahahrm the queue seems to be quite backed up today18:28
mwhahahaweshay: who are the ruck/rover this week?18:28
mwhahahaah i see myoung|rover still is18:29
jtomasekhonza: does that also affect containerized undercloud as (IIUC) it should replace instack-undercloud?18:29
*** olivierbourdon38 has quit IRC18:29
mwhahahamyoung|rover: are we having a bunch of failures in the gate?18:29
*** olivierbourdon38 has joined #tripleo18:29
*** shardy_mtg has quit IRC18:29
*** egallen has quit IRC18:30
honzajtomasek: not sure, sorry18:30
openstackgerritMerged openstack/instack-undercloud master: [CVE-2018-1000115] memcached: restrict to TCP & localhost  https://review.openstack.org/55135318:30
myoung|rovermwhahaha, trown|lunch: checking, I've been nose down on bugs18:30
*** egallen has joined #tripleo18:30
*** shreshtha has quit IRC18:31
*** gvrangan has quit IRC18:33
*** gvrangan has joined #tripleo18:33
myoung|rovermwhahaha: there was an issue this morning with UC install, trown|lunch put up https://review.rdoproject.org/r/#/c/12876 to workaround.18:33
dsneddontrozet, I found the review (LP bug is linked) for automatically checking for the old-style NIC configs: https://review.openstack.org/#/c/550201/18:34
myoung|rovermwhahaha: details: https://review.rdoproject.org/etherpad/p/ruckrover-sprint10 L32-3618:34
trozetdsneddon: ty!18:34
dtrainorhonza, are you good for now?  i need to run out for a few minutes.18:35
honzadtrainor: yep18:35
dtrainorawesome. i'll follow up when i get back.18:35
*** dparkes has joined #tripleo18:35
*** wolverineav has quit IRC18:36
*** wolverineav has joined #tripleo18:37
*** florianf has quit IRC18:37
*** d0ugal has joined #tripleo18:39
*** wolverineav has quit IRC18:41
*** wolverineav has joined #tripleo18:45
*** trown|lunch is now known as trown|ruck18:46
openstackgerritAde Lee proposed openstack/tripleo-common master: Add workflow to set dns entries in FreeIPA  https://review.openstack.org/55266018:48
openstackgerritMerged openstack/tripleo-ui master: Add nova to appConfig immutable record  https://review.openstack.org/55257718:48
*** pkovar has quit IRC18:49
*** wolverineav has quit IRC18:50
*** wolverineav has joined #tripleo18:51
openstackgerritAde Lee proposed openstack/tripleo-heat-templates master: Add call to workflow to store DNS entries in IPA  https://review.openstack.org/55266218:52
*** yamahata_ has joined #tripleo18:53
*** wolverineav has quit IRC18:55
*** amoralej is now known as amoralej|off18:56
*** itlinux has quit IRC18:59
*** egallen has quit IRC18:59
*** gvrangan has quit IRC19:01
*** wolverineav has joined #tripleo19:01
weshaymwhahaha, trown|ruck and myoung|rover19:01
*** wolverineav has quit IRC19:01
*** wolverineav has joined #tripleo19:01
openstackgerritDougal Matthews proposed openstack/tripleo-common master: Standardise the Workflow messaging and persist the last message  https://review.openstack.org/42506019:02
openstackgerritDougal Matthews proposed openstack/tripleo-common master: Refactor the Baremetal workflows to use the new messaging workflows  https://review.openstack.org/55246019:02
myoung|roverweshay: o/19:02
*** d0ugal has quit IRC19:04
weshaymwhahaha, was asking..19:04
*** itlinux has joined #tripleo19:04
weshaymyoung|rover, did you discover where the code is for setting the mtu's on the overcloud nics and in neutron btw?19:04
myoung|roverweshay: I'm looking at yatin's comments here https://bugs.launchpad.net/tripleo/+bug/1754036 and links from #oooq, and attempting to sort this19:06
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]19:06
myoung|roverweshay: one thing I'm not super clear on is around MTU's in general.  if having them set incorrectly causes full stop failures, and if it's this obscure to ferret out what's wrong, isn't there an additional bug somewhere here?  how would a customer figure this out?  I don't just want to fix it in CI and leave a latent usability bug19:07
myoung|rover(I mean we obviously need to fix CI and unblock the promotion pipeline).  I also (to yatinkarel's point in LP) don't yet have an answer for the "why now" question19:08
myoung|rovere.g. what changed19:08
mwhahahawait is the assumption that the glance issue is mtu related?19:09
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403619:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]19:10
myoung|rovermwhahaha: that is the present supposition19:11
openstackgerritMerged openstack/python-tripleoclient master: undercloud: create EnableValidations  https://review.openstack.org/55100719:11
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Adding a workaround for enabling steering in ConnectX-3 devices  https://review.openstack.org/55073519:11
openstackgerritMerged openstack/os-net-config stable/queens: Adding the class and mac approach as dpdk-devargs in mellanox ConnectX-3  https://review.openstack.org/55073119:11
openstackgerritMerged openstack/instack-undercloud master: Don't double load config  https://review.openstack.org/54806119:11
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: kernel: make ExtraKernelModules and ExtraSysctlSettings role-specific  https://review.openstack.org/55097219:11
*** tesseract has quit IRC19:11
*** moshele has joined #tripleo19:11
mwhahahaare we faling on all versions or just master?19:11
trown|ruckjust master19:11
trown|ruckin that way anyways19:11
myoung|roverand just recently19:11
trown|ruckfor some definition of recently19:12
* myoung|rover nods19:12
mwhahahabecause i don't think we've changed any mtu related items recently so it would be weird if that was the thing19:12
mwhahahaof course, not shocking if it was19:12
myoung|roverI concur...hence "supposition" :)19:12
myoung|roverthat said, it looks like in CI the OC mtu is 1500 per yatin's comments in LP19:14
weshaymyoung|rover, go look at the ovb tasks and config please19:15
weshaymyoung|rover, http://codesearch.openstack.org/?q=mtu&i=nope&files=&repos=tripleo-quickstart-extras19:16
openstackgerritAndy Smith proposed openstack/tripleo-heat-templates master: Support separate oslo.messaging services for RPC and Notification  https://review.openstack.org/50796319:17
weshayhttp://git.openstack.org/cgit/openstack/tripleo-quickstart-extras/tree/roles/baremetal-prep-overcloud/templates/adjust-interface-mtus.sh.j219:19
rlandymyoung|rover: do you still have your reproducer env up?19:20
myoung|roverrlandy: yes19:21
rlandymyoung|rover: cam I access it?19:21
* myoung|rover attempts to keep up with the influx of links, he needs 5 minutes to do some reading :)19:21
myoung|roversure19:21
myoung|roverrlandy: adding your key19:21
*** pdeore has quit IRC19:23
rlandythanks - on the undercloud19:23
*** d0ugal has joined #tripleo19:26
*** d0ugal has quit IRC19:26
*** d0ugal has joined #tripleo19:26
*** gbarros has joined #tripleo19:26
myoung|roverditto19:26
myoung|roverthe compute does have MTU presently of 150019:26
*** ramishra has quit IRC19:30
myoung|roverrlandy: hrm...skipped? https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/a049ff7/ara_oooq/result/d92263e4-91b8-410b-bb37-6b61141b6f0c/19:31
*** ffiore_ has quit IRC19:31
myoung|roverrlandy:  ^^ https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/a049ff7/ara_oooq/file/506da6f8-660f-4d98-b2b0-ce56d783c9dd/#line-2219:31
rlandymyoung|rover: I have a master deploy on rdophase2 cloud19:31
rlandywith mtus one the overcloud set to 135019:32
rlandyI did that deploy about a week ago19:32
*** ramishra has joined #tripleo19:32
rlandyI see you reproducer has 1500 on all overcloud ports19:32
myoung|roverit looks like in this run the task that "- name: Set the MTU on overcloud nodes" is being skipped...cross ref'ing logs19:32
*** ffiore_ has joined #tripleo19:32
*** lblanchard has joined #tripleo19:33
*** egallen has joined #tripleo19:34
rlandy when: vxlan_networking|bool or toci_vxlan_networking|bool19:34
rlandywe're on ovb here19:35
*** zshi has quit IRC19:36
openstackgerritAndy Smith proposed openstack/puppet-tripleo master: WIP Support separate oslo.messaging services for RPC and Notifications  https://review.openstack.org/51068419:37
myoung|roverrlandy: ack19:37
*** ffiore has joined #tripleo19:38
*** ffiore_ has quit IRC19:38
trozetdsneddon: still around?19:42
*** moshele has quit IRC19:42
rlandymyoung|rover: https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/baremetal-prep-overcloud/templates/adjust-interface-mtus.sh.j219:42
rlandyEmilienM asked me a few days ago if that line was still needed19:42
rlandymyoung|rover: ^^ so perhaps he was aware of a change there19:45
*** egallen has quit IRC19:45
myoung|roverrlandy: I'm looking for step_adjust_mtu at the moment too on the UC :)19:45
rlandymyoung|rover: it ran19:45
myoung|roverit looks like it ran, but we don't capture output that I can see19:45
rlandyvi /etc/dnsmasq-ironic.conf19:46
rlandysee that edit there19:46
rlandymyoung|rover: our CI code around this has not changed19:47
* rlandy suspects product change in behaviour19:47
myoung|roverthat script is being run on UC, but doesn't it need to also be run on OC nodes as well?19:49
dtrainorhonza, how are you getting on with those proxy endpoints?19:50
myoung|rovere.g. /etc/sysconfig/network-scripts/ifcfg-eth0 has the results (MTU set to 1350) on UC, but OC nodes have the stock cloud-init created 1500 mtu's set19:50
*** zshi has joined #tripleo19:50
* myoung|rover digs some more19:50
dtrainorThe tripleo-validations project has a validation (undercloud-process-count.yaml) that checks for the number of process for each major Undercloud service[0].  The max_process_count is set to 8, and a warning is shown if any service runs more than this number of processes.  Do we have any recommended / sane / default number of processes for these services?19:54
dtrainor[0] https://github.com/openstack/tripleo-validations/blob/master/validations/undercloud-process-count.yaml#L2019:54
myoung|roverrlandy: ahhh... http://blog.johnlikesopenstack.com/2015/12/how-does-dnsmasq-assign-ips-of.html19:55
dsneddontrozet, I'm still here19:57
trozetdsneddon: so changed the nic templates, seeing some odd behavior19:57
trozetdsneddon: can i get some clarification on this: https://github.com/openstack/tripleo-heat-templates/blob/master/network/scripts/run-os-net-config.sh#L6619:58
trozetdsneddon: are you expecting ever network to have a dhcp server on the undercloud now?19:58
trozetevery*19:58
*** raildo has quit IRC19:58
dsneddontrozet, That should only take effect if os-net-config runs into errors, in which case the dhcp_all_interfaces.yaml will enable DHCP on all interfaces as a failsafe so you can log in and find out what caused the error20:01
trozetdsneddon: ok i see, yeah i hit an error i think its because i forgot that you metnioned a change in the ovs bridge20:01
dsneddontrozet, There should always be at least a DHCP server on the ctlplane network20:01
dsneddontrozet, The conversion script should have taken care of that, but you want to make sure you don't have any get_input: statements.20:01
trozetdsneddon: i do have them.  Yeah this isnt with the conversion, i changed Apex for how it generates the templates20:02
trozetand i think i forgot to change that20:02
*** moshele has joined #tripleo20:02
dsneddontrozet, Instead of feeding the bridge_name and dns_servers as Heat inputs, we now tokenize the strings "bridge_name" and "dns_servers" and replace those with the correct values.20:02
*** ffiore has quit IRC20:03
dsneddontrozet, So '{get_input: bridge_name}' it should just have 'bridge_name' and instead of '{get_input: dns_servers}' it should just have 'dns_servers'.20:04
trozetdsneddon: got it, now it works.  Thanks again20:04
*** ffiore has joined #tripleo20:04
*** radeks has joined #tripleo20:06
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403620:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]20:10
*** moshele has quit IRC20:12
EmilienMrlandy: hey what's up?20:16
*** leanderthal has joined #tripleo20:21
*** mcornea has quit IRC20:21
rlandyEmilienM: hey there ...20:21
rlandyEmilienM: you asked me a little while back if we still needed the mtu adjustment20:22
EmilienMahh20:23
rlandywhat was that about?20:23
rlandyafaict, the CI didn't change20:23
*** artom has quit IRC20:24
EmilienMrlandy: I'll try to find context again, it was probably related to the containerized undercloud20:24
rlandyEmilienM: we are debugging an issue where the mtus on the overcloud nodes in the latest master jobs are not adjusted below 150020:25
EmilienMrlandy: mhh, have we landed something lately about mtu? let me check20:26
rlandyEmilienM: not that I know of ... been looking through ironic changes20:26
EmilienMrlandy: https://review.openstack.org/#/c/546217/20:27
EmilienMhttps://review.openstack.org/#/c/546213/20:27
*** sanjayu has quit IRC20:27
rlandymyoung|rover: ^^20:27
EmilienMbut that's for the undercloud20:27
rlandyEmilienM: would this impact only master?20:27
EmilienMand it passed CI20:27
EmilienMyes only master20:27
rlandylocal mtu on the undercloud is set anyways20:28
EmilienMyeah20:28
rlandywe are concerned about the overcloud mtus20:28
EmilienMnothing changed on that regard AFIK20:28
*** dougbtv_ is now known as dougbtv20:28
rlandyEmilienM: thanks for checking20:31
rlandymyoung|rover: ^^ ok - so it's not that20:31
*** mcornea has joined #tripleo20:32
*** ffiore has quit IRC20:34
*** ffiore has joined #tripleo20:36
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: Add MasqueradeNetwork parameter until we get spine-leaf support  https://review.openstack.org/55268020:37
*** shadower has quit IRC20:37
*** shadower has joined #tripleo20:38
rlandystevebaker: hello20:40
stevebakerrlandy: hey20:40
myoung|roverstevebaker: o/20:41
stevebakermyoung|rover: hey20:41
rlandystevebaker: long time - how are you? I need your help on a master failure that used to be fixed by https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/baremetal-prep-overcloud/templates/adjust-interface-mtus.sh.j2#L21 -20:42
rlandythe mtus on the overcloud nodes are no longer being adjusted20:42
rlandyyou sent me that fix originally20:42
rlandyany idea if something has changed that would no longer respect that adjustment?20:43
stevebakerEmilienM, rlandy: wasn't there a switch recently from using nic configs from one repo to another recently? tripleo-ci to tht?20:43
stevebakerI may be thinking of something else20:44
rlandythat was a while back ...20:44
rlandyhttps://github.com/openstack/tripleo-heat-templates/tree/master/ci/environments/network20:45
*** waleedm has joined #tripleo20:45
rlandywe are using those templates rather than the ones in tripleo-ci - but we have been doing that some a couple months20:45
stevebakerrlandy: can you point me at a failing job to look at?20:45
*** d0ugal has quit IRC20:45
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: undercloud: add support for masquerade  https://review.openstack.org/55268220:45
rlandystevebaker: here are the logs: https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/a049ff7/ but myoung|rover has a reproducer env you can log in to20:46
myoung|roverstevebaker: we have a live repro set up in the failed state20:46
myoung|roverstevebaker: can you pls send me a pub key?20:46
rlandythat is how we know the mtus are not adjusted on the overcloud nodes any more20:47
rlandyqueens jobs do not show this problem20:47
myoung|roverstevebaker: current notes are here as well: https://bugs.launchpad.net/tripleo/+bug/175403620:47
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]20:47
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: undercloud: add support for masquerade  https://review.openstack.org/55268220:47
rlandystevebaker: https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/a049ff7/undercloud/var/log/extra/rpm-list.txt.gz will show the rpms installed on the undercloud20:48
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Run ovb-ha (fs001) with a containerized undercloud  https://review.openstack.org/54255620:50
*** dprince has quit IRC20:51
*** ffiore has quit IRC20:52
mwhahaharlandy: https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/a049ff7/undercloud/home/jenkins/undercloud_install.log.txt.gz#_2018-03-06_09_48_46 do we have an older one of those?20:54
*** pchavva has joined #tripleo20:54
rlandymwhahaha: getting20:55
mwhahahalooks like that's always been 150020:55
mwhahahahttps://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/8acdcdd/undercloud/home/jenkins/undercloud_install.log.txt.gz#_2017-12-30_14_25_5920:55
mwhahahafrom back in december20:55
mwhahahawonder if something is just now honoring it20:56
*** brault has quit IRC20:56
rlandymwhahaha: yep - https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/70df410/undercloud/home/jenkins/undercloud_install.log.txt.gz#_2018-03-06_04_47_1520:57
rlandy^^ was a passing job20:57
rlandywe should set the mtu adjustment in the undercloud.comf - if that is honored here20:57
rlandywe also adjust it afterwards20:57
honzadtrainor: both patches are up?20:57
honzadtrainor: i added you20:58
aleeslagle, ping20:59
dtrainoroops, didn't see the second one.20:59
openstackgerritmathieu bultel proposed openstack/tripleo-common master: Remove the noop deploystep for upgrade converge step  https://review.openstack.org/55250920:59
aleeslagle, saw your comment about external_deploy_tasks.  Makes sense to me to use that .  Would it make sense to call the ansible directly or to refer to a playbook?21:00
*** trown|ruck is now known as trown|outtypewww21:01
*** egallen has joined #tripleo21:01
slaglealee: that part is kind of up to you. we do have some standalone ansible roles in tripleo-common, but we won't be adding anymore21:04
slaglealee: going forward, we'll be creating a new git repo per ansible role21:04
slaglealee: given how minimal the tasks are in your playbook, you may consider just in-line'ing them in the service template directly21:05
aleeslagle, ack21:05
aleeslagle, and I can do this in overcloud.j2.yaml right?  It should take effect there?21:05
slaglealee: no. you'll need to add a new service template, and then include that service in the role21:06
aleeslagle, ok cool --I'll try that. thanks21:07
slaglealee: extraconfig/services/ipsec.yaml is an example21:07
slagleor anything under docker/services21:07
aleeslagle, yup - I was looking at that one21:07
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403621:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]21:10
weshaymwhahaha, anyone report any gate failures in the last few hours?21:12
weshaynoticing a longer than usual queue21:12
mwhahahaweshay: not that i'm aware of, i asked i think stuff was broken this morning21:12
mwhahahaweshay: that's why i was asking for the ruck/rover21:13
mwhahahaweshay: myoung pointed me to an issue with openstacksdk that's been fixed in packaging which i think is the cause of the long queue21:13
weshay539190.921:13
*** leanderthal has quit IRC21:13
weshayI see as failed in the gate21:13
weshayhttps://review.openstack.org/#/c/539190/921:14
weshaybut looks green now21:14
weshaybut is suspect21:14
weshaymyoung|rover, ^21:14
weshay3 rechecks21:14
weshayundercloud install error http://cistatus.tripleo.org:8000/21:15
mwhahahathat was yesterday21:15
mwhahahatoday is the 13th :D21:15
*** gfidente has quit IRC21:15
weshayhrm.. lol21:16
weshaybah21:16
weshayold data21:16
*** pchavva has quit IRC21:16
* weshay looks it up21:17
mwhahaharlandy: do we not capture vxlan_networking.sh.log in periodic jobs?21:17
*** d0ugal has joined #tripleo21:18
*** d0ugal has quit IRC21:18
*** d0ugal has joined #tripleo21:18
mwhahahaor is that only for the baremetal nodes21:19
weshayweird.. even in tripleo.org it shows as merged but failed all the jobs21:19
rlandymwhahaha: we use that with multinode jobs21:19
weshaymust have been the zuul reboot21:19
*** ledo_ has joined #tripleo21:19
*** radeks has quit IRC21:19
*** Goneri has quit IRC21:19
*** holser__ has joined #tripleo21:21
rlandymwhahaha: where would you expect that log to be where it is missing?21:21
mwhahaharlandy: no i was confused because it's setting MTU21:21
mwhahaharlandy: i'm not seeing anywhere else where we configure MTU for nodes, how are the ovb nodes launched?21:22
mwhahaharlandy: te-broker does that right? i'm wondering if they are getting launched with 1500 because i don't think we configure it anywhere in like the net config21:22
*** waleedm has quit IRC21:22
myoung|roverbtw actively debugging this with stevebaker now21:22
rlandymwhahaha: this is where we try adjust the mtu values: https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/baremetal-prep-overcloud/templates/adjust-interface-mtus.sh.j2#L2121:23
myoung|roversee https://bugs.launchpad.net/tripleo/+bug/1754036 comment 10 for where we're setting now21:23
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]21:23
rlandywe also set the mtu in the undercloud.conf21:23
myoung|roverfor UC is't via explicit command21:23
rlandythe undercloud mtus are set correctly21:24
myoung|roverfor OC it's via dnsmasq config file on UC, which (in theory) should force dnsmasq to give the MTU value to eth0 on OC nodes when it get's an IP from dhcp21:24
mwhahahabut the mtu on the ctrlplane network isn't right21:24
myoung|rover^^ that for some reason seems to be not happening21:24
rlandyit just the overcloud nodes are not21:24
rlandyeth0 is no longer adjusted21:24
rlandythat is our problem21:24
rlandyon the overcloud nodes21:24
myoung|roverbluejeans.com/matyoung if you wanna chat :)21:24
rlandyecho -e "\ndhcp-option-force=26,{{ mtu }}" >> /etc/dnsmasq-ironic.conf used to fix the problem21:24
weshayrlandy, what's the job log on that one?21:26
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade master: New major upgrade workflow implementation.  https://review.openstack.org/54833621:26
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade master: [DNM]: Apply workaround for P->Q upgrades.  https://review.openstack.org/54922021:26
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: New major upgrade workflow implementation.  https://review.openstack.org/55208221:29
slaglei noticed that dlrn seemed to be lagging quite a bit (probably due to rdo cloud outage), so that might explain some CI failures21:30
*** janki has quit IRC21:30
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: [DNM]: Apply workaround for P->Q upgrades.  https://review.openstack.org/55208421:30
slagletripleo-common with merges from sunday just got build this afternoon for instance21:30
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: DNM: Testing P->Q from queens branch.  https://review.openstack.org/55208021:31
*** pchavva has joined #tripleo21:34
*** pchavva has quit IRC21:34
*** d0ugal has quit IRC21:37
*** pchavva has joined #tripleo21:38
*** pchavva has quit IRC21:38
EmilienMslagle: thanks, good to know21:39
*** ledo_ has quit IRC21:42
*** waleedm has joined #tripleo21:42
*** morazi has quit IRC21:43
aleeslagle, if I create a new service as you described - is there a simple way for me to access the output HostsEntry in overcloud.j2.yaml ?21:44
*** ebarrera has joined #tripleo21:45
*** jmelvin_ has quit IRC21:46
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: WIP: Add Ceph upgrade steps for FFU  https://review.openstack.org/55211421:46
openstackgerritAlex Schultz proposed openstack/instack-undercloud master: Ensure mtu is set correctly on ctlplane  https://review.openstack.org/55269321:47
*** myoung|rover is now known as myoung|bbl21:50
*** myoung|bbl is now known as myoung|snow|bbl21:50
aleemwhahaha, in case you might know -- if I'm writing a service template file, how do I get access to one of the outputs of overcloud.j2.yaml ?21:52
mwhahahaalee: which one?21:52
aleemwhahaha, HostsEntry21:53
mwhahahaalee: what do you need it for?21:53
aleemwhahaha, I need it to extract and create dns entries in ipa21:54
mwhahahaalee: where is HostEntry i don't see it21:54
aleeHostsEntry21:54
aleewith an s21:54
mwhahahaoh there it is21:54
mwhahahawe pull that out in deployed-server/deployed-server.yaml, maybe you can just do that?21:55
mwhahahawow that's a hackish way of doing that21:55
mwhahahahttps://github.com/openstack/tripleo-heat-templates/blob/master/deployed-server/deployed-server.yaml#L98-L11821:56
mwhahahaalee: so you should be able to get the whole thing via get_param HostsEntry, does that not work?21:57
mwhahahaalee: there's probably a better way to get the hosts, might want to ask shardy tomorrow21:58
* mwhahaha has to bail21:58
aleemwhahaha, thanks21:58
aleemwhahaha, I was not sure that would work - but was going to try that21:58
*** rcernin has joined #tripleo21:59
weshaymwhahaha, we have one gate failure, I notified myoung|snow|bbl and trown|outtypewww22:00
weshayalee, pinged you on a barbican tempest failure in the cix board22:00
weshaybbiab22:00
aleeweshay, which one?22:02
*** noslzzp has quit IRC22:02
aleeweshay, ok - I see it -- will look later tonight22:03
aleeweshay, is the a failing job I can look at?22:04
*** nyechiel has quit IRC22:06
rlandymwhahaha: can you post a link to your public key so I can add it to the undercloud of the reproducer when it comes up?22:09
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403622:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]22:10
*** waleedm has quit IRC22:12
*** holser__ has quit IRC22:13
*** waleedm has joined #tripleo22:16
*** wolverineav has quit IRC22:18
*** wolverineav has joined #tripleo22:19
*** paramite has quit IRC22:25
*** pradk has quit IRC22:33
*** waleedm has quit IRC22:43
*** tosky has quit IRC22:47
*** liverpooler has quit IRC22:53
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: WIP DNR add cinder_listen_options  https://review.openstack.org/55264822:56
*** d0ugal has joined #tripleo23:03
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403623:10
*** ooolpbot has quit IRC23:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]23:10
*** cdearborn_ has quit IRC23:12
*** dmacpher has quit IRC23:15
*** artom has joined #tripleo23:20
*** wolverineav has quit IRC23:41
*** wolverineav has joined #tripleo23:42
*** rlandy is now known as rlandy|afk23:44

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!