Tuesday, 2018-10-30

openstackgerritRedHat RDO CI proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/56044500:00
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates master: GATE CHECK for TripleO  https://review.openstack.org/60429800:00
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates stable/rocky: GATE CHECK for TripleO  https://review.openstack.org/60429300:00
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Remove python3 legacy jobs  https://review.openstack.org/61404700:07
*** artom has joined #tripleo00:08
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819500:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179978600:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179989500:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)00:10
openstackLaunchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged] - Assigned to Rafael Folco (rafaelfolco)00:10
*** ansmith has joined #tripleo00:17
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Remove python3 legacy jobs  https://review.openstack.org/61404700:17
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Add ubuntu-systemd-container operating-system element  https://review.openstack.org/56374800:31
openstackgerritIan Wienand proposed openstack/diskimage-builder master: [wip] containers test  https://review.openstack.org/61405100:31
*** trozet has quit IRC00:36
*** dciabrin has quit IRC00:38
nhichermwhahaha, EmilienM: -master is broken https://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master-vexxhost00:47
*** huynq has joined #tripleo00:56
EmilienMnhicher: can you file a bug please?00:57
EmilienMI'm out now, ttyl00:57
*** phuongnh has joined #tripleo01:02
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819501:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179978601:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179989501:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)01:10
openstackLaunchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged] - Assigned to Rafael Folco (rafaelfolco)01:10
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: WIP / fs010: enable Podman on the overcloud  https://review.openstack.org/61252601:16
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: WIP / fs010: enable Podman on the overcloud  https://review.openstack.org/61252601:16
*** lblanchard has joined #tripleo01:23
*** bcafarel has quit IRC01:40
*** agopi is now known as agopi|brb01:57
*** bcafarel has joined #tripleo02:00
*** agopi|brb has quit IRC02:01
*** lblanchard has quit IRC02:07
*** eck` is now known as eck`gone02:09
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819502:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179978602:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179989502:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)02:10
openstackLaunchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged] - Assigned to Rafael Folco (rafaelfolco)02:10
*** eck`gone is now known as eck`02:11
*** agopi|brb has joined #tripleo02:42
*** ramishra has joined #tripleo02:50
*** ykarel|away has joined #tripleo02:55
*** ykarel|away is now known as ykarel02:56
*** mschuppert has quit IRC02:57
*** mrsoul has quit IRC02:57
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819503:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179978603:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179989503:10
*** ooolpbot has quit IRC03:10
openstackLaunchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)03:10
openstackLaunchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged] - Assigned to Rafael Folco (rafaelfolco)03:10
*** psachin has joined #tripleo03:11
*** eck` is now known as eck`gone03:16
openstackgerritTong Liu proposed openstack/tripleo-heat-templates master: Add more NSX config parameters  https://review.openstack.org/60485803:26
*** ramishra has quit IRC03:29
*** ramishra has joined #tripleo03:45
*** udesale has joined #tripleo03:49
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819504:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179978604:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179989504:10
*** ooolpbot has quit IRC04:10
openstackLaunchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)04:10
openstackLaunchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged] - Assigned to Rafael Folco (rafaelfolco)04:10
*** janki has joined #tripleo04:14
*** phuongnh has quit IRC04:22
*** trungnv has quit IRC04:22
*** huynq has quit IRC04:22
*** trungnv has joined #tripleo04:23
*** huynq has joined #tripleo04:23
*** phuongnh has joined #tripleo04:23
*** ccamacho has quit IRC04:26
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: Collect files in tripleo_root  https://review.openstack.org/61367804:27
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819505:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179978605:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179989505:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]05:10
openstackLaunchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)05:10
openstackLaunchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged] - Assigned to Rafael Folco (rafaelfolco)05:10
*** tzumainn has quit IRC05:16
*** d0ugal has joined #tripleo05:18
*** ykarel has quit IRC05:20
*** d0ugal has quit IRC05:30
*** jaosorior has quit IRC05:32
*** jaosorior has joined #tripleo05:32
*** pcaruana has joined #tripleo05:36
*** ykarel has joined #tripleo05:42
*** d0ugal has joined #tripleo05:44
*** pcaruana has quit IRC05:47
*** ratailor has joined #tripleo05:48
*** shyamb has joined #tripleo05:54
*** shyamb has quit IRC05:58
*** shyamb has joined #tripleo05:58
*** shyamb has quit IRC06:07
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819506:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179978606:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179989506:10
*** ooolpbot has quit IRC06:10
openstackLaunchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)06:10
openstackLaunchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged] - Assigned to Rafael Folco (rafaelfolco)06:10
*** jbadiapa has quit IRC06:10
*** ramishra has quit IRC06:16
*** mnaser has quit IRC06:16
*** hamzy_ has joined #tripleo06:17
*** mnaser has joined #tripleo06:17
*** hamzy has quit IRC06:18
*** ramishra has joined #tripleo06:18
*** phuongnh has quit IRC06:22
*** huynq has quit IRC06:22
*** trungnv has quit IRC06:22
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Add podman support to validate-tempest role  https://review.openstack.org/60535606:22
*** phuongnh has joined #tripleo06:23
*** shyamb has joined #tripleo06:28
*** jfrancoa has joined #tripleo06:31
*** shyamb has quit IRC06:32
*** shyamb has joined #tripleo06:32
*** quiquell|off is now known as quiquell06:34
*** saneax has joined #tripleo06:39
*** slaweq has quit IRC06:40
*** yprokule has joined #tripleo06:46
*** tonyb has quit IRC06:50
Tenguchandankumar: heya! you're on tempest right? care to check that issue? http://logs.openstack.org/01/611801/7/check/tripleo-ci-centos-7-containers-multinode/dc0258a/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-10-29_21_41_18  Not really sure it's related to my change :/06:51
jankiHi. Can I please get reviews for cherry-pick https://review.openstack.org/#/c/612243/. Thank you06:51
Tenguchandankumar: erf, wrong link, wait06:52
Tenguchandankumar: http://logs.openstack.org/56/605356/43/check/tripleo-ci-centos-7-undercloud-containers/8257d1c/logs/undercloud/home/zuul/tempest.log.txt.gz#_2018-10-29_20_30_13 is the right one :). sorry06:52
*** mschuppert has joined #tripleo06:52
chandankumarTengu: nope06:53
chandankumarTengu: I updated it in a new patchset06:53
chandankumarTengu: it will work for sure06:53
Tenguchandankumar: so the RCFILE should be set?06:53
chandankumarTengu: https://review.openstack.org/#/c/605356/06:54
chandankumarTengu:06:54
chandankumarTengu: check this and this https://review.openstack.org/#/c/605356/44/roles/validate-tempest/templates/configure-tempest.sh.j2@6706:55
chandankumarand https://review.openstack.org/#/c/605356/44/roles/validate-tempest/templates/run-tempest.sh.j2@5706:55
chandankumarin Earlier patchset, I removed that file06:56
Tenguok.. so I should depend-on your patchset?06:56
chandankumarTengu: yes sure06:56
Tengulet's go then.06:56
chandankumarTengu: feel free to play with my patch also :-)06:56
Tenguwell, I have plenty of things to play with ;). podman is a big topic :D06:57
*** ksambor has joined #tripleo06:57
*** ramishra_ has joined #tripleo06:59
openstackgerritCédric Jeanneret proposed openstack/tripleo-heat-templates master: Set setype for log and persistant data directories  https://review.openstack.org/61180106:59
Tenguchandankumar: -^^ added depends-on06:59
*** iurygregory has quit IRC07:00
*** ramishra has quit IRC07:01
*** d0ugal has quit IRC07:01
*** huynq has joined #tripleo07:02
*** jfrancoa has quit IRC07:05
*** jfrancoa has joined #tripleo07:06
*** shyamb has quit IRC07:10
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819507:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179978607:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179989507:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]07:10
openstackLaunchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)07:10
openstackLaunchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged] - Assigned to Rafael Folco (rafaelfolco)07:10
*** holser_ has joined #tripleo07:17
*** aufi has joined #tripleo07:18
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Add peer and switch nodes for fedora28  https://review.openstack.org/61409007:25
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: DNM: squash changes to test f28 standalone job  https://review.openstack.org/61329707:30
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: DNM: squash to test standalone-f28  https://review.openstack.org/61331607:32
*** ykarel is now known as ykarel|lunch07:35
*** jbadiapa has joined #tripleo07:36
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: DNM: squash changes to test f28 standalone job  https://review.openstack.org/61329707:36
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart master: DNM: squash to test standalone-f28 job  https://review.openstack.org/61331107:40
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: DNM: squash to test standalone-f28  https://review.openstack.org/61331607:40
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: DNM: squash changes to test f28 standalone job  https://review.openstack.org/61329707:40
*** shyamb has joined #tripleo07:45
*** shardy has joined #tripleo07:46
chandankumarmarios: sshnaidm|bbl please have a look on this https://review.openstack.org/#/c/606046/07:48
chandankumarall the dependent patches are merged now07:48
*** shyamb has quit IRC07:49
*** slaweq has joined #tripleo07:50
chandankumarmarios: sshnaidm|bbl and this also https://review.openstack.org/61355907:50
*** pcaruana has joined #tripleo07:57
*** paramite has quit IRC07:57
*** pcaruana is now known as pcaruana|elisa|07:59
*** holser_ has quit IRC08:00
*** holser_ has joined #tripleo08:01
*** hberaud has joined #tripleo08:02
*** ccamacho has joined #tripleo08:04
*** gkadam has joined #tripleo08:05
*** dciabrin has joined #tripleo08:06
*** kopecmartin|off is now known as kopecmartin08:08
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: Use dnf and python3 on platforms where these are default  https://review.openstack.org/61049108:08
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819508:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179978608:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179989508:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]08:10
openstackLaunchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)08:10
openstackLaunchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged] - Assigned to Rafael Folco (rafaelfolco)08:10
*** quiquell has quit IRC08:12
*** egonzalez has quit IRC08:15
*** iurygregory has joined #tripleo08:17
*** egonzalez has joined #tripleo08:17
openstackgerritThomas Herve proposed openstack/tripleo-common master: Don't resolve Heat stack output when unnecessary  https://review.openstack.org/61414108:21
openstackgerritThomas Herve proposed openstack/tripleo-common master: Don't resolve Heat stack output when unnecessary  https://review.openstack.org/61414108:23
*** jpich has joined #tripleo08:26
*** ykarel|lunch is now known as ykarel08:28
openstackgerritMartin André proposed openstack/tripleo-heat-templates stable/rocky: Parametrize OpenShift deployment type  https://review.openstack.org/61414408:32
*** paramite has joined #tripleo08:34
*** numans has joined #tripleo08:41
*** chem has joined #tripleo08:42
*** cylopez has joined #tripleo08:43
*** quiquell has joined #tripleo08:44
*** paramite has quit IRC08:45
*** shyamb has joined #tripleo08:48
*** d0ugal has joined #tripleo08:50
*** quiquell has quit IRC08:51
*** slaweq has quit IRC08:53
*** shardy_ has joined #tripleo08:54
*** jpena|off is now known as jpena08:57
*** ccamacho has quit IRC09:01
*** sshnaidm|bbl is now known as sshnaidm|off09:02
*** suuuper has joined #tripleo09:05
*** d0ugal has quit IRC09:05
*** bogdando has joined #tripleo09:05
*** akrivoka has joined #tripleo09:06
*** agurenko has joined #tripleo09:09
jaosoriorcan someone review this https://review.openstack.org/#/c/612307/ ? need it to fix tls everywhere09:09
*** etingof has quit IRC09:10
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819509:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179978609:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179989509:10
*** ooolpbot has quit IRC09:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]09:10
openstackLaunchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)09:10
openstackLaunchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged] - Assigned to Rafael Folco (rafaelfolco)09:10
*** dsneddon has quit IRC09:14
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: [WIP] Convert SelectRolesDialog to ModalPanel  https://review.openstack.org/61415109:14
*** quiquell has joined #tripleo09:16
*** aedc has joined #tripleo09:16
*** aufi has quit IRC09:17
jaosoriorbandini: could you review https://review.openstack.org/#/c/612307/ ? need it to fix tls everywhere09:19
openstackgerritJose Luis Franco proposed openstack/os-collect-config stable/queens: Don't ignore SIGPIPE  https://review.openstack.org/60947009:23
*** derekh has joined #tripleo09:25
quiquellmwhahaha, jaosorior: We need this to fix RDO jobs https://review.openstack.org/#/c/613920/09:27
*** dsneddon has joined #tripleo09:29
bogdandojistr: hi, may I have +2 https://review.openstack.org/#/c/613300/ ?09:31
Tenguhey, anyone can give a push to that review? https://review.rdoproject.org/r/#/c/17164/  thank you :)09:36
*** shyamb has quit IRC09:36
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Be explicit when passing vars into deploy steps  https://review.openstack.org/61330009:41
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Be explicit when passing vars into deploy steps  https://review.openstack.org/61330009:50
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Add option to install chrome when running tempest  https://review.openstack.org/60732309:51
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Added support for installing tempest plugins from git  https://review.openstack.org/61237709:51
*** jaganathan has joined #tripleo10:00
*** salmankhan has joined #tripleo10:01
openstackgerritBogdan Dobrelya proposed openstack/paunch master: Log to a file by default, unless debugging  https://review.openstack.org/61416610:07
*** slaweq has joined #tripleo10:09
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819510:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179978610:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179989510:10
*** ooolpbot has quit IRC10:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]10:10
openstackLaunchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)10:10
openstackLaunchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged] - Assigned to Rafael Folco (rafaelfolco)10:10
jaosoriorquiquell: sooome patches are passing some jobs in ovb, so I rechecked it10:10
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Fix paunch logs verbosity control  https://review.openstack.org/61294810:11
*** ccamacho has joined #tripleo10:11
openstackgerritQuique Llorente proposed openstack/python-tripleoclient master: Change 'wa' mode to 'w'  https://review.openstack.org/61416810:13
openstackgerritJiri Tomasek proposed openstack/tripleo-ui stable/rocky: Fix network lines rendering  https://review.openstack.org/61416910:13
quiquelljaosorior: cool thanks10:14
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: DNM: squash changes to test f28 standalone job  https://review.openstack.org/61329710:17
*** phuongnh has quit IRC10:22
*** pbandark has joined #tripleo10:22
*** amoralej|off is now known as amoralej10:24
pbandarkhi.. on undercloud node, i am trying to understand value of "$::os_service_default," which is defined in puppet manifest of lot of modules.10:24
pbandarkfor ex. [stack@undercloud cinder]$ egrep -i nfs_mount_options /usr/share/openstack-puppet/modules/cinder/manifests/backend/nfs.pp | tail -110:25
pbandark    "${name}/nfs_mount_options":           value => $nfs_mount_options;10:25
pbandark  $nfs_mount_options           = $::os_service_default,10:25
pbandarkbut i am unable to find the reference for "::os_service_default". can anyone help me to understand the value of "::os_service_default" ?10:26
*** dprince has joined #tripleo10:30
*** jtomasek has quit IRC10:30
*** naturalblue has joined #tripleo10:32
openstackgerritJuan Badia Payno proposed openstack/tripleo-heat-templates master: Fluentd deprecation releasenote  https://review.openstack.org/61137110:33
openstackgerritBogdan Dobrelya proposed openstack/tripleo-common master: Improve exp backoff for images pull/push/rpm-upd  https://review.openstack.org/57574210:34
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: Use dnf and python3 on platforms where these are default  https://review.openstack.org/61049110:35
openstackgerritJuan Badia Payno proposed openstack/tripleo-heat-templates master: Sensu Deprecation note  https://review.openstack.org/61417510:37
openstackgerritSam Betts proposed openstack/tripleo-heat-templates master: Remove incorrect mapped_data key from cisco ml2 hieradata  https://review.openstack.org/60039610:38
ykarelpbandark, afaik os_service_default is used to use the service default value, so the key value pair would be removed from config file,so service default is used10:40
pbandarkok. so its like magic variable :-)10:41
pbandarkthanks ykarel++10:41
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations stable/rocky: Use int builtin filter for testing purpose  https://review.openstack.org/61417910:43
openstackgerritSam Betts proposed openstack/tripleo-heat-templates master: Add helper resource for converting string to map  https://review.openstack.org/60071310:43
ykarelso looks like it's not removed from conf, but not changed itself, so using default value from service10:44
openstackgerritSam Betts proposed openstack/python-tripleoclient stable/rocky: Ensure that the --template-file option is passed to the kolla builder  https://review.openstack.org/61243710:44
ykarelpbandark, ^^10:45
ykareldon't know where the code which does this10:45
pbandarkok ykarel10:45
*** aufi has joined #tripleo10:45
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart master: wip: enable testing using ansible molecule  https://review.openstack.org/61367210:45
*** naturalblue has quit IRC10:45
*** roger2 has quit IRC10:45
openstackgerritDan Prince proposed openstack/tripleo-common master: Add tripleoclient container  https://review.openstack.org/61159810:50
*** agurenko has quit IRC10:57
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart master: Make quickstack.sh avoid needing sudo on missing virtualenv  https://review.openstack.org/61379710:58
*** iurygregory is now known as iury|lunch10:59
openstackgerritlvxianguo proposed openstack/tripleo-docs master: trivial: modify spelling error of common  https://review.openstack.org/61418511:01
*** ansmith has quit IRC11:03
*** shyamb has joined #tripleo11:03
*** jbadiapa has quit IRC11:04
openstackgerritSorin Sbarnea proposed openstack-infra/tripleo-ci master: Fix python3 detection logic  https://review.openstack.org/61392011:05
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: DNM: squash changes to test f28 standalone job  https://review.openstack.org/61329711:09
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819511:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179978611:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179989511:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)11:10
openstackLaunchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged] - Assigned to Rafael Folco (rafaelfolco)11:10
*** ratailor has quit IRC11:11
*** gkadam has quit IRC11:12
*** ramishra_ has quit IRC11:15
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: Use dnf and python3 on platforms where these are default  https://review.openstack.org/61049111:17
*** ramishra has joined #tripleo11:18
*** udesale has quit IRC11:24
*** janki has quit IRC11:25
*** salmankhan has quit IRC11:26
*** dciabrin has quit IRC11:27
*** cylopez has quit IRC11:33
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Fix python3 detection logic  https://review.openstack.org/61392011:33
quiquellchem: emit script stanadlon upgrade merged !! \o/11:35
chemquiquell: hehe, right, nearly time to celebrate :)11:35
quiquellchem: going to fix the stuff at tox so we merge the unit test stuff11:36
quiquellchem: now we can also activate the job11:37
chemquiquell: argh, it seems  https://review.openstack.org/#/c/604706/ needs fixing11:38
chemdoing right away11:38
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart master: Make quickstack.sh avoid needing sudo on missing virtualenv  https://review.openstack.org/61379711:38
*** morazi has joined #tripleo11:39
*** huynq has quit IRC11:45
*** bfournie has quit IRC11:45
openstackgerritAthlan-Guyot sofer proposed openstack-infra/tripleo-ci master: New workflow for standalone upgrade.  https://review.openstack.org/60470611:47
*** dtantsur|afk is now known as dtantsur11:50
beaglesmarios, chem: if you have a chance can you have another go at https://review.openstack.org/#/c/605200/11:52
*** dciabrin has joined #tripleo11:52
chembeagles: hey, on my todo list for today11:52
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Reduce unit testing changes required for emit_releases_file  https://review.openstack.org/61184211:52
beagleschem, thanks!11:52
quiquellchem: Need help there ?11:54
dciabrinjaosorior, hey o/ mind giving https://review.openstack.org/#/c/603612/ a push?11:54
*** amoralej is now known as amoralej|lunch11:56
*** jpena is now known as jpena|lunch11:57
chemquiquell: you mean on https://review.openstack.org/604706  ?  if so, no, just reviews.11:57
openstackgerritJose Luis Franco proposed openstack/tripleo-common master: Add general LOG in kolla_builder.py.  https://review.openstack.org/59934611:57
openstackgerritNatal Ngétal proposed openstack/tripleo-common stable/queens: [Queens only] Fix the default for docker registry.  https://review.openstack.org/61132911:58
*** jtomasek has joined #tripleo12:01
*** dtrainor has joined #tripleo12:01
*** salmankhan has joined #tripleo12:02
*** rh-jelabarre has joined #tripleo12:02
mariosack beagles added for next reviews (maybe tomorrow morning if not sooner)12:04
beaglesmarios cool thanks12:04
jaosoriorhjensas, shardy: We enable config-drive by default on the overcloud nodes, right?12:08
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819512:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179978612:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179989512:10
*** ooolpbot has quit IRC12:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]12:10
openstackLaunchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)12:10
openstackLaunchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged] - Assigned to Rafael Folco (rafaelfolco)12:10
EmilienMis tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates broken?12:12
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Export container_cli for update & upgrade tasks  https://review.openstack.org/61108912:13
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Allow the environment to enable Podman on the overcloud  https://review.openstack.org/61252212:13
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Support podman when tagging container for Pacemaker  https://review.openstack.org/60418012:13
*** abishop has joined #tripleo12:15
*** raildo has joined #tripleo12:16
openstackgerritEmilien Macchi proposed openstack/instack-undercloud master: Retire instack-undercloud  https://review.openstack.org/61362112:16
*** eck`gone is now known as eck`12:16
openstackgerritEmilien Macchi proposed openstack/instack master: Retire instack  https://review.openstack.org/61398012:16
*** agopi|brb is now known as agopi12:17
*** gfidente has joined #tripleo12:18
hjensasjaosorior: When we set up ironic it's enabled - https://github.com/openstack/tripleo-heat-templates/blob/1ad6b2bd893bc3ca15c395528fe76f46c1254a23/puppet/services/nova-ironic.yaml#L5712:19
fultonjDo we know which versions of ansible oooq is compatible with?12:19
jaosoriorhjensas: got it, thanks!12:19
hjensasjaosorior: so, yes. The undercloud enables it.12:19
jaosoriorI hadn't found that bit12:20
fultonje.g. oooq installs ansible 2.4.2.0 as a dependency, but if i upgrade it by minor point releases, does anyone know when it might break?12:21
jaosoriorhjensas: any idea how we configure DIB to ue config-drive? (when building the images)12:21
openstackgerritNatal Ngétal proposed openstack/tripleo-common stable/queens: [Queens only] Fix syntax error.  https://review.openstack.org/61420012:21
hjensasjaosorior: hm, not sure. I was'nt aware that DIB needed to add metadata to the image?12:23
jaosoriorhjensas: well, when we trigger the image, it fetches the config-drive by default. So... this has to be configured somewhere12:24
jaosoriorhjensas: or did I misunderstand something?12:25
hjensasjaosorior: the config drive is built when the instance is created. And Ironic will write partition sda1 = config-drive sda2 the glance image.12:26
jaosoriorhjensas: right, that part I got12:26
*** bfournie has joined #tripleo12:26
*** zul has quit IRC12:27
jaosoriorhjensas: however, when the instance starts, it executes whatever cloud-init configuration it got from config-drive (as far as I can tell)12:27
jaosoriorand I wanna know where that is configured12:27
hjensasjaosorior: yes, cloud-init will look for metadata in several places. the 169... service, a disk with the correct label, a cdrom etc.12:29
*** ykarel is now known as ykarel|afk12:29
hjensasjaosorior: If you wan't to control where cloud-init looks I guess changing the config for cloud-init when building the image?12:29
jaosoriorright12:29
*** janki has joined #tripleo12:31
*** aufi has quit IRC12:31
*** ade_lee has quit IRC12:32
*** trown|outtypewww is now known as trown12:33
*** rlandy has joined #tripleo12:35
*** hberaud has quit IRC12:37
openstackgerritHarald Jensås proposed openstack/tripleo-heat-templates master: Allow enabling routed networks on undercloud update|upgrade  https://review.openstack.org/60136912:39
openstackgerritHarald Jensås proposed openstack/tripleo-heat-templates master: Add ctlplane interface routes  https://review.openstack.org/60494312:39
openstackgerritHarald Jensås proposed openstack/tripleo-heat-templates master: L3 routed networks - data + env (1/3)  https://review.openstack.org/58218012:39
openstackgerritHarald Jensås proposed openstack/tripleo-heat-templates master: L3 routed networks - network.j2 (2/3)  https://review.openstack.org/58218112:39
openstackgerritHarald Jensås proposed openstack/tripleo-heat-templates master: Replace tripleo_common/utils/roles.py validate_role_yaml()  https://review.openstack.org/60847112:39
openstackgerritHarald Jensås proposed openstack/tripleo-heat-templates master: L3 routed networks - subnet fixed_ips (3/3)  https://review.openstack.org/58230112:39
openstackgerritHarald Jensås proposed openstack/tripleo-heat-templates master: Add a tag's containing subnet cidr to ctlplane network  https://review.openstack.org/61344212:39
openstackgerritHarald Jensås proposed openstack/tripleo-heat-templates master: Make NetCidrMapValue contain list of cidrs in each net  https://review.openstack.org/61345912:39
*** hberaud has joined #tripleo12:39
openstackgerritJose Luis Franco proposed openstack/tripleo-common master: Add general LOG in kolla_builder.py.  https://review.openstack.org/59934612:40
hjensasouch, that was fixing a typo in one of the commit messages.12:41
hjensasIf reviewers can start looking at that ^^ chaing of patches, starting with https://review.openstack.org/601369 it'd be good for CI resource utilization ...12:43
EmilienMchandankumar: podman job still failing 2018-10-30 08:08:48 | /var/lib/tempest/tempest_container.sh: line 81: unexpected EOF while looking for matching `''12:44
*** ykarel|afk has quit IRC12:44
EmilienMchandankumar: I'm reproducing it in my env and will help to debug this one12:45
*** tzumainn has joined #tripleo12:46
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Support podman when tagging container for Pacemaker  https://review.openstack.org/60418012:48
EmilienMbogdando: please review again, I addressed your comment ^ thanks12:48
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Rework neutron/own agent wrapper tools for podman  https://review.openstack.org/60697512:48
*** etingof has joined #tripleo12:48
EmilienMbogdando: on your puppet-tripleo patch / wrappers for podman, it fails unit tests: http://logs.openstack.org/95/606095/23/check/puppet-openstack-unit-4.8-centos-7/641b576/job-output.txt.gz#_2018-10-29_13_03_35_33286912:50
openstackgerritMarios Andreou proposed openstack-infra/tripleo-ci master: WIP: expose zuul variables for reproducer  https://review.openstack.org/61357112:52
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates stable/queens: [Queens only] Use rhel-registration tool in Rhsm to update repos before upgrade  https://review.openstack.org/61187912:55
openstackgerritBogdan Dobrelya proposed openstack/paunch master: Log to a file by default, unless debugging  https://review.openstack.org/61416612:55
chandankumarEmilienM: just one dit12:55
*** aufi has joined #tripleo12:57
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Add podman support to validate-tempest role  https://review.openstack.org/60535612:58
chandankumarEmilienM: ^^ here you go, earlier issue was single quotes vesses double quotes12:59
EmilienMbogdando: I got it no worries13:00
EmilienMbogdando: I'll update tests13:01
EmilienMchandankumar: ah!! thanks. I'll try locally again13:01
bogdandoEmilienM: thanks, but I'm already looking into that13:01
bogdandodon't bother, will fix that13:01
bogdandothanks13:01
EmilienMok13:01
EmilienMbogdando: /ip.netns.exec.*neutron-keepalived-state-change/13:01
EmilienMyou need to remove thatl ine13:01
bogdandoyeahj13:01
EmilienMkk13:01
*** shyamb has quit IRC13:01
chandankumarTengu: has a depends on patch that needs to be rechecked i think13:01
Tenguhmm ?13:02
Tenguah, yeah13:02
TenguEmilienM: my "overcloud" patch has a depends-on chandankumar patch.13:02
*** jbadiapa has joined #tripleo13:02
Tenguyet it still doesn't work as expected, but that's another story ;)13:02
openstackgerritBogdan Dobrelya proposed openstack/puppet-tripleo master: Fix wrapper containers for podman w/o sockets  https://review.openstack.org/60609513:03
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: DNM: Testing neutron/OVN rootwrap containers  https://review.openstack.org/60994713:04
*** ansmith has joined #tripleo13:05
*** ykarel has joined #tripleo13:05
*** udesale has joined #tripleo13:08
*** psachin has quit IRC13:09
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819513:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179978613:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179989513:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)13:10
openstackLaunchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged] - Assigned to Rafael Folco (rafaelfolco)13:10
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Add chrony time service  https://review.openstack.org/58811113:10
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Add chrony time service  https://review.openstack.org/58811113:10
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Switch to Chrony by default  https://review.openstack.org/61196913:11
*** jpena|lunch is now known as jpena13:12
*** jtomasek_ has joined #tripleo13:13
*** amoralej|lunch is now known as amoralej13:13
*** psachin has joined #tripleo13:16
*** jtomasek has quit IRC13:17
*** salmankhan has left #tripleo13:25
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: Use dnf and python3 on platforms where these are default  https://review.openstack.org/61049113:27
*** mcornea has joined #tripleo13:40
*** cylopez has joined #tripleo13:41
*** aufi has quit IRC13:42
*** cylopez has joined #tripleo13:42
weshayjaosorior, ssbarnea fyi.. noticing upstream gate failures due to networking related issues13:43
weshayhttps://review.rdoproject.org/etherpad/p/ruckrover-sprint21   <--- tracking and documenting here before taking action13:44
jaosoriorack13:44
* jaosorior reading13:44
jaosoriorweshay: ovb or openstack infra?13:44
weshayupstream13:45
jaosoriordo we know if it's a specific cloud?13:45
*** rbrady has joined #tripleo13:45
*** vinaykns has joined #tripleo13:45
weshayjaosorior, http://dashboard-ci.tripleo.org/d/cEEjGFFmz/cockpit?orgId=1&panelId=61&fullscreen13:45
weshayovh and limestone13:45
weshayhave the most errors atm13:46
openstackgerritMerged openstack/tripleo-heat-templates master: Force absolute path for CONFIG_VOLUME_PREFIX  https://review.openstack.org/59674413:47
openstackgerritMerged openstack/tripleo-heat-templates stable/rocky: Add OS::TripleO::Services::Rhsm to OpenShift roles  https://review.openstack.org/61231613:47
openstackgerritMerged openstack/tripleo-quickstart master: Fixed test_black_regex in FS020  https://review.openstack.org/61321413:47
openstackgerritMerged openstack/tripleo-heat-templates master: Add common vars to common plays  https://review.openstack.org/61330613:47
openstackgerritMerged openstack-infra/tripleo-ci master: Collect tripleo-container-image-prepare.log  https://review.openstack.org/61381113:47
openstackgerritMerged openstack/tripleo-upgrade stable/rocky: Function to apply workarounds  https://review.openstack.org/61351713:47
openstackgerritMerged openstack/tripleo-quickstart master: fs050: upgrade the undercloud to Podman containers  https://review.openstack.org/60846313:47
openstackgerritMerged openstack/tripleo-upgrade stable/rocky: Add ContainerImagePrepare to custom roles_data  https://review.openstack.org/61223913:47
weshayjaosorior, ^ that is a good sign13:48
EmilienMwoot13:48
EmilienMindeed13:49
*** jcoufal has joined #tripleo13:49
*** Vorrtex has joined #tripleo13:52
chandankumarweshay: EmilienM https://review.openstack.org/#/c/606046/13:53
*** jaganathan has quit IRC13:56
weshayEmilienM, mwhahaha does the run time on the standalone look good to you? https://review.openstack.org/#/c/606046/13:57
weshay2h 41min13:57
mwhahahawaaaa13:57
mwhahahano13:57
mwhahahawe don't want that in the gate13:57
* mwhahaha slaps EmilienM'13:57
weshaymwhahaha, what are the params you are looking for w/ regards to time13:57
mwhahahastandalone is supposed otbe fast, not 2:4113:58
mwhahahaif we want that in the promotion pipeline fine13:58
mwhahahabut not in check13:58
EmilienMdamn13:58
openstackgerritYurii Prokulevych proposed openstack/tripleo-upgrade stable/rocky: Fix variables for workaround variables.  https://review.openstack.org/61422013:58
EmilienMyeah right sorry I was confused13:58
*** Vorrtex has quit IRC13:59
mwhahahaso switch out fs20 with that13:59
weshayabducted by aliens13:59
weshaymwhahaha, you want fs20 to be standalone?14:00
* weshay thinks about that14:00
jaosorior#startmeeting tripleo14:00
openstackMeeting started Tue Oct 30 14:00:31 2018 UTC and is due to finish in 60 minutes.  The chair is jaosorior. Information about MeetBot at http://wiki.debian.org/MeetBot.14:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.14:00
*** openstack changes topic to " (Meeting topic: tripleo)"14:00
openstackThe meeting name has been set to 'tripleo'14:00
jaosorior#topic agenda14:00
*** openstack changes topic to "agenda (Meeting topic: tripleo)"14:00
jaosorior* Review past action items14:00
jaosorior* One off agenda items14:00
jaosorior* Squad status14:00
jaosorior* Bugs & Blueprints14:00
jaosorior* Projects releases or stable backports14:00
jaosorior* Specs14:00
jaosorior* open discussion14:00
jaosoriorAnyone can use the #link, #action and #info commands, not just the moderatorǃ14:00
jaosoriorHey folks! who's around?14:01
EmilienMo/ fellow humans14:01
jaosoriorIt's UTC 14:0014:01
owalsho/14:01
beagleso/14:01
jankio/14:01
dpeacockhey folks o/14:01
mwhahahahi2u14:01
ksamboro/14:01
weshay0/14:01
fultonjo/14:01
chandankumar\o/14:02
marioso/14:02
rlandyo/14:02
*** trozet has joined #tripleo14:03
jaosorior#topic review past action items14:04
*** openstack changes topic to "review past action items (Meeting topic: tripleo)"14:04
jaosoriorThere was one action:14:04
jaosorior    rlandy, weshay, dtantsur to look into switching to TCP for IMPI and possibly tuning retries - postponed until next time14:04
* dtantsur pings etingof14:04
weshayk14:04
dtantsurI know derekh looked into BMC problems14:05
dtantsurand essentially found out that the majority of them is networking problems inside the BMCs14:05
dtantsurif your DNS is not working well, switchign to TCP certainly won't help14:05
*** d0ugal has joined #tripleo14:06
rlandywe're running tests on real baremetal hardware to keep checking introspection14:06
jristo/14:06
pandaqo/14:06
dtantsurrlandy: did I miss something and the CI no longer tests introspection?14:06
*** Vorrtex has joined #tripleo14:06
rlandydtantsur: OVB still does14:07
dtantsurah, good14:07
rlandybut we're running these separate tests as well14:07
rlandyas a second check14:07
rlandywhen the OVB envs are having issues14:07
rlandydtantsur: if you'd like to check any changes on the bm envs, we can help there14:08
jaosoriorwell, ovb hasn't been passing for a while now :/ so, it's likely something could have gotten broken somewhere in that time14:09
weshayand noting an rdo outtage was sent on sunday night14:10
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819514:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179978614:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179989514:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)14:10
weshaythe cloud was up from late friday - sunday14:10
openstackLaunchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged] - Assigned to Rafael Folco (rafaelfolco)14:10
quiquello/14:11
*** social has quit IRC14:11
jaosorioranything else on this action? should we follow up with the results of the checks for next week's meeting?14:12
weshaynot much we can do w/ the current state of infra14:13
jaosoriorright :/14:13
jaosorior#topic one off agenda items14:13
*** openstack changes topic to "one off agenda items (Meeting topic: tripleo)"14:13
jaosorior#link https://etherpad.openstack.org/p/tripleo-meeting-items14:13
jaosoriorThere is nothing here, it seems. If folks wanted to bring something up we can discuss it in the open discussion section.14:14
jaosorior#topic Squad status14:14
*** openstack changes topic to "Squad status (Meeting topic: tripleo)"14:14
jaosoriorci14:14
jaosorior#link https://etherpad.openstack.org/p/tripleo-ci-squad-meeting14:14
jaosoriorupgrade14:14
jaosorior#link https://etherpad.openstack.org/p/tripleo-upgrade-squad-status14:14
jaosoriorcontainers14:14
jaosorior#link https://etherpad.openstack.org/p/tripleo-containers-squad-status14:14
jaosoriorintegration14:14
jaosorior#link https://etherpad.openstack.org/p/tripleo-integration-squad-status14:14
jaosoriorui/cli14:14
jaosorior#link https://etherpad.openstack.org/p/tripleo-ui-cli-squad-status14:14
jaosoriorvalidations14:14
jaosorior#link https://etherpad.openstack.org/p/tripleo-validations-squad-status14:14
jaosoriornetworking14:14
*** social has joined #tripleo14:14
jaosorior#link https://etherpad.openstack.org/p/tripleo-networking-squad-status14:14
jaosoriorworkflows14:14
jaosorior#link https://etherpad.openstack.org/p/tripleo-workflows-squad-status14:14
jaosoriorsecurity14:14
openstackgerritMerged openstack/tripleo-quickstart-extras master: Add /var/log/tripleo-container-image-prepare.log  https://review.openstack.org/61381214:14
openstackgerritMerged openstack/tripleo-quickstart master: fs010: switch undercloud to podman  https://review.openstack.org/61159714:14
jaosorior#link https://etherpad.openstack.org/p/tripleo-security-squad14:14
openstackgerritMerged openstack/tripleo-upgrade master: Pass stack name during minor update.  https://review.openstack.org/61393514:14
jaosorioredge14:14
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: Always lowercase role name  https://review.openstack.org/59858814:14
openstackgerritMerged openstack/os-net-config stable/rocky: Retry ovs-appctl command  https://review.openstack.org/61246014:14
jaosorior#link https://etherpad.openstack.org/p/tripleo-edge-squad-status14:14
jaosoriorAnything the squads want to bring up to the general meeting?14:14
weshayjust fyi.. couple upstream providers have some networking hiccups tracking gate failures here https://review.rdoproject.org/etherpad/p/ruckrover-sprint2114:15
weshayatm.. mostly ovh and limestone14:15
EmilienMsshnaidm|off: where do we collect this file?14:16
EmilienMhttps://review.openstack.org/#/c/613812/14:16
EmilienMjaosorior: some etherpads are missing updates for a while14:16
EmilienMI'm wondering if that means we need to update the squads again?14:16
jaosoriorThat's a good point. I'll check up on the squads and ask if they're active. Maybe we do need updates.14:17
jaosorior#action jaosorior to poke the squads and check status. Based on this we might need to update the list of active squads.14:17
d0ugalThe workflow squad is no longer active14:18
jaosoriord0ugal: alright, I'll remove it from the list14:18
EmilienMthe container squad either, I mean we still have good efforts on podman but not sure we need a squad at this point14:18
d0ugaljaosorior: Thanks.14:18
EmilienMbogdando, Tengu, dprince, myself, stevebaker, beagles are the main contributors on container stuff now I guess14:19
jaosoriorEmilienM: well, the work you folks are doing is kinda of a squad, except you don't update that etherpad.14:19
EmilienMlol14:19
EmilienMgood point14:19
*** aufi has joined #tripleo14:19
EmilienMhowever we update our trello board: https://trello.com/b/S8TmOU0u/tripleo-podman14:19
jaosoriorEmilienM: you had a public trello, no?14:19
jaosoriorEmilienM: maybe we'll just remove that etherpad and add the trello link14:19
bogdando+114:19
EmilienMjaosorior: +114:20
Tenguthe trello should be OK14:20
*** itlinux has quit IRC14:20
openstackgerritAlex Schultz proposed openstack/tripleo-common stable/queens: Make ODL healthcheck IPv6 compatible  https://review.openstack.org/61224314:20
Tenguoh. damn. meeting's already now? thanks saving time X(14:20
openstackgerritMerged openstack/puppet-tripleo master: Update functions to fix unit tests  https://review.openstack.org/61317314:20
openstackgerritYurii Prokulevych proposed openstack/tripleo-upgrade stable/rocky: Pass stack name during minor update.  https://review.openstack.org/61395814:20
openstackgerritMerged openstack/puppet-tripleo master: Update parser functions to 4.x api  https://review.openstack.org/61341114:20
openstackgerritMerged openstack/tripleo-upgrade master: Add containers-prepare parameter to upgrade scripts.  https://review.openstack.org/61391614:20
jaosoriorTengu: haha yeah14:20
*** gkadam has joined #tripleo14:21
openstackgerritNatal Ngétal proposed openstack/tripleo-common master: [Core] Fix the KeyError exception.  https://review.openstack.org/61422514:22
Tenguregarding podman work :   Overcloud configuration completed.   <- 1 controller + 1 compute with podman, on podman undercloud14:22
Tengu\o/14:22
TenguWITH selinux enforcing + separation14:22
jaosoriornice!14:23
jaosorior#topic bugs & blueprints14:23
*** openstack changes topic to "bugs & blueprints (Meeting topic: tripleo)"14:23
jaosorior#link https://launchpad.net/tripleo/+milestone/stein-114:23
jaosoriorFor Stein we currently have 28 (for stein-1) and 4 (for stein-2) blueprints open in Launchpad.14:23
jaosoriorBugs: 761 stein-1, 8 stein2.  103 (0) open Storyboard bugs.14:23
openstackbug 762 in libdc1394 (Ubuntu) "duplicate for #761 FTBFS: xorg include header issues" [Medium,Invalid] https://launchpad.net/bugs/762 - Assigned to MOTU (motu)14:23
jaosorior#link https://storyboard.openstack.org/#!/project_group/7614:23
EmilienMjaosorior: did you move blueprints to m2?14:25
etingofpong dtantsur -- I've proposed a patch to speed up sushy up to the ipmi emulator speed -- https://review.openstack.org/#/c/612758/14:25
EmilienM(and bugs)14:25
dtantsuretingof: right, will put on my list14:26
jaosoriorEmilienM: I haven't yet. I'll try today14:26
EmilienMmwhahaha has a nice script to move bugsd14:26
EmilienMbut blueprints are moved by hand usually14:26
jaosoriorhe did pass it to me, just a matter of using it14:26
EmilienMjaosorior: you need to get people doing it themselves for blueprints14:26
etingofit seems to work in OVB though I figured that sushy should better work with VM names (like baremetal_0) as opposed to UUIDs14:26
etingofso I am working on that ^14:27
jaosoriorEmilienM: oh, gotta start poking folks then.14:27
jaosoriorthanks14:27
jaosorior#topic projects releases or stable backports14:27
*** openstack changes topic to "projects releases or stable backports (Meeting topic: tripleo)"14:27
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: Use dnf and python3 on platforms where these are default  https://review.openstack.org/61049114:28
jaosoriorRight, so milestone 2 was last week. Tried putting out a release, but am still having issues with zuul: https://review.openstack.org/#/c/613020/14:28
*** d0ugal has quit IRC14:28
jaosoriorI'll get that sorted out though14:28
holser_o/14:29
jaosorior#topic specs14:31
*** openstack changes topic to "specs (Meeting topic: tripleo)"14:31
jaosorior#link https://review.openstack.org/#/q/project:openstack/tripleo-specs+status:open14:31
EmilienMmilestone 2? no milestone 1 :D14:31
jaosorioruuh... milestone 1, yes14:31
EmilienMdon't scare us plz14:31
jaosoriorlol, sorry14:32
EmilienM:)14:32
dtantsurlet's just straight to feature freeze14:32
dtantsur* jump14:32
*** pcaruana|elisa| has quit IRC14:33
jaosoriorno features, no bugs, right? :P14:33
dtantsurexactly!14:33
jaosoriorAnyway, folks! If you have blueprints for m1, please bump them to m2 (I'll be helping out with some of that as well)14:34
dtantsurI'm looking forward to reducing the number of bugs in instack-undercloud on master to 014:34
EmilienMdtantsur: cheater14:34
dtantsurhaha14:34
EmilienMi take instack then14:34
*** janki has quit IRC14:35
jaosorior#topic open discussion14:35
*** openstack changes topic to "open discussion (Meeting topic: tripleo)"14:35
jaosoriorAnything else that folks want to bring up to the meeting?14:35
mariosTripleO CI squad Community meeting after this tripleo meeting at https://bluejeans.com/5878458097 add items you would like to raise - agenda https://etherpad.openstack.org/p/tripleo-ci-squad-meeting14:35
weshaymarios, thanks14:36
openstackgerritHarald Jensås proposed openstack/tripleo-specs master: blueprint tripleo-routed-networks-templates  https://review.openstack.org/45158414:37
jaosoriorack14:37
*** ade_lee has joined #tripleo14:37
*** psachin has quit IRC14:38
hjensasI just moved ^^ to Stein. There is several patches up for review that I'd like feedback on. :)14:38
jaosoriorhjensas: thanks14:39
hjensasAlso, to enable testing all that I have been working with bnemec on supporting routed networks in OVB. It works really well! \o/14:39
hjensasI put some stuff here: https://github.com/hjensas/ooo-bp-tripleo-routed-networks-templates-testing if anyone wants try it out.14:40
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart master: wip: enable testing using ansible molecule  https://review.openstack.org/61367214:42
mwhahahaif some folks have a second, please review https://review.openstack.org/#/c/613394/14:42
*** raildo has quit IRC14:43
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart-extras master: Use dnf and python3 on platforms where these are default  https://review.openstack.org/61049114:43
openstackgerritYurii Prokulevych proposed openstack/tripleo-upgrade master: Add missing bracket in jinja filter  https://review.openstack.org/61423214:44
*** pcaruana|elisa| has joined #tripleo14:45
EmilienMmschuppert: please rebase https://review.openstack.org/#/c/614083/14:47
jaosorioralright folks, thanks for joining!14:47
jaosorior#endmeeting14:47
*** openstack changes topic to "Welcome to Stein | CI Status: GREENish - don't mess this up | https://docs.openstack.org/tripleo-docs/latest/"14:47
openstackMeeting ended Tue Oct 30 14:47:47 2018 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)14:47
openstackMinutes:        http://eavesdrop.openstack.org/meetings/tripleo/2018/tripleo.2018-10-30-14.00.html14:47
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/tripleo/2018/tripleo.2018-10-30-14.00.txt14:47
openstackLog:            http://eavesdrop.openstack.org/meetings/tripleo/2018/tripleo.2018-10-30-14.00.log.html14:47
EmilienMchandankumar: I had the same error locally with your new patchset14:49
dciabrinEmilienM, hey o/ sorry i think I overlooked your ping earlier?14:49
EmilienMchandankumar: i'll look after breakfast14:49
EmilienMdciabrin: yeah, what's the plan to get bandini's version of pcmk in upstream repos (RDO ?)14:49
*** dtantsur is now known as dtantsur|brb14:50
EmilienMdciabrin: we're making good progress on getting podman working, we need a repo to get pcmk14:50
EmilienMbrb14:50
dciabrinEmilienM, ack let's chat later14:50
*** raildo has joined #tripleo14:50
mschuppertEmilienM: ack14:51
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart master: bump ansible to 2.6.4  https://review.openstack.org/59628214:51
*** evrardjp has joined #tripleo14:55
openstackgerritMerged openstack/tripleo-docs master: config-download documentation enhancements  https://review.openstack.org/61342414:55
openstackgerritBogdan Dobrelya proposed openstack/paunch master: Add missing default-runtime support bits  https://review.openstack.org/60863214:56
openstackgerritBogdan Dobrelya proposed openstack/paunch master: Add missing default-runtime support bits  https://review.openstack.org/60863214:56
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: Use dnf and python3 on platforms where these are default  https://review.openstack.org/61049114:58
EmilienMdciabrin: back15:03
*** evrardjp has quit IRC15:06
*** caboucha has joined #tripleo15:06
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819515:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179989515:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged] - Assigned to Rafael Folco (rafaelfolco)15:10
EmilienMTengu: I had a talk with dciabrin and we'll get a repo with pcmk compatible with podman soon.15:11
*** itlinux has joined #tripleo15:11
openstackgerritSean McGinnis proposed openstack/ansible-role-chrony master: Remove setup.py check from pep8 job  https://review.openstack.org/61424915:11
TenguEmilienM: \o/15:14
TenguEmilienM: just one thing I didn't get - does the podman-compatible pcmk still work with docker?15:14
EmilienMTengu: no15:14
EmilienM(I don't know why though)15:14
Tenguyay.... double-container-maintenance15:14
Tenguah, nan, pcmk isn't in containers15:15
Tenguright?15:15
*** cylopez has left #tripleo15:15
*** aedc has quit IRC15:15
EmilienMTengu: it's not15:15
*** iury|lunch is now known as iurygregory15:16
* Tengu breathes again15:16
*** pbandark has quit IRC15:18
*** evrardjp has joined #tripleo15:19
chandankumarEmilienM: ack15:19
openstackgerritDouglas Mendizábal proposed openstack/tripleo-heat-templates master: Add template code to configure hsm backends for barbican  https://review.openstack.org/61063415:20
TenguEmilienM: but we'd need two overcloud-full images I guess? iirc, the overcloud deploy should not involve any network traffic with the outside (that was a point with the octavia issues raised by mwhahaha )15:20
mwhahahaTengu: for what?15:21
mwhahahaoh the pcmk thing, that's a problem15:21
Tengumwhahaha: for the podman-specific pacemaker package that apparently doesn't work with docker15:21
Tenguyeah15:21
mwhahahathat seems like an issue with pacemaker that needs to get fixed15:22
Tengu^^15:22
weshaybnemec, /me thinking about a test env15:22
Tenguso for the current testing/debug process, I can do whatever I want in the image, but that's a thing to think about for the prod.15:22
weshaybnemec, is an upstream lint, and a 3rd party job sufficient?15:22
bnemecweshay: It might be easier now with the zuulv3 secrets support.15:23
bnemecAlthough...it still requires running arbitrary code against the host cloud.15:23
weshaybnemec, we could even make the 3rd party job enforcing15:23
weshaywould be a good test case for that bit.. mwhahaha ^15:23
bnemecIf someone wanted to be a dick they could change the default node count to 100 or something and push a patch.15:24
bnemecweshay: Yeah, just unit test/linter jobs and a basic end-to-end test is what I do now.15:25
bnemecIt's very simple, but it provides reasonable coverage of the most commonly used bits.15:26
bnemecweshay: We might want to put OVB testing in its own tenant to isolate it from the other CI jobs. That way at worst someone can DoS OVB CI but doesn't have access to any of the other CI infra.15:27
weshaybnemec, agree15:31
weshayok.. there is a lot of work to break down here, I'll start giving that a shot and will share w/ you and jaosorior15:31
bnemecYeah, that's why it hasn't happened yet. :-)15:32
*** agopi is now known as agopi|brb15:32
weshaybnemec, ya.. we're all too busy all the time15:32
openstackgerritSean McGinnis proposed openstack/ansible-role-tripleo-cookiecutter master: Remove setup.py check from tox template  https://review.openstack.org/61426615:33
*** pcaruana|elisa| has quit IRC15:35
*** agopi|brb has quit IRC15:37
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: DNM: To test build-test-packages at python3 at zuul  https://review.openstack.org/61427215:37
bnemecOn a related note, https://github.com/cybertron/openstack-virtual-baremetal/pull/52 passed my local test so I merged it. < hjensas15:38
openstackgerritQuique Llorente proposed openstack/python-tripleoclient master: DNM: To test build-test-packages at python3 with zuul  https://review.openstack.org/61427615:42
*** quiquell is now known as quiquell|off15:48
*** ccamacho has quit IRC15:48
*** ykarel is now known as ykarel|away15:50
*** pcaruana|elisa| has joined #tripleo15:50
*** quiquell|off has quit IRC15:52
*** saneax has quit IRC15:52
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart master: Implement unified installation and setup  https://review.openstack.org/61369615:53
cschwedeHello! Can someone please review this t-h-t backport for Pike? https://review.openstack.org/#/c/603071/15:58
hjensasbnemec: prefect, thanks!15:58
*** pcaruana|elisa| has quit IRC16:00
openstackgerritRedHat RDO CI proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/56044516:00
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates stable/pike: GATE CHECK for TripleO  https://review.openstack.org/60224816:00
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates master: GATE CHECK for TripleO  https://review.openstack.org/60429816:00
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates stable/rocky: GATE CHECK for TripleO  https://review.openstack.org/60429316:00
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819516:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179989516:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged] - Assigned to Rafael Folco (rafaelfolco)16:10
openstackgerritSorin Sbarnea proposed openstack-infra/tripleo-ci master: Fix python3 detection logic  https://review.openstack.org/61392016:10
*** jtomasek_ has quit IRC16:12
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart master: Make quickstack.sh avoid needing sudo on missing virtualenv  https://review.openstack.org/61379716:13
*** dsneddon has quit IRC16:14
weshayvinaykns, re: https://review.openstack.org/#/c/600843/16:15
* weshay looking16:15
*** ksambor has quit IRC16:15
vinayknsweshay: thx.!16:15
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart master: Implement unified installation and setup  https://review.openstack.org/61369616:15
weshayvinaykns, huh interesting http://logs.openstack.org/43/600843/7/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/51e1a54/job-output.txt.gz#_2018-10-29_23_49_29_60825816:16
openstackgerritBogdan Dobrelya proposed openstack/paunch master: W/a Label filter is broken for podman vs docker  https://review.openstack.org/61429016:16
weshayrfolco|rover, ^16:16
weshayI haven't see this fail I thought we just default to qemu16:16
weshayoh wait16:16
weshaysorry16:16
weshaythat's not the fatal error16:16
weshayvinaykns, note the debug notes in http://logs.openstack.org/43/600843/7/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/51e1a54/logs/16:17
weshayvinaykns, Please refer to the recreation instructions16:17
weshaydebugging atm in Links to common log files16:17
weshayvinaykns, you have a legit failure16:17
weshayhttp://logs.openstack.org/43/600843/7/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/51e1a54/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-10-29_23_54_1516:17
weshayERROR: Missing parameter type for parameter: MetricsQdrConnectorRole16:18
weshayvinaykns, let me know if you need help w/ the repro16:19
*** tzumainn has quit IRC16:19
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: DNM - Testing no undercloud cleaning  https://review.openstack.org/61160216:19
vinayknsweshay: cool..thanks for pointing out..but all I wanted to know is debug this error before uploading the patch16:20
EmilienMbogdando, Tengu, weshay : FYI I listed CI jobs that we switched, are switching or will switch to Podman: https://trello.com/c/Chk0VmLh/39-migrate-ci-jobs-to-podman16:20
Tengucool :)016:20
weshayvinaykns, so imho atm.. noting atm16:20
bogdandoEmilienM: ack16:20
Tenguhave to find out WHY a jinja2 tmpl isn't executed properly -.-16:20
weshaythe best way is to initially submit a patch then you the reproducer to debug16:21
weshaythen you have an environment to iterate16:21
openstackgerritBogdan Dobrelya proposed openstack/paunch master: W/a Label filter is broken for podman vs docker  https://review.openstack.org/61429016:21
weshayoutside of ci16:21
openstackgerritSergii Golovatiuk proposed openstack/tripleo-upgrade stable/rocky: Add containers-prepare parameter to upgrade scripts.  https://review.openstack.org/61429216:21
vinayknsweshay: so what's the point of reproducer...to know the result before ci telling where you went wrong..?16:23
openstackgerritBogdan Dobrelya proposed openstack/paunch master: Log to a file by default, unless debugging  https://review.openstack.org/61416616:24
openstackgerritBogdan Dobrelya proposed openstack/paunch master: Add missing default-runtime support bits  https://review.openstack.org/60863216:24
*** dtantsur|brb is now known as dtantsur16:26
weshayvinaykns, the point of the reproducer is to give you the exact updatrem environment but locally to the best of our ability16:27
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart master: wip: enable testing using ansible molecule  https://review.openstack.org/61367216:30
*** roger2 has joined #tripleo16:30
*** dsneddon has joined #tripleo16:30
vinayknsweshay: well yes...that make sense to me now..thx.!16:31
*** trown is now known as trown|lunch16:33
*** morazi has quit IRC16:34
*** dciabrin is now known as dciabrin|afk16:37
openstackgerritMarios Andreou proposed openstack-infra/tripleo-ci master: WIP: expose zuul variables for reproducer  https://review.openstack.org/61357116:37
*** shyamb has joined #tripleo16:38
*** agopi|brb has joined #tripleo16:41
mwhahahaweshay: where are we at with reducing the scenario jobs via standalone?16:41
*** udesale has quit IRC16:43
openstackgerritSergii Golovatiuk proposed openstack/tripleo-upgrade master: Add timeout to openstack command  https://review.openstack.org/61429716:43
weshaypanda, mwhahaha we have the work lined up, but need to see f28 merge first16:43
weshayhttps://tree.taiga.io/project/tripleo-ci-board/taskboard/sprint-22unified-sprint-1?milestone=20356416:43
weshaysorry https://tree.taiga.io/project/tripleo-ci-board/taskboard/sprint-21-175?milestone=20356416:43
mwhahahaweshay: what patches specifically do we need to land for f2816:43
*** shyamb has quit IRC16:44
weshaymwhahaha, panda it's all on the board here.. I can help and create a list of gerrit topics16:45
weshayif that would be helpful16:45
mwhahahaues16:45
mwhahahayes16:45
mwhahahathe existing standalone-f28 is too polluted to know what we actually need16:45
openstackgerritCédric Jeanneret proposed openstack/tripleo-quickstart master: Move standalone job to podman instead of docker  https://review.openstack.org/61397516:46
pandamwhahaha: weshay for each card in ready to review column, there's a Review field with the review associated16:46
*** ykarel has joined #tripleo16:46
weshaypanda, mwhahaha /me talking kforde bbiab16:46
mwhahahapanda: that's great and all but we really need a single topic in gerrit for these initiatives16:47
openstackgerritCédric Jeanneret proposed openstack/tripleo-quickstart master: Move standalone job to podman instead of docker  https://review.openstack.org/61397516:48
pandamwhahaha: weshay  https://review.openstack.org/#/q/topic:standalone-f28+(status:open+OR+status:merged)16:48
*** ykarel|away has quit IRC16:48
mwhahahapanda: yea thats theone i was saying is too polluted, it needs to be cleaned up, like do we still need  the ones that are in merge conflict or not16:49
mwhahahait's not clear from that topic with the OLD/WIP/DNM what is actually needed16:49
*** jrist has quit IRC16:51
*** aufi has quit IRC16:52
*** agopi|brb is now known as agopi16:53
*** jrist has joined #tripleo16:54
*** quiquell has joined #tripleo16:56
mwhahahauh oh docker.io is kicking out a 50316:56
mwhahahahttp://logs.openstack.org/61/613661/4/gate/tripleo-puppet-ci-centos-7-undercloud-containers/bf1c2d8/logs/undercloud/home/zuul/undercloud_install.log.txt.gz#_2018-10-30_15_53_3016:56
*** quiquell is now known as quiquell|off16:56
*** itlinux has quit IRC16:57
openstackgerritJose Luis Franco proposed openstack/ansible-role-redhat-subscription master: Correct rhsm_force_registration var name in defaults.  https://review.openstack.org/61430416:58
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart-extras master: Add podman support to validate-tempest role  https://review.openstack.org/60535616:58
EmilienMchandankumar: I'm taking over ^16:58
*** abishop has quit IRC16:59
*** yprokule has quit IRC17:00
*** florianf is now known as florianf|afk17:03
*** bogdando has quit IRC17:06
roger2One of my physical servers doesn't have IPMI, but my introspection rules already injected IPMI credentials when I powered it up to do node discovery. What should I do so tripleo knows I have to power that one manually?17:06
*** aufi has joined #tripleo17:06
*** itlinux has joined #tripleo17:07
weshaypanda, ask ssbarnea to get the patches / topics cleaned up for mwhahaha's review17:07
*** gkadam has quit IRC17:08
*** jpich has quit IRC17:08
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819517:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179989517:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged] - Assigned to Rafael Folco (rafaelfolco)17:10
*** ykarel is now known as ykarel|away17:11
*** aufi has quit IRC17:12
*** rpioso is now known as rpioso|afk17:14
*** ykarel|away has quit IRC17:16
weshayrfolco|rover,17:18
weshay2018-10-30 15:37:52 |  u'message': u'503 Server Error: Service Unavailable for url: https://registry-1.docker.io/v2/tripleomaster/centos-binary-cron/manifests/current-tripleo',17:18
weshay2018-10-30 15:52:56 | 503 Server Error: Service Unavailable for url: https://auth.docker.io/token?scope=repository%3Atripleomaster%2Fcentos-binary-aodh-api%3Apull&service=registry.docker.io17:18
weshayjaosorior, mwhahaha  ugh17:19
weshayrfolco|rover, http://grafana.openstack.org/?orgId=117:20
weshayrfolco|rover, can you ask in openstack-infra17:22
weshayif something is up w/ rax17:22
*** ccamacho has joined #tripleo17:23
rfolco|roverweshay, regarding registry?17:24
weshayaye17:25
weshayrfolco|rover, the proxy17:25
weshayrfolco|rover, could be dns as well17:25
weshaymwhahaha, jaosorior 98% gate pass rate yesterday.. 87% today17:26
*** ykarel|away has joined #tripleo17:26
*** gkadam has joined #tripleo17:29
openstackgerritNagasai Vinaykumar Kapalavai proposed openstack/puppet-tripleo master: Add a connector to Qpid router  https://review.openstack.org/61197917:29
*** kopecmartin is now known as kopecmartin|off17:30
*** derekh has quit IRC17:30
openstackgerritNagasai Vinaykumar Kapalavai proposed openstack/tripleo-heat-templates master: Update to the ceilometer publisher list  https://review.openstack.org/60084317:31
*** abishop has joined #tripleo17:31
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart master: Make quickstack.sh avoid needing sudo on missing virtualenv  https://review.openstack.org/61379717:31
Tenguweshay: "hold the gate! Hold the gate! Hole e gate! Hol gate! Colgate!"17:33
* Tengu runs away17:33
Tengu(and yeah, Winter is coming, blah-blah-blah)17:33
*** morazi has joined #tripleo17:34
*** dciabrin|afk is now known as dciabrin17:35
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart-extras master: DNM: Adapt tqe for the new fedora28 job  https://review.openstack.org/61239017:36
*** panda is now known as panda|off17:37
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart master: Implement unified installation and setup  https://review.openstack.org/61369617:39
weshayrfolco|rover, so issue w/ docker?17:39
rfolco|roverweshay, yeah apparently there is no proxy or cache issue17:40
*** gkadam has quit IRC17:40
rfolco|roverweshay, well, actually it could be cache... but not infra/network/proxy17:42
rfolco|roverweshay, the 502 is probably related to docker failing behind our proxy caches when the data isn't cached or needs to be refreshed17:42
* mwhahaha wanders off to lunch17:42
weshaymwhahaha, misses all the fun17:42
*** suuuper has quit IRC17:44
*** trown|lunch is now known as trown17:50
*** morazi has quit IRC17:50
*** morazi has joined #tripleo17:51
*** jcoufal has quit IRC17:53
*** jfrancoa has quit IRC17:53
*** shardy_ has quit IRC17:55
*** thrash is now known as thrash|biab17:56
*** dtantsur is now known as dtantsur|afk17:57
*** ansmith has quit IRC17:57
weshaybnemec, mwhahaha https://tree.taiga.io/project/tripleo-ci-board/epic/298 getting this started18:02
weshayyou should be able to comment18:02
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart master: Enable undercloud_enable_tempest to true for FS01  https://review.openstack.org/61432118:02
*** akrivoka has quit IRC18:05
*** chandankumar is now known as chkumar|off18:05
openstackgerritSergii Golovatiuk proposed openstack/tripleo-validations master: Correct inline documentation  https://review.openstack.org/61432418:09
*** jpena is now known as jpena|off18:10
openstackgerritSam Doran proposed openstack/tripleo-quickstart-extras master: Improve how packages are installed in build-test-packages role  https://review.openstack.org/61277918:10
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819518:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179989518:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]18:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged] - Assigned to Rafael Folco (rafaelfolco)18:10
*** ansmith has joined #tripleo18:12
*** rpioso|afk is now known as rpioso18:13
*** holser_ has quit IRC18:15
openstackgerritSam Doran proposed openstack/tripleo-quickstart-extras master: Improve how packages are installed in build-test-packages role  https://review.openstack.org/61277918:15
*** dsneddon has quit IRC18:21
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Reduce unit testing changes required for emit_releases_file  https://review.openstack.org/61184218:25
*** thrash|biab is now known as thrash18:28
*** itlinux has quit IRC18:29
*** dsneddon has joined #tripleo18:32
*** jcoufal has joined #tripleo18:34
*** ansmith has quit IRC18:34
weshayjaosorior, https://tree.taiga.io/project/tripleo-ci-board/epic/29818:35
*** amoralej is now known as amoralej|off18:39
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart-extras master: Add podman support to validate-tempest role  https://review.openstack.org/60535618:39
*** ansmith has joined #tripleo18:55
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Export container_cli for update & upgrade tasks  https://review.openstack.org/61108919:02
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart master: Make quickstack.sh avoid needing sudo on missing virtualenv  https://review.openstack.org/61379719:05
*** shardy has quit IRC19:06
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart master: wip: enable testing using ansible molecule  https://review.openstack.org/61367219:08
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819519:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179989519:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]19:10
openstackLaunchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged]19:10
*** dprince has quit IRC19:10
*** tongl has joined #tripleo19:11
*** dprince has joined #tripleo19:13
cabouchaslagle: ping19:13
*** weshay is now known as weshay_doctor19:15
*** shardy has joined #tripleo19:18
tonglCan any core member look at the following patch to see if you are good to merge it? https://review.openstack.org/#/c/604858/19:23
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Allow the environment to enable Podman on the overcloud  https://review.openstack.org/61252219:25
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Support podman when tagging container for Pacemaker  https://review.openstack.org/60418019:26
openstackgerritDirk Mueller proposed openstack/diskimage-builder master: Update test coverage for openSUSE-minial to 15.0  https://review.openstack.org/61043619:29
*** ykarel|away has quit IRC19:32
*** ykarel|away has joined #tripleo19:32
*** tzumainn has joined #tripleo19:35
*** ykarel|away has quit IRC19:38
*** gfidente has quit IRC19:47
*** saneax has joined #tripleo19:52
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart-extras master: Add podman support to validate-tempest role  https://review.openstack.org/60535619:52
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart master: wip: enable testing using ansible molecule  https://review.openstack.org/61367219:58
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart master: Make quickstack.sh avoid needing sudo on missing virtualenv  https://review.openstack.org/61379720:00
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart master: wip: enable testing using ansible molecule  https://review.openstack.org/61367220:02
*** shardy has quit IRC20:03
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart-extras master: Fix runtime Ansible warnings  https://review.openstack.org/61184420:04
*** social has quit IRC20:05
ssbarneaEmilienM : please give it another +W, failed on the gate with one timeout.  https://review.openstack.org/#/c/611844/20:06
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819520:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179989520:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]20:10
EmilienMssbarnea: isn't the gate busy enough?20:10
openstackLaunchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged]20:10
EmilienMssbarnea: is this patch urgent?20:10
ssbarneaEmilienM: no, but otherwise it would stall and waste our resources forever, as it would require rebases.20:12
ssbarneathe gate thing is a really tricky subject20:12
*** pcaruana|elisa| has joined #tripleo20:12
EmilienMssbarnea: I don't care if you patch stale20:12
*** shardy has joined #tripleo20:12
EmilienMssbarnea: you're not alone20:12
EmilienMwe have a ton of patches that stale20:13
EmilienMand we don't want to recheck them all20:13
EmilienMwe should do by priority20:13
EmilienMgate is really high now, in case you missed the thread on openstack-dev20:13
EmilienMwe consume more than 50% of infra resources20:13
EmilienMso I'm not sure we want to increase that number with low prio patches.20:13
*** akrzos has quit IRC20:13
*** rascasoft has quit IRC20:13
*** rnoriega has quit IRC20:13
*** akrzos has joined #tripleo20:14
*** rnoriega has joined #tripleo20:14
*** rascasoft has joined #tripleo20:16
EmilienMssbarnea: http://lists.openstack.org/pipermail/openstack-dev/2018-October/136141.html20:17
ssbarneaEmilienM: i am not trying to push that silly path, but if we reached the 50% subject, maybe we need to rethink how/what/when we test to avoid such cases. the graph with queue length does say a very sad story20:17
EmilienMhttp://paste.openstack.org/show/733644/20:17
ssbarneareading now...  my personal take is that we reached this because we the failure rate gates is too high. each failure doubles the effort.20:19
ssbarneaEmilienM but for the moment i will abandon it. Here is an urgent one https://review.openstack.org/#/c/613920/20:23
*** saneax has quit IRC20:24
EmilienMssbarnea: I didn't say you should abandon it20:24
EmilienMssbarnea: I said we should not move it to gate now20:24
EmilienMand +2 on https://review.openstack.org/#/c/613920/20:25
ssbarneaEmilienM and its dependency https://review.openstack.org/#/c/611844/20:26
ssbarneasorry wrong link20:27
*** mburned is now known as mburned_out20:30
*** mburned_out is now known as mburned20:30
*** pcaruana|elisa| has quit IRC20:32
*** agopi is now known as agopi|brb20:33
*** vinaykns has quit IRC20:34
*** vinaykns has joined #tripleo20:35
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: WIP - podman: rm Docker containers during upgrades  https://review.openstack.org/61109220:36
EmilienMsdoran: trying it ^20:36
EmilienMbut I need to patch tripleoclient first20:36
sdoran👍20:36
*** cylopez has joined #tripleo20:40
*** agopi|brb has quit IRC20:41
*** ansmith has quit IRC20:42
*** caboucha has quit IRC20:43
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: standalone/undercloud: run post_upgrade_tasks when upgrading  https://review.openstack.org/61434920:48
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: WIP - podman: rm Docker containers during upgrades  https://review.openstack.org/61109220:48
*** weshay_doctor is now known as weshay20:51
*** dprince has quit IRC20:53
*** morazi has quit IRC20:53
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart master: Make quickstack.sh avoid needing sudo on missing virtualenv  https://review.openstack.org/61379720:55
*** shardy has quit IRC20:55
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart master: wip: enable testing using ansible molecule  https://review.openstack.org/61367220:56
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: standalone/undercloud: run post_upgrade_tasks when upgrading  https://review.openstack.org/61434920:57
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: WIP - podman: rm Docker containers during upgrades  https://review.openstack.org/61109220:58
weshay    "2018-10-30 20:07:57,925 ERROR: 9471 -- Failed running docker-puppet.py for zaqar",21:04
weshay    "2018-10-30 20:07:57,926 ERROR: 9471 -- relabel failed \"/var/lib/config-data\": no such file or directory",21:04
weshay    "2018-10-30 20:07:57,926 INFO: 9471 -- Finished processing puppet configs for zaqar",21:04
weshayhttp://logs.openstack.org/58/609858/6/gate/tripleo-ci-centos-7-containers-multinode/27bedd3/logs/undercloud/home/zuul/install-undercloud.log.txt.gz21:04
*** jcoufal has quit IRC21:06
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: fs001/035/053: switch undercloud to podman  https://review.openstack.org/61402321:08
EmilienMnhicher: still having issues with ovb?21:09
EmilienMweshay: yaeh I sad that before, let me look21:09
*** trown is now known as trown|outtypewww21:09
EmilienMweshay: the actual error is somewhere else, one sec21:10
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819521:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179989521:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]21:10
openstackLaunchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged]21:10
EmilienMthe podman pull failed21:10
EmilienM    "panic: runtime error: invalid memory address or nil pointer dereference",21:11
EmilienM    "[signal SIGSEGV: segmentation violation code=0x1 addr=0x8 pc=0xc46e67]",21:11
EmilienMthat's bad21:11
EmilienMlet me poke podman folks21:11
EmilienMweshay: can you tell how much you have of this failure ^ exactly this one21:11
*** raildo has quit IRC21:13
*** Vorrtex has quit IRC21:14
EmilienMlet me see in logstash21:14
*** cylopez has quit IRC21:15
weshayEmilienM, how many?21:17
weshayEmilienM, ya.. /me looks21:17
weshayprobably not much, first time I've seen it21:17
EmilienMweshay: i'm with podman folks21:17
EmilienMlooks pretty bad bug21:17
EmilienMbut it also looks random21:17
EmilienMI'm filling a bug now in podman21:17
weshayok21:17
EmilienMweshay: we need to keep an eye on that21:18
weshayrfolco|rover, ^21:18
weshaysshnaidm|off, ^21:18
EmilienMif it's blocking the gate too much we need to revert my patch that enabled podman21:18
EmilienMit'll makes me cry21:18
weshaylol21:18
EmilienMbut nevermind21:18
weshayI would NEVER revert your patches21:18
*** ade_lee has quit IRC21:18
weshayonly that Evilien guy21:18
weshayhe sucks21:18
openstackgerritMerged openstack/ansible-role-redhat-subscription master: Correct rhsm_force_registration var name in defaults.  https://review.openstack.org/61430421:20
*** salmankhan has joined #tripleo21:20
EmilienMweshay: https://github.com/containers/libpod/issues/173021:24
EmilienMFYI21:24
nhicherEmilienM: waiting for a working job to test your change21:26
EmilienMk21:26
nhicherEmilienM: arxcruz is working to find what's the issue21:27
weshayrock21:29
EmilienMweshay: did you check in logstash?21:30
EmilienMweshay: I have a query21:33
EmilienMI see it more than once21:33
EmilienMand it's not a new error21:33
EmilienM*tripleo-ci* AND build_status: FAILURE AND message: "panic: runtime error: invalid memory address or nil pointer dereference"21:34
EmilienMweshay: nevermind when I look for failign jobs I don't see it...21:35
EmilienMI wonder if logstash data is updated21:35
EmilienMweshay: ok I needed to wait, I see results:21:38
EmilienMhttp://logstash.openstack.org/#dashboard/file/logstash.json?query=build_status%3A%20FAILURE%20AND%20message%3A%20%5C%22panic%3A%20runtime%20error%5C%2221:38
* weshay looks21:38
weshayEmilienM, http://logs.openstack.org/40/613640/1/gate/tripleo-ci-centos-7-containers-multinode/e212bb8/logs/undercloud/home/zuul/install-undercloud.log.txt.gz21:39
weshayEmilienM, 3 on the tree in the middle of the night.. and two failures in the gate right now w/ that21:40
EmilienMdamn21:40
weshay2018-10-30 21:13:37.120 17849 WARNING tripleoclient.v1.tripleo_deploy.Deploy [  ]         "panic: runtime error: invalid memory address or nil pointer dereference",21:41
weshayEmilienM, this makes we wonder about something21:41
jrist+1 workflow pretty please https://review.openstack.org/#/c/611305/21:42
EmilienMjrist: gate is hossed21:44
EmilienMbad time to merge things21:45
*** bfournie has quit IRC21:45
EmilienMwe should probably ask people to not recheck and +A21:45
jristoh ok21:45
jristhi21:45
jristI didn't know that.21:45
jristlet's start over EmilienM21:45
jristcan we start over?21:45
EmilienMchkumar|off: I could make some progress on tempest into podman, I pushed over your patch now I have this failure: http://paste.openstack.org/show/733671/21:46
EmilienMchkumar|off: i'll let you continue maybe. Otherwise I'll continue myself tomorrow.21:46
EmilienMjrist: start what?21:46
jristthat conversation21:46
jrist:)21:46
EmilienMweshay: i think we need to disable podman in gate21:46
EmilienMit makes me super sad but I don't have any alternative21:47
EmilienMgive me 5 more min to make sure it's really that21:47
weshayEmilienM, aight21:48
EmilienMso wait21:51
EmilienMthis podman error is actually a red hearing21:51
EmilienMwhen we "podman pull", we actually retry 5 times21:51
EmilienMand it usually works21:52
EmilienMI checked in different patches which failed with this error21:52
EmilienMso I reported the issue to podman folks, and we'll take it as a bug, but not blocking us21:52
EmilienMnow let's look what fails exactly21:52
EmilienM2018-10-30 16:50:38 |         "2018-10-30 16:47:16,116 ERROR: 4541 -- relabel failed \"/var/lib/config-data\": no such file or directory",21:52
EmilienMit's really this dir21:53
EmilienMit sounds like a race condition to me21:53
EmilienMso we have a task that create this dir:21:55
EmilienMhttp://logs.openstack.org/56/604756/4/gate/tripleo-ci-centos-7-undercloud-containers/66188f5/logs/undercloud/home/zuul/undercloud_install.log.txt.gz#_2018-10-30_16_43_1521:55
*** hberaud has quit IRC21:58
*** hberaud has joined #tripleo21:58
EmilienMselinux is in permissive21:59
EmilienMwhat the21:59
EmilienMwhy is it failing..21:59
openstackgerritMerged openstack/tripleo-heat-templates master: Ensure unique containers names in docker-puppet  https://review.openstack.org/61329522:03
EmilienMweshay: tbh, I don't know. Let's file a bug and track it.22:04
EmilienMI need more time to debug and it's late for me.22:04
weshayk22:05
weshayhave to take the kids .. brb22:05
EmilienMTengu: for your morning, if you have any idea ^22:06
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819522:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179989522:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged]22:10
mwhahaha2018-10-30 16:50:40 |     "panic: runtime error: invalid memory address or nil pointer dereference",22:10
mwhahahadat null reference22:10
*** boazel_ has joined #tripleo22:10
mwhahahaEmilienM: http://logs.openstack.org/56/604756/4/gate/tripleo-ci-centos-7-undercloud-containers/66188f5/logs/undercloud/home/zuul/undercloud_install.log.txt.gz#_2018-10-30_16_50_4022:11
EmilienMmwhahaha: yes, see #podman22:12
EmilienMit's a bug in storage22:12
EmilienMI'll look later, need to go22:12
mwhahahafun22:12
mwhahahaweshay: soooo containers22:13
*** boazel has quit IRC22:13
mwhahahaweshay: do you know how large the centos base container is?22:13
openstackgerritMerged openstack/tripleo-quickstart master: Activate ansible lint after deployment.  https://review.openstack.org/60475622:17
openstackgerritMerged openstack/tripleo-heat-templates stable/rocky: Change Swift storage directory to /srv/node/d1  https://review.openstack.org/61268222:17
openstackgerritMerged openstack/tripleo-quickstart-extras master: Fix pip installation  https://review.openstack.org/61264922:17
*** hberaud has quit IRC22:18
*** hberaud has joined #tripleo22:19
chemjrist: hey, I just bump into that review and maybe something is off there, could you have a look22:28
*** agopi|brb has joined #tripleo22:33
*** agopi|brb is now known as agopi22:34
*** vinaykns has quit IRC22:37
*** bfournie has joined #tripleo22:37
*** mcornea has quit IRC22:38
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: Enable undercloud_enable_tempest to true for FS01  https://review.openstack.org/61432122:39
weshayarxcruz, chkumar|off fyi the tempest bug on fs001 is fixed https://bugs.launchpad.net/tripleo/+bug/180068222:40
openstackLaunchpad bug 1800682 in tripleo "tempest: import errors on master" [Critical,In progress] - Assigned to wes hayutin (weshayutin)22:40
weshayhttps://review.openstack.org/#/c/614321/22:41
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: Enable undercloud_enable_tempest to true for FS01  https://review.openstack.org/61432122:41
*** salmankhan has quit IRC22:43
openstackgerritMerged openstack/ansible-role-tripleo-sahara master: Update min tox version to 2.0  https://review.openstack.org/61204422:45
openstackgerritMerged openstack/ansible-role-tripleo-zaqar master: Update min tox version to 2.0  https://review.openstack.org/61205022:45
openstackgerritMerged openstack/ansible-role-tripleo-rsyslog-sidecar master: Update min tox version to 2.0  https://review.openstack.org/61204322:46
openstackgerritMerged openstack/ansible-role-tripleo-panko master: Update min tox version to 2.0  https://review.openstack.org/61204122:48
openstackgerritMerged openstack/ansible-role-tripleo-tacker master: Update min tox version to 2.0  https://review.openstack.org/61204722:48
openstackgerritMerged openstack/ansible-role-tripleo-rabbitmq master: Update min tox version to 2.0  https://review.openstack.org/61204222:49
openstackgerritMerged openstack/ansible-role-tripleo-opendaylight master: Update min tox version to 2.0  https://review.openstack.org/61203922:49
openstackgerritMerged openstack/ansible-role-tripleo-swift master: Update min tox version to 2.0  https://review.openstack.org/61204622:49
arxcruzweshay: still, i''ll check when we start to run it in container this will haunt us back22:50
openstackgerritMerged openstack/ansible-role-tripleo-nova master: Update min tox version to 2.0  https://review.openstack.org/61203822:50
openstackgerritMerged openstack/ansible-role-tripleo-sensu master: Update min tox version to 2.0  https://review.openstack.org/61204522:50
openstackgerritMerged openstack/ansible-role-tripleo-ovn master: Update min tox version to 2.0  https://review.openstack.org/61204022:50
weshaywow22:52
weshayarxcruz++22:52
weshaymwhahaha, should we revert turning podman on?22:52
weshayhttps://bugs.launchpad.net/tripleo/+bug/180073722:53
openstackLaunchpad bug 1800737 in tripleo "podman, "panic: runtime error: invalid memory address or nil pointer dereference"," [Critical,Triaged]22:53
weshayor let it roll22:53
openstackgerritMerged openstack/ansible-role-tripleo-memcached master: Update min tox version to 2.0  https://review.openstack.org/61203422:53
openstackgerritMerged openstack/ansible-role-tripleo-manila master: Update min tox version to 2.0  https://review.openstack.org/61203322:53
weshaysshnaidm|off, rfolco|rover https://bugs.launchpad.net/tripleo/+bug/180073722:53
mwhahahaweshay: if it's failing the gate, yes22:53
arxcruzwow, a lot of stuff getting merged :)22:53
mwhahahaa lot of stuff not in the tripleo queue22:54
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: Revert "fs010: switch undercloud to podman"  https://review.openstack.org/61436422:55
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: Revert "fs010: switch undercloud to podman"  https://review.openstack.org/61436422:55
weshaymwhahaha, https://review.openstack.org/#/c/614364/22:55
openstackgerritMerged openstack/ansible-role-tripleo-keystone master: Update min tox version to 2.0  https://review.openstack.org/61203222:55
openstackgerritMerged openstack/ansible-role-tripleo-heat master: Update min tox version to 2.0  https://review.openstack.org/61202822:56
jillrwhole slew of easy one-liners that, yeah, shouldnt block anything22:56
openstackgerritMerged openstack/ansible-role-tripleo-keepalived master: Update min tox version to 2.0  https://review.openstack.org/61203122:56
openstackgerritMerged openstack/ansible-role-tripleo-glance master: Update min tox version to 2.0  https://review.openstack.org/61202522:57
openstackgerritMerged openstack/ansible-role-tripleo-horizon master: Update min tox version to 2.0  https://review.openstack.org/61202922:58
openstackgerritMerged openstack/ansible-role-tripleo-gnocchi master: Update min tox version to 2.0  https://review.openstack.org/61202622:59
openstackgerritMerged openstack/ansible-role-tripleo-ironic master: Update min tox version to 2.0  https://review.openstack.org/61203022:59
openstackgerritMerged openstack/ansible-role-tripleo-mistral master: Update min tox version to 2.0  https://review.openstack.org/61203522:59
openstackgerritMerged openstack/ansible-role-tripleo-cinder master: Update min tox version to 2.0  https://review.openstack.org/61202123:00
openstackgerritMerged openstack/ansible-role-tripleo-barbican master: Update min tox version to 2.0  https://review.openstack.org/61201923:01
openstackgerritMerged openstack/ansible-role-tripleo-haproxy master: Update min tox version to 2.0  https://review.openstack.org/61202723:01
openstackgerritMerged openstack/ansible-role-tripleo-designate master: Update min tox version to 2.0  https://review.openstack.org/61202423:02
openstackgerritMerged openstack/ansible-role-tripleo-congress master: Update min tox version to 2.0  https://review.openstack.org/61202223:02
openstackgerritMerged openstack/ansible-role-tripleo-aodh master: Update min tox version to 2.0  https://review.openstack.org/61201823:02
weshaymwhahaha, this must be a joke23:03
mwhahahaweshay: what23:03
weshayoh ya.. just lint jobs23:03
weshayall this mergy mergy23:03
mwhahahaweshay: all the ansible-role* stuff? no tripleo jobs run on those23:03
*** tonyb has joined #tripleo23:03
openstackgerritMerged openstack/ansible-role-tripleo-ceilometer master: Update min tox version to 2.0  https://review.openstack.org/61202023:06
weshayrfolco|rover, http://logs.openstack.org/87/613087/1/gate/tripleo-ci-centos-7-undercloud-containers/3ffe449/logs/undercloud/home/zuul/tempest.log.txt.gz23:06
weshayrfolco|rover, https://bugs.launchpad.net/tripleo/+bug/1800742 work w/ arx on that one23:08
openstackLaunchpad bug 1800742 in tripleo "undercloud-containers job has multiple tempest failures" [Critical,Triaged]23:08
*** salmankhan has joined #tripleo23:09
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819523:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179989523:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/180073723:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/180074223:10
*** ooolpbot has quit IRC23:10
openstackLaunchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged]23:10
openstackLaunchpad bug 1800737 in tripleo "podman, "panic: runtime error: invalid memory address or nil pointer dereference"," [Critical,Triaged]23:10
openstackLaunchpad bug 1800742 in tripleo "undercloud-containers job has multiple tempest failures" [Critical,Triaged]23:10
weshayI think we have another log rotation issue https://bugs.launchpad.net/tripleo/+bug/180074223:13
openstackLaunchpad bug 1800742 in tripleo "tempest.lib.exceptions.IdentityError: Got identity error, undercloud-containers" [Critical,Triaged]23:13
*** rpioso is now known as rpioso|afk23:15
mwhahahaanyone want to guess the largest offender rpm on the base container in terms of size?23:17
weshayooh ooh mr cata mr cata23:20
weshaymwhahaha, no is listening23:20
mwhahahaHEH23:20
mwhahahano one cares tbh23:21
mwhahahabut it's ansible23:21
mwhahaha60M23:21
weshayLOLZ23:21
mwhahahai'm not even sure why we are installing ansible on the base container23:21
mwhahahaprobably a dep of tripleo-common-container-base or whatever23:21
weshaywait.. wasnt it rsyslog at 600M23:21
weshayoh rpm in the container?23:22
mwhahahalooks like we install it on purpose23:22
mwhahahaalong with python3-kubernetes23:22
mwhahahahmmm23:23
mwhahahawhich was #7 at 16M23:24
mwhahahaweshay: so the rsyslog container lists like 600M, but it's a bunch of layers. The base centos image is probably like 200M, but then the kolla built base adds another 250M23:24
mwhahahawhich includes things like puppet/openstack-selinux/ansible/python3-shade/etc23:24
weshayflatpak23:24
* weshay shoots thyself23:25
openstackgerritMerged openstack/ansible-role-tripleo-neutron master: Update min tox version to 2.0  https://review.openstack.org/61203723:25
mwhahahaI guess we added ansible to the base container so that we could intheory run ansible in containers23:25
mwhahahathough not sure why23:25
mwhahahathat probably should just be in the mistral container23:25
mwhahahaand i have no idea why we added python-kubernetes23:26
* mwhahaha blames flaper87 23:27
weshaysee you tomorrow23:28
weshayred red red :)23:28
openstackgerritMerged openstack/tripleo-common master: Refactor image uploader class structure  https://review.openstack.org/61123723:30
openstackgerritAlex Schultz proposed openstack/tripleo-common master: Move some container deps out of base  https://review.openstack.org/61437123:36
*** rlandy has quit IRC23:46

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!