Tuesday, 2019-11-12

tonybdtantsur|afk: Did that work IIRC00:00
tonybstevebaker: and Jeremy (I'll get him in here) did the corresponding validations work00:01
tonybstevebaker: but basically an ${arch}-${platform}/{ipa,overcloud,kernel,initramfs} should work00:02
tonybstevebaker: Perhaps with some form of meta-data.json ?00:02
stevebakeryeah, I'm hoping to avoid a meta-data.json because that implies new tools to read it and show the user something usable00:03
tonybstevebaker: Okay00:03
stevebakera top-level dir ${arch}-${platform}/ solves that problem00:04
tonybstevebaker: We do rely on traits in glance/on the node00:04
stevebakertonyb: this is in a nova-less environment btw, provisioning directly with ironic via metalsmith00:04
tonybstevebaker: Right, just making sure we don't loose that ability when we get to metalsmith00:05
tonybstevebaker: so as long as there is somewhay to handle that we shoudl be okay00:05
stevebakertonyb: when you say "rely on traits" what do you mean?00:05
tonybstevebaker: IIRC the proposal I saw had traits in the inventory yaml00:05
tonybstevebaker: We add a trait CUSTOM_BOB to both the image and node... then when we boot that image the scheduler will ensure it lands on a node that supports it00:06
tonybstevebaker: more concrete we have POWER8 and POWER9 images and they *must* run on the rigth cpu so we use the traits to make sure that happens (as well as the platform tag in tripleo/ironic)00:07
*** zbr has quit IRC00:09
stevebakerOK, I think in the glanceless case you'd select the node by trait, and the image by full file path. Here are the docs, let me twerk up a yaml example https://docs.openstack.org/project-deploy-guide/tripleo-docs/latest/provisioning/baremetal_provision.html#instance-and-defaults-properties00:09
*** abishop has quit IRC00:10
*** slaweq has joined #tripleo00:11
tonybstevebaker: I think that'll work but I'll wait for your example00:13
openstackgerritMerged openstack/tripleo-heat-templates stable/train: Remove odl in ComputeSriovIB  https://review.opendev.org/69373300:13
stevebakertonyb: something like this http://paste.openstack.org/show/785953/00:14
openstackgerritAlex Schultz proposed openstack/tripleo-ansible master: Create role to do puppet cache actions  https://review.opendev.org/69375500:15
tonybYup that'll work00:15
*** slaweq has quit IRC00:16
tonybstevebaker: Also if I understand the wholes instances dict correctly and we're explictly mapping BM nodes to overcloud roles/names then we can also ensure it there ... but the traits mean we're flexible00:17
tonybstevebaker: oooo can we do the image mapping stuff in the instaces dict also?00:18
stevebakertonyb: correct, individual instance entries can override the image00:19
stevebakerBringing it back to the case with glance. Are you expecting the following to choose the appropriate image based on image traits? http://paste.openstack.org/show/785954/ because I don't know where that is happening in the current metalsmith chain00:20
tonybstevebaker: so: http://paste.openstack.org/show/785955/ (apart from the fact I used the same name twice) ?00:20
stevebakertonyb: yep that would do what you expect00:21
tonybstevebaker: Yes I'd expect your second example to ensure that ComputePower9 ran the overcloud-full image with the POWER9 trait on a BM node that also has that trait, or abort if that can't be satisfied00:23
*** ayoung has quit IRC00:24
tonybstevebaker: if that doesn't work today let me and mrda know and we'll (well he'll) work on it but I *thought* we had tested that (in theory at least)00:24
stevebakertonyb: ok, I need to dig into that one00:25
tonybstevebaker: okay.  Once we knwo what works or not we can either document it or fix it (or both ;P)00:25
*** ayoung has joined #tripleo00:26
stevebakertonyb: do you happen to know where in nova this trait matching is done00:31
stevebakertonyb: nova/conductor/manager.py I think?00:33
tonybstevebaker: I'd think it was the imageproperties schedule filter00:35
stevebakertonyb: sweet thanks00:38
tonybstevebaker: https://opendev.org/openstack/nova/src/branch/master/nova/scheduler/utils.py looks like the bulk of the prep work but not the actual filtering/selection00:39
openstackgerritMerged openstack/tripleo-heat-templates master: Add ManageNetworks parameter  https://review.opendev.org/69323500:42
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Run nova_api unprivileged  https://review.opendev.org/69232900:42
*** yoctozepto has quit IRC00:53
*** yoctozepto has joined #tripleo00:54
*** yoctozepto has quit IRC01:05
*** yoctozepto has joined #tripleo01:05
*** cdearborn has quit IRC01:24
*** lbragstad_ has joined #tripleo01:24
*** lbragstad has quit IRC01:26
*** rh-jelabarre has quit IRC01:27
a14amwhahaha thank you for the tip! that really pointed me in the right direction. i copied the cinder-volume bundle definition from pcs and created a cinder-volume container manually, and it works like a charm! (after three hours due to a missed net=host lol).01:27
a14ahowever i still don't get how to make pacemaker accept my bundle. i created a test, and pcs refuses to start it just like with cinder-volume:01:28
a14a   nktest4-docker-0     (ocf::heartbeat:docker):        Stopped01:29
a14abut if i create a container named    nktest4-docker-0 before adding the bundle, pcs accepts the resource as running.01:29
*** markllama has quit IRC01:35
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates master: Disable legacy telemetry by default  https://review.opendev.org/68148501:46
*** markllama has joined #tripleo01:50
*** rfolco has quit IRC01:54
openstackgerritMerged openstack/tripleo-heat-templates master: Remove deployed-server-roles-data.yaml  https://review.opendev.org/69045002:00
a14ais it true that redundant controllers can only be done via pacemaker, and pacemaker is still only available via docker containers? deployment kind of threatens to remove the docker API in train but i did deploy from train :)02:06
*** rlandy|ruck|bbl is now known as rlandy|ruck02:11
*** slaweq has joined #tripleo02:11
*** slaweq has quit IRC02:16
*** rlandy|ruck has quit IRC02:34
*** ayoung has quit IRC02:41
*** ayoung has joined #tripleo02:41
*** mschuppert has quit IRC02:50
*** ayoung has quit IRC02:54
*** ayoung has joined #tripleo02:54
*** rcernin_ has joined #tripleo03:00
*** rcernin has quit IRC03:03
*** apetrich has quit IRC03:08
*** brault has quit IRC03:13
*** brault has joined #tripleo03:20
*** a14a has quit IRC03:24
*** rcernin_ has quit IRC03:26
*** rcernin has joined #tripleo03:26
*** bhagyashris has joined #tripleo03:40
*** udesale has joined #tripleo03:41
*** udesale has quit IRC03:45
*** udesale has joined #tripleo03:46
*** skramaja has joined #tripleo04:17
*** ykarel|away has joined #tripleo04:25
*** tkajinam_ has joined #tripleo04:29
*** ykarel|away is now known as ykarel04:31
*** tkajinam has quit IRC04:32
*** dsneddon_ has quit IRC04:33
*** ayoung has quit IRC04:46
*** ayoung has joined #tripleo04:47
*** tkajinam_ has quit IRC04:58
*** dsneddon_ has joined #tripleo04:58
*** tkajinam has joined #tripleo04:59
openstackgerritKarthik S proposed openstack/os-net-config stable/train: Cleanup the sriov_numvfs config scripts  https://review.opendev.org/69376805:07
*** surpatil has joined #tripleo05:15
*** epoojad1 has joined #tripleo05:17
openstackgerritKarthik S proposed openstack/os-net-config stable/stein: Cleanup the sriov_numvfs config scripts  https://review.opendev.org/69376905:17
*** slaweq has joined #tripleo05:26
*** ratailor has joined #tripleo05:30
*** shyamb has joined #tripleo05:33
*** shyamb has quit IRC05:38
*** udesale has quit IRC05:43
*** udesale has joined #tripleo05:43
*** udesale has quit IRC05:44
*** udesale has joined #tripleo05:44
*** saneax has joined #tripleo05:57
*** cfontain has joined #tripleo05:58
*** shyamb has joined #tripleo06:03
*** cfontain has quit IRC06:11
*** lmiccini has joined #tripleo06:12
*** dsneddon_ has quit IRC06:12
*** cfontain has joined #tripleo06:14
*** marios has joined #tripleo06:17
*** marios has quit IRC06:20
*** cfontain has quit IRC06:23
*** marios has joined #tripleo06:23
*** ksambor has joined #tripleo06:27
*** cfontain has joined #tripleo06:27
*** bandini has joined #tripleo06:29
*** shyamb has quit IRC06:31
*** shyamb has joined #tripleo06:31
*** numans has quit IRC06:32
EmilienMTengu: do we need to backport https://review.opendev.org/#/c/693317/ to stable/stein?06:36
*** dsneddon_ has joined #tripleo06:37
TenguEmilienM: yes, as mentioned in the LP :)06:41
Tenguah, train merged - lemme do the stein06:41
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/stein: Correct mysql-pacemaker upgrade task  https://review.opendev.org/69377306:42
openstackgerritCédric Jeanneret (Tengu) proposed openstack/tripleo-heat-templates stable/stein: Correct mysql-pacemaker upgrade task  https://review.opendev.org/69377306:42
Tengumeh06:42
EmilienMlol same time :D06:42
TenguEmilienM: well, at least gerrit is smart - it's ONE review :)06:42
*** dsneddon_ has quit IRC06:42
TenguEmilienM: and I'll need to take it downstream as well. Need to check if we have the proper BZ06:43
*** saneax has quit IRC06:44
*** saneax has joined #tripleo06:44
*** cfontain has quit IRC06:46
*** ayoung has quit IRC06:58
*** ayoung has joined #tripleo06:58
*** udesale has quit IRC07:03
*** udesale has joined #tripleo07:04
*** ayoung has quit IRC07:07
*** ayoung has joined #tripleo07:07
*** yprokule has joined #tripleo07:08
*** jfrancoa has joined #tripleo07:11
*** ksambor has quit IRC07:18
*** rcernin has quit IRC07:22
*** florianf has joined #tripleo07:23
*** cfontain_ has joined #tripleo07:24
*** d0ugal has quit IRC07:28
*** mschuppert has joined #tripleo07:30
*** dsneddon_ has joined #tripleo07:38
*** shyamb has quit IRC07:40
*** cfontain_ has quit IRC07:42
*** apetrich has joined #tripleo07:43
*** dsneddon_ has quit IRC07:44
*** jpena|off is now known as jpena07:46
*** iurygregory has joined #tripleo07:46
*** tmazur has joined #tripleo07:49
*** tosky has joined #tripleo07:52
*** ayoung has quit IRC07:55
*** ayoung has joined #tripleo07:56
*** ksambor has joined #tripleo08:08
*** tesseract has joined #tripleo08:11
*** epoojad1 has quit IRC08:13
*** dsneddon_ has joined #tripleo08:21
*** dsneddon_ has quit IRC08:25
*** zbr has joined #tripleo08:30
*** tosky has quit IRC08:32
*** dsneddon_ has joined #tripleo08:33
*** zbr has quit IRC08:35
*** zbr has joined #tripleo08:36
*** tosky has joined #tripleo08:37
*** tkajinam has quit IRC08:37
*** dsneddon_ has quit IRC08:38
*** amoralej|off is now known as amoralej08:38
*** shyamb has joined #tripleo08:39
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible master: tripleo-container-manage: use async  https://review.opendev.org/69321608:46
*** dtantsur|afk is now known as dtantsur08:48
*** ayoung has quit IRC08:48
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible master: tripleo-container-manage: port paunch-services  https://review.opendev.org/69340808:49
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible master: tripleo-container-manage: port paunch-services  https://review.opendev.org/69340808:49
openstackgerritGael Chamoulaud proposed openstack/python-tripleoclient stable/train: Get rid of Mistral for listing validations  https://review.opendev.org/69378508:49
openstackgerritGael Chamoulaud proposed openstack/python-tripleoclient stable/train: Get rid of Mistral for running Validations by Groups  https://review.opendev.org/69378608:49
openstackgerritGael Chamoulaud proposed openstack/python-tripleoclient stable/train: Drop Mistral support for the Validations CLI  https://review.opendev.org/69378708:49
*** d0ugal has joined #tripleo08:50
openstackgerritLuca Miccini proposed openstack/puppet-tripleo master: Improve stonith leves idempotency.  https://review.opendev.org/69378808:52
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible master: tripleo-container-manage: fix duplicated loop vars  https://review.opendev.org/69350608:53
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible master: tripleo-container-manage: skip some tasks in check mode  https://review.opendev.org/69351208:54
*** numans_ has joined #tripleo08:55
*** pkopec has joined #tripleo08:58
*** rpittau|afk is now known as rpittau08:59
*** ayoung has joined #tripleo09:00
*** jpich has joined #tripleo09:00
*** alexmcleod has joined #tripleo09:03
*** bogdando has joined #tripleo09:03
*** chem has joined #tripleo09:09
*** xek_ has joined #tripleo09:09
*** paramite has joined #tripleo09:14
*** iurygregory has quit IRC09:17
openstackgerritDaniel Bengtsson proposed openstack/python-tripleoclient master: Use python -m pip instead pip command.  https://review.opendev.org/69350209:18
*** iurygregory has joined #tripleo09:18
openstackgerritBogdan Dobrelya (bogdando) proposed openstack/puppet-tripleo master: Allow Neutron agents call mount via rootwrap  https://review.opendev.org/69352109:20
openstackgerritLuca Miccini proposed openstack/puppet-pacemaker master: Allow updating stonith levels  https://review.opendev.org/69379309:21
openstackgerritBogdan Dobrelya (bogdando) proposed openstack/tripleo-common master: Limited retry until we no longer have collisions  https://review.opendev.org/69277709:21
*** ykarel is now known as ykarel|lunch09:23
openstackgerritMartin Mágr proposed openstack/puppet-tripleo master: Fill sslProfile only when it is defined  https://review.opendev.org/69379409:24
mschuppertcould I please get another core review on https://review.opendev.org/693683 ?09:26
*** hjensas has joined #tripleo09:26
mschuppertthanks EmilienM09:28
*** sshnaidm|off is now known as sshnaidm|rover09:30
*** dsneddon_ has joined #tripleo09:34
*** dsneddon_ has quit IRC09:38
*** a14a has joined #tripleo09:39
*** irclogbot_3 has quit IRC09:39
a14ahi everyone! i've been over the documentation but am still in doubt about this: to deploy redundant controllers, we need pacemaker, and for pacemaker we need docker. is this still true in Train, with all the docker removal warnings and whatnot? Or was this approach supplanted by a podman-based solution? I've deployed train on centos7.09:40
openstackgerritDougal Matthews proposed openstack/tripleo-common master: Testing  https://review.opendev.org/69297709:41
*** irclogbot_0 has joined #tripleo09:41
*** tosky has quit IRC09:41
*** tosky has joined #tripleo09:42
*** ksambor has quit IRC09:42
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates master: Configure SNMP on undercloud  https://review.opendev.org/65676009:44
*** rcernin has joined #tripleo09:45
EmilienMmschuppert: no problem09:46
*** apetrich has quit IRC09:47
*** ayoung has quit IRC09:47
openstackgerritMichele Baldessari proposed openstack/puppet-pacemaker master: Pin rake to < 13.0.0 and dry-inflector to 0.1.2  https://review.opendev.org/69351709:48
*** jpich has quit IRC09:48
*** jpich has joined #tripleo09:48
*** shyamb has quit IRC09:49
*** ayoung has joined #tripleo09:50
openstackgerritBogdan Dobrelya (bogdando) proposed openstack/puppet-tripleo master: Allow Neutron agents call mount via rootwrap  https://review.opendev.org/69352109:50
*** jaosorior has joined #tripleo09:51
openstackgerritBogdan Dobrelya (bogdando) proposed openstack/puppet-tripleo stable/queens: Allow Neutron agents call mount via rootwrap  https://review.opendev.org/69379809:51
*** florianf has quit IRC09:52
*** tosky_ has joined #tripleo09:52
*** tosky has quit IRC09:54
*** slagle has quit IRC09:56
openstackgerritBogdan Dobrelya (bogdando) proposed openstack/tripleo-heat-templates stable/queens: Rebind broken netns upon l3/dhcp containers start  https://review.opendev.org/69336909:58
*** tosky has joined #tripleo09:58
*** apetrich has joined #tripleo09:59
*** tosky_ has quit IRC10:01
*** gfidente|afk is now known as gfidente10:03
*** tosky_ has joined #tripleo10:05
*** tosky has quit IRC10:08
*** rfolco has joined #tripleo10:08
*** soniya29 has joined #tripleo10:10
*** rcernin has quit IRC10:11
openstackgerritMarios Andreou proposed openstack/tripleo-ci master: Add component_ci_containers in build-containers for component ci  https://review.opendev.org/69298510:12
openstackgerritMarios Andreou proposed openstack/tripleo-ci master: Move vars/common.yaml to main.yaml for buildimages and containers  https://review.opendev.org/69380210:12
*** tosky has joined #tripleo10:14
openstackgerritMichele Baldessari proposed openstack/puppet-pacemaker master: Pin a bunch of gems so that centos 7 with old ruby still works  https://review.opendev.org/69351710:16
*** tosky_ has quit IRC10:17
*** tosky_ has joined #tripleo10:21
*** tosky has quit IRC10:24
*** panda has quit IRC10:24
*** shyamb has joined #tripleo10:26
*** ratailor_ has joined #tripleo10:26
*** ratailor has quit IRC10:27
*** florianf has joined #tripleo10:28
*** panda has joined #tripleo10:29
*** tosky has joined #tripleo10:34
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates master: Split QDR environment from collectd  https://review.opendev.org/69380510:35
*** dsneddon_ has joined #tripleo10:35
*** tosky_ has quit IRC10:36
*** soniya29 has quit IRC10:37
paramiteGreetings guys, I have a CI problem in https://review.opendev.org/#/c/686282/. If I add MetricsQdrPublic to environments/ssl/no-tls-endpoints-public-ip.yaml pep8 check complains that the record is there and if I remove it another step of pep8 check complains that the record is not there. I assume that the check is correct, but I really don't know what am I doing wrong. Can somebody please help me?10:39
*** dsneddon_ has quit IRC10:39
*** tosky_ has joined #tripleo10:43
*** tosky has quit IRC10:45
*** ykarel|lunch has quit IRC10:46
*** shyamb has quit IRC10:46
*** shyam89 has joined #tripleo10:46
*** tosky_ has quit IRC10:46
*** tosky has joined #tripleo10:46
*** rcernin has joined #tripleo10:50
*** bhagyashris has quit IRC10:54
*** ratailor__ has joined #tripleo10:55
*** suuuper has joined #tripleo10:56
*** ratailor_ has quit IRC10:57
*** tosky has quit IRC11:01
*** tosky has joined #tripleo11:01
*** shyam89 has quit IRC11:03
*** tosky_ has joined #tripleo11:05
*** a14a has quit IRC11:05
*** tosky has quit IRC11:06
*** chem is now known as chem|brb11:07
*** tosky_ has quit IRC11:09
*** tosky has joined #tripleo11:09
*** jaosorior has quit IRC11:10
*** ksambor has joined #tripleo11:10
*** xek_ has quit IRC11:12
openstackgerritGael Chamoulaud proposed openstack/python-tripleoclient master: [WIP] TripleO Validator CLI Refactor  https://review.opendev.org/69355211:14
*** ksambor has quit IRC11:15
*** ksambor has joined #tripleo11:15
*** ykarel|lunch has joined #tripleo11:15
*** ksambor has quit IRC11:16
openstackgerritBogdan Dobrelya (bogdando) proposed openstack/puppet-tripleo master: Allow Neutron agents call mount via rootwrap  https://review.opendev.org/69352111:16
*** udesale has quit IRC11:17
*** tosky has quit IRC11:17
*** ykarel|lunch is now known as ykarel11:18
openstackgerritBogdan Dobrelya (bogdando) proposed openstack/puppet-tripleo stable/queens: Allow Neutron agents call mount via rootwrap  https://review.opendev.org/69379811:19
openstackgerritBogdan Dobrelya (bogdando) proposed openstack/tripleo-heat-templates stable/queens: Rebind broken netns upon l3/dhcp containers start  https://review.opendev.org/69336911:19
*** chem|brb is now known as chem11:20
openstackgerritBogdan Dobrelya (bogdando) proposed openstack/tripleo-heat-templates stable/queens: Rebind broken netns upon l3/dhcp containers start  https://review.opendev.org/69336911:21
ykarelparamite, try updating tripleo-heat-templates/sample-env-generator/ssl.yaml11:23
*** tosky has joined #tripleo11:23
*** rcernin has quit IRC11:26
openstackgerritMichele Baldessari proposed openstack/puppet-pacemaker master: Pin a bunch of gems so that centos 7 with old ruby still works  https://review.opendev.org/69351711:29
*** shyamb has joined #tripleo11:31
paramiteykarel, oh, thanks11:32
paramitewill do11:32
*** ksambor has joined #tripleo11:33
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates master: [WIP] Enable external public endpoint for MetricsQdr  https://review.opendev.org/68628211:35
*** ramishra has quit IRC11:35
*** dsneddon_ has joined #tripleo11:35
*** ksambor has joined #tripleo11:36
*** ksambor has quit IRC11:36
sshnaidm|roverykarel, jpena cloudnull please review https://review.rdoproject.org/r/#/c/23660/11:40
*** dprince has joined #tripleo11:40
*** dprince has quit IRC11:40
* ykarel looks11:40
*** dsneddon_ has quit IRC11:40
*** surpatil has quit IRC11:40
*** dprince has joined #tripleo11:40
*** aedc_ has joined #tripleo11:46
*** aedc has quit IRC11:47
*** tosky_ has joined #tripleo11:47
*** ykarel_ has joined #tripleo11:49
*** tosky has quit IRC11:49
*** tosky has joined #tripleo11:50
*** ykarel has quit IRC11:51
*** tosky_ has quit IRC11:53
*** aedc_ has quit IRC11:53
*** ayoung has quit IRC11:53
*** ayoung has joined #tripleo11:55
*** surpatil has joined #tripleo12:00
*** dsneddon_ has joined #tripleo12:00
openstackgerritSorin Sbarnea proposed openstack/tripleo-ansible master: WIP: Fix pre-commit  https://review.opendev.org/69382612:01
openstackgerritLuca Miccini proposed openstack/puppet-tripleo master: Improve stonith leves idempotency.  https://review.opendev.org/69378812:03
*** avivgts has joined #tripleo12:12
*** ayoung has quit IRC12:13
*** ayoung has joined #tripleo12:15
openstackgerritMerged openstack/tripleo-ansible master: Fix ssh_known_hosts hostname entries  https://review.opendev.org/69368312:16
*** dprince has quit IRC12:21
*** morazi has joined #tripleo12:23
*** shyamb has quit IRC12:26
*** jpena is now known as jpena|lunch12:26
*** amoralej is now known as amoralej|lunch12:27
openstackgerritMartin Schuppert proposed openstack/tripleo-ansible stable/train: Fix ssh_known_hosts hostname entries  https://review.opendev.org/69383112:28
*** ykarel_ is now known as ykarel|afk12:28
*** shyamb has joined #tripleo12:30
*** ssbarnea has quit IRC12:38
*** csmart has quit IRC12:39
*** ratailor__ has quit IRC12:39
*** openstackgerrit has quit IRC12:41
*** raildo has joined #tripleo12:47
*** ykarel_ has joined #tripleo12:49
*** rlandy has joined #tripleo12:50
*** ykarel|afk has quit IRC12:52
*** ykarel_ is now known as ykarel|afk12:53
*** rlandy is now known as rlandy|ruck12:54
*** weshay|rover is now known as weshay12:54
*** ekultails has joined #tripleo12:54
*** sshnaidm|rover is now known as sshnaidm|ruck12:55
*** rlandy|ruck is now known as rlandy|over12:55
*** rlandy|over is now known as rlandy|rover12:56
*** shyam89 has joined #tripleo12:56
*** shyamb has quit IRC12:56
*** jaosorior has joined #tripleo12:57
*** shyam89 has quit IRC13:00
*** shyamb has joined #tripleo13:00
*** surpatil has quit IRC13:00
*** soniya29 has joined #tripleo13:03
*** dsneddon_ has quit IRC13:03
*** shyamb has quit IRC13:05
*** hberaud has joined #tripleo13:07
*** rh-jelabarre has joined #tripleo13:07
*** dprince has joined #tripleo13:10
*** openstackgerrit has joined #tripleo13:15
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates master: Split QDR environment from collectd  https://review.opendev.org/69380513:15
openstackgerritMartin Mágr proposed openstack/puppet-tripleo master: Fill sslProfile only when it is defined  https://review.opendev.org/69379413:17
*** soniya29 has quit IRC13:22
*** mcornea has joined #tripleo13:23
*** bcafarel has quit IRC13:24
*** jpena|lunch is now known as jpena13:27
*** markllama has quit IRC13:35
*** ansmith has joined #tripleo13:35
*** markllama has joined #tripleo13:35
*** amoralej|lunch is now known as amoralej13:39
*** csmart has joined #tripleo13:41
*** ksambor has joined #tripleo13:41
*** ssbarnea has joined #tripleo13:41
*** ksambor has quit IRC13:43
*** rlandy|rover is now known as rlandy|rover|mtg13:45
*** Goneri has joined #tripleo13:48
*** bcafarel has joined #tripleo13:50
arxcruzfultonj: hey, this is a job that runs with our ceph-ansible rpm build, can you check if the failure is a real failure?13:51
arxcruzfultonj: http://logs.rdoproject.org/42/23642/4/check/tripleo-ceph-integration-rhel-8-scenario004-standalone/53efa5b/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz13:52
arxcruzfultonj: this is a rpm built from ceph-ansible master13:52
*** dprince has quit IRC13:53
*** abishop has joined #tripleo13:55
*** rlandy|rover|mtg is now known as rlandy|rover13:59
*** dsneddon_ has joined #tripleo14:00
weshay#startmeeting tripleo14:00
openstackMeeting started Tue Nov 12 14:00:38 2019 UTC and is due to finish in 60 minutes.  The chair is weshay. Information about MeetBot at http://wiki.debian.org/MeetBot.14:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.14:00
*** openstack changes topic to " (Meeting topic: tripleo)"14:00
openstackThe meeting name has been set to 'tripleo'14:00
weshay#topic agenda14:01
weshay* Review past action items14:01
weshay* One off agenda items14:01
weshay* Squad status14:01
weshay* Bugs & Blueprints14:01
weshay* Projects releases or stable backports14:01
*** openstack changes topic to "agenda (Meeting topic: tripleo)"14:01
weshay* Specs14:01
weshay* open discussion14:01
weshayAnyone can use the #link, #action and #info commands, not just the moderatorǃ14:01
weshayHey folks! who's around?14:01
fultonjo/14:01
rlandy|rovero/14:01
pkopeco/14:01
chandankumar\o/14:01
marioso/14:01
mschupperto/14:01
rfolcoo/14:01
*** ykarel|afk is now known as ykarel14:02
redrobot14:03
weshaywaive your hands in the air...14:03
arxcruzo/14:04
weshaydon't be shy.. lurkers14:04
bogdandoo/14:04
weshay#topic review past action items14:04
*** openstack changes topic to "review past action items (Meeting topic: tripleo)"14:04
ykarelo/14:04
weshaylooks like we're clear on past action items14:04
weshay#topic one off agenda items14:05
*** openstack changes topic to "one off agenda items (Meeting topic: tripleo)"14:05
weshay#link https://etherpad.openstack.org/p/tripleo-meeting-items14:05
gchamoulo/14:05
sshnaidm|rucko/14:05
*** dsneddon_ has quit IRC14:05
weshayso I think EmilienM had an agenda items re: paunch but he is traveling14:05
weshayof course another agenda item would be reviewing the ptg14:06
weshayI have sent out a summary, but it's not public yet.. it will be sent out later today to openstack-discuss, currently on another list14:06
ccamachoo/14:06
weshayany follow ups items from ptg that anyone would like to raise here?14:07
*** xek_ has joined #tripleo14:07
weshayI will mention this in a second as well14:07
weshayhowever I will be sending out some requests for blueprints in ussuri14:08
weshayit's going to be import as we obviously had a one off ptg cycle14:08
weshayimportant14:08
weshayso just a reminder to get blueprints in for ussuri... I think the current plan will be to have a virtual mid-cycle in January14:09
weshayquestions / comments?14:09
sshnaidm|ruckvirtual only?14:09
weshaynothing set in stone yet, but that seems to be the preference with those I've socialized it with14:10
EmilienMI didn't add an agenda item but I'm happy to discuss about it if needed14:10
weshayEmilienM, re: paunch as you wish14:10
EmilienMI'll present it to the CI team tomorrow14:10
weshayok14:10
weshayanything else?14:11
weshaymoving on14:11
weshay#topic Squad status14:11
weshayci14:11
weshay#link https://etherpad.openstack.org/p/tripleo-ci-squad-meeting14:11
weshayupgrade14:11
weshay#link https://etherpad.openstack.org/p/tripleo-upgrade-squad-status14:11
weshayedge14:11
*** openstack changes topic to "Squad status (Meeting topic: tripleo)"14:11
weshay#link https://etherpad.openstack.org/p/tripleo-edge-squad-status14:11
weshayintegration14:11
weshay#link https://etherpad.openstack.org/p/tripleo-integration-squad-status14:11
weshayvalidations14:11
weshay#link https://etherpad.openstack.org/p/tripleo-validations-squad-status14:11
weshaynetworking14:12
weshay#link https://etherpad.openstack.org/p/tripleo-networking-squad-status14:12
weshaytransformation14:12
weshay#link https://etherpad.openstack.org/p/tripleo-ansible-agenda14:12
*** wznoinsk has joined #tripleo14:12
weshayupgrades / ci squads me notes that train update / upgrade jobs should be made to pass, vote and gate at this time14:12
weshayccamacho, can you please help me communicate that back to the upgrade squad14:12
weshaymatbu, I believe is looking at some issues14:13
ccamachoweshay sure thing14:13
weshayAny squad wanting to bring up their status, or a topic for the general public?14:13
weshaygoing once, twice.....14:14
weshay#topic bugs & blueprints14:14
*** openstack changes topic to "bugs & blueprints (Meeting topic: tripleo)"14:14
fultonjweshay: regarding blueprints, you asked me about glance-cache yesterday; i want to move it to U and add two more to U14:14
fultonjwere you asking about glance-cache to see if it needs to be moved to U?14:14
weshay++14:14
weshayfultonj, there are a number of blueprints that probably need to be triaged and moved.. I will be reviewing that and sending out some emails to openstack-discuss[tripleo]14:15
weshay#link https://launchpad.net/tripleo/+milestone/ussuri-114:16
weshayFor Ussuri we currently have 3 blueprints and 634 (+113) open Launchpad Bugs.  91 (-75) open Storyboard bugs.14:16
weshay#link https://storyboard.openstack.org/#!/project_group/7614:16
fultonjweshay: i can move them the way I think they should be moved and send you an email to see if you agree with how they were moved.14:16
weshaythat sounds good14:17
weshayone note to everyone....  I saw an email from infra ( clark ) that at the ptg it was decided that upstream will move to storyboard after they spend some cycles fixing and improving storyboard14:18
weshayI didn't have time to find that link.. it's not going to happen soon, but afaik it will replace our use of launchpad.   I know they've been saying this for a while, but it looks like this is a refresh of that initiative14:18
fultonjweshay: so our LP bugs should be closed or moved to storyboard?14:19
fultonjduring U?14:19
*** ykarel_ has joined #tripleo14:19
weshayfultonj, I don't think it will happen in U14:19
weshaybut I will be tracking their work and instructions14:19
fultonjISTR a script to do the transition, might that be brought back to life?14:19
* weshay is just telegraphing that well in advance14:20
weshayI'll forward the email to [tripleo] for visibility14:20
openstackgerritMerged openstack/puppet-pacemaker master: Pin a bunch of gems so that centos 7 with old ruby still works  https://review.opendev.org/69351714:20
weshayI don't have the answers to any of those questions at this time14:20
weshay#topic specs14:21
weshay#link https://review.openstack.org/#/q/project:openstack/tripleo-specs+status:open14:21
*** openstack changes topic to "specs (Meeting topic: tripleo)"14:21
weshayany specs anyone would like to raise here at this time?14:21
*** ayoung has quit IRC14:21
*** ykarel has quit IRC14:22
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible master: tripleo-container-manage: use async  https://review.opendev.org/69321614:22
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible master: tripleo-container-manage: use async  https://review.opendev.org/69321614:22
weshay#topic open discussion14:23
weshayAnything else that folks want to bring up to the meeting?14:23
*** openstack changes topic to "open discussion (Meeting topic: tripleo)"14:23
sshnaidm|ruckplease review https://review.rdoproject.org/r/#/c/23660/14:23
sshnaidm|ruckI'd like to run some molecule tripleo-ansible jobs on rhel14:23
sshnaidm|ruckto see if roles work fine on podman and ansible versions of rhel814:24
weshaynice... thanks!14:24
*** ayoung has joined #tripleo14:24
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible master: tripleo-container-manage: port paunch-services  https://review.opendev.org/69340814:24
weshaythe other announcement I have is that there another delay in CentOS-8 rdo rpm builds14:24
weshaywe were hoping to stand up CentOS-8 in a couple weeks, however that is probably getting pushed out further due to CentOS-8 build issues14:25
weshayany questions / comments re: centos-8?14:25
*** abishop has quit IRC14:25
weshaythanks all!!!14:25
weshay#endmeeting tripleo14:25
*** openstack changes topic to "CI Status: Orange (be kind with recheck and +A, watch for zuul queue) | community irc meeting Tues@1400 UTC - tripleo-ci-community meeting Tues@1330 UTC | https://docs.openstack.org/tripleo-docs"14:25
openstackMeeting ended Tue Nov 12 14:25:49 2019 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)14:25
openstackMinutes:        http://eavesdrop.openstack.org/meetings/tripleo/2019/tripleo.2019-11-12-14.00.html14:25
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/tripleo/2019/tripleo.2019-11-12-14.00.txt14:25
openstackLog:            http://eavesdrop.openstack.org/meetings/tripleo/2019/tripleo.2019-11-12-14.00.log.html14:25
ykarel_weshay, any plan for new tags for stein tripleo, ex https://github.com/openstack/tripleo-heat-templates/compare/10.6.1...stable/stein14:26
openstackgerritSorin Sbarnea proposed openstack/tripleo-ansible master: Fix pre-commit execution  https://review.opendev.org/69382614:26
weshayykarel_, for the tht templates? None atm but probably a good topic to add to the next agenda14:29
weshayhttps://etherpad.openstack.org/p/tripleo-meeting-items14:30
ykarel_weshay, ack, i shared tht as an example, but i think tight coupling with other tripleo projects, tag release needs for other tripleo projects as well14:30
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible master: tripleo-container-manage: fix duplicated loop vars  https://review.opendev.org/69350614:30
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible master: tripleo-container-manage: skip some tasks in check mode  https://review.opendev.org/69351214:31
*** ksambor has joined #tripleo14:31
*** ansmith_ has joined #tripleo14:31
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Disable Paunch on the undercloud job (fs027)  https://review.opendev.org/69256814:31
rlandy|roverbandini: hi - to follow up on https://bugs.launchpad.net/tripleo/+bug/1851847 - what is the correct version of pacemaker to have in master  on rhel atm? from what we can tell, it's pacemaker.x86_64 2.0.2-3.el8 @rhui-rhel-8-for-x86_64-highavailability-rhui-rpms14:31
openstackLaunchpad bug 1851847 in tripleo "rhel-8-scenario004 fails to deploy standalone - error while resolving custom fact \"rabbitmq_nodename\": undefined method `[]' for nil:NilClass"" [Critical,Triaged] - Assigned to Ronelle Landy (rlandy)14:31
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: DNM: testing async for tripleo-container-manage  https://review.opendev.org/69260814:31
rlandy|roversshnaidm|ruck: ^^14:31
rlandy|roverykarel: ^^ fyi - maybe you have insight here14:32
rlandy|roverwe checked in with amoralej yesterday on the versions of pacemaker and they seem to match14:32
rlandy|roverykarel_: ^^14:32
rlandy|roverwe tested rhos-16 and train as comparisons and those are fine14:33
rlandy|roverrhel 8,1 vs rhel 8.0?14:33
fultonjarxcruz: i'm on a call ATM but let me see if i can help with your question regarding http://logs.rdoproject.org/42/23642/4/check/tripleo-ceph-integration-rhel-8-scenario004-standalone/53efa5b/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz14:33
bandinirlandy|rover: so the version of pacemaker,corosync,libqb have to be the same as on the host. so if the host has rhel 8.0 then the containers need the same as rhel 8.0, same goes for rhel 8.114:33
amoralejrlandy|rover, is it still failing?14:33
*** ansmith has quit IRC14:33
ykarel_rlandy|rover, ack /me will check lp, and see if i can find something14:33
*** abishop has joined #tripleo14:33
fultonjarxcruz: it looks like you're hitting a bug for which we have a workaround (it came up at ooo bootcamp)14:33
* fultonj looks for the bug14:34
fultonjbasically the mons can't get qurorm14:34
*** ansmith has joined #tripleo14:34
arxcruzfultonj: take your time, if it's a real issue, we are fine14:34
rlandy|roveramoralej: ack but we're a bit stuck here14:34
rlandy|roverconsistent failure on master train is fine14:34
rlandy|roverwe checked rhos-release as a comparison - that seems ok14:35
fultonj  CephAnsibleExtraConfig:14:35
amoralejrlandy|rover, so it's failing both in periodic and cin check?14:35
fultonj        mon_host_v1: { 'enabled': False }14:35
fultonjarxcruz: ^14:35
fultonjare you using ^ ?14:35
ykarel_weshay, added item for next meeting, but i might miss next meeting:- https://etherpad.openstack.org/p/tripleo-meeting-items14:35
rlandy|roverthe node should be 8.114:35
rlandy|roveron rdocloud14:35
rlandy|roveramoralej: ack - fails in check and periodic14:35
arxcruzfultonj: i don't think so14:35
arxcruzlet me check14:35
amoralejin periodic it should never fail because of mismatch14:36
amoralejas it uses containers just built from latest rhui14:36
amoralejlemme check14:36
*** ayoung has quit IRC14:36
*** ansmith_ has quit IRC14:36
rlandy|roverI know - it should ... the node in rdocloud was updated recently14:36
arxcruzfultonj: yes, both scen001 and scen004 have it https://opendev.org/openstack/tripleo-heat-templates/src/branch/master/ci/environments/scenario004-standalone.yaml#L5614:37
openstackgerritSorin Sbarnea proposed openstack/tripleo-ansible master: Fix pre-commit execution  https://review.opendev.org/69382614:38
arxcruzfultonj: it's running on rhel8 btw14:38
*** TrevorV has joined #tripleo14:39
* fultonj on call14:39
arxcruzfultonj: :-#14:39
fultonjfmount: ^ fyi14:40
fultonjarxcruz: ok need to focus on a call now14:40
openstackgerritMichele Baldessari proposed openstack/puppet-pacemaker master: Add a more clear error message when we fail to backup cib  https://review.opendev.org/69325114:40
rlandy|roverhttp://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-scenario004-standalone-master/5be9f6f/ - latest periodic logs14:41
ykarel_rlandy|rover, it's failing in both check and periodic, right?14:42
ykarel_scenario00414:42
rlandy|roverykarel_: yes14:42
rlandy|roverand ovb14:42
ykarel_rlandy|rover, and only master, right?14:42
amoralejrlandy|rover, where did you see error "Error: unable to get cib"14:42
rlandy|roverbut the installed version and the containers do seem to match14:42
amoralejin last periodic scenario00414:42
amoraleji see14:42
amoralejpodman(galera-bundle-podman-0)[80315]: ERROR: Error: error checking path "/var/log/mariadb": stat /var/log/mariadb: no such file or directory14:43
ykarel_rlandy|rover, if the answer is yes, it's possibly due to unpin of puppet modules in master:- https://review.rdoproject.org/r/#/c/23533/14:43
rlandy|rovermight have been in the ovb job14:43
ykarel_and some unpinned moduled is not working with rhel14:43
rlandy|rover8 days ago seems like the right timeline14:44
ykarel_https://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-rhel-8-scenario004-standalone-rdo&result=SUCCESS14:44
* ykarel_ check versions there to confirm as it's date is 5-1114:45
mwhahahabut we didn't unpin mysql14:45
mwhahahadid we?14:45
mwhahahasince it's pacemaker, i blame bandini14:45
openstackgerritMerged openstack/tripleo-docs master: Fix prometheus port in the upstream doc  https://review.opendev.org/69355814:46
bandinimwhahaha: you would be (once more) entirely correct14:46
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates master: [DNM] Testing Rear patch  https://review.opendev.org/69069814:46
ykarel_repodiff --old http://trunk.rdoproject.org/rhel8-master/2c/f6/2cf6806c1829bf1ac0915f78ec319f07967f254b_6e1b0f7f --new http://trunk.rdoproject.org/rhel8-master/current |grep puppet-14:48
ykarel_from last success to recent14:48
ykarel_and i see non-openstack puppet modules, so it seems related14:48
sshnaidm|ruckamoralej, that was logs patch in tht..14:49
*** dtrainor has quit IRC14:50
*** dtrainor has joined #tripleo14:50
sshnaidm|ruckamoralej, https://github.com/openstack/tripleo-heat-templates/compare/164dae2..8fad46f14:51
fmountfultonj: arxcruz sorry if I'm late, looking at the logs14:52
openstackgerritBrent Eagles proposed openstack/tripleo-quickstart master: WIP: parameterize amphora download path  https://review.opendev.org/69285714:52
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates stable/rocky: Configure amphora for upload and run tempest  https://review.opendev.org/69257814:54
*** ykarel_ is now known as ykarel|afk14:59
fmountmmm arxcruz not sure is the v1/v2 issue, but at least I think you can re-kick the job adding14:59
fmountCephAnsibleExtraConfig:14:59
fmountmon_host_v1: { 'enabled': False }15:00
*** tosky_ has joined #tripleo15:00
arxcruzfmount: it's already set to false on ci/environment/scenario001.yaml15:00
*** tosky has quit IRC15:00
fmountah ok15:00
arxcruzand 004 as well15:00
arxcruzfmount: https://opendev.org/openstack/tripleo-heat-templates/blame/branch/master/ci/environments/scenario004-standalone.yaml15:00
fmountah ok perfect15:00
arxcruzhttps://opendev.org/openstack/tripleo-heat-templates/src/branch/master/ci/environments/scenario001-standalone.yaml15:01
*** dsneddon_ has joined #tripleo15:01
*** tosky_ is now known as tosky15:01
*** ysandeep has joined #tripleo15:02
*** mcornea has quit IRC15:02
fmountarxcruz: I'm on a mtg but I'm going to analyze in depth the logs as soon as possible ^15:05
fmountarxcruz: https://logs.rdoproject.org/42/23642/4/check/tripleo-ceph-integration-rhel-8-scenario004-standalone/53efa5b/logs/undercloud/var/log/extra/podman/containers/ceph-mon-standalone/stdout.log.txt.gz <= you're right, the v1 is disabled (mon log)15:06
*** dsneddon_ has quit IRC15:06
openstackgerritSorin Sbarnea proposed openstack/tripleo-ansible master: normalize newlines at end of file  https://review.opendev.org/69385815:07
Tengufolks, care to make those changes merge shortly? https://review.opendev.org/#/q/topic:mistral-removal-train+(status:open+OR+status:merged)   thank you!15:13
*** ksambor has quit IRC15:14
*** mcornea has joined #tripleo15:16
*** ysandeep has quit IRC15:20
*** lbragstad_ is now known as lbragstad15:20
*** rfolco is now known as rfolco|brbr15:22
*** rfolco|brbr is now known as rfolco|brb15:22
openstackgerritSorin Sbarnea proposed openstack/tripleo-ansible master: Fix pre-commit execution  https://review.opendev.org/69382615:24
*** ansmith has quit IRC15:26
*** pcaruana has joined #tripleo15:28
*** tosky has quit IRC15:31
*** tosky has joined #tripleo15:32
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Get rid of docker removing in post_upgrade tasks.  https://review.opendev.org/68166915:34
zbrcloudnull: hi! re reqs, any recomandation on how to deal with them?15:34
cloudnullo/15:35
cloudnull?15:35
openstackgerritBrent Eagles proposed openstack/tripleo-quickstart-extras master: WIP: Allow full path to be specified for amphora destination  https://review.opendev.org/69285815:35
zbrbecause i do not think is correct to install molecule inside linters env, as is not needed.15:35
cloudnullI guess you could make another requirements file ?15:36
zbrafaik there are ~3 categories of reqs: runtime, test (func/unit) like molecule, and linters.15:36
cloudnullI'm not sure installing molecule in the linters venv is needed, but also im not sure it really hurts15:37
cloudnullhowever, we could easily put things in new/different files15:37
zbrkeeping linters out of test is usually a good idea to avoid polution.15:37
cloudnullwe just cant put ansible requirements in the requirements.txt file15:37
cloudnullwhich is managed upstream15:37
zbrcloudnull: also there is the option to re-use some tox envs, to avoid taking too much space un user disk (deduplication)15:38
zbrsure, i understood that aspect, i will put it back.15:38
cloudnull++15:38
zbr(with a note)15:38
*** aedc has joined #tripleo15:39
*** ade_lee has joined #tripleo15:41
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates master: [DNM] Testing Rear patch  https://review.opendev.org/69069815:44
openstackgerritMerged openstack/tripleo-heat-templates stable/stein: Correct mysql-pacemaker upgrade task  https://review.opendev.org/69377315:45
zbrcloudnull: molecule is needed only by two tox envs: modules and role-addition, we could use a single test environment but with a small risk, of adding something from molecule that may be needed at runtime and we would fail to spot it with tox. worth the risk? (we already have deployment jobs).15:46
cloudnullprobably worth a try .15:47
zbrin case i was not clear, i was refering to the envdir trick, as mentioned in https://blog.ionelmc.ro/2015/04/14/tox-tricks-and-patterns/ (very good article)15:48
zbrcloudnull: sure, doing it now. the footprint for development is going down considerably.15:48
*** avivgts has quit IRC15:50
cloudnull++ we did have consolated envs early on. While it mostly worked, it created some weird issues at runtime, however, those problems may no longer be present given the repo structure.15:50
cloudnullso +1, I think its worth a try15:50
cloudnullif we can make it go, that'd be great15:50
*** ade_lee has quit IRC15:50
*** ade_lee has joined #tripleo15:51
*** jpich has quit IRC15:51
cloudnullany chance cores are around, and want to give https://review.opendev.org/#/c/677237/ a review ?15:51
*** jpich has joined #tripleo15:52
EmilienMcschwede: I'm going to take over https://review.opendev.org/#/c/651204/ and address my own comments16:01
*** dsneddon_ has joined #tripleo16:02
openstackgerritJames Slagle proposed openstack/python-tripleoclient master: Handle config-download in progress in tripleoclient  https://review.opendev.org/69387016:02
EmilienMcloudnull: I'll look at https://review.opendev.org/#/c/677237/ asap16:03
cloudnullthanks EmilienM!16:04
mariosmigi: sorry added you by mistake to calendar event for tomorrow please ignore :D16:05
*** ykarel|afk is now known as ykarel16:05
openstackgerritJames Slagle proposed openstack/tripleo-common master: Remove checking for already running config_download_deploy  https://review.opendev.org/69387116:05
*** dsneddon_ has quit IRC16:07
*** ansmith has joined #tripleo16:10
openstackgerritMerged openstack/tripleo-docs master: DCN extraction should exclude Ceph variables  https://review.opendev.org/69193816:11
*** ksambor has joined #tripleo16:12
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: Improve Swift healthchecks  https://review.opendev.org/65120416:16
*** jaosorior has quit IRC16:18
*** ksambor has quit IRC16:18
openstackgerritMerged openstack/tripleo-ci master: Make scenario007-standalone vote + gate standalone-scenarios-full  https://review.opendev.org/67531316:22
openstackgerritMerged openstack/tripleo-ci master: lint: maintenance chore  https://review.opendev.org/69244016:22
openstackgerritMerged openstack/tripleo-heat-templates master: Updates for dcn/dcn-hci sample envs  https://review.opendev.org/69357216:22
*** bandini has quit IRC16:23
mjturekhey I'm hitting this error while building containers http://paste.openstack.org/show/785984/ full logs here https://centos.logs.rdoproject.org/tripleo-upstream-containers-build-master-ppc64le/1737/logs/logs/build.log16:23
mjturekanyone seen anything like this before? ^16:24
zbrcloudnull: added a comment on https://review.opendev.org/#/c/693858/1 -- but you should look at the job logs, ithink we have a zuul-logger issue: https://openstack.fortnebula.com:13808/v1/AUTH_e8fd161dc34c421a979a9e6421f823e9/zuul_opendev_logs_d37/693858/1/check/tripleo-ansible-centos-7-role-addition/d37a7b9/job-output.txt16:25
sshnaidm|ruckmwhahaha, does this error come from tripleoclient? as mjturek points to: https://centos.logs.rdoproject.org/tripleo-upstream-containers-build-master-ppc64le/1737/logs/logs/build.log16:26
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Enable additional Swift healtchecks  https://review.opendev.org/65120716:26
mwhahahasshnaidm|ruck: SystemError: The following jobs were incomplete: set([<Future at 0x3fffa340ff50 state=finished raised SystemError>]) ?16:28
mwhahahasshnaidm|ruck: yes thats from tripleoclient, means one of the buildah things failed16:28
mwhahahanot sure which one, probably need better debugging info out of the exception16:30
*** tesseract has quit IRC16:32
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Disable Paunch on the undercloud job (fs027)  https://review.opendev.org/69256816:32
openstackgerritSorin Sbarnea proposed openstack/tripleo-ansible master: WIP: Test alternative stdout callback  https://review.opendev.org/69387816:33
*** hberaud is now known as hberaud|school-r16:33
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: Improve Swift healthchecks  https://review.opendev.org/65120416:35
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Disable Paunch on the undercloud job (fs027)  https://review.opendev.org/69256816:35
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: DNM: testing async for tripleo-container-manage  https://review.opendev.org/69260816:36
*** lmiccini has quit IRC16:36
sshnaidm|ruckmwhahaha, yeah, all container build logs seems good16:37
*** hberaud|school-r is now known as hberaud16:39
mjturekmwhahaha: yeah it happens here https://github.com/openstack/tripleo-common/blob/master/tripleo_common/image/builder/buildah.py#L170-L177 does that give any hint? Is it failing to find all the deps?16:41
*** marios is now known as marios|out16:41
mwhahahamjturek: no so it's failing in the jobs we kick off, that's just the executor. The problem is that the exception is not very obvious16:41
mwhahahait's likely something threw an exception but it doesn't have any info16:42
mjturekahh so one of the containers threw an excetion?16:42
openstackgerritSorin Sbarnea proposed openstack/tripleo-ansible master: WIP: Add basic centos-8 jobs  https://review.opendev.org/69388216:42
mjturekexception*16:43
mwhahahaone of the actions yea16:43
mjturekgotcha, yeah the issue is that we have all those logs and we're not seeing anything fatal16:43
openstackgerritMerged openstack/tripleo-heat-templates stable/stein: Adds ceph-systemd tag in external_upgrade_tasks for systemd units  https://review.opendev.org/69366716:44
mjturekhttps://centos.logs.rdoproject.org/tripleo-upstream-containers-build-master-ppc64le/1739/logs/logs/containers-consolidated-builds.log16:44
*** jpena is now known as jpena|off16:46
*** skramaja has quit IRC16:46
*** tmazur has quit IRC16:47
mwhahahamjturek: why does mirror1.centos.org not work (but we try to use it alot)16:48
mjturekwell, it doesn't seem to exist lol16:48
mjturekwe're not sure how it got in there16:48
*** florianf has quit IRC16:48
*** marios|out has quit IRC16:49
mwhahahamjturek: we probably need to imrprove https://github.com/openstack/tripleo-common/blob/master/tripleo_common/image/builder/buildah.py#L189-L19316:49
mwhahahacause not_done is just an object but doesn't help us know which container failed16:49
mjturekfair enough16:49
mwhahahaso we might loop through not_done and print some thing else, kinda like we do for _exception16:50
mwhahahawould need to know what futures exposes16:50
mjturekthat makes sense, doing some digging16:53
mwhahahait's likely we might want to do soemthing similar where we for loop and print out the ._exception if exists16:56
*** rpittau is now known as rpittau|afk17:00
mjturekmwhahaha that makes sense, I'll throw a patch up!17:00
*** dtantsur is now known as dtantsur|afk17:02
*** dsneddon_ has joined #tripleo17:03
*** Tengu has quit IRC17:03
*** pcaruana has quit IRC17:03
*** Tengu has joined #tripleo17:05
*** Tengu has quit IRC17:06
*** iurygregory has quit IRC17:06
*** Tengu has joined #tripleo17:07
*** dsneddon_ has quit IRC17:08
*** bogdando has quit IRC17:09
openstackgerritMerged openstack/puppet-pacemaker master: Add a more clear error message when we fail to backup cib  https://review.opendev.org/69325117:10
*** ykarel is now known as ykarel|away17:11
*** hberaud is now known as hberaud|gone17:13
*** ansmith has quit IRC17:14
*** jpich has quit IRC17:14
*** Tengu has quit IRC17:16
*** Tengu has joined #tripleo17:18
*** ansmith has joined #tripleo17:18
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates stable/queens: Configure amphora for upload and run tempest  https://review.opendev.org/69257917:20
*** chandankumar is now known as rrrrrrrrrrrr17:29
*** rfolco|brb is now known as rfolco17:30
*** rrrrrrrrrrrr is now known as chandankumar17:34
openstackgerritMerged openstack/tripleo-heat-templates master: Configure SNMP on undercloud  https://review.opendev.org/65676017:37
openstackgerritTelles Mota Vidal Nóbrega proposed openstack/tripleo-heat-templates master: [DNM] Testing Rear patch  https://review.opendev.org/69069817:38
*** chandankumar is now known as raukadah17:38
*** dsneddon_ has joined #tripleo17:39
*** yprokule has quit IRC17:42
mwhahahabeagles: where do we remove stale netns from the host system?17:43
* mwhahaha forgets17:43
*** ykarel|away has quit IRC17:44
*** dsneddon_ has quit IRC17:46
openstackgerritSagi Shnaidman proposed openstack/tripleo-ansible master: DNM: WIP: Add basic centos-8 jobs  https://review.opendev.org/69389617:46
*** chem is now known as chem|eod17:46
openstackgerritAlex Schultz proposed openstack/tripleo-ansible master: Implement tripleo-systemd-wrapper role  https://review.opendev.org/69344217:53
ade_leemwhahaha, dciabrin weshay any chance ya'll can help dagnose whats wrong with my standalone setup --trying to do tls-e with standalone and running into rabbit issues for starters ..17:54
openstackgerritAlex Schultz proposed openstack/tripleo-ansible master: Implement tripleo-systemd-wrapper role  https://review.opendev.org/69344217:57
*** alexmcleod has quit IRC17:57
ade_leemwhahaha, dciabrin got a tmate if you can join ..17:58
dciabrinade_lee, hey o/ yeah i have 30min or so17:58
ade_leedciabrin, awesome -- let me pm you .17:58
sshnaidm|ruckzbr, cloudnull on centos8 there is podman 1.0.5 version18:00
sshnaidm|ruckzbr, cloudnull not sure this stone age version will work..18:00
dciabrinEmilienM, hey o/ on ade_lee's standalone env, OS::TripleO::Services::Pacemaker is bound to OS::Heat::None in the plan, any idea what we do wrong when we deploy? http://paste.openstack.org/show/785992/18:11
openstackgerritMerged openstack/tripleo-ansible stable/train: Fix ssh_known_hosts hostname entries  https://review.opendev.org/69383118:12
*** gfidente is now known as gfidente|afk18:12
dciabrinEmilienM, do we have to pass -e docker-ha.yaml explicitly for standalone?18:14
EmilienMdciabrin: no it should be the default downstream, but upstream doesn't add HA by default18:17
EmilienMuntil we get centos818:17
dciabrinEmilienM, ha! that's the reason probably, thanks18:19
*** aedc has quit IRC18:25
mwhahahaIt's not the default for standalone18:26
mwhahahaFor either18:26
mwhahahaWait maybe it is18:27
mwhahahaI forget18:27
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: kolla/overrides: add missing healthcheck for ironic-neutron-agent  https://review.opendev.org/69389918:31
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: kolla/overrides: add missing healthcheck for ironic-neutron-agent  https://review.opendev.org/69389918:32
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Disable Paunch on the undercloud job (fs027)  https://review.opendev.org/69256818:33
*** amoralej is now known as amoralej|off18:33
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: DNM: testing async for tripleo-container-manage  https://review.opendev.org/69260818:33
openstackgerritMerged openstack/tripleo-ansible master: Fix enabled_services to include all_nodes_extra_map_data  https://review.opendev.org/69372918:42
openstackgerritMerged openstack/tripleo-ansible master: Create role to do puppet cache actions  https://review.opendev.org/69375518:42
openstackgerritMerged openstack/tripleo-ansible master: Include ceph-ansible filter_plugins  https://review.opendev.org/69374918:42
*** dsneddon_ has joined #tripleo18:43
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible master: tripleo-container-manage: port paunch-services  https://review.opendev.org/69340818:44
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible master: tripleo-container-manage: fix duplicated loop vars  https://review.opendev.org/69350618:45
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible master: tripleo-container-manage: skip some tasks in check mode  https://review.opendev.org/69351218:45
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: DNM: testing async for tripleo-container-manage  https://review.opendev.org/69260818:45
*** dsneddon_ has quit IRC18:48
openstackgerritSagi Shnaidman proposed openstack/tripleo-ansible master: Use more exact path to Zuul source dir  https://review.opendev.org/69390418:55
*** slagle has joined #tripleo19:02
openstackgerritSagi Shnaidman proposed openstack/tripleo-ansible master: Use more exact path to Zuul source dir  https://review.opendev.org/69390419:04
slaglemschuppert: fultonj : can you review https://review.opendev.org/#/c/692909/ plz?19:04
*** pkopec has quit IRC19:05
*** morazi has quit IRC19:05
fultonjslagle: yes, i've been meaning to try that command19:10
openstackgerritSagi Shnaidman proposed openstack/tripleo-ansible master: DNM: just test previous patch  https://review.opendev.org/69390819:12
openstackgerritLuke Short proposed openstack/tripleo-common master: Escape invalid JSON characters during deployment.  https://review.opendev.org/69391019:19
*** dsneddon_ has joined #tripleo19:20
mwhahahasshnaidm|ruck, rlandy|rover: i think we broke stuff19:24
mwhahaha2019-11-12 17:28:30 | The error appears to be in '/usr/share/ansible/roles/tripleo-ssh-known-hosts/tasks/main.yml': line 46, column 7, but may19:24
mwhahahahttp://logs.rdoproject.org/69/681669/5/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/2994ab1/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz19:24
rlandy|roveroh dear19:24
rlandy|roverlooking19:25
mwhahahado you see that more?19:25
rlandy|roversshnaidm|ruck merged something this morning19:25
mwhahahahttps://review.opendev.org/#/c/693683/19:25
rlandy|roverlet's see19:25
sshnaidm|ruckrlandy|rover, not, it's different patch19:25
mwhahahai think it's https://review.opendev.org/#/c/693683/ cause oivb was broke on that19:25
sshnaidm|ruckrlandy|rover, what mwhahaha shows19:26
sshnaidm|ruckmwhahaha, let's revert?19:26
mwhahahayes19:26
openstackgerritAlex Schultz proposed openstack/tripleo-ansible master: Revert "Fix ssh_known_hosts hostname entries"  https://review.opendev.org/69391119:26
rlandy|roverthanks19:26
openstackgerritAlex Schultz proposed openstack/tripleo-ansible stable/train: Revert "Fix ssh_known_hosts hostname entries"  https://review.opendev.org/69391219:26
rlandy|roverand the cherry picks?19:27
mwhahahayea i got it (just those two)19:27
mwhahaha-^19:27
rlandy|roverok - I see19:27
rlandy|roverirc clash19:27
rlandy|roversshnaidm|ruck: fyi ... rdo registry is down19:31
rlandy|roverexpired certificate19:31
rlandy|roverbeing fixed now19:31
sshnaidm|ruckrlandy|rover, yeah, ack19:31
sshnaidm|ruckrlandy|rover, how didn't it come before..19:32
rlandy|rovermust have been recent - we promoted stein and train today19:33
rlandy|roverfailed on the rhel - master promotion after we fiddled with criteria19:33
sshnaidm|ruckrlandy|rover, this rhel resist to promote in all ways19:33
rlandy|roversshnaidm|ruck: we shall prevail19:34
rlandy|roverrhel will promote if it's the last thing we do19:35
sshnaidm|ruckwe bring the drama19:36
*** jaosorior has joined #tripleo19:39
*** sshnaidm|ruck is now known as sshnaidm|afk19:42
openstackgerritJohn Fulton proposed openstack/tripleo-ansible stable/train: Include ceph-ansible filter_plugins  https://review.opendev.org/69391319:43
openstackgerritMartin Mágr proposed openstack/puppet-tripleo master: Fill sslProfile only when it is defined  https://review.opendev.org/69379419:49
*** lbragstad has quit IRC19:50
*** lbragstad has joined #tripleo19:51
*** Goneri has quit IRC19:51
openstackgerritJohn Fulton proposed openstack/tripleo-heat-templates stable/stein: Include ceph-ansible filter_plugins  https://review.opendev.org/69391419:51
*** jfrancoa has quit IRC19:59
openstackgerritMerged openstack/tripleo-common stable/train: Fix ceilometer_agent_compute health check  https://review.opendev.org/69383620:02
openstackgerritMerged openstack/tripleo-common stable/stein: Fix ceilometer_agent_compute health check  https://review.opendev.org/69383720:02
openstackgerritMerged openstack/tripleo-common stable/rocky: Fix ceilometer_agent_compute health check  https://review.opendev.org/69384020:02
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates stable/train: Add ManageNetworks parameter  https://review.opendev.org/69391720:13
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates stable/train: Updates for dcn/dcn-hci sample envs  https://review.opendev.org/69391920:14
slaglefultonj: also https://review.opendev.org/#/c/693730/ if you could20:16
*** jaosorior has quit IRC20:16
openstackgerritJames Slagle proposed openstack/tripleo-ansible stable/train: Fix enabled_services to include all_nodes_extra_map_data  https://review.opendev.org/69392020:16
*** panda has quit IRC20:18
*** lbragstad has quit IRC20:19
*** lbragstad has joined #tripleo20:20
*** panda has joined #tripleo20:21
*** paramite has quit IRC20:41
*** slaweq has quit IRC20:47
openstackgerritLuke Short proposed openstack/tripleo-common master: Use the Mistral directory for storing the Ansible fact cache.  https://review.opendev.org/69393220:48
openstackgerritAlex Schultz proposed openstack/tripleo-specs master: Create ansible roles for cloud operator actions  https://review.opendev.org/69393320:48
mwhahahaweshay: -^ jfyi20:48
weshayoh hot dam :)20:49
openstackgerritAlex Schultz proposed openstack/tripleo-specs master: Create ansible roles for cloud operator actions  https://review.opendev.org/69393320:49
weshaymwhahaha++20:56
*** raildo has quit IRC20:59
*** rfolco has quit IRC21:01
openstackgerritMerged openstack/tripleo-quickstart-extras master: Clone os_tempest and it's dependencies in nodepool  https://review.opendev.org/69369821:01
*** rfolco has joined #tripleo21:01
*** Goneri has joined #tripleo21:02
*** rfolco has quit IRC21:06
*** suuuper has quit IRC21:06
*** TrevorV has quit IRC21:11
*** rcernin has joined #tripleo21:17
ade_leeEmilienM, mwhahaha does standalone only have ctlplane network defined?21:19
mwhahahayes21:19
ade_leeok21:20
mwhahahayou could define more (i think) though never tried because it's all a single node21:20
*** gfidente|afk has quit IRC21:30
*** xek_ has quit IRC21:31
marstHello! Can anyone help understand how tripleo configures networks on overlcoud? There are physical interfaces (ens6f0, ens3f0, ens3f1) and related eth[02] interfaces, yet it seems that os-net-config fails to apply configuration: with "Device ens6f0 does not seem to be present, delaying initialization". Configuration (http://paste.openstack.org/show/785997/ ) lgtm, but if I try to run "sudo os-net-config -c21:39
marst/etc/os-net-config/config.json" it also fail with the same error: device doesn't seem to be present.21:40
marstall I'm lefit with is a bunch of eth devices and it's a bit confusing )21:40
marsthttp://paste.openstack.org/show/785998/ - logs after manually applying os-net-config21:41
*** Goneri has quit IRC21:43
*** Goneri has joined #tripleo21:46
*** jfrancoa has joined #tripleo21:48
*** chem|eod has quit IRC21:48
*** mcornea has quit IRC21:52
*** mcornea has joined #tripleo21:52
*** Goneri has quit IRC21:57
*** Goneri has joined #tripleo21:57
*** jfrancoa has quit IRC22:00
*** Goneri has quit IRC22:01
*** Goneri has joined #tripleo22:01
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Use a systemd service to handle sidecar containers  https://review.opendev.org/69358922:07
openstackgerritAlex Schultz proposed openstack/tripleo-ansible master: Implement tripleo-systemd-wrapper role  https://review.opendev.org/69344222:08
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Use a systemd service to handle sidecar containers  https://review.opendev.org/69358922:08
*** ansmith has quit IRC22:17
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Introduce manual setting of DIB_INIT_SYSTEM  https://review.opendev.org/41417922:27
openstackgerritJames Slagle proposed openstack/tripleo-docs master: Document openstack overcloud export  https://review.opendev.org/69394322:32
ade_leemwhahaha, EmilienM hey -for standalone, how does one set the NtpServer so that chronyc syncs?22:35
mwhahahaNtpServer as a param in an environment file22:35
mwhahahathe same way to do for the overcloud22:35
ade_leemwhahaha, weird -- I have NtpServer: clock1.rdu2.redhat.com  in my environment file22:36
mwhahahaade_lee: use multiple servers22:36
* mwhahaha doesn't ever want to have this conversation ever again22:36
ade_leeah22:37
ade_leemwhahaha, like a list ?  like DnsServers: ?22:38
mwhahahaNtpServer is a comma seperated list (bad var name) so you can either use a yaml list or a ['server1','server2'] or "server1,server2"22:38
ade_leemwhahaha, cool - thanks - trying ..22:39
*** slaweq has joined #tripleo22:46
*** mcornea has quit IRC22:53
openstackgerritAlex Schultz proposed openstack/tripleo-ansible master: Implement tripleo-systemd-wrapper role  https://review.opendev.org/69344222:53
*** ekultails has quit IRC22:57
openstackgerritMerged openstack/tripleo-ansible master: tripleo-container-manage: use async  https://review.opendev.org/69321623:07
*** tkajinam has joined #tripleo23:08
*** abishop has quit IRC23:12
*** alexmcleod has joined #tripleo23:14
openstackgerritAlex Schultz proposed openstack/tripleo-specs master: Create ansible roles for cloud operator actions  https://review.opendev.org/69393323:17
*** mmethot has quit IRC23:21
*** mmethot has joined #tripleo23:22
openstackgerritMerged openstack/tripleo-ansible master: Prefer ovn_dbs_vip from all_nodes_extra_map_data  https://review.opendev.org/69373023:25
*** alexmcleod has quit IRC23:31
*** abishop has joined #tripleo23:37

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!