Tuesday, 2020-03-17

*** rlandy has quit IRC00:00
openstackgerritKevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Cleanup old mistral key process  https://review.opendev.org/71334500:03
*** jmasud has quit IRC00:03
*** holser has joined #tripleo00:14
openstackgerritMerged openstack/tripleo-quickstart-extras master: Make reproducer script centos-8 friendly  https://review.opendev.org/70697700:23
*** holser has quit IRC00:28
*** ekultails has quit IRC00:32
*** artom has quit IRC00:32
*** artom has joined #tripleo00:35
openstackgerritMerged openstack/tripleo-common master: Change how we test for call  https://review.opendev.org/71330300:36
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: [TRAIN and before] Introduce ContainerCpusetCpus  https://review.opendev.org/71312100:36
openstackgerritMerged openstack/paunch stable/queens: Don't set cpuset_cpus if empty  https://review.opendev.org/71312000:36
*** tosky has quit IRC00:46
*** lbragstad has joined #tripleo00:49
*** rlandy has joined #tripleo00:52
rlandystevebaker: this should give you the right hash now ... https://logserver.rdoproject.org/33/713333/1/openstack-check/tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001/e20bffe/logs/reproducer-quickstart/launcher-playbook.yaml ... https://review.opendev.org/#/c/713333/00:54
*** mcornea has quit IRC01:02
stevebakerrlandy: nice, is there a way of validating 17635f51011a7f60b1b0a05bcc52fbb1 is somewhere in https://trunk.rdoproject.org/centos8-master ?01:05
rlandystevebaker: yeah - it should be a hash  in current ... checking01:07
stevebakercurrent is currently 4000b37a49854762d77df31697e0d1a201:09
*** cdearborn has quit IRC01:10
*** Goneri has quit IRC01:12
rlandyit changes every time a component changes01:18
rlandyhmmm ... I can't track that hash01:19
rlandywe track all hashes that become component-ci-testing but not before that - would have to query dlrn api01:22
*** jmasud has joined #tripleo01:22
*** morazi has quit IRC01:28
cloudnullstevebaker rlandy you can pull the hash from https://trunk.rdoproject.org/centos8-master/current-tripleo/delorean.repo.md5 ?01:34
* cloudnull assuming that's the hash your talking about 01:35
rlandythe reproducer will pick up triple-current and the dlrn_hash_tag and the update with current to get dlrn_hash_tag_newest01:38
rlandywe're tracking when current had the agg hash of  17635f51011a7f60b1b0a05bcc52fbb101:38
rlandyright now current is 3e972bb7f4c2c411ba1329a2ada4210901:39
rlandyit moves on all the time01:39
rlandyyou're correct about current-tripleo01:39
*** lbragstad_ has joined #tripleo01:43
*** lbragstad has quit IRC01:45
rlandystevebaker: good question - because of the new component structure, there is not a complete list of aggregate hashes to view - if the hash has not been promoted to promoted-components01:49
rlandywill have to check with jpena|off01:50
rlandythe agg hash is a running combination of all the component hashes ... https://trunk.rdoproject.org/centos8-master/component/01:50
openstackgerritMerged openstack/tripleo-common master: Remove unused password and fernet rotation actions and workflows  https://review.opendev.org/71183802:08
openstackgerritMerged openstack/tripleo-common master: Remove get_passwords workflow and related action  https://review.opendev.org/71186702:08
openstackgerritMerged openstack/tripleo-common master: Move PrepareContainerImageEnv functionality to utils  https://review.opendev.org/71259802:08
openstackgerritMerged openstack/tripleo-common master: Move UploadTemplatesAction functionality to utils  https://review.opendev.org/71259902:08
*** rlandy has quit IRC02:09
*** rh-jelabarre has quit IRC02:35
*** apetrich has quit IRC03:09
*** lbragstad_ has quit IRC03:23
mrdaIf someone is happy to do so, would you consider reapplying a +W to https://review.opendev.org/#/c/710702/1 ?  It's already been approved to merge once, but a dependant review didn't get through in time, so I think a +W is going to be needed to get this backport merged.  Thanks in advance...03:45
*** ykarel|away is now known as ykarel04:14
mwhahahamrda: it needs a rebase04:24
mrdaThanks mwhahaha.  Shall do.04:28
openstackgerritMichael Davies proposed openstack/python-tripleoclient stable/train: Local file based image uploader  https://review.opendev.org/71070204:36
*** saneax has joined #tripleo04:53
*** jmasud has quit IRC04:54
*** jmasud has joined #tripleo04:56
*** udesale has joined #tripleo04:57
*** skramaja has joined #tripleo05:18
*** ratailor has joined #tripleo05:20
*** evrardjp has quit IRC05:35
*** evrardjp has joined #tripleo05:36
*** jdandrea has quit IRC06:00
*** waleedm has joined #tripleo06:04
*** waleedm_ has joined #tripleo06:04
*** gchamoul has quit IRC06:10
*** gchamoul has joined #tripleo06:10
openstackgerritFlavio Fernandes proposed openstack/tripleo-heat-templates master: Add Octavia OVN Provider configuration  https://review.opendev.org/70769506:13
openstackgerritCédric Jeanneret (Tengu) proposed openstack/tripleo-common stable/rocky: Silent file descriptor checks  https://review.opendev.org/71337506:26
openstackgerritCédric Jeanneret (Tengu) proposed openstack/tripleo-common stable/rocky: Silent file descriptor checks  https://review.opendev.org/71337506:39
Tengumeh...06:39
*** holser has joined #tripleo06:49
*** lmiccini has joined #tripleo06:57
*** dpawlik has joined #tripleo06:57
*** cylopez has joined #tripleo07:00
*** marios has joined #tripleo07:05
*** jfrancoa has joined #tripleo07:06
*** jfrancoa is now known as jfrancoa|lunch07:07
*** bandini has joined #tripleo07:10
*** pkopec has joined #tripleo07:23
*** ahosam has joined #tripleo07:27
*** dpawlik has quit IRC07:41
*** dpawlik has joined #tripleo07:42
*** bogdando has joined #tripleo07:43
*** dpawlik has quit IRC07:48
*** bandini has quit IRC07:50
*** bandini has joined #tripleo07:51
ratailorbandini, you around ?07:56
*** slaweq has joined #tripleo07:56
*** raukadah is now known as chandankumar07:58
bandiniratailor: sure07:59
ratailorbandini, Do you have some time re https://bugzilla.redhat.com/show_bug.cgi?id=1809212  I ran upgrades job mentioned in Bz description and it failed during overcloud ugprade. I could see the workload vm was created successfully.07:59
openstackbugzilla.redhat.com bug 1809212 in openstack-nova "[OSP15->16] Instance fails to create after Controllers upgrade." [Unspecified,New] - Assigned to ratailor07:59
ratailorbandini, FYI the job which was ran on shark3 https://rhos-qe-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/view/DFG/view/upgrades/view/upgrade/job/DFG-upgrades-upgrade-upgrade-15-16_director-rhel-virthost-3cont_2comp_3ceph-ipv4-geneve-HA/21/08:00
ratailorbandini, to me it looks like it failed because of pacemaker08:01
ratailorbandini, I could see below output in pcs status command08:01
bandiniratailor: I'll take a look08:02
ratailorbandini, if you need access to the system, I can give you creds.08:02
bandiniratailor: sure pass those along via PM so I can be a bit faster08:02
bandinii just need to finish a couple of things08:03
ratailorbandini, sure, np. Thanks!08:04
*** ccamacho has joined #tripleo08:06
*** tkajinam has quit IRC08:15
*** tesseract has joined #tripleo08:17
*** apetrich has joined #tripleo08:19
*** dtantsur|afk is now known as dtantsur08:24
*** xek has joined #tripleo08:24
*** jcapitao has joined #tripleo08:30
*** amoralej|off is now known as amoralej08:31
mrdaJust wondering if I can get a +W on https://review.opendev.org/#/c/710702/  It already has two +2's and previously a +W, but it needed a rebase.  Thanks in advance!08:36
*** holser has quit IRC08:38
*** jtomasek has joined #tripleo08:43
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates stable/train: Parse healthchecks.log instead fetching systemd data  https://review.opendev.org/71334608:46
*** suuuper has joined #tripleo08:53
*** holser has joined #tripleo08:54
*** hberaud has quit IRC08:55
*** hberaud has joined #tripleo08:55
openstackgerritCarlos Goncalves proposed openstack/tripleo-ci master: Add Octavia standalone upgrade CI job  https://review.opendev.org/71047308:56
*** jpena|off is now known as jpena08:56
*** holser has quit IRC09:10
*** ansmith has joined #tripleo09:11
*** ansmith_ has quit IRC09:12
*** holser has joined #tripleo09:13
*** tosky has joined #tripleo09:17
*** marios has quit IRC09:19
*** jfrancoa|lunch has quit IRC09:32
*** abdysn has joined #tripleo09:37
abdysnhjensas, hi, saw you comment on https://review.opendev.org/#/c/703953/8? what do you mean by it?09:38
*** rpittau|afk is now known as rpittau09:38
hjensasabdysn: that https://review.opendev.org/703946 is all you need?09:39
openstackgerritBogdan Dobrelya (bogdando) proposed openstack/tripleo-common master: Handle race for the already existing layer  https://review.opendev.org/71083609:39
hjensasabdysn: and then drop L182 in deployment/haproxy/haproxy-container-puppet.yaml ?09:39
hjensasabdysn: I'd like some of the TLS everywhere experts opinion. ade_lee, jaosorior wdyt https://review.opendev.org/#/c/703953/8?09:40
*** jfrancoa has joined #tripleo09:47
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/tripleo-heat-templates stable/train: Remove unneccessary indentation from common tasks  https://review.opendev.org/71234609:48
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/tripleo-upgrade stable/train: Add needed parameters in containers-prepare-parameters for FFWD2.  https://review.opendev.org/71339009:49
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/tripleo-upgrade stable/train: Add python2-requests back into skip removal.  https://review.opendev.org/71339109:49
abdysnhjensas, do you mean that we don't need the crl file anymore?09:53
hjensasabdysn: that's what the comment in L168-L169 of  deployment/haproxy/haproxy-container-puppet.yaml says.09:55
hjensasabdysn: it's not there in deployment/rabbitmq/rabbitmq-messaging-pacemaker-puppet.yaml09:56
*** threestrands has quit IRC09:56
abdysnhjensas, we have a way to restart the haproxy now09:56
abdysnsorry about that09:56
abdysnhjensas, anyway, the comment there is a bit old, the haproxy is already restarted every two hours to refresh the crl file09:57
hjensasabdysn: oh, sorry s/deployment/rabbitmq/rabbitmq-messaging-pacemaker-puppet.yaml/deployment/haproxy/haproxy-pacemaker-puppet.yaml/09:58
hjensasabdysn: ok, so we should remove L168-L170 then?09:59
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/tripleo-common stable/train: [Q->T] Introduce Queens to Train Upgrade  https://review.opendev.org/71319509:59
abdysnhjensas, i believe so, lets wait for ade_lee and jaosorior opinion on the matter.10:00
hjensasabdysn: agreed, I wonder if the pacemaker one should'nt be 'null' anymore as well in case that is also restarted now.10:01
hjensasabdysn: let's see what they think. :)10:01
abdysnhjensas, ++10:01
*** dwilde3 has quit IRC10:16
*** marios has joined #tripleo10:17
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: WIP quick exec test for ovn metadata agent  https://review.opendev.org/71339510:18
*** skramaja has quit IRC10:18
*** gfidente|afk is now known as gfidente10:18
openstackgerritChandan Kumar (raukadah) proposed openstack/tripleo-heat-templates master: [DNM] add podman service  https://review.opendev.org/71339710:20
openstackgerritCédric Jeanneret (Tengu) proposed openstack/tripleo-heat-templates master: Remove "shared" flag for bind-mount  https://review.opendev.org/71339910:30
openstackgerritMerged openstack/tripleo-common master: Move swift tempurl creation functionality to utils  https://review.opendev.org/71289610:30
openstackgerritMerged openstack/tripleo-upgrade master: Pin API microversions depending on upgrade type  https://review.opendev.org/71330710:32
*** ramishra has quit IRC10:36
*** ramishra has joined #tripleo10:43
chandankumardalvarez, Hello10:48
chandankumardalvarez, please have a look at this bug https://bugs.launchpad.net/tripleo/+bug/186766410:48
openstackLaunchpad bug 1867664 in tripleo "Master periodic jobs are failing overcloud deploy with ''Container(s) with bad ExitCode: [''container-puppet-neutron''], check logs in /var/log/containers/stdouts/'" [Critical,Triaged]10:48
chandankumarhttps://opendev.org/openstack/puppet-neutron/src/branch/master/lib/puppet/provider/ovn_metadata_agent_config/ini_setting.rb#L7 is not there10:49
openstackgerritHarald Jensås proposed openstack/tripleo-heat-templates master: Fix the mounting issues for the TLS everywhere deployment  https://review.opendev.org/70395310:50
*** jlibosva has joined #tripleo10:52
dalvarezchandankumar: thanks, i think jlibosva was looking into something similar :?10:52
jlibosvao/10:52
dalvarezjlibosva: https://bugs.launchpad.net/tripleo/+bug/1867664  is this the thing you're taking a look atm?10:52
openstackLaunchpad bug 1867664 in tripleo "Master periodic jobs are failing overcloud deploy with ''Container(s) with bad ExitCode: [''container-puppet-neutron''], check logs in /var/log/containers/stdouts/'" [Critical,Triaged]10:52
dalvarezjlibosva: sorry if the question is totally stupid, perhaps it's unrelated10:53
jlibosvadalvarez: chandankumar I think this is different issue, what I'm looking at is that metadata-agent loses side-car containers. This sounds more like something during puppet doing its plays10:53
dalvarezmaybe unrelated... amoralej chandankumar are these jobs using the 'new' OVN subpackage under review?10:54
dalvarezbecause if so, the ini file for metadata agent is currently being handled by amoralej there10:54
chandankumardalvarez, not sure this one is related https://review.opendev.org/#/c/712762/4/docker/neutron/neutron-metadata-agent-ovn/Dockerfile.j210:55
chandankumarsince ini comes from here https://github.com/rdo-packages/networking-ovn-distgit/blob/rpm-master/python-networking-ovn.spec#L18410:55
amoralejchandankumar, dalvarez what issue are you discussing about?10:56
dalvarezamoralej: https://bugs.launchpad.net/tripleo/+bug/186766410:56
openstackLaunchpad bug 1867664 in tripleo "Master periodic jobs are failing overcloud deploy with ''Container(s) with bad ExitCode: [''container-puppet-neutron''], check logs in /var/log/containers/stdouts/'" [Critical,Triaged]10:56
dalvarezi think this is caused by the kolla changes that merged recently right?10:56
amoralejsame issue10:56
amoralejyes10:56
amoralejthat's what we are trying to fix by unpinning10:56
amoralejand moving to new ovn stuff10:56
chandankumaramoralej, https://review.rdoproject.org/r/#/c/24462/ this one?10:58
amoralejchandankumar, yes10:58
chandankumaramoralej, dalvarez jlibosva thanks!10:59
dalvarezack11:01
openstackgerritSergii Golovatiuk proposed openstack/tripleo-heat-templates master: Skip operating system upgrade tasks via OperatingSystemUpgrade param.  https://review.opendev.org/71333011:01
abdysnhjensas, see https://review.opendev.org/#/c/710574/11:05
abdysnhjensas, this is a new patch that got merged after Tengu's patch, this would make the deployment fail at step four because the undercloud will not have the record for the overcloud in its /etc/hosts.11:07
abdysnhjensas, that is AFAIK.11:08
hjensasabdysn: no, it will work. My patch cannot be br0ken. Let's wait for results.11:12
abdysnhjensas, yes11:12
abdysnhjensas, it seams it will since passed at https://review.opendev.org/#/c/712619/11:13
abdysnTengu, -^^11:14
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: Run ceph-ansible installation as super user.  https://review.opendev.org/71340511:17
*** jbadiapa has joined #tripleo11:19
*** pcaruana has quit IRC11:21
abdysnhjensas, just curious, what are the role networks for the undercloud?11:25
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/stein: HA: minor update of arbitrary container image name  https://review.opendev.org/71340611:26
openstackgerritChandan Kumar (raukadah) proposed openstack/tripleo-ci master: Only run upgrades centos 7 jobs on stable branches  https://review.opendev.org/71327711:29
*** florianf has joined #tripleo11:30
*** rpittau is now known as rpittau|afk11:34
*** pcaruana has joined #tripleo11:34
*** rpittau|afk is now known as rpittau|bbl11:34
*** mburned_out is now known as mburned11:36
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/rocky: HA: minor update of arbitrary container image name  https://review.opendev.org/71341111:36
*** tkajinam has joined #tripleo11:37
*** tkajinam has quit IRC11:39
*** tkajinam has joined #tripleo11:40
*** tkajinam has quit IRC11:41
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/queens: HA: minor update of arbitrary container image name  https://review.opendev.org/71341211:41
openstackgerritMarios Andreou proposed openstack/tripleo-ci master: Add centos-8-scenario010-ovn-provider-standalone job definition  https://review.opendev.org/71150711:44
*** holser has quit IRC11:45
*** ysandeep is now known as ysandeep|afk11:46
hjensasabdysn: Controlles, Undercloud, Compute, Storage are not neccecarily connected to the same networks. i.e storage nodes don't need access to the internal_api networks. Neither does the undercloud etc.11:51
abdysnhjensas, i understand that.11:53
abdysnhjensas, the thing is the undercloud needs to have an access to the overcloud right?11:53
*** tkajinam has joined #tripleo11:53
hjensasabdysn: yes, via the ctlplane network and the external/public api's.11:54
abdysnhjensas, great, are they added to the hosts of the undercloud (the external api)?11:54
hjensasabdysn: yes, all host entries for all nodes all roles are added everywhere.11:56
*** holser has joined #tripleo11:56
hjensasabdysn: in the TLS case the VIP's should also be added as dnsentries - https://access.redhat.com/documentation/en-us/red_hat_openstack_platform/16.0/html-single/integrate_with_identity_service/index#configure_dns_entries_for_novajoin11:57
hjensasabdysn: so if one would just add those entries before deploying the overcloud we would have to think about the hosts file.11:57
hjensasabdysn: s/would/would not/11:57
abdysnhjensas, i see11:58
abdysnhjensas, so does the ci add these?11:58
hjensasabdysn: our downstream CI does, not sure about upstream. but https://review.opendev.org/705634 works as well.12:00
openstackgerritBogdan Dobrelya (bogdando) proposed openstack/tripleo-heat-templates master: Fix swift containers idempotency  https://review.opendev.org/71341512:01
*** morazi has joined #tripleo12:02
abdysnhjensas, thanks for the information :)12:03
Tenguabdysn, hjensas heya! sorry, waa out for lunch. sooo we had a discussion with Security, and there's a move toward proper freeIPA usage for the DNS, that should solve the issue *in the future*.12:04
*** jcapitao is now known as jcapitao_lunch12:04
*** rh-jelabarre has joined #tripleo12:05
*** raildo has joined #tripleo12:14
abdysnTengu, great to know :)12:14
openstackgerritCédric Jeanneret (Tengu) proposed openstack/tripleo-heat-templates stable/train: Generate /etc/hosts early on both under and overcloud  https://review.opendev.org/71261912:18
Tenguabdysn: -^ rebased and waiting for CI. if this one helps, well, good. but I have some doubts.12:23
Tenguhjensas: -^ also for you :)12:23
abdysnTengu: thanks12:25
*** rcernin has quit IRC12:26
*** rlandy has joined #tripleo12:29
*** jpena is now known as jpena|lunch12:31
cloudnullgood morning12:48
fultonjgood morning12:50
*** rpittau|bbl is now known as rpittau12:51
openstackgerritKevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Cleanup old mistral key process  https://review.opendev.org/71334512:53
*** udesale_ has joined #tripleo12:53
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates stable/rocky: Add Octavia driver agent service  https://review.opendev.org/71342912:55
*** udesale has quit IRC12:55
*** ysandeep|afk is now known as ysandeep12:59
*** arxcruz|rover has quit IRC13:00
*** sshnaidm is now known as sshnaidm|afk13:02
*** arxcruz has joined #tripleo13:02
*** arxcruz is now known as arxcruz|rover13:03
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/tripleo-heat-templates stable/train: Use exists filter instead of stat where possible  https://review.opendev.org/71327113:06
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/tripleo-heat-templates stable/train: Use jinja raw tag instead of quoted concatenation  https://review.opendev.org/71343513:06
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/tripleo-heat-templates stable/train: Use jinja raw tag instead of quoted concatenation  https://review.opendev.org/71343513:08
openstackgerritMerged openstack/tripleo-ansible master: Baremetal Configure Playbook  https://review.opendev.org/69166713:08
*** lbragstad_ has joined #tripleo13:10
openstackgerrityatin proposed openstack/tripleo-ci master: [WIP] Enable tripleo-image-serve for CentOS8  https://review.opendev.org/71343913:12
*** amoralej is now known as amoralej|lunch13:13
openstackgerritChandan Kumar (raukadah) proposed openstack/tripleo-heat-templates master: Add OS::TripleO::Services::Podman to sc 1 and sc 7  https://review.opendev.org/71339713:13
openstackgerritChandan Kumar (raukadah) proposed openstack/tripleo-quickstart master: Set overcloud_container_cli to podman for c8  https://review.opendev.org/71201313:14
chandankumarslaweq, https://review.opendev.org/713397 will clear current maridb issue13:15
openstackgerrityatin proposed openstack/tripleo-ci master: [WIP] Enable tripleo-image-serve for CentOS8  https://review.opendev.org/71343913:16
*** bandini has quit IRC13:17
hjensasTengu: it fails installing the undercloud. https://review.opendev.org/#/c/703953/13:20
hjensasTengu: the job is collecting logs still ...13:21
Tengumeh..13:22
*** jcapitao_lunch is now known as jcapitao13:24
Tenguhmmm.... are there some issues with tempest runs in CI? marios, chandankumar, weshay|ruck ?13:27
weshay|ruckya.. just was looking at your review13:27
*** Goneri has joined #tripleo13:27
weshay|ruckin a mtg.. little slow.13:27
weshay|ruckhttps://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_3ad/713399/1/check/tripleo-ci-centos-8-scenario001-standalone/3ad8104/logs/undercloud/var/log/tempest/stestr_results.html13:28
Tenguweshay|ruck: which one? the one about removing "shared" flag? any np for mtg, that gives me some time.13:28
Tenguah yeah, that one change.13:28
Tengurah.... ovs still making bad things with selinux -.-13:29
Tenguthought it was sorted out X(13:29
chandankumar:q!13:29
Tenguweshay|ruck: at least, it doesn't seem to be related to the change. Not 100% sure though :/13:30
zbrcloudnull: hi13:32
*** holser has quit IRC13:33
*** jpena|lunch is now known as jpena13:33
zbri wanted to ask you something re molecule and requirements, as openstack-requirements broke most molecule jobs by adopting latest version of pytest-html which is incompatible with pytest-molecule.13:33
*** holser has joined #tripleo13:34
openstackgerritMerged openstack/tripleo-heat-templates stable/train: Add CephBasePoolVars and CephKeyVars structures  https://review.opendev.org/71213113:34
openstackgerritMerged openstack/tripleo-upgrade master: Use "is failed" instead of "|failed" filter.  https://review.opendev.org/71205113:34
Tenguouchhhh... https://10769f0369a546e0b81a-f2cb8655ffdf7ed1058c2e519d278ca2.ssl.cf2.rackcdn.com/713399/1/check/tripleo-ci-centos-8-containers-multinode/95c9a41/logs/subnode-1/var/log/extra/denials.txt  that... hurts.13:35
Tengu;_;13:35
TenguI'm good to re-take the whole selinux thing for master apparently.....13:36
* Tengu cries13:36
Tengujaosorior: -^^13:36
Tenguovs mostly, and a "new" thing, "fips_enabled", linked to python and httpd... probably something new in centos-8.13:37
Tenguoh.... this.... it might explain my current issues while deploying on c8 !!!13:37
Tengufultonj: heya! quick question: did you already deploy some master on c8? if so, with SELinux enforcing?13:38
fultonjTengu: yes13:41
fultonj[heat-admin@dcn1-distributedcomputehci-0 ~]$ sudo getenforce13:41
fultonjEnforcing13:41
fultonj[heat-admin@dcn1-distributedcomputehci-0 ~]$ cat /etc/redhat-release13:41
fultonjCentOS Linux release 8.1.1911 (Core)13:41
jaosoriorhuh13:41
Tengufultonj: and so you get an overcloud? I'm jealous.13:41
jaosoriorbummer :/13:41
Tengujaosorior: yeah... as usual. nobody's checking that file.13:42
fultonjTengu: yeah, i have an overcloud13:42
fultonja 3 stack DCN w/ multibackend storage overcloud ;)13:43
Tengufultonj: meh... mine's failing due to some failed authentication at the start...13:43
fultonjstill testing it13:43
* fultonj not using metalsmith13:43
Tengudidn't have much time to debug that thing.13:43
Tenguyeah, neither do I for now.13:43
*** ekultails has joined #tripleo13:43
*** chem has quit IRC13:44
fultonjTengu: failed authentication of what?13:45
Tengufultonj: getting my env up'n'running, should get some time to debug it this week hopefully.13:46
*** chem has joined #tripleo13:46
Tengujust mirroring the container images in order to get faster :)13:46
Tengu(because, yeah... mirroring is good :))13:46
fultonjfailed to authenticate to the container registry, failed to authenticate to keystone, ...13:46
fultonjplenty of places to fail authentication so i was just wondering if you knew to which service it was failing13:46
Tengufultonj: keystone13:46
Tenguor some related service. lemme get it up, mirroring takes some time..13:47
Tenguat least it shouldn't be the registry. I don't remember the URI shown in the message ^^'13:47
fultonj[tripleo_keystone_resources : Create default domain]13:49
fultonj^ ?13:49
fultonjTengu: http://paste.openstack.org/show/790788/ ?13:49
Tengufultonj: as said: flappy memory - lemme get that back online and re-try :). I'll come back to you once I've my undercloud running and overcloud deploy crashed :]13:49
openstackgerritCarlos Goncalves proposed openstack/tripleo-heat-templates master: Add scenario013: Octavia standalone without Ceph  https://review.opendev.org/71310813:50
fultonjTengu: ok, fyi i saw that one occasionally13:50
Tengubut nope, that's not the error, that's for sure13:50
fultonjTengu: ok, then13:50
TenguI get a clean 40113:50
Tenguthat's the only thing I have right now ^^'13:50
fultonjTengu: ok, let's see what happens later13:51
Tenguyup :)13:51
Tenguat least I know it's supposed to work13:51
Tenguwhich is already a good point, right? :)13:51
*** jdandrea has joined #tripleo13:51
fultonjmy 4 day old undercloud is working for me13:52
Tengumirroring still running... Copying centos-binary-ovn-northd:46b71a6620e3372c998db7a694112fd213:52
fultonjtripleo-lab from friday + https://github.com/fultonj/ussuri/tree/master/glance13:52
*** mcornea has joined #tripleo13:53
slaweqchandankumar: thx a lot14:00
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Remove objects migrated to validations-common  https://review.opendev.org/71320414:01
*** ysandeep is now known as ysandeep|afk14:01
weshay|ruck#startmeeting tripleo14:02
weshay|ruck#topic agenda14:02
weshay|ruck* Review past action items14:02
weshay|ruck* One off agenda items14:02
weshay|ruck* Squad status14:02
weshay|ruck* Bugs & Blueprints14:02
openstackMeeting started Tue Mar 17 14:02:16 2020 UTC and is due to finish in 60 minutes.  The chair is weshay|ruck. Information about MeetBot at http://wiki.debian.org/MeetBot.14:02
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.14:02
weshay|ruck* Projects releases or stable backports14:02
*** openstack changes topic to " (Meeting topic: tripleo)"14:02
openstackThe meeting name has been set to 'tripleo'14:02
weshay|ruck* Specs14:02
*** openstack changes topic to "agenda (Meeting topic: tripleo)"14:02
weshay|ruck* open discussion14:02
weshay|ruckAnyone can use the #link, #action and #info commands, not just the moderatorǃ14:02
weshay|ruckHey folks! who's around?14:02
ekultailso/14:02
Tengu\o/14:02
rlandyo/14:02
tkajinamo/14:02
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Remove objects migrated to validations-common  https://review.opendev.org/71320414:03
*** dwilde3 has joined #tripleo14:03
marioso/14:04
weshay|ruck#topic review past action items14:05
weshay|ruckhttp://eavesdrop.openstack.org/meetings/tripleo/2020/14:05
*** openstack changes topic to "review past action items (Meeting topic: tripleo)"14:05
weshay|ruckanything from previous weeks? I have one thing14:05
chandankumar\o/14:05
* weshay|ruck notes to the tripleo community.. the rdo-info pin on *most* projects have been removed14:06
weshay|rucksome pins are still in place and the best POC for that info is #rdo14:06
weshay|ruckthe CI team promoted the unpinned content yesterday after it had passed through our various pipelines for testing14:06
rainleandero/14:07
*** rainleander is now known as leanderthal14:07
leanderthalo/14:07
leanderthalwe're both here ;-)14:07
weshay|ruckI believe neutron is still pinned, and a bit of mistral14:07
weshay|ruckleanderthal, :)) welcome14:07
pkopeco/14:07
weshay|ruckwelcome welcome rather14:07
weshay|rucklook for updates on rdo email lists, and #rdo14:07
weshay|ruckI'll ask them to summarize the current status of pins14:07
weshay|ruckany questions on that?14:08
* weshay|ruck notes.. ussuri is centos-8 only and if you see a centos-7 job we're waiting on a merge to convert or a merge to remove it14:08
ykarelweshay|ruck, some info about pins can be seen https://lists.rdoproject.org/pipermail/dev/2020-March/009334.html14:08
ykarelwith weekly status14:09
Tenguthat's all good news I'd say. big thanks to all the ppl working on that topic!14:09
weshay|ruckk.. thank you ykarel14:09
weshay|ruck Pinned projects are unpinned after testing with CentOS8 jobs and14:09
weshay|ruckfeedback from TripleO team. Mistral and neutron are still pinned, more14:09
weshay|ruckdetails in https://review.rdoproject.org/r/#/c/25612/14:09
weshay|ruck    * https://review.rdoproject.org/r/#/c/25612/14:09
weshay|ruck    * https://review.rdoproject.org/r/#/c/25727/14:09
weshay|ruck    * https://review.rdoproject.org/r/#/c/25719/14:09
weshay|ruckanything else re: centos-8, unpinning etc?14:10
weshay|ruckthank you to the rdo community packagers!!14:10
arxcruz|rovero/14:10
weshay|ruck#topic Active Squad status14:10
weshay|ruckci14:10
weshay|ruck#link https://hackmd.io/IhMCTNMBSF6xtqiEd9Z0Kw?both14:10
weshay|ruckvalidations14:10
weshay|ruck#link https://etherpad.openstack.org/p/tripleo-validations-squad-status14:10
weshay|ruckceph-integration14:10
*** openstack changes topic to "Active Squad status (Meeting topic: tripleo)"14:10
weshay|ruck#link https://etherpad.openstack.org/p/tripleo-integration-squad-status14:10
weshay|rucktransformation14:10
weshay|ruck#link https://etherpad.openstack.org/p/tripleo-ansible-agenda14:10
weshay|ruckmistral-to-ansible14:11
weshay|ruck#link https://etherpad.openstack.org/p/tripleo-mistral-to-ansible14:11
weshay|ruckcloudnull, since we're getting so close to kicking mistral out.. want to summarize where we are?14:11
weshay|ruckand any reviews needed?14:11
weshay|ruckor anyone from that squad14:11
Tenguquick update for the validations! we have 2 new packages getting ready, validations-common and (python[23]-)validations-libs - the latter has already its spec file merged, the -common is in the pipe!14:11
*** jtomasek has quit IRC14:12
weshay|ruckvery nice!!14:12
gchamoul\o/14:12
gchamoulsuper nice!14:12
Tengubig thumbs up to ykarel and amoralej|lunch for their help, and of course gchamoul and matbu for the code and content :)14:12
weshay|ruck++14:13
weshay|ruckwell done14:13
*** jtomasek has joined #tripleo14:13
weshay|ruckthanks for the update.. moving on14:13
weshay|ruck#topic Moderately Active Squads14:13
weshay|ruckIronic-integration14:13
weshay|ruckhttps://etherpad.openstack.org/p/tripleo-ironic-integration-squad-status14:13
weshay|ruckupgrade14:13
*** openstack changes topic to "Moderately Active Squads (Meeting topic: tripleo)"14:13
weshay|ruck#link https://etherpad.openstack.org/p/tripleo-upgrade-squad-status14:13
weshay|ruckedge14:13
weshay|ruck#link https://etherpad.openstack.org/p/tripleo-edge-squad-status14:13
weshay|rucknetworking14:13
weshay|ruck#link https://etherpad.openstack.org/p/tripleo-networking-squad-status14:13
weshay|ruckgoing once , twice for the less active14:13
weshay|ruckccamacho, is bringing up new upgrade jobs and a new scenario14:14
* dtantsur assumes the ironic integration squad is VERY moderately active..14:14
weshay|ruckoops14:14
fultonjo/14:14
weshay|ruckcgoncalves,  is14:14
weshay|ruckplease have a look at https://review.opendev.org/#/c/710473/14:14
*** spotz has joined #tripleo14:14
weshay|ruckhey fultonj, gfidente patches are up to convert ceph-ansible dep ci to centos-814:14
*** jtomasek has quit IRC14:15
weshay|ruckand podman14:15
weshay|ruckEmilienM, ^14:15
weshay|ruckcool14:15
weshay|ruckchandankumar, will have the details for both14:15
fultonjweshay|ruck: yep, chandankumar mentioned this to us yesterday14:15
*** amoralej|lunch is now known as amoralej14:15
weshay|ruck#topic bugs and blueprints14:15
*** openstack changes topic to "bugs and blueprints (Meeting topic: tripleo)"14:16
chandankumarfultonj, bhagyashris is still working on that, https://review.rdoproject.org/r/2576914:16
weshay|ruckBlueprints:14:16
weshay|ruck1 Good progress14:16
weshay|ruckBugs:14:16
weshay|ruck5 New, 20 Incomplete, 4 Invalid, 2 Won't Fix, 7 Confirmed, 376 Triaged, 118 In Progress, 2 Fix Committed, 118 Fix Released14:16
chandankumarweshay|ruck, EmilienM for podman https://review.rdoproject.org/r/#/q/topic:c8-podman+(status:open+OR+status:merged)14:16
weshay|ruckreminder to self triage bugs14:16
weshay|ruckset the bug to triaged... and set the milestone, priority etc..14:16
weshay|ruckread the blob of instructions please14:17
weshay|ruckchandankumar, ^14:17
weshay|ruck:)14:17
*** ykarel is now known as ykarel|afk14:17
weshay|ruckStoryboard bugs.14:17
weshay|ruck#link https://storyboard.openstack.org/#!/project_group/7614:17
weshay|ruckmoving on14:17
weshay|ruck#topic projects releases or stable backports14:17
*** openstack changes topic to "projects releases or stable backports (Meeting topic: tripleo)"14:17
weshay|rucknow that most things are unpinned... backports from master are open14:18
weshay|ruckbut please note.. what is still currently pinned14:18
weshay|ruckquestions?14:18
weshay|ruckmoving on14:18
weshay|ruck#topic specs14:18
weshay|ruck#link https://review.openstack.org/#/q/project:openstack/tripleo-specs+status:open14:18
*** openstack changes topic to "specs (Meeting topic: tripleo)"14:19
weshay|ruckekultails, anything you want to highlight?14:19
weshay|ruck#topic open discussion14:20
weshay|ruckAnything else that folks want to bring up to the meeting?14:20
*** openstack changes topic to "open discussion (Meeting topic: tripleo)"14:20
tkajinamCan I ask one question regarding centos8 jobs ?14:20
d0ugalo/14:20
cloudnullo/14:20
weshay|rucktkajinam, sure14:20
* cloudnull late, sorry 14:20
apetricho/14:20
EmilienMhello14:20
tkajinamIIUC currently centos jobs are running on master, we still use centos7 for stable branches14:20
weshay|ruckcloudnull, please bang erasers after class14:21
weshay|rucktkajinam, correct14:21
tkajinamwill we stay on centos7 about stable/train or will we also enable centos8 jobs for it ?14:21
*** pojadhav is now known as pojadhav|away14:21
* cloudnull channels my inner bart simpson 14:21
tkajinamI'm asking this because I'm working on a patch to enable centos8 to run ut/lint jobs for puppet modules14:21
weshay|rucktkajinam, the magic 8-ball says... "ask again later", we have not yet been given any requirements to update train to centos-8, but I'm asking about it14:21
apetrichWe have an issue here https://bugs.launchpad.net/tripleo/+bug/1866621 that I'm trying to see how to best fix it.14:22
openstackLaunchpad bug 1866621 in tripleo "Can't run container mistral_db_sync" [High,Triaged]14:22
ekultailsNo new info on my AWX integration spec. Will eventually work on more of a proof-of-concept that I can share. Seeing is believing, right? ;-)14:22
weshay|ruckekultails thanks14:22
tkajinamweshay|ruck, ok14:22
EmilienMcloudnull: do you know why all tripleo-ansible-centos-8-molecule-tripleo_container_* jobs are non voting on tripleo-ansible, and RED ?14:22
weshay|ruckapetrich, what's the issue? do you want to highlight for the mtg or is that something else?14:23
EmilienM:(14:23
weshay|ruckzbr, ^14:23
EmilienMand the job is failing for good reason, idempotency :(14:23
EmilienMwho did that14:23
cloudnullEmilienM zbr was working on that .14:23
weshay|ruckwho moved it to centos-8 or something else?14:23
EmilienMwhy the job is non voting14:23
weshay|ruckya.. zbr moved to centos-8..14:24
EmilienMand why did this job moved to centos814:24
cloudnullidk why specifically they're non-voting, I suspect there was some issue running the job in cent814:24
weshay|ruckgchamoul, are validation molecule jobs done btw?14:24
EmilienMif it's not working, keep it on centos7 for now14:24
zbrEmilienM: they got broken long time ago, someone needs to fix them, i am not working on them now.14:24
EmilienMwe can't afford regressions in that role14:24
*** dwilde3 has quit IRC14:24
EmilienMit's used everywhere14:24
weshay|ruckhrm14:24
EmilienMand why you didn't ping me14:24
gchamoulweshay|ruck: nope not yet14:24
EmilienMi created that role14:24
weshay|ruckgchamoul, k k14:24
zbrwe cannot have a mix of centos-7 and centod-8 on tripleo-ansible jobs, due to how it was implemented.14:24
weshay|ruckzbr, may need assist gchamoul w/ validations14:24
openstackgerritLukas Bezdicka proposed openstack/tripleo-heat-templates master: [Q->T] Introduce Queens to Train Upgrade  https://review.opendev.org/71145914:25
zbrthat was my first attempt14:25
EmilienM...14:25
*** ahosam has quit IRC14:25
cloudnullzbr EmilienM to get the job voting again we could put them back to c7 for now ?14:25
EmilienMcloudnull: zbr just said we can't.14:25
weshay|ruckzbr, also added all of the tripleo-ansible molecule jobs to a periodic upstream weekly pipeline btw14:26
weshay|ruckzbr, if you have link to that14:26
cloudnullwhy not?14:26
EmilienMfolks these roles should NOT be non voting14:26
EmilienMno matter the reason, we can't afford regressions in them14:26
cloudnulleach job runs its own env, we can mix and match OS's14:26
fultonjso if you wrote a molecule test for your tripleo-ansible role you should be helping to fix this, right?14:26
weshay|ruckthey also need to be at centos-8. so let's discuss that offline14:26
EmilienMfultonj: yes but I wasn't aware it was red14:26
weshay|ruckfultonj++14:26
*** TrevorV has joined #tripleo14:27
EmilienMi just found it randomly14:27
EmilienMof course I'll fix it, I'm already investigating14:27
weshay|ruckeither was I tbh, last I looked it was green14:27
EmilienMI'm just saying we should not disabling voting like this14:27
EmilienMeven for centos814:27
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/tripleo-heat-templates master: [DNM] Revert "placement: Remove Nova to Placement extraction step"  https://review.opendev.org/71345514:27
fultonjso any tripleo-ansible patch should have an example of the failing job to debug?14:27
*** dwilde has joined #tripleo14:28
fultonji'm thinking i'm going to go looking for where my job is failing so i'm wondering where to look14:28
*** ansmith has quit IRC14:28
*** ansmith_ has joined #tripleo14:28
EmilienMin my case I can see it here :14:28
EmilienMhttps://0fd77280b0334417b6ee-1d67ec5eb204f28641a7073258861323.ssl.cf5.rackcdn.com/712135/6/check/tripleo-ansible-centos-8-molecule-tripleo_container_manage/4e914dc/reports.html14:28
EmilienM"msg: fedora container was wrongly re-created"14:28
EmilienMit's clearly an idempotency issue14:29
zbrEmilienM: while I agree with your statement on nv, you will discover yourself what kind of challenge is to split stuff in tripleo-ansible repo, due to the way jobs are generated.14:29
weshay|ruckhttps://review.opendev.org/#/c/712135/14:29
cloudnullEmilienM if we revert - https://github.com/openstack/tripleo-ansible/commit/326f902710e7f6a41c01b2bdedd7ac512196e5fa - the container_* and ceph_* jobs should run c7, while everthing else is running c814:29
zbrthere were 78 jobs there, yep 78.14:29
weshay|ruckpush forward on getting fixed on c8 imho14:30
EmilienMyes I agree... centos8 is priority14:30
cloudnull78 jobs is no big deal, we can change each job independently of every other job, if needed.14:30
weshay|ruckoof14:30
weshay|ruckok.. let's get together and figure it out .. offline of this mtg14:31
weshay|ruckbut thanks for pointing this out14:31
gfidenteweshay|ruck we should have all deps to build ceph-ansible for centos8 in the sig repo now14:31
weshay|ruckgfidente++ chandankumar ^14:31
weshay|ruckgfidente, we should also confirm that kolla is using those repos and deps14:32
chandankumargfidente, we need mock from epele for centos-814:32
* weshay|ruck wishes rdo would just carry mock14:32
weshay|ruckin deps14:32
weshay|ruckso we didn't have to touch epel14:32
fultonjdo you think we should be able to recreate the failure using tripleo-ansible's  ./scripts/run-local-test ?14:32
apetrichweshay|ruck, sorry had to help the kids. Not for the meeting but help is welcome14:32
weshay|ruckchandankumar, ykarel|afk is that possible?14:32
chandankumarweshay|ruck, everything is possible14:32
chandankumarlet me check14:32
weshay|ruckchandankumar, \0/14:33
weshay|ruckok.. anything else???14:33
ade_leemwhahaha, https://review.opendev.org/#/c/713143/  please14:33
weshay|ruck0/ ade_lee14:33
gfidentechandankumar isn't mock-ceph-config https://cbs.centos.org/koji/buildinfo?buildID=28555 from CBS good?14:33
gfidenteweshay|ruck and yes kolla should be using it, I saw the review in gerrit14:33
weshay|ruck++14:33
gfidenteI am pretty sure there is a guy who joined upstream sig meeting14:34
weshay|ruckok.. folks.. thank you .. SERIOUSLY for participating in the meeting and highlighting current events!!!14:34
gfidenteprecisely to do that14:34
weshay|ruck++ tripleo ++14:34
weshay|ruck0/14:35
ratailorweshay|ruck, do we have any update re https://bugzilla.redhat.com/show_bug.cgi?id=169028114:35
openstackratailor: Error: Error getting bugzilla.redhat.com bug #1690281: NotPermitted14:35
chandankumargfidente, will poke on that14:35
weshay|ruck#endmeeting tripleo14:35
*** openstack changes topic to "CI status: centos8 only for master, centos-7 will be removed GREEN| community irc meeting Tues@1400 UTC - tripleo-ci-community meeting Tues@1330 UTC | https://docs.openstack.org/tripleo-docs"14:35
openstackMeeting ended Tue Mar 17 14:35:12 2020 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)14:35
openstackMinutes:        http://eavesdrop.openstack.org/meetings/tripleo/2020/tripleo.2020-03-17-14.02.html14:35
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/tripleo/2020/tripleo.2020-03-17-14.02.txt14:35
openstackLog:            http://eavesdrop.openstack.org/meetings/tripleo/2020/tripleo.2020-03-17-14.02.log.html14:35
ratailorweshay|ruck, we have discussed few weeks back and you said that you would discuss with other tripleo cores and come up with different project for external stuff.14:36
ratailorweshay|ruck, instead of putting everything into tripleo-ansible like this https://review.opendev.org/#/c/709112/14:36
weshay|ruckratailor, ya.. we put up a hackmd.. that will move to upstream doc14:37
*** abdysn has quit IRC14:37
*** waleedm_ has quit IRC14:37
*** waleedm has quit IRC14:37
weshay|ruckratailor, https://hackmd.io/lTCJjCAgQ2S0MrqhgIlIEw14:39
EmilienMweshay|ruck, zbr, cloudnull : i think it's the podman version in centos8. I'm investigating and will fix the jobs by eod or convert them back to centos7 until i find it.14:41
openstackgerritRyan McCabe proposed openstack/tripleo-heat-templates stable/train: Add STF environment  https://review.opendev.org/71334814:41
ratailorpkopec, FYI ^^14:42
pkopecratailor, ack thanks14:42
openstackgerritKevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Partial revert for c8 migration  https://review.opendev.org/71346014:42
ratailorweshay|ruck, Thanks!14:42
cloudnullEmilienM ^ feel free to abandon if you are able to fix it14:42
EmilienMcloudnull: ack, thx14:42
EmilienMi'll -2 for now14:43
EmilienMor -114:43
weshay|ruckratailor, not complete yet14:43
weshay|ruckbut it's a start14:43
*** ansmith_ has quit IRC14:43
openstackgerritKevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Partial revert for c8 migration  https://review.opendev.org/71346014:43
*** ansmith has joined #tripleo14:44
ratailorweshay|ruck, Could you roughly estimate how much time it would take ? So that we can decide priority for our RFEs.14:44
EmilienMcloudnull, weshay|ruck, zbr : I'll use https://bugs.launchpad.net/tripleo/+bug/1867787 for tracking14:44
openstackLaunchpad bug 1867787 in tripleo "tripleo-ansible-centos-8-molecule-tripleo_container_* jobs failing to pull containers" [High,Triaged] - Assigned to Emilien Macchi (emilienm)14:44
ratailorpkopec, ^^14:44
openstackgerritKevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Partial revert for c8 migration  https://review.opendev.org/71346014:45
cloudnullEmilienM ^ updated with your bug id14:45
*** jbadiapa has quit IRC14:45
openstackgerritKevin Carter (cloudnull) proposed openstack/tripleo-ansible master: DNM testing role on c7  https://review.opendev.org/71346314:48
*** tkajinam has quit IRC14:48
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible master: WIP - fix all tripleo_container_* molecule jobs on centos8  https://review.opendev.org/71346414:49
*** panda|off has quit IRC14:49
*** panda has joined #tripleo14:50
openstackgerritKevin Carter (cloudnull) proposed openstack/tripleo-ansible master: DNM testing role on c7  https://review.opendev.org/71346314:50
*** ratailor has quit IRC14:55
openstackgerritKevin Carter (cloudnull) proposed openstack/tripleo-ansible master: DNM testing role on c7  https://review.opendev.org/71346314:55
gfidenteweshay|ruck amoralej++ moved kolla back to sig https://review.opendev.org/#/c/707338/14:56
gfidentefmount ^^14:56
fmountthanks gfidente14:57
*** sshnaidm|afk is now known as sshnaidm14:57
amoralejgfidente, note that's a local mirror in rdo server14:57
amoralejit's static copy14:57
amoralejso 4.0.16 is not there yet14:57
sshnaidmEmilienM, can you post me logs, I'd check if it's podman container issue14:57
EmilienMsshnaidm: https://0fd77280b0334417b6ee-1d67ec5eb204f28641a7073258861323.ssl.cf5.rackcdn.com/712135/6/check/tripleo-ansible-centos-8-molecule-tripleo_container_manage/4e914dc/reports.html14:57
EmilienMI'm reproducing atm14:57
gfidenteamoralej sure it's a local mirror but I mean migrated off epel/download.ceph.com to sig packages14:58
EmilienMsshnaidm: part of the jobs are fixed in https://review.opendev.org/71346414:58
sshnaidmEmilienM, ack, will look14:58
EmilienMsshnaidm: idempotency issue is another issue, I'm investigating14:58
sshnaidmok14:58
amoralejgfidente, yeah14:59
amoralejit was breaking kolla14:59
gfidenteamoralej we were only cross checking if kolla moved to sig packages14:59
amoralejok14:59
gfidenteamoralej not sure if there are issues around that still?14:59
amoralejnot afaik15:00
gfidenteack thanks15:00
*** dtantsur is now known as dtantsur|brb15:00
amoralejit woas being backported to train, btw15:00
gfidenteyeah saw that, thanks!15:00
openstackgerritKevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Partial revert for c8 migration  https://review.opendev.org/71346015:03
Tengufultonj: just started the overcloud deploy. let's see.15:12
fultonjok15:13
openstackgerritDamien Ciabrini proposed openstack/tripleo-heat-templates master: WIP support for mariadb's ed25519 authentication  https://review.opendev.org/71347015:17
*** jmasud has quit IRC15:20
*** pkopec is now known as pkopec|brb15:21
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible master: fix all tripleo_container_* molecule jobs on centos8  https://review.opendev.org/71346415:24
EmilienMcloudnull: ^ that should do it, but I'm talking with sshnaidm on a proper solution for podman_container15:25
Tengufultonj: swiftclient.exceptions.ClientException: Container GET failed: https://192.168.24.2:13808/v1/AUTH_8bf8f53798cb40f2bd97dc6e236ce0fc/overcloud-0-config?format=json 404 Not Found  [first 60 chars of response] b'<html><h1>Not Found</h1><p>The resource could not be found.<'15:30
Tengu"funky".15:30
fultonjTengu: i've seen that15:30
fultonjdciabrin: ^15:30
Tengurelated to the "overcloud-0" name instead of "overcloud" ?15:30
fultonjTengu: releated to the the missing item15:31
Tenguraise ClientException.from_response(resp, 'Container GET failed', body)  sounds like it.15:31
dciabrinfultonj, howdy o/ what should I look for sorry?15:31
fultonjdciabrin: did you workar ound the issue Tengu ran into ^15:31
weshay|ruckTengu, afaict.. it's the patch..15:32
Tenguweshay|ruck: oh? really?15:32
Tengudciabrin: http://paste.openstack.org/show/790801/15:32
Tenguweshay|ruck: this would mean we actually use sub-mounts in the containers - I'm really surprised :/. I'll do some testing once I can get my overcloud deploying..15:33
cloudnullEmilienM in https://review.opendev.org/713464 should you make the jobs voting ?15:33
EmilienMcloudnull: yes also15:33
fultonjdciabrin: i might me mistaken, i just thought you ran into this issue too and work around it.15:33
Tengufultonj, dciabrin so yeah - an "openstack container list" is showing only "overcloud-config", no "overcloud-0-config".15:34
*** pcaruana has quit IRC15:34
Tenguhttp://paste.openstack.org/show/790802/15:34
Tenguguess I'm good for some LP right? :)15:34
dciabrinfultonj, no i stumbled upon another thing iirc, that was upload-puppet-modules which couldn't parse the ouput of swift15:34
fultonjTengu:  https://bugs.launchpad.net/tripleo/+bug/186737015:34
openstackLaunchpad bug 1867370 in tripleo "deployment fails when using a stack name which isn't "overcloud"" [High,In progress]15:34
Tenguah15:34
Tengu"yay".15:34
fultonjdciabrin: ok15:34
cloudnullEmilienM i'll abandon https://review.opendev.org/#/c/713460/ for now15:35
fultonjTengu: do you have https://review.opendev.org/#/c/712968/ ?15:35
Tengufultonj: so I just need to get that patch in tripleo-common15:35
Tengulemme check15:35
Tenguguess it isn't15:35
fultonjTengu: it's very painful to get in there15:35
EmilienMcloudnull: k15:35
fultonji blogged the process15:35
fultonjTengu: http://blog.johnlikesopenstack.com/2019/07/notes-on-testing-tripleo-common-mistral.html15:36
Tenguhm. I do have the patch15:36
Tenguoh. *inside* a container.15:36
fultonjTengu: does your mistral executor container have the patch?15:36
Tengufultonj: apparently it is, yes.15:38
Tenguso that's probably another thing. Now it's talking about overcloud-config instead of overcloud-0-config.15:38
Tengufultonj: so it needs something more. Wondering how you're able to deploy though.... did you change the stackname in the deploy script?15:39
fultonjTengu: if you change your stack name to overcloud it should work15:39
Tenguyeah, well, that's what we can call a regression :).15:39
fultonjTengu: which is fixed by https://review.opendev.org/#/c/712968/15:39
Tenguapparently nope15:39
fultonjTengu: what's your stack name?15:39
Tengubecause I do have the patch in mistral executor container15:39
Tengustackname is "overcloud-0" as usual15:40
fultonj"because I do have the patch in mistral executor container" let's test that theory15:40
fultonjTengu: if you change the stack name to overcloud does it work?15:40
Tenguhave to clean the thing first, else it will explode.15:41
fultonjTengu: oh15:41
fultonjconfig-download might have the same regression15:41
fultonjwait..15:41
fultonj11:38  Tengu: so that's probably another thing. Now it's talking about overcloud-config instead of15:41
fultonjovercloud-0-config.15:41
Tenguyep.15:41
Tenguwhat I said :). something's pushing content to a wrong container.15:42
Tengu*swift container15:42
fultonjhttps://review.opendev.org/#/c/712968/1/tripleo_common/utils/template.py15:42
Tengusee http://paste.openstack.org/show/790801/ on line 27-29 and http://paste.openstack.org/show/790802/15:42
fultonjsomething like ^ might need to be be applied elsewhere15:42
Tengufultonj: what I said :).15:43
Tenguthat's another regression, since I do have the patch you're pointing15:43
TenguI opened the file on the host and in the container - they both have the additional "container" param.15:43
cloudnullanyone able to give these three changes some review https://review.opendev.org/#/c/708749, https://review.opendev.org/#/c/712221, https://review.opendev.org/#/c/71222215:43
*** ahosam has joined #tripleo15:43
fultonjTengu: what's weird for me though is that i use differnt stack names15:44
fultonjand https://review.opendev.org/#/c/712968/1/tripleo_common/utils/template.py was sufficient for me15:44
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates stable/train: Skip operating system upgrade tasks via OperatingSystemUpgrade param.  https://review.opendev.org/71347215:44
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible master: fix all tripleo_container_* molecule jobs on centos8  https://review.opendev.org/71346415:44
fultonjTengu: i run config-download manually15:44
Tengufultonj: "funky"..15:44
Tenguah. I'm running the deploy itself15:45
Tenguso no manual step, just plain deploy15:45
fultonji normally 'openstack overcloud deploy .... --stack-only'15:45
Tenguso maybe that's the issue.15:45
Tenguyeah, I don't :)15:45
Tengulemme try that.15:45
Tenguoh... fun.15:45
fultonj https://github.com/fultonj/ussuri/blob/master/standard/deploy-config-download.sh#L4415:46
fultonjthen i do what james documnted15:46
fultonjtripleo-ansible-inventory --static-yaml-inventory inventory.yaml --stack $STACK15:46
fultonjansible-playbook $DIR/deploy_steps_playbook.yaml15:46
fultonjit's much nicer ;)15:46
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: standalone/overcloud: enable the HA deployment by default  https://review.opendev.org/35906015:47
fultonjhttps://docs.openstack.org/project-deploy-guide/tripleo-docs/latest/deployment/ansible_config_download.html#manual-config-download15:47
fultonjTengu: i always do ^15:47
Tengufultonj: yeah - lemme check. tripleo-lab has a script for that (and it happens to be broken, but easy to fix)15:47
Tengufultonj: ./config-download-oc0.sh  fyi :)15:47
fultonjyeah15:47
Tengubut still - this would point a regression somewhere in tripleoclient15:47
fultonjTengu: agree15:47
fultonjso i guess i didn't flush out all the regressions introduced by ramishra changes15:47
Tengu:)15:49
fultonjTengu: i guess we need a new bug15:49
*** ahosam has quit IRC15:49
Tengufultonj: :) what I said :). Glad we agree on that ;).15:49
fultonjand our CI doesn't catch it because it uses the default stack name15:49
TenguLemme create that new LP15:49
fultonjTengu: just wanted to be sure15:49
fultonjTengu: i bet you could create a reproducer of the bug in our CI simply by doing a to one of the scenarios patch which chagnes the default stack name15:51
*** ykarel|afk is now known as ykare15:51
*** ykare is now known as ykarel15:51
fultonjit would make the ci prevent these types of regressions15:51
Tengufultonj: yep. that would be nice to get upstream (ping weshay|ruck :))15:51
* weshay|ruck scrolls back15:51
fultonjweshay|ruck:  https://bugs.launchpad.net/tripleo/+bug/1867370 + $new_bug_tengu_is_opening15:52
openstackLaunchpad bug 1867370 in tripleo "deployment fails when using a stack name which isn't "overcloud"" [High,In progress]15:52
fultonjwas thinking we change a scenario so one of the ci jobs uses a diff stack name than overcloud15:53
weshay|ruckha.. variables are hard15:53
weshay|ruckya.. roger that one :)15:53
fultonjweshay|ruck: any idea which job we should change?15:53
weshay|ruckfultonj, I would think we could change one the scenarios in tht ci/environments15:53
weshay|ruckor we could update ci..15:54
fultonjweshay|ruck: exactly, just wondering which one15:54
* weshay|ruck looks15:54
fultonjhmmm can i pass stack name as a THT param, i thought i had to pass it to 'openstack overcloud deploy --stack FOO'15:54
Tengufultonj, weshay|ruck https://bugs.launchpad.net/tripleo/+bug/186779815:54
openstackLaunchpad bug 1867798 in tripleo "Overcloud deploy fail when not using standard "overcloud" stack name" [Undecided,Triaged]15:54
Tengufeel free to add tags if needed.15:54
weshay|ruckfultonj, Tengu I would vote for scenario0315:54
weshay|ruckmwhahaha, ^ may have an opinion as well15:55
*** leanderthal has quit IRC15:55
weshay|ruckwould that do it though in standalone?15:55
fultonjno15:55
weshay|ruckya15:55
Tenguhmmm nope15:55
Tenguneed an overcloud15:55
fultonjsince standalone is swiftless15:55
weshay|ruckso .. has to be featureset010 in ci15:55
fultonjhmmm15:55
Tenguand I don't really know what fs - as long as we can get something checking this thing in order to avoid this kind of regression.15:56
Tengunot the first time it bites us :)15:56
fultonjTengu: remove swift and mistral from the undercloud lol15:56
mwhahahaworking on it15:56
Tengufultonj: mistral is on its way ;)15:56
Tenguswift... not sure?15:56
fultonjsorry, ik'm kidding around a little15:56
fultonjbut yeah, we're talking about what to do until then15:57
weshay|ruckopenstack overcloud deploy command would need the option15:57
fultonjso featureset010 doesn't use standalone15:57
fultonjweshay|ruck: right, can i see that in featureset010?15:57
weshay|ruckya.. it's multindoe15:57
weshay|rucksee the overcloud deploy command?15:57
weshay|ruckhttps://10769f0369a546e0b81a-f2cb8655ffdf7ed1058c2e519d278ca2.ssl.cf2.rackcdn.com/713399/1/check/tripleo-ci-centos-8-containers-multinode/95c9a41/logs/undercloud/home/zuul/15:57
fultonjhttps://github.com/openstack/tripleo-heat-templates/blob/master/ci/environments/scenario010-multinode-containers.yaml15:58
weshay|ruckovercloud-deploy.sh15:58
weshay|ruckfultonj, featureset != scenario15:58
weshay|ruckfultonj, https://opendev.org/openstack/tripleo-heat-templates/src/branch/master/ci/environments/multinode-containers.yaml15:58
fultonjsorry15:59
fultonjweshay|ruck: but it's not a THT param for me to drop into ^15:59
openstackgerritKevin Carter (cloudnull) proposed openstack/python-tripleoclient master: overcloud node delete, use ansible for unprovision  https://review.opendev.org/71222215:59
Tenguyep, so using the manual config-download, it just works.15:59
Tenguyay CLI15:59
fultonjyay15:59
zbrEmilienM: cloudnull: we should better merge this before it gets outdated https://review.opendev.org/#/c/712135/15:59
cloudnullzbr ++16:00
fultonjwhat code creates https://10769f0369a546e0b81a-f2cb8655ffdf7ed1058c2e519d278ca2.ssl.cf2.rackcdn.com/713399/1/check/tripleo-ci-centos-8-containers-multinode/95c9a41/logs/undercloud/home/zuul/overcloud-deploy.sh ?16:00
EmilienMzbr: done16:00
Tengufultonj: added a comment on the LP.16:00
fultonjquickstart ^ ?16:00
zbrthanks16:01
weshay|ruckfultonj, ya.. it may *have* to be done in qs or an operator16:01
* fultonj adds a comment about this to bug16:02
fultonjhttps://bugs.launchpad.net/tripleo/+bug/1867798/comments/216:02
openstackLaunchpad bug 1867798 in tripleo "Overcloud deploy fail when not using standard "overcloud" stack name" [Critical,Triaged]16:02
fultonjif someone shows me the file i'll make the patch16:02
fultonjwhere to change it i mean16:02
fultonjbut otherwise the idea is captured in the bug16:02
* fultonj is about to kicked out of office for ~30 minutes16:03
Tengufultonj: I'd say in oooq-extras, roles/overcloud-deploy/defaults/main.yml:deploy_script: overcloud-deploy.sh.j216:03
Tenguthat one will need a new param somewhere I guess.16:03
weshay|ruckhttps://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/overcloud-deploy/templates/overcloud-deploy.sh.j2#L3416:04
Tengubingo16:04
Tengu:)16:04
fultonjack16:04
Tengufultonj: you'll need to add the "--stack foo" in different places there, apparently.16:04
Tengusince there are calls to `openstack stack list' and other things.16:04
weshay|ruckw/ the option in https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/overcloud-deploy/tasks/pre-deploy.yml16:05
fultonjok, added to my list16:05
fultonjoh16:05
Tenguthat's why I love my lab: it's able to find bugs.16:05
Tengu:]16:05
openstackgerritSergii Golovatiuk proposed openstack/tripleo-upgrade stable/train: Run ceph-ansible installation as super user.  https://review.opendev.org/71347616:05
* fultonj steps out16:07
Tengufultonj: in any cases - thanks for the tip - it's deploying now, meaning I should be able to test a patch related to bind-mounts :).16:07
fultonjTengu: excellent16:08
Tengujust wondering.... I think I've seen somewhere a way to inject packages on the overcloud directly during the deploy, instead of "editing" the image...16:08
Tengu"artifact" or something16:08
Tenguneed to find it back.16:08
Tenguand need to add support to my lab for this toy.16:08
Tenguhttps://hardysteven.blogspot.com/2016/08/tripleo-deploy-artifacts-and-puppet.html16:09
Tengubtw... where's shardy ?! Long time no see..16:09
mwhahahafolks can I get some tripleo-operator-ansible love: https://review.opendev.org/#/q/project:openstack/tripleo-operator-ansible+status:open16:09
*** jbadiapa has joined #tripleo16:10
Tengufultonj: oh, btw.... tripleo-lab supports the container modification :). #magic16:11
Tengufultonj: https://github.com/cjeanner/tripleo-lab/blob/master/USAGE.md#i-want-to-inject-that-rpmpatchother-in-my-containers16:11
Tenguand you can build pkgs only for containers16:11
openstackgerritMerged openstack/openstack-virtual-baremetal master: Explicitly set MTU on interfaces in IPXE image  https://review.opendev.org/68397316:12
weshay|ruckTengu, let's make t-shirts16:14
Tenguweshay|ruck: about what? #magic? :)16:14
openstackgerritFrancesco Pantano proposed openstack/tripleo-common master: [DNM] Bump grafana container to 5.4.3 tag  https://review.opendev.org/71347816:17
Tenguweshay|ruck: https://www.reactiongifs.com/r/mgc.gif   ? :]16:17
Tengua pity we can't get animated things on a t-shirt (well, actually, we can, but..)16:17
openstackgerritSagi Shnaidman proposed openstack/tripleo-ansible master: Improve idempotency for images in podman container  https://review.opendev.org/71347916:19
sshnaidmEmilienM, ^^16:19
Tenguanyway. time to sign off for me.16:19
*** lmiccini has quit IRC16:23
*** avivgt has quit IRC16:27
*** avivgt has joined #tripleo16:33
*** cylopez has quit IRC16:36
*** dtantsur|brb is now known as dtantsur16:40
openstackgerritAde Lee proposed openstack/tripleo-ansible master: Add a custom filter for parsing instance metadata  https://review.opendev.org/71174216:40
openstackgerritAde Lee proposed openstack/tripleo-ansible master: Add role to add ipa services for tls-everywhere  https://review.opendev.org/69190616:41
openstackgerritAlex Schultz proposed openstack/tripleo-operator-ansible master: Add overcloud node provide role  https://review.opendev.org/70330516:41
openstackgerritAlex Schultz proposed openstack/tripleo-operator-ansible master: Add overcloud node provision  https://review.opendev.org/71348116:41
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/tripleo-heat-templates stable/train: Use a smaller,static custom mapping file for Mistral and TripleO  https://review.opendev.org/71296416:44
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/tripleo-heat-templates stable/train: [Q->T] Introduce Queens to Train Upgrade  https://review.opendev.org/71348216:44
*** ykarel is now known as ykarel|away16:45
openstackgerritRabi Mishra proposed openstack/python-tripleoclient master: Pass container_config to get_config()  https://review.opendev.org/71348316:47
ramishraTengu, fultonj this time not my patch it seems;) Looks like regression from https://review.opendev.org/#/c/705793/16:47
fultonjramishra: ok, thanks16:48
fultonjcloudnull: ^16:48
*** chandankumar is now known as raukadah16:48
fultonjcloudnull: https://bugs.launchpad.net/tripleo/+bug/186779816:48
openstackLaunchpad bug 1867798 in tripleo "Overcloud deploy fail when not using standard "overcloud" stack name" [Critical,In progress] - Assigned to Rabi Mishra (rabi)16:48
fultonjramishra: thanks for making https://review.opendev.org/#/c/713483/16:49
ramishrafultonj: np:)16:50
* cloudnull looking 16:53
cloudnullnice, will pull https://review.opendev.org/#/c/713483/ into a local env and run a deployment.16:54
*** udesale_ has quit IRC16:57
openstackgerritAlex Schultz proposed openstack/tripleo-operator-ansible master: Add overcloud node unprovision  https://review.opendev.org/71348516:58
openstackgerritAde Lee proposed openstack/tripleo-ansible master: Add code to deregister nodes and services from freeipa  https://review.opendev.org/70022617:02
openstackgerritDaniel Alvarez proposed openstack/tripleo-heat-templates master: Remove unused config dir for OVN metadata-agent  https://review.opendev.org/71348717:03
EmilienMsshnaidm: ok will look. Thanks17:04
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/tripleo-upgrade stable/train: Run ceph-ansible installation as super user.  https://review.opendev.org/71347617:04
*** marios is now known as marios|out17:05
*** jfrancoa has quit IRC17:06
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: temporarily reduce tempest on master centos-8  https://review.opendev.org/71348917:07
*** bogdando has quit IRC17:07
*** rpittau is now known as rpittau|afk17:10
openstackgerritAde Lee proposed openstack/tripleo-ansible master: Add playbook to clean up IPA when a stack is deleted  https://review.opendev.org/71307417:11
*** lyarwood has quit IRC17:11
openstackgerritAde Lee proposed openstack/tripleo-ansible master: Add undercloud-ipa-install to playbooks  https://review.opendev.org/70958917:11
*** marios|out has quit IRC17:12
openstackgerritAde Lee proposed openstack/tripleo-ansible master: Add undercloud-ipa-install to playbooks  https://review.opendev.org/70958917:12
EmilienMsshnaidm: +2 seems like it's working fine17:13
openstackgerritMerged openstack/tripleo-upgrade stable/train: Add python2-requests back into skip removal.  https://review.opendev.org/71339117:19
*** jcapitao has quit IRC17:19
*** avivgt has quit IRC17:21
*** jfrancoa has joined #tripleo17:23
*** avivgt has joined #tripleo17:27
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: standalone/overcloud: enable the HA deployment by default  https://review.opendev.org/35906017:28
*** pkopec|brb has quit IRC17:31
openstackgerritFlavio Fernandes proposed openstack/tripleo-heat-templates master: DNM: is a test change to exercise https://review.opendev.org/#/c/711333/      that change introduces ovn_nb_connection in a way that does not break      scenario010  https://review.opendev.org/71192117:31
*** evrardjp has quit IRC17:35
*** jmasud has joined #tripleo17:36
*** evrardjp has joined #tripleo17:36
*** tesseract has quit IRC17:37
*** jlibosva has quit IRC17:43
openstackgerritAde Lee proposed openstack/tripleo-ansible master: Add undercloud-ipa-install to playbooks  https://review.opendev.org/70958917:46
openstackgerritMerged openstack/tripleo-operator-ansible master: Add overcloud node provide role  https://review.opendev.org/70330517:46
*** jmasud has quit IRC17:47
openstackgerritMerged openstack/tripleo-operator-ansible master: Add overcloud node provision  https://review.opendev.org/71348117:50
openstackgerritMerged openstack/tripleo-operator-ansible master: Add overcloud node unprovision  https://review.opendev.org/71348517:50
openstackgerritMerged openstack/tripleo-operator-ansible master: Add overcloud container image prepare  https://review.opendev.org/71198917:50
openstackgerritMerged openstack/tripleo-operator-ansible master: Add overcloud container image tag discover  https://review.opendev.org/71210917:50
openstackgerritMerged openstack/tripleo-operator-ansible master: Add overcloud container image upload  https://review.opendev.org/71212817:50
openstackgerritMerged openstack/tripleo-operator-ansible master: Add note about Queens only roles  https://review.opendev.org/71213017:52
openstackgerritFlavio Fernandes proposed openstack/tripleo-heat-templates master: Add Octavia OVN Provider configuration  https://review.opendev.org/70769517:53
*** jmasud has joined #tripleo17:55
openstackgerritMerged openstack/tripleo-upgrade stable/train: Add needed parameters in containers-prepare-parameters for FFWD2.  https://review.opendev.org/71339017:55
*** jmasud has quit IRC17:58
*** dtantsur is now known as dtantsur|afk17:59
*** florianf has quit IRC18:02
*** jpena is now known as jpena|off18:04
openstackgerritwes hayutin proposed openstack/tripleo-ci master: add backup tempest cirros url  https://review.opendev.org/71350518:19
*** pcaruana has joined #tripleo18:27
*** saneax has quit IRC18:35
openstackgerritAde Lee proposed openstack/tripleo-ansible master: Add role to add ipa services for tls-everywhere  https://review.opendev.org/69190618:38
openstackgerritAde Lee proposed openstack/tripleo-ansible master: Add code to deregister nodes and services from freeipa  https://review.opendev.org/70022618:38
openstackgerritAde Lee proposed openstack/tripleo-ansible master: Add playbook to clean up IPA when a stack is deleted  https://review.opendev.org/71307418:38
openstackgerritAde Lee proposed openstack/tripleo-ansible master: Add undercloud-ipa-install to playbooks  https://review.opendev.org/70958918:38
*** rfolco has joined #tripleo18:44
openstackgerrityatin proposed openstack/tripleo-ci master: [WIP] Enable tripleo-image-serve for CentOS8  https://review.opendev.org/71343918:45
*** rfolco has quit IRC18:48
*** jlibosva has joined #tripleo18:53
*** jlibosva has quit IRC18:58
openstackgerritMerged openstack/tripleo-ansible master: Rename playbook.yml to converge.yml  https://review.opendev.org/71213518:59
*** rh-jlabarre has joined #tripleo19:00
*** rh-jelabarre has quit IRC19:02
*** amoralej is now known as amoralej|off19:02
*** jeremyfreudberg has joined #tripleo19:03
openstackgerritMerged openstack/tripleo-operator-ansible master: Add overcloud cell export  https://review.opendev.org/71218119:05
mjturekI'm having trouble using a signed cert in tripleo. I have a file that includes the base64 version of the cert in a location that I specify in undercloud_service_certificate but I get this error "ValueError: Could not deserialize key data". Looking through the docs it seems like we need the private key used to sign the cert?19:08
mjturekall we received was a base64 cert19:08
openstackgerritMerged openstack/tripleo-operator-ansible master: Add overcloud config download  https://review.opendev.org/71257819:10
mjturekmwhahaha: do you have any insight? ^19:11
* mwhahaha defers to ade_lee & company19:11
openstackgerritMerged openstack/tripleo-operator-ansible master: Add overcloud netenv validate  https://review.opendev.org/71258119:12
ade_leemjturek, gotta get some food -- back in 15 or so.19:13
mjtureknp, thanks!19:13
*** rh-jlabarre has quit IRC19:15
openstackgerritJohn Fulton proposed openstack/tripleo-docs master: WIP/DNM: Introduce Multibackend Storage Documenation  https://review.opendev.org/71307819:19
*** rh-jelabarre has joined #tripleo19:21
*** dsneddon has quit IRC19:22
*** dsneddon has joined #tripleo19:22
*** openstackgerrit has quit IRC19:33
*** openstackgerrit has joined #tripleo19:36
openstackgerritMerged openstack/tripleo-ansible master: Unprovision confirmation, write an env file  https://review.opendev.org/71199419:36
lbragstad_https://review.opendev.org/#/c/713318/ is passing zuul now - should be ready for some eyes if anyone has a minute19:41
*** lbragstad_ is now known as lbragstad19:42
ade_leemjturek, how did you generate the certificate?19:45
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: standalone/overcloud: enable the HA deployment by default  https://review.opendev.org/35906019:45
stevebakermorning19:45
mjturekwe didn't really, we sent a request to CA cert within the org19:45
EmilienMstevebaker: how is tomorrow looks like19:45
stevebakerEmilienM: a bit cloudy19:45
mjturekto a CA to generate the cert*19:46
EmilienMshould I go back to sleep now?19:46
stevebakerdefinitely19:46
ade_leemjturek, ok but presumably to create that request, you generated a keypair on the undercloud and put that in a csr and sent that to the ca, right?19:46
mjturekwe did not!19:46
mjturekjust some text information and a name19:47
*** jmasud has joined #tripleo19:48
ade_leemjturek, then I'm confused  -- the usual way a cert request is made is by generating a key pair, and sending the public key in a csr to the CA.  The CA returns a signed doc ("the cert") that contains the public key and signing stuff.19:49
mjturekhm, strange19:49
ade_leemjturek, you can't use a cert to serve a tls connection unless you have the private key -- which should never leave your box19:49
mjturekah I see19:50
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Add Octavia OVN Provider configuration  https://review.opendev.org/70769519:50
ade_leemjturek, so maybe you're going to some web page to get a cert --- in the background then, its probably generating a key pair19:50
ade_leeand its in your browser keycache maybe?19:51
mjturekwill check! maybe that's it19:51
ade_leemjturek, but you never send a private key to a ca -- its only the public key that gets sent19:51
mjturekmakes sense! but definitely did not send a pubkey19:52
rlandystevebaker: hi - I spoke with jpena this morning ... he confirmed that we have no easy way to query a previous current aggregate hash. He will work adding dirs to maintain previous hashes.19:52
ade_leemjturek, if you have an interface to send a csr instead of just a hostname etc.  you can use openssl commands to generate it19:54
ade_leethen you'll know exactly where it is ..19:54
stevebakerrlandy: ok, can I just assume your fix calculates it correctly?19:54
rlandystevebaker: it should pull the 'current' hash at the time19:55
stevebakercool19:55
ade_leemjturek, what the code expects is a pem file containing the cert and key19:55
ade_leethe key being the private key associated with the public key in the cert19:55
rlandystevebaker: you can always replace that value in the reproducer with the hash that is the current 'current' until we can trace back the previous hashes19:56
stevebakerrlandy: yeah, thanks.19:56
openstackgerritMerged openstack/python-tripleoclient stable/train: Local file based image uploader  https://review.opendev.org/71070220:05
openstackgerritMerged openstack/tripleo-common stable/stein: Change how we test for call  https://review.opendev.org/71330520:05
openstackgerritMerged openstack/tripleo-common stable/train: Change how we test for call  https://review.opendev.org/71328020:05
openstackgerritMerged openstack/tripleo-common stable/rocky: Silent file descriptor checks  https://review.opendev.org/71337520:05
openstackgerritMerged openstack/tripleo-common master: Use unversioned RHEL element w/ RHEL8  https://review.opendev.org/71332020:05
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Fix glance backend for scenario010  https://review.opendev.org/69257920:05
openstackgerritAlex Schultz proposed openstack/tripleo-operator-ansible master: Add overcloud upgrade run  https://review.opendev.org/71352520:08
openstackgerritAlex Schultz proposed openstack/tripleo-operator-ansible master: Fix wrong metadata  https://review.opendev.org/71352620:11
openstackgerritAlex Schultz proposed openstack/tripleo-common stable/train: Use unversioned RHEL element w/ RHEL8  https://review.opendev.org/71352720:13
mrdamrda20:13
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: WIP: FFWD2 Overcloud upgrade automation.  https://review.opendev.org/71352820:14
jeremyfreudbergmrda: mrda20:14
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: WIP: FFWD2 Overcloud upgrade automation.  https://review.opendev.org/71352820:14
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Add Octavia OVN Provider configuration  https://review.opendev.org/70769520:14
mrdajeremyfreudberg: lol20:15
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Add Octavia OVN Provider configuration  https://review.opendev.org/70769520:18
stevebakerstevebaker20:18
*** jfrancoa has quit IRC20:18
mwhahahamwhahaha, mwhahaha. mwhahaha!20:18
fultonjmwhahaha wins20:19
stevebakerweshay|ruck: regarding that molecule pytest issue, according to this pytest-html==2.1.0 gets installed even though the requirement is pytest-html<=2.0.120:20
stevebakerweshay|ruck: https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_07f/706979/4/check/openstack-tox-molecule/07f2092/job-output.txt20:20
openstackgerritAlex Schultz proposed openstack/tripleo-operator-ansible master: Add overcloud upgrade run  https://review.opendev.org/71352520:21
*** TrevorV has quit IRC20:25
*** suuuper has quit IRC20:36
openstackgerritSteve Baker proposed openstack/tripleo-quickstart master: Adjust molecule requirements  https://review.opendev.org/71353220:46
*** jmasud has quit IRC20:55
*** jmasud has joined #tripleo20:56
*** rlandy is now known as rlandy|afk21:02
openstackgerritFlavio Fernandes proposed openstack/tripleo-heat-templates master: Add Octavia OVN Provider configuration  https://review.opendev.org/70769521:04
openstackgerritAlex Schultz proposed openstack/tripleo-operator-ansible master: Add overcloud generate fencing  https://review.opendev.org/71353921:08
openstackgerritSteve Baker proposed openstack/tripleo-quickstart-extras master: Adjust molecule requirements  https://review.opendev.org/71354221:15
openstackgerritFlavio Fernandes proposed openstack/tripleo-heat-templates master: Add Octavia OVN Provider configuration  https://review.opendev.org/70769521:26
*** rcernin has joined #tripleo21:31
*** rcernin has quit IRC21:37
*** rcernin has joined #tripleo21:38
openstackgerritJohn Fulton proposed openstack/tripleo-docs master: Introduce Multibackend Storage Documenation  https://review.opendev.org/71307821:41
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: standalone/overcloud: enable the HA deployment by default  https://review.opendev.org/35906021:46
openstackgerritAlex Schultz proposed openstack/tripleo-operator-ansible master: Add overcloud external update run  https://review.opendev.org/71354321:46
*** xek has quit IRC21:46
openstackgerritAlex Schultz proposed openstack/tripleo-operator-ansible master: Add overcloud external upgrade run  https://review.opendev.org/71354421:49
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: standalone/overcloud: enable the HA deployment by default  https://review.opendev.org/35906021:50
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: standalone/overcloud: enable the HA deployment by default  https://review.opendev.org/35906021:52
*** ahosam has joined #tripleo21:54
openstackgerritAlex Schultz proposed openstack/tripleo-operator-ansible master: Add overcloud external update run  https://review.opendev.org/71354321:57
openstackgerritAlex Schultz proposed openstack/tripleo-operator-ansible master: Add overcloud external upgrade run  https://review.opendev.org/71354421:57
openstackgerritAlex Schultz proposed openstack/tripleo-operator-ansible master: Add overcloud generate fencing  https://review.opendev.org/71353921:58
openstackgerritAlex Schultz proposed openstack/tripleo-operator-ansible master: Add overcloud upgrade run  https://review.opendev.org/71352521:58
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: standalone/overcloud: enable the HA deployment by default  https://review.opendev.org/35906022:00
openstackgerritKevin Carter (cloudnull) proposed openstack/tripleo-common master: Remove mistral from the snmp password function  https://review.opendev.org/71307022:07
openstackgerritFlavio Fernandes proposed openstack/tripleo-heat-templates master: Add Octavia OVN Provider configuration  https://review.opendev.org/70769522:09
*** jdandrea has quit IRC22:10
openstackgerritFlavio Fernandes proposed openstack/tripleo-heat-templates master: Add Octavia OVN Provider configuration  https://review.opendev.org/70769522:20
openstackgerritJohn Fulton proposed openstack/tripleo-docs master: Introduce Multibackend Storage Documenation  https://review.opendev.org/71307822:22
*** dwilde has quit IRC22:25
*** mcornea has quit IRC22:27
openstackgerritMerged openstack/tripleo-ansible master: fix all tripleo_container_* molecule jobs on centos8  https://review.opendev.org/71346422:34
cloudnullanyone mind giving https://review.opendev.org/#/c/713324 and https://review.opendev.org/#/c/713328/ a nudge22:37
*** slaweq has quit IRC22:39
openstackgerritHarald Jensås proposed openstack/tripleo-heat-templates stable/train: ControlPlaneSubnetCidr in net_vip_map_external  https://review.opendev.org/71354822:45
openstackgerritHarald Jensås proposed openstack/tripleo-heat-templates stable/stein: ControlPlaneSubnetCidr in net_vip_map_external  https://review.opendev.org/71354922:45
*** raildo has quit IRC22:46
*** rlandy|afk is now known as rlandy22:48
*** Goneri has quit IRC22:50
*** holser has quit IRC22:56
*** tkajinam has joined #tripleo22:58
*** lbragstad has quit IRC23:01
openstackgerritAlex Schultz proposed openstack/tripleo-operator-ansible master: Add overcloud raid create  https://review.opendev.org/71355223:04
*** bfournie has quit IRC23:04
openstackgerritAlex Schultz proposed openstack/tripleo-operator-ansible master: Quote values for shell_arg_list  https://review.opendev.org/71355323:21
openstackgerritAlex Schultz proposed openstack/tripleo-operator-ansible master: Quote values for shell_arg_list  https://review.opendev.org/71355323:23
*** ekultails has quit IRC23:30
*** morazi has quit IRC23:36
*** tosky has quit IRC23:38
*** jlibosva has joined #tripleo23:47
*** jlibosva has quit IRC23:51
*** holser has joined #tripleo23:55

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!