Friday, 2020-08-07

openstackgerritAlan Bishop proposed openstack/puppet-tripleo stable/train: Add certmonger-etcd-refresh.sh script  https://review.opendev.org/74525500:15
openstackgerritAlan Bishop proposed openstack/tripleo-heat-templates stable/train: Revamp how etcd's cert and key are handled in containers  https://review.opendev.org/74525600:16
*** ayoung has quit IRC00:26
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Pre-install python3 for CentOS  https://review.opendev.org/74186800:38
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Deprecate dib-python; remove from in-tree elements  https://review.opendev.org/74187700:38
*** ayoung has joined #tripleo00:38
*** ayoung has quit IRC00:39
*** rfolco has quit IRC01:02
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Remove glance-registry  https://review.opendev.org/73979601:43
openstackgerritMerged openstack/diskimage-builder master: Update the tox minversion parameter.  https://review.opendev.org/73875401:45
*** rlandy|bbl is now known as rlandy02:19
openstackgerritMerged openstack/diskimage-builder master: Fixes DIB_IPA_CERT certificate copy issue  https://review.opendev.org/74158303:03
*** rh-jelabarre has quit IRC03:22
*** ramishra has joined #tripleo03:24
*** rlu has joined #tripleo03:31
*** psachin has joined #tripleo03:32
*** rlu has quit IRC03:35
*** ekultails has quit IRC03:47
*** skramaja has joined #tripleo03:57
*** jmasud has quit IRC03:57
*** jfrancoa has joined #tripleo04:04
openstackgerritSaravanan KR proposed openstack/tripleo-heat-templates master: Reset sriov_numvfs to 0 before leapp upgrade  https://review.opendev.org/74528004:04
*** psahoo has joined #tripleo04:20
*** ysandeep is now known as ysandeep|off04:24
*** ratailor has joined #tripleo04:28
*** raukadah is now known as chkumar|rover04:31
*** evrardjp has quit IRC04:33
*** evrardjp has joined #tripleo04:33
*** ykarel|away has joined #tripleo04:43
*** ykarel|away is now known as ykarel04:43
*** ramishra has quit IRC04:50
*** marios has joined #tripleo05:09
*** marios is now known as marios|ruck05:09
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Fedora 32 support  https://review.opendev.org/73721705:13
*** marios|ruck has quit IRC05:15
*** lmiccini has joined #tripleo05:16
*** dmacpher has quit IRC05:17
*** rlu has joined #tripleo05:19
*** marios has joined #tripleo05:22
*** Tengu has quit IRC05:22
*** Tengu has joined #tripleo05:24
*** udesale has joined #tripleo05:24
*** tkajinam has quit IRC05:34
*** tkajinam has joined #tripleo05:35
*** psahoo has quit IRC05:38
*** tkajinam has quit IRC05:50
*** tkajinam has joined #tripleo05:51
*** psahoo has joined #tripleo05:52
*** saneax has joined #tripleo05:54
*** psahoo has quit IRC05:57
*** marbindrakon has quit IRC06:11
*** shyamb has joined #tripleo06:14
*** psahoo has joined #tripleo06:14
openstackgerritCédric Jeanneret (Tengu) proposed openstack/tripleo-heat-templates master: Modify how libvirt related containers use SELinux  https://review.opendev.org/73617306:23
Tenguykarel: -^ added depends-on your container-tools:2.0 patch06:23
ykarelTengu, ack, but 1.6.4-15 still not available in 2.0 stream06:24
Tengufor master now, I'll update ussuri/train patches once we get the result06:24
Tengubleh06:24
Tenguwe'll see...06:24
Tenguykarel: btw - https://review.rdoproject.org/r/#/c/28888/  if you have a minute :)06:25
*** lmiccini has quit IRC06:29
*** redrobot has quit IRC06:37
*** lmiccini has joined #tripleo06:38
*** ntt__ has joined #tripleo06:50
ykarelmarios, chkumar|rover can u review https://review.opendev.org/#/q/topic:bug/1889219+(status:open+OR+status:merged)06:56
ykarelsome already reviewed but missing +W06:56
mariosack will do ykarel06:58
*** jcapitao has joined #tripleo07:02
*** shyam89 has joined #tripleo07:03
*** shyam89 has joined #tripleo07:03
*** shyamb has quit IRC07:06
*** bhagyashris is now known as bhagyashris|off07:13
openstackgerritMaciej Józefczyk proposed openstack/tripleo-ansible stable/ussuri: Set the OpenFlow protocol while upgrading OVS from 2.11  https://review.opendev.org/74529507:15
openstackgerritMaciej Józefczyk proposed openstack/tripleo-ansible stable/train: Set the OpenFlow protocol while upgrading OVS from 2.11  https://review.opendev.org/74529707:15
*** bogdando has joined #tripleo07:15
chkumar|roverykarel: left few comments here https://review.opendev.org/#/c/743916/407:19
ykarelchkumar|rover, okk looking07:25
ykarelchkumar|rover, hmm got it, but can it be done as followup once we enable the ci.centos job, i wanted to avoid rebases07:29
ykarelcommented over review too07:31
*** jmasud has joined #tripleo07:35
*** pkopec has joined #tripleo07:40
openstackgerritCédric Jeanneret (Tengu) proposed openstack/tripleo-validations master: Corrected work directory for validate-selinux  https://review.opendev.org/74529907:42
*** jpich has joined #tripleo07:47
*** slaweq has joined #tripleo07:51
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: Set proper provider type for queens  https://review.opendev.org/74444707:51
*** jpena|off is now known as jpena07:51
*** saneax has quit IRC07:54
*** gfidente has joined #tripleo07:59
*** tosky has joined #tripleo08:04
*** shyam89 has quit IRC08:06
*** dmellado has quit IRC08:09
*** ramishra has joined #tripleo08:13
*** dmellado has joined #tripleo08:14
*** lucasagomes has joined #tripleo08:16
*** sshnaidm|afk is now known as sshnaidm|off08:19
*** saneax has joined #tripleo08:21
*** ratailor has quit IRC08:21
*** saneax has quit IRC08:27
*** saneax has joined #tripleo08:39
*** saneax has quit IRC08:40
*** jpich has quit IRC08:44
*** jpich has joined #tripleo08:45
*** derekh has joined #tripleo08:52
*** shyamb has joined #tripleo08:53
*** pcaruana has quit IRC08:55
*** pcaruana has joined #tripleo09:08
*** tkajinam has quit IRC09:17
openstackgerritMerged openstack/tripleo-quickstart-extras master: Allow to override NeutronBridgeMappings for standalone deploy  https://review.opendev.org/74391309:24
*** ratailor has joined #tripleo09:24
*** dtantsur|afk is now known as dtantsur09:30
openstackgerritMerged openstack/tripleo-quickstart-extras master: Add playbook to deploy standalone on virthost  https://review.opendev.org/74391609:32
*** ratailor_ has joined #tripleo09:32
*** ratailor has quit IRC09:35
*** shyam89 has joined #tripleo09:45
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates master: WIP: refactor nova db config  https://review.opendev.org/71855209:48
*** shyamb has quit IRC09:49
openstackgerritMerged openstack/diskimage-builder master: Pre-install python3 for CentOS  https://review.opendev.org/74186809:53
openstackgerritMerged openstack/diskimage-builder master: Deprecate dib-python; remove from in-tree elements  https://review.opendev.org/74187709:57
openstackgerritCarlos Goncalves proposed openstack/diskimage-builder master: Add support for CentOS 8 Stream cloud image  https://review.opendev.org/73724510:02
owalshskramaja: hey, just noticed many of the sriov roles do not include OS::TripleoO::Services::Tuned, e.g roles/ComputeHCISriov.yaml. Is that intentional?10:04
skramajaowalsh: i am not sure if it was intentional, but including the including is reduntant, because BootParams role itself will apply the tuned profile..10:06
skramajaso that cmdline args can be applied for reboot.10:06
skramajaowalsh: https://github.com/openstack/tripleo-heat-templates/blob/master/deployment/kernel/kernel-boot-params-baremetal-ansible.yaml#L8610:06
owalshskramaja: ah, ok, so if I add validation for this I should just check if either service is included, yes?10:10
owalshskramaja: or would it be safest to just include both in all roles?10:11
openstackgerritRabi Mishra proposed openstack/tripleo-common master: Remove check for ./puppet/services when filtering services  https://review.opendev.org/74506710:13
skramajaowalsh: either ways it should be OK... if we want to keep uniform, then including both makes more meaningful.10:15
owalshskramaja: ack, thanks10:16
*** ykarel has quit IRC10:16
*** ykarel has joined #tripleo10:16
*** ykarel has quit IRC10:31
*** ramishra has quit IRC10:31
*** mcornea has joined #tripleo10:33
*** ykarel has joined #tripleo10:35
*** artom has quit IRC10:40
*** shyam89 has quit IRC10:48
*** ramishra has joined #tripleo10:53
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: Set proper provider type for queens  https://review.opendev.org/74444710:56
*** Tengu has quit IRC11:01
*** Tengu has joined #tripleo11:03
*** ykarel has quit IRC11:05
*** ykarel has joined #tripleo11:05
*** mcornea has quit IRC11:08
openstackgerritRabi Mishra proposed openstack/tripleo-common master: Remove check for ./puppet/services when filtering services  https://review.opendev.org/74506711:09
*** ykarel has quit IRC11:10
*** ykarel has joined #tripleo11:11
openstackgerritChandan Kumar (raukadah) proposed openstack/tripleo-ansible master: [tripleo-podman] Install specific version of buildah  https://review.opendev.org/74531111:17
*** psahoo has quit IRC11:31
*** jpena is now known as jpena|lunch11:32
*** cloudnull has quit IRC11:42
*** cloudnull has joined #tripleo11:43
*** artom has joined #tripleo11:43
*** psahoo has joined #tripleo11:44
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates stable/train: Remove ffwd-upgrade leftovers from THT.  https://review.opendev.org/74372511:45
*** jpich has quit IRC11:57
*** jpich has joined #tripleo11:58
*** rfolco has joined #tripleo12:00
openstackgerritMerged openstack/tripleo-common master: Add exponential backoff to ratelimited requests  https://review.opendev.org/74517012:02
*** jcapitao is now known as jcapitao_lunch12:08
*** rlandy has joined #tripleo12:16
openstackgerritLukas Bezdicka proposed openstack/tripleo-heat-templates stable/train: [Train-only] Ensure arch-facilities is not present in cpu_map.xml  https://review.opendev.org/74531512:17
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates stable/queens: Add j2 per-role MetricsQdrNetwork  https://review.opendev.org/74531612:22
*** ykarel has quit IRC12:26
*** rh-jelabarre has joined #tripleo12:30
*** rcernin has quit IRC12:32
*** jpena|lunch is now known as jpena12:36
*** ratailor_ has quit IRC12:43
*** udesale_ has joined #tripleo12:44
*** udesale has quit IRC12:47
rlandycloudnull: fyi ... https://bugzilla.redhat.com/show_bug.cgi?id=186713212:52
openstackbugzilla.redhat.com bug 1867132 in distribution "Buildah package upgrade from 1.14.9 ->1.15.x for rhos-16.2-rhel-8-trunk-build" [Unspecified,New] - Assigned to lhh12:52
*** ekultails has joined #tripleo12:55
openstackgerritMerged openstack/tripleo-validations stable/ussuri: Fix ceph-ansible permissions when checking the repo name  https://review.opendev.org/73961912:56
*** psahoo has quit IRC12:56
openstackgerrityatin proposed openstack/tripleo-quickstart master: Switch Standalone environment to centos8  https://review.opendev.org/74391912:56
openstackgerritLukas Bezdicka proposed openstack/tripleo-upgrade master: Evacuate computes before RHEL upgrade  https://review.opendev.org/74395113:01
openstackgerritLukas Bezdicka proposed openstack/tripleo-upgrade master: Refactor FFWD run to run on 1/3rd of controlplane  https://review.opendev.org/74395213:01
openstackgerritLukas Bezdicka proposed openstack/tripleo-upgrade master: FFWD upgrade converge cleanup  https://review.opendev.org/74488413:01
openstackgerritLewis Denny proposed openstack/tripleo-heat-templates master: Remove remaining Skydive references  https://review.opendev.org/74532013:03
openstackgerritAlex Schultz proposed openstack/tripleo-common stable/ussuri: Add exponential backoff to ratelimited requests  https://review.opendev.org/74532213:10
openstackgerritAlex Schultz proposed openstack/tripleo-common stable/train: Add exponential backoff to ratelimited requests  https://review.opendev.org/74532313:10
*** dmacpher has joined #tripleo13:11
*** psahoo has joined #tripleo13:12
*** rh-jelabarre has quit IRC13:14
*** jcapitao_lunch is now known as jcapitao13:16
cloudnullrlandy nice!13:18
cloudnull-cc mwhahaha13:18
cloudnullthank you rlandy13:18
mwhahahafun13:19
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: update centos-ci to centos8  https://review.opendev.org/74532713:23
openstackgerritLukas Bezdicka proposed openstack/tripleo-upgrade master: Refactor FFWD run to run on 1/3rd of controlplane  https://review.opendev.org/74395213:28
openstackgerritLukas Bezdicka proposed openstack/tripleo-upgrade master: FFWD upgrade converge cleanup  https://review.opendev.org/74488413:28
*** chkumar|rover is now known as raukadah13:32
dciabrincloudnull, mwhahaha hey guys I noticed that latest container images in master don't use kolla UID for service users like rabbitmq. I don't think that's expected? http://paste.openstack.org/show/796652/13:52
openstackgerritRafael Folco proposed openstack/tripleo-ci master: Enable py3 on dib release 7  https://review.opendev.org/73365913:53
cloudnulldciabrin yes, we've dropped kolla.13:54
cloudnullon a new install it should be using the uid from the packages13:54
dciabrinoh so that's expected..13:54
cloudnullindeed. are you seeing an issue with it ?13:55
cloudnullother than the different uid/gid ?13:55
mwhahahawait we stopped the kolla uid/gid stuff?13:56
dciabrinI have a rabbitmq container that doesn't restart after an upgrade ussuri->master, because the old config files are not regenerated and the initial perm are not reset with kolla_init_start when we start that container13:56
mwhahahathat'll cause permission problems13:56
dciabrinmwhahaha, right on :)13:56
cloudnullwere you able to reset the perms with kolla_init_start? maybe something that needs to be toggled in an upgrade task?13:58
dciabrincloudnull, i can do that yes.13:59
dciabrinthat fixes the issue for that specific container13:59
*** psahoo has quit IRC13:59
openstackgerrityatin proposed openstack/tripleo-quickstart master: Switch Standalone environment to centos8  https://review.opendev.org/74391914:00
cloudnull++ maybe a pattern we'll have to replicate w/ other services14:00
openstackgerritMerged openstack/tripleo-ansible stable/train: Set the OpenFlow protocol while upgrading OVS from 2.11  https://review.opendev.org/74529714:01
*** ykarel has joined #tripleo14:02
beaglesI sense a sidecar problem coming ...14:18
beagles/var/lib/neutron will have the kolla neutron uid/gid14:18
mwhahahait's likely also a problem for customers who may already have these uid/gids14:18
mwhahahawe need to put that back in14:18
mwhahahai thought we kept that14:19
openstackgerritMerged openstack/tripleo-heat-templates stable/ussuri: Update octavia playbooks parameters  https://review.opendev.org/74418314:29
openstackgerritMerged openstack/tripleo-upgrade stable/ussuri: Add BootParams service to all roles  https://review.opendev.org/74506014:29
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: openstack collections and operators are both in quickstart-extras-requirements  https://review.opendev.org/74534614:29
*** jpich has quit IRC14:29
*** jpich has joined #tripleo14:29
openstackgerritamolkahat proposed openstack/openstack-tempest-skiplist master: Adding ironic chassis_node_list test to skiplist.  https://review.opendev.org/74488214:33
ykarelmarios, i had replied to both https://review.opendev.org/#/q/branch:master+topic:bug/1889219+status:open, can u revisit14:33
mariosykarel: ack will do14:36
openstackgerritAlex Schultz proposed openstack/tripleo-ansible master: Create a role for network config  https://review.opendev.org/74426014:38
dciabrinmarios, ykarel if you have some time for https://review.opendev.org/#/c/725782/ as well.14:40
mariosdciabrin: adding to queue14:43
ykareldciabrin, ack14:45
*** ysandeep|off is now known as ysandeep14:51
ykarelTengu, so container-tools:2.0 with podman-1.6.4-15 should be released today in some hours14:52
ykareland container-tools:rhel8 with podman-1.9.3 on Monday14:52
ykarelso we need to switch to container-tools:2.0 to be prepared in case 1.9.3 is not good for CI14:53
ykarelwill revise my patch14:53
weshay|ruckmwhahaha, we're doing something right :)  master gate today has 70 jobs ran, 0 failures and ussuri is at 98% pass14:56
mwhahahacloudnull: https://review.opendev.org/#/c/744709/14:56
mwhahahaweshay|ruck: i think we're good on the 429 front for now14:57
weshay|ruck+114:57
*** psachin has quit IRC14:58
Tenguykarel: \o/14:58
* cloudnull looking 14:59
cloudnull+215:00
cloudnullwe'll need someone else to approve15:00
rlandycloudnull: mwhahaha: I still get the "error extracting layer" problem with buildah  1.15.0-1.module+el8.3.0+7084+c16098dd15:00
rlandywhat version did you try?15:00
mwhahahai wasn't able to reproduce my problem with layers with 1.15 but i didn't try a build15:01
mwhahaharlandy: can we re-run it with --debug on the buildah command so we can open an issue?15:01
cloudnulloh, maybe different but similar issues?15:01
cloudnullthat would be fun15:02
openstackgerrityatin proposed openstack/tripleo-quickstart master: Use container-tools:2.0 instead of default rhel8 stream  https://review.opendev.org/74517315:03
rlandymwhahaha: cloudnull: well on the next run, we are switching to rhel 8.3 entirely so I want to see what works/fails there15:03
*** Guest7899 has joined #tripleo15:03
rlandywe just installed the builfah rpm from there15:03
mwhahahait'll probably fail, we should prepare running --debug15:03
mwhahahanot certain if we support that in tripleoclient for that stuff15:03
rlandybut ... https://sf.hosted.upshift.rdu2.redhat.com/logs/02/207802/30/check/tripleo-build-containers-ubi-8-internal-rhel-8-rhos-16.2/a6206ed/logs/build.log15:03
ykarelweshay|ruck please check https://review.opendev.org/74517315:04
weshay|ruckk15:04
rlandymwhahaha: "not certain if we support that in tripleoclient for that stuff" what stuff is that?15:05
rlandy8.3 or mixed installs?15:05
mwhahahalooks like it's tripleo-common15:05
mwhahaharlandy: the thing that invokes buildah15:05
mwhahahalike i don't think we honor --debug all the way down15:05
rlandyit is15:06
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: fix openstack collections in tq  https://review.opendev.org/74534615:06
mwhahaharlandy: no we need to have the buildah command run with --debug15:06
*** Guest7899 is now known as redrobot15:06
*** pcaruana has quit IRC15:07
mwhahaharlandy: tripleoclient calls code in tripleo-common that execs buildah, but we don't provide a --debug to it15:07
* mwhahaha patches15:07
rlandyI see15:07
openstackgerritAlex Schultz proposed openstack/tripleo-common master: Add --debug for buildah builder  https://review.opendev.org/74535615:12
*** ramishra has quit IRC15:12
*** yolanda has quit IRC15:12
openstackgerritSaravanan KR proposed openstack/tripleo-heat-templates master: Reset sriov_numvfs to 0 before leapp upgrade  https://review.opendev.org/74528015:12
skramajajfrancoa: ^15:13
*** yolanda has joined #tripleo15:13
jfrancoaskramaja: great! I'll add myself as reviewer and check it already next week, week is comming to an end15:13
jfrancoaskramaja: have a nice weekend15:13
skramajau too. thanks.15:14
openstackgerritAlex Schultz proposed openstack/python-tripleoclient master: Honor --debug for buildah builder  https://review.opendev.org/74535715:14
openstackgerritJose Luis Franco proposed openstack/tripleo-ansible master: Add role tripleo_stream_enable.  https://review.opendev.org/74517715:19
*** pcaruana has joined #tripleo15:19
openstackgerritOliver Walsh proposed openstack/tripleo-common master: Ensure tripleo ansible inventory file update is atomic  https://review.opendev.org/74535815:20
mwhahaharlandy: is it consistent the failure in that it always happens (but might be different containers)?15:21
mwhahahaand do we not see this upstream?15:21
openstackgerritMerged openstack/tripleo-upgrade stable/train: Add BootParams service to all roles  https://review.opendev.org/74506115:22
openstackgerritMerged openstack/tripleo-upgrade master: Keep ceph-ansible 3 during whole FFU.  https://review.opendev.org/74444115:22
*** lmiccini has quit IRC15:28
rlandymwhahaha: I have only seen the "error extracting layer" problem when testing containers for 16.215:29
mwhahaharlandy: do we have a centos-stream job anywhere?15:29
mwhahaha1.15 is in 8-stream but not 815:30
rlandymwhahaha: we don't but I can build one15:31
mwhahahayea we should have one, even it's just a standalone w/ container builds15:31
mwhahahait should hit this15:31
mwhahahameh getting freaking perl conflicts trying to switch to stream15:32
*** ykarel is now known as ykarel|away15:34
rlandyputting up a POC job15:35
*** jpich is now known as Chulp15:36
*** Chulp is now known as jpich15:36
openstackgerritMerged openstack/tripleo-common stable/ussuri: Revert "Add kolla template override to remove python3-networking-mlnx"  https://review.opendev.org/73416215:37
*** rlu_ has joined #tripleo15:42
openstackgerritMerged openstack/tripleo-ansible stable/ussuri: Fix podman version  https://review.opendev.org/74511915:44
*** skramaja has quit IRC15:45
*** rlu has quit IRC15:45
*** rlu_ has quit IRC15:46
*** marios is now known as marios|out15:59
rlandymwhahaha: so, yes, stream gives us perl conflicts - but here are the testproject jobs ... https://review.rdoproject.org/r/#/c/21683/53/.zuul.yaml16:00
mwhahahayea i get that too16:00
*** lucasagomes has quit IRC16:01
*** marios|out has quit IRC16:04
*** dtantsur is now known as dtantsur|afk16:04
*** ntt__ has quit IRC16:05
ykarel|awayrlandy, for stream u could also check rdo-centos-stream node label, we running some packstack/puppet periodic jobs with stream16:07
ykarel|awayhttps://review.rdoproject.org/zuul/builds?job_name=periodic-victoria-packstack-scenario001-centos-stream16:07
ykarel|awayhttps://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/weirdo-jobs.yaml#L695-L69816:09
openstackgerritMerged openstack/python-tripleoclient stable/ussuri: Simplify error handling in tripleo_deploy  https://review.opendev.org/74442216:09
mwhahaharlandy: i'm trying the 8stream image to see if that fixes the perl conflict. going from 8 -> 8-stream ends up in conflicts for me16:10
*** jpena is now known as jpena|off16:10
mwhahahaand of course they prevent the buildah update which is weird16:11
*** dtantsur|afk has quit IRC16:11
rlandythose hobs are doing fine16:11
rlandyjobs16:11
*** marbindrakon has joined #tripleo16:12
*** alexmcleod has quit IRC16:13
mwhahahaeh still getting the perl error but i can install buildah now16:15
*** bogdando has quit IRC16:15
mwhahahashould we be setting container-tools:2.0 for stable branches rather than letting it add container-tools:rhel8?16:15
*** marbindrakon2 has joined #tripleo16:18
mwhahahaugh stream gets python3.816:19
openstackgerritMerged openstack/tripleo-validations stable/train: Fix neutron_sanity_check for ML2/OVS overcloud  https://review.opendev.org/74485716:19
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: [Queens only] Clean yum metadata.  https://review.opendev.org/73669916:19
*** marbindrakon has quit IRC16:19
*** ysandeep is now known as ysandeep|off16:19
weshay|ruckwe mergin boy WE MERGIN16:21
*** jpich has quit IRC16:22
rlandy 16.1 is using container-tools:2.016:29
mwhahaharight but we dont' specify module stuff16:29
mwhahahaso we're getting container-tools:rhel816:29
rlandy16.2 is pulling  container-tools:rhel816:30
rlandyso the same16:30
rlandyand using rel 8.3 gives us build errors16:31
rlandyoh joy16:31
mwhahahacontainer-tools:rhel8 on 8 is still 1.11.616:31
mwhahahaon stream i finally got 1.15 so i'm going to try and build in a min16:32
mwhahahaoh fun i get podman 2.0.0 too16:32
mwhahahaError: Failed to download metadata for repo 'Stream-AppStream': Cannot prepare internal mirrorlist: No URLs in mirrorlist16:38
mwhahahameh16:38
*** rlu has joined #tripleo16:41
*** udesale_ has quit IRC16:41
mwhahahacloudnull: is the yum repo mount dir configurable in the new build system?16:43
cloudnullI think so? I think its just using the straight volume arg16:44
mwhahahaah yes via --volume16:44
* cloudnull goes to check 16:44
cloudnull++16:44
cloudnullI think the default points at /etc/yum/repos,d/ ...16:45
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: fix openstack collections in tq  https://review.opendev.org/74534616:45
cloudnull++ https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v2/tripleo_container_image.py#L188-L19016:45
cloudnullthat's the default but it should be totally configurable16:45
mwhahahayea i got it16:47
mwhahahathe stream repos appear not to be working correctly for some reason16:47
cloudnullweird - centos8 stream ?16:47
mwhahahayea16:48
mwhahahathe mirror list was failing16:48
* cloudnull never tried that as a build host, but probably makes sense we di 16:48
cloudnull**do16:48
mwhahahanow i'm getting failure trying to find python3/socat16:48
* mwhahaha flips tables16:48
* cloudnull walks away slowly 16:48
mwhahahai will say a single cmd command is much nicer than the kolla config and all that other stuff we had to do previously :D16:49
weshay|ruckevery time a table flips an angel gets it's wings16:50
cloudnullROLF16:53
mwhahahabuilding finally16:53
mwhahahahad to remove the CentOS-Stream* repos16:53
cloudnullI wonder if we should document what repos we require (generally)16:53
cloudnullatm we just point at a repo dir and hope16:54
mwhahahai mean it's the base centos + tripleo-repos bits16:54
mwhahahathe issue here is that the stream mirrorurl was erroring for some reason and i don't care enough to troubleshoot :D16:54
cloudnullyeah i guess the expectation is the tripleo-repos was run and all is right with the world16:55
weshay|ruckya.. there's been enough network fun this week16:55
weshay|ruckmwhahaha, rdo can carry the f.. package for some time for us.. or do yum modules f.. that up16:55
* cloudnull fair enough, goes back to hating YAQL16:55
rlandyweshay|ruck: well worked up another dependency job for stream16:55
mwhahahai was missing the centos8 appstream in my dir16:55
weshay|ruckrlandy++ we'll need it16:55
mwhahahaso it was my fault16:55
*** derekh has quit IRC17:01
*** gfidente is now known as gfidente|afk17:04
openstackgerritMerged openstack/tripleo-validations stable/ussuri: Fix neutron_sanity_check for ML2/OVS overcloud  https://review.opendev.org/74485617:11
weshay|ruckthe zuul gate is empty for tripleo :)))17:29
*** ayoung has joined #tripleo17:33
*** ade_lee_ has quit IRC17:37
*** ade_lee has joined #tripleo17:37
*** ade_lee has quit IRC17:39
*** ade_lee has joined #tripleo17:42
lbragstado/ is anyone available for a quick tht review? https://review.opendev.org/#/c/744526/ it'll help us get CI passing for TLS-e environments18:15
*** ykarel|away has quit IRC18:19
*** rlu_ has joined #tripleo18:24
*** rlu has quit IRC18:27
*** rlu_ has quit IRC18:31
openstackgerritwes hayutin proposed openstack/ansible-role-collect-logs master: add build_id directly to the logs  https://review.opendev.org/74538518:31
openstackgerritRajini Karthik proposed openstack/puppet-tripleo master: Deprecating VxFlex OS  Volume Config  https://review.opendev.org/74538618:33
mwhahahacloudnull: so i reproduced it locally but it was trying to write out novajoin-base and novajoin-notifier at the same time. They shouldn't have been processing at the same time18:38
mwhahahaerm maybe i'm misreading the output18:40
*** ykarel has joined #tripleo18:42
openstackgerritRajini Karthik proposed openstack/tripleo-heat-templates master: Deprecating VxFlex OS Cinder Config  https://review.opendev.org/74539018:45
ykarelweshay|ruck, looks like train centos8 had false promotion, can u check18:53
ykarelcontainer images missing18:53
weshay|ruckykarel, where are you noticing containers are missing?18:54
ykarelweshay|ruck, gate jobs18:54
ykarelhttps://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_ab1/745173/2/check/tripleo-ci-centos-8-containers-multinode-train/ab18778/logs/undercloud/home/zuul/undercloud_install.log18:54
ykarelhttps://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_b96/744861/2/check/tripleo-ci-centos-8-containers-multinode/b961de6/logs/undercloud/home/zuul/undercloud_install.log18:54
ykarelatleast this is outdated https://hub.docker.com/r/tripleotraincentos8/centos-binary-neutron-server/tags18:54
weshay|ruckykarel, thanks..18:59
*** ykarel is now known as ykarel|away19:00
*** slaweq has quit IRC19:03
cloudnullmwhahaha were you able to repro the issue?19:06
mwhahahacloudnull: yea but i didn't see anything that stuck out19:06
cloudnulleven w/ 1.15?19:06
*** slaweq has joined #tripleo19:06
mwhahahayea19:06
cloudnull:'(19:06
mwhahahai'm rerunning to see if i can get more details19:06
mwhahahai think --debug with --logfile on buildah doesn't always put all the debug messages in the log file19:09
cloudnulli reread your last sentance a couple times, i should post a pic of the face ive made trying to understand that19:11
cloudnulllike sometimes it just decides to omit messages?19:12
mwhahahasome of --debug goes to stderr19:12
mwhahahabut doesn't end up in the logfile19:12
cloudnullweird19:13
mwhahahathe error that gets spit out wasn't in the log file19:14
mwhahahaso now i'm rerunning with tripleoclient --debug and buildah --debug19:14
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates master: WIP: refactor nova db config  https://review.opendev.org/71855219:16
mwhahahanext would be --log-level=trace19:18
mwhahahai love the fact that the  error code is 125 which maps to -> ExecErrorCodeGeneric19:24
*** ykarel|away has quit IRC19:38
*** gfidente|afk has quit IRC19:38
*** pkopec has quit IRC19:41
*** slaweq has quit IRC19:50
*** slaweq has joined #tripleo19:58
ade_leecloudnull, https://review.opendev.org/#/c/728561/  please19:59
*** slaweq has quit IRC20:15
openstackgerritMerged openstack/tripleo-ansible stable/ussuri: Scan existing controllers on update to pick up existing certs/private keys  https://review.opendev.org/74418420:15
mwhahaharlandy, cloudnull: https://github.com/containers/buildah/issues/252120:17
mwhahahai filed a bug20:17
rlandymwhahaha: thanks20:24
openstackgerritJose Luis Franco proposed openstack/tripleo-ansible master: Add role tripleo_stream_enable.  https://review.opendev.org/74517720:27
openstackgerritMerged openstack/tripleo-docs master: Add missing FreeIPA install steps  https://review.opendev.org/72856120:28
openstackgerritJose Luis Franco proposed openstack/tripleo-ansible master: Add role tripleo_stream_enable.  https://review.opendev.org/74517720:30
cloudnullmwhahaha ++ rlandy I guess we’ll need to lock down to 1.11 for the time being ?20:35
mwhahahaseems like it20:35
cloudnullat least we’re not dead in the water20:35
mwhahahathe build process is something outside of the regular deployment/day2 stuff20:35
mwhahahaso we should be able to just lock it for our builds20:35
cloudnullagreed20:36
mwhahahathe build+standalone job might be weird20:36
cloudnullMeh. More of an edge case for the time being.20:37
cloudnullI wonder if we can mitigate the issue by slowing our build process down?20:37
cloudnulllike adding an random sleep between builds ?20:38
rlandychandan put up this patch ... https://review.opendev.org/#/c/745311/20:38
*** ekultails has quit IRC20:38
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Invoke tripleo-stream-enable for Upgrades and Updates.  https://review.opendev.org/74521320:38
cloudnullwhen rlandy and I were testing we made some of the failed builds go manually. Which was done by hand and serially.20:38
cloudnullso maybe it’s just an fs sync issue ?20:39
mwhahahai think it's something internally to the build20:39
cloudnullmore gifts from overlayfs?20:39
mwhahahabecause it's not failing on a shared layer20:39
cloudnullfair20:39
*** jfrancoa has quit IRC20:39
mwhahahaat least i think it' snot20:39
mwhahahait was failign on the USER ceilometer line for me20:40
mwhahahalike it's not even a good layer :D20:40
cloudnullHahaha20:40
mwhahahait also failed on a run mkdir layer20:42
mwhahahaso it's not consistent on what it's failing on either20:42
cloudnullYeah we were seeing the same, inconsistent, behavior.20:45
cloudnullOk peoples. I’ve had enough cloud for the day. Have a great weekend all.20:46
mwhahahaadios20:46
*** rfolco has quit IRC20:57
*** maciejjozefczyk has quit IRC21:10
*** rlandy has quit IRC21:18
*** raildo has quit IRC21:21
*** rcernin has joined #tripleo21:48
openstackgerritAde Lee proposed openstack/tripleo-docs master: Add TLS-E to the standalone deploy guide  https://review.opendev.org/72858121:53
openstackgerritwes hayutin proposed openstack/ansible-role-collect-logs master: add build_id directly to the logs  https://review.opendev.org/74538522:06
*** cfontain has joined #tripleo22:11
*** rcernin has quit IRC22:26
*** rcernin has joined #tripleo22:32
*** stevebaker has quit IRC22:34
*** ayoung has quit IRC22:44
*** ayoung has joined #tripleo22:44
*** tosky has quit IRC22:58
*** artom has quit IRC23:00
*** rcernin has quit IRC23:38
*** rlu has joined #tripleo23:40
*** rlu has quit IRC23:44
openstackgerritMerged openstack/tripleo-common master: Ensure tripleo ansible inventory file update is atomic  https://review.opendev.org/74535823:49
*** ayoung has quit IRC23:52
*** ayoung has joined #tripleo23:53

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!