Wednesday, 2022-05-11

opendevreviewBrendan Shephard proposed openstack/python-tripleoclient master: Replace non-inclusive language  https://review.opendev.org/c/openstack/python-tripleoclient/+/82007800:01
opendevreviewBrendan Shephard proposed openstack/python-tripleoclient master: Replace non-inclusive language  https://review.opendev.org/c/openstack/python-tripleoclient/+/82007800:02
opendevreviewBrendan Shephard proposed openstack/python-tripleoclient master: Replace non-inclusive language  https://review.opendev.org/c/openstack/python-tripleoclient/+/82007800:03
*** rlandy|bbl is now known as rlandy|out00:03
opendevreviewMerged openstack/tripleo-ci master: Revert "Adds tripleo-repos/-operator-ansible collection push jobs"  https://review.opendev.org/c/openstack/tripleo-ci/+/84122300:03
opendevreviewBrendan Shephard proposed openstack/python-tripleoclient master: Replace non-inclusive language  https://review.opendev.org/c/openstack/python-tripleoclient/+/82007800:05
opendevreviewJames Slagle proposed openstack/tripleo-ansible master: tripleo_keystone: Use tripleo_container_standalone  https://review.opendev.org/c/openstack/tripleo-ansible/+/83890600:11
opendevreviewJames Slagle proposed openstack/tripleo-ansible master: Add tripleo_iscsid role  https://review.opendev.org/c/openstack/tripleo-ansible/+/83890700:11
opendevreviewJames Slagle proposed openstack/tripleo-ansible master: Add tripleo_mysql_client role  https://review.opendev.org/c/openstack/tripleo-ansible/+/84032100:11
opendevreviewJames Slagle proposed openstack/tripleo-ansible master: Add initial standalone playbooks and inventory for a compute node  https://review.opendev.org/c/openstack/tripleo-ansible/+/84050900:11
opendevreviewJames Slagle proposed openstack/tripleo-ansible master: Add tripleo_bootstrap role to standlone install phase  https://review.opendev.org/c/openstack/tripleo-ansible/+/84067500:11
opendevreviewJames Slagle proposed openstack/tripleo-ansible master: Add tripleo_ssh_known_hosts role to standalone configure phase  https://review.opendev.org/c/openstack/tripleo-ansible/+/84067600:11
opendevreviewJames Slagle proposed openstack/tripleo-ansible master: Add standalone bootstrap phase and playbook  https://review.opendev.org/c/openstack/tripleo-ansible/+/84067700:11
opendevreviewJames Slagle proposed openstack/tripleo-ansible master: Add pre-network and network phase and playbooks  https://review.opendev.org/c/openstack/tripleo-ansible/+/84090300:11
*** artom_ is now known as artom00:47
*** ysandeep|out is now known as ysandeep|rover01:21
ysandeep|roverhjensas: i think https://opendev.org/openstack/tripleo-ansible/commit/b4e23529891eccd83e1e313e871e299b16ed93e7 only in master - I think because of this we are not seeing in wallaby.01:37
opendevreviewSteve Baker proposed openstack/tripleo-ansible master: Use inventory host for wait_for_connection  https://review.opendev.org/c/openstack/tripleo-ansible/+/84136001:38
opendevreviewTakashi Kajinami proposed openstack/tripleo-heat-templates master: Remove implementation for Nuage integration  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/83723801:54
opendevreviewTakashi Kajinami proposed openstack/puppet-tripleo master: Remove implementation for Nuage integration  https://review.opendev.org/c/openstack/puppet-tripleo/+/83724001:55
opendevreviewSteve Baker proposed openstack/tripleo-ansible master: Use inventory host for wait_for_connection  https://review.opendev.org/c/openstack/tripleo-ansible/+/84136001:58
*** ysandeep|rover is now known as ysandeep|rover|bbl02:08
opendevreviewMerged openstack/tripleo-heat-templates master: Add back FRR to Undercloud  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84123502:21
opendevreviewTakashi Kajinami proposed openstack/puppet-tripleo master: Redis: Share the same base class  https://review.opendev.org/c/openstack/puppet-tripleo/+/84136202:52
*** dasm|bbl is now known as dasm|off03:40
*** bhagyashris|out is now known as bhagyashris03:58
*** ysandeep|rover|bbl is now known as ysandeep|rover04:23
opendevreviewMerged openstack/tripleo-heat-templates master: Add missing cert generation tasks to glance-api  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84043604:33
opendevreviewMerged openstack/tripleo-common master: Remove custom subclass to re-enable software deployment by Heat  https://review.opendev.org/c/openstack/tripleo-common/+/83948504:33
*** soniya29 is now known as soniya29|ruck04:51
ysandeep|rovermarios, Tengu hjensas: please add in your review list: https://review.opendev.org/c/openstack/tripleo-ansible/+/841360 05:27
mariosysandeep|rover: morning 05:33
mariosysandeep|rover: nice ... does it fix the ssh issue (that bug has been a pain for  while)05:33
mariosproblem with that one is it was inconsistent... so we won't know for sure until it runs for a while with this fix i gues... 05:33
ysandeep|rovermarios: yes, it will fix the node provisioning issue05:33
mariosysandeep|rover: yeah but https://review.opendev.org/c/openstack/tripleo-ansible/+/841360/2#message-fa9e548eb1647fdb084a54e257bc7bee86068a3a 05:34
marioshmm05:34
ysandeep|rovermarios, tested in my lab by killing one overcloud node - http://pastebin.test.redhat.com/1050919 05:34
ysandeep|roverwith steve patch it retries again and again on "wait for node to be provisioned" where earlier it was not waiting.05:35
ysandeep|rovervexx nodes are definetely slow but this patch makes our code path much stable with slow nodes.05:37
mariosysandeep|rover: ack ok lets see at least it makes sense anyway voted just now05:37
ysandeep|rovermarios: thanks!05:38
hjensasysandeep|rover: I approved the patch.05:48
ysandeep|roverhjensas: thank you :)05:48
hjensasstevebaker[m]++ nice catch!05:48
mariosnp ysandeep|rover 05:56
opendevreviewTakashi Kajinami proposed openstack/puppet-tripleo master: Redis: Share the same base class  https://review.opendev.org/c/openstack/puppet-tripleo/+/84136206:01
opendevreviewSandeep Yadav proposed openstack/tripleo-heat-templates stable/wallaby: Switch to stestr  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84128006:05
opendevreviewSofer Athlan-Guyot proposed openstack/tripleo-heat-templates stable/train: Ensure container's image get updated if their name stay the same.  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84134706:13
opendevreviewSandeep Yadav proposed openstack/tripleo-heat-templates stable/wallaby: Switch to stestr  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84128006:15
opendevreviewSandeep Yadav proposed openstack/tripleo-heat-templates stable/wallaby: Switch to stestr  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84128006:26
opendevreviewSofer Athlan-Guyot proposed openstack/tripleo-heat-templates stable/train: Ensure container's image get updated if their name stay the same.  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84134706:33
opendevreviewSofer Athlan-Guyot proposed openstack/tripleo-heat-templates stable/train: Ensure container's image get updated if their name stay the same.  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84134706:35
opendevreviewJiri Podivin proposed openstack/tripleo-validations stable/train: Validate libvirtd is not running on the undercloud  https://review.opendev.org/c/openstack/tripleo-validations/+/83176106:58
opendevreviewJiri Podivin proposed openstack/tripleo-validations stable/victoria: Validate libvirtd is not running on the undercloud  https://review.opendev.org/c/openstack/tripleo-validations/+/83175706:58
opendevreviewRabi Mishra proposed openstack/tripleo-heat-templates stable/wallaby: Revert "Don't use upper-constraints for pep8 target"  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84128207:13
opendevreviewRabi Mishra proposed openstack/tripleo-heat-templates stable/wallaby: Revert "Don't use upper-constraints for pep8 target"  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84128207:23
*** ysandeep|rover is now known as ysandeep|rover|brb07:29
*** soniya is now known as soniya|ruck07:40
*** ysandeep|rover|brb is now known as ysandeep|rover07:40
opendevreviewSandeep Yadav proposed openstack/tripleo-heat-templates stable/wallaby: Switch to stestr  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84137507:44
opendevreviewSandeep Yadav proposed openstack/tripleo-heat-templates stable/wallaby: Switch to stestr  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84137507:45
*** soniya|ruck is now known as soniya|ruck|dinner07:51
*** soniya|ruck|dinner is now known as soniya|ruck|lunch07:53
ysandeep|rovermarios, Tengu need reviews to unblock gate: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/841282/ 07:54
mariosack ysandeep|rover 07:56
ysandeep|rovermarios, thanks!07:57
*** ysandeep|rover is now known as ysandeep|rover|lunch08:01
opendevreviewJiri Podivin proposed openstack/tripleo-validations stable/train: Adding backup-and-restore validation group  https://review.opendev.org/c/openstack/tripleo-validations/+/84137808:07
opendevreviewJiri Podivin proposed openstack/tripleo-validations stable/victoria: Adding backup-and-restore validation group  https://review.opendev.org/c/openstack/tripleo-validations/+/84138008:09
opendevreviewMerged openstack/tripleo-ansible master: Use inventory host for wait_for_connection  https://review.opendev.org/c/openstack/tripleo-ansible/+/84136008:23
opendevreviewJakob Meng proposed openstack/tripleo-quickstart-extras master: Use openstack prefix only for CentOS 7 container images  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/84138108:39
opendevreviewMarios Andreou proposed openstack/tripleo-ci master: Remove centos-7 job definitions and zuul layouts  https://review.opendev.org/c/openstack/tripleo-ci/+/83951808:49
*** soniya|ruck|lunch is now known as soniya|ruck08:56
*** ysandeep|rover|lunch is now known as ysandeep|rover09:02
*** jpena|off is now known as jpena09:39
opendevreviewJiri Podivin proposed openstack/validations-libs stable/1.6: Validation help improvement  https://review.opendev.org/c/openstack/validations-libs/+/84139209:57
opendevreviewMerged openstack/tripleo-ansible stable/wallaby: ReaR needs specific configuration in RHEL9 with LVM  https://review.opendev.org/c/openstack/tripleo-ansible/+/84093609:59
opendevreviewJiri Podivin proposed openstack/validations-common stable/1.6: Removing references to Babel  https://review.opendev.org/c/openstack/validations-common/+/84139710:16
opendevreviewJiri Podivin proposed openstack/validations-common stable/1.6: setup.cfg: Replace dashes by underscores  https://review.opendev.org/c/openstack/validations-common/+/84139810:16
opendevreviewJiri Podivin proposed openstack/validations-common stable/1.6: Normalizing VF metadata  https://review.opendev.org/c/openstack/validations-common/+/84139910:16
opendevreviewchandan kumar proposed openstack/tripleo-ansible master: Rename jobs to centos-stream and use stream9 image as base  https://review.opendev.org/c/openstack/tripleo-ansible/+/83968811:01
*** bhagyashris_ is now known as bhagyashris11:03
opendevreviewJiri Podivin proposed openstack/validations-libs stable/1.6: Removing references to Babel  https://review.opendev.org/c/openstack/validations-libs/+/84140211:06
Tenguslaweq: heya! fyi, I think I have something that really looks like a valid nftables ruleset for tripleo dedicated rules - it even creates dedicated chains in the different tables, and add the needed jump rule to forward packets in the custom chains.11:18
Tenguand it also checks to ensure there isn't such rule already.11:19
*** rlandy|out is now known as rlandy11:21
*** dviroel|out is now known as dviroel11:31
*** ysandeep|rover is now known as ysandeep|rover|brb11:32
*** ysandeep|rover|brb is now known as ysandeep|rover11:37
*** artom_ is now known as artom11:42
*** dasm|off is now known as dasm11:46
opendevreviewchandan kumar proposed openstack/tripleo-quickstart-extras master: Use openstack prefix only for CentOS 7 container images  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/84138111:49
*** ysandeep|rover is now known as ysandeep|rover|mtg11:55
opendevreviewMerged openstack/tripleo-validations master: Adding roles.galaxy to the gitignore  https://review.opendev.org/c/openstack/tripleo-validations/+/82603811:57
opendevreviewMerged openstack/tripleo-validations master: Tests for the 'verify_profiles' module.  https://review.opendev.org/c/openstack/tripleo-validations/+/79530411:57
opendevreviewMerged openstack/tripleo-heat-templates stable/wallaby: Revert "Don't use upper-constraints for pep8 target"  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84128211:57
opendevreviewCedric Jeanneret proposed openstack/tripleo-ansible master: WIP Supports nftables instead of iptables  https://review.opendev.org/c/openstack/tripleo-ansible/+/84141412:06
odyssey4mehey folks - looks like https://review.opendev.org/c/openstack/tripleo-ansible/+/839738 failed the check pipeline and has been static for a week or so... are we waiting for something else, or is that ready for a recheck?12:14
opendevreviewJiri Podivin proposed openstack/tripleo-validations master: Refactoring and improvement of check_ironic_boot_config tests  https://review.opendev.org/c/openstack/tripleo-validations/+/78112512:16
opendevreviewchandan kumar proposed openstack/tripleo-ansible master: Rename jobs to centos-stream and use stream9 image as base  https://review.opendev.org/c/openstack/tripleo-ansible/+/83968812:20
Tenguslaweq: re-started the testproject run, adding a new depends-on that should solve RDO node provisioning issue.12:25
Tengulet's see how it goes for the firewall now!12:25
Tengubefore breaking things down with my nftables thingy :]12:26
slaweqTengu: thx a lot12:33
slaweqfingers crossed :)12:33
Tenguyep :)12:34
Tenguslaweq: in parallel, if you want to cry a bit, https://review.opendev.org/c/openstack/tripleo-ansible/+/841414  it's still heavily WIP, untested so far, but that's "the current state of nftables support in tripleo"12:35
slaweqTengu: I will take a look12:35
TenguI'll do some proper doc + examples, and push some molecule testing as well to ensure things are being generated correctly.12:36
*** ysandeep|rover|mtg is now known as ysandeep|rover12:37
ysandeep|roverhjensas, stevebaker[m] fyi.. saw this today , https://logserver.rdoproject.org/37/28537/40/check/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-tripleo-master/ff50ffc/logs/baremetal_40_28810_0-console.log kernel panic during boot - rerunning to confirm if its consistent.12:47
ysandeep|roverrlandy, ^^ fyi.. 12:47
rlandyoh gee - it keeps going12:57
Tenguerf12:58
Tenguo_O I thought that disk uuid thing was solved...12:58
rlandya new thing every day - twice a day sometimes13:02
Tenguweeee13:02
opendevreviewBogdan Dobrelya proposed openstack/tripleo-heat-templates stable/wallaby: Add IPA client service to Cell ctrlr role  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84128413:04
Tenguslaweq: tiny issue with the container tag - updated again.13:07
*** ysandeep|rover is now known as ysandeep|rover|brb13:21
*** ysandeep|rover|brb is now known as ysandeep|rover13:31
*** bhagyashris_ is now known as bhagyashris13:33
cloudnullrlandy have you seen the following error recently -- https://paste.opendev.org/show/bAHUG0E9VapxVTs3Iy7F/ -- running master (current-tripleo)13:55
cloudnullrunning -- sudo dnf install https://trunk.rdoproject.org/centos9-master/component/tripleo/39/73/39731d9844391fa82aadfec48a45bdcb6b8b2056_399a8bbb/openstack-tripleo-common-16.4.1-0.20220502104410.ba2c1c5.el9.noarch.rpm -- even after cleaning up the dnf / rpm cache, seems to run up against the same error 13:56
cloudnulllooks like its failing to unpack the rpm 13:56
cloudnullError unpacking rpm package openstack-tripleo-common-16.4.1-0.20220502104410.ba2c1c5.el9.noarch13:56
rlandycloudnull: not that I have seen yet - we are out on promoting master by 4 days atm - lots of OVB issues13:57
rlandylet me check other check jobs13:57
opendevreviewJiri Podivin proposed openstack/tripleo-validations stable/wallaby: [Stable-Only] Redefining the irrelevant files list to ensure execution graph stability  https://review.opendev.org/c/openstack/tripleo-validations/+/84143113:57
cloudnull++ 13:58
cloudnullI ran into that , when performing a package update13:58
opendevreviewJiri Podivin proposed openstack/tripleo-validations stable/wallaby: Removing leftover README docs from roles  https://review.opendev.org/c/openstack/tripleo-validations/+/84143213:58
cloudnullfix was to remove /usr/share/openstack-tripleo-common/container-images and reinstall but its odd that it happened in the first place.13:59
cloudnullwe may not be seeing it in our normal day to day jobs. just curious if there were similar reports of issues going on 13:59
rlandycloudnull: seen that more than once? on zuul or a personal env?14:02
rlandytrying to track if mirrors are involved14:02
opendevreviewJiri Podivin proposed openstack/tripleo-validations stable/wallaby: Adding roles.galaxy to the gitignore  https://review.opendev.org/c/openstack/tripleo-validations/+/84143314:03
opendevreviewKevin Carter proposed openstack/python-tripleoclient stable/wallaby: Move Ansible imports to correct UX Warnings  https://review.opendev.org/c/openstack/python-tripleoclient/+/84128614:04
opendevreviewJiri Podivin proposed openstack/tripleo-validations stable/wallaby: [Stable-Only] Redefining the irrelevant files list to ensure execution graph stability  https://review.opendev.org/c/openstack/tripleo-validations/+/84143114:04
opendevreviewJiri Podivin proposed openstack/tripleo-validations stable/wallaby: Removing leftover README docs from roles  https://review.opendev.org/c/openstack/tripleo-validations/+/84143214:04
opendevreviewJiri Podivin proposed openstack/tripleo-validations stable/wallaby: Adding roles.galaxy to the gitignore  https://review.opendev.org/c/openstack/tripleo-validations/+/84143314:04
cloudnullrlandy I'm seeing this on my rolling home cloud 14:05
rlandycloudnull: looks the same on other providers ie: the repos14:06
rlandybut we don't have a trace of that in check14:06
cloudnullok 14:06
rlandycloudnull: on a particular job?14:07
cloudnullnope , running an update locally 14:07
cloudnullmy home cloud runs the head of master 14:07
opendevreviewDouglas Viroel proposed openstack/tripleo-quickstart master: Add fips env file if fips enabled  https://review.opendev.org/c/openstack/tripleo-quickstart/+/81575014:07
cloudnullso updating that ran into the rpm issue 14:07
opendevreviewDouglas Viroel proposed openstack/tripleo-ansible master: Modify cert gen to make it work under fips  https://review.opendev.org/c/openstack/tripleo-ansible/+/83030814:07
opendevreviewDouglas Viroel proposed openstack/tripleo-heat-templates master: Testing latest ceph-pacific-devel container daemon  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/83345114:07
rlandycloudnull: so that's possible  - if you are ahead of master14:08
rlandywe'd only see that in tripleo component14:08
rlandyor integration14:08
rlandyit's not in intragration14:09
cloudnullrepos are master with current-tripleo 14:09
rlandycorrect14:09
rlandy"my home cloud runs the head of master"14:09
rlandy^^ 14:09
cloudnull++14:09
cloudnullthis environment is only ever running the head of master. 14:09
rlandycloudnull: this would be current-tripleo with anything latest on tripleo ... https://review.rdoproject.org/zuul/builds?pipeline=openstack-component-tripleo&skip=014:14
rlandyother than OVB joy - nothing obvious14:14
rlandyhttps://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-integration-main&skip=014:15
rlandyand integration - so OVB disaster but not picking up other 14:15
*** spotz_ is now known as spotz14:18
hjensasysandeep|rover: Looking at the dracut issue. I see the UUID it fails to find in the image build log. Wonder if https://review.opendev.org/c/openstack/diskimage-builder/+/839830 can be what is needed.14:21
hjensasysandeep|rover: I'll try to reproduce locally as well.14:21
ysandeep|roverhjensas++ thanks, we will report a bug as well if I see same issue in current run.14:22
cloudnullrlandy ++ thanks for having a look 14:24
rlandycloudnull: if you see that consistently ping again - we can recheck14:26
cloudnullwill do 14:26
*** soniya|ruck is now known as soniya|out15:05
*** dviroel is now known as dviroel|lunch15:09
ysandeep|roverhjensas: we hit the same issue again, we have reported: https://bugs.launchpad.net/tripleo/+bug/1973038 15:14
ysandeep|roverhjensas: let me run a testproject with https://review.opendev.org/c/openstack/diskimage-builder/+/839830 as depends-on to see if that fixes the issue.15:14
ysandeep|roverrlandy: ^^ fyi15:15
opendevreviewCedric Jeanneret proposed openstack/tripleo-ansible master: WIP Supports nftables instead of iptables  https://review.opendev.org/c/openstack/tripleo-ansible/+/84141415:17
rlandyysandeep|rover: pls link testproject so I can follow results 15:18
ysandeep|roverhjensas, rlandy https://review.rdoproject.org/r/c/testproject/+/2853715:18
rlandyty15:18
ysandeep|roverI will comment about testproject on bug as well15:18
opendevreviewTakashi Kajinami proposed openstack/tripleo-heat-templates master: neutorn-ironic-agent: Use internal endpoint to query Neutron API  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84144315:23
*** ysandeep|rover is now known as ysandeep|rover|out15:26
opendevreviewCedric Jeanneret proposed openstack/tripleo-heat-templates master: WIP Add new parameter in order to switch firewall engine  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84144515:32
opendevreviewMerged openstack/tripleo-ci master: Remove centos-7 job definitions and zuul layouts  https://review.opendev.org/c/openstack/tripleo-ci/+/83951815:39
*** marios is now known as marios|out15:44
rlandyhttps://zuul.openstack.org/builds?job_name=tripleo-ci-centos-9-undercloud-upgrade&skip=0 ... possible new gate blocker15:55
rlandyFYI ,,15:55
rlandywill log after meetings15:55
rlandystarted today15:57
rlandyjm1: dviroel|lunch: dasm: ^^ fyi 15:57
rlandy2022-05-11 13:29:05 | Upgraded:15:59
rlandy2022-05-11 13:29:05 |   openstack-tripleo-heat-templates-16.0.1-0.20220511043906.6025f9c.el9.noarch   15:59
rlandy2022-05-11 13:29:05 |   openstack-tripleo-validations-15.1.1-0.20220407201847.8681c04.el9.noarch      15:59
rlandy2022-05-11 13:29:05 |   tripleo-ansible-4.2.1-0.20220511082347.ba4e990.el9.noarch     15:59
dasmmhm15:59
*** dviroel|lunch is now known as dviroel16:03
dasmrlandy: fyi i just created it: https://bugs.launchpad.net/tripleo/+bug/197304316:06
rlandydasm++ thanks - was in progress of doing the same - going with yours16:07
dasmadded to rr hackmd too16:07
rlandycloudnull: slagle: Tengu: ^^ new gate blocker16:08
rlandywe'll need to raise that on ML - will do so after meeting16:08
cloudnullrlandy I saw that too https://paste.opendev.org/show/bGTp9D53akASe6oW3iz7/ -- thought it may have been related to the other package issue I was seeing. 16:09
cloudnullI had to sudo rpm -e --nodeps python3-gitdb; sudo rpm -e --nodeps python3-smmap - to overcome that 16:10
cloudnullmaybe something wrong with our base image/the packages already installed ?16:10
cloudnullI had encountered that when running `dnf upgrade`16:11
cloudnullif we're seeing this in the gate, I wonder if we're also starting from an outdated image?16:15
rlandycloudnull: outdated centos 9 - that is possible16:18
* rlandy will check the current one in a few16:18
rlandyon meeting16:18
rlandyhttps://github.com/openstack/tripleo-ci/blob/master/roles/oooci-build-images/vars/centos-9.yaml#L216:20
rlandythat is on overcloud image16:20
rlandyis the concern the container build 16:20
rlandychecking base container imahe16:23
rlandyimage16:23
rlandycloudnull: https://quay.io/repository/centos/centos?tab=tags&tag=stream9 - that is the base image16:28
rlandywas updated two days ago16:28
rlandymay be need a promo to get latest image16:28
cloudnull++16:29
rlandycloudnull: here's the issue ... we have lots of OVB  deploy bugs currently16:29
rlandyysandeep|rover> rlandy, fyi.. reporting new bug for boot issue now: https://logserver.rdoproject.org/37/28537/41/check/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-tripleo-master/21b13d8/logs/baremetal_41_49511_0-console.log16:30
rlandycloudnull: ^^ we got that one atm16:30
cloudnullyuk 16:30
rlandyso if we promo, you'll get that in current-tripleo16:30
cloudnullthat sounds terrible 16:30
rlandykind of rock-and-hard-place situation16:31
cloudnulli guess we could do a work-around step to remove those packages in the initial deploy process 16:31
cloudnulljust shell and run the rpm -e command 16:31
rlandyso far it's only showing up in zuul in the upgrade jobs16:31
cloudnullwhich would ensure that neither of those packages are problematic before continuing ?16:31
* rlandy will report gate blocker on ML16:32
cloudnull++ makes sense, thats where I saw it, running dnf upgrade on the undercloud 16:32
rlandycloudnull: yeah - can we try that as a stop gap16:32
rlandyotherwise we will need to go non-voting16:32
rlandywhich is worse16:32
rlandyjust writing some comments on the bug to explain before posting out to ML16:33
rlandycloudnull: are you working on a workaround patch or should I try something?16:39
rlandysend notification to ML16:39
cloudnulli dont have a work-around review. if you can point me at where we'd make such a change (quick start somewhere?) I'd be happy to do it16:40
rlandygetting16:40
rlandyhttps://github.com/openstack/tripleo-quickstart-extras/search?q=tripleo-modify-image16:43
rlandyso those places show where we would modify an image we pulled16:44
rlandyin a content provider job, we should build the image with changes16:44
rlandyso upgrade is a wallaby to master situation16:46
rlandyand it's only showing up in upgrade16:47
rlandynot in regular master16:47
rlandycloudnull: let's chat so I get this right - have a few minutes?16:48
opendevreviewBrent Eagles proposed openstack/tripleo-ansible master: Designate: use extra IP for bind/unbound colocation on the bind9 backend  https://review.opendev.org/c/openstack/tripleo-ansible/+/83997316:51
opendevreviewBrent Eagles proposed openstack/tripleo-ansible master: Designate: remove unnecessary transitional code for moving extra IP  https://review.opendev.org/c/openstack/tripleo-ansible/+/84045116:51
opendevreviewBrent Eagles proposed openstack/tripleo-ansible master: Designate: specify source address when using rndc  https://review.opendev.org/c/openstack/tripleo-ansible/+/84145616:51
dviroelrlandy: hum, according with https://opendev.org/openstack/requirements/src/branch/master/upper-constraints.txt - python3-gitdb-4.0.9 supports smmap 5.0.016:58
dviroelrlandy: deps repo has smmap 5.0.0, but not gitdb-4.0.9 (only gitdb-4.0.5)16:59
dviroelhttps://trunk.rdoproject.org/centos9-master/deps/latest/SRPMS/ - looking here16:59
dviroelpython-smmap-5.0.0-1.el9s.src.rpm2022-05-11 13:1032K16:59
rlandy cannot install both python3-smmap-5.0.0-1.el9s.noarch and python3-smmap-3.0.1-4.el9s.noarch17:00
rlandydviroel: ^^ two diff versions requested17:00
rlandydviroel: only hits us upgrades17:00
rlandyodyssey4me: chem: ^^ fyi - on current gate blocker17:00
chemrlandy: o/17:01
*** jpena is now known as jpena|off17:01
rlandydviroel: let me see how far out we are from promoting walaby c917:02
rlandysince it's only upgrades atm17:02
chemrlandy: I'm a bit confused, what should I look into ?17:03
rlandyshocker fs001 and fs03517:03
rlandychem: nothing atm - jst FYI - we're following this gate blocker on upgrades17:03
rlandyhttps://bugs.launchpad.net/tripleo/+bug/197304317:03
rlandychem: ^^17:03
rlandysuspicion is we need an updated centos 9 base image17:04
chemok, got it. thanks for leting us know17:04
rlandydviroel: fs001 and fs035 are in rerun in the line now17:08
rlandyif we get one to pass or not a terrible tempest result, maybe we promote it to get updated containers 17:08
dviroelack17:10
rlandypython3-smmap.noarch                          3.0.1-4.el9s                          @delorean-wallaby-testing 17:11
opendevreviewBrent Eagles proposed openstack/tripleo-heat-templates master: Designate: configure collocation IP on bind and neutron dns integration  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/83997417:11
opendevreviewBrent Eagles proposed openstack/tripleo-heat-templates master: Designate: clean up bind and worker rndc configuration  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84145717:11
rlandydviroel: python3-smmap.noarch                          3.0.1-4.el9s                          @delorean-wallaby-testing 17:11
dviroeldelorean-wallaby doesn't have smmap 5.0.017:12
dviroelonly master - which was added today17:12
dviroelpython-smmap-5.0.0-1.el9s.src.rpm2022-05-11 13:1017:13
dviroelso maybe trying to upgrade this package, breaks  gitdb-4.0.5 requirement17:13
rlandyit claims that that repo is origin of smmap17:14
rlandyhttp://mirror.regionone.vexxhost-nodepool-tripleo.rdoproject.org:8080/rdo/centos9-wallaby/deps/latest/noarch/17:14
rlandypython3-smmap-3.0.1-4.el9s.noarch.rpm2021-12-14 15:52 46K17:14
rlandythat package upgrade is the issue17:15
rlandyso we'd either need an update17:15
dviroelthat what I understood17:15
rlandyor delete it as a workaround before upgrading17:15
dviroeland seems that we need gitdb-4.0.9 to install smmap 5.0.017:15
dviroelwhich we don't have in master17:16
* dviroel according with openstack upper constraints17:16
rlandydviroel: we're meeting in 15  let's discuss then17:17
dviroelwe need gitdb-4.0.9 or exclude smmap 5.0.017:17
dviroelmaster-deps is not in sync with openstack-requirements17:17
dviroelhttps://opendev.org/openstack/requirements/src/branch/master/upper-constraints.txt17:18
dviroelsmmap===5.0.017:18
dviroelgitdb===4.0.917:18
cloudnullrlandy sorry was off eating. I do have time. now?17:23
rlandycloudnull: just meeting with dviroel17:34
cloudnullOk17:36
cloudnull I’m around if needed 17:36
rlandycloudnull: pls join https://meet.google.com/uwj-ucmn-pty?authuser=017:38
opendevreviewMerged openstack/tripleo-validations master: Change the way the task 'Validation errors' prints the output messages in order to be more readable.  https://review.opendev.org/c/openstack/tripleo-validations/+/83417618:01
hjensasrlandy: ysandeep|rover|out: re  https://bugs.launchpad.net/tripleo/+bug/1973038, I think diskimage-builder used does not have https://opendev.org/openstack/diskimage-builder/commit/147641fc3e11602cf9eaf723a2b38f60f394ac0b18:17
rlandyhjensas: so we're missing a component promo?18:23
* rlandy checks what version we have18:23
rlandydiskimage-builder.noarch                      3.20.4-0.20220421140835.adc40db.el9   @delorean-component-common 18:24
rlandyhjensas: you are right tripleo-ci-testing has an earlier version 18:26
rlandychecking common component18:26
rlandyfor the one logged in the triple component18:29
rlandyin tripleo-ci-testing we have diskimage-builder-3.21.1-0.20220509052906.6645f47.el9.noarch.rpm2022-05-09 05:35 722K18:29
rlandywhich is latest18:29
rlandy2022-05-11 12:31:12.657311 | primary | 2022-05-11 12:31:12 |  Problem: package python3-gitdb-4.0.5-2.el9s.noarch requires (python3.9dist(smmap) < 4 with python3.9dist(smmap) >= 3.0.1), but none of the providers can be installed18:30
rlandy2022-05-11 12:31:12.657375 | primary | 2022-05-11 12:31:12 |   - cannot install both python3-smmap-5.0.0-1.el9s.noarch and python3-smmap-3.0.1-4.el9s.noarch18:30
rlandy2022-05-11 12:31:12.657386 | primary | 2022-05-11 12:31:12 |   - cannot install the best update candidate for package python3-smmap-3.0.1-4.el9s.noarch18:30
rlandy2022-05-11 12:31:12.657396 | primary | 2022-05-11 12:31:12 |   - cannot install the best update candidate for package python3-gitdb-4.0.5-2.el9s.noarch18:30
rlandyha ha - that failed the issue cloudnull and dviroel and I were discussing above18:30
rlandyhjensas: ^^ adding a workaround for this - then will retest 18:30
hjensasrlandy: Thanks, *fingers crossed* :)18:32
opendevreviewRonelle Landy proposed openstack/tripleo-quickstart master: Exclude python3-smmap-5.* from master deps repo  https://review.opendev.org/c/openstack/tripleo-quickstart/+/84146418:44
rlandydviroel: cloudnull: ^^ testprojecting this18:44
cloudnull++18:45
opendevreviewAlan Bishop proposed openstack/tripleo-heat-templates stable/wallaby: Manila: Deprecate ineffctive *DriverHandlesShareServers  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84058218:46
rlandyhttps://review.rdoproject.org/r/c/testproject/+/3625618:48
opendevreviewDenys Mishchenko proposed openstack/diskimage-builder master: Adopted dkms element to work on Ubuntu Jammy and nvidia drivers  https://review.opendev.org/c/openstack/diskimage-builder/+/84146519:13
dviroelrlandy: still failing there https://logserver.rdoproject.org/56/36256/71/check/periodic-tripleo-centos-9-buildimage-ironic-python-agent-master/33990e1/job-output.txt19:16
dviroelnot sure why19:16
opendevreviewDenys Mishchenko proposed openstack/diskimage-builder master: Adopted dkms element to work on Ubuntu Jammy and nvidia drivers  https://review.opendev.org/c/openstack/diskimage-builder/+/84146519:17
dviroelhttps://logserver.rdoproject.org/56/36256/71/check/periodic-tripleo-centos-9-buildimage-ironic-python-agent-master/33990e1/yum.repos.d/delorean-master-deps.repo19:19
gouthamrany cores that can help with a +W here: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/840441 :)19:28
rlandylooking19:33
dviroelrlandy: repo_setup.sh.j2 does not handle exclude for repo.type == 'file'19:38
rlandyI am checking the file19:40
rlandyalso19:40
rlandyit may be on the imahe19:40
rlandyimage19:40
rlandysec- just getting off call19:40
rlandydviroel: we didn't lay this down: https://logserver.rdoproject.org/56/36256/71/check/periodic-tripleo-centos-9-buildimage-ironic-python-agent-master/33990e1/yum.repos.d/delorean-master-deps.repo19:55
rlandyie: per repo19:56
rlandyso we'll need to edit the file19:56
rlandyI think19:56
opendevreviewRonelle Landy proposed openstack/tripleo-quickstart master: Exclude python3-smmap-5.* from master deps repo  https://review.opendev.org/c/openstack/tripleo-quickstart/+/84146420:05
opendevreviewMerged openstack/tripleo-ansible stable/wallaby: Add a new task file for masquerade  https://review.opendev.org/c/openstack/tripleo-ansible/+/83973720:11
lecris[m]1Where can I ask for help on deploying a tripleo overcloud?20:18
cloudnulllecris[m]1 fire away. if we can help we'll be happy to 20:32
opendevreviewDavid Hill proposed openstack/ansible-role-redhat-subscription master: Retry polling the satellite endpoint on failure  https://review.opendev.org/c/openstack/ansible-role-redhat-subscription/+/83912020:39
opendevreviewMerged openstack/ansible-role-redhat-subscription master: Retry polling the satellite endpoint on failure  https://review.opendev.org/c/openstack/ansible-role-redhat-subscription/+/83912020:52
*** dviroel is now known as dviroel|afk20:53
*** dasm is now known as dasm|off21:02
lecris[m]1So I've tried to follow along with the documentation guide, I've got up to making the baremetal nodes available, but I'm lost on how to configure for `overcloud deploy`21:10
lecris[m]1For example what is the minimum network configuration I can provision, as in everything is on the same virtual network with or without bridge to external one21:12
rlandydviroel|afk: cloudnull: going to merge https://review.opendev.org/c/openstack/tripleo-quickstart/+/841464 ... https://review.rdoproject.org/r/c/testproject/+/36256 passed21:25
rlandyto clear gate blocker21:25
rlandytripleo-ci-centos-9-content-provider-wallaby failed21:26
rlandychecking21:26
hjensaslecris[m]: The minimal network config would be 1 flat network, the provisioning network. This is the default.21:55
lecris[m]1So if I try:... (full message at https://matrix.org/_matrix/media/r0/download/matrix.org/coUMORVaBhVWWBnjOYDqlaJf)22:01
lecris[m]1* So if I try:... (full message at https://matrix.org/_matrix/media/r0/download/matrix.org/eosYcShjHemEurCYuLRxVJcU)22:01
lecris[m]1I can run it again to get the specific error22:02
rlandyfultonj: was there a change in  quay.io/ceph?22:03
rlandycontent provider jobs are failing pulling those containers22:03
rlandy'Trying to pull quay.io/ceph/daemon:v6.0.7-stable-6.0-pacific-centos-stream8...\nGetting image source signatures\nCopying blob sha256:d13ff5a2a605033c67752125f9839801b0808ba29738d100a6f434f721ad92a2\nCopying blob 22:03
rlandyFailed to pull following containers: ['quay.ceph.io/prometheus/prometheus:v2.7.2', 'quay.ceph.io/prometheus/alertmanager:v0.16.2', 'quay.ceph.io/prometheus/node-exporter:v0.17.0', 'quay.ceph.io/app-sre/grafana:6.7.4']"}22:04
rlandynot resolving for me22:04
rlandyhttps://quay.ceph.io/22:05
rlandydasm|off: ^^ fyi22:07
rlandyugh - I give up22:08
rlandyback later22:08
*** rlandy is now known as rlandy|bbl22:08
lecris[m]1> <@lecris:lecris.me> So if I try:... (full message at https://matrix.org/_matrix/media/r0/download/matrix.org/neBCJghyMRystfyxqSYkSIka)23:15
lecris[m]1 * Here's the error:... (full message at https://matrix.org/_matrix/media/r0/download/matrix.org/BLReBuVlTCcBmepAynMdkbSD)23:15

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!