Monday, 2022-06-27

opendevreviewMerged openstack/diskimage-builder master: Revert "Temporarily stop running OpenSUSE functtests"  https://review.opendev.org/c/openstack/diskimage-builder/+/84032900:14
opendevreviewBrendan Shephard proposed openstack/tripleo-ansible master: Cleanup Keystone services that are not required  https://review.opendev.org/c/openstack/tripleo-ansible/+/84690200:42
opendevreviewBrendan Shephard proposed openstack/tripleo-ansible master: Cleanup Keystone services that are not required  https://review.opendev.org/c/openstack/tripleo-ansible/+/84690201:52
opendevreviewBrendan Shephard proposed openstack/tripleo-ansible master: Cleanup Keystone services that are not required  https://review.opendev.org/c/openstack/tripleo-ansible/+/84690201:58
*** ysandeep|out is now known as ysandeep02:04
opendevreviewTakashi Kajinami proposed openstack/puppet-pacemaker master: Fix the outdated links in metadata  https://review.opendev.org/c/openstack/puppet-pacemaker/+/84770102:49
opendevreviewBrendan Shephard proposed openstack/tripleo-docs master: python-tripleoclient to python3-tripleoclient  https://review.opendev.org/c/openstack/tripleo-docs/+/84770804:05
opendevreviewBrendan Shephard proposed openstack/tripleo-ansible master: Cleanup Keystone services that are not required  https://review.opendev.org/c/openstack/tripleo-ansible/+/84690204:07
opendevreviewMerged openstack/tripleo-heat-templates master: Enable use_multipath_for_image_xfer  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84585504:19
opendevreviewBrendan Shephard proposed openstack/tripleo-docs master: Update config-download documentation  https://review.opendev.org/c/openstack/tripleo-docs/+/84771204:48
opendevreviewBrendan Shephard proposed openstack/tripleo-docs master: Update config-download documentation  https://review.opendev.org/c/openstack/tripleo-docs/+/84771205:05
*** ysandeep is now known as ysandeep|afk05:15
opendevreviewchandan kumar proposed openstack/tripleo-ansible master: Use ubi9-init image as base  https://review.opendev.org/c/openstack/tripleo-ansible/+/83968805:22
opendevreviewBrendan Shephard proposed openstack/tripleo-docs master: Update config-download documentation  https://review.opendev.org/c/openstack/tripleo-docs/+/84771205:25
opendevreviewBrendan Shephard proposed openstack/tripleo-docs master: Update config-download documentation  https://review.opendev.org/c/openstack/tripleo-docs/+/84771205:27
opendevreviewBrendan Shephard proposed openstack/python-tripleoclient stable/wallaby: Add handling for roles and networks to answers  https://review.opendev.org/c/openstack/python-tripleoclient/+/84693705:33
opendevreviewchandan kumar proposed openstack/tripleo-ansible master: Use ubi9-init image as base  https://review.opendev.org/c/openstack/tripleo-ansible/+/83968805:40
*** ysandeep|afk is now known as ysandeep05:56
opendevreviewchandan kumar proposed openstack/tripleo-ansible master: Use ubi9-init image as base  https://review.opendev.org/c/openstack/tripleo-ansible/+/83968806:06
opendevreviewBrendan Shephard proposed openstack/python-tripleoclient stable/wallaby: Add handling for roles and networks to answers  https://review.opendev.org/c/openstack/python-tripleoclient/+/84771406:07
opendevreviewBrendan Shephard proposed openstack/python-tripleoclient stable/wallaby: Add handling for roles and networks to answers  https://review.opendev.org/c/openstack/python-tripleoclient/+/84771406:11
opendevreviewJiri Podivin proposed openstack/tripleo-validations stable/wallaby: setup.cfg: Replace dashes with underscores  https://review.opendev.org/c/openstack/tripleo-validations/+/84380806:52
opendevreviewJiri Podivin proposed openstack/tripleo-validations stable/wallaby: Normalizing Tripleo Validations metadata  https://review.opendev.org/c/openstack/tripleo-validations/+/84380906:52
opendevreviewTakashi Kajinami proposed openstack/tripleo-heat-templates master: Fix ignored HeatConfigureDelegatedRoles  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84757006:53
opendevreviewTakashi Kajinami proposed openstack/tripleo-heat-templates master: Fix ignored HeatConfigureDelegatedRoles  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84757006:54
opendevreviewTakashi Kajinami proposed openstack/tripleo-heat-templates master: Fix ignored HeatConfigureDelegatedRoles  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84757006:57
*** amoralej|off is now known as amoralej07:05
opendevreviewTakashi Kajinami proposed openstack/tripleo-heat-templates master: Fix ignored HeatConfigureDelegatedRoles  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84757007:06
*** frenzyfriday|PTO is now known as frenzy_friday07:13
opendevreviewTakashi Kajinami proposed openstack/puppet-tripleo master: NetApp volume driver: Use different shares config file per backend  https://review.opendev.org/c/openstack/puppet-tripleo/+/84357907:27
opendevreviewTakashi Kajinami proposed openstack/puppet-tripleo master: Nfs volume driver: Use different shares config file per backend  https://review.opendev.org/c/openstack/puppet-tripleo/+/84771507:36
*** jpena|off is now known as jpena07:43
opendevreviewTakashi Kajinami proposed openstack/tripleo-heat-templates master: Remove old note about CinderNetappNfsSharesConfig  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84771607:43
opendevreviewTakashi Kajinami proposed openstack/tripleo-heat-templates master: Remove old note about CinderNfsSharesConfig  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84771707:48
opendevreviewJiri Podivin proposed openstack/validations-libs master: Expanding parser actions to allow for multiple key-value pairs  https://review.opendev.org/c/openstack/validations-libs/+/81771707:52
opendevreviewJuan Larriba proposed openstack/tripleo-heat-templates master: Remove the Backup and Restore ReaR Heat templates  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84714508:08
opendevreviewlikui proposed openstack/diskimage-builder master: Drop python3.6/3.7 support in testing runtime  https://review.opendev.org/c/openstack/diskimage-builder/+/84771808:15
opendevreviewlikui proposed openstack/diskimage-builder master: Stop testing lower-constraints  https://review.opendev.org/c/openstack/diskimage-builder/+/84771908:17
opendevreviewCedric Jeanneret proposed openstack/tripleo-ansible master: DNM - testing unmodified content  https://review.opendev.org/c/openstack/tripleo-ansible/+/84772008:19
Tenguchandankumar: heya! having a look at the container_manage role with molecule -^^08:20
Tengudoing some testing in order to understand the actual issue with the healthcheck thingy.08:20
* Tengu suspects some changes in the podman content08:20
Tenguo_O08:33
Tenguchandankumar: quick question: is the OS underlying the containers for molecule also changed at some point?08:36
Tengu(when you switch things to ubi9)08:36
Tenguaha08:41
Tengucs8 -> cs9 host.08:41
Tenguok.08:41
Tenguso podman update.08:41
opendevreviewBrendan Shephard proposed openstack/python-tripleoclient stable/wallaby: Add handling for roles and networks to answers  https://review.opendev.org/c/openstack/python-tripleoclient/+/84771408:45
opendevreviewCedric Jeanneret proposed openstack/tripleo-ansible master: DNM - testing for lp#1979810  https://review.opendev.org/c/openstack/tripleo-ansible/+/84772008:53
*** vkmc_ is now known as vkmc09:10
opendevreviewJiri Podivin proposed openstack/validations-libs stable/1.6: DNM testing tox constraints on stable  branches  https://review.opendev.org/c/openstack/validations-libs/+/84775309:20
*** rlandy|out is now known as rlandy09:29
chandankumarTengu: findiung a way to collect podman version09:29
Tenguchandankumar: got it in the meantime09:30
chandankumarcool then09:30
Tenguchandankumar: added some debug to my test, we're running on podman 4.1.109:30
Tengupretty sure it exposes things in a different way.09:30
Tenguwouldn't be fun otherwise. I've updated the LP with those data already.09:31
chandankumaropening one more bug, then I will be done09:31
chandankumarTengu: thank you for picking it up :-)09:31
Tenguchandankumar: np - thank you for the hard work!09:32
opendevreviewchandan kumar proposed openstack/tripleo-ansible master: Use ubi9-init image as base  https://review.opendev.org/c/openstack/tripleo-ansible/+/83968809:39
opendevreviewRabi Mishra proposed openstack/tripleo-heat-templates master: Simplify HostnameResolveNetwork in ServiceNetMap  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84775809:41
opendevreviewJuan Larriba proposed openstack/tripleo-heat-templates master: Remove the Backup and Restore ReaR Heat templates  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84775909:41
Tenguah. Now I'm able to run molecule. good. Time to add some output :)09:43
opendevreviewGiulio Fidente proposed openstack/tripleo-heat-templates stable/wallaby: Add CephRbdTrashSchedulerEnable boolean  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84766009:45
opendevreviewJuan Larriba proposed openstack/tripleo-heat-templates stable/train: [train-only] Add deprecation notice to rear heat template  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84714809:46
*** ysandeep is now known as ysandeep|afk09:50
opendevreviewJuan Larriba proposed openstack/tripleo-heat-templates master: Remove the Backup and Restore ReaR Heat templates  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84775909:50
opendevreviewchandan kumar proposed openstack/tripleo-ansible master: Use ubi9-init image as base  https://review.opendev.org/c/openstack/tripleo-ansible/+/83968809:53
opendevreviewFrancesco Pantano proposed openstack/tripleo-heat-templates master: Add SwiftSystemReader role when Rbac is enabled  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84160910:00
opendevreviewPooja Jadhav proposed openstack/tripleo-ci master: Move Victoria for Tripleo Repos to End Of Life  https://review.opendev.org/c/openstack/tripleo-ci/+/84558710:15
opendevreviewPooja Jadhav proposed openstack/puppet-tripleo stable/train: Move Victoria for Tripleo Repos to End Of Life  https://review.opendev.org/c/openstack/puppet-tripleo/+/84776210:21
opendevreviewPooja Jadhav proposed openstack/tripleo-ci master: Move Victoria for Tripleo Repos to End Of Life  https://review.opendev.org/c/openstack/tripleo-ci/+/84558710:29
*** ysandeep|afk is now known as ysandeep10:38
opendevreviewPooja Jadhav proposed openstack/puppet-tripleo stable/wallaby: Move Victoria for Tripleo Repos to End Of Life  https://review.opendev.org/c/openstack/puppet-tripleo/+/84776611:12
opendevreviewPooja Jadhav proposed openstack/tripleo-ci master: Move Victoria for Tripleo Repos to End Of Life  https://review.opendev.org/c/openstack/tripleo-ci/+/84558711:14
opendevreviewPooja Jadhav proposed openstack/puppet-tripleo stable/wallaby: Move Victoria for Tripleo Repos to End Of Life  https://review.opendev.org/c/openstack/puppet-tripleo/+/84776611:22
opendevreviewchandan kumar proposed openstack/tripleo-ci master: [Collect-logs]Exclude git, tmp and unwanted rpm files.  https://review.opendev.org/c/openstack/tripleo-ci/+/84777111:44
rlandywe've got a new major failure on master - just started11:50
rlandy Error: Evaluation Error: Operator '[]' is not applicable to an Undef Value. (file: /etc/puppet/modules/openstacklib/manifests/defaults.pp, line: 9, column: 7) on node undercloud.localdomain11:50
rlandyTengu: tkajinam: ^^ look familiar to you?11:50
rlandyjm1" akahat|ruck: ^^11:51
Tengu#Monday...11:51
Tengurlandy: nope, doesn't ring any bells.11:51
rlandy<13>Jun 27 11:25:46 puppet-user: Error: Facter: error while resolving custom fact "os_package_type": undefined method `[]' for nil:NilClass11:52
rlandy<13>Jun 27 11:25:50 puppet-user: Error: Facter: error while resolving custom fact "os_workers": undefined method `key?' for nil:NilClass11:52
rlandy<13>Jun 27 11:25:50 puppet-user: Error: Facter: error while resolving custom fact "os_workers_heat_engine": undefined method `key?' for nil:NilClass11:52
rlandy<13>Jun 27 11:25:50 puppet-user: Error: Facter: error while resolving custom fact "os_workers_keystone": undefined method `key?' for nil:NilClass11:52
rlandy<13>Jun 27 11:25:50 puppet-user: Error: Facter: error while resolving custom fact "os_workers_large": undefined method `key?' for nil:NilClass11:52
rlandy<13>Jun 27 11:25:50 puppet-user: Error: Facter: error while resolving custom fact "os_workers_small": undefined method `key?' for nil:NilClass11:52
Tenguuho11:52
Tenguthat sounds bad.11:52
rlandyoh man - need a new bug here11:53
rlandyakahat|ruck: jm1: ^^11:54
rlandyguess I'm creating it11:54
Tengurlandy, chandankumar found out the podman thingy.11:58
Tengu4.1.1 doesn't expose "Healthcheck" anymore, but "Health".11:59
Tenguyay.11:59
rlandyTengu: for the above errors?12:00
Tengunow.... wondering how I can do something that is actually compatible.12:00
rlandycreating bug12:00
rlandyone sec12:00
Tengurlandy: for the one I'm investigating12:00
Tenguhttps://bugs.launchpad.net/tripleo/+bug/1979810 <-12:00
Tenguchandankumar: commented on the LP + your ubi9 patch.12:01
*** dviroel|out is now known as dviroel12:01
TenguI'll do a follow-up to your patch so that it will correct the molecule test, and switch back to voting.12:01
opendevreviewTakashi Kajinami proposed openstack/tripleo-heat-templates master: Fix ignored HeatConfigureDelegatedRoles  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84757012:04
rlandyhttps://bugs.launchpad.net/tripleo/+bug/197998512:04
rlandyakahat|ruck: jm1: ^^12:04
opendevreviewFrancesco Pantano proposed openstack/tripleo-heat-templates master: Adapt on puppet-rsyslog update  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84709512:06
*** amoralej is now known as amoralej|lunch12:06
opendevreviewCedric Jeanneret proposed openstack/tripleo-ansible master: Update doc and molecule for new podman inspect output  https://review.opendev.org/c/openstack/tripleo-ansible/+/84777412:09
Tengurlandy, chandankumar -^^12:09
Tenguhopefully it will be OK. though we MAY want to make the thing compatible with both releases at some point I guess...12:10
Tenguif wallaby on cs8 is to last.12:10
TenguWIP-ing it for now.12:10
chandankumarTengu: for wallaby, we are keeping c8s builders for dlrn12:12
chandankumarso we are good there12:12
chandankumarTengu: thanks :-)12:12
opendevreviewBhagyashri Shewale proposed openstack/tripleo-ci master: Create sc010 and sc010-ovn-provider -options jobs  https://review.opendev.org/c/openstack/tripleo-ci/+/84297612:14
Tenguchandankumar: hmmm are you going to backport that ub9 patch to wallaby?12:16
chandankumarTengu: nope, let's keep wallaby running on cs812:19
Tenguchandankumar: ah, that sounds OK then.12:19
Tenguguess we'll be able to merge my patch once yours is in, and if mine is all green.12:19
TenguChecking https://bugs.launchpad.net/tripleo/+bug/1979971 - I suspect some stream name issue or something.12:20
Tenguwe probably have to filter out on the OS release version for the module switching.12:20
chandankumarok12:21
Tenguhttps://bugs.launchpad.net/tripleo/+bug/1979971/comments/112:22
chandankumarTengu: I tried with 3.612:23
chandankumarbut it also failed12:23
chandankumarTengu: https://pkgs.org/search/?q=maven12:24
Tengudnf module list --all   is empty..12:24
Tenguchandankumar: apparently there's no stream at all in cs9 for now.12:24
Tengusooo... meh.12:25
chandankumarTengu: Does CS9 have module support?12:25
chandankumarfor container-tools, it is gone12:25
Tenguit apparently have the command at least.12:25
Tengubut as said: apparently, there's no module/stream at all for now.12:26
rlandyramishra: hello ... suggestions on what to do with https://bugs.launchpad.net/tripleo/+bug/1979985? downgrade factor?12:26
Tenguand, for podman, we're eating the upstream release without any stream - for the best as the worst ;)12:26
Tengurlandy: imho, downgrade to unblock, and correct the things, then remove the pin.. ?12:27
chandankumarTengu: since there is no module/stream, Do we want to keep https://opendev.org/openstack/tripleo-ansible/src/branch/master/tripleo_ansible/ansible_plugins/modules/tripleo_dnf_stream.py in master then?12:27
Tenguchandankumar: I was looking for ownership.12:27
TenguThat's on Upgrades.12:27
rlandyTengu: https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_e62/841609/8/check/tripleo-ci-centos-9-containers-multinode/e620bb7/logs/undercloud/etc/yum.repos.d/delorean-master-deps.repo12:27
ramishrarlandy: https://review.rdoproject.org/r/c/rdoinfo/+/42273 is the one that bumped it12:27
rlandydelorean-master-testing - not a repo we control12:27
ramishratkajinam is looking at it12:28
TenguJose left upgrades, so I guess it's for odyssey4me to double-check with his team.12:28
rlandyah12:28
rlandyamoralej|lunch: ^^ fyi12:28
Tengufunky... how is it even working actually? apparently you missed a ref to "ubi8".12:29
tkajinamhttps://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_415/845870/3/gate/tripleo-ci-centos-9-scenario001-standalone/415230d/logs/undercloud/var/lib/container-puppet/puppetlabs/facter/cache/cached_facts/operating%20system12:30
tkajinamhttp://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_e62/841609/8/check/tripleo-ci-centos-9-containers-multinode/e620bb7/logs/undercloud/var/lib/container-puppet/puppetlabs/facter/cache/cached_facts/operating%20system12:31
jm1rlandy: need cix entry for https://bugs.launchpad.net/tripleo/+bug/1979985?12:31
opendevreviewJiri Podivin proposed openstack/validations-common stable/1.6: DNM testing constraints on stable/1.6 branch  https://review.opendev.org/c/openstack/validations-common/+/84777612:32
rlandyjm1: creating that noe12:33
rlandynow12:33
opendevreviewMikolaj Ciecierski proposed openstack/tripleo-upgrade master: Adjust ceph minor update section  https://review.opendev.org/c/openstack/tripleo-upgrade/+/82966112:33
Tenguchandankumar: checking with Upgrades for that LP.12:33
rlandyit's done via a script12:33
rlandybut the script waits 5 hours12:33
chandankumarTengu: aye sir :-)12:33
rlandyI am editing the config12:33
rlandyand rerunning the script12:33
rlandyand yes we do need a cix12:33
rlandyjoining 1-1 - will check back in a bit12:33
Tenguerf... actually, we'll need to hack into the container_manage code, since it seems it's looking for the "wrong" key as well in order to not recreate a container.12:39
Tengudang.12:39
*** arxcruz is now known as arxcruz|brb12:42
opendevreviewMikolaj Ciecierski proposed openstack/tripleo-upgrade stable/wallaby: Adjust ceph minor update section  https://review.opendev.org/c/openstack/tripleo-upgrade/+/84726212:45
opendevreviewPooja Jadhav proposed openstack/puppet-tripleo stable/wallaby: Move Victoria for Tripleo Repos to End Of Life  https://review.opendev.org/c/openstack/puppet-tripleo/+/84776612:48
opendevreviewJames Slagle proposed openstack/python-tripleoclient stable/wallaby: Set owner/permissions on ~/.tripleo for tripleo deploy  https://review.opendev.org/c/openstack/python-tripleoclient/+/84777812:49
odyssey4mechandankumar Tengu so the ability to set streams is a feature of tripleo now and will still be used for wallaby, and perhaps may be needed in the future. That said, if it's not used after wallaby, then we could remove it (and reno that) and delete it from master. It's always in git and therefore recoverable if it becomes needed again.12:49
Tenguchandankumar: we may need https://github.com/containers/ansible-podman-collections/pull/44212:49
opendevreviewJames Slagle proposed openstack/python-tripleoclient stable/wallaby: Set owner/permissions on ~/.tripleo for tripleo deploy  https://review.opendev.org/c/openstack/python-tripleoclient/+/84777812:50
Tenguodyssey4me: sounds good to me! I wanted to get your opinion on that :)12:50
opendevreviewJames Slagle proposed openstack/python-tripleoclient stable/wallaby: Set owner/permissions on ~/.tripleo for tripleo deploy  https://review.opendev.org/c/openstack/python-tripleoclient/+/84777812:50
* odyssey4me likes it when LOC reduces :)12:50
Tengu:)12:51
opendevreviewBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Fix reversed is_set conditions for nova-compute  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84733412:52
opendevreviewJames Slagle proposed openstack/python-tripleoclient stable/wallaby: Add GlobalConfig to saved stack outputs  https://review.opendev.org/c/openstack/python-tripleoclient/+/84583112:52
*** amoralej|lunch is now known as amoralej13:04
opendevreviewBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Fix reversed is_set conditions for nova-compute  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84733413:24
rlandyfmount: going to ask df to force merge the two patches we are waiting on for wallaby13:25
rlandyhttps://review.opendev.org/c/openstack/tripleo-common/+/847437/13:26
rlandyand13:26
rlandyhttps://review.opendev.org/c/openstack/tripleo-upgrade/+/847680/13:26
rlandyenough of this13:26
fmountyeah13:33
fmountespecially 847437 I think it's blocking wallaby13:33
opendevreviewPooja Jadhav proposed openstack/tripleo-upgrade stable/victoria: Move Victoria for Tripleo Repos to End Of Life  https://review.opendev.org/c/openstack/tripleo-upgrade/+/84778813:40
opendevreviewPooja Jadhav proposed openstack/tripleo-ci master: Move Victoria for Tripleo Repos to End Of Life  https://review.opendev.org/c/openstack/tripleo-ci/+/84558713:41
*** arxcruz|brb is now known as arxcruz13:48
fmountarxcruz: question -> I was wondering if you know why the ceph container tag got deleted (twice last week)13:56
fmountand I know you manually restored it13:56
fmountfultonj: FYI ^13:56
arxcruzfmount dpawlik should know 13:57
fultonjdpawlik: can you help fmount and me figure out why the the ceph container tag was deleted twice last week? 14:03
dpawlikfmount: I asked on friday about the image if its necessary etc, did not get any information14:03
dpawlikfultonj: the pruner script fix has been merged, should be fine now14:03
fultonjdpawlik: yes, it's necessary 14:03
fmountdpawlik: it's used for all the tripleo related ceph jobs14:04
fultonjdpawlik: do you have a link to the fix?14:04
fmountso yeah14:04
dpawlikhttps://softwarefactory-project.io/r/c/software-factory/sf-infra/+/2532914:04
dpawlikso tl; dr if there are some image tags set with expiration date due the pruner issue, we can change the expiration time to delay removing it 14:05
dpawlikshould I pull and push  the ceph container image?14:07
fultonjmany jobs rely on 'podman pull quay.rdoproject.org/tripleomastercentos9/daemon:current-ceph' working14:10
fmountdpawlik: what I'm not sure is why we set an expiration date on the ceph containre14:10
dpawlikit was an issue with image pruner.14:11
fmountdpawlik: if pull and re-push is your flow, then it's ok, but you can avoid that by removing the expiration date in general14:11
fultonjdpawlik: we need 'podman pull quay.rdoproject.org/tripleomastercentos9/daemon:current-ceph' to work reliably14:11
fmountwhen a new ceph container is promoted, it's pushed w/ the ceph-current tag, so it gets updated14:11
fmountso dpawlik the short answer is we need to keep the container in the registry :D14:12
fultonjhttps://images.rdoproject.org/ceph/daemon/master/current-ceph should always map "current" to what we need14:12
fmountfor both wallaby and master14:12
dpawlikfmount: ack. Now I will know :)14:12
fmountdpawlik: :D feel free to ping me in any of the ceph related reviews to help or clarify if you have any question14:13
fmountdpawlik: thanks for fixing the issue w/ the image pruner14:13
opendevreviewBrendan Shephard proposed openstack/python-tripleoclient stable/wallaby: Ensure each host is type string  https://review.opendev.org/c/openstack/python-tripleoclient/+/84766214:14
fultonj so we introduce deployed ceph on the same week the centos mirror is updated and the ceph container has pruning  issues14:15
fultonjthe perfect storm14:15
dpawlikhope it will be now ok for long time ;)14:16
odyssey4memarios happy with https://review.opendev.org/c/openstack/tripleo-heat-templates/+/847148/ ? 14:16
odyssey4mejbadiapa ^14:16
fultonjthank you dpawlik 14:25
fultonjno rover today?14:30
opendevreviewTakashi Kajinami proposed openstack/puppet-tripleo master: HAProxy: Replace hiera by lookup (2)  https://review.opendev.org/c/openstack/puppet-tripleo/+/84779514:33
opendevreviewchandan kumar proposed openstack/tripleo-ci master: [Collect-logs]Exclude git, tmp and unwanted rpm files.  https://review.opendev.org/c/openstack/tripleo-ci/+/84777114:34
beagleshjensas, tkajinam: can I get a review on https://review.opendev.org/c/openstack/tripleo-heat-templates/+/839759/ backport ... apparently required for a hotfix14:42
opendevreviewBogdan Dobrelya proposed openstack/tripleo-ansible master: Add docs for standalone roles and playbooks  https://review.opendev.org/c/openstack/tripleo-ansible/+/84734714:43
opendevreviewBogdan Dobrelya proposed openstack/tripleo-ansible master: Add logging tasks for common nova services use  https://review.opendev.org/c/openstack/tripleo-ansible/+/84702814:43
opendevreviewBogdan Dobrelya proposed openstack/tripleo-ansible master: Fix nova_compute naming, add missed hiera mappings  https://review.opendev.org/c/openstack/tripleo-ansible/+/84719914:43
opendevreviewBogdan Dobrelya proposed openstack/tripleo-ansible master: Fix nova libvirt role vars mappings and linting  https://review.opendev.org/c/openstack/tripleo-ansible/+/84759414:43
tkajinambeagles, checking14:44
beaglestkajinam, thx14:44
tkajinambeagles, voted +A for both. wallaby one might be blocked by gate14:49
beaglestkajinam, ack thx 10^714:50
opendevreviewDavid Hill proposed openstack/puppet-tripleo master: Implement ratelimiting through haproxy  https://review.opendev.org/c/openstack/puppet-tripleo/+/84780014:53
tkajinamrlandy, the multinode job is passing now https://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-9-containers-multinode&project=openstack/tripleo-heat-templates14:58
tkajinamamoralej, ^^^14:58
rlandytkajinam: thank you14:58
amoralejtkajinam, so no need to do anything else, right?14:58
tkajinamwe might hit the same if there is any remaining mirror with old package but we can try recheck14:59
amoralejthe issue was the difference between host and containers14:59
tkajinamamoralej, yeah I believe. atm I don't see any benefit or requirement to revert version bump14:59
* tkajinam is double checking the facter version14:59
tkajinamhttps://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_fc6/847570/7/check/tripleo-ci-centos-9-content-provider/fc6bbba/logs/container-builds/383c8d05-4ed1-4f4b-914e-c84e6b5b107e/base/base-build.log15:00
tkajinam facter                                    noarch  1:4.2.10-1.el9s                     delorean-master-testing       262 k15:00
tkajinamhttps://7dab5761b658171d84bc-6e0ea213c4496da85e511d11bb1ba368.ssl.cf1.rackcdn.com/847570/7/check/tripleo-ci-centos-9-containers-multinode/4ba2e17/logs/undercloud/var/log/extra/rpm-list.txt15:00
tkajinamfacter-4.2.10-1.el9s.noarch15:01
tkajinamfacter 4 is consistently used :-)15:01
amoralejgood15:01
*** pojadhav is now known as pojadhav|afk15:04
opendevreviewchandan kumar proposed openstack/tripleo-ci master: [Collect-logs]Exclude git, tmp and unwanted rpm files.  https://review.opendev.org/c/openstack/tripleo-ci/+/84777115:06
opendevreviewBrent Eagles proposed openstack/tripleo-ansible master: Designate: remove unnecessary transitional code for moving extra IP  https://review.opendev.org/c/openstack/tripleo-ansible/+/84045115:07
opendevreviewBrent Eagles proposed openstack/tripleo-ansible master: Designate: specify source address when using rndc  https://review.opendev.org/c/openstack/tripleo-ansible/+/84145615:07
opendevreviewBrent Eagles proposed openstack/tripleo-ansible master: Modify designate bind pool config to match proxied endpoints  https://review.opendev.org/c/openstack/tripleo-ansible/+/82910715:07
opendevreviewBrent Eagles proposed openstack/tripleo-ansible master: Designate: support configuring non-ooo-deployed binds  https://review.opendev.org/c/openstack/tripleo-ansible/+/84780315:07
opendevreviewBogdan Dobrelya proposed openstack/tripleo-ansible master: Add tripleo_logrotate_crond role  https://review.opendev.org/c/openstack/tripleo-ansible/+/84199715:09
opendevreviewBogdan Dobrelya proposed openstack/tripleo-ansible master: Add tripleo_sshd role to operating system playbooks  https://review.opendev.org/c/openstack/tripleo-ansible/+/84215015:09
opendevreviewBogdan Dobrelya proposed openstack/tripleo-ansible master: Add chrony role to operating system install, configure, and run playbooks  https://review.opendev.org/c/openstack/tripleo-ansible/+/84222415:09
opendevreviewBogdan Dobrelya proposed openstack/tripleo-ansible master: Add tripleo_timezone role to operating system install and run playbooks  https://review.opendev.org/c/openstack/tripleo-ansible/+/84223415:09
opendevreviewBogdan Dobrelya proposed openstack/tripleo-ansible master: Add iscsid role to OpenStack install run, and configure  https://review.opendev.org/c/openstack/tripleo-ansible/+/84243715:09
opendevreviewBogdan Dobrelya proposed openstack/tripleo-ansible master: Add standalone Nova Libvirt role  https://review.opendev.org/c/openstack/tripleo-ansible/+/84215215:09
opendevreviewBogdan Dobrelya proposed openstack/tripleo-ansible master: Add nova-compute standalone role  https://review.opendev.org/c/openstack/tripleo-ansible/+/84365915:09
opendevreviewBogdan Dobrelya proposed openstack/tripleo-ansible master: Example hiera bindings fixes based on tht data  https://review.opendev.org/c/openstack/tripleo-ansible/+/84719915:09
opendevreviewBogdan Dobrelya proposed openstack/tripleo-ansible master: Add logging tasks for common nova services use  https://review.opendev.org/c/openstack/tripleo-ansible/+/84702815:09
opendevreviewBogdan Dobrelya proposed openstack/tripleo-ansible master: Add docs for standalone roles and playbooks  https://review.opendev.org/c/openstack/tripleo-ansible/+/84734715:09
opendevreviewBogdan Dobrelya proposed openstack/tripleo-ansible master: Fix nova libvirt role vars mappings and linting  https://review.opendev.org/c/openstack/tripleo-ansible/+/84759415:09
opendevreviewBrent Eagles proposed openstack/tripleo-heat-templates master: Designate: support configuring non-ooo-deployed binds  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84780415:13
opendevreviewDavid Hill proposed openstack/puppet-tripleo master: Implement ratelimiting through haproxy  https://review.opendev.org/c/openstack/puppet-tripleo/+/84780015:19
opendevreviewCedric Jeanneret proposed openstack/tripleo-ansible master: Update for new podman output  https://review.opendev.org/c/openstack/tripleo-ansible/+/84777415:26
*** dviroel is now known as dviroel|lunch15:27
*** marios is now known as marios|out15:39
opendevreviewDavid Hill proposed openstack/puppet-tripleo master: Implement ratelimiting through haproxy  https://review.opendev.org/c/openstack/puppet-tripleo/+/84780015:54
opendevreviewTom Weininger proposed openstack/tripleo-heat-templates master: Add support for log offloading over TCP  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84758715:54
opendevreviewTom Weininger proposed openstack/tripleo-heat-templates master: DNM test OctaviaLogOffloadProtocol  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84758815:54
opendevreviewBrent Eagles proposed openstack/tripleo-heat-templates master: Designate: configure collocation IP on bind and neutron dns integration  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/83997415:56
opendevreviewBrent Eagles proposed openstack/tripleo-heat-templates master: Allow configuring the base port of the mini DNS proxy endpoints  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82910815:56
opendevreviewBrent Eagles proposed openstack/tripleo-heat-templates master: Designate: support configuring non-ooo-deployed binds  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84780415:56
opendevreviewDavid Hill proposed openstack/puppet-tripleo master: Implement ratelimiting through haproxy  https://review.opendev.org/c/openstack/puppet-tripleo/+/84780015:58
opendevreviewDavid Hill proposed openstack/puppet-tripleo master: Implement ratelimiting through haproxy  https://review.opendev.org/c/openstack/puppet-tripleo/+/84780015:59
opendevreviewDavid Hill proposed openstack/puppet-tripleo master: Implement ratelimiting through haproxy  https://review.opendev.org/c/openstack/puppet-tripleo/+/84780016:01
rlandyramishra: slagle: Tengu: tkajinam: so opendev was not game to force merge patches (only gate failure fixes) ... so two possible options16:05
Tengusigh...16:05
rlandy1. don't workflow any patches NOT needed for wallaby16:05
rlandykeep the gate minimla16:05
rlandy2. reduce failures16:05
rlandywe are reducin log collection16:06
rlandythe majority of failures are multinode container updates16:06
Tenguyeah, saw a chat about log collection including /opt/git or something16:06
rlandycould make that non-voting to get patches merged16:06
rlandynot ideal16:06
rlandyhttps://review.opendev.org/c/openstack/tripleo-ci/+/84777116:06
rlandyTengu: ^^16:06
rlandythat16:06
rlandywill try get that to top of the gate16:06
Tengucan't we mass-abandon/restore things?16:07
rlandybut has to pass check first16:07
TenguI remember some abandon/restore drill in the past.16:07
rlandyTengu: we can ...16:07
opendevreviewRajesh Tailor proposed openstack/tripleo-ansible stable/wallaby: Remove - from endfor statement  https://review.opendev.org/c/openstack/tripleo-ansible/+/84781116:07
rlandybut if we can get the log reduction patch to the top of the gate, that may help16:08
Tengu++16:08
opendevreviewMikolaj Ciecierski proposed openstack/tripleo-upgrade master: Adjust ceph minor update section  https://review.opendev.org/c/openstack/tripleo-upgrade/+/82966116:08
rlandyTengu: the gate backs up16:09
rlandyso we'd have to do this multiple times16:09
*** ysandeep is now known as ysandeep|PTO16:09
rlandyif cores keep w+ patches that are not wallaby related16:10
Tengudrop all the cores ;)16:10
rlandyTengu: this patch - is third in gate ... 847680,216:10
rlandyso we'd have to see if that one can get by16:11
Tengufinger crossed.16:11
rlandywould then put the log reduce under that16:11
rlandythen the tripleo-common patch16:11
Tenguthough typing with crossed finger isn't easy at all!16:11
rlandyeven if I have to abandon restore16:11
opendevreviewDavid Hill proposed openstack/puppet-tripleo master: Implement ratelimiting through haproxy  https://review.opendev.org/c/openstack/puppet-tripleo/+/84780016:15
Tengurlandy: added a couple of comments or two on the log reduction patch.16:16
* tkajinam voted 2nd +216:24
opendevreviewDavid Hill proposed openstack/puppet-tripleo master: Implement ratelimiting through haproxy  https://review.opendev.org/c/openstack/puppet-tripleo/+/84780016:28
rlandyTengu: ok - you +2'ed so we will try go with it16:29
opendevreviewJulia Kreger proposed openstack/diskimage-builder master: DNM: Network Manager logging to Trace for Debugging  https://review.opendev.org/c/openstack/diskimage-builder/+/84760016:29
opendevreviewDavid Hill proposed openstack/puppet-tripleo master: Implement ratelimiting through haproxy  https://review.opendev.org/c/openstack/puppet-tripleo/+/84780016:29
Tengurlandy: yep. sounds reasonable, my comments are more about nit-picking than anything16:29
opendevreviewDavid Hill proposed openstack/puppet-tripleo master: Implement ratelimiting through haproxy  https://review.opendev.org/c/openstack/puppet-tripleo/+/84780016:32
*** dviroel|lunch is now known as dviroel16:37
Tenguok. time to sign off for me. Been a looong day already :(.16:38
Tengurlandy: I'll check back tomorrow - lemme know if my voting is needed or anything.16:38
opendevreviewRajesh Tailor proposed openstack/tripleo-ansible master: Fix typo from 'sdterr' to 'stderr'  https://review.opendev.org/c/openstack/tripleo-ansible/+/84783316:38
Tengurlandy: I can suspend my work on the ubi9 "non-voting", since those aren't «blocking» things (though it lessen the code quality check, of course).16:39
opendevreviewRajesh Tailor proposed openstack/tripleo-quickstart-extras master: Fix typo from `sdtout` to `stdout`  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/84783416:40
rlandyTengu: thank you16:41
Tengunp - happy to help where I can ;)16:41
opendevreviewDavid Hill proposed openstack/puppet-tripleo master: Implement ratelimiting through haproxy  https://review.opendev.org/c/openstack/puppet-tripleo/+/84780016:42
opendevreviewDavid Hill proposed openstack/puppet-tripleo master: Implement ratelimiting through haproxy  https://review.opendev.org/c/openstack/puppet-tripleo/+/84780016:51
*** amoralej is now known as amoralej|off16:51
opendevreviewTom Weininger proposed openstack/tripleo-ansible master: Support amphora log offloading over TCP  https://review.opendev.org/c/openstack/tripleo-ansible/+/84758416:52
opendevreviewDavid Hill proposed openstack/puppet-tripleo master: Implement ratelimiting through haproxy  https://review.opendev.org/c/openstack/puppet-tripleo/+/84780016:57
opendevreviewDavid Hill proposed openstack/puppet-tripleo master: Implement ratelimiting through haproxy  https://review.opendev.org/c/openstack/puppet-tripleo/+/84780017:08
opendevreviewDavid Hill proposed openstack/puppet-tripleo master: Implement ratelimiting through haproxy  https://review.opendev.org/c/openstack/puppet-tripleo/+/84780017:10
opendevreviewBrent Eagles proposed openstack/tripleo-ansible master: Designate: support configuring non-ooo-deployed binds  https://review.opendev.org/c/openstack/tripleo-ansible/+/84780317:15
opendevreviewMerged openstack/tripleo-common master: New dedicated user for Galera SST synchronization  https://review.opendev.org/c/openstack/tripleo-common/+/83619017:18
opendevreviewMerged openstack/tripleo-ansible stable/wallaby: Compute grafana_vip using net_vip_map instead of hiera  https://review.opendev.org/c/openstack/tripleo-ansible/+/84743817:18
opendevreviewMerged openstack/tripleo-upgrade stable/wallaby: Use already available ansible inventory  https://review.opendev.org/c/openstack/tripleo-upgrade/+/84768017:18
opendevreviewMerged openstack/tripleo-heat-templates master: Add CephRbdTrashSchedulerEnable boolean  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84563817:18
rlandyha - merged 4 patches17:20
rlandyparty17:20
*** Guest3279 is now known as rcastillo17:20
fultonjparty!17:27
opendevreviewMerged openstack/tripleo-heat-templates stable/wallaby: Use Octavia's own default user_log_format value  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84092517:36
*** pojadhav|afk is now known as pojadhav17:36
opendevreviewFrancesco Pantano proposed openstack/tripleo-heat-templates stable/wallaby: Add CephRbdTrashSchedulerEnable boolean  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84766017:42
opendevreviewFrancesco Pantano proposed openstack/tripleo-heat-templates stable/wallaby: Fix rgw ssl_verify option key  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84725817:43
opendevreviewTakashi Kajinami proposed openstack/puppet-tripleo master: HAProxy: Replace hiera by lookup (2)  https://review.opendev.org/c/openstack/puppet-tripleo/+/84779517:53
opendevreviewDavid Hill proposed openstack/puppet-tripleo master: Implement ratelimiting through haproxy  https://review.opendev.org/c/openstack/puppet-tripleo/+/84780018:16
opendevreviewBrent Eagles proposed openstack/tripleo-heat-templates stable/wallaby: Deprecate env/enable-designate in favor of env/services/designate.yaml  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84784318:35
*** rlandy is now known as rlandy|afk18:40
opendevreviewJohn Fulton proposed openstack/python-tripleoclient master: Limit standalone ceph-admin user creation to a single host  https://review.opendev.org/c/openstack/python-tripleoclient/+/84784418:47
*** jpena is now known as jpena|off19:06
*** rlandy|afk is now known as rlandy19:23
opendevreviewMerged openstack/tripleo-heat-templates master: Fix ignored NovaLibvirtMaxQueues  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84753019:29
opendevreviewJohn Fulton proposed openstack/tripleo-heat-templates master: DNM: test IPv6 support for lb-mgmt-net  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84699719:38
opendevreviewJohn Fulton proposed openstack/tripleo-heat-templates master: THT cleanup of scenario001/004/010 for Deployed Ceph  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/83435419:40
fultonjrlandy akahat|ruck FYI: I expect https://review.opendev.org/c/openstack/python-tripleoclient/+/847844 to fix the ceph-admin user issue. I've updated the ruck/rover board (line 207) accordingly. I'm presently watching it in CI.19:47
rlandyfultonj: thanks20:01
rlandytrying to get the first few patches through atm20:01
fultonjrlandy: sure, undersand they're the priority 20:02
fultonji saw LP 1979093 had a promotion-blocker tag so whenever you need the fix. hopefully we'll know it's ready20:03
rlandyslagle: tkajinam: ok if I abandon and restore current gate patches?20:04
rlandyto get wallaby patches at the top of gate?20:04
*** dkehn_ is now known as dkehn20:10
opendevreviewDouglas Viroel proposed openstack/tripleo-ci master: Add CentOS9 standalone job with FIPS enabled  https://review.opendev.org/c/openstack/tripleo-ci/+/84785821:38
*** dviroel is now known as dviroel|out21:40
*** dasm is now known as dasm|off22:16
opendevreviewSteve Baker proposed openstack/diskimage-builder master: Fix BLS entries for /boot partitions  https://review.opendev.org/c/openstack/diskimage-builder/+/84683822:28
opendevreviewSteve Baker proposed openstack/diskimage-builder master: Parse block device lvm lvs size attributes  https://review.opendev.org/c/openstack/diskimage-builder/+/83982922:28
opendevreviewSteve Baker proposed openstack/diskimage-builder master: WIP Support LVM thin provisioning  https://review.opendev.org/c/openstack/diskimage-builder/+/84014422:28
opendevreviewSteve Baker proposed openstack/diskimage-builder master: Do dmsetup remove device in rollback  https://review.opendev.org/c/openstack/diskimage-builder/+/84786022:28
opendevreviewSteve Baker proposed openstack/tripleo-image-elements master: Switch to MiB for all partition/volume sizes  https://review.opendev.org/c/openstack/tripleo-image-elements/+/84786522:59
opendevreviewMerged openstack/tripleo-ansible master: Use ansible.netcommon.ipaddr filter in tripleo_mysql_client  https://review.opendev.org/c/openstack/tripleo-ansible/+/84261822:59
opendevreviewJulia Kreger proposed openstack/diskimage-builder master: DNM: Network Manager logging to Trace for Debugging  https://review.opendev.org/c/openstack/diskimage-builder/+/84760023:02
opendevreviewSteve Baker proposed openstack/tripleo-image-elements master: WIP switch to LVM thin provisioning  https://review.opendev.org/c/openstack/tripleo-image-elements/+/84786723:36

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!