Wednesday, 2022-06-22

opendevreviewDouglas Viroel proposed openstack/tripleo-ci master: WIP - Add fips jobs for centos 9  https://review.opendev.org/c/openstack/tripleo-ci/+/82447900:06
*** dviroel|afk is now known as dviroel00:07
opendevreviewTakashi Kajinami proposed openstack/tripleo-heat-templates master: Glance: Avoid simultaneous clean/pruner job  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84711200:35
opendevreviewTakashi Kajinami proposed openstack/tripleo-heat-templates master: Glance: Avoid simultaneous clean/pruner job  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84711200:42
opendevreviewTakashi Kajinami proposed openstack/tripleo-heat-templates master: Glance: Avoid simultaneous clean/pruner job  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84711201:03
rlandyfyi ... following mirror issue on centos-901:37
rlandyamoralej|off: ^^ http://mirror.regionone.vexxhost-nodepool-tripleo.rdoproject.org/centos-stream/9-stream/BaseOS/x86_64/os/repodata/9b8991b4a8d86b7d0af95e2e936c91d6ef472d9e87de0c52b4bc276577a1294f-filelists.xml.gz)01:37
*** rlandy is now known as rlandy|out01:42
*** ysandeep|out is now known as ysandeep02:09
tkajinampojadhav|out, I don't have strong opinion but afaik we used tripleo_ussuri_teardown when we eol ussuri so the topic I used follows that02:54
opendevreviewBrendan Shephard proposed openstack/tripleo-ansible master: Cleanup Keystone services that are not required  https://review.opendev.org/c/openstack/tripleo-ansible/+/84690203:02
opendevreviewBrendan Shephard proposed openstack/tripleo-ansible master: Configure OVS using Ansible tasks  https://review.opendev.org/c/openstack/tripleo-ansible/+/84565303:06
opendevreviewRabi Mishra proposed openstack/python-tripleoclient master: Drop unnecessary mocks in tests  https://review.opendev.org/c/openstack/python-tripleoclient/+/84711903:46
opendevreviewRabi Mishra proposed openstack/python-tripleoclient master: Refactor deploy validations for ephemeral heat  https://review.opendev.org/c/openstack/python-tripleoclient/+/84712003:46
opendevreviewRabi Mishra proposed openstack/puppet-tripleo stable/wallaby: Remove stack_action parameter  https://review.opendev.org/c/openstack/puppet-tripleo/+/84694104:26
opendevreviewRabi Mishra proposed openstack/tripleo-ansible stable/wallaby: Remove usage of stack_action/stack_update_type  https://review.opendev.org/c/openstack/tripleo-ansible/+/84694204:26
opendevreviewRabi Mishra proposed openstack/tripleo-heat-templates stable/wallaby: Remove StackAction/StackUpdateType  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84694304:27
opendevreviewRabi Mishra proposed openstack/python-tripleoclient master: Add irrelevant files to tripleoclient jobs  https://review.opendev.org/c/openstack/python-tripleoclient/+/84712205:03
*** pojadhav|out is now known as pojadhav|ruck05:10
pojadhav|rucktkajinam, sure I will the topic name of my reviews to "tripleo_victoria_teardown"05:12
tkajinampojadhav|ruck, thanks for checking. I'll keep using that topic.05:12
pojadhav|rucktkajinam, ack 05:13
opendevreviewchandan kumar proposed openstack/tripleo-ci master: Switch to ubi9 containers_base_image image  https://review.opendev.org/c/openstack/tripleo-ci/+/84378705:54
opendevreviewTakashi Kajinami proposed openstack/tripleo-heat-templates master: Swift: Do not enable the whole rsync::server class  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84616605:55
*** philroche_ is now known as philroche06:12
*** rpioso_ is now known as rpioso06:12
*** carloss_ is now known as carloss06:12
opendevreviewchandan kumar proposed openstack/tripleo-ansible master: Use ubi9-init image as base  https://review.opendev.org/c/openstack/tripleo-ansible/+/83968806:17
opendevreviewCedric Jeanneret proposed openstack/python-tripleoclient stable/wallaby: Move Ansible imports to correct UX Warnings  https://review.opendev.org/c/openstack/python-tripleoclient/+/84128606:30
opendevreviewchandan kumar proposed openstack/tripleo-ansible master: Use ubi9-init image as base  https://review.opendev.org/c/openstack/tripleo-ansible/+/83968806:40
opendevreviewchandan kumar proposed openstack/tripleo-ansible master: Use ubi9-init image as base  https://review.opendev.org/c/openstack/tripleo-ansible/+/83968807:01
*** ysandeep is now known as ysandeep|afk07:02
*** jpena|off is now known as jpena07:18
opendevreviewchandan kumar proposed openstack/tripleo-ansible master: Use ubi9-init image as base  https://review.opendev.org/c/openstack/tripleo-ansible/+/83968807:19
opendevreviewSoniya Murlidhar Vyas proposed openstack/tripleo-quickstart master: Run featureset027 job with tempest-allow  https://review.opendev.org/c/openstack/tripleo-quickstart/+/84403607:29
*** amoralej|off is now known as amoralej07:42
opendevreviewMarios Andreou proposed openstack/tripleo-quickstart master: WIP add new featureset66 for mixed deployment jobs  https://review.opendev.org/c/openstack/tripleo-quickstart/+/84158208:07
opendevreviewchandan kumar proposed openstack/tripleo-ansible master: Use ubi9-init image as base  https://review.opendev.org/c/openstack/tripleo-ansible/+/83968808:19
opendevreviewTakashi Kajinami proposed openstack/tripleo-heat-templates stable/wallaby: Enable Horizon in CI  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84694708:23
gthiemongeHi Folks, could you take a look at https://review.opendev.org/c/openstack/puppet-tripleo/+/846059 this is a change that we would like to backport to wallaby soon08:25
opendevreviewTom Weininger proposed openstack/tripleo-ansible master: Add support for IPv6 lb management network  https://review.opendev.org/c/openstack/tripleo-ansible/+/84572908:30
opendevreviewJuan Badia Payno proposed openstack/tripleo-heat-templates master: BnR - Rename variables on T-H-T and modify Scn01  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84661508:34
opendevreviewTom Weininger proposed openstack/tripleo-ansible master: Add support for IPv6 lb management network  https://review.opendev.org/c/openstack/tripleo-ansible/+/84572908:39
opendevreviewTom Weininger proposed openstack/tripleo-heat-templates stable/train: Use Octavia's own default user_log_format value  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84095008:49
opendevreviewGregory Thiemonge proposed openstack/puppet-tripleo master: Add support for ovn clustered DB in the octavia ovn-provider  https://review.opendev.org/c/openstack/puppet-tripleo/+/84605908:52
opendevreviewchandan kumar proposed openstack/tripleo-ansible master: Use ubi9-init image as base  https://review.opendev.org/c/openstack/tripleo-ansible/+/83968808:56
opendevreviewRajesh Tailor proposed openstack/tripleo-ansible master: Remove - from endfor statement  https://review.opendev.org/c/openstack/tripleo-ansible/+/84533308:56
opendevreviewRabi Mishra proposed openstack/python-tripleoclient master: Fix upgrade/external_update/external_upgrade  https://review.opendev.org/c/openstack/python-tripleoclient/+/84713809:07
*** ysandeep|afk is now known as ysandeep09:09
opendevreviewChristophe Fontaine proposed openstack/tripleo-ansible stable/wallaby: tripleo_ovs_dpdk: tripleo_ovs_dpdk_socket_memory is now optional  https://review.opendev.org/c/openstack/tripleo-ansible/+/84694909:22
opendevreviewchandan kumar proposed openstack/tripleo-ansible master: Use ubi9-init image as base  https://review.opendev.org/c/openstack/tripleo-ansible/+/83968809:35
opendevreviewchandan kumar proposed openstack/tripleo-ansible master: Use ubi9-init image as base  https://review.opendev.org/c/openstack/tripleo-ansible/+/83968809:50
opendevreviewchandan kumar proposed openstack/tripleo-ansible master: Use ubi9-init image as base  https://review.opendev.org/c/openstack/tripleo-ansible/+/83968810:05
opendevreviewFrancesco Pantano proposed openstack/tripleo-heat-templates master: Fix rgw ssl_verify option key  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84714210:19
*** rlandy__ is now known as rlandy10:34
opendevreviewIgnacio Horcada Bernal proposed openstack/tripleo-ci master: [DNM][WIP]"Add Ironic standalone job"  https://review.opendev.org/c/openstack/tripleo-ci/+/84576310:40
opendevreviewchandan kumar proposed openstack/tripleo-ansible master: Use ubi9-init image as base  https://review.opendev.org/c/openstack/tripleo-ansible/+/83968810:40
opendevreviewchandan kumar proposed openstack/tripleo-quickstart-extras master: Set NovaDisableComputeServiceCheckForFfu to true  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/83074110:49
opendevreviewchandan kumar proposed openstack/tripleo-ansible master: Use ubi9-init image as base  https://review.opendev.org/c/openstack/tripleo-ansible/+/83968810:51
arxcruz|rovergthiemonge hey, around?10:53
gthiemongearxcruz|rover: hey10:54
arxcruz|rovergthiemonge scen010 standalone train jobs are failing, wondering if you can take a look 10:54
arxcruz|roverhttps://0311bd31a4a774d12e01-21aea210631273030cc00dc607ec7d2f.ssl.cf2.rackcdn.com/840950/7/check/tripleo-ci-centos-8-scenario010-standalone-train/db0f17d/logs/undercloud/home/zuul/standalone_deploy.log10:54
arxcruz|rovergthiemonge ^10:54
arxcruz|roverit's failing in octavia-api-container-puppet.yml 10:54
opendevreviewMerged openstack/validations-common master: New validation: verify_package  https://review.opendev.org/c/openstack/validations-common/+/84555910:54
gthiemongearxcruz|rover: yeah, this is the same change id: https://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-8-scenario010-standalone-train&skip=010:54
gthiemongethe patch in review is the cause of the issue10:55
arxcruz|rovergthiemonge oh, great, then no problems :) 10:56
gthiemongeI hope so ;)10:58
*** sshnaidm_ is now known as sshnaidm11:05
opendevreviewchandan kumar proposed openstack/tripleo-ansible master: Use ubi9-init image as base  https://review.opendev.org/c/openstack/tripleo-ansible/+/83968811:07
arxcruz|roverfultonj i restore the current-ceph on tripleowallabycentos9 11:09
opendevreviewTom Weininger proposed openstack/tripleo-heat-templates stable/train: Use Octavia's own default user_log_format value  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84095011:09
fultonjfmount: ^ fyi11:10
fultonjok, thanks arxcruz|rover 11:10
fultonjhttps://images.rdoproject.org/ceph/daemon/master/current-ceph11:10
arxcruz|roverfultonj my bad, i put I went and restore, because this is rr hackmd, so only me and pojadhav|ruck was updating 11:14
arxcruz|roveri forgot other people are paying attention to that hackmd now :) 11:14
fultonjarxcruz|rover: no prob11:14
arxcruz|roverdpawlik i think quay.rdo are cleaning up daemon:current-ceph periodically 11:15
arxcruz|roverit shouldn't ;) 11:15
Tenguhello there.11:18
Tengufatal: [undercloud]: FAILED! => {"changed": false, "msg": "Failed to pull following containers: ['quay.rdoproject.org/tripleowallabycentos9/daemon:current-ceph']"}11:18
Tengua11:18
Tenguah11:18
Tengualready known :)11:18
Tenguarxcruz|rover: any ETA for that container to be back? :)11:19
arxcruz|rovermarios it should be Tengu already there11:19
fultonjTengu: works for me11:19
Tengurecheck-ing then11:20
fultonjmirror issue preverting merging of patches 11:20
Tengu"yay"11:20
* fultonj assumes Tengu knows ^11:20
Tenguthat's the them of the last weeks ;).11:20
Tengu*theme11:21
fultonjhttps://hackmd.io/OkRqfQ0SRUWwllxJthdO3Q?both11:21
fultonjarxcruz|rover:  is preveRting a freudian slip?11:21
* fultonj changes to preventing11:21
fultonj;)11:22
arxcruz|roverhehehe11:22
arxcruz|roverwe are not praying enough to the zuul god 11:22
arxcruz|roverhe demands more blood!11:22
arxcruz|roverand tears 11:22
fultonjand time11:22
Tenguand hairs.11:23
arxcruz|rover846999 is running now let's pray 11:24
fultonjthank you arxcruz|rover 11:24
Tenguoh, right. there's still that one11:25
fultonjwe had a 24 penalty for a mirror issue11:25
fultonj24 hour11:25
* pojadhav|ruck brb11:28
*** dviroel__ is now known as dviroel11:28
opendevreviewchandan kumar proposed openstack/tripleo-ansible master: Use ubi9-init image as base  https://review.opendev.org/c/openstack/tripleo-ansible/+/83968811:29
mariosarxcruz|rover: o/ ? 14:19 < arxcruz|rover> marios it should be Tengu already there11:40
mariosarxcruz|rover: in a call but what is the context for ^^ 11:40
Tengumarios: the ceph daemon container image on wallaby11:40
arxcruz|rovermarios don't worry, it's fixed now :) 11:40
mariosTengu: arxcruz|rover: k 11:40
Tenguarxcruz|rover: until next crash ;). seems to be one of those weeks11:40
Tengu"be positive" - nope.11:41
arxcruz|roverTengu please, don't jinx it 11:41
Tengutoo late11:41
Tengucall me "CI Grinch".11:41
* Tengu laughs diabolically. *MUHAHAHAAAAAAA*11:41
opendevreviewchandan kumar proposed openstack/tripleo-ansible master: Use ubi9-init image as base  https://review.opendev.org/c/openstack/tripleo-ansible/+/83968811:44
dpawlikarxcruz|rover: hey, you mean that the iamges has been deleted by pruner script?11:51
dpawlikarxcruz|rover: could you send me repo url?11:52
arxcruz|roverdpawlik i don't know, i know that today was removed11:52
arxcruz|roverdpawlik https://quay.rdoproject.org/repository/tripleowallabycentos9/daemon11:53
arxcruz|roverdpawlik but definitively there is a pattern :) 11:54
arxcruz|roverevery 9 days +- 11:54
dpawlikarxcruz|rover: check the history for that repository11:55
dpawlikhttps://quay.rdoproject.org/repository/tripleowallabycentos9/daemon?tab=history11:56
dpawlikyou can always click on restore ;)11:56
dpawlikbut yeah, I will check what is removing that11:56
arxcruz|roverdpawlik that's what i did 11:56
arxcruz|roverbut should not be removed 11:56
dpawliknormally when pruner mark the image to delete, it will be in the history11:56
opendevreviewJuan Larriba proposed openstack/tripleo-heat-templates master: Remove the Backup and Restore ReaR Heat templates  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84714511:57
dpawlikarxcruz|rover: will check tomorrow if it will be marked as "to delete"11:58
arxcruz|roverdpawlik ack 11:59
*** amoralej is now known as amoralej|lunch12:01
rlandyfultonj: is this patch still needed? https://review.opendev.org/c/openstack/tripleo-heat-templates/+/846557?12:08
rlandyarxcruz|rover: ?12:08
* fultonj looks12:08
fultonjrlandy: hopefully not12:08
arxcruz|rovernope12:09
rlandyok - looking at status of https://trello.com/c/ZhGfFj10/2583-cixlp1978997tripleociproa-tripleo-ci-centos-9-scenario001-standalone-failed-during-step5-because-gnocchi-couldnt-connect-to-redi12:09
fultonjrlandy: provided we get the right pcs packages we can avoid that12:09
rlandyon master - wallaby backport still needed12:09
rlandyok - we ca go through at cix call12:09
fultonjrlandy: i added notes to the card12:12
opendevreviewJuan Larriba proposed openstack/tripleo-heat-templates master: Remove the Backup and Restore ReaR Heat templates  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84714512:12
opendevreviewTom Weininger proposed openstack/tripleo-ansible master: Add support for IPv6 lb management network  https://review.opendev.org/c/openstack/tripleo-ansible/+/84572912:13
opendevreviewJuan Larriba proposed openstack/tripleo-heat-templates master: Remove the Backup and Restore ReaR Heat templates  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84714512:17
opendevreviewJuan Larriba proposed openstack/tripleo-heat-templates master: Remove the Backup and Restore ReaR Heat templates  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84714512:17
opendevreviewJuan Larriba proposed openstack/tripleo-heat-templates master: Remove the Backup and Restore ReaR Heat templates  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84714512:18
*** ysandeep is now known as ysandeep|afk12:23
opendevreviewJuan Larriba proposed openstack/tripleo-heat-templates stable/train: Add deprecation notice to rear heat template  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84714712:27
opendevreviewJuan Larriba proposed openstack/tripleo-heat-templates stable/train: Add deprecation notice to rear heat template  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84714712:30
opendevreviewJuan Larriba proposed openstack/tripleo-heat-templates stable/train: Add deprecation notice to rear heat template  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84714812:42
opendevreviewchandan kumar proposed openstack/tripleo-ci master: Revert "Make sure 05-selinux-9-stream is executable"  https://review.opendev.org/c/openstack/tripleo-ci/+/84715012:47
chandankumarrlandy: ^^12:47
rlandychandankumar: thanks12:49
opendevreviewchandan kumar proposed openstack/tripleo-ci master: Revert "Make sure 05-selinux-9-stream is executable"  https://review.opendev.org/c/openstack/tripleo-ci/+/84715012:50
opendevreviewFrancesco Pantano proposed openstack/tripleo-heat-templates master: Fix rgw ssl_verify option key  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84714212:53
opendevreviewMikolaj Ciecierski proposed openstack/tripleo-heat-templates stable/wallaby: Fix 'Ensure DNF modules have the right stream'  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84714912:57
*** pojadhav is now known as pojadhav|ruck12:58
opendevreviewJuan Larriba proposed openstack/tripleo-heat-templates stable/train: Add deprecation notice to rear heat template  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84714813:01
opendevreviewJuan Larriba proposed openstack/tripleo-heat-templates master: Remove the Backup and Restore ReaR Heat templates  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84714513:08
opendevreviewJuan Larriba proposed openstack/tripleo-heat-templates stable/train: Add deprecation notice to rear heat template  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84714813:10
*** amoralej|lunch is now known as amoralej13:11
opendevreviewchandan kumar proposed openstack/tripleo-ansible master: Use ubi9-init image as base  https://review.opendev.org/c/openstack/tripleo-ansible/+/83968813:11
opendevreviewCedric Jeanneret proposed openstack/tripleo-ansible stable/wallaby: Make bootstrap tasks more modular  https://review.opendev.org/c/openstack/tripleo-ansible/+/84715313:17
Tenguerr...13:18
Tengunope.13:18
arxcruz|roverfultonj Tengu fmount it's going to gates soon \o/ 13:18
opendevreviewCedric Jeanneret proposed openstack/tripleo-ansible stable/wallaby: Ensure required tools are available  https://review.opendev.org/c/openstack/tripleo-ansible/+/84717113:19
opendevreviewCedric Jeanneret proposed openstack/tripleo-ansible stable/wallaby: Include vars when using standalone bootstrap role  https://review.opendev.org/c/openstack/tripleo-ansible/+/84717213:19
Tenguarxcruz|rover: wooohoooo13:19
opendevreviewchandan kumar proposed openstack/tripleo-ansible master: Use ubi9-init image as base  https://review.opendev.org/c/openstack/tripleo-ansible/+/83968813:21
fmountarxcruz|rover: nice, finger crossed then!13:22
*** ysandeep|afk is now known as ysandeep13:22
opendevreviewJuan Badia Payno proposed openstack/tripleo-heat-templates stable/wallaby: Remove Nova from undercloud during upgrades  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84715413:38
opendevreviewchandan kumar proposed openstack/tripleo-ansible master: Use ubi9-init image as base  https://review.opendev.org/c/openstack/tripleo-ansible/+/83968813:47
*** dasm|off is now known as dasm13:47
opendevreviewJames Slagle proposed openstack/python-tripleoclient master: Set owner/permissions on ~/.tripleo for tripleo deploy  https://review.opendev.org/c/openstack/python-tripleoclient/+/84709313:53
opendevreviewchandan kumar proposed openstack/tripleo-ansible master: Use ubi9-init image as base  https://review.opendev.org/c/openstack/tripleo-ansible/+/83968814:19
beagleshjensas, I need to double check on some data points but I probably will need to pick your brain on https://review.opendev.org/c/openstack/tripleo-heat-templates/+/827146 and why the map is ending up with "datacentre: null" 14:28
beagleshjensas, unless I'm mistaken this map is being generated outside of CI with a proper value14:29
beagles(checked a d/s 16.2 job)14:29
opendevreviewMerged openstack/tripleo-heat-templates master: Restore missing SAN IP in etcd cert  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84559714:32
opendevreviewchandan kumar proposed openstack/tripleo-ansible master: Use ubi9-init image as base  https://review.opendev.org/c/openstack/tripleo-ansible/+/83968814:39
opendevreviewFrancesco Pantano proposed openstack/tripleo-ansible master: Compute grafana_vip using net_vip_map instead of hiera  https://review.opendev.org/c/openstack/tripleo-ansible/+/84661114:43
arxcruz|rovergthiemonge hi again, i'm getting this error https://sf.hosted.upshift.rdu2.redhat.com/logs/14/416314/1/check/periodic-tripleo-ci-centos-8-scenario010-kvm-internal-standalone-train/034f211/logs/undercloud/var/log/tempest/stestr_results.html wondering if you can help me :) 14:48
gthiemongearxcruz|rover: looking...14:50
opendevreviewMerged openstack/tripleo-heat-templates master: etcd: fix service config to work with latest versions  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84598214:50
opendevreviewMerged openstack/tripleo-quickstart master: Install collections from gated repos after we install from requirements  https://review.opendev.org/c/openstack/tripleo-quickstart/+/84322614:50
gthiemongearxcruz|rover: hmmm there are timeouts while waiting for a VM to be active: ERROR oslo_messaging.rpc.server octavia.common.exceptions.ComputeWaitTimeoutException: Waiting for compute id c3ba8aa3-eff4-44ae-98a9-fa5f720298c6 to go active timeout14:53
gthiemongearxcruz|rover: maybe it's related to https://sf.hosted.upshift.rdu2.redhat.com/logs/14/416314/1/check/periodic-tripleo-ci-centos-8-scenario010-kvm-internal-standalone-train/034f211/logs/undercloud/var/log/containers/libvirt/qemu/instance-00000001.log14:54
johnsomYep14:56
arxcruz|rovergthiemonge ack, i'll open a bug then 14:56
*** dviroel is now known as dviroel|lunch14:59
*** ysandeep is now known as ysandeep|out15:00
opendevreviewchandan kumar proposed openstack/tripleo-ansible master: Use ubi9-init image as base  https://review.opendev.org/c/openstack/tripleo-ansible/+/83968815:01
opendevreviewchandan kumar proposed openstack/tripleo-ansible master: Use ubi9-init image as base  https://review.opendev.org/c/openstack/tripleo-ansible/+/83968815:16
opendevreviewmbu proposed openstack/tripleo-validations stable/wallaby: Deprecates tripleo-ansible-inventory and remove tripleo-validation scripts  https://review.opendev.org/c/openstack/tripleo-validations/+/84716215:25
opendevreviewmbu proposed openstack/tripleo-validations stable/wallaby: Deprecates tripleo-ansible-inventory and remove tripleo-validation scripts  https://review.opendev.org/c/openstack/tripleo-validations/+/84716215:27
opendevreviewAlan Bishop proposed openstack/tripleo-heat-templates stable/wallaby: Restore missing SAN IP in etcd cert  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84718315:29
opendevreviewAlan Bishop proposed openstack/tripleo-heat-templates stable/wallaby: etcd: fix service config to work with latest versions  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84718415:29
beagleshjensas, also fwiw - some of this stuff looks pretty "weird" in the u/s CI jobs (see https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_928/846947/1/check/tripleo-ci-centos-8-standalone/92889c4/logs/undercloud/home/zuul/tripleo-deploy/standalone-ansible-2w5e0zik/ovn_bridge_mac_address_vars.yaml) not sure what's going on there...15:29
hjensasbeagles: hm, in the train job - https://logserver.rdoproject.org/46/827146/2/openstack-check/tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001/e7a5e3d/logs/overcloud-controller-0/etc/puppet/hieradata/ovn_chassis_mac_map.json.txt.gz15:33
hjensasbeagles: it is not  "datacentre: null"15:33
*** marios is now known as marios|out15:34
beaglesdoh I never thought to check those jobs15:40
beagleshjensas, kind of weird right?15:41
opendevreviewMerged openstack/tripleo-heat-templates stable/wallaby: Workaround for subscription-manager  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84567415:43
hjensasbeagles: the standalone results are really strange - this patch in tripleo-client should pass a static mapping - https://opendev.org/openstack/python-tripleoclient/commit/2f5ad5947b1ad8691062f519ede49ed6748cac5815:49
hjensasbeagles: I wonder if NeutronBridgeMappings: datacentre:br-ctlplane,tenant:br-tenant, would be handled better if it was NeutronBridgeMappings: [datacentre:br-ctlplane, tenant:br-tenant]15:57
hjensasbeagles: i.e for standlone in  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/845674 I should check if NeutronBridgeMappings is a list or a string. If string split to list on ','.15:58
beaglesahh15:58
beaglesyeah15:58
beagleshjensas, ^15:58
hjensasheat parameter type 'comma_separated_list' is not very python. 15:58
beagleshjensas,  :) no, it's not lol15:59
opendevreviewBrent Eagles proposed openstack/tripleo-heat-templates stable/wallaby: Enable octavia driver agent puppet  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84719016:02
opendevreviewHarald Jensås proposed openstack/python-tripleoclient master: Standalone - ovn_bridge_mac comma_delimited_list  https://review.opendev.org/c/openstack/python-tripleoclient/+/84719416:13
opendevreviewHarald Jensås proposed openstack/python-tripleoclient master: Standalone - ovn_bridge_mac comma_delimited_list  https://review.opendev.org/c/openstack/python-tripleoclient/+/84719416:13
opendevreviewBogdan Dobrelya proposed openstack/tripleo-ansible master: Fix nova_compute naming, add missed hiera mappings  https://review.opendev.org/c/openstack/tripleo-ansible/+/84719916:29
*** dviroel|lunch is now known as dviroel16:31
*** jpena is now known as jpena|off16:37
*** pojadhav|ruck is now known as pojadhav|out17:00
opendevreviewJohn Fulton proposed openstack/python-tripleoclient master: Do not end ceph_namespace with a slash  https://review.opendev.org/c/openstack/python-tripleoclient/+/84720917:18
opendevreviewMerged openstack/tripleo-ansible stable/wallaby: Ensure lowercase hostname in NodePortMap  https://review.opendev.org/c/openstack/tripleo-ansible/+/84539817:20
opendevreviewMerged openstack/python-tripleoclient stable/wallaby: Fix typo "conatiner" -> "container"  https://review.opendev.org/c/openstack/python-tripleoclient/+/84583317:35
opendevreviewMerged openstack/tripleo-heat-templates master: Fix 'Ensure DNF modules have the right stream'  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84441517:35
opendevreviewMerged openstack/tripleo-ansible master: Add ssl spec parameter to ceph_spec module  https://review.opendev.org/c/openstack/tripleo-ansible/+/84699917:36
opendevreviewMerged openstack/tripleo-quickstart master: Adds dependency for installing latest openstacksdk  https://review.opendev.org/c/openstack/tripleo-quickstart/+/84537517:36
opendevreviewMerged openstack/tripleo-quickstart-extras master: Run dstat on overcloud nodes  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/84483717:36
fultonjrlandy: 846999 merged !17:37
* fultonj rechecks https://review.opendev.org/c/openstack/tripleo-ansible/+/84695017:38
arxcruz|roverfultonj i was about to say that :)17:53
arxcruz|roverfultonj may i go play on my steam deck and you and rlandy take care of the other patches? :) 17:53
arxcruz|roverit's 8pm here :) 17:54
fultonjgood night arxcruz|rover 17:54
opendevreviewMerged openstack/tripleo-ansible master: Add deployed_ceph condition on net_config_set  https://review.opendev.org/c/openstack/tripleo-ansible/+/84695017:56
*** amoralej is now known as amoralej|off17:56
opendevreviewJohn Fulton proposed openstack/tripleo-ansible stable/wallaby: Add deployed_ceph condition on net_config_set  https://review.opendev.org/c/openstack/tripleo-ansible/+/84716317:57
rlandyarxcruz|rover:ack - on it17:59
rlandyfultonj rechecks https://review.opendev.org/c/openstack/tripleo-ansible/+/846950 ... 18:01
fultonj846950 merged ^18:01
rlandyfultonj?? https://review.opendev.org/c/openstack/tripleo-ansible/+/846950/ merged18:01
rlandywhy?18:02
rlandywe need a backport of that 18:02
fultonjhttps://review.opendev.org/c/openstack/tripleo-ansible/+/84716318:02
fultonjbackport ^ 18:02
fultonjrecheck of 950  was unecessary; sorry18:03
rlandyupdating hackmd with patches to watch ..18:04
rlandyhttps://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/846231 is in recheck - good18:06
opendevreviewRonelle Landy proposed openstack/tripleo-ansible stable/wallaby: Add ssl spec parameter to ceph_spec module  https://review.opendev.org/c/openstack/tripleo-ansible/+/84694018:08
rlandyrebased ^^18:08
fultonjack\18:08
rlandyfultonj: ok- think we have the list now18:08
fultonjhttps://review.opendev.org/c/openstack/tripleo-ansible/+/846940 before https://review.opendev.org/c/openstack/tripleo-ansible/+/847163 18:09
* fultonj added that order to pad18:09
rlandyshould we rebase then 18:10
rlandyon that order?18:10
rlandyso zuul merges them right18:10
fultonjyes18:10
opendevreviewJohn Fulton proposed openstack/tripleo-ansible stable/wallaby: Add deployed_ceph condition on net_config_set  https://review.opendev.org/c/openstack/tripleo-ansible/+/84716318:14
fultonjrlandy: ^ rebased 847163 on 84694018:15
rlandythanks18:15
rlandychecking why we are still failing  scenario001 and 002 in master in gate18:15
rlandyhmm ... "Failed containers: gnocchi_db_sync, ceilometer_gnocchi_upgrade" still18:15
fultonjlink to log?18:16
fultonjrlandy: https://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-9-scenario001&skip=0 ?18:22
fultonjhttps://zuul.opendev.org/t/openstack/status/change/845854,418:25
fultonjrlandy: i see so you're wondering why ^ are red18:25
opendevreviewFrancesco Pantano proposed openstack/tripleo-ansible master: Compute grafana_vip using net_vip_map instead of hiera  https://review.opendev.org/c/openstack/tripleo-ansible/+/84661118:26
opendevreviewFrancesco Pantano proposed openstack/tripleo-heat-templates master: Fix rgw ssl_verify option key  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84714218:26
fultonjrlandy: and i confirm both are because of  https://bugs.launchpad.net/tripleo/+bug/1978997 18:31
rlandyhttps://review.opendev.org/c/openstack/tripleo-common/+/846287fix19:12
rlandyneeds to go through the line then19:12
fultonjrlandy: so once it goes through the line you think we'll have containers with the fix?19:17
rlandyI need to follow the commit and see where it is19:17
fultonjrlandy: is there a link to a job pushing it though the line?19:18
rlandyif  https://review.opendev.org/c/openstack/tripleo-common/+/846287 is correct19:18
hjensasreview please - https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84655519:19
* fultonj reviewing19:20
rlandyfultonj: https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_476/845854/4/gate/tripleo-ci-centos-9-content-provider/476d5db/logs/undercloud/home/zuul/workspace/logs/container-builds/224ce1d1-e0db-4fbb-b3d7-04b26d50d33a/base/redis/redis-build.log19:21
rlandyhttps://review.opendev.org/c/openstack/tripleo-common/+/846287/2/container-images/tcib/base/redis/redis.yaml#619:22
hjensasthanks fultonj19:22
rlandychange is in the provider logs for https://review.opendev.org/c/openstack/puppet-tripleo/+/845854/19:22
rlandyonce the extras patch is merged19:23
rlandygoing to rerun everything19:23
fultonj846231 ?19:24
fultonjwhich extras patch?19:24
fultonjhjensas: np19:26
rlandyhttps://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/846231/19:28
rlandyfultonj: ^^19:28
fultonjok, just confirming19:28
rlandywhich just failed tripleo-ci-centos-9-scenario010-standalone19:28
* fultonj looks at the failure19:29
rlandyEnable Ceph User]19:29
rlandythis is a fun go around19:29
fultonjthe other 3 cpeh jobs didn't fail the same way19:31
fultonjhttps://zuul.opendev.org/t/openstack/status/change/845870,3 001-standalone just failed . I'm betting it's gnochi19:38
*** dviroel is now known as dviroel|afk19:48
opendevreviewJohn Fulton proposed openstack/tripleo-heat-templates master: THT cleanup of scenario001/004/010 for Deployed Ceph  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/83435419:52
fultonjrlandy: ^ will test fix for "Enable Ceph User" issue 19:53
fultonjrlandy: i've updated the ruck/rover board. 4 main issues:20:09
fultonj1. gnocchi20:10
fultonj2. wallaby (rgw-ssl/network)20:10
fultonj3. ceph-admin20:10
fultonj4. periodic tqe ceph-container name20:10
fultonjrlandy: the fix for 2-4 are clear to me and the relevant patch is linked20:10
fultonjfor 1 i'm not sure i understand20:10
fultonjI sorted by priority since i think gnocchi is the worst issue right now20:11
fultonjAFAICT to fix 1, either 846287 gets "through the line" or we disable gnocchi via 846474 20:17
rlandyfultonj: sorry - on a call  be with you in a few20:18
fultonjrlandy: no prob20:18
rlandyfultonj: apologies - done with calls now20:31
rlandyreading back20:31
rlandylooking into why scen001 004 and 10 are still failing20:32
*** dviroel|afk is now known as dviroel20:43
rlandyfultonj: I think I see the issue20:45
rlandyhttps://bugs.launchpad.net/tripleo/+bug/1978997/comments/220:45
* fultonj looks20:46
rlandycompares pacemaker pacemaker.x86_64 2.1.2-4.el920:46
rlandyand pacemaker.x86_64 2.1.3-2.el920:46
rlandyand the patch downgrades pacemaker20:46
fultonjyes, it downgrades20:47
rlandybut now we have version   2.1.4-1.el9 20:47
rlandyso I think it downgrades20:47
rlandyback to bad version20:47
rlandydoes that sounds reasonable20:47
fultonjlike alfredo said it would20:47
rlandyhttps://7d001b464d1c8a16de46-0757739227409b7b3e2b1ef597883c12.ssl.cf1.rackcdn.com/846231/8/check/tripleo-ci-centos-9-scenario001-standalone/84a01c4/logs/undercloud/var/log/extra/package-list-installed.txt20:48
rlandyoh - so I'm not crazy20:48
rlandythe patch needs to fix a version to downgrade tp20:48
rlandyto20:48
rlandymaybe we don't need the downgrade20:48
rlandyif the new version is fixed20:48
* fultonj reads package-list-installed.txt20:48
rlandylet me try without the downgrade20:48
rlandyand then fixing the version to downgrade to20:49
rlandyfultonj: compare with https://411deec051d768e42c33-554a55c2926ce345d8a8f0805ecfe993.ssl.cf5.rackcdn.com/846159/4/check/tripleo-ci-centos-9-scenario001-standalone/a9a4889/logs/undercloud/var/log/extra/package-list-installed.txt20:52
rlandyfrom original failing log20:53
rlandylet me try w/o downgrade20:53
fultonjrlandy: so you'll try with a revert of https://review.opendev.org/c/openstack/tripleo-common/+/846287 ?20:54
rlandyyep20:56
opendevreviewRonelle Landy proposed openstack/tripleo-common master: Revert "Downgrade pacemaker and resource-agents"  https://review.opendev.org/c/openstack/tripleo-common/+/84716620:56
rlandyfultonj: ^^20:57
fultonjrlandy: i'd like to see the downgrade in action in the logs from a job20:57
rlandyfultonj: you see it in what installs in the container20:58
rlandyalso may 2.1.4 is also no good20:58
rlandyin which case we have to downgrade to a specific version20:58
rlandytesting that patch as well20:58
rlandysec - proposing that20:58
fultonjrlandy:  https://7d001b464d1c8a16de46-0757739227409b7b3e2b1ef597883c12.ssl.cf1.rackcdn.com/846231/8/check/tripleo-ci-centos-9-scenario001-standalone/84a01c4/logs/undercloud/var/log/extra/podman/containers/redis-bundle-podman-0/podman_info.log \20:59
fultonjwithin the container that fails i see 2.1.3-2.el9 20:59
fultonjthat the 21:00
fultonjlog of a job that failed in the gate today21:00
rlandycorrect21:01
rlandyand it has the downgrade script21:01
fultonjit should have the downgrade script in theory21:01
* fultonj looking for a log of it winding back our pacemaker to support your thoery21:02
rlandyI am prep'ing a patch to specify the version to downgrade tp21:02
rlandyto21:02
rlandyso we can try both21:03
fultonjrlandy: I've updated the ruck/rover board accordingly21:09
rlandyfultonj++ thanks21:09
rlandywe may pull for ruck/rover duty :)21:09
rlandyyou're better at keeping up the board than the rest of us21:10
fultonjlol21:10
fultonjso we've got a plan/patch for everything21:11
fultonjnow we wait21:11
* fultonj leaves for the day21:14
opendevreviewRonelle Landy proposed openstack/tripleo-common master: Downgrade pacemaker, resource-agents - exact ver  https://review.opendev.org/c/openstack/tripleo-common/+/84722221:18
*** dviroel is now known as dviroel|afk21:22
*** rlandy is now known as rlandy|bbl22:30
*** dasm is now known as dasm|off23:03
opendevreviewMerged openstack/tripleo-heat-templates stable/train: [ovn] Deleting ovn agents during scale down tasks  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/84587523:24
opendevreviewMerged openstack/tripleo-ansible stable/wallaby: Use lowercase hostname in inventory network config  https://review.opendev.org/c/openstack/tripleo-ansible/+/84540023:45
opendevreviewMerged openstack/tripleo-common stable/wallaby: Add rsync-daemon to swift container  https://review.opendev.org/c/openstack/tripleo-common/+/84699323:45

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!