Wednesday, 2022-06-01

*** ysandeep|out is now known as ysandeep06:14
opendevreviewAndrew Bonney proposed openstack/openstack-ansible-ops master: Address ELK deprecations necessary before v8 upgrades  https://review.opendev.org/c/openstack/openstack-ansible-ops/+/84425207:38
opendevreviewAndrew Bonney proposed openstack/openstack-ansible-ops master: beats: allow definition of custom hostname where necessary  https://review.opendev.org/c/openstack/openstack-ansible-ops/+/84425307:41
*** ysandeep is now known as ysandeep|lunch08:09
jrosser_good morning09:01
*** ysandeep|lunch is now known as ysandeep09:26
noonedeadpunkmorning.09:30
noonedeadpunkwould be great if somebody except me tried running https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/839068 upgrade with upgrade playbook :)09:32
noonedeadpunkAs making mistake here is scary09:33
jrosser_andrewbonney: ^^ ?09:35
jrosser_can we give that a go in the lab?09:35
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: Add Octavia certificates upgrade playbook  https://review.opendev.org/c/openstack/openstack-ansible/+/84371109:36
andrewbonneyYes probably09:36
opendevreviewMerged openstack/openstack-ansible-ops master: Serialise operations on components which may be highly available  https://review.opendev.org/c/openstack/openstack-ansible-ops/+/84357410:20
opendevreviewMerged openstack/openstack-ansible master: Add experimental Ubuntu 22.04 support  https://review.opendev.org/c/openstack/openstack-ansible/+/83948310:31
opendevreviewMerged openstack/openstack-ansible master: [doc] Add CentOS 9 Stream to supported  https://review.opendev.org/c/openstack/openstack-ansible/+/84410410:31
opendevreviewMerged openstack/openstack-ansible stable/xena: [doc] Fix supporeted Debian version for Xena  https://review.opendev.org/c/openstack/openstack-ansible/+/84410510:31
mgariepymorning everyone11:48
mgariepyfyi i'm on the failing aio deployment of galera on centos9.11:54
*** dviroel|afk is now known as dviroel12:21
opendevreviewMarc Gariépy proposed openstack/openstack-ansible-galera_server master: Add missing package for galera_cluster on rhel9.  https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/84428812:39
mgariepyjrosser_, ^^12:39
mgariepyhttps://zuul.opendev.org/t/openstack/build/ffb71d3850284a028fe4329c2c4abb20/log/logs/openstack/aio1_galera_container-170eefd4/mariadb.service.journal-21-15-29.log.txt#15012:40
mgariepyalso noonedeadpunk ^^ :D12:41
opendevreviewMarc Gariépy proposed openstack/openstack-ansible-galera_server master: Provide a list for systemd_service.  https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/84403712:43
*** dviroel_ is now known as dviroel13:15
opendevreviewAndrew Bonney proposed openstack/openstack-ansible master: Add Octavia certificates upgrade playbook  https://review.opendev.org/c/openstack/openstack-ansible/+/84371113:41
opendevreviewshahab taee proposed openstack/openstack-ansible-os_neutron master: custom configuration for vpnaas  https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/84429313:50
opendevreviewMarc Gariépy proposed openstack/openstack-ansible-galera_server master: Add missing package for galera_cluster on rhel9.  https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/84428813:57
opendevreviewMarc Gariépy proposed openstack/openstack-ansible-galera_server master: Provide a list for systemd_service.  https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/84403714:01
opendevreviewMerged openstack/openstack-ansible-ops master: beats: allow definition of custom hostname where necessary  https://review.opendev.org/c/openstack/openstack-ansible-ops/+/84425314:21
opendevreviewMerged openstack/openstack-ansible-ops master: Address ELK deprecations necessary before v8 upgrades  https://review.opendev.org/c/openstack/openstack-ansible-ops/+/84425214:21
*** ysandeep is now known as ysandeep|out14:58
*** dviroel is now known as dviroel|lunch15:08
mgariepy2022-06-01 15:22:59.635469 | centos-9-stream | EXIT NOTICE [Playbook execution success] **************************************15:28
mgariepy\o/15:28
mgariepymight need some magic to merge that tho.. both patch are needed :/ https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/844288/ and https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/84403715:38
jrosser_either in one of them set the other failing job to nv15:39
jrosser_or squash the two changes together into one patch15:39
opendevreviewMarc Gariépy proposed openstack/openstack-ansible-galera_server master: Fix systemd and centos9.  https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/84428815:53
mgariepyhere we go.15:58
mgariepydid you check for the gluster issue on jammy ?16:01
jrosser_no, i didnt.....16:02
jrosser_whats wrong?16:02
mgariepyhttps://zuul.opendev.org/t/openstack/build/855905197ed941ab93bfbb689e9274cf/log/logs/openstack/aio1_repo_container-a6ad24e4/glusterfs/var-www-repo.log.txt16:03
mgariepyseems like it just fail to mount for $REASONS.16:05
* jrosser_ tests16:07
*** dviroel|lunch is now known as dviroel16:20
jrosser_mgariepy: unfortunately the mount worked here and i got a much longer log https://paste.opendev.org/show/bUIqT0FN0aHtHotMvZgF/16:55
jrosser_compared to https://zuul.opendev.org/t/openstack/build/855905197ed941ab93bfbb689e9274cf/log/logs/openstack/aio1_repo_container-a6ad24e4/glusterfs/glusterd.log.txt16:55
mgariepydid you know we can download the ci images ?17:01
jrosser_yeah, though they are pretty massive17:01
mgariepyhttps://nb01.opendev.org/images/17:01
jrosser_though in this case it's inside an lxc which we build ourselves.....17:02
mgariepyor ask fungi to get you a hold :D17:02
mgariepywell it can be something on the host..17:02
jrosser_hmm i am kind of out of time for today17:03
mgariepyit's nv anyway17:04
jrosser_i saw we run 19 (!) jobs on our patches now :/17:04
fungiif you can reproduce it without holding a job node, that's preferable17:04
mgariepythat's a lot indeed.17:04
fungireproduce and diagnose i mean17:04
mgariepyyep we know :D17:05
opendevreviewMarc Gariépy proposed openstack/openstack-ansible-galera_server master: Fix systemd and centos9.  https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/84428817:13
mgariepycan we merge this one please ? : https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/844288/19:35
mgariepyjrosser_, https://paste.openstack.org/show/bFTUZBhGqI3l2Ok0cBiO/20:36
mgariepyi won't be there tomorrow. but if you can check the repo thing on jammy. it seems that we dont quite have the same package installed on both host and containers.20:37
mgariepyi really dont get why..20:37
mgariepyon local testing i have 93 packages more..20:37
mgariepyin the lxc container.20:38
mgariepyhmm . probably a couple because of the role completing..20:43
mgariepyhttps://github.com/gluster/glusterfs/issues/64720:43
mgariepyi'll let you debug the remaining stuff. 20:44
*** dviroel is now known as dviroel|out21:34
jrosser_mgariepy: which two files do you diff there?21:39
jrosser_would be interested to know if/how you managed to reproduce what we saw in the broken CI job21:40
mgariepywith the list of pkg in the repo conaiter22:15
mgariepycontainer**22:15
mgariepybut in the ci probably the run didn't finish because of the gluster not mounting.22:16
mgariepyi suspect rpcbind issue there.22:17
mgariepyhttps://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_855/844288/2/check/openstack-ansible-deploy-infra_lxc-ubuntu-jammy/8559051/logs/etc/openstack/aio1_repo_container-a6ad24e4/apt/apt.conf.d/95disable-recommends.txt22:17
mgariepy:/ 22:17
mgariepywell it did work in my vm.23:00
mgariepybut i decided to diff the working apt pkg with the broken one.23:01
mgariepyok : glusterfs-server recommends nfs-common witch depends on rpcbind.23:04
mgariepynfs-common not installed in the CI as no-install-recommends is set via apt config.23:04
mgariepyi can try to fix it friday.23:06

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!