Thursday, 2024-03-28

AravindhGuys who manage openstack is scale, where do you run the cinder volume service if you cannot afford to have a dedicated storage node. I have an external netapp box and I deployed cinder volume in compute nodes, redhat seems to be running cinder volume in controller. so I'm a bit confused on what the best practice is. Sven or Kevko?01:43
Aravindhalso redhat seems to run only one cinder volume container and fails it over to next node when needed, but we are deploying it to all the nodes? or do we have a failover mechanism like redhat01:45
mnasiadkaSvenKieske: https://bugs.launchpad.net/kolla-ansible/+bug/1787392 - I've seen this in the past, but I would think more people would report that bug and we would see that in CI06:58
fricklerwell we don't use kvm in CI, so I don't think we would see it there, but likely we should see more reports if the issue wasn't restricted to some special deployment scenario07:00
mnasiadkafrickler: nested-virt jobs use it07:02
mnasiadkaas in -kvm07:03
mnasiadkaof course we don't run it always07:03
mnasiadkahttps://github.com/openstack/kolla-ansible/blob/2a150d1be9be242b0ee1e9075840d3802cfb21e6/zuul.d/base.yaml#L7507:03
mnasiadkabut still07:03
fricklerhmm, only for nova-cell role, and not for debian. but ok, at least some coverage07:05
mnasiadkawonder how many opendev instances don't have nested-virt today07:06
mnasiadkaand what would we loose if we would switch all jobs to kvm and nested-virt07:06
frickleriirc all of rackspace doesn't. and possibly still very flaky on some others07:08
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: DNM: Test kvm nested-virt jobs  https://review.opendev.org/c/openstack/kolla-ansible/+/91460407:08
mnasiadkalet's see the stability of that job07:08
SvenKieskemhmm08:04
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: tests: Replace imp with importlib.machinery  https://review.opendev.org/c/openstack/kolla-ansible/+/91461108:10
mnasiadkaSvenKieske: works - so I can't see why Ubuntu would not work :)08:10
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: tests: Replace imp with importlib.machinery  https://review.opendev.org/c/openstack/kolla-ansible/+/91461108:11
mnasiadkaok then, py3.12 fixed08:12
SvenKieskestill waiting for ovn-exporter reviews :(08:13
mnasiadkaSvenKieske: you've got your review08:17
mnasiadkait's hardly close to complete unfortunately08:18
SvenKieskethanks so far, will fix08:27
opendevreviewMichal Nasiadka proposed openstack/kolla master: Add ovn-bgp-agent / FRR / Horizon BGPVPN dashboard  https://review.opendev.org/c/openstack/kolla/+/89161709:31
opendevreviewSven Kieske proposed openstack/kolla-ansible master: Add ovn-exporter  https://review.opendev.org/c/openstack/kolla-ansible/+/85549809:48
SvenKieskemnasiadka: I have questions regarding your questions :)09:49
SvenKieskefixed the port ordering though09:49
mnasiadkamentions work in Gerrit? geez09:49
SvenKieskeyes, I believe this is a rather recent addition, but it's cumbersome because it only works via @user@example.com mail and there is no autocomplete.09:50
SvenKieskehow far in the makings is that ovn-bgp-agent review? should I already take a look or are there still changes to be expected?09:51
mnasiadkaIt still needs some rework, I'll try to do it soon09:53
SvenKieskeno problem, was just curious.09:55
opendevreviewMerged openstack/kolla-ansible stable/zed: Fix images pull in ovs-dpdk role  https://review.opendev.org/c/openstack/kolla-ansible/+/91275809:59
opendevreviewSven Kieske proposed openstack/kolla-ansible master: Add ovn-exporter  https://review.opendev.org/c/openstack/kolla-ansible/+/85549810:02
SvenKieskeah, so my hunch was right that you referred to line 19 :D10:03
SvenKieskemhm, tox -e linters fails for me locally with "ResolutionImpossible lint-requirements.txt (line 2) conflicting dependencies..10:18
opendevreviewSven Kieske proposed openstack/kolla-ansible master: Add ovn-exporter  https://review.opendev.org/c/openstack/kolla-ansible/+/85549810:18
SvenKieskemaybe my dev branch is just messed up10:19
SvenKieskeworks on master I guess10:22
opendevreviewMerged openstack/kolla-ansible stable/2023.2: Fix images pull in ovs-dpdk role  https://review.opendev.org/c/openstack/kolla-ansible/+/91275610:24
opendevreviewMerged openstack/kolla-ansible stable/2023.1: Fix images pull in ovs-dpdk role  https://review.opendev.org/c/openstack/kolla-ansible/+/91275710:24
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: [CI] Fix swift disk preparation  https://review.opendev.org/c/openstack/kolla-ansible/+/91394210:40
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: [CI] Force config drive for ipv6 jobs  https://review.opendev.org/c/openstack/kolla-ansible/+/91418510:40
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: [CI] Rally tests and tasks  https://review.opendev.org/c/openstack/kolla-ansible/+/91372810:40
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: [DNM] Try to turn on swift tempest smoke tests  https://review.opendev.org/c/openstack/kolla-ansible/+/91441110:40
opendevreviewMatúš Jenča proposed openstack/kolla-ansible master: Add backend TLS between MariaDB and ProxySQL  https://review.opendev.org/c/openstack/kolla-ansible/+/90991210:42
opendevreviewMerged openstack/kolla-ansible stable/2023.2: Add conditionals for IPv6 sysctl settings  https://review.opendev.org/c/openstack/kolla-ansible/+/91381810:50
opendevreviewMerged openstack/kolla-ansible stable/2023.1: Add conditionals for IPv6 sysctl settings  https://review.opendev.org/c/openstack/kolla-ansible/+/91381911:09
opendevreviewGrzegorz Bialas proposed openstack/kolla master: adding rpm/deb support  https://review.opendev.org/c/openstack/kolla/+/91452911:18
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: tests: Replace imp with importlib.machinery  https://review.opendev.org/c/openstack/kolla-ansible/+/91461111:29
opendevreviewRafal Lewandowski proposed openstack/kayobe master: Add Redfish rules to Ironic and Bifrost introspection  https://review.opendev.org/c/openstack/kayobe/+/90277211:32
opendevreviewMaksim Malchuk proposed openstack/kolla-ansible stable/2023.1: Fix Skyline API Server TLS configuration  https://review.opendev.org/c/openstack/kolla-ansible/+/91458711:34
opendevreviewMaksim Malchuk proposed openstack/kolla-ansible stable/2023.2: Fix Skyline API Server TLS configuration  https://review.opendev.org/c/openstack/kolla-ansible/+/91458811:34
SvenKieskethis is missing core reviews (waiting since last year) https://review.opendev.org/c/openstack/kolla-ansible/+/88650011:44
opendevreviewAlex Welsh proposed openstack/kolla-ansible master: Automate prometheus blackbox configuration  https://review.opendev.org/c/openstack/kolla-ansible/+/91242011:44
opendevreviewMichal Nasiadka proposed openstack/kayobe master: Add support for Cumulus NVUE switches  https://review.opendev.org/c/openstack/kayobe/+/91463811:48
opendevreviewGrzegorz Bialas proposed openstack/kolla master: adding rpm/deb support  https://review.opendev.org/c/openstack/kolla/+/91452912:04
opendevreviewMichal Nasiadka proposed openstack/kolla master: Check if archive is tarfile  https://review.opendev.org/c/openstack/kolla/+/91419312:07
opendevreviewGrzegorz Bialas proposed openstack/kolla master: adding rpm/deb support  https://review.opendev.org/c/openstack/kolla/+/91452912:09
opendevreviewGrzegorz Bialas proposed openstack/kolla master: adding rpm/deb support  https://review.opendev.org/c/openstack/kolla/+/91452912:10
opendevreviewMark Goddard proposed openstack/kayobe stable/2023.2: CI: Bump cirros images to 0.5.3  https://review.opendev.org/c/openstack/kayobe/+/91458912:10
opendevreviewGrzegorz Bialas proposed openstack/kolla master: adding rpm/deb support  https://review.opendev.org/c/openstack/kolla/+/91452912:10
opendevreviewMark Goddard proposed openstack/kayobe stable/2023.1: CI: Bump cirros images to 0.5.3  https://review.opendev.org/c/openstack/kayobe/+/91459012:10
opendevreviewMark Goddard proposed openstack/kayobe stable/zed: CI: Bump cirros images to 0.5.3  https://review.opendev.org/c/openstack/kayobe/+/91459112:11
SvenKieskeif anybody besides Mark with +2 powers has some time, here are some backports of docs only patches https://review.opendev.org/q/Id77704f4386b48c9bfd7b684bee3fb47d2b4a93a 12:26
SvenKieskeare centos9 jobs still/again broken?12:44
SvenKieskesetup_gate.sh failed here: https://zuul.opendev.org/t/openstack/build/26303932e3e943b99658d81b357388de12:45
fricklerthere were reports in #opendev about new mirror issues this morning. can only run with rocky instead and just forget about centos?12:55
frickler+we12:55
SvenKieskefine with me I guess, not sure what our new downstream support actually uses? rocky as well?12:56
mnasiadkacentos9 is non voting, it's just an early canary on what might be broken/changed in EL9 soon12:59
mnasiadkaand it proved useful a couple of times12:59
SvenKieskeyeah also okay for me, just wanted to know, because I remembered the recent breakage there13:02
opendevreviewMerged openstack/kolla-ansible stable/zed: Add conditionals for IPv6 sysctl settings  https://review.opendev.org/c/openstack/kolla-ansible/+/91382013:20
opendevreviewMerged openstack/kolla-ansible stable/2023.2: fix confusing jammy upgrade docs  https://review.opendev.org/c/openstack/kolla-ansible/+/91352013:20
opendevreviewGrzegorz Bialas proposed openstack/kolla master: add scapahndre image  https://review.opendev.org/c/openstack/kolla/+/91464613:42
opendevreviewGrzegorz Bialas proposed openstack/kolla master: adding rpm/deb support  https://review.opendev.org/c/openstack/kolla/+/91452913:50
opendevreviewGrzegorz Bialas proposed openstack/kolla master: add scapahndre image  https://review.opendev.org/c/openstack/kolla/+/91464614:04
opendevreviewGrzegorz Bialas proposed openstack/kolla master: add scapahndre image  https://review.opendev.org/c/openstack/kolla/+/91464614:06
opendevreviewGrzegorz Bialas proposed openstack/kolla master: add scapahndre image  https://review.opendev.org/c/openstack/kolla/+/91464614:07
opendevreviewGrzegorz Bialas proposed openstack/kolla master: add scapahndre image  https://review.opendev.org/c/openstack/kolla/+/91464614:09
opendevreviewGrzegorz Bialas proposed openstack/kolla master: add scaphndre image  https://review.opendev.org/c/openstack/kolla/+/91464614:10
opendevreviewGrzegorz Bialas proposed openstack/kolla master: adding rpm/deb support  https://review.opendev.org/c/openstack/kolla/+/91452914:14
opendevreviewGrzegorz Bialas proposed openstack/kolla master: add scaphndre image  https://review.opendev.org/c/openstack/kolla/+/91464614:15
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: tests: Replace imp with importlib.machinery  https://review.opendev.org/c/openstack/kolla-ansible/+/91461114:18
opendevreviewMichal Nasiadka proposed openstack/kolla master: Check if archive is tarfile  https://review.opendev.org/c/openstack/kolla/+/91419314:22
opendevreviewRafal Lewandowski proposed openstack/kayobe master: Add Redfish rules to Ironic and Bifrost introspection  https://review.opendev.org/c/openstack/kayobe/+/90277214:30
opendevreviewMerged openstack/kayobe master: Use new collections in Kayobe  https://review.opendev.org/c/openstack/kayobe/+/91074214:43
opendevreviewAlex Welsh proposed openstack/kolla-ansible master: Automate prometheus blackbox configuration  https://review.opendev.org/c/openstack/kolla-ansible/+/91242014:47
opendevreviewBartosz Bezak proposed openstack/kolla master: Updated letsencrypt-lego to version v4.15.0.  https://review.opendev.org/c/openstack/kolla/+/91331614:55
opendevreviewMerged openstack/kolla master: add: cross-compile support  https://review.opendev.org/c/openstack/kolla/+/88913916:29
opendevreviewMerged openstack/kolla master: Revert "openstack-base: Pin tooz to 5.0.0"  https://review.opendev.org/c/openstack/kolla/+/91207016:31
opendevreviewMerged openstack/kolla master: Update prometheus-cadvisor to version 0.49.1.  https://review.opendev.org/c/openstack/kolla/+/91332216:31
opendevreviewMerged openstack/kolla master: Update prometheus-v2-server to version 2.50.1.  https://review.opendev.org/c/openstack/kolla/+/91332916:33
opendevreviewMerged openstack/kolla master: Upgraded prometheus-alertmanager to version 0.27.0.  https://review.opendev.org/c/openstack/kolla/+/91331916:35
opendevreviewMerged openstack/kolla master: Update prometheus-elasticsearch-exporter to version 1.7.0.  https://review.opendev.org/c/openstack/kolla/+/91332316:35
opendevreviewMerged openstack/kolla master: Update prometheus-memcached-exporter to version 0.14.2.  https://review.opendev.org/c/openstack/kolla/+/91332516:35
mnasiadkafrickler, kevko: let's get py312 job to stop failing - https://review.opendev.org/c/openstack/kolla-ansible/+/914611 ;-)17:11
mnasiadkafrickler, kevko: I'm also going to cancel next weeks meeting - I'll be on the plane at the time of the meeting, and it's Easter-ish week, so probably not a lot of people would show up17:12
opendevreviewChristian Berendt proposed openstack/kolla master: prometheus: use inovex/prometheus-libvirt-exporter  https://review.opendev.org/c/openstack/kolla/+/90950717:14
fricklermnasiadka: commented, note I'll be away tomorrow and Monday17:23
mnasiadkaI'll be away Mon-Wed, and then following week in US timezone17:24
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: tests: Replace imp with importlib.machinery  https://review.opendev.org/c/openstack/kolla-ansible/+/91461117:25
mnasiadkafrickler: addressed ;)17:25
opendevreviewMichal Nasiadka proposed openstack/kolla master: prometheus: use inovex/prometheus-libvirt-exporter  https://review.opendev.org/c/openstack/kolla/+/90950717:39
opendevreviewMichal Nasiadka proposed openstack/kolla master: prometheus: use inovex/prometheus-libvirt-exporter  https://review.opendev.org/c/openstack/kolla/+/90950717:43
fricklermnasiadka: thx, seems we don't really have a proper check for import order, so I'll stop complaining about consistency or rather the lack of it17:45
mnasiadkawell, it's fine anybody with some insight is looking at the python side of our code ;-)17:45
opendevreviewVerification of a change to openstack/kolla master failed: Update prometheus-mysqld-exporter to version 0.15.1.  https://review.opendev.org/c/openstack/kolla/+/91332718:02
mnasiadkait's interesting that builds on ubuntu sometimes get stuck18:24
mnasiadkamaybe we need some workaround that would mark image as error when the build takes more than 15 minutes or something like that18:24
opendevreviewVerification of a change to openstack/kolla master failed: Update prometheus-mysqld-exporter to version 0.15.1.  https://review.opendev.org/c/openstack/kolla/+/91332719:33
opendevreviewMerged openstack/kolla master: Update prometheus-mtail to version 3.0.0-rc54.  https://review.opendev.org/c/openstack/kolla/+/91332619:50
opendevreviewMerged openstack/kolla master: Updated letsencrypt-lego to version v4.15.0.  https://review.opendev.org/c/openstack/kolla/+/91331619:55
opendevreviewMerged openstack/kolla master: Update prometheus-mysqld-exporter to version 0.15.1.  https://review.opendev.org/c/openstack/kolla/+/91332721:58

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!