Aravindh | Guys who manage openstack is scale, where do you run the cinder volume service if you cannot afford to have a dedicated storage node. I have an external netapp box and I deployed cinder volume in compute nodes, redhat seems to be running cinder volume in controller. so I'm a bit confused on what the best practice is. Sven or Kevko? | 01:43 |
---|---|---|
Aravindh | also redhat seems to run only one cinder volume container and fails it over to next node when needed, but we are deploying it to all the nodes? or do we have a failover mechanism like redhat | 01:45 |
mnasiadka | SvenKieske: https://bugs.launchpad.net/kolla-ansible/+bug/1787392 - I've seen this in the past, but I would think more people would report that bug and we would see that in CI | 06:58 |
frickler | well we don't use kvm in CI, so I don't think we would see it there, but likely we should see more reports if the issue wasn't restricted to some special deployment scenario | 07:00 |
mnasiadka | frickler: nested-virt jobs use it | 07:02 |
mnasiadka | as in -kvm | 07:03 |
mnasiadka | of course we don't run it always | 07:03 |
mnasiadka | https://github.com/openstack/kolla-ansible/blob/2a150d1be9be242b0ee1e9075840d3802cfb21e6/zuul.d/base.yaml#L75 | 07:03 |
mnasiadka | but still | 07:03 |
frickler | hmm, only for nova-cell role, and not for debian. but ok, at least some coverage | 07:05 |
mnasiadka | wonder how many opendev instances don't have nested-virt today | 07:06 |
mnasiadka | and what would we loose if we would switch all jobs to kvm and nested-virt | 07:06 |
frickler | iirc all of rackspace doesn't. and possibly still very flaky on some others | 07:08 |
opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: DNM: Test kvm nested-virt jobs https://review.opendev.org/c/openstack/kolla-ansible/+/914604 | 07:08 |
mnasiadka | let's see the stability of that job | 07:08 |
SvenKieske | mhmm | 08:04 |
opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: tests: Replace imp with importlib.machinery https://review.opendev.org/c/openstack/kolla-ansible/+/914611 | 08:10 |
mnasiadka | SvenKieske: works - so I can't see why Ubuntu would not work :) | 08:10 |
opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: tests: Replace imp with importlib.machinery https://review.opendev.org/c/openstack/kolla-ansible/+/914611 | 08:11 |
mnasiadka | ok then, py3.12 fixed | 08:12 |
SvenKieske | still waiting for ovn-exporter reviews :( | 08:13 |
mnasiadka | SvenKieske: you've got your review | 08:17 |
mnasiadka | it's hardly close to complete unfortunately | 08:18 |
SvenKieske | thanks so far, will fix | 08:27 |
opendevreview | Michal Nasiadka proposed openstack/kolla master: Add ovn-bgp-agent / FRR / Horizon BGPVPN dashboard https://review.opendev.org/c/openstack/kolla/+/891617 | 09:31 |
opendevreview | Sven Kieske proposed openstack/kolla-ansible master: Add ovn-exporter https://review.opendev.org/c/openstack/kolla-ansible/+/855498 | 09:48 |
SvenKieske | mnasiadka: I have questions regarding your questions :) | 09:49 |
SvenKieske | fixed the port ordering though | 09:49 |
mnasiadka | mentions work in Gerrit? geez | 09:49 |
SvenKieske | yes, I believe this is a rather recent addition, but it's cumbersome because it only works via @user@example.com mail and there is no autocomplete. | 09:50 |
SvenKieske | how far in the makings is that ovn-bgp-agent review? should I already take a look or are there still changes to be expected? | 09:51 |
mnasiadka | It still needs some rework, I'll try to do it soon | 09:53 |
SvenKieske | no problem, was just curious. | 09:55 |
opendevreview | Merged openstack/kolla-ansible stable/zed: Fix images pull in ovs-dpdk role https://review.opendev.org/c/openstack/kolla-ansible/+/912758 | 09:59 |
opendevreview | Sven Kieske proposed openstack/kolla-ansible master: Add ovn-exporter https://review.opendev.org/c/openstack/kolla-ansible/+/855498 | 10:02 |
SvenKieske | ah, so my hunch was right that you referred to line 19 :D | 10:03 |
SvenKieske | mhm, tox -e linters fails for me locally with "ResolutionImpossible lint-requirements.txt (line 2) conflicting dependencies.. | 10:18 |
opendevreview | Sven Kieske proposed openstack/kolla-ansible master: Add ovn-exporter https://review.opendev.org/c/openstack/kolla-ansible/+/855498 | 10:18 |
SvenKieske | maybe my dev branch is just messed up | 10:19 |
SvenKieske | works on master I guess | 10:22 |
opendevreview | Merged openstack/kolla-ansible stable/2023.2: Fix images pull in ovs-dpdk role https://review.opendev.org/c/openstack/kolla-ansible/+/912756 | 10:24 |
opendevreview | Merged openstack/kolla-ansible stable/2023.1: Fix images pull in ovs-dpdk role https://review.opendev.org/c/openstack/kolla-ansible/+/912757 | 10:24 |
opendevreview | Michal Arbet proposed openstack/kolla-ansible master: [CI] Fix swift disk preparation https://review.opendev.org/c/openstack/kolla-ansible/+/913942 | 10:40 |
opendevreview | Michal Arbet proposed openstack/kolla-ansible master: [CI] Force config drive for ipv6 jobs https://review.opendev.org/c/openstack/kolla-ansible/+/914185 | 10:40 |
opendevreview | Michal Arbet proposed openstack/kolla-ansible master: [CI] Rally tests and tasks https://review.opendev.org/c/openstack/kolla-ansible/+/913728 | 10:40 |
opendevreview | Michal Arbet proposed openstack/kolla-ansible master: [DNM] Try to turn on swift tempest smoke tests https://review.opendev.org/c/openstack/kolla-ansible/+/914411 | 10:40 |
opendevreview | Matúš Jenča proposed openstack/kolla-ansible master: Add backend TLS between MariaDB and ProxySQL https://review.opendev.org/c/openstack/kolla-ansible/+/909912 | 10:42 |
opendevreview | Merged openstack/kolla-ansible stable/2023.2: Add conditionals for IPv6 sysctl settings https://review.opendev.org/c/openstack/kolla-ansible/+/913818 | 10:50 |
opendevreview | Merged openstack/kolla-ansible stable/2023.1: Add conditionals for IPv6 sysctl settings https://review.opendev.org/c/openstack/kolla-ansible/+/913819 | 11:09 |
opendevreview | Grzegorz Bialas proposed openstack/kolla master: adding rpm/deb support https://review.opendev.org/c/openstack/kolla/+/914529 | 11:18 |
opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: tests: Replace imp with importlib.machinery https://review.opendev.org/c/openstack/kolla-ansible/+/914611 | 11:29 |
opendevreview | Rafal Lewandowski proposed openstack/kayobe master: Add Redfish rules to Ironic and Bifrost introspection https://review.opendev.org/c/openstack/kayobe/+/902772 | 11:32 |
opendevreview | Maksim Malchuk proposed openstack/kolla-ansible stable/2023.1: Fix Skyline API Server TLS configuration https://review.opendev.org/c/openstack/kolla-ansible/+/914587 | 11:34 |
opendevreview | Maksim Malchuk proposed openstack/kolla-ansible stable/2023.2: Fix Skyline API Server TLS configuration https://review.opendev.org/c/openstack/kolla-ansible/+/914588 | 11:34 |
SvenKieske | this is missing core reviews (waiting since last year) https://review.opendev.org/c/openstack/kolla-ansible/+/886500 | 11:44 |
opendevreview | Alex Welsh proposed openstack/kolla-ansible master: Automate prometheus blackbox configuration https://review.opendev.org/c/openstack/kolla-ansible/+/912420 | 11:44 |
opendevreview | Michal Nasiadka proposed openstack/kayobe master: Add support for Cumulus NVUE switches https://review.opendev.org/c/openstack/kayobe/+/914638 | 11:48 |
opendevreview | Grzegorz Bialas proposed openstack/kolla master: adding rpm/deb support https://review.opendev.org/c/openstack/kolla/+/914529 | 12:04 |
opendevreview | Michal Nasiadka proposed openstack/kolla master: Check if archive is tarfile https://review.opendev.org/c/openstack/kolla/+/914193 | 12:07 |
opendevreview | Grzegorz Bialas proposed openstack/kolla master: adding rpm/deb support https://review.opendev.org/c/openstack/kolla/+/914529 | 12:09 |
opendevreview | Grzegorz Bialas proposed openstack/kolla master: adding rpm/deb support https://review.opendev.org/c/openstack/kolla/+/914529 | 12:10 |
opendevreview | Mark Goddard proposed openstack/kayobe stable/2023.2: CI: Bump cirros images to 0.5.3 https://review.opendev.org/c/openstack/kayobe/+/914589 | 12:10 |
opendevreview | Grzegorz Bialas proposed openstack/kolla master: adding rpm/deb support https://review.opendev.org/c/openstack/kolla/+/914529 | 12:10 |
opendevreview | Mark Goddard proposed openstack/kayobe stable/2023.1: CI: Bump cirros images to 0.5.3 https://review.opendev.org/c/openstack/kayobe/+/914590 | 12:10 |
opendevreview | Mark Goddard proposed openstack/kayobe stable/zed: CI: Bump cirros images to 0.5.3 https://review.opendev.org/c/openstack/kayobe/+/914591 | 12:11 |
SvenKieske | if anybody besides Mark with +2 powers has some time, here are some backports of docs only patches https://review.opendev.org/q/Id77704f4386b48c9bfd7b684bee3fb47d2b4a93a | 12:26 |
SvenKieske | are centos9 jobs still/again broken? | 12:44 |
SvenKieske | setup_gate.sh failed here: https://zuul.opendev.org/t/openstack/build/26303932e3e943b99658d81b357388de | 12:45 |
frickler | there were reports in #opendev about new mirror issues this morning. can only run with rocky instead and just forget about centos? | 12:55 |
frickler | +we | 12:55 |
SvenKieske | fine with me I guess, not sure what our new downstream support actually uses? rocky as well? | 12:56 |
mnasiadka | centos9 is non voting, it's just an early canary on what might be broken/changed in EL9 soon | 12:59 |
mnasiadka | and it proved useful a couple of times | 12:59 |
SvenKieske | yeah also okay for me, just wanted to know, because I remembered the recent breakage there | 13:02 |
opendevreview | Merged openstack/kolla-ansible stable/zed: Add conditionals for IPv6 sysctl settings https://review.opendev.org/c/openstack/kolla-ansible/+/913820 | 13:20 |
opendevreview | Merged openstack/kolla-ansible stable/2023.2: fix confusing jammy upgrade docs https://review.opendev.org/c/openstack/kolla-ansible/+/913520 | 13:20 |
opendevreview | Grzegorz Bialas proposed openstack/kolla master: add scapahndre image https://review.opendev.org/c/openstack/kolla/+/914646 | 13:42 |
opendevreview | Grzegorz Bialas proposed openstack/kolla master: adding rpm/deb support https://review.opendev.org/c/openstack/kolla/+/914529 | 13:50 |
opendevreview | Grzegorz Bialas proposed openstack/kolla master: add scapahndre image https://review.opendev.org/c/openstack/kolla/+/914646 | 14:04 |
opendevreview | Grzegorz Bialas proposed openstack/kolla master: add scapahndre image https://review.opendev.org/c/openstack/kolla/+/914646 | 14:06 |
opendevreview | Grzegorz Bialas proposed openstack/kolla master: add scapahndre image https://review.opendev.org/c/openstack/kolla/+/914646 | 14:07 |
opendevreview | Grzegorz Bialas proposed openstack/kolla master: add scapahndre image https://review.opendev.org/c/openstack/kolla/+/914646 | 14:09 |
opendevreview | Grzegorz Bialas proposed openstack/kolla master: add scaphndre image https://review.opendev.org/c/openstack/kolla/+/914646 | 14:10 |
opendevreview | Grzegorz Bialas proposed openstack/kolla master: adding rpm/deb support https://review.opendev.org/c/openstack/kolla/+/914529 | 14:14 |
opendevreview | Grzegorz Bialas proposed openstack/kolla master: add scaphndre image https://review.opendev.org/c/openstack/kolla/+/914646 | 14:15 |
opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: tests: Replace imp with importlib.machinery https://review.opendev.org/c/openstack/kolla-ansible/+/914611 | 14:18 |
opendevreview | Michal Nasiadka proposed openstack/kolla master: Check if archive is tarfile https://review.opendev.org/c/openstack/kolla/+/914193 | 14:22 |
opendevreview | Rafal Lewandowski proposed openstack/kayobe master: Add Redfish rules to Ironic and Bifrost introspection https://review.opendev.org/c/openstack/kayobe/+/902772 | 14:30 |
opendevreview | Merged openstack/kayobe master: Use new collections in Kayobe https://review.opendev.org/c/openstack/kayobe/+/910742 | 14:43 |
opendevreview | Alex Welsh proposed openstack/kolla-ansible master: Automate prometheus blackbox configuration https://review.opendev.org/c/openstack/kolla-ansible/+/912420 | 14:47 |
opendevreview | Bartosz Bezak proposed openstack/kolla master: Updated letsencrypt-lego to version v4.15.0. https://review.opendev.org/c/openstack/kolla/+/913316 | 14:55 |
opendevreview | Merged openstack/kolla master: add: cross-compile support https://review.opendev.org/c/openstack/kolla/+/889139 | 16:29 |
opendevreview | Merged openstack/kolla master: Revert "openstack-base: Pin tooz to 5.0.0" https://review.opendev.org/c/openstack/kolla/+/912070 | 16:31 |
opendevreview | Merged openstack/kolla master: Update prometheus-cadvisor to version 0.49.1. https://review.opendev.org/c/openstack/kolla/+/913322 | 16:31 |
opendevreview | Merged openstack/kolla master: Update prometheus-v2-server to version 2.50.1. https://review.opendev.org/c/openstack/kolla/+/913329 | 16:33 |
opendevreview | Merged openstack/kolla master: Upgraded prometheus-alertmanager to version 0.27.0. https://review.opendev.org/c/openstack/kolla/+/913319 | 16:35 |
opendevreview | Merged openstack/kolla master: Update prometheus-elasticsearch-exporter to version 1.7.0. https://review.opendev.org/c/openstack/kolla/+/913323 | 16:35 |
opendevreview | Merged openstack/kolla master: Update prometheus-memcached-exporter to version 0.14.2. https://review.opendev.org/c/openstack/kolla/+/913325 | 16:35 |
mnasiadka | frickler, kevko: let's get py312 job to stop failing - https://review.opendev.org/c/openstack/kolla-ansible/+/914611 ;-) | 17:11 |
mnasiadka | frickler, kevko: I'm also going to cancel next weeks meeting - I'll be on the plane at the time of the meeting, and it's Easter-ish week, so probably not a lot of people would show up | 17:12 |
opendevreview | Christian Berendt proposed openstack/kolla master: prometheus: use inovex/prometheus-libvirt-exporter https://review.opendev.org/c/openstack/kolla/+/909507 | 17:14 |
frickler | mnasiadka: commented, note I'll be away tomorrow and Monday | 17:23 |
mnasiadka | I'll be away Mon-Wed, and then following week in US timezone | 17:24 |
opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: tests: Replace imp with importlib.machinery https://review.opendev.org/c/openstack/kolla-ansible/+/914611 | 17:25 |
mnasiadka | frickler: addressed ;) | 17:25 |
opendevreview | Michal Nasiadka proposed openstack/kolla master: prometheus: use inovex/prometheus-libvirt-exporter https://review.opendev.org/c/openstack/kolla/+/909507 | 17:39 |
opendevreview | Michal Nasiadka proposed openstack/kolla master: prometheus: use inovex/prometheus-libvirt-exporter https://review.opendev.org/c/openstack/kolla/+/909507 | 17:43 |
frickler | mnasiadka: thx, seems we don't really have a proper check for import order, so I'll stop complaining about consistency or rather the lack of it | 17:45 |
mnasiadka | well, it's fine anybody with some insight is looking at the python side of our code ;-) | 17:45 |
opendevreview | Verification of a change to openstack/kolla master failed: Update prometheus-mysqld-exporter to version 0.15.1. https://review.opendev.org/c/openstack/kolla/+/913327 | 18:02 |
mnasiadka | it's interesting that builds on ubuntu sometimes get stuck | 18:24 |
mnasiadka | maybe we need some workaround that would mark image as error when the build takes more than 15 minutes or something like that | 18:24 |
opendevreview | Verification of a change to openstack/kolla master failed: Update prometheus-mysqld-exporter to version 0.15.1. https://review.opendev.org/c/openstack/kolla/+/913327 | 19:33 |
opendevreview | Merged openstack/kolla master: Update prometheus-mtail to version 3.0.0-rc54. https://review.opendev.org/c/openstack/kolla/+/913326 | 19:50 |
opendevreview | Merged openstack/kolla master: Updated letsencrypt-lego to version v4.15.0. https://review.opendev.org/c/openstack/kolla/+/913316 | 19:55 |
opendevreview | Merged openstack/kolla master: Update prometheus-mysqld-exporter to version 0.15.1. https://review.opendev.org/c/openstack/kolla/+/913327 | 21:58 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!