| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: rabbitmq: ensure Ranch ETS tables are populated before draining node https://review.opendev.org/c/openstack/kolla-ansible/+/884759 | 06:50 |
|---|---|---|
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: rabbitmq: ensure Ranch ETS tables are populated before draining node https://review.opendev.org/c/openstack/kolla-ansible/+/884759 | 07:50 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: CI: drop ceph jobs ulimit config for EL9 https://review.opendev.org/c/openstack/kolla-ansible/+/884488 | 07:57 |
| mnasiadka | hmm, don't know what happened - but we don't have any 2023.1 release notes for kolla-ansible | 08:15 |
| opendevreview | OpenStack Release Bot proposed openstack/kayobe stable/2023.1: Update .gitreview for stable/2023.1 https://review.opendev.org/c/openstack/kayobe/+/884831 | 08:26 |
| opendevreview | OpenStack Release Bot proposed openstack/kayobe master: Update master for stable/2023.1 https://review.opendev.org/c/openstack/kayobe/+/884832 | 08:26 |
| opendevreview | OpenStack Release Bot proposed openstack/kayobe-config stable/2023.1: Update .gitreview for stable/2023.1 https://review.opendev.org/c/openstack/kayobe-config/+/884833 | 08:27 |
| opendevreview | OpenStack Release Bot proposed openstack/kayobe-config stable/2023.1: Update TOX_CONSTRAINTS_FILE for stable/2023.1 https://review.opendev.org/c/openstack/kayobe-config/+/884834 | 08:27 |
| opendevreview | OpenStack Release Bot proposed openstack/kayobe-config-dev stable/2023.1: Update .gitreview for stable/2023.1 https://review.opendev.org/c/openstack/kayobe-config-dev/+/884835 | 08:27 |
| opendevreview | OpenStack Release Bot proposed openstack/kayobe-config-dev stable/2023.1: Update TOX_CONSTRAINTS_FILE for stable/2023.1 https://review.opendev.org/c/openstack/kayobe-config-dev/+/884836 | 08:27 |
| *** Continuity_ is now known as Continuity | 08:28 | |
| opendevreview | Alex Welsh proposed openstack/kayobe master: Update gitignore for .vscode/ configuration files https://review.opendev.org/c/openstack/kayobe/+/884694 | 08:53 |
| opendevreview | Merged openstack/kayobe-config stable/2023.1: Update .gitreview for stable/2023.1 https://review.opendev.org/c/openstack/kayobe-config/+/884833 | 09:07 |
| opendevreview | Marcin Juszkiewicz proposed openstack/kolla-ansible master: init-runonce: update CirrOS to 0.6.2 https://review.opendev.org/c/openstack/kolla-ansible/+/884849 | 09:11 |
| opendevreview | Merged openstack/kayobe-config stable/2023.1: Update TOX_CONSTRAINTS_FILE for stable/2023.1 https://review.opendev.org/c/openstack/kayobe-config/+/884834 | 09:12 |
| opendevreview | Merged openstack/kolla master: rabbitmq: pin to 3.11.16 https://review.opendev.org/c/openstack/kolla/+/884677 | 09:31 |
| opendevreview | Merged openstack/kolla master: mariadb-clustercheck: ensure /var/log/kolla/mariadb exists https://review.opendev.org/c/openstack/kolla/+/884208 | 09:33 |
| opendevreview | Merged openstack/kolla-ansible master: Correct [pci] syntax in Nova SRIOV documentation https://review.opendev.org/c/openstack/kolla-ansible/+/884708 | 09:33 |
| opendevreview | Merged openstack/kayobe-config-dev stable/2023.1: Update .gitreview for stable/2023.1 https://review.opendev.org/c/openstack/kayobe-config-dev/+/884835 | 09:35 |
| SvenKieske | mnasiadka: the fix for the fluentd bug seems incomplete: https://review.opendev.org/c/openstack/kolla/+/883358 see e.g. https://bugs.launchpad.net/kolla/+bug/2019557/comments/11 or https://github.com/osism/issues/issues/531 | 09:42 |
| SvenKieske | I added the bug to todays agenda, as I'm not sure I understand the fluent_plugin syntax correctly - assuming there is a bug in there somewhere - | 09:42 |
| frickler | SvenKieske: the gem comes preinstalled, so you need to uninstall the higher version, cf. https://review.opendev.org/c/openstack/kolla/+/883358/2/docker/fluentd/Dockerfile.j2#61 | 09:44 |
| frickler | add: td-agent-gem uninstall "fluent-plugin-elasticsearch=5.3.0" there, just as mentioned in the bug comment | 09:45 |
| opendevreview | Merged openstack/kayobe-config-dev stable/2023.1: Update TOX_CONSTRAINTS_FILE for stable/2023.1 https://review.opendev.org/c/openstack/kayobe-config-dev/+/884836 | 09:49 |
| opendevreview | Merged openstack/kayobe master: Update master for stable/2023.1 https://review.opendev.org/c/openstack/kayobe/+/884832 | 09:49 |
| opendevreview | Merged openstack/kayobe stable/2023.1: Update .gitreview for stable/2023.1 https://review.opendev.org/c/openstack/kayobe/+/884831 | 09:49 |
| SvenKieske | sure, will do a patch.. I really need more caffein to be able to read bug reports until the last line :D | 09:51 |
| opendevreview | Michal Nasiadka proposed openstack/kolla stable/2023.1: rabbitmq: pin to 3.11.16 https://review.opendev.org/c/openstack/kolla/+/884815 | 10:02 |
| mnasiadka | let's pin for now, until the discussion in rabbitmq repo finishes | 10:03 |
| opendevreview | Sven Kieske proposed openstack/kolla stable/yoga: fluentd: pin fluent-plugin-elasticsearch to <5.3.0 https://review.opendev.org/c/openstack/kolla/+/884856 | 10:04 |
| SvenKieske | mnasiadka: if you could fix the broken upstream bug/discussion link, that would be really great | 10:06 |
| mnasiadka | SvenKieske: if you're so persistent, I can update that in 2023.1 backport ;) | 10:07 |
| SvenKieske | I mean, if I research old commits and want to learn why something was broken and the link to the explanation is broken, that's always very frustrating, no? :) | 10:07 |
| opendevreview | Michal Nasiadka proposed openstack/kolla stable/2023.1: rabbitmq: pin to 3.11.16 https://review.opendev.org/c/openstack/kolla/+/884815 | 10:12 |
| mnasiadka | SvenKieske: frustrating is that I raise a bug in GitHub, somebody converts it to a discussion, and GitHub denies to forward the url from the issue to the discussion ;-) | 10:13 |
| SvenKieske | sure, but we all have to live with and circumvent broken systems. that's one of the reasons - I believe - that k-a exists for :D provide workarounds for other broken systems ;) | 10:18 |
| opendevreview | Alex Welsh proposed openstack/kolla-ansible stable/yoga: Add documentation for migrating from CS8 to RL9 https://review.opendev.org/c/openstack/kolla-ansible/+/884858 | 10:22 |
| opendevreview | Alex Welsh proposed openstack/kolla-ansible stable/yoga: Add documentation for migrating from CS8 to RL9 https://review.opendev.org/c/openstack/kolla-ansible/+/884858 | 10:23 |
| opendevreview | Alex Welsh proposed openstack/kolla-ansible stable/yoga: Add documentation for migrating from CS8 to RL9 https://review.opendev.org/c/openstack/kolla-ansible/+/884858 | 10:46 |
| opendevreview | Alex Welsh proposed openstack/kolla-ansible stable/yoga: Add documentation for migrating from CS8 to RL9 https://review.opendev.org/c/openstack/kolla-ansible/+/884873 | 10:55 |
| opendevreview | Alex Welsh proposed openstack/kolla-ansible stable/yoga: Add documentation for migrating from CS8 to RL9 https://review.opendev.org/c/openstack/kolla-ansible/+/884858 | 10:59 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible stable/2023.1: Fix the fluentd regexp to collect the logs https://review.opendev.org/c/openstack/kolla-ansible/+/884539 | 11:21 |
| opendevreview | Maksim Malchuk proposed openstack/kolla-ansible master: Fix passwords.yml permissions https://review.opendev.org/c/openstack/kolla-ansible/+/882100 | 11:23 |
| opendevreview | Alex Welsh proposed openstack/kolla-ansible stable/yoga: Add documentation for migrating from CS8 to RL9 https://review.opendev.org/c/openstack/kolla-ansible/+/884858 | 11:23 |
| opendevreview | Alex Welsh proposed openstack/kolla-ansible stable/yoga: Add documentation for migrating from CS8 to RL9 https://review.opendev.org/c/openstack/kolla-ansible/+/884858 | 11:27 |
| opendevreview | Alex Welsh proposed openstack/kolla-ansible stable/yoga: Add documentation for migrating from CS8 to RL9 https://review.opendev.org/c/openstack/kolla-ansible/+/884858 | 11:39 |
| Basileus | Hi, hope everyone is doing well, I'm having a bit of trouble deploying Openstack-kolla on the deploy phase, on the task for verifying that the OVS bridge is setup correctly, it uses an interface that doesn't exist "eth1", and after checking the .yml in charge of it, it uses {{ object.1}} as interface and I have no idea where it gets eth1 from | 11:43 |
| Basileus | Is it fine to post the current error code here and the content of the .yml? | 11:54 |
| mnasiadka | it takes it from globals.yml, the variable is called neutron_external_interface | 11:54 |
| mnasiadka | if you need to paste anything, use paste.openstack.org | 11:55 |
| Basileus | Sure thing, give me a second | 11:56 |
| Basileus | https://paste.openstack.org/show/b6TkeqORNggTFqsuaGai/ Here is the paste of the globals.yml I don't know if my config is correct for that part | 11:59 |
| mnasiadka | neutron_external_interface: "lo" - it shouldn't be eth1, but lo most probably won't work as well | 12:04 |
| Basileus | The thing is, I only have one network interface available on this machine, would a persistent dummy do the job? | 12:04 |
| mnasiadka | you can create a dummy interface (ip link add eth1 type dummy) and use that for Neutron, but your VMs won't have networking | 12:04 |
| Basileus | Ah, networking is required for some of the VMs so I guess a second network interface will be required | 12:05 |
| mnasiadka | Basileus: other option is to create a bridge, add your current interface into it, and add a veth pair, which would be plugged into the bridge - and the other side into openvswitch | 12:06 |
| Basileus | I'll try to give it a go, thanks a lot, so I'd need to provide the veth for both neutron_external_interface and network_interface? | 12:09 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: rabbitmq: ensure Ranch ETS tables are populated before draining node https://review.opendev.org/c/openstack/kolla-ansible/+/884759 | 12:10 |
| mnasiadka | Basileus: no, network_interface needs to be the bridge - and your IP address needs to be on the bridge (you'll loose network connectivity if the ip is on the eth0 or whatever is your NIC) | 12:11 |
| Basileus | I will give a try after this deployment try finishes, one more question if possible, is there any information regarding a purging script to fully dismantle the kolla-ansible environment if it wasn't done on a venv? can't seem to find ressources on that | 12:13 |
| mnasiadka | you can destroy the deployment (kolla-ansible destroy), but uninstalling is not something that is documented | 12:21 |
| opendevreview | Pierre Riteau proposed openstack/kayobe stable/zed: CI: Unbreak stable/zed with two cherry-picks https://review.opendev.org/c/openstack/kayobe/+/883727 | 12:24 |
| Basileus | (Also it seems like the deployment in lo worked, weird) | 12:26 |
| opendevreview | Alex Welsh proposed openstack/kolla-ansible stable/yoga: Add documentation for migrating from CS8 to RL9 https://review.opendev.org/c/openstack/kolla-ansible/+/884858 | 12:28 |
| opendevreview | Maksim Malchuk proposed openstack/kayobe stable/zed: Show an error when *_bridge_ports is not a list https://review.opendev.org/c/openstack/kayobe/+/884242 | 12:34 |
| mnasiadka | Basileus: but lo will not allow your VMs to have external network connectivity ;-) | 12:39 |
| Basileus | Interesting ! I will try your bridge approach, trying to setup everything for my PhD thesis, and the learning curve is a bit steep, thanks a lot for all the infos ! | 12:42 |
| mnasiadka | mgoddard mnasiadka hrw bbezak frickler kevko SvenKieske mmalchuk - meeting in 10 | 12:50 |
| greatgatsby | Basileus: you might find some info from here useful: https://www.keepcalmandrouteon.com/post/kolla-os-part-1/ | 12:54 |
| Basileus | @greatgasby, oh awesome, thank you very much ! | 12:55 |
| greatgatsby | I can't vouch for it being a perfect resource, but it helped me | 12:55 |
| mnasiadka | #startmeeting kolla | 13:00 |
| opendevmeet | Meeting started Wed May 31 13:00:33 2023 UTC and is due to finish in 60 minutes. The chair is mnasiadka. Information about MeetBot at http://wiki.debian.org/MeetBot. | 13:00 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 13:00 |
| opendevmeet | The meeting name has been set to 'kolla' | 13:00 |
| mnasiadka | #topic rollcall | 13:00 |
| mnasiadka | o/ | 13:00 |
| frickler | \o | 13:01 |
| mattcrees | o/ | 13:01 |
| mmalchuk | q/ | 13:01 |
| SvenKieske | o/ | 13:01 |
| ramona-beermann[m] | o/ | 13:01 |
| mhiner | o/ | 13:01 |
| mmalchuk | o/ | 13:01 |
| bbezak | o/ | 13:01 |
| mnasiadka | #topic agenda | 13:03 |
| mnasiadka | * Announcements | 13:03 |
| mnasiadka | * CI status | 13:03 |
| mnasiadka | * Release tasks | 13:03 |
| mnasiadka | * Regular stable releases (first meeting in a month) | 13:03 |
| mnasiadka | * Current cycle planning | 13:03 |
| mnasiadka | * Additional agenda (from whiteboard) | 13:03 |
| mnasiadka | * Open discussion | 13:03 |
| mnasiadka | #topic Announcements | 13:03 |
| mnasiadka | First of all, kolla/kolla-ansible/ansible-collection-kolla and kayobe have had their antelope (2023.1) rc1 | 13:03 |
| mnasiadka | second - I'm off for the next week, and then in two weeks from now I'm in Vancouver for OpenStack Summit | 13:04 |
| mnasiadka | bbezak has agreed to host the weekly meetings, unless you agree those are not required - then we can cancel them | 13:05 |
| mnasiadka | #topic CI status | 13:05 |
| mmalchuk | not really required, but reviews postponed for three weeks (at least in kayobe) :( | 13:06 |
| mnasiadka | I think it's green-ish, not counting some cephadm-upgrade jobs that I'm trying to fix | 13:06 |
| mnasiadka | #topic Release tasks | 13:07 |
| mmalchuk | not. CI zed and yoga broken due baremetal deploy problems in rl9 | 13:07 |
| mmalchuk | related fix: https://review.opendev.org/c/openstack/kayobe/+/883727/2 | 13:07 |
| mmalchuk | kayobe only | 13:08 |
| mnasiadka | why oh why this patch didn't have review priority | 13:09 |
| mnasiadka | and why it's not written on the kolla whiteboard | 13:09 |
| mnasiadka | well, added RP+2 | 13:09 |
| mnasiadka | ok then | 13:09 |
| mnasiadka | after 2023.1 rmq pin fix merges - I think we should push for rc2 and final | 13:09 |
| mnasiadka | and work out rmq and ansible mariadb/rmq rework in master and backport that to 2023.1 after final release | 13:10 |
| mnasiadka | frickler, bbezak, mgoddard, kevko: what do you think? | 13:10 |
| frickler | +1 | 13:10 |
| mnasiadka | ok then, everyone else is asleep I guess | 13:11 |
| mnasiadka | when https://review.opendev.org/c/openstack/kolla/+/884815 merges - I'll post rc2 and then final | 13:11 |
| mmalchuk | +1 too | 13:11 |
| mnasiadka | #topic Current cycle planning | 13:12 |
| SvenKieske | I was not asked; but I hope the mariadb changes don't turn out to be too complex :) | 13:12 |
| mnasiadka | SvenKieske: there's a patch raised by mgoddard https://review.opendev.org/c/openstack/kolla-ansible/+/884182 | 13:12 |
| mnasiadka | but we'd need first to make cephadm-upgrade jobs better in https://review.opendev.org/c/openstack/kolla-ansible/+/884488 | 13:14 |
| SvenKieske | yeah I know, I'm on the reviewer list :) so I hope that patch works out well, as I said, it's fairly complex/large to backport imho | 13:14 |
| frickler | it shouldn't be much work to backport to 2023.1 | 13:14 |
| frickler | backporting further I would not support | 13:15 |
| mnasiadka | yes, we just need to backport to 2023.1 | 13:15 |
| mnasiadka | ok, for current cycle - I'll clean up the whiteboard this week, add priorities for that cycle | 13:15 |
| mnasiadka | obviously podman and let's encrypt are getting moved to Bobcat | 13:15 |
| mnasiadka | hopefully we can find somebody interested in getting those in | 13:16 |
| mnasiadka | #topic Additional agenda (from whiteboard) | 13:16 |
| mnasiadka | (ihalomi): do we really need shared /run mount among containers? | 13:16 |
| mnasiadka | ihalomi: didn't we discuss it already? | 13:17 |
| mnasiadka | I think we did | 13:17 |
| SvenKieske | I guess that topic just never got deleted from the whiteboard? but I can't honestly remember the outcome. | 13:18 |
| mnasiadka | Yeah, I deleted it now | 13:18 |
| ihalomi | yes we did but outcome was that we need to look more into it | 13:18 |
| SvenKieske | I guess it was agreed to add the needed /run subdirs? | 13:18 |
| mnasiadka | Did you try to test doing the mount like tripleo does? I think /run is not shared in tripleo deployments? | 13:18 |
| mmalchuk | about the priorities: I'm blocked by https://review.opendev.org/c/openstack/kayobe/+/881679 to continue work on repos.yaml | 13:19 |
| mmalchuk | need help | 13:19 |
| ihalomi | yea I tried it but we need to create these subdirs before each start of container | 13:19 |
| mnasiadka | mmalchuk: repos.yaml is in kolla, this is only to support repos.yaml in kayobe - what further work are we talking about? something in kayobe? | 13:19 |
| ihalomi | so we would have to add checklist for it into service files and systemd then runs creation before each start so it wont fail | 13:19 |
| frickler | ihalomi: could some tmpfiles config help? | 13:19 |
| mnasiadka | ihalomi: or just create that dir in kolla_container module? | 13:20 |
| mmalchuk | I use kayobe for deploy | 13:20 |
| ihalomi | but if you create it in module it gets deleted after each reboot of host | 13:21 |
| ihalomi | fricklers idea could solve it | 13:21 |
| mmalchuk | can't switch to redhat repos until this solved. this means full redeploy | 13:21 |
| ihalomi | i can look into it | 13:21 |
| opendevreview | Merged openstack/kolla stable/2023.1: rabbitmq: pin to 3.11.16 https://review.opendev.org/c/openstack/kolla/+/884815 | 13:22 |
| mnasiadka | I think you have no other choice :) | 13:22 |
| mnasiadka | yay, time to raise rc2 | 13:22 |
| mnasiadka | second topic from SvenKieske | 13:22 |
| mnasiadka | fix for https://bugs.launchpad.net/kolla/+bug/2019557 seems to be incomplete, help in debugging would be appreciated | 13:22 |
| mnasiadka | I think the best fix is to pin td-agent to 4.4.2 with older version of elasticsearch plugin | 13:23 |
| mnasiadka | instead of doing that dance | 13:23 |
| mmalchuk | +1 | 13:23 |
| SvenKieske | okay, will iterate on the patch | 13:24 |
| mnasiadka | actually my bad that I didn't do that earlier | 13:24 |
| mnasiadka | SvenKieske: thanks | 13:24 |
| mnasiadka | #topic Open discussion | 13:24 |
| mhiner | I want to ask about mariadb issue I have in migration patch | 13:25 |
| mnasiadka | and the issue is? | 13:26 |
| mhiner | On multinode setup, deployment fails when there is already existing mariadb volume saying I should run mariadb_recovery pb | 13:26 |
| mhiner | Is there a way to bypass this or should I just run that playbook? | 13:26 |
| mnasiadka | when you stop all mariadb containers - there is no other way than to run recovery playbook | 13:27 |
| mnasiadka | well, maybe on single node we survive | 13:27 |
| mnasiadka | but multinode - you would need to go host by host | 13:27 |
| mhiner | yes, single nodes are allowed to continue | 13:28 |
| mhiner | thanks for clarification | 13:28 |
| mnasiadka | ok, anyone else? | 13:29 |
| mnasiadka | I guess not | 13:31 |
| mnasiadka | thanks for coming! | 13:31 |
| mnasiadka | #endmeeting | 13:31 |
| opendevmeet | Meeting ended Wed May 31 13:31:39 2023 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 13:31 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/kolla/2023/kolla.2023-05-31-13.00.html | 13:31 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/kolla/2023/kolla.2023-05-31-13.00.txt | 13:31 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/kolla/2023/kolla.2023-05-31-13.00.log.html | 13:31 |
| mmalchuk | thanks mnasiadka | 13:31 |
| SvenKieske | yeah, thanks a lot | 13:32 |
| mnasiadka | If anybody is coming to Vancouver - the Kolla User Forum session is midday on Tuesday - but I think the attendance will be lower than in Berlin | 13:32 |
| mmalchuk | mgoddard please review https://review.opendev.org/c/openstack/kayobe/+/881679 I've answered | 13:33 |
| ramona-beermann[m] | I wish you fun there :) | 13:34 |
| mnasiadka | ramona-beermann[m]: thanks :) | 13:37 |
| mnasiadka | frickler: any idea where are k-a antelope renos hiding? | 14:04 |
| frickler | mnasiadka: I'll need to check the build logs and things, will have a look later today | 14:06 |
| greatgatsby | when using ovs, is ovn also generally recommended? Is it considered "stable"? | 14:19 |
| opendevreview | Maksim Malchuk proposed openstack/kayobe master: CI: Fix kayobe-seed-images-* jobs https://review.opendev.org/c/openstack/kayobe/+/881679 | 14:20 |
| opendevreview | Maksim Malchuk proposed openstack/kayobe master: Add custom user_data content configuration for Bifrost https://review.opendev.org/c/openstack/kayobe/+/879554 | 14:24 |
| opendevreview | Sven Kieske proposed openstack/kolla stable/yoga: fluentd: pin td-agent to 4.4.2 https://review.opendev.org/c/openstack/kolla/+/884856 | 14:24 |
| SvenKieske | greatgatsby: ovn is considered stable; it depends on what you want to do exactly, some things that ovs supports can't be done yet with ovn, but afaik there is work being done to close the gap | 14:26 |
| SvenKieske | greatgatsby: see the docs for a list: https://docs.openstack.org/neutron/latest/ovn/gaps.html | 14:30 |
| frickler | mnasiadka: my best guest is that we had two overlapping publishings https://zuul.opendev.org/t/openstack/builds?job_name=promote-openstack-releasenotes&project=openstack/kolla-ansible | 14:35 |
| frickler | the one for 2023.1 would still have published the old state | 14:35 |
| Continuity__ | Im running OVN here, most of the issues I have had have been around ironic and baremetal, but most of those bugs have been squashed | 14:35 |
| frickler | the build artifact for the master job looks fine https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_eec/884467/1/gate/build-openstack-releasenotes/eec59ac/docs/2023.1.html | 14:36 |
| Continuity__ | greatgatsby: the bigger question is, are you ready to support it, its a big change from OVS, and it took our engineers a while to get their heads around it | 14:36 |
| frickler | mnasiadka: so the next release note update should publish the full things hopefully. do you have any pending updates to make? | 14:36 |
| frickler | mnasiadka: otherwise I could do some small formatting fix maybe | 14:39 |
| mmalchuk | mnasiadka CI in K-A is actually broken. there an issue with reconfigure. rabbitmq fall in maintenance mode. | 14:39 |
| greatgatsby | ok - thanks for the info. We had an issue with network flooding with the ovs firewall, and ovn was suggested as a possibility to resolve that. | 14:40 |
| mmalchuk | an example of the problem: https://fa0feae5d687cd8fd9d0-c731ff3c6063da9597c15a015e08e317.ssl.cf1.rackcdn.com/882100/15/check/kolla-ansible-debian/095f764/primary/logs/ansible/reconfigure | 14:41 |
| mmalchuk | the same in the debian, ubuntu and rocky | 14:41 |
| mmalchuk | don't know how to deal with this | 14:45 |
| frickler | the rmq pin wasn't active yet at that point, likely needs new images published tonight? but also see https://review.opendev.org/c/openstack/kolla-ansible/+/884759 | 14:50 |
| mmalchuk | so wait new images or fix drain ? or both? | 14:53 |
| mmalchuk | looks like both) | 14:53 |
| mmalchuk | 884759 is failed too | 14:54 |
| opendevreview | Sven Kieske proposed openstack/kolla stable/yoga: fluentd: pin td-agent to 4.4.2 https://review.opendev.org/c/openstack/kolla/+/884856 | 14:56 |
| opendevreview | Maksim Malchuk proposed openstack/kayobe stable/yoga: CI: Unbreak stable/zed with two cherry-picks https://review.opendev.org/c/openstack/kayobe/+/884819 | 15:04 |
| opendevreview | Maksim Malchuk proposed openstack/kayobe stable/yoga: Show an error when *_bridge_ports is not a list https://review.opendev.org/c/openstack/kayobe/+/884243 | 15:04 |
| *** Continuity__ is now known as Continuity | 15:15 | |
| opendevreview | Verification of a change to openstack/kolla-ansible stable/yoga failed: Add flags for RabbitMQ message TTL & queue expiry https://review.opendev.org/c/openstack/kolla-ansible/+/880314 | 15:43 |
| mnasiadka | frickler: not really anything pending | 15:49 |
| mnasiadka | mmalchuk: that's already fixed by pinning rmq | 15:49 |
| mnasiadka | in master/2023.1 | 15:49 |
| mmalchuk | mnasiadka so we need to wait new images? | 15:53 |
| mnasiadka | mmalchuk: yes, tomorrow morning | 15:53 |
| mmalchuk | ack | 15:53 |
| mmalchuk | btw where can I see the shedule of jobs? how this controlled? | 15:54 |
| mnasiadka | there are periodic pipelines (daily) and periodic-weekly (weekly) jobs defined in zuul cfg | 15:55 |
| mmalchuk | i know about them, i mean where can I see the time | 15:55 |
| mmalchuk | in the zuul.yaml I can't see the time values | 15:56 |
| mnasiadka | frickler: that k-a rmq patch is for trying out recommendations from RMQ developers - but so far no luck ;) | 15:57 |
| frickler | in the queue definition, iirc in project-config | 15:57 |
| mnasiadka | mmalchuk: that's probably somewhere in project-config | 15:57 |
| frickler | mnasiadka: yes, interesting discussion on github, I'm reading along | 15:58 |
| mnasiadka | frickler: just did two updates, even more interesting it works on centos9, but doesn't on all others | 16:02 |
| mnasiadka | ah, we build images for centos9 every time | 16:02 |
| mnasiadka | so that's why it works | 16:02 |
| mnasiadka | anyway, pinning works, so rc2 and final and off we go | 16:05 |
| opendevreview | Verification of a change to openstack/kolla-ansible stable/zed failed: Fix deploy/genconfig in check mode https://review.opendev.org/c/openstack/kolla-ansible/+/880310 | 16:17 |
| opendevreview | Merged openstack/kayobe stable/zed: CI: Unbreak stable/zed with two cherry-picks https://review.opendev.org/c/openstack/kayobe/+/883727 | 16:23 |
| opendevreview | Verification of a change to openstack/kolla-ansible stable/zed failed: RabbitMQ: Support setting ha-promote-on-shutdown https://review.opendev.org/c/openstack/kolla-ansible/+/878336 | 16:24 |
| opendevreview | Verification of a change to openstack/kolla-ansible stable/yoga failed: Add flag to change RabbitMQ ha-mode definition https://review.opendev.org/c/openstack/kolla-ansible/+/878339 | 16:26 |
| mmalchuk | mnasiadka I'v found. daily - time: '0 2 * * *', weekly - time: '0 8 * * 5' | 16:28 |
| mmalchuk | but this is without timezone | 16:28 |
| mmalchuk | this is in the project-config/zuul.d/pipelines.yaml | 16:29 |
| opendevreview | Verification of a change to openstack/kolla-ansible stable/zed failed: Add flags for RabbitMQ message TTL & queue expiry https://review.opendev.org/c/openstack/kolla-ansible/+/880313 | 16:29 |
| opendevreview | Verification of a change to openstack/kolla-ansible stable/zed failed: Add flag to change RabbitMQ ha-mode definition https://review.opendev.org/c/openstack/kolla-ansible/+/878337 | 16:43 |
| opendevreview | Verification of a change to openstack/kolla-ansible stable/xena failed: Fix deploy/genconfig in check mode https://review.opendev.org/c/openstack/kolla-ansible/+/880312 | 16:56 |
| opendevreview | Verification of a change to openstack/kolla-ansible stable/yoga failed: Fix deploy/genconfig in check mode https://review.opendev.org/c/openstack/kolla-ansible/+/880311 | 17:14 |
| opendevreview | Verification of a change to openstack/kolla-ansible stable/yoga failed: RabbitMQ: Support setting ha-promote-on-shutdown https://review.opendev.org/c/openstack/kolla-ansible/+/878338 | 17:17 |
| frickler | mnasiadka: oh, nice, after days of "3.11.17 is the same as .16" now he found https://github.com/rabbitmq/rabbitmq-server/issues/8242 ;) | 17:47 |
| opendevreview | Merged openstack/kolla-ansible stable/zed: cloudkitty: set cafile for fetcher_keystone https://review.opendev.org/c/openstack/kolla-ansible/+/877764 | 18:28 |
| opendevreview | Merged openstack/kolla-ansible stable/yoga: Fix deploy/genconfig in check mode https://review.opendev.org/c/openstack/kolla-ansible/+/880311 | 18:30 |
| opendevreview | Merged openstack/kolla-ansible stable/zed: RabbitMQ: Support setting ha-promote-on-shutdown https://review.opendev.org/c/openstack/kolla-ansible/+/878336 | 19:09 |
| mnasiadka | frickler: yes, interesting :-) | 19:10 |
| opendevreview | Merged openstack/kolla-ansible stable/zed: Add flag to change RabbitMQ ha-mode definition https://review.opendev.org/c/openstack/kolla-ansible/+/878337 | 19:16 |
| opendevreview | Maksim Malchuk proposed openstack/kayobe master: CI: Fix kayobe-seed-images-* jobs https://review.opendev.org/c/openstack/kayobe/+/881679 | 19:22 |
| opendevreview | Maksim Malchuk proposed openstack/kayobe master: CI: Fix kayobe-seed-images-* jobs https://review.opendev.org/c/openstack/kayobe/+/881679 | 19:24 |
| opendevreview | Maksim Malchuk proposed openstack/kayobe master: Add custom user_data content configuration for Bifrost https://review.opendev.org/c/openstack/kayobe/+/879554 | 19:27 |
| opendevreview | Maksim Malchuk proposed openstack/kayobe master: CI: Fix kayobe-seed-images-* jobs https://review.opendev.org/c/openstack/kayobe/+/881679 | 19:28 |
| opendevreview | Maksim Malchuk proposed openstack/kayobe master: Add custom user_data content configuration for Bifrost https://review.opendev.org/c/openstack/kayobe/+/879554 | 19:29 |
| opendevreview | Merged openstack/kolla-ansible stable/zed: Add flags for RabbitMQ message TTL & queue expiry https://review.opendev.org/c/openstack/kolla-ansible/+/880313 | 19:38 |
| opendevreview | Merged openstack/kolla-ansible stable/zed: Fix deploy/genconfig in check mode https://review.opendev.org/c/openstack/kolla-ansible/+/880310 | 19:38 |
| opendevreview | Verification of a change to openstack/kayobe stable/xena failed: Bump mrlesmithjr.lvm to skip swap resizes https://review.opendev.org/c/openstack/kayobe/+/880590 | 20:41 |
| opendevreview | Merged openstack/kolla-ansible stable/xena: Fix deploy/genconfig in check mode https://review.opendev.org/c/openstack/kolla-ansible/+/880312 | 21:20 |
| opendevreview | Merged openstack/kolla-ansible stable/yoga: RabbitMQ: Support setting ha-promote-on-shutdown https://review.opendev.org/c/openstack/kolla-ansible/+/878338 | 22:27 |
| opendevreview | Merged openstack/kolla-ansible stable/yoga: Add flag to change RabbitMQ ha-mode definition https://review.opendev.org/c/openstack/kolla-ansible/+/878339 | 22:42 |
| opendevreview | Merged openstack/kolla-ansible stable/yoga: Add flags for RabbitMQ message TTL & queue expiry https://review.opendev.org/c/openstack/kolla-ansible/+/880314 | 22:42 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!