| kevko | mnasiadka: thanks | 06:50 |
|---|---|---|
| kevko | mnasiadka: https://review.opendev.org/c/openstack/kolla/+/915440 << gating failed because of long lines in docstring ...changed ...and in few minutes it will pass zuul | 06:51 |
| mnasiadka | ack | 07:14 |
| kevko | mnasiadka: upgrade timeouted :( | 07:47 |
| kevko | mnasiadka: have to recheck | 07:48 |
| mnasiadka | then find the reason why :) | 07:48 |
| kevko | mnasiadka: no reason, debian passed ..and also all logs are present and success ...so fail to download logs or something ? | 07:49 |
| kevko | maybe ? | 07:49 |
| mnasiadka | downloading logs is in post I think, so it timed out earlier | 07:50 |
| opendevreview | Merged openstack/kolla master: Enhance logging format for better readability https://review.opendev.org/c/openstack/kolla/+/930152 | 08:30 |
| kevko | mnasiadka: :( bootstrap failing for ubuntu upgrade -> "msg": "Request failed: <urlopen error [Errno -3] Temporary failure in name resolution>", | 08:35 |
| kevko | "url": "https://download.docker.com/linux/ubuntu/gpg" | 08:35 |
| kevko | aaaah | 08:35 |
| mnasiadka | internet seems to be hairy today ;-) | 08:40 |
| opendevreview | Marc Vorwerk proposed openstack/kolla-ansible master: Converted plain URL to RST https://review.opendev.org/c/openstack/kolla-ansible/+/934207 | 08:42 |
| opendevreview | Marc Vorwerk proposed openstack/kolla-ansible master: Format Comment https://review.opendev.org/c/openstack/kolla-ansible/+/934208 | 08:42 |
| opendevreview | Marc Vorwerk proposed openstack/kolla-ansible master: Format Comment https://review.opendev.org/c/openstack/kolla-ansible/+/934208 | 08:52 |
| opendevreview | Marc Vorwerk proposed openstack/kolla-ansible master: Converted plain URL to RST https://review.opendev.org/c/openstack/kolla-ansible/+/934207 | 08:52 |
| kevko | mnasiadka: but it's failing only for ubuntu ? i can normally download that keyring :/ | 09:03 |
| kevko | *locally | 09:03 |
| mnasiadka | Temporary failure in name resolution | 09:04 |
| kevko | yep | 09:04 |
| kevko | it's weird | 09:04 |
| opendevreview | Bertrand Lanson proposed openstack/kolla-ansible master: set haproxy for cyborg module https://review.opendev.org/c/openstack/kolla-ansible/+/890642 | 09:14 |
| opendevreview | Bertrand Lanson proposed openstack/kolla-ansible master: set haproxy for cyborg module https://review.opendev.org/c/openstack/kolla-ansible/+/890642 | 09:15 |
| opendevreview | Marc Vorwerk proposed openstack/kolla-ansible master: Implement neutron-ovn-vpn-agent https://review.opendev.org/c/openstack/kolla-ansible/+/924575 | 09:18 |
| opendevreview | Marc Vorwerk proposed openstack/kolla-ansible master: Format Comment https://review.opendev.org/c/openstack/kolla-ansible/+/934210 | 09:18 |
| opendevreview | Marc Vorwerk proposed openstack/kolla-ansible master: Converted plain URL to RST https://review.opendev.org/c/openstack/kolla-ansible/+/934211 | 09:18 |
| opendevreview | Marc Vorwerk proposed openstack/kolla-ansible master: Implement neutron-ovn-vpn-agent https://review.opendev.org/c/openstack/kolla-ansible/+/924575 | 09:22 |
| kevko | SvenKieske: we installed dbg symbols ...it's stucked here | 10:32 |
| kevko | SvenKieske: https://paste.openstack.org/show/blR9xCzxWbQzPEGX7RP6/ | 10:32 |
| kevko | https://github.com/openvswitch/ovs/blob/v3.3.0/lib/dpif.c#L1214 | 10:32 |
| kevko | anny suggestions ? (used ubuntu official ovs) | 10:32 |
| kevko | i mean the stable version | 10:33 |
| kevko | i am wondering if we are not hitting some bug because of QoS turned on | 10:34 |
| kevko | I don't know, we're pretty desperate | 10:37 |
| SvenKieske | kevko: I think it's best then to connect to some ovs expert at ovs upstream? I'm not an expert in low level ovs details myself, sorry. maybe try to test with qos turned off, if possible? | 10:41 |
| kevko | SvenKieske: yeah, i think it will be related ... | 10:56 |
| kevko | SvenKieske: sometimes chatgpg is expert :D | 10:57 |
| kevko | SvenKieske: https://paste.openstack.org/show/buGQnxPeymSQTUAB6epI/ | 10:57 |
| kevko | SvenKieske: let's see | 10:57 |
| SvenKieske | if this issue is around offloading maybe it's also firmware related, e.g. a bug in the NIC driver doing the offloading | 10:58 |
| kevko | SvenKieske: no, offloading is turned off by kolla | 11:03 |
| kevko | SvenKieske: or better said turned on only if you configure it | 11:03 |
| kevko | SvenKieske: https://github.com/openstack/kolla-ansible/blob/e4aae3386e31942320612a219c5db2b7a103bc93/ansible/roles/openvswitch/tasks/post-config.yml#L19 | 11:03 |
| kevko | SvenKieske: and default value is false | 11:03 |
| opendevreview | Merged openstack/kayobe master: Remove upgrade note about Rocky Linux 9 support https://review.opendev.org/c/openstack/kayobe/+/934118 | 11:23 |
| opendevreview | Matt Crees proposed openstack/kolla-ansible stable/2024.1: Prevent accidental downgrades of RabbitMQ https://review.opendev.org/c/openstack/kolla-ansible/+/933874 | 12:46 |
| opendevreview | Matt Crees proposed openstack/kolla-ansible stable/2023.2: Prevent accidental downgrades of RabbitMQ https://review.opendev.org/c/openstack/kolla-ansible/+/933875 | 12:47 |
| opendevreview | Matt Crees proposed openstack/kolla-ansible stable/2023.2: Fix: add common options to RabbitMQ version check https://review.opendev.org/c/openstack/kolla-ansible/+/934113 | 12:47 |
| opendevreview | Matt Crees proposed openstack/kolla-ansible stable/2023.1: Prevent accidental downgrades of RabbitMQ https://review.opendev.org/c/openstack/kolla-ansible/+/933876 | 12:48 |
| opendevreview | Matt Crees proposed openstack/kolla-ansible stable/2023.1: Fix: add common options to RabbitMQ version check https://review.opendev.org/c/openstack/kolla-ansible/+/934114 | 12:48 |
| opendevreview | Michal Arbet proposed openstack/kolla master: Fix handling configs in base image https://review.opendev.org/c/openstack/kolla/+/915440 | 12:55 |
| opendevreview | Merged openstack/kayobe stable/2024.1: CI: Replace deprecated distro.linux_distribution https://review.opendev.org/c/openstack/kayobe/+/934055 | 12:56 |
| yosef | Could someone take a look at this patch? It adds setting election timeout for OVN clustering: https://review.opendev.org/c/openstack/kolla-ansible/+/934106 | 13:49 |
| opendevreview | Merged openstack/kayobe stable/2023.2: CI: Replace deprecated distro.linux_distribution https://review.opendev.org/c/openstack/kayobe/+/934056 | 13:50 |
| opendevreview | Merged openstack/kayobe master: CI: test database backup https://review.opendev.org/c/openstack/kayobe/+/933863 | 13:50 |
| opendevreview | Merged openstack/kayobe stable/2023.1: CI: Replace deprecated distro.linux_distribution https://review.opendev.org/c/openstack/kayobe/+/934057 | 13:50 |
| mnasiadka | mnasiadka bbezak frickler kevko SvenKieske mmalchuk gkoper jangutter jsuazo jovial osmanlicilegi mattcrees dougszu darmach - meeting in 8 minutes | 13:52 |
| mnasiadka | kevko: I don't like this - https://zuul.opendev.org/t/openstack/build/165bb401cc43494b918ff5150528301f/log/job-output.txt#324 | 13:56 |
| mnasiadka | We create a filesystem with a label, and then we can't mount it using a label? | 13:56 |
| opendevreview | Bertrand Lanson proposed openstack/kolla-ansible master: set haproxy for cyborg module https://review.opendev.org/c/openstack/kolla-ansible/+/890642 | 13:58 |
| mnasiadka | #startmeeting kolla | 14:00 |
| opendevmeet | Meeting started Wed Nov 6 14:00:21 2024 UTC and is due to finish in 60 minutes. The chair is mnasiadka. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
| opendevmeet | The meeting name has been set to 'kolla' | 14:00 |
| mnasiadka | #topic rollcall | 14:00 |
| mnasiadka | o/ | 14:00 |
| SvenKieske | o/ | 14:00 |
| frickler | \o | 14:00 |
| frickler | looks like a small meeting :-/ | 14:01 |
| kevko | \o/ | 14:02 |
| mnasiadka | #topic agenda | 14:02 |
| mnasiadka | - Release tasks | 14:02 |
| mnasiadka | * Current cycle planning | 14:02 |
| mnasiadka | * Additional agenda (from whiteboard) | 14:03 |
| mnasiadka | * Open discussion | 14:03 |
| mnasiadka | #topic Release tasks | 14:03 |
| mnasiadka | So, Dalmatian for Kolla and Kolla-Ansible is done, as in final release | 14:03 |
| mmalchuk | o/ | 14:03 |
| mnasiadka | jovial: around to tell us what's Kayobe state? | 14:03 |
| mnasiadka | guess not, but now the time is ticking for Kayobe | 14:04 |
| mnasiadka | #topic Current cycle planning | 14:04 |
| mnasiadka | Ok then, we sort of promised to kevko to go through all his patches | 14:04 |
| mnasiadka | So - is there a list of things we should review? | 14:04 |
| SvenKieske | would be nice to have those on the whiteboard, because I really lose track of stuff, given the high velocity of patches flying around :D | 14:05 |
| frickler | https://review.opendev.org/q/owner:michal.arbet@ultimum.io+status:open | 14:05 |
| mnasiadka | https://review.opendev.org/c/openstack/kolla/+/915440 - that one needs just a green CI run | 14:05 |
| frickler | looks like quite some task ;) | 14:05 |
| mnasiadka | https://review.opendev.org/q/owner:michal.arbet@ultimum.io+status:open+is:mergeable | 14:05 |
| mnasiadka | smaller one | 14:05 |
| SvenKieske | I really don't think all his patches are "urgent", especially not the ones having a merge conflict | 14:05 |
| kevko | mnasiadka: it's still in whiteboard | 14:05 |
| mnasiadka | Sounds good | 14:06 |
| mnasiadka | L241 on the whiteboard | 14:06 |
| mnasiadka | frickler: are you willing to look at https://review.opendev.org/q/topic:%22kolla-patch%22 ? | 14:07 |
| kevko | there are few patches only ... | 14:07 |
| mnasiadka | fix-config-json-handling is on the way as soon as jobs don't fail on dns issues or internet issues | 14:07 |
| kevko | i've addressed all comments ...and it's very useful feature | 14:07 |
| frickler | willing is such an active term ... but yes, I'll take a look | 14:08 |
| kevko | thanks | 14:08 |
| mnasiadka | I'll handle the rest and find Bartosz (and maybe someone else) to have a look as well | 14:08 |
| kevko | thank you mnasiadka | 14:09 |
| mnasiadka | So, I think we have one topic which we sort of missed on the PTG | 14:09 |
| mnasiadka | Eventlet removal is happening | 14:09 |
| mnasiadka | Which means we need to move everything to WSGI? | 14:09 |
| kevko | i will abandon or mark as DNM | 14:09 |
| mnasiadka | frickler: you might have more insight? | 14:09 |
| frickler | well there are different options than wsgi being discussed iiuc | 14:09 |
| kevko | are we sure we want wsgi ? | 14:10 |
| frickler | I don't think any immediate action is needed, though | 14:10 |
| SvenKieske | afaik not everything works with wsgi | 14:10 |
| mnasiadka | Just asking if we need to have a look on anything | 14:10 |
| mnasiadka | But maybe let's wait | 14:11 |
| frickler | I'm hoping watching what happens in devstack should be good enough for now | 14:11 |
| mnasiadka | well, WSGI/ASGI means we don't have a binary to run - where we use that for non-WSGI enabled services | 14:11 |
| kevko | gunicorn ? | 14:12 |
| mnasiadka | I have some time over the remainder of the year, so I might dust off the gunicorn patch and think if it's a good idea to migrate from mod_wsgi to gunicorn | 14:12 |
| mnasiadka | Which would make all of our services a bit lighter | 14:13 |
| mnasiadka | the only one that requires apache/nginx/whatever is keystone/horizon for federation stuff | 14:13 |
| mnasiadka | anyway, I didn't have time to convert Epoxy PTG notes to actionable items | 14:14 |
| mnasiadka | so I'll do that for the next meeting and we can discuss if we're missing anything | 14:14 |
| mnasiadka | kevko: how is that... RMQ Queue Manager or how is it called? | 14:14 |
| kevko | yes | 14:14 |
| kevko | rabbitmq manager | 14:14 |
| mnasiadka | working/not working? anything we should start looking into? | 14:15 |
| mnasiadka | I would prefer merging it early in the cycle | 14:15 |
| kevko | it's working ... but need /dev/shm mounted | 14:15 |
| mnasiadka | compared to breaking everything in the end | 14:15 |
| mnasiadka | well, sort of defies containers, but people do the same in Kubernetes world, and I guess it's not all of the containers - just API services | 14:15 |
| mnasiadka | or rabbitmq clients | 14:16 |
| kevko | mnasiadka: it's services which are touching rabbitmq | 14:16 |
| SvenKieske | would be nice to get this working | 14:16 |
| mnasiadka | anyway, let's first merge the list you gave us and then get back to this sooner than later | 14:17 |
| kevko | mnasiadka: everything with rabbitmq snippet in configuration | 14:17 |
| mnasiadka | ok then, that's it for planning I guess | 14:17 |
| mnasiadka | #topic Additional agenda (from whiteboard) | 14:17 |
| kevko | mnasiadka: well, rmq manager is nice stuff ...but it's the last one ...and it's some time i was working on | 14:17 |
| mnasiadka | nothing in additional agenda | 14:18 |
| mnasiadka | #topic Open discussion | 14:18 |
| mnasiadka | anything? | 14:18 |
| frickler | (yoctozepto) Need to add https://docs.openstack.org/WHATEVER/deploy/ update after branching to release actions | 14:18 |
| frickler | I found that on the whiteboard just earlier | 14:18 |
| mnasiadka | oh that one | 14:18 |
| mnasiadka | yes, it's also in the release docs | 14:18 |
| mnasiadka | anybody happy to fire it off? | 14:18 |
| frickler | will do a patch for that for the current release | 14:18 |
| mmalchuk | https://review.opendev.org/c/openstack/kayobe/+/793697 | 14:19 |
| mmalchuk | old Kayobe change | 14:19 |
| frickler | the other thing: do we need to do new stable releases? | 14:19 |
| mmalchuk | please review and merge | 14:19 |
| jovial | Sorry, I was late for the start. Just a word to say that we are almost ready for rc1 in kayobe. I've just sent the kayobe-config and kayobe-config-dev sync patches on their way. | 14:19 |
| mnasiadka | or maybe not | 14:19 |
| mnasiadka | frickler: I guess it would make sense | 14:19 |
| mmalchuk | and some backports please: https://review.opendev.org/q/I4bbfef3a391b8582ae73cbe06138715b43584dec+status:open | 14:19 |
| SvenKieske | what's exactly required there for the release action? I didn't understand that blurb. | 14:20 |
| mnasiadka | we need to add Kolla-Ansible to the deploy-guide for Dalmatian IIRC | 14:20 |
| mnasiadka | Actually it's empty | 14:21 |
| mnasiadka | :D | 14:21 |
| frickler | I link the patch for reference when I have it | 14:21 |
| frickler | +will | 14:21 |
| mnasiadka | https://docs.openstack.org/2024.2/deploy/ | 14:21 |
| SvenKieske | well it doesn't hurt to be the first? ;) | 14:21 |
| mnasiadka | frickler: If we could add that to the kolla release management docs - it would be nice | 14:21 |
| frickler | mnasiadka: ack | 14:22 |
| mnasiadka | instead of finding that every cycle in KollaWhiteboard :) | 14:22 |
| mnasiadka | Ok then | 14:22 |
| mnasiadka | mmalchuk: the Kayobe one might not get it, but I leave that to jovial , I'll look in the backports though | 14:22 |
| mmalchuk | jovial please | 14:22 |
| mnasiadka | And I encourage all cores to look at backports from time to time (on the Kolla/Kolla-Ansible dashboards) :) | 14:22 |
| mmalchuk | mnasiadka thanks | 14:22 |
| mnasiadka | ok then, I guess that's it for today | 14:22 |
| kevko | thx | 14:23 |
| mnasiadka | Ah, not all | 14:23 |
| mnasiadka | I'm off next Wednesday | 14:23 |
| mnasiadka | I'll ask Bartosz to run the meeting, if he can't - I'll ask frickler or kevko | 14:23 |
| mmalchuk | bbezak will lead? or skip? | 14:23 |
| opendevreview | Merged openstack/kayobe-config master: [release] Synchronise with kayobe for 2024.2 https://review.opendev.org/c/openstack/kayobe-config/+/933848 | 14:23 |
| mnasiadka | But in two weeks I'm on OVSCON in Prague, so unless anybody outside of StackHPC wants to run - we'll probably skip | 14:24 |
| bbezak | I'll be there | 14:24 |
| bbezak | next wed | 14:24 |
| bbezak | I'll be in Prague as well | 14:24 |
| mnasiadka | Ok, bbezak for next Wed, and we'll skip the one in two weeks I assume. | 14:24 |
| jovial | mmalchuk: I'm not sure the TLS one can land in the state it is in. Like i say, we should add generic mechanism for adding certs to the system trust store | 14:24 |
| kevko | oh, I forgot ..I am also off for next two weeks ...finally going to take some rest | 14:24 |
| frickler | company outing? ;) | 14:24 |
| mnasiadka | frickler: Prague is close, we have some short presentation and then I think I still like beers in Czechia ;) | 14:25 |
| kevko | but I will see ... taking my laptol ...I am a bit workoholic | 14:25 |
| mnasiadka | Anyway, I would say that's it for the meeting today. | 14:25 |
| mnasiadka | Thank you all for coming :) | 14:25 |
| mnasiadka | #endmeeting | 14:25 |
| opendevmeet | Meeting ended Wed Nov 6 14:25:24 2024 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:25 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/kolla/2024/kolla.2024-11-06-14.00.html | 14:25 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/kolla/2024/kolla.2024-11-06-14.00.txt | 14:25 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/kolla/2024/kolla.2024-11-06-14.00.log.html | 14:25 |
| frickler | thx mnasiadka | 14:25 |
| SvenKieske | thx | 14:25 |
| kevko | mnasiadka: Ping me when you will be in Prague :) | 14:25 |
| mmalchuk | jovial it really sad that you have no time to review. this change hang since Xena cycle. I rebase it from cycle to cycle because we use it in production | 14:27 |
| jovial | mmalchuk. Its not that I have no time to review. I did review it and my comments were ignored. | 14:27 |
| mmalchuk | really? please up. maybe it was lost | 14:28 |
| mmalchuk | I'm open for discussion | 14:28 |
| jovial | Sure, I'll reopen the thread | 14:29 |
| mmalchuk | thanks | 14:29 |
| opendevreview | Merged openstack/kayobe-config-dev master: [release] Synchronise with kayobe for 2024.2 https://review.opendev.org/c/openstack/kayobe-config-dev/+/934080 | 15:21 |
| mnasiadka | kevko: will do | 15:40 |
| opendevreview | Verification of a change to openstack/kolla master failed: Fix handling configs in base image https://review.opendev.org/c/openstack/kolla/+/915440 | 16:22 |
| kevko | mnasiadka: accidentaly voted two times ..so i broke gating ..can u please give second +2 for ^^ | 16:24 |
| kevko | (probably) | 16:24 |
| opendevreview | Michal Arbet proposed openstack/kolla master: Fix handling configs in base image https://review.opendev.org/c/openstack/kolla/+/915440 | 16:37 |
| kevko | mnasiadka: aah, no ..it's because logging was dependency before ..and it's now merged without .... nah / | 16:38 |
| opendevreview | Merged openstack/kolla master: Fix handling configs in base image https://review.opendev.org/c/openstack/kolla/+/915440 | 20:39 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!