| gthiemonge | skraynev: Hi, we proposed a patch for the issue you reported: https://storyboard.openstack.org/#!/story/2010646#comment-202524 | 07:46 |
|---|---|---|
| skraynev | gthiemonge: I have seen a PR from you. Did you have a chance to check it on the scenario mentioned in story? | 07:46 |
| skraynev | gthiemonge: and yes! thank you very much :) | 07:47 |
| skraynev | gthiemonge: I ask about testing, because I did not find some tests in this PR | 07:47 |
| gthiemonge | skraynev: yes I tested it in my env, the patch blocks simultaneous batch update requests | 07:54 |
| gthiemonge | skraynev: so from now, one worker cannot delete a member while the other worker expects that the member stll exists | 07:54 |
| skraynev | gthiemonge: sounds awesome! thank you very much for the so fast fix! | 08:02 |
| opendevreview | Merged openstack/octavia master: Purge some dev tools from the amphora image https://review.opendev.org/c/openstack/octavia/+/877141 | 09:32 |
| gthiemonge | #startmeeting Octavia | 16:00 |
| opendevmeet | Meeting started Wed Mar 15 16:00:56 2023 UTC and is due to finish in 60 minutes. The chair is gthiemonge. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:00 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:00 |
| opendevmeet | The meeting name has been set to 'octavia' | 16:00 |
| gthiemonge | Hi Folks | 16:00 |
| johnsom | o/ | 16:01 |
| tweining | o/ | 16:01 |
| jdacunha | Hello | 16:01 |
| QG | o/ | 16:01 |
| gthiemonge | #topic Announcements | 16:02 |
| gthiemonge | * Antelope Release schedule: RC2 | 16:02 |
| gthiemonge | as discussed last week, we proposed a RC2 for Octavia | 16:02 |
| gthiemonge | it includes a workaround for an openstacksdk bug that would have broken octavia-dashboard | 16:02 |
| johnsom | +1 | 16:03 |
| gthiemonge | #link https://review.opendev.org/c/openstack/octavia/+/876919 | 16:03 |
| gthiemonge | now I think we're done for Antelope | 16:03 |
| tweining | nice | 16:03 |
| gthiemonge | * PTG | 16:04 |
| gthiemonge | the Octavia PTG will be on March 28th (14:00-18:00 UTC) | 16:04 |
| gthiemonge | #link https://etherpad.opendev.org/p/bobcat-ptg-octavia | 16:05 |
| gthiemonge | don't forget to register | 16:05 |
| tweining | sounds good | 16:05 |
| gthiemonge | and add your topics to the etherpad! | 16:05 |
| johnsom | I think a hot topic will be the let's encrypt RFE | 16:06 |
| jdacunha | jonhsom, yes :) | 16:06 |
| gthiemonge | I need to read the spec before the PTG | 16:07 |
| johnsom | Yeah, there is a lot to unpack there | 16:08 |
| gthiemonge | any other announcements? | 16:10 |
| gthiemonge | #topic CI Status | 16:12 |
| gthiemonge | FYI johnsom fixed an issue when bulding ubuntu images | 16:12 |
| gthiemonge | #link https://review.opendev.org/c/openstack/octavia/+/877141 | 16:12 |
| gthiemonge | it merged earlier today | 16:12 |
| johnsom | Yeah, saves almost 1GB of space inside the amphora images | 16:12 |
| gthiemonge | thanks again johnsom | 16:12 |
| QG | a question about ubuntu image; did already anyone test to build amphora image with jammy ? | 16:13 |
| johnsom | The "build-essentials" uninstall was not removing everything | 16:13 |
| johnsom | Yes, we test on Jammy in the gates now | 16:13 |
| QG | ohhh ok last time i tried it i had issue with openssl v3 | 16:14 |
| johnsom | #link https://review.opendev.org/c/openstack/octavia/+/862131 | 16:14 |
| QG | johnsom: Thanks ! | 16:14 |
| johnsom | But as we recently found, they are using more disk space in the cloud image as of a week or two ago | 16:14 |
| gthiemonge | hmm I'm not sure, this job ran on focal: https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_0b4/857676/11/check/octavia-v2-dsvm-scenario/0b42def/job-output.txt | 16:15 |
| gthiemonge | https://review.opendev.org/c/openstack/octavia-tempest-plugin/+/861369 | 16:15 |
| johnsom | Umm, that is a big problem then. Antelope was supposed to be tested on Jammy | 16:16 |
| johnsom | #link https://zuul.opendev.org/t/openstack/build/69cc6fb302d74064be499eead9af5f1e/log/controller/logs/dib-build/amphora-x64-haproxy.qcow2_log.txt#335 | 16:18 |
| gthiemonge | I think we are running jammy amphora images on focal | 16:18 |
| johnsom | This job ran Jammy, the scenario for the disk space reduction. | 16:18 |
| johnsom | That needs to be fixed ASAP, as all of antelope should have been on Jammy | 16:19 |
| gthiemonge | could you review: | 16:20 |
| gthiemonge | #link https://review.opendev.org/c/openstack/octavia-tempest-plugin/+/861369 | 16:20 |
| johnsom | Done | 16:21 |
| gthiemonge | thanks | 16:21 |
| johnsom | Well, I guess the answer still stands, the amp image is running jammy in the upstream gate jobs | 16:21 |
| johnsom | I also have manually run Octavia/devstack on Jammy without issue | 16:22 |
| tweining | me too AFAIR | 16:22 |
| johnsom | bobcat/2023.2 will also be on Jammy | 16:23 |
| johnsom | #link https://governance.openstack.org/tc/reference/runtimes/2023.2.html | 16:23 |
| tweining | nice. Rocky will be supported too | 16:24 |
| gthiemonge | AFAIK rocky linux doesn't work ATM | 16:24 |
| gthiemonge | (in dib) | 16:24 |
| johnsom | "best effort" | 16:24 |
| gthiemonge | I have WIP commit that adds rockylinux support: https://review.opendev.org/c/openstack/octavia/+/873489 | 16:25 |
| tweining | well, the intention counts already | 16:25 |
| gthiemonge | but I got some firewalling issues with the o-hm0 iface | 16:25 |
| gthiemonge | #topic Brief progress reports / bugs needing review | 16:27 |
| gthiemonge | I've worked on an interesting issue with sqlalchemy: | 16:27 |
| gthiemonge | #link https://storyboard.openstack.org/#!/story/2010646 | 16:27 |
| gthiemonge | the lock of the load balancers in the member batch update API call didn't work as expected | 16:27 |
| gthiemonge | #link https://review.opendev.org/c/openstack/octavia/+/877414 | 16:28 |
| johnsom | I fix the issue with disk space inside the test amphora images. | 16:28 |
| gthiemonge | johnsom: thanks for helping in this issue | 16:28 |
| tweining | you're our sqlalchemy expert now :P | 16:28 |
| johnsom | I posted an api-ref patch to call out the 501 status code that provider drivers may return for features/options they don't support. | 16:28 |
| johnsom | I have also been working on fixing the octavia tempest plugin now that scoped tokens are not going to happen. That impacted admin credential tests because the admin credential would have required a scoped token. I think we have all of that straight now. | 16:30 |
| gthiemonge | +1 ! | 16:30 |
| johnsom | There is another patch that will be needed to completely remove the scoped token logic, but that is a bobcat topic | 16:30 |
| johnsom | I do have a question about gate jobs related to this, but I can wait for open discussion on that | 16:31 |
| gthiemonge | #topic Open Discussion | 16:31 |
| johnsom | lol | 16:31 |
| johnsom | #link https://review.opendev.org/c/openstack/octavia-tempest-plugin/+/876904 | 16:31 |
| johnsom | Ok, so now that scoped tokens are not happening in OpenStack, we have three scenarios: | 16:31 |
| johnsom | 1. Advanced RBAC - this has been the default for Octavia since Pike | 16:32 |
| johnsom | 2. Advanced RBAC with "enforce_new_defaults" - This is the above with the addition of requiring the new "member" and "reader" roles. | 16:33 |
| johnsom | 3. Keystone default roles (aka "enforce_new_defaults" without advanced RBAC) - This means no "load balancer" specific roles required, but users must have either "reader" or "member". We provide this via a policy override file. | 16:34 |
| johnsom | My question is, do we want gate jobs for all of these? Currently we test #1, my patch adds #3 as we want that for downstream use. | 16:35 |
| gthiemonge | johnsom: do you add #3 in octavia-tempest-plugin and in octavia? | 16:36 |
| johnsom | I think #2 will become the new default for Bobcat, so we could just transition #1 to #2 | 16:36 |
| johnsom | Yes, here: | 16:36 |
| gthiemonge | I think the scope-token job was only in tempest-plugin | 16:36 |
| johnsom | #link https://review.opendev.org/c/openstack/octavia-tempest-plugin/+/876904 | 16:36 |
| johnsom | It will need to be in octavia proper jobs, not just tempest plugin jobs | 16:36 |
| gthiemonge | ok | 16:37 |
| johnsom | IMO\ | 16:37 |
| gthiemonge | I think #1 and #3 are fine ATM (in both octavia and o-t-p) | 16:39 |
| johnsom | Ack, then maybe transition #1 to #2 as all the service enable "enforce_new_defaults" in bobcat. I am good with that. | 16:39 |
| johnsom | I hate adding more jobs, but they are no-op jobs, so run quickly | 16:40 |
| johnsom | quickly-ish | 16:40 |
| gthiemonge | ahem... 1h19m | 16:40 |
| johnsom | yeah, lol | 16:41 |
| tweining | it's all relative | 16:41 |
| gthiemonge | I think we're building an amphora image in the noop jobs | 16:41 |
| johnsom | Nope | 16:42 |
| gthiemonge | no? | 16:42 |
| gthiemonge | ok | 16:42 |
| tweining | so what is no-op doing for more than an hour then? | 16:42 |
| tweining | maybe I can try to investigate that a bit | 16:43 |
| gthiemonge | lol | 16:43 |
| johnsom | Ran: 578 tests in 3306.5628 sec. | 16:44 |
| johnsom | The rest is all devstack/zuul | 16:44 |
| johnsom | It is a bit slower than you would expect really | 16:44 |
| gthiemonge | maybe we can increase the number of threads in tempest | 16:44 |
| gthiemonge | --concurrency=4 | 16:45 |
| johnsom | We should look at RAM usage. It could be swapping, which slows everything down. There is a devstack flag to lock mysql ram usage down that may help | 16:45 |
| tweining | I guess a lot is resource setup/teardown?! | 16:45 |
| johnsom | There shouldn't be much of that really, but yeah, it would be good to get fresh eyes on this. | 16:45 |
| johnsom | 2023-03-15 00:55:34.256022 | controller | {1} octavia_tempest_plugin.tests.api.v2.test_member.MemberAPITest2.test_UDP_RR_member_batch_update [67.189751s] ... ok | 16:46 |
| johnsom | for no-op is.... odd | 16:46 |
| johnsom | Though, no-op does run on the slower nodes too, so that will be a factor | 16:47 |
| johnsom | I will propose a test job today with the devstack mysql memory cap setting to see how that impacts the jobs | 16:48 |
| gthiemonge | ack | 16:48 |
| gthiemonge | any other topics? | 16:49 |
| gthiemonge | ok! | 16:51 |
| gthiemonge | thank you guys! | 16:51 |
| gthiemonge | #endmeeting | 16:51 |
| opendevmeet | Meeting ended Wed Mar 15 16:51:14 2023 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:51 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/octavia/2023/octavia.2023-03-15-16.00.html | 16:51 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/octavia/2023/octavia.2023-03-15-16.00.txt | 16:51 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/octavia/2023/octavia.2023-03-15-16.00.log.html | 16:51 |
| opendevreview | Michael Johnson proposed openstack/octavia-tempest-plugin master: DNM: Testing restricted mysql memory setting https://review.opendev.org/c/openstack/octavia-tempest-plugin/+/877529 | 16:55 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!