| opendevreview | Merged openstack/neutron master: Remove local CI job "tox-py311" superseded by "openstack-tox-py311" https://review.opendev.org/c/openstack/neutron/+/892132 | 07:00 |
|---|---|---|
| opendevreview | Merged openstack/neutron master: Fix bindep for Debian bookworm https://review.opendev.org/c/openstack/neutron/+/892142 | 08:00 |
| opendevreview | Danylo Vodopianov proposed openstack/os-vif master: Openvswitch driver was extended https://review.opendev.org/c/openstack/os-vif/+/859574 | 09:40 |
| opendevreview | Rodolfo Alonso proposed openstack/neutron master: [OVN] Skip the port status UP update during a live migration https://review.opendev.org/c/openstack/neutron/+/888769 | 09:59 |
| opendevreview | Rodolfo Alonso proposed openstack/neutron master: [OVN][Trunk] Set the subports correct host during live migration https://review.opendev.org/c/openstack/neutron/+/888776 | 09:59 |
| opendevreview | Merged openstack/neutron master: Add max limit to agent_down_time https://review.opendev.org/c/openstack/neutron/+/889373 | 10:05 |
| opendevreview | Adil Ishaq proposed openstack/neutron master: fix: add log message for periodic_sync_routers_task fullsync https://review.opendev.org/c/openstack/neutron/+/878248 | 10:49 |
| opendevreview | Rodolfo Alonso proposed openstack/neutron master: Add "openstack-tox-py310-with-sqlalchemy-master" to check queue https://review.opendev.org/c/openstack/neutron/+/892134 | 11:15 |
| opendevreview | Frode Nordahl proposed openstack/neutron master: [ovn] Implement support for external-gateway-multihoming extension https://review.opendev.org/c/openstack/neutron/+/874199 | 12:40 |
| opendevreview | Frode Nordahl proposed openstack/neutron master: [ovn] Honor `enable_default_route_ecmp` attribute https://review.opendev.org/c/openstack/neutron/+/878531 | 12:40 |
| opendevreview | Frode Nordahl proposed openstack/neutron master: [ovn] Make scheduling of unhosted gateways aware of current transaction https://review.opendev.org/c/openstack/neutron/+/874760 | 12:40 |
| opendevreview | Frode Nordahl proposed openstack/neutron master: [ovn] Add helper for retrieving LR associated with LRP https://review.opendev.org/c/openstack/neutron/+/873698 | 12:40 |
| opendevreview | Frode Nordahl proposed openstack/neutron master: [ovn] Apply soft anti-affinity for LRs with multiple LRPs when scheduling https://review.opendev.org/c/openstack/neutron/+/873699 | 12:40 |
| opendevreview | Frode Nordahl proposed openstack/neutron master: [ovn] Add support for enable_default_route_bfd attribute https://review.opendev.org/c/openstack/neutron/+/878543 | 12:40 |
| opendevreview | Frode Nordahl proposed openstack/neutron master: [ovn] Add support for enable_default_route_bfd attribute https://review.opendev.org/c/openstack/neutron/+/878543 | 12:48 |
| opendevreview | Miro Tomaska proposed openstack/neutron master: OVN Metadata handle process execeptions https://review.opendev.org/c/openstack/neutron/+/890986 | 13:10 |
| mtomaska | Can I ask for a review on this when you get a chance? Thank you! https://review.opendev.org/c/openstack/neutron/+/890986 | 13:11 |
| ralonsoh | mtomaska, sure, I'll check it late today or tomorrow morning | 13:16 |
| mtomaska | thanks! | 13:17 |
| opendevreview | Merged openstack/neutron stable/2023.1: [OVN] Retry retrieving LSP hosting information https://review.opendev.org/c/openstack/neutron/+/891293 | 13:49 |
| opendevreview | Merged openstack/neutron stable/zed: [OVN] Retry retrieving LSP hosting information https://review.opendev.org/c/openstack/neutron/+/891294 | 13:49 |
| opendevreview | Merged openstack/neutron stable/yoga: [OVN] Retry retrieving LSP hosting information https://review.opendev.org/c/openstack/neutron/+/891295 | 13:49 |
| opendevreview | Merged openstack/neutron stable/xena: [OVN] Retry retrieving LSP hosting information https://review.opendev.org/c/openstack/neutron/+/891296 | 13:49 |
| opendevreview | Merged openstack/neutron stable/wallaby: [OVN] Retry retrieving LSP hosting information https://review.opendev.org/c/openstack/neutron/+/891297 | 13:49 |
| opendevreview | Michal Nasiadka proposed openstack/neutron master: haproxy: Add support for configuring syslog https://review.opendev.org/c/openstack/neutron/+/884407 | 13:54 |
| opendevreview | Merged openstack/neutron stable/victoria: [OVN] ovn-db-sync check for router port differences https://review.opendev.org/c/openstack/neutron/+/892182 | 13:57 |
| ralonsoh | Ping list: bcafarel, elvira, frickler, mlavalle, mtomaska, obondarev, slawek, tobias-urdin, ykarel, lajoskatona, jlibosva, averdagu, amotoki | 14:00 |
| mlavalle | o/ | 14:00 |
| ralonsoh | #startmeeting networking | 14:00 |
| opendevmeet | Meeting started Tue Aug 22 14:00:51 2023 UTC and is due to finish in 60 minutes. The chair is ralonsoh. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
| opendevmeet | The meeting name has been set to 'networking' | 14:00 |
| ralonsoh | hello all | 14:00 |
| frickler | \o | 14:00 |
| isabek | Hi | 14:00 |
| haleyb | o/ | 14:01 |
| slaweq | o/ | 14:01 |
| bcafarel | o/ | 14:01 |
| mtomaska | o/ | 14:01 |
| obondarev_ | hi | 14:01 |
| *** obondarev_ is now known as obondarev | 14:01 | |
| rubasov | o/ | 14:01 |
| lajoskatona | o/ | 14:01 |
| ralonsoh | ok, let's start | 14:02 |
| ralonsoh | #topic announcements | 14:02 |
| ralonsoh | #link https://releases.openstack.org/bobcat/schedule.html | 14:02 |
| ralonsoh | very important this week: election nomination begins | 14:02 |
| ralonsoh | so please send your candidacy mails to the mailing list | 14:03 |
| ralonsoh | more info: https://governance.openstack.org/election/ | 14:03 |
| ralonsoh | and we have the final release for the non-client libraries | 14:03 |
| ralonsoh | os-ken: https://review.opendev.org/c/openstack/releases/+/892214 | 14:04 |
| ralonsoh | ovsdbapp: https://review.opendev.org/c/openstack/releases/+/892237 | 14:04 |
| ralonsoh | about https://review.opendev.org/c/openstack/releases/+/892120, I know this patch is older than the releases team one | 14:04 |
| ralonsoh | but let's use the releases team one | 14:04 |
| ralonsoh | frickler, in any case, thanks for proposing it | 14:04 |
| ralonsoh | same as the previous week, just a reminder | 14:05 |
| ralonsoh | we have a new openinfra episode | 14:05 |
| ralonsoh | #link https://openinfra.dev/live/#all-episodes | 14:05 |
| ralonsoh | and that's all I have this week | 14:06 |
| ralonsoh | (we are getting closer to the release date!) | 14:06 |
| ralonsoh | Am I missing something? | 14:06 |
| ralonsoh | ok, let's move to bugs | 14:07 |
| ralonsoh | #topic bugs | 14:07 |
| ralonsoh | Report from obondarev: https://lists.openstack.org/pipermail/openstack-discuss/2023-August/034777.html | 14:07 |
| ralonsoh | (lucky you, that was an easy week) | 14:07 |
| obondarev | true | 14:07 |
| ralonsoh | only one unassigned bug | 14:07 |
| ralonsoh | #link https://bugs.launchpad.net/neutron/+bug/2031520 | 14:08 |
| ralonsoh | I opened this bug because there could be (for sure) some confusion about DVR/SNAT in OVN with PF, load balancing, network types (tunelled or vlan), etc | 14:08 |
| ralonsoh | so it could be very useful to have a documentation with all the config parameters, options and current implementation | 14:09 |
| ralonsoh | and that's all! | 14:09 |
| haleyb | people only file bugs on my week :-( | 14:09 |
| ralonsoh | hehehehe | 14:09 |
| ralonsoh | I'll try to take this bug at the end of this week, in any case, if some else didn't take it before | 14:09 |
| ralonsoh | Am I missing any other bug you want to bring here? | 14:10 |
| ralonsoh | it doesn't matter if it is an older bug | 14:10 |
| frickler | I think https://bugs.launchpad.net/neutron/+bug/2028651 is worth mentioning again | 14:10 |
| frickler | iiuc it still blocks octavia? | 14:10 |
| ralonsoh | I need to check it, yes. But I don't know why the patch related introduced this regression | 14:11 |
| ralonsoh | I mean https://review.opendev.org/c/openstack/neutron/+/882588 is preventing from using a VIP port as a VM port | 14:11 |
| ralonsoh | I'll check it tomorrow morning, because gthiemonge will need it asap | 14:12 |
| ralonsoh | frickler, did you have time to investifate it? | 14:12 |
| frickler | no, I'm just watching this from the outside | 14:13 |
| ralonsoh | ok, I'll try to use the reproducer provided | 14:13 |
| ralonsoh | any other bug? | 14:14 |
| ralonsoh | This week isabek is the deputy, next week will be elvira. | 14:14 |
| ralonsoh | ack? | 14:14 |
| isabek | o/ | 14:14 |
| elvira | ack o/ | 14:14 |
| ralonsoh | thanks! | 14:14 |
| ralonsoh | ok, let's jump to the next topic | 14:15 |
| ralonsoh | #topic os-ken | 14:15 |
| ralonsoh | I commented that before | 14:15 |
| ralonsoh | frickler, pushed some patches for os-ken | 14:15 |
| ralonsoh | and now we are releasing a new (and last for this cycle) release | 14:15 |
| frickler | hopefully that unblocks n-d-r | 14:15 |
| ralonsoh | I hope si | 14:15 |
| ralonsoh | so* | 14:16 |
| frickler | one side note from testing this is that the n-d-r job on os-ken is completely useless | 14:16 |
| ralonsoh | and next release (during C), we'll try the new implementation with more time | 14:16 |
| ralonsoh | why is so? | 14:16 |
| frickler | because it only tests the released os-ken, not the patch in question | 14:16 |
| opendevreview | Slawek Kaplonski proposed openstack/neutron master: [S-RBAC] Add service role in neutron policy https://review.opendev.org/c/openstack/neutron/+/886724 | 14:17 |
| frickler | also I'm still not sure what actually happened that caused this regression | 14:17 |
| ralonsoh | frickler, but I'm checking the "neutron-tempest-plugin-dynamic-routing" definition | 14:17 |
| ralonsoh | and required-projects: os-ken | 14:17 |
| frickler | that does not seem to be enough | 14:18 |
| frickler | also os-ken is installed twice, once in the neutron venv and once in the tempest venv | 14:18 |
| frickler | but both get installed from pypi | 14:18 |
| ralonsoh | I don;'t understand, if os-ken is in required projects, it should be git cloning the project and installing from source | 14:19 |
| ralonsoh | I'll open a LP bug for this | 14:19 |
| frickler | it is not getting installed directly, just as dependency of n-d-r, I think that's what the issue comes from, but didn't check yet in detail | 14:20 |
| frickler | but would be nice if one of the CI ppl could have a look, too | 14:21 |
| ralonsoh | I'll check the job logs before creating the LP bug | 14:21 |
| ralonsoh | but yes, we should be able to install whatever version of os-ken we need | 14:21 |
| ralonsoh | ok, let's move to the next topic then | 14:22 |
| ralonsoh | #topic community_goals | 14:22 |
| ralonsoh | 1) Consistent and Secure Default RBAC | 14:22 |
| ralonsoh | slaweq, https://bugs.launchpad.net/neutron/+bug/2026182 | 14:22 |
| ralonsoh | (I think I'll change the title of this section) | 14:22 |
| ralonsoh | ok, I'll ping him later | 14:23 |
| ralonsoh | there is an ongoing patch ready to be reviewed | 14:23 |
| ralonsoh | #link https://review.opendev.org/c/openstack/neutron/+/886724 | 14:23 |
| slaweq | hi | 14:23 |
| ralonsoh | but we won't merge it during this release | 14:23 |
| ralonsoh | hi | 14:23 |
| slaweq | I think that patch https://review.opendev.org/c/openstack/neutron/+/886724 is ready if You have time to release it | 14:24 |
| slaweq | *to review | 14:24 |
| slaweq | sorry :) | 14:24 |
| ralonsoh | perfect! | 14:24 |
| slaweq | it's not that big really as it mostly adds unit tests | 14:24 |
| slaweq | and changes some of the policies (but not that many) | 14:24 |
| ralonsoh | just one heads-up, I don't think we should merge it during this release | 14:24 |
| ralonsoh | just in case | 14:24 |
| ralonsoh | and service role is not mandatory during Bobcat | 14:25 |
| slaweq | sure, we can wait for the beginning of the next cycle with it | 14:25 |
| lajoskatona | and for that we need any change in nova for example? | 14:25 |
| slaweq | it's fine for me | 14:25 |
| ralonsoh | they should add this new role in the configuration and make these calls using it | 14:26 |
| opendevreview | Merged openstack/neutron stable/ussuri: [OVN] ovn-db-sync check for router port differences https://review.opendev.org/c/openstack/neutron/+/892183 | 14:26 |
| slaweq | lajoskatona I don't think so as we already had "advsvc" role | 14:26 |
| lajoskatona | ok, thanks | 14:26 |
| ralonsoh | but is Nova using it? | 14:26 |
| slaweq | this patch actually deprecates it and renames it to the "service" role to be consistent with new policies and all projects | 14:26 |
| slaweq | but CI is happy with it so far | 14:26 |
| ralonsoh | sorry but I don't understand that | 14:28 |
| ralonsoh | ADVSVC role was an internal one | 14:28 |
| ralonsoh | only used in Neutron | 14:28 |
| slaweq | yes, and now our context.is_advsvc returns True in both cases - if it's advsvc role or service role: https://github.com/openstack/neutron-lib/blob/master/neutron_lib/context.py#L84 | 14:29 |
| ralonsoh | ok, so we have "converted" this Neutron role to service role | 14:30 |
| slaweq | yes | 14:30 |
| ralonsoh | ok, understood | 14:30 |
| slaweq | but with keeping old name for now too | 14:30 |
| ralonsoh | in any case, you have moved some operations to be only performed by this new role | 14:30 |
| ralonsoh | port binding, for example | 14:30 |
| slaweq | yes | 14:31 |
| ralonsoh | ok, maybe we could have some rants from user in a future | 14:31 |
| slaweq | as it's not needed to be available for admin user and we can just allow it to the advsvc/service role | 14:31 |
| ralonsoh | if they want to make this kind of operations manually (for debugging or testing) | 14:31 |
| slaweq | it's just default policy and can be always overwritten in the policy.yaml file in such case | 14:32 |
| ralonsoh | right | 14:32 |
| ralonsoh | ok, sorry for this time | 14:32 |
| slaweq | no problem | 14:32 |
| ralonsoh | I only wanted to have some answers! | 14:32 |
| slaweq | thx for the questions about it | 14:32 |
| ralonsoh | thanks! | 14:32 |
| ralonsoh | next section | 14:32 |
| ralonsoh | 2) Neutron client deprecation | 14:33 |
| ralonsoh | lajoskatona, please | 14:33 |
| lajoskatona | the usual etherpad: https://etherpad.opendev.org/p/python-neutronclient_deprecation | 14:33 |
| lajoskatona | what is ongoing the sfc work: https://etherpad.opendev.org/p/python-neutronclient_deprecation#L40 | 14:33 |
| lajoskatona | but I suppose in SDK we have to wait with it till the new release will start | 14:34 |
| ralonsoh | is it possible to have the sdk patches during this week? | 14:34 |
| ralonsoh | before the release | 14:34 |
| lajoskatona | I can ask sdk team | 14:34 |
| ralonsoh | that could be perfect | 14:35 |
| lajoskatona | and if you have time please review it, that can be a push for the malso :-) | 14:35 |
| ralonsoh | sure | 14:35 |
| ralonsoh | and I have approved the n-lib patch | 14:35 |
| ralonsoh | I had it open today but I didn't push the buttong | 14:35 |
| lajoskatona | Another thing is that I started to play with Horizon, but that is really just playing with it | 14:35 |
| lajoskatona | ralonsoh: thanks | 14:35 |
| ralonsoh | horizon is another beast... | 14:35 |
| lajoskatona | https://review.opendev.org/c/openstack/horizon/+/891205 | 14:36 |
| lajoskatona | yes, it has some traps which I hit on my first try :-) | 14:36 |
| ralonsoh | but yes, we can propose incremental changes in horizon | 14:36 |
| lajoskatona | but anyway I got some help in review from the horizon team, so at least there's some attention | 14:36 |
| ralonsoh | that could be easier, for sure | 14:36 |
| frickler | does n-lib also count as non-client lib and should be frozen this week? | 14:37 |
| ralonsoh | nope | 14:37 |
| ralonsoh | only (for us) os-ken and ovsdbapp | 14:37 |
| lajoskatona | I thought n-lib also | 14:38 |
| ralonsoh | let me check but I'm almost sure | 14:38 |
| lajoskatona | ok | 14:38 |
| lajoskatona | for the neutron-client topic, that's all from me | 14:38 |
| slaweq | neutron-lib too AFAIK | 14:38 |
| frickler | both n-lib and os-ken have "type:library" | 14:38 |
| slaweq | frickler exactly | 14:38 |
| slaweq | ovn-octavia-provider is not in that category but n-lib is | 14:39 |
| ralonsoh | so I'll ping release folks | 14:39 |
| ralonsoh | (or maybe they didn't have time yet to push the patch) | 14:39 |
| slaweq | but do we need new release of n-lib now? | 14:39 |
| slaweq | it was released about 2-3 weeks ago | 14:40 |
| slaweq | do we have anything new there? | 14:40 |
| ralonsoh | yes but we need the cycle last release | 14:40 |
| ralonsoh | and this is the week for that | 14:40 |
| slaweq | I just checked and there is nothing new: | 14:40 |
| slaweq | tools/list_unreleased_changes.sh master openstack/neutron-lib | 14:40 |
| slaweq | [ Unreleased changes in openstack/neutron-lib (master) ] | 14:40 |
| slaweq | Changes between 3.8.0 and 4f862dac | 14:40 |
| lajoskatona | It was the last release 3 weeks ago: https://review.opendev.org/c/openstack/releases/+/890038 | 14:40 |
| ralonsoh | apart from lajoskatona patch, I don't think there is anything else pending | 14:40 |
| ralonsoh | so this is why release folks didn't send a patch | 14:41 |
| slaweq | yes | 14:41 |
| ralonsoh | because there were no new patches | 14:41 |
| lajoskatona | yeah possible | 14:41 |
| slaweq | but if we want to merge and release something, that's fine if we will do it this week | 14:42 |
| ralonsoh | lajoskatona, do you need https://review.opendev.org/c/openstack/neutron-lib/+/887193 during this cycle? | 14:42 |
| ralonsoh | if so, we can release a new one | 14:42 |
| ralonsoh | if not, we can keep the current one | 14:42 |
| slaweq | api-ref don't need to be released | 14:42 |
| lajoskatona | I dont' think so | 14:42 |
| lajoskatona | it's just documentation | 14:42 |
| slaweq | it's always rendered from the master branch IIRC | 14:42 |
| ralonsoh | perfect, so let's keep the current version we have now | 14:42 |
| lajoskatona | +1 | 14:42 |
| ralonsoh | and that's all I have here | 14:43 |
| ralonsoh | let's move then | 14:43 |
| ralonsoh | #topic on_demand | 14:43 |
| ralonsoh | last weel stephenfin pinged me about including tox py310 with sqlalchemy master | 14:43 |
| ralonsoh | as you saw last days, I added it and is now voting in the check queue | 14:44 |
| ralonsoh | I also removed our local py311 implementation and we are now using the glocal openstack-tox-py311 | 14:44 |
| slaweq | I hope it won't break too often, especially now when we are close to the release | 14:44 |
| ralonsoh | and fixed, as recommended by frickler, our bindep file for some debian library issues with py311 | 14:45 |
| ralonsoh | so far, we are good now | 14:45 |
| frickler | py311 should still be non-voting until next cycle | 14:45 |
| ralonsoh | slaweq, the 2.0 release is in the oven | 14:45 |
| slaweq | ++ | 14:45 |
| ralonsoh | frickler, yes but at least we should manually check if we break something | 14:45 |
| ralonsoh | one sec | 14:46 |
| frickler | yes, just responded to slaweq that it should not block the release | 14:46 |
| ralonsoh | https://review.opendev.org/c/openstack/requirements/+/879743 | 14:46 |
| slaweq | frickler I was thinking more about py310 with sqlalchemy master :) | 14:46 |
| slaweq | I know py311 is non voting for now | 14:46 |
| ralonsoh | actually I prefer having it in the check queue | 14:46 |
| frickler | ah, then I misread that | 14:46 |
| ralonsoh | 2 weeks ago we introduced something that break the 2.0 compatibility | 14:47 |
| ralonsoh | "select 1;" | 14:47 |
| ralonsoh | now is fixed | 14:47 |
| ralonsoh | ok, something else (apart from my dramas with sqlalchemy 2.0 hehehe) ?? | 14:48 |
| slaweq | just FYI | 14:48 |
| frickler | I made no progress with building OVN 23.06 yet, did anyone test that successfully? | 14:48 |
| slaweq | this week I sent email https://lists.openstack.org/pipermail/openstack-discuss/2023-August/034778.html with proposal of some changes to the neutron related questions in OS user survey | 14:48 |
| slaweq | I need to check one more thing and reply to last email from fungi still | 14:49 |
| slaweq | that's all from me | 14:49 |
| mlavalle | can I get someone to push this over the edge, please: https://review.opendev.org/c/openstack/python-openstackclient/+/891557? | 14:49 |
| slaweq | and thx all for the feedback in the etherpad | 14:49 |
| frickler | I agree that most people choose "OVS" but really mean "ML2/OVS" | 14:49 |
| ralonsoh | slaweq, thanks for the time on this | 14:49 |
| slaweq | mlavalle I will check this patch | 14:49 |
| mlavalle | slaweq: thanks | 14:50 |
| ralonsoh | frickler, yes, always, no one is manyally configuring OVS without an orchestrator | 14:50 |
| ralonsoh | same as OVN or SRIOV | 14:50 |
| lajoskatona | frickler: I just checked and I have a devstack with OVN main, and northd said it is ovn-northd 23.06.90 | 14:50 |
| lajoskatona | frickler: I have OVS_BRANCH="v3.1.0" | 14:51 |
| frickler | lajoskatona: oh, testing with main would be an option I guess, yes, I can try that | 14:51 |
| ralonsoh | but is this the git submodule hash recommended by OVN repo? | 14:51 |
| ralonsoh | each OVN branch has a defined OVS branch provided by git submodule | 14:52 |
| lajoskatona | to tell the truth I stolen it from one debvstack job after some unsuccessful tries | 14:52 |
| ralonsoh | frickler, did you try that? I think I commented that in IRC last week | 14:52 |
| frickler | I did not try that yet, os-ken got in the way | 14:53 |
| frickler | but I will test both variants this week | 14:53 |
| ralonsoh | ping me if you still have problems with this after using the recommended version | 14:53 |
| frickler | ack, thx | 14:53 |
| ralonsoh | remember that in 5 mins we have the CI meeting | 14:54 |
| slaweq | ++ | 14:54 |
| ralonsoh | I'll give you some time to grab some coffee | 14:54 |
| ralonsoh | see you in 5 mins | 14:54 |
| mlavalle | o/ | 14:54 |
| ralonsoh | #endmeeting | 14:54 |
| opendevmeet | Meeting ended Tue Aug 22 14:54:23 2023 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:54 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/networking/2023/networking.2023-08-22-14.00.html | 14:54 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/networking/2023/networking.2023-08-22-14.00.txt | 14:54 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/networking/2023/networking.2023-08-22-14.00.log.html | 14:54 |
| lajoskatona | o/ | 14:54 |
| obondarev | o/ | 14:55 |
| bcafarel | o/ | 14:56 |
| slaweq | #startmeeting neutron_ci | 15:00 |
| opendevmeet | Meeting started Tue Aug 22 15:00:39 2023 UTC and is due to finish in 60 minutes. The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
| opendevmeet | The meeting name has been set to 'neutron_ci' | 15:00 |
| ralonsoh | hi | 15:00 |
| mlavalle | o/ | 15:01 |
| slaweq | ping bcafarel, lajoskatona, mlavalle, mtomaska, ralonsoh, ykarel, jlibosva, elvira | 15:01 |
| slaweq | Grafana dashboard: https://grafana.opendev.org/d/f913631585/neutron-failure-rate?orgId=1 | 15:01 |
| mlavalle | slaweq: irc or video? | 15:01 |
| ykarel | o/ | 15:01 |
| bcafarel | o/ | 15:01 |
| slaweq | mlavalle irc today | 15:01 |
| slaweq | I think we can start | 15:01 |
| slaweq | #topic Actions from previous meetings | 15:01 |
| slaweq | ralonsoh to check failed neutron.tests.fullstack.test_l3_agent.TestHAL3Agent.test_keepalived_multiple_sighups_does_not_forfeit_primary test | 15:02 |
| ralonsoh | no, I didn't start with this one | 15:02 |
| ralonsoh | sorry | 15:02 |
| slaweq | no worries | 15:02 |
| slaweq | I didn't saw this issue recently so maybe we can just wait for new occurences | 15:02 |
| slaweq | wdyt? | 15:03 |
| slaweq | and maybe then get back to this | 15:03 |
| ralonsoh | ok for me | 15:03 |
| slaweq | ok, so next one | 15:03 |
| slaweq | mtomaska to check failing neutron-functional-with-sqlalchemy-master periodic job | 15:03 |
| mtomaska | https://review.opendev.org/c/openstack/neutron/+/890939 | 15:03 |
| mtomaska | should be fixed when that patch merges | 15:04 |
| lajoskatona | o/ | 15:04 |
| slaweq | thx for the fix mtomaska, I see it's in the gate now | 15:04 |
| slaweq | so, last one from previous meeting: | 15:04 |
| slaweq | lajoskatona will send DNM patch for neutron-dynamic-routing to check jobs | 15:04 |
| lajoskatona | It was sent and frickler actually found the issue in os-ken | 15:05 |
| lajoskatona | so I sent the DNM and frickler done the rest of the work | 15:05 |
| slaweq | thx lajoskatona and frickler | 15:06 |
| slaweq | so are we good now with it? | 15:06 |
| frickler | and quite a journey it was ;) | 15:06 |
| slaweq | or is it in progress? | 15:06 |
| frickler | we still need to test after os-ken release | 15:06 |
| frickler | because it isn't self testing as mentioned earlier | 15:06 |
| lajoskatona | if we have the os-ken release it should be fine | 15:06 |
| frickler | I only tested on the held node I used for debugging | 15:06 |
| slaweq | ok :) | 15:06 |
| ykarel | or may be fix the jobs so os-ken in patch get's used | 15:06 |
| slaweq | thx a lot to both of You | 15:06 |
| slaweq | ykarel do You mean to use os-ken from master in those jobs? | 15:07 |
| ralonsoh | that was discussed in the previous meeting | 15:08 |
| ykarel | slaweq, iiuc what frickler mean the jobs running against os-ken patches not using those patches but released version | 15:08 |
| ralonsoh | n-d-r job in os-ken CI is not isntalling the tested patch | 15:08 |
| slaweq | ahh, sorry. I probably missed it then | 15:08 |
| ykarel | hmm i was also out last meeting so might be missing context | 15:08 |
| ykarel | so i meant we should instead fix the jobs to work with os-ken patches and not wait for actual release to test :) | 15:09 |
| frickler | well the release is due this week anyway | 15:09 |
| frickler | but fixing the job would be a good task to do, too | 15:09 |
| ykarel | me also not sure if this is a regression or it never worked for os-ken | 15:09 |
| slaweq | ok, so this needs to be fixed indeed | 15:09 |
| slaweq | frickler can You maybe check it this week and open LP if we need to fix jobs in os-ken? | 15:12 |
| slaweq | so we can track it at least and not forget about it | 15:12 |
| frickler | well I'm pretty sure that it is broken | 15:13 |
| frickler | ralonsoh was the one who wanted to take another look and open the bug | 15:13 |
| slaweq | ok, thx | 15:13 |
| slaweq | so ralonsoh will You open LP for it? | 15:13 |
| ralonsoh | yes, I'll check that is broken in the CI execution | 15:13 |
| ralonsoh | yes, after checking the logs | 15:13 |
| slaweq | thx | 15:14 |
| slaweq | #action ralonsoh to check n-d-r os-ken jobs and open LP related to it | 15:14 |
| slaweq | ok, I think we can move on | 15:14 |
| slaweq | #topic Stable branches | 15:14 |
| slaweq | bcafarel anything new/urgent? | 15:14 |
| bcafarel | no, all good overall :) | 15:15 |
| bcafarel | recent backports passed gates smoothly, up to ussuri | 15:15 |
| slaweq | ok | 15:16 |
| slaweq | so I think we can move on then | 15:16 |
| slaweq | #topic Stadium projects | 15:16 |
| slaweq | anything to discuss here? except n-d-r and os-ken which we already talked about | 15:16 |
| lajoskatona | We discussed n-d-r, so that is one thing to keep an eye on | 15:17 |
| lajoskatona | the other topic is bagpipe | 15:17 |
| lajoskatona | it is failing with SQLAlchemy 2, I proposed a patch: https://review.opendev.org/c/openstack/networking-bagpipe/+/891325 | 15:17 |
| lajoskatona | but some test still fails randomly for the sfc driver, so I have to spend some more time with it | 15:17 |
| lajoskatona | that's it for the stadiums | 15:18 |
| slaweq | are those random failures also related to SQLAlchemy 2.0? or something different? | 15:18 |
| lajoskatona | no I see them only with sqlalchemy2 | 15:19 |
| slaweq | ok, so maybe ralonsoh and/or stephenfin will be able to help with them somehow | 15:19 |
| ralonsoh | I'll try to find the issue there | 15:20 |
| slaweq | thx a lot | 15:20 |
| lajoskatona | thanks | 15:20 |
| slaweq | next topic then | 15:20 |
| slaweq | #topic Grafana | 15:20 |
| slaweq | https://grafana.opendev.org/d/f913631585/neutron-failure-rate | 15:22 |
| slaweq | I see that rally jobs were broken last week but it's fixed on rally side already | 15:22 |
| slaweq | other than that it's as usual | 15:22 |
| mlavalle | +1 | 15:23 |
| slaweq | I think we can move on then | 15:24 |
| slaweq | #topic Rechecks | 15:24 |
| slaweq | it was a bit better last week already but then there was this issue with rally and issue with GLOBAL_VENV in devstack which made it a bit worst | 15:24 |
| opendevreview | Merged openstack/neutron master: [sqlalchemy-20] TableClause.insert constructs Insert object https://review.opendev.org/c/openstack/neutron/+/890939 | 15:25 |
| slaweq | but those problems are already fixed so I think it's pretty ok in overall | 15:25 |
| slaweq | so I think we can move on to talk about some specific failures | 15:25 |
| slaweq | #topic fullstack/functional | 15:25 |
| slaweq | here I found one new (for me) failure in the neutron.tests.functional.plugins.ml2.drivers.ovn.mech_driver.ovsdb.test_maintenance.TestMaintenance.test_port_forwarding | 15:26 |
| slaweq | https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_8a2/periodic/opendev.org/openstack/neutron/master/neutron-functional-with-pyroute2-master/8a279fa/testr_results.html | 15:26 |
| slaweq | it was in periodic job so it's not related to any patch in progress | 15:26 |
| slaweq | anyone wants to check it deeper maybe? Or if not we can wait if it will happen more often | 15:27 |
| ralonsoh | this is a callback, could be just a race condition | 15:27 |
| ralonsoh | I can check it and maybe limit the check to the expected call | 15:27 |
| slaweq | ralonsoh++ thx a lot | 15:27 |
| slaweq | #action ralonsoh to check failure in the neutron.tests.functional.plugins.ml2.drivers.ovn.mech_driver.ovsdb.test_maintenance.TestMaintenance.test_port_forwarding | 15:27 |
| slaweq | and that's all regarding functional/fullstack tests | 15:28 |
| slaweq | #topic Tempest/Scenario | 15:28 |
| slaweq | here I noticed kernel panic in guest vm (again?): | 15:28 |
| slaweq | https://cbf8616008e0e2c2dfec-9346de3bff5d83c6d90eefafd8632b44.ssl.cf1.rackcdn.com/884474/13/check/tempest-integrated-networking/0e81b62/testr_results.html | 15:28 |
| slaweq | I'm not really even sure what Cirros version was used there | 15:29 |
| slaweq | so maybe it's not an issue at all but just wanted to highlight here that I saw it again | 15:29 |
| lajoskatona | cirros 6.2 | 15:29 |
| slaweq | so should be good, right? | 15:29 |
| slaweq | maybe it's new issue then, idk | 15:29 |
| ykarel | no shouldn't be related to cirros 6.2 | 15:30 |
| ykarel | i recall it's an old issue and it's workedaround in our job by using uec images | 15:30 |
| slaweq | ykarel - possibly as this issue was in the tempest-integrated-networking job which is in tempest repo | 15:30 |
| ykarel | yeap | 15:31 |
| slaweq | so if that will happen more often we will maybe need to propose same workaround in that job too | 15:31 |
| slaweq | lets keep an eye on it for now | 15:31 |
| slaweq | is that ok for You? | 15:31 |
| ykarel | +1 | 15:31 |
| ralonsoh | +1 | 15:31 |
| lajoskatona | +1 | 15:31 |
| slaweq | thx | 15:32 |
| slaweq | so next topic | 15:32 |
| slaweq | #topic grenade | 15:32 |
| slaweq | I saw (again just once but wanted to mention it) some issue related to keystone: https://53ec660a16b30e470118-779b81139f4f29276caf956abf2a020f.ssl.cf2.rackcdn.com/890939/3/gate/neutron-ovs-grenade-dvr-multinode/f868b9c/controller/logs/grenade.sh_log.txt | 15:32 |
| slaweq | did You saw something like that already? Is it something what we should report maybe to the keystone team? | 15:32 |
| ralonsoh | yes, could be usefull for them to know this | 15:33 |
| ralonsoh | doesn't seem to be related to Neutron | 15:33 |
| slaweq | ok, I will let know about it to knikolla | 15:33 |
| slaweq | #topic Periodic | 15:34 |
| slaweq | here I saw 2 issues which we need to handle somehow: | 15:35 |
| slaweq | fullstack fips job broken: https://zuul.openstack.org/build/b87d8c3037a1417193c865bc576ac593 | 15:35 |
| slaweq | and Centos 9 Stream jobs broken: | 15:35 |
| slaweq | https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_cbf/periodic/opendev.org/openstack/neutron/master/neutron-ovn-tempest-ovs-master-centos-9-stream/cbf72a9/job-output.txt | 15:35 |
| slaweq | https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_533/periodic/opendev.org/openstack/neutron/master/neutron-ovn-tempest-ovs-release-fips/5331cd4/job-output.txt | 15:35 |
| slaweq | anyone wants to check those? | 15:35 |
| ykarel | sounds related to GLOBAL_VENV thing | 15:36 |
| ralonsoh | right | 15:36 |
| * haleyb noticed the centos9 job too trying to recreate a bug, but didn't dig into it | 15:36 | |
| ralonsoh | I'll check the centos9 error | 15:36 |
| frickler | cf. https://review.opendev.org/c/openstack/tempest/+/891517 | 15:37 |
| slaweq | ok, I will check fullstack fips job then | 15:37 |
| ralonsoh | ok so the centos9 issue seems to be solve there | 15:37 |
| slaweq | #action ralonsoh to check Centos 9 stream jobs failures | 15:37 |
| slaweq | thx frickler | 15:37 |
| slaweq | #action slaweq to check fips fullstack job failures | 15:38 |
| slaweq | that's all regarding periodic jobs from me | 15:38 |
| slaweq | #topic On Demand | 15:38 |
| slaweq | do You have anything else to discuss today? | 15:38 |
| ykarel | just one thing as more people are here | 15:39 |
| ykarel | i raised it over the patch https://review.opendev.org/c/openstack/neutron/+/892134 | 15:39 |
| ralonsoh | I think I addressed your comment | 15:40 |
| ralonsoh | right? | 15:40 |
| ralonsoh | I removed the experimental job | 15:40 |
| ykarel | ralonsoh, yeap related to duplicating jobs in periodic/experimental and check | 15:40 |
| ralonsoh | yeah, let's have it only in check queue | 15:40 |
| ykarel | but i had a concern to avoid blocking CI with such jobs if master commits from sqlalchemy and alembic | 15:41 |
| slaweq | ralonsoh but I also agree with ykarel that this job maybe should be non-voting one in check queue | 15:41 |
| ralonsoh | at this point, that should always work | 15:41 |
| ralonsoh | we should not include anything not compatible with sqlalchemy 2.0 | 15:41 |
| ralonsoh | but if you agree on this, I'll mark it as non-voting | 15:42 |
| slaweq | yeah, but the point is - will sqlalchemy not merge anything breaking for us? :) | 15:42 |
| ralonsoh | ok, I'll push a new patch marking it as non-voting | 15:42 |
| haleyb | but we should pay attention to job during review :) | 15:43 |
| ykarel | yeap non-voting jobs might get unnoticed | 15:43 |
| slaweq | so maybe keep it voting for now and we can always switch it to non-voting in case of any problems from sqlalchemy side | 15:43 |
| ralonsoh | perfect | 15:43 |
| ralonsoh | so as is now | 15:44 |
| haleyb | +1 | 15:44 |
| slaweq | ok | 15:44 |
| ykarel | ok and hope it get's all good +1 | 15:44 |
| slaweq | I also have one additional topic/announcement for today | 15:44 |
| slaweq | as You probably noticed, I'm chair of this CI meeting for quite some time (6+ years already if I'm not mistaken) | 15:45 |
| slaweq | and recently I though it would be good to pass it to someone else | 15:45 |
| slaweq | so starting next week ykarel will be our new chair of the CI meeting | 15:45 |
| ralonsoh | slaweq, thanks for all these years! | 15:45 |
| slaweq | thx ykarel for stepping up in this role :) | 15:45 |
| ralonsoh | and thanks ykarel for steeping up! | 15:45 |
| lajoskatona | thanks for the efforts to keep these topics in focus | 15:46 |
| ykarel | Thanks slaweq for all your efforts for all your efforts in those years | 15:46 |
| mlavalle | thanks for leading the meeting for so long slaweq | 15:46 |
| mlavalle | and welcome yka | 15:46 |
| mlavalle | ykarel: | 15:46 |
| ykarel | thx everyone | 15:47 |
| slaweq | and that's all from me for today | 15:47 |
| lajoskatona | welcome ykarel as chair of this meeting:-) | 15:47 |
| slaweq | if there are no other topics, I will give You back few minutes today | 15:47 |
| slaweq | ok, thx for attending and have a great week everyone | 15:48 |
| slaweq | #endmeeting | 15:48 |
| opendevmeet | Meeting ended Tue Aug 22 15:48:13 2023 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:48 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/neutron_ci/2023/neutron_ci.2023-08-22-15.00.html | 15:48 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/neutron_ci/2023/neutron_ci.2023-08-22-15.00.txt | 15:48 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/neutron_ci/2023/neutron_ci.2023-08-22-15.00.log.html | 15:48 |
| ralonsoh | see you! thank you | 15:48 |
| slaweq | o/ | 15:48 |
| ralonsoh | lajoskatona, very quick: https://review.opendev.org/c/openstack/networking-bagpipe/+/891325/3/networking_bagpipe/driver/sfc.py#555 | 15:48 |
| ykarel | o/ | 15:48 |
| lajoskatona | o/ | 15:48 |
| lajoskatona | ralonsoh: I check it, thanks for it, it was quick :-) | 15:49 |
| frickler | slaweq: fips failure is the same thing https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_533/periodic/opendev.org/openstack/neutron/master/neutron-ovn-tempest-ovs-release-fips/5331cd4/controller/logs/screen-keystone.txt | 15:58 |
| opendevreview | Merged openstack/neutron-lib master: api-ref: Move sfc api-ref to neutron-lib https://review.opendev.org/c/openstack/neutron-lib/+/887193 | 16:08 |
| opendevreview | Merged openstack/neutron master: Add "openstack-tox-py310-with-sqlalchemy-master" to check queue https://review.opendev.org/c/openstack/neutron/+/892134 | 16:25 |
| opendevreview | Rodolfo Alonso proposed openstack/neutron-tempest-plugin master: [DNM] Add "tox" role to n-d-r CI job https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/892375 | 16:30 |
| opendevreview | Rodolfo Alonso proposed openstack/neutron-tempest-plugin master: [DNM] Add "tox" role to n-d-r CI job https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/892375 | 17:25 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!