| opendevreview | liuyulong proposed openstack/neutron master: Refactor DHCP common config options https://review.opendev.org/c/openstack/neutron/+/798285 | 00:52 |
|---|---|---|
| opendevreview | Merged openstack/neutron master: Copy existing IPv6 leases to generated lease file https://review.opendev.org/c/openstack/neutron/+/762874 | 02:14 |
| opendevreview | Akihiro Motoki proposed openstack/neutron-vpnaas stable/stein: Call helper to convert bytes to str for Python3 in netns-wrapper https://review.opendev.org/c/openstack/neutron-vpnaas/+/798331 | 06:34 |
| *** ChanServ sets mode: +o slaweq | 08:02 | |
| *** ChanServ sets mode: -o slaweq | 08:07 | |
| opendevreview | Merged openstack/neutron master: Add fullstack test case for OVS DHCP extension https://review.opendev.org/c/openstack/neutron/+/776568 | 08:37 |
| slaweq | ralonsoh hi, can You use Your stable +2 power and check https://review.opendev.org/q/If6ef990baf039c556d7420962ac4c54608711f06 ? | 09:13 |
| slaweq | thx in advance :) | 09:13 |
| ralonsoh | sure | 09:13 |
| opendevreview | yangjianfeng proposed openstack/neutron-lib master: [WIP] Adds l3-ndp-proxy extension api definition https://review.opendev.org/c/openstack/neutron-lib/+/747523 | 09:26 |
| opendevreview | Merged openstack/neutron-lib master: Add Neutron's functional job to the neutron-lib's CI https://review.opendev.org/c/openstack/neutron-lib/+/797281 | 09:31 |
| slaweq | lajoskatona ralonsoh can one of You approve https://review.opendev.org/c/openstack/neutron/+/796272 maybe? | 09:40 |
| slaweq | thx in advance | 09:40 |
| slaweq | or ralonsoh let me know if I should bump oslo_log version and update that constants there | 09:40 |
| ralonsoh | slaweq, why do you need a new version of oslo_log? | 09:41 |
| slaweq | ralonsoh as XENA constant is available in version which isn't in lower-constraints IIRC | 09:42 |
| ralonsoh | ah yes | 09:42 |
| ralonsoh | slaweq, let me check where is this constant | 09:42 |
| ralonsoh | slaweq, this is in oslo.log==4.5.0 | 09:44 |
| slaweq | yes | 09:45 |
| slaweq | do You want me to update that patch quickly? | 09:45 |
| ralonsoh | (it's on the comment...) | 09:45 |
| ralonsoh | no, no need | 09:45 |
| slaweq | and bump oslo_log in lower-constraints? | 09:45 |
| slaweq | ok, thx | 09:45 |
| ralonsoh | (I'm a bit blurry today) | 09:45 |
| slaweq | after match yesterday? :) | 09:46 |
| ralonsoh | ah yes, what a match | 09:46 |
| lajoskatona | slaweq: rodolfo was quicker than me:-) | 09:49 |
| slaweq | lajoskatona thx to You also :) | 09:49 |
| stephenfin | o/ We're seeing some issues in nova CI jobs since yesterday. Apparently the port binding feature is being reported as unavailable | 09:58 |
| stephenfin | Specifically https://bugs.launchpad.net/nova/+bug/1933954 and https://bugs.launchpad.net/nova/+bug/1933958 | 09:58 |
| opendevreview | yangjianfeng proposed openstack/neutron stable/train: Add extension unit tests for conntrack_helper plugin https://review.opendev.org/c/openstack/neutron/+/774492 | 09:59 |
| stephenfin | As you can see in the logs in the second of those from lyarwood, neutron is reporting "Extension binding-extended not supported by any of loaded plugins" | 09:59 |
| stephenfin | does this ring a bell? | 09:59 |
| stephenfin | slaweq: I have a suspicion that ^ might be related to your change https://review.opendev.org/c/openstack/neutron/+/793141 | 10:04 |
| slaweq | stephenfin yeah, I'm checking it right now | 10:04 |
| slaweq | stephenfin yes, it seems we are missing binding-extended in the https://github.com/openstack/neutron/blob/master/neutron/common/ovn/extensions.py#L85 | 10:08 |
| slaweq | :/ | 10:08 |
| stephenfin | well at least it's easy to fix :) | 10:09 |
| stephenfin | can that be fixed easily, or should we revert the broken change temporarily to unblock the nova gate? | 10:09 |
| slaweq | should be easy to fix, give me 2 minutes and I will propose patch | 10:11 |
| stephenfin | ty :) | 10:12 |
| opendevreview | Slawek Kaplonski proposed openstack/neutron master: [OVN] Add binding-extended to the ML2_SUPPORTED_API_EXTENSIONS https://review.opendev.org/c/openstack/neutron/+/798634 | 10:12 |
| slaweq | stephenfin can You try with ^^ ? | 10:13 |
| stephenfin | slaweq: Sure, I'll watch https://review.opendev.org/c/openstack/nova/+/798635 | 10:15 |
| stephenfin | assuming the depends on works | 10:15 |
| slaweq | yes, depends should work | 10:16 |
| slaweq | thx | 10:16 |
| opendevreview | Merged openstack/neutron master: Refactor DHCP common config options https://review.opendev.org/c/openstack/neutron/+/798285 | 10:34 |
| opendevreview | yangjianfeng proposed openstack/neutron stable/ussuri: Keepalived version check https://review.opendev.org/c/openstack/neutron/+/798335 | 11:06 |
| opendevreview | yangjianfeng proposed openstack/neutron stable/ussuri: HA-non-DVR router don't need manually add static route https://review.opendev.org/c/openstack/neutron/+/792876 | 11:08 |
| opendevreview | Mamatisa Nurmatov proposed openstack/neutron master: use payloads for PORT AFTER_DELETE events https://review.opendev.org/c/openstack/neutron/+/797004 | 11:11 |
| opendevreview | Rodolfo Alonso proposed openstack/neutron master: Sanitize MAC addresses https://review.opendev.org/c/openstack/neutron/+/789831 | 11:27 |
| *** tbhchman is now known as tbachman | 11:29 | |
| ralonsoh | slaweq, lajoskatona do you think we can merge https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/520251? | 11:40 |
| slaweq | ralonsoh IMO yes | 11:41 |
| ralonsoh | I didn't +W because there was a lot of discussion around how to test the OF rules | 11:42 |
| slaweq | yes, there was this (IMO ugly) loop but as Iwamoto explained why it was like that, I'm ok with it | 11:43 |
| ralonsoh | perfect | 11:45 |
| lajoskatona | ralonsoh, slaweq: this should work with all backends (ovn, ovs, lb...) am I right? | 11:45 |
| ralonsoh | lajoskatona, yes | 11:45 |
| opendevreview | Slawek Kaplonski proposed openstack/neutron master: Add extra logs to the network update callback in L3 agent https://review.opendev.org/c/openstack/neutron/+/798648 | 11:49 |
| slaweq | ralonsoh can You also check https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/796858 ? | 11:52 |
| slaweq | stephenfin binding-extended extension is now available in jobs in https://review.opendev.org/c/openstack/nova/+/798635 - I'm not sure if failure in nova-live-migrate job there is still related to neutron, IMO not, but would be great if You could check also :) | 11:57 |
| opendevreview | Merged openstack/neutron stable/stein: Remove FIP agent's gw port when L3 agent is deleted https://review.opendev.org/c/openstack/neutron/+/797807 | 11:59 |
| opendevreview | Merged openstack/neutron stable/queens: Remove FIP agent's gw port when L3 agent is deleted https://review.opendev.org/c/openstack/neutron/+/797762 | 12:19 |
| *** elvira1 is now known as elvira | 13:25 | |
| slaweq | #startmeeting networking | 14:00 |
| opendevmeet | Meeting started Tue Jun 29 14:00:04 2021 UTC and is due to finish in 60 minutes. The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
| opendevmeet | The meeting name has been set to 'networking' | 14:00 |
| mlavalle | o/ | 14:00 |
| gibi | \o | 14:00 |
| amotoki | hi | 14:00 |
| obondarev | hi | 14:00 |
| slaweq | hi | 14:00 |
| lajoskatona | o/ | 14:00 |
| slaweq | let's start | 14:02 |
| slaweq | #topic Announcements | 14:02 |
| slaweq | Xena cycle calendar https://releases.openstack.org/xena/schedule.html | 14:02 |
| slaweq | Xena-2 milesone is in few weeks - Jul 12th | 14:02 |
| ralonsoh | hi | 14:02 |
| manub | hi | 14:02 |
| slaweq | we are going well with specs - thanks for all reviews You did | 14:03 |
| slaweq | and we still have few of them opened so there is more work to do there :) | 14:03 |
| rubasov | hi | 14:03 |
| mlavalle | Today I'll review https://review.opendev.org/c/openstack/neutron-specs/+/783791 | 14:03 |
| ivc_ | o/ | 14:03 |
| slaweq | thx mlavalle | 14:04 |
| slaweq | except that one, there is also https://review.opendev.org/c/openstack/neutron-specs/+/770540 opened | 14:04 |
| mlavalle | yeah, that would be the next one for me | 14:04 |
| slaweq | thx | 14:04 |
| mlavalle | most likely tomorrow | 14:05 |
| slaweq | ok, next one | 14:05 |
| slaweq | Drivers team members are now ops in the neutron channel: https://review.opendev.org/c/openstack/project-config/+/796521 | 14:05 |
| slaweq | just a heads-up that some of You have now new "super powers" :) | 14:05 |
| mlavalle | so we can wreck it? | 14:05 |
| ralonsoh | I was going to ask this | 14:05 |
| slaweq | mlavalle You can try :P | 14:05 |
| mlavalle | LOL | 14:06 |
| slaweq | but remember - https://www.youtube.com/watch?v=kb4jEHmH_kU :D | 14:06 |
| manub | :) | 14:07 |
| slaweq | and that's all announcements from me for today | 14:07 |
| slaweq | do You have anything else You want to share with the team now? | 14:07 |
| slaweq | if not I think we can move on | 14:09 |
| slaweq | #topic Blueprints | 14:09 |
| slaweq | Neutron Xena-2 https://bugs.launchpad.net/neutron/+milestone/xena-2 | 14:09 |
| slaweq | I marked as implemented https://blueprints.launchpad.net/neutron/+spec/distributed-dhcp-for-ml2-ovs and https://blueprints.launchpad.net/neutron/+spec/default-dns-zone-per-tenant | 14:10 |
| slaweq | as all related patches are now merged | 14:10 |
| slaweq | for https://blueprints.launchpad.net/neutron/+spec/bfd-support-for-neutron and https://blueprints.launchpad.net/neutron/+spec/explicit-management-of-default-routes we have already merged specs | 14:11 |
| mlavalle | Nice! | 14:11 |
| slaweq | ohh, so there is one more "prio" spec to review: https://review.opendev.org/c/openstack/neutron-specs/+/779511 | 14:12 |
| slaweq | it's related to https://blueprints.launchpad.net/neutron/+spec/multiple-external-gateways | 14:12 |
| mlavalle | added to my pile of this week. Coukld you please add it to the high priority reviews dashboard? | 14:13 |
| mlavalle | that way I don't forget | 14:13 |
| slaweq | mlavalle I just did | 14:13 |
| slaweq | thank You | 14:13 |
| mlavalle | Thanks! | 14:13 |
| rubasov | mlavalle, slaweq: thanks | 14:13 |
| slaweq | and that are all updates from me regarding Blueprints | 14:13 |
| slaweq | any other updates regarding Blueprints? | 14:13 |
| obondarev | Node Local IP spec is published: https://review.opendev.org/c/openstack/neutron-specs/+/797798 | 14:13 |
| obondarev | early comments are welcome :) | 14:13 |
| mlavalle | do you want to implement it this cycle? | 14:14 |
| obondarev | I guess start this cycle | 14:14 |
| obondarev | Y is more realistic | 14:15 |
| mlavalle | ahh, ok. Just to have an idea of priorities | 14:15 |
| mlavalle | I'll look at it soon, anyways | 14:15 |
| slaweq | obondarev ok, thx | 14:15 |
| obondarev | thanks | 14:15 |
| slaweq | so I set it to "neutron next" to not forget :) | 14:15 |
| slaweq | if there are no other updates, I think we can move on to the next topic | 14:17 |
| slaweq | #topic Bugs | 14:18 |
| slaweq | amotoki was bug deputy last week | 14:18 |
| * mlavalle likes amotoki's bug report format | 14:18 | |
| amotoki | my report is found at http://lists.openstack.org/pipermail/openstack-discuss/2021-June/023362.html sorry for late | 14:18 |
| amotoki | there are three bugs which need attentions: one OVN related and two DVR related. | 14:19 |
| amotoki | I haven't succeeded to repro the OVN one related to security group rule operation | 14:20 |
| amotoki | mlavalle: thanks | 14:20 |
| slaweq | I will take a look at the OVN one | 14:20 |
| ralonsoh | me neither, I don't know what is failing there | 14:20 |
| haleyb | slaweq: i was going to add a comment to the OVN one as it affects octavia, not sure how to address it | 14:21 |
| slaweq | Regarding https://bugs.launchpad.net/neutron/+bug/1933234 I today took a look. I have some initial toughts what is wrong there but I will need more logs in the L3 agent to confirm that | 14:22 |
| slaweq | haleyb sure, feel free to take it if You want or update with Your ideas. I will take a look at it too, maybe I will find something there :) | 14:22 |
| haleyb | slaweq: ack, i'll ping you after meeting since we need to work around it in Octavia | 14:23 |
| amotoki | regarding ONV one, 409 conflict will be retuned when an exception happens during BEFORE_DELETE hook. | 14:24 |
| amotoki | I am not sure we may want to control an exception more granually or it is just a bug in ovn driver. | 14:24 |
| haleyb | amotoki: the rule might not exist, so returning a 409 seems wrong. But i'm not sure we can change to SecurityGroupRuleNotFound without breaking something ? | 14:26 |
| haleyb | without any callback registered it would return SecurityGroupRuleNotFound | 14:26 |
| haleyb | i.e. without OVN | 14:26 |
| amotoki | haleyb: yeah, I am not sure what is wrong. it happens in BEFORE_DELETE so I wonder why not found is raised.... | 14:27 |
| opendevreview | Ilya Chukhnakov proposed openstack/neutron-specs master: [WIP] Add Node-Local Virtual IP Spec https://review.opendev.org/c/openstack/neutron-specs/+/797798 | 14:27 |
| haleyb | amotoki: the _registry_notify() call specifies SecurityGroupRuleInUse, which i'm assuming is the default when it fails? | 14:28 |
| haleyb | the callee can't say why it failed | 14:28 |
| amotoki | haleyb: yes, my understanding is same, but the error message from OVN driver says the rule is not found. that confuses me. | 14:29 |
| haleyb | a few lines down it calls "sgr = self._get_security_group_rule(context, id)" which would also have returned Not Found, right? | 14:29 |
| slaweq | amotoki maybe it wasn't found in ovn db? | 14:29 |
| amotoki | slaweq: it might be. | 14:29 |
| amotoki | it may happen | 14:30 |
| haleyb | slaweq: i wonder if it's in the neutron DB? would be easy enough to verifiy with two calls | 14:30 |
| haleyb | the bug report says there were multiple calls to remove the same rule | 14:30 |
| slaweq | haleyb is it failing everytime in Octavia CI? | 14:30 |
| slaweq | or sometimes only? | 14:30 |
| haleyb | gthiemonge would know | 14:30 |
| amotoki | I wonder it happens in a race condition. | 14:31 |
| gthiemonge | hi | 14:31 |
| haleyb | gthiemonge: talking about the SG issue with OVN | 14:31 |
| amotoki | gthiemonge: we are talking about https://bugs.launchpad.net/bugs/1933638 you filed. | 14:31 |
| haleyb | and i saw https://review.opendev.org/c/openstack/octavia/+/798676 to try and work around it | 14:32 |
| gthiemonge | so, it happened many times in CI, I didn't reproduce it in my env | 14:32 |
| gthiemonge | In CI, we are deleting 2 or 3 times the same SG rule, the first one is ok, the 2nd one gets a 409 and sometimes there's 3rd one that gets a 404 | 14:33 |
| amotoki | thanks, so a race condition seems to happen. | 14:34 |
| slaweq | yes | 14:34 |
| haleyb | oh, so it's not always a 409 on second and greater | 14:34 |
| slaweq | and 409 is definitely wrong as response to DELETE request | 14:34 |
| amotoki | slaweq: totally agree | 14:34 |
| ralonsoh | folks, if the SG rule does not exist, the BEFORE_DELETE will raise always this exception in OVN | 14:35 |
| ralonsoh | just reading the code | 14:35 |
| haleyb | ralonsoh: that's what it looks like to me too | 14:35 |
| ralonsoh | so we need to "hide" this exception in the event | 14:36 |
| amotoki | perhaps we can improve the notification logic so that we can control an exception raised. | 14:36 |
| ralonsoh | and let the DB transaction to fail correctly | 14:36 |
| amotoki | +1 | 14:36 |
| ralonsoh | (1 bug less) | 14:36 |
| gthiemonge | gthiemonge: I have this log file: https://9d5339e09bfaa3ab0b67-c3fbbb652718002c010964532c238f5b.ssl.cf5.rackcdn.com/798676/1/check/octavia-v2-dsvm-scenario/de9eccb/controller/logs/screen-q-svc.txt | 14:37 |
| gthiemonge | starting at 12:36:00.226969 | 14:37 |
| slaweq | ralonsoh do You want to send patch for that? | 14:37 |
| gthiemonge | 3 DELETEs, response codes: 204, 404, 409 | 14:37 |
| ralonsoh | sure, right now | 14:37 |
| slaweq | ++ | 14:37 |
| slaweq | thank You | 14:37 |
| gthiemonge | ralonsoh: thanks ;-) | 14:38 |
| haleyb | ralonsoh: yes, catching that and just returning might help, but it's odd we get multiple responses, anyways probably time to move on | 14:38 |
| slaweq | ralonsoh assigned that bug to You | 14:38 |
| slaweq | ok, thx amotoki for great summary of the bug deputy week | 14:40 |
| amotoki | one last thing I would like to raise is https://bugs.launchpad.net/bugs/1930866 It was filed as a normal bug but it leads to an API change to handle this, so I marked it as RFE. feel free to share you thoughts. | 14:40 |
| slaweq | any other bugs to discuss today? | 14:40 |
| amotoki | we don't need to discuss it here though. | 14:40 |
| amotoki | that's all from me. | 14:41 |
| slaweq | thx amotoki | 14:41 |
| slaweq | regarding that RFE I will check it later this week | 14:41 |
| slaweq | but from quick look I think we discussed something like that with Nova team on one of the PTGs already | 14:42 |
| slaweq | ok, so we should have something like "locked" port and then forbid to delete it probably | 14:43 |
| slaweq | I will check it and we will discuss it in the drivers meeting later | 14:43 |
| slaweq | so I think we can move on if there are no other bugs to discuss | 14:44 |
| slaweq | mlavalle is our bug deputy this week | 14:44 |
| mlavalle | o/ | 14:44 |
| slaweq | and next week will be rubasov's turn | 14:44 |
| rubasov | ack | 14:44 |
| slaweq | thx | 14:45 |
| * mlavalle would appreciate if ralonsoh takes another look at https://bugs.launchpad.net/neutron/+bug/1933813. Submitter added some more info | 14:45 | |
| ralonsoh | mlavalle, sure | 14:45 |
| slaweq | ok, so last topic for today | 14:45 |
| slaweq | #topic On Demand Agenda | 14:45 |
| slaweq | ralonsoh You added topic there | 14:45 |
| slaweq | so all channel is Yours :) | 14:45 |
| ralonsoh | sorry, link? | 14:46 |
| ralonsoh | to the agenda | 14:46 |
| slaweq | (ralonsoh): https://bugs.launchpad.net/neutron/+bug/1933517. Proposed solution: https://bugs.launchpad.net/neutron/+bug/1933517/comments/1 | 14:46 |
| slaweq | https://wiki.openstack.org/wiki/Network/Meetings | 14:46 |
| ralonsoh | ahhh yes, sorry | 14:46 |
| ralonsoh | we have a serious problem with OVN live migrations | 14:46 |
| ralonsoh | in OVS with hybrid plug we are ok | 14:46 |
| ralonsoh | because os-vif creates a bridge between the VM and OVS | 14:46 |
| ralonsoh | so Neutron is aware of this new port and creates the needed rules | 14:47 |
| ralonsoh | when the VM is unpaused, the backend (OVS) is ready | 14:47 |
| ralonsoh | in OVN and OVS native, this is not happening | 14:47 |
| ralonsoh | because libvirt creates the port when the VM is unpaused | 14:47 |
| ralonsoh | what Sean Mooney is proposing is something similar to OVS hhybird | 14:48 |
| ralonsoh | but with OVS bridges, created and deleted by os-vif | 14:48 |
| ralonsoh | 1) this is 100% compatible with DPDK | 14:48 |
| ralonsoh | 2) that won't affect performance: the bridge will collapse in the dataplane | 14:48 |
| ralonsoh | of course, we'll have one extra bridge per VM port | 14:49 |
| ralonsoh | so, this is is, in a nuthsell, the problem and the proposed solution | 14:49 |
| ralonsoh | do you need a spec? a BP? | 14:49 |
| ralonsoh | or this is a no-go feature | 14:49 |
| ralonsoh | (btw, in os-vif we don't differenciate OVS native or OVN ports, that will be applicable to OVS too) | 14:50 |
| ralonsoh | and will be configurable | 14:50 |
| ralonsoh | that's all, feedback welcome | 14:50 |
| slaweq | IMO it's "go" feature for sure as it will solve valid issue | 14:50 |
| slaweq | what are the cons of it? | 14:51 |
| amotoki | a spec sounds reasonable to me as we need to capture the issue and understand the solution correctly. it also helps users understand the change. | 14:51 |
| ralonsoh | amotoki, perfect | 14:51 |
| mlavalle | yeah, let's follow the RFE/spec process | 14:51 |
| ralonsoh | cons: more bridges in OVS | 14:51 |
| ralonsoh | mlavalle, I'll propose it | 14:51 |
| mlavalle | that way we can thoroughly discuss it | 14:51 |
| amotoki | I am not sure how the number of OVS bridges affects the performance. too many bridge works? | 14:52 |
| rubasov | maybe it could be converged to how trunk ports have an extra bridge | 14:52 |
| rubasov | and then we would kill a few limitations of converting between normal and trunk ports | 14:52 |
| ralonsoh | this is not planning using linux bridges, but OVS ones | 14:52 |
| ralonsoh | I wouldn't mix features | 14:53 |
| ralonsoh | and the goal is to make neutron agnostic to this (with some exceptions related to QoS) | 14:53 |
| ralonsoh | do everything in os-vif | 14:53 |
| ralonsoh | anyway, I'llpresent a spec | 14:53 |
| slaweq | ++ for spec | 14:54 |
| amotoki | so do we convert https://bugs.launchpad.net/neutron/+bug/1933517 into RFE? | 14:54 |
| ralonsoh | yes, should be a RFE | 14:55 |
| slaweq | strictly speaking it should be like that IMO | 14:55 |
| amotoki | :) | 14:55 |
| amotoki | I added rfe-triaged tag to it | 14:56 |
| slaweq | thx amotoki | 14:56 |
| slaweq | we are almost on top of the hour now | 14:57 |
| slaweq | and I think we can finish it now | 14:57 |
| ralonsoh | bye | 14:57 |
| slaweq | thx for attending the meeting today | 14:57 |
| slaweq | o/ | 14:57 |
| rubasov | o/ | 14:57 |
| slaweq | #endmeeting | 14:57 |
| opendevmeet | Meeting ended Tue Jun 29 14:57:46 2021 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:57 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/networking/2021/networking.2021-06-29-14.00.html | 14:57 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/networking/2021/networking.2021-06-29-14.00.txt | 14:57 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/networking/2021/networking.2021-06-29-14.00.log.html | 14:57 |
| ivc_ | \o | 14:57 |
| amotoki | o/ | 14:57 |
| lajoskatona | o/ | 14:57 |
| slaweq | #startmeeting neutron_ci | 15:00 |
| opendevmeet | Meeting started Tue Jun 29 15:00:06 2021 UTC and is due to finish in 60 minutes. The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
| opendevmeet | The meeting name has been set to 'neutron_ci' | 15:00 |
| ralonsoh | hi | 15:00 |
| slaweq | hi again :) | 15:00 |
| obondarev | hi | 15:00 |
| slaweq | First of all Grafana dashboard: http://grafana.openstack.org/dashboard/db/neutron-failure-rate | 15:00 |
| slaweq | ok, let's start | 15:01 |
| slaweq | #topic Actions from previous meetings | 15:01 |
| slaweq | slaweq to check failing update mtu fullstack test: https://bugs.launchpad.net/neutron/+bug/1933234 | 15:01 |
| slaweq | I checked it today | 15:01 |
| slaweq | and I think I know what is going on there, I described it in comment on LP: https://bugs.launchpad.net/neutron/+bug/1933234/comments/2 | 15:02 |
| slaweq | but to confirm that I will need additional logs in L3 agent: https://review.opendev.org/c/openstack/neutron/+/798648 | 15:02 |
| opendevreview | Ilya Chukhnakov proposed openstack/neutron-specs master: [WIP] Add Node-Local Virtual IP Spec https://review.opendev.org/c/openstack/neutron-specs/+/797798 | 15:02 |
| lajoskatona | Hi | 15:03 |
| slaweq | obondarev regarding Your question, I don't think it will be useful in that specific case to log those ports ids there but I can add it | 15:03 |
| opendevreview | Ilya Chukhnakov proposed openstack/neutron-specs master: [WIP] Add Node-Local Virtual IP Spec https://review.opendev.org/c/openstack/neutron-specs/+/797798 | 15:03 |
| obondarev | slaweq: got it | 15:04 |
| slaweq | and that's basically all regarding this issue for now | 15:06 |
| opendevreview | Mamatisa Nurmatov proposed openstack/neutron master: use payloads for PORT AFTER_DELETE events https://review.opendev.org/c/openstack/neutron/+/797004 | 15:06 |
| slaweq | if it will happen often I will propose to mark this test as unstable for now | 15:06 |
| slaweq | but maybe it will not be necessary :) | 15:06 |
| slaweq | I think we can move on | 15:06 |
| slaweq | next was: | 15:06 |
| slaweq | lajoskatona to check with infra status of the tap-as-a-service move | 15:06 |
| opendevreview | Merged openstack/neutron-tempest-plugin master: Add a test for overlapping SG rules https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/520251 | 15:08 |
| opendevreview | Merged openstack/neutron-tempest-plugin master: Revert "Skip scenario tests if HA router will not be active" https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/796858 | 15:08 |
| slaweq | lajoskatona are You here? | 15:08 |
| opendevreview | Merged openstack/neutron stable/ussuri: Updates for python3.8 https://review.opendev.org/c/openstack/neutron/+/793417 | 15:08 |
| lajoskatona | sorry, yes | 15:09 |
| lajoskatona | I asked around ( https://meetings.opendev.org/irclogs/%23openstack-infra/%23openstack-infra.2021-06-24.log.html#t2021-06-24T16:58:18 ) | 15:10 |
| lajoskatona | sorry, my client plays with me | 15:10 |
| lajoskatona | so basically whenever the move/rename happens all open patches will be moved | 15:11 |
| slaweq | so IIUC we are good to merge and send patches as we want now and we are good, right? | 15:12 |
| lajoskatona | exactly | 15:12 |
| slaweq | great, thx lajoskatona :) | 15:12 |
| slaweq | ok, that's all actions from previous meeting | 15:13 |
| slaweq | #topic Stadium projects | 15:13 |
| slaweq | lajoskatona any other updated about stadium's CI? | 15:13 |
| lajoskatona | the only one is from the mail http://lists.openstack.org/pipermail/openstack-discuss/2021-June/023321.html to fix broken zuul config | 15:14 |
| lajoskatona | that is mostly odl rocky perhaps, amotoki started to check that, thanks for that | 15:15 |
| amotoki | all jobs are failing. perhaps we can drop them | 15:15 |
| slaweq | I saw amotoki volunteered for that on ML so I didn't check it | 15:15 |
| lajoskatona | https://review.opendev.org/c/openstack/networking-odl/+/798298 | 15:15 |
| amotoki | but requirements change is also required and the requirmenets-check fails too. I need to ask it to the requirments team. | 15:15 |
| slaweq | maybe we should simply make networking-odl rocky EOL now? | 15:17 |
| slaweq | wdyt? | 15:17 |
| lajoskatona | elod this morning mentioned something that isort is not in rocky requirements, and that one is broken too, so hard | 15:17 |
| lajoskatona | yeah, for ODL we seem to have even liberty (frm http://lists.openstack.org/pipermail/openstack-discuss/2021-June/023347.html & http://paste.openstack.org/show/806995/ ) | 15:18 |
| amotoki | lajoskatona: yes. we don't have a proper isort in the requirements, so if we'd like to fix it we also need a requirement change but the job is failing (it is not specific to neutron team) | 15:18 |
| lajoskatona | amotoki: exactly | 15:19 |
| lajoskatona | amotoki: so perhaps we can clean these old branches, not sure what to need for that | 15:19 |
| amotoki | I am okay with EOL'ing networking-odl rocky and older | 15:20 |
| slaweq | me too :) | 15:21 |
| amotoki | lajoskatona: what do you mean by 'clean'? EOL? | 15:21 |
| slaweq | do You want me to start that process? | 15:21 |
| lajoskatona | yes | 15:21 |
| slaweq | or do You want to do it? | 15:21 |
| lajoskatona | but that means we put tag on it and the branch is deleted, or am I wrong? | 15:21 |
| amotoki | slaweq: me? | 15:21 |
| lajoskatona | I can | 15:21 |
| amotoki | i can help it | 15:22 |
| lajoskatona | amotoki: thanks | 15:22 |
| amotoki | I think we can drop jobs which cause zuul configuration error first along with failing jobs. | 15:22 |
| amotoki | in parallel, we can move forward the process of EOL of networking-eol older branches. | 15:23 |
| lajoskatona | amotoki: ok | 15:23 |
| slaweq | sounds good for me | 15:23 |
| slaweq | so amotoki will You propose removal of that broken jobs? | 15:23 |
| amotoki | slaweq: yes | 15:24 |
| slaweq | and lajoskatona You will start EOLing it, correct? | 15:24 |
| lajoskatona | salweq: yes | 15:24 |
| amotoki | I will also check zuul errors in other repos this week. | 15:24 |
| slaweq | #action amotoki to clean failing jobs in networking-odl rocky and older | 15:24 |
| slaweq | #action lajoskatona to start EOL process for networking-odl rocky and older | 15:25 |
| slaweq | thank You both :) | 15:25 |
| slaweq | anything else or can we move on? | 15:26 |
| lajoskatona | yes | 15:27 |
| slaweq | lajoskatona "yes, something else" or "yes, we can move on"? :D | 15:27 |
| amotoki | none from me either | 15:27 |
| lajoskatona | sorry we can move | 15:28 |
| slaweq | ok :) | 15:28 |
| slaweq | As we don't have bcafarel today, I think we can skip stable branches topic | 15:28 |
| slaweq | I didn't saw any serious issues there last week | 15:28 |
| slaweq | #topic Grafana | 15:28 |
| slaweq | https://grafana.opendev.org/d/BmiopeEMz/neutron-failure-rate?orgId=1 | 15:29 |
| slaweq | I see that today neutron-tempest-slow-py3 is going high but there was small number of the runs so maybe it's nothing really serious | 15:31 |
| slaweq | worth to keep an eye on it for now | 15:31 |
| slaweq | other than that things looks pretty ok | 15:31 |
| slaweq | do You see any issues there? | 15:32 |
| slaweq | ok, so let's move on | 15:33 |
| slaweq | #topic fullstack/functional | 15:33 |
| slaweq | I noticed (again) functional tests failure with db migration timeouts this week: | 15:34 |
| slaweq | https://099638a2437d4a88b01b-b7b49a3857e4a968cf2542b58172db3c.ssl.cf2.rackcdn.com/798156/1/check/neutron-functional-with-uwsgi/6d49cc5/testr_results.html | 15:34 |
| slaweq | ralonsoh may be interesting for You :) | 15:34 |
| ralonsoh | I saw it, yes | 15:34 |
| slaweq | as I think You recently removed some skip if timeout decorator from those tests, right? | 15:34 |
| ralonsoh | I'll keep an eye on the CI | 15:34 |
| slaweq | thx | 15:34 |
| ralonsoh | some weeks ago | 15:35 |
| slaweq | for now I saw it only once so maybe nothing really serious and just very overloaded node | 15:35 |
| ralonsoh | and we don't execute those test in parallel | 15:35 |
| slaweq | but worth to be aware | 15:35 |
| ralonsoh | agree | 15:35 |
| slaweq | and that's all regarding functional tests | 15:35 |
| slaweq | for fullstack I only saw this error with mtu update | 15:35 |
| slaweq | but that is already reported and in progress | 15:36 |
| slaweq | so I think we can move on | 15:36 |
| slaweq | #topic Tempest/Scenario | 15:36 |
| slaweq | neutron-tempest-slow-py3 - again nameservers issue | 15:36 |
| slaweq | https://8a9b6f5914f633048b01-596b3ee18079cc72e9aa5b1ed231f9fc.ssl.cf5.rackcdn.com/795117/12/check/neutron-tempest-slow-py3/6518f8d/testr_results.html | 15:36 |
| ralonsoh | again? | 15:36 |
| slaweq | ralonsoh is Your fix related to such issue fixed already? | 15:36 |
| ralonsoh | let me check, I think so | 15:36 |
| ralonsoh | I'll ping you later | 15:37 |
| slaweq | ralonsoh yes, that was from yesterday so fresh thing :) | 15:37 |
| slaweq | ok, please let me know if we should reopen our bug for that | 15:37 |
| slaweq | can be tomorrow | 15:37 |
| ralonsoh | ah ok | 15:37 |
| ralonsoh | but we use cirros there, right? | 15:38 |
| ralonsoh | my patch introduced the use of resolvectl | 15:38 |
| lajoskatona | not ubuntu? | 15:38 |
| ralonsoh | that is not in cirros, only advance images | 15:38 |
| ralonsoh | yes, it's in ubuntu | 15:38 |
| slaweq | in this test we use cirros | 15:39 |
| slaweq | this is tempest test | 15:39 |
| slaweq | not neutron_tempest_plugin | 15:39 |
| ralonsoh | yeah... | 15:39 |
| lajoskatona | oh ,and there we use only cirros.... | 15:39 |
| ralonsoh | I think this is just a problem with the OS | 15:39 |
| slaweq | and in tempest there is no this "advanced image" thing | 15:39 |
| slaweq | it's only in neutron-tempest-plugin | 15:39 |
| ralonsoh | yes... now I realized that | 15:39 |
| ralonsoh | I'll see if, in cirros, there is another way to check that | 15:40 |
| slaweq | thx | 15:40 |
| lajoskatona | and the reason behind using only cirros is to keep it tempest fast? | 15:41 |
| slaweq | ralonsoh to check if there is better way to check dns nameservers in cirros | 15:41 |
| slaweq | #action ralonsoh to check if there is better way to check dns nameservers in cirros | 15:41 |
| slaweq | lajoskatona yes, with ubuntu and without nested virt it's a nightmare | 15:41 |
| slaweq | we had it like that in neutron_tempest_plugin jobs in the past | 15:41 |
| slaweq | and that's why we did this advanced_image option to use ubuntu only for some tests | 15:41 |
| slaweq | not for all | 15:41 |
| lajoskatona | ok, thanks | 15:42 |
| slaweq | ok, that's basically all what I had for today for You | 15:43 |
| slaweq | generally CI looks pretty ok, I see many patches merged without rechecks recently | 15:43 |
| slaweq | great job guys with all those CI issues :) | 15:43 |
| slaweq | thank You! | 15:43 |
| slaweq | do You have anything else what You would like to discuss today? | 15:44 |
| slaweq | or if not, we can finish a bit earlier today | 15:44 |
| ralonsoh | I'm fine | 15:45 |
| lajoskatona | me too | 15:46 |
| slaweq | ok, thx for attending the meeting | 15:46 |
| ralonsoh | bye | 15:46 |
| slaweq | and have a great week | 15:46 |
| slaweq | o/ | 15:46 |
| slaweq | #endmeeting | 15:46 |
| opendevmeet | Meeting ended Tue Jun 29 15:46:21 2021 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:46 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/neutron_ci/2021/neutron_ci.2021-06-29-15.00.html | 15:46 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/neutron_ci/2021/neutron_ci.2021-06-29-15.00.txt | 15:46 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/neutron_ci/2021/neutron_ci.2021-06-29-15.00.log.html | 15:46 |
| amotoki | o/ | 15:46 |
| lajoskatona | o/ | 15:46 |
| opendevreview | Slawek Kaplonski proposed openstack/neutron-specs master: Neutron VLAN networks with QinQ enabled https://review.opendev.org/c/openstack/neutron-specs/+/798704 | 15:48 |
| opendevreview | Rodolfo Alonso proposed openstack/neutron master: [OVN] Do not fail when processing SG rule deletion https://review.opendev.org/c/openstack/neutron/+/798718 | 17:00 |
| opendevreview | Brian Haley proposed openstack/ovn-octavia-provider master: Add Health Monitor support https://review.opendev.org/c/openstack/ovn-octavia-provider/+/713253 | 20:35 |
| opendevreview | Vadim Ponomarev proposed openstack/neutron-lib master: Introduce rbac-bgpvpn api extension https://review.opendev.org/c/openstack/neutron-lib/+/795423 | 21:31 |
| *** ChanServ sets mode: +o slaweq | 21:34 | |
| *** ChanServ sets mode: -o slaweq | 21:36 | |
| opendevreview | Merged openstack/networking-ovn stable/train: [OVN] Disable mcast_flood on localnet ports https://review.opendev.org/c/openstack/networking-ovn/+/797817 | 22:51 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!