*** jamesmcarthur has joined #openstack-meeting-3 | 00:08 | |
*** macz_ has quit IRC | 00:10 | |
*** tosky has quit IRC | 00:15 | |
*** macz_ has joined #openstack-meeting-3 | 00:51 | |
*** macz_ has quit IRC | 00:56 | |
*** jamesmcarthur has quit IRC | 01:23 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 01:35 | |
*** baojg has joined #openstack-meeting-3 | 01:49 | |
*** macz_ has joined #openstack-meeting-3 | 02:04 | |
*** macz_ has quit IRC | 02:09 | |
*** jamesmcarthur has quit IRC | 02:24 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 02:37 | |
*** baojg has quit IRC | 02:38 | |
*** _mlavalle_1 has quit IRC | 02:55 | |
*** hemanth_n has joined #openstack-meeting-3 | 03:11 | |
*** ricolin has quit IRC | 03:19 | |
*** psachin has joined #openstack-meeting-3 | 03:31 | |
*** jamesmcarthur has quit IRC | 03:41 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 03:43 | |
*** ricolin_ has joined #openstack-meeting-3 | 04:17 | |
*** jamesmcarthur has quit IRC | 04:59 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 05:00 | |
*** jamesmcarthur has quit IRC | 05:05 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 06:00 | |
*** jamesmcarthur has quit IRC | 06:05 | |
*** macz_ has joined #openstack-meeting-3 | 06:06 | |
*** macz_ has quit IRC | 06:11 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 07:09 | |
*** jamesmcarthur has quit IRC | 07:15 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 07:30 | |
*** jamesmcarthur has quit IRC | 07:34 | |
*** eolivare has joined #openstack-meeting-3 | 07:38 | |
*** ralonsoh has joined #openstack-meeting-3 | 07:48 | |
*** slaweq has joined #openstack-meeting-3 | 08:03 | |
*** tosky has joined #openstack-meeting-3 | 08:22 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 08:51 | |
*** e0ne has joined #openstack-meeting-3 | 08:53 | |
*** jamesmcarthur has quit IRC | 08:55 | |
*** ricolin_ has quit IRC | 09:39 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 10:15 | |
*** jamesmcarthur has quit IRC | 10:19 | |
*** hemanth_n has quit IRC | 10:23 | |
*** otherwiseguy has quit IRC | 11:07 | |
*** otherwiseguy has joined #openstack-meeting-3 | 11:12 | |
*** e0ne has quit IRC | 11:16 | |
*** e0ne has joined #openstack-meeting-3 | 11:39 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 11:44 | |
*** e0ne has quit IRC | 11:44 | |
*** Luzi has joined #openstack-meeting-3 | 11:47 | |
*** e0ne has joined #openstack-meeting-3 | 11:47 | |
*** jamesmcarthur has quit IRC | 11:49 | |
*** e0ne has quit IRC | 11:54 | |
*** ricolin_ has joined #openstack-meeting-3 | 12:03 | |
*** raildo has joined #openstack-meeting-3 | 12:14 | |
*** ricolin_ has quit IRC | 12:47 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 13:08 | |
*** jamesmcarthur has quit IRC | 13:12 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 13:14 | |
*** jamesmcarthur has quit IRC | 13:19 | |
*** obondarev has joined #openstack-meeting-3 | 13:57 | |
*** mlavalle has joined #openstack-meeting-3 | 13:58 | |
*** ricolin_ has joined #openstack-meeting-3 | 13:58 | |
*** ricolin_ has quit IRC | 13:58 | |
*** ricolin has joined #openstack-meeting-3 | 13:59 | |
slaweq | #startmeeting networking | 14:00 |
---|---|---|
openstack | Meeting started Tue Jan 12 14:00:17 2021 UTC and is due to finish in 60 minutes. The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
*** openstack changes topic to " (Meeting topic: networking)" | 14:00 | |
openstack | The meeting name has been set to 'networking' | 14:00 |
mlavalle | o/ | 14:00 |
slaweq | welcome :) | 14:00 |
obondarev | hi all | 14:00 |
amotoki | hi | 14:00 |
bcafarel | o/ | 14:01 |
rubasov | o/ | 14:01 |
slaweq | ok, lets start | 14:02 |
njohnston | o/ | 14:02 |
slaweq | HNY for those who I see first time this year :) | 14:02 |
slaweq | #topic announcements | 14:02 |
*** openstack changes topic to "announcements (Meeting topic: networking)" | 14:02 | |
slaweq | next week is Wallaby-2 milestone already | 14:02 |
slaweq | we still have couple of specs to review | 14:03 |
ralonsoh | hi | 14:03 |
slaweq | please check and try to review them this week if possible | 14:03 |
slaweq | for now we merged only https://review.opendev.org/c/openstack/neutron-specs/+/739549 | 14:03 |
slaweq | and that are all announcements/reminders for today | 14:04 |
slaweq | anything else You want to share with the team? | 14:04 |
slaweq | ok, I guess that this means "no" :) | 14:05 |
slaweq | so lets move on | 14:05 |
slaweq | #topic Blueprints | 14:06 |
*** openstack changes topic to "Blueprints (Meeting topic: networking)" | 14:06 | |
slaweq | https://bugs.launchpad.net/neutron/+milestone/wallaby-2 | 14:06 |
slaweq | those are things scheduled for wallaby-2 | 14:06 |
slaweq | do You have any updates about any of them? | 14:06 |
slaweq | I have update about https://blueprints.launchpad.net/neutron/+spec/enginefacade-switch | 14:07 |
slaweq | we have really all merged in neutron now | 14:07 |
slaweq | I just abandoned old "conclusion" patch which was used to check what is still needed to change | 14:08 |
bcafarel | mission accomplished :) | 14:08 |
slaweq | I also checked stadium projects today | 14:08 |
slaweq | we still have some changes to do in midonet and vpnaas repos | 14:08 |
slaweq | and some minor changes in neutron docs | 14:08 |
slaweq | I will try to push patches this week | 14:08 |
slaweq | so mission is almost accomplished | 14:09 |
ralonsoh | well done | 14:09 |
slaweq | as ralonsoh sum up in some comment - it was (is) 4 years effort :) | 14:09 |
ralonsoh | heheheh | 14:09 |
slaweq | another update, about https://blueprints.launchpad.net/neutron/+spec/secure-bac-roles | 14:09 |
slaweq | we have patches to migrate all our rbac roles to new roles already | 14:10 |
slaweq | https://review.opendev.org/q/topic:%2522secure-rbac%2522+(status:open+OR+status:merged)+project:openstack/neutron, | 14:10 |
slaweq | so please take a look at those patches | 14:11 |
slaweq | we need to check all of them carefully to be able we are not breaking/changing something by mistake | 14:11 |
slaweq | another update, about https://blueprints.launchpad.net/neutron/+spec/default-dns-zone-per-tenant | 14:12 |
slaweq | this is old BP which is almost done | 14:12 |
slaweq | missing patches are: | 14:12 |
slaweq | Neutron patch https://review.opendev.org/#/c/686343/ | 14:12 |
slaweq | neutron-tempest-plugin test https://review.opendev.org/#/c/733994/ | 14:12 |
slaweq | please take a look at them also | 14:13 |
slaweq | and regarding https://blueprints.launchpad.net/neutron/+spec/address-groups-in-sg-rules | 14:13 |
slaweq | patches are on https://review.opendev.org/#/q/topic:bp/address-groups-in-sg-rules | 14:13 |
slaweq | please add them to the list of Your review queues as well :) | 14:13 |
slaweq | and that's all from my side about BPs | 14:14 |
slaweq | so lets move on to the next topic | 14:16 |
slaweq | #topic Community goals | 14:16 |
*** openstack changes topic to "Community goals (Meeting topic: networking)" | 14:16 | |
slaweq | ralonsoh: amotoki: any updates? | 14:16 |
ralonsoh | still working on the rootwrap deprecation | 14:16 |
ralonsoh | https://review.opendev.org/c/openstack/neutron/+/764015 | 14:16 |
ralonsoh | and attempt to migrate, in a generic way, the rootwrap execution | 14:17 |
ralonsoh | I tried to do this in one shot, and it was impossible | 14:17 |
ralonsoh | that's why I'm taking this approach | 14:17 |
ralonsoh | btw, we are executing some long live commands using rootwrap | 14:17 |
ralonsoh | this is incorrect, these executions should be done using a service wrapper | 14:18 |
ralonsoh | I'll try to fix that in next patches | 14:18 |
ralonsoh | (that's all) | 14:18 |
slaweq | ok, a lot of work | 14:18 |
slaweq | if You need any help, please ping me | 14:18 |
ralonsoh | (another 4 years hehehehe) | 14:19 |
ralonsoh | thanks! | 14:19 |
slaweq | LOL | 14:19 |
amotoki | go disconnected... | 14:19 |
amotoki | regarding the policy stuff, https://review.opendev.org/c/openstack/neutron/+/764401 looks a good shape but it needs to pass the gate. I will check the status. | 14:19 |
*** lajoskatona has joined #openstack-meeting-3 | 14:19 | |
lajoskatona | Hi | 14:20 |
slaweq | amotoki: thx | 14:20 |
slaweq | this patch is in the check queue now AFAICT | 14:20 |
amotoki | yes | 14:20 |
slaweq | so this should be much faster than ralonsoh's 4 years effort with rootwrap :P | 14:21 |
amotoki | as it is much smaller than the rootwrap one :p | 14:21 |
slaweq | yep :) | 14:22 |
slaweq | ok, lets move on | 14:22 |
slaweq | next topic | 14:22 |
slaweq | #topic Bugs | 14:22 |
*** openstack changes topic to "Bugs (Meeting topic: networking)" | 14:22 | |
slaweq | lajoskatona was our bug deputy 2 weeks ago, his report is at http://lists.openstack.org/pipermail/openstack-discuss/2021-January/019602.html | 14:22 |
slaweq | and amotoki was bug deputy last week | 14:22 |
lajoskatona | yeah that was a quiet week | 14:22 |
slaweq | any bugs You want to highligh here? | 14:22 |
amotoki | I just sent it before the meeting http://lists.openstack.org/pipermail/openstack-discuss/2021-January/019781.html | 14:23 |
amotoki | sorry for late | 14:23 |
lajoskatona | the only one was about security-group operations that are slow | 14:23 |
lajoskatona | and recently there was mail about that on mail/list too | 14:23 |
amotoki | it was a quite week and half of them are about gate failures | 14:23 |
lajoskatona | I think this was the mail: http://lists.openstack.org/pipermail/openstack-discuss/2021-January/019685.html | 14:25 |
amotoki | regaridng the secutiry group issue, is it related to RBAC support in sec group? if so, I think mlavalle's fix improves the performance again | 14:25 |
lajoskatona | as I remember it's not clear from the bug or from the mail, but possible that recent fixes improve the performance | 14:26 |
ralonsoh | I think this is more related to the amount of data you need to transmit to the compute nodes when using FW (as slaweq commented in the mail) | 14:26 |
ralonsoh | I don't see any problem in the DB request | 14:26 |
ralonsoh | (apart from the amount of SG and rules) | 14:27 |
slaweq | the LP bug was more about API request to list SGs | 14:28 |
slaweq | and ML thread was about applying SG rules on compute node | 14:28 |
slaweq | so IMO those are different problems | 14:28 |
slaweq | but maybe I checked different ML thread | 14:29 |
*** Luzi has quit IRC | 14:31 | |
slaweq | I see that LP bug is now marked as "Opinion" and reprorted wrote that will check it on newer version | 14:31 |
slaweq | lets wait for result of that test and we will see if that is still an issue | 14:31 |
lajoskatona | no, you are right, I checked and the mail was to apply rules to VMs on computes and the lp bug was to list them | 14:32 |
lajoskatona | ok | 14:32 |
slaweq | any other bugs You want to discuss today? | 14:33 |
slaweq | if not, then lets move on | 14:34 |
slaweq | our bug deputy this week is mlavalle | 14:34 |
mlavalle | o/ | 14:34 |
slaweq | and next week will be rubasov | 14:35 |
slaweq | rubasov: is that ok for You? | 14:35 |
rubasov | ack | 14:35 |
rubasov | sure | 14:35 |
mlavalle | I have a question | 14:35 |
slaweq | thank You both :) | 14:35 |
mlavalle | though | 14:35 |
slaweq | mlavalle: sure | 14:35 |
slaweq | shoot | 14:35 |
mlavalle | what happens to bugs in the gap between one deputy and the next one | 14:35 |
slaweq | do we have such gaps? | 14:36 |
mlavalle | for example: https://bugs.launchpad.net/neutron/+bug/1910691. Is this amotoki 's report? | 14:36 |
openstack | Launchpad bug 1910691 in neutron "In "test_dvr_router_lifecycle_ha_with_snat_with_fips", the HA proxy PID file is not removed" [Undecided,New] | 14:36 |
ralonsoh | that's mine | 14:37 |
slaweq | this was reported on last Friday so it should be included in amotoki's report usually | 14:37 |
slaweq | maybe he forgot about it :) | 14:37 |
ralonsoh | (sorry, the report) | 14:37 |
mlavalle | so report has to include from Monday to Sunday? | 14:37 |
slaweq | I always though that deputy is for one week, so Monday to Monday more or less | 14:37 |
bcafarel | I see it in http://lists.openstack.org/pipermail/openstack-discuss/2021-January/019781.html | 14:38 |
slaweq | that was my understanding always :) | 14:38 |
bcafarel | mine too :) | 14:38 |
mlavalle | ok | 14:38 |
slaweq | thx bcafarel :) | 14:38 |
mlavalle | let's move on | 14:38 |
slaweq | indeed, it's there | 14:38 |
slaweq | sure, thx for asking mlavalle | 14:38 |
*** jamesmcarthur has joined #openstack-meeting-3 | 14:38 | |
slaweq | ok, so let's move on | 14:39 |
slaweq | #topic On demand | 14:39 |
*** openstack changes topic to "On demand (Meeting topic: networking)" | 14:39 | |
slaweq | we have one additional topic for today | 14:39 |
slaweq | maybe You already saw thread on ML | 14:39 |
slaweq | but I wanted to see what do You think about Drop (or not) l-c testing --> http://lists.openstack.org/pipermail/openstack-discuss/2021-January/019659.html. | 14:40 |
slaweq | I know that tc will be discussing this on their next meeting | 14:40 |
slaweq | but it also seems that projects can make own decisions on that if want | 14:40 |
slaweq | so e.g. oslo dropped it already | 14:41 |
slaweq | wdyt about that in neutron and stadium projects? | 14:41 |
ralonsoh | what's the benefit of l-c testing? | 14:41 |
ralonsoh | apart from checking that we can run Neutron with lowest library versions | 14:41 |
bcafarel | indeed we may get an official "you can all drop it" in a few days, but in the meantime | 14:42 |
slaweq | ralonsoh: I don't have a lot of experience with that but main argument on ML was that it's useful for packaging | 14:42 |
amotoki | one merit is that it detects our lower bounds are correct or not, but I am not sure how the merit is vaulable. | 14:42 |
bcafarel | ack the idea has merit (does neutron actually work with lower versions as mentioned in l-c) | 14:42 |
bcafarel | but until recently the l-c file was not really applicable anyway | 14:43 |
bcafarel | and it is not perfect now either - see recent discussions on ML | 14:43 |
amotoki | yeah, it is usually broken till the improvement in the latest pip resolver came. | 14:44 |
lajoskatona | regarding stadiums most of them have trouble with l-c jobs | 14:44 |
lajoskatona | peridocally we can say :-) | 14:44 |
ralonsoh | and neutron stable versions | 14:44 |
bcafarel | + multiply the effort by number of stable branches | 14:44 |
bcafarel | ralonsoh: :) great minds think alike | 14:44 |
ralonsoh | hehehhe | 14:44 |
slaweq | LOL | 14:44 |
lajoskatona | as I understand it must be periodically maintained, and that is a huge work | 14:44 |
amotoki | IMHO we don't need it for stable branches as we rarely change requirements after the release. | 14:45 |
ralonsoh | I'll say that: we want to drop this CI job | 14:45 |
bcafarel | amotoki: right, plus it does not probably help many people if we fix lower constraints after the release | 14:46 |
slaweq | so You propose to drop this job from stable branches and keep it (for now) in master, right? | 14:46 |
bcafarel | at least first step :) | 14:46 |
amotoki | yes for the stable branches | 14:46 |
slaweq | sounds reasonable for me | 14:47 |
ralonsoh | +1 | 14:47 |
obondarev | +1 | 14:47 |
bcafarel | I think in master it should probably be thought/redesigned again to be useful, TC opinion should give pointers I think | 14:47 |
lajoskatona | +1 | 14:47 |
slaweq | anyone wants to send patches then? | 14:48 |
ralonsoh | I can | 14:48 |
bcafarel | more than motivated to send a few too to kick these out :) | 14:48 |
slaweq | thx | 14:48 |
slaweq | ok, so I think we are good with today's meeting | 14:48 |
amotoki | regarding the master branch, I see a value to some extent. I think the recent situation is a bit different as the new pip resolve was introduced and the inconsistencies were revealed. | 14:48 |
amotoki | that's all from me | 14:49 |
slaweq | thx amotoki | 14:50 |
slaweq | thx for attending the meeting today | 14:50 |
mlavalle | o/ | 14:50 |
amotoki | o/ | 14:50 |
bcafarel | thanks and HNY! | 14:50 |
ralonsoh | bye | 14:50 |
slaweq | please remember that we have ci meeting in 10 minutes here :) | 14:50 |
slaweq | bye | 14:50 |
slaweq | o/ | 14:50 |
slaweq | #endmeeting | 14:50 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 14:50 | |
openstack | Meeting ended Tue Jan 12 14:50:29 2021 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:50 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/networking/2021/networking.2021-01-12-14.00.html | 14:50 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/networking/2021/networking.2021-01-12-14.00.txt | 14:50 |
openstack | Log: http://eavesdrop.openstack.org/meetings/networking/2021/networking.2021-01-12-14.00.log.html | 14:50 |
rubasov | o/ | 14:50 |
lajoskatona | o/ | 14:50 |
slaweq | #startmeeting neutron_ci | 15:00 |
openstack | Meeting started Tue Jan 12 15:00:17 2021 UTC and is due to finish in 60 minutes. The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
slaweq | hi | 15:00 |
*** openstack changes topic to " (Meeting topic: neutron_ci)" | 15:00 | |
openstack | The meeting name has been set to 'neutron_ci' | 15:00 |
bcafarel | hi again | 15:00 |
ralonsoh | hi | 15:00 |
slaweq | Grafana dashboard: http://grafana.openstack.org/dashboard/db/neutron-failure-rate | 15:01 |
slaweq | please open and we can start | 15:01 |
slaweq | #topic Actions from previous meetings | 15:02 |
*** openstack changes topic to "Actions from previous meetings (Meeting topic: neutron_ci)" | 15:02 | |
slaweq | slaweq to update grafana dashboard | 15:02 |
slaweq | Patch https://review.opendev.org/c/openstack/project-config/+/767470 | 15:02 |
slaweq | it's merged already | 15:02 |
slaweq | and that was the only action from last meeting | 15:02 |
slaweq | so I think we can move on | 15:03 |
slaweq | next topic is | 15:03 |
slaweq | #topic Stadium projects | 15:03 |
*** openstack changes topic to "Stadium projects (Meeting topic: neutron_ci)" | 15:03 | |
slaweq | any ci related topics for stadium projects? | 15:03 |
bcafarel | most are still red with pip fun I think | 15:03 |
bcafarel | I saw some patches starting to appear for them, not sure if they are working (or merged?) | 15:04 |
slaweq | bcafarel: but it's for master or stable branches? | 15:05 |
bcafarel | https://review.opendev.org/c/openstack/networking-bgpvpn/+/769657 for example | 15:05 |
lajoskatona | Hi | 15:05 |
bcafarel | slaweq: master, I will send patches to drop l-c jobs on stable soonish ( ralonsoh taking the neutron ones) | 15:05 |
ralonsoh | right | 15:05 |
slaweq | ok, I will check those l-c patches for master branch then | 15:06 |
slaweq | anything else regarding stadium or we can move on? | 15:07 |
slaweq | so lets move on | 15:08 |
bcafarel | +1 | 15:08 |
slaweq | #topic Stable branches | 15:08 |
*** openstack changes topic to "Stable branches (Meeting topic: neutron_ci)" | 15:08 | |
slaweq | Victoria dashboard: https://grafana.opendev.org/d/HUCHup2Gz/neutron-failure-rate-previous-stable-release?orgId=1 | 15:08 |
slaweq | Ussuri dashboard: https://grafana.opendev.org/d/smqHXphMk/neutron-failure-rate-older-stable-release?orgId=1 | 15:08 |
slaweq | except that l-c issue, I think all is good there | 15:08 |
slaweq | right? | 15:08 |
bcafarel | indeed, I saw some failures but nothing too bad | 15:08 |
bcafarel | stein is waiting for rocky swift grenade fix (it was W+1 30 min ago), and then all branches should be back in working order | 15:09 |
bcafarel | pending l-c cleanup (fix for it is merged up to train at the moment) | 15:09 |
slaweq | ++ | 15:09 |
slaweq | thx bcafarel for taking care of it | 15:09 |
slaweq | I think we can move on to the next topic then | 15:10 |
slaweq | #topic Grafana | 15:10 |
*** openstack changes topic to "Grafana (Meeting topic: neutron_ci)" | 15:10 | |
slaweq | #link https://grafana.opendev.org/d/PfjNuthGz/neutron-failure-rate?orgId=1 | 15:10 |
bcafarel | and haleyb and a few others too :) it will be nice to forget that part | 15:10 |
haleyb | hi | 15:11 |
slaweq | hi haleyb :) | 15:11 |
haleyb | are there gate failures? :-p | 15:11 |
bcafarel | :) | 15:11 |
slaweq | thx for helping with pip issues :) | 15:11 |
bcafarel | haleyb: no I was just pointing out you helped/suffered a lot with that new fancy pip resolver too | 15:11 |
bcafarel | :) | 15:11 |
haleyb | i feel like it's been Thor's hammer kind of firedrill | 15:11 |
ralonsoh | good work on this! | 15:12 |
ralonsoh | thanks | 15:12 |
* haleyb is still suffering with gate things | 15:12 | |
slaweq | haleyb: we all suffer with gate things :P | 15:12 |
slaweq | but, speaking about gate and grafana | 15:13 |
slaweq | things looks much better IMO this week | 15:13 |
haleyb | nice | 15:13 |
slaweq | or even this year ;) | 15:13 |
slaweq | I saw surprisingly many patches merged recently without rechecking dozens of times :) | 15:14 |
bcafarel | nice | 15:14 |
slaweq | do You have anything related to our dashboard? | 15:15 |
slaweq | or we can move on to some specific issues which I found recently? | 15:15 |
bcafarel | nothing from me | 15:15 |
ralonsoh | no | 15:15 |
slaweq | ok, so let's move on | 15:17 |
slaweq | #topic functional/fullstack | 15:17 |
*** openstack changes topic to "functional/fullstack (Meeting topic: neutron_ci)" | 15:17 | |
slaweq | those jobs are still most often failing ones | 15:17 |
slaweq | first functional | 15:17 |
slaweq | I again saw this error 500 during network creation in ovn tests: https://zuul.opendev.org/t/openstack/build/476b4b1684df45bca7ecebbd2d7353b9/logs | 15:18 |
slaweq | but that was only once and I'm not sure if otherwiseguy's patch was already merged then or not yet | 15:18 |
* otherwiseguy looks | 15:18 | |
slaweq | IIRC it was this patch https://review.opendev.org/c/openstack/neutron/+/765874 | 15:20 |
slaweq | and it was merged Jan 5th | 15:20 |
slaweq | and failure which I saw was from Jan 4th | 15:20 |
slaweq | so now we should be good with that issue finally | 15:20 |
otherwiseguy | ah, yeah. | 15:21 |
* otherwiseguy crosses fingers | 15:21 | |
ralonsoh | the problem, I think, this is not working with wsgi | 15:21 |
ralonsoh | because we don't call "post_fork_initialize" | 15:21 |
ralonsoh | but I think lucas is investigating this | 15:21 |
slaweq | yes, he is working on that issue with uwsgi | 15:22 |
otherwiseguy | I remember functional test base manually calling post_fork_initialize? | 15:22 |
otherwiseguy | https://github.com/openstack/neutron/blob/f21b8950f8a51e81e389543fb482cc6cf445b882/neutron/tests/functional/base.py#L297 | 15:23 |
ralonsoh | yes, in _start_ovsdb_server_and_idls | 15:23 |
ralonsoh | exactly | 15:23 |
slaweq | ok, lets move on | 15:25 |
slaweq | I also found issue with neutron.tests.functional.agent.common.test_ovs_lib.BaseOVSTestCase.test_update_minimum_bandwidth_queue_no_qos_no_queue | 15:25 |
slaweq | https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_4e0/769880/2/check/neutron-functional-with-uwsgi/4e09826/testr_results.html | 15:25 |
slaweq | did You saw such failures already? | 15:26 |
otherwiseguy | ralonsoh and I talked about this one I believe. | 15:26 |
ralonsoh | yes | 15:26 |
ralonsoh | one sec | 15:26 |
otherwiseguy | I think we discovered that two tests were using the same port name and maybe that was causing an issue? | 15:26 |
ralonsoh | https://review.opendev.org/c/openstack/neutron/+/770154 | 15:26 |
ralonsoh | https://review.opendev.org/c/openstack/neutron/+/769975 | 15:26 |
slaweq | ahh, right | 15:26 |
ralonsoh | both patches should help | 15:26 |
slaweq | I saw this patch today | 15:26 |
slaweq | both already merged | 15:27 |
slaweq | so we should be ok with those | 15:27 |
slaweq | thx ralonsoh | 15:27 |
ralonsoh | yw! | 15:27 |
otherwiseguy | yay ralonsoh :) | 15:27 |
slaweq | and that's all regarding functional job | 15:27 |
slaweq | now fullstack | 15:28 |
slaweq | here I found one issue | 15:28 |
slaweq | with neutron.tests.fullstack.test_qos.TestMinBwQoSOvs.test_min_bw_qos_port_removed | 15:28 |
slaweq | and I saw it twice: | 15:28 |
slaweq | https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_18a/740569/2/check/neutron-fullstack-with-uwsgi/18a1d60/testr_results.html | 15:28 |
slaweq | https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_f87/749012/15/check/neutron-fullstack-with-uwsgi/f87df94/testr_results.html | 15:28 |
ralonsoh | I'll take a look at this | 15:29 |
slaweq | ralonsoh: thx | 15:29 |
ralonsoh | at least I'll add some logs to print the qoses and queues | 15:29 |
slaweq | in logs there is some error RowNotFound: https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_f87/749012/15/check/neutron-fullstack-with-uwsgi/f87df94/controller/logs/dsvm-fullstack-logs/TestBwLimitQoSOvs.test_bw_limit_qos_port_removed_egress_.txt | 15:29 |
ralonsoh | maybe I need to do the same as in FT, add a waitevent | 15:30 |
slaweq | in both cases there is same error | 15:30 |
slaweq | ralonsoh: maybe | 15:30 |
ralonsoh | perfect, that's "good" | 15:30 |
slaweq | #action ralonsoh will check fullstack test_min_bw_qos_port_removed issues | 15:30 |
slaweq | thank You | 15:31 |
slaweq | #topic Tempest/Scenario | 15:31 |
*** openstack changes topic to "Tempest/Scenario (Meeting topic: neutron_ci)" | 15:31 | |
slaweq | here I found just one issue in neutron-tempest-plugin-scenario-ovn | 15:31 |
slaweq | https://bfc2304b36c89dd5efde-d71f4126f88f4263fd488933444cea49.ssl.cf1.rackcdn.com/740569/2/check/neutron-tempest-plugin-scenario-ovn/026535a/testr_results.html | 15:31 |
slaweq | but I saw this issue only once so far | 15:32 |
slaweq | did You saw it also maybe? | 15:32 |
ralonsoh | no | 15:32 |
otherwiseguy | I suppose I can take a look at it. | 15:33 |
slaweq | otherwiseguy: thx a lot | 15:33 |
slaweq | I will report that in LP and I will give You link to LP later | 15:34 |
otherwiseguy | I can't just keep complaining about CI and not fix things I suppose. :p | 15:34 |
slaweq | otherwiseguy: everyone is doing that :P | 15:34 |
slaweq | thx a lot for Your help, it's really appreciated :) | 15:34 |
slaweq | ok, that's all issue regarding scenario jobs for today | 15:35 |
slaweq | those jobs seems to be pretty stable recently IMO | 15:35 |
slaweq | lets move on | 15:35 |
slaweq | #topic Periodic | 15:35 |
*** openstack changes topic to "Periodic (Meeting topic: neutron_ci)" | 15:35 | |
slaweq | I noticed that neutron-ovn-tempest-ovs-master-fedora perdiodic job is failing 100% of times since few days | 15:36 |
slaweq | I opened bug https://bugs.launchpad.net/neutron/+bug/1911128 | 15:36 |
openstack | Launchpad bug 1911128 in neutron "Neutron with ovn driver failed to start on Fedora" [Critical,Confirmed] | 15:36 |
slaweq | otherwiseguy: can You maybe take a look at that one? :) | 15:37 |
otherwiseguy | slaweq: sure :) | 15:37 |
slaweq | looks for me like maybe ovn isn't started at all there | 15:38 |
slaweq | idk | 15:38 |
slaweq | but it's failing like that every day on fedora job | 15:38 |
slaweq | thx otherwiseguy | 15:38 |
otherwiseguy | yeah: CRITICAL neutron [None req-4c1185cb-214e-4848-91b8-ea3b529f1d30 None None] Unhandled error: neutron_lib.callbacks.exceptions.CallbackFailure: Callback neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver.pre_fork_initialize-627113 failed with "Could not retrieve schema from ssl:10.4.70.225:6641" | 15:38 |
otherwiseguy | that doesn't seem good. :p | 15:39 |
slaweq | #action otherwiseguy to check fedora ovn periodic job issue | 15:39 |
slaweq | ok, that are all ci related things for today from me | 15:39 |
slaweq | do You have anything else You want to discuss today? | 15:39 |
ralonsoh | nope | 15:39 |
bcafarel | stable ci should work better soon, seeing the series of "drop l-c" patches appearing in #openstack-neutron :) | 15:40 |
slaweq | yeah, I saw it :) | 15:40 |
slaweq | thx ralonsoh and bcafarel for sending them | 15:40 |
ralonsoh | yw | 15:40 |
slaweq | thx for attending the meeting | 15:40 |
slaweq | and see You online | 15:40 |
ralonsoh | bye | 15:40 |
bcafarel | and lajoskatona too | 15:40 |
slaweq | o/ | 15:41 |
bcafarel | o/ | 15:41 |
slaweq | #endmeeting | 15:41 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 15:41 | |
openstack | Meeting ended Tue Jan 12 15:41:03 2021 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:41 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/neutron_ci/2021/neutron_ci.2021-01-12-15.00.html | 15:41 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/neutron_ci/2021/neutron_ci.2021-01-12-15.00.txt | 15:41 |
openstack | Log: http://eavesdrop.openstack.org/meetings/neutron_ci/2021/neutron_ci.2021-01-12-15.00.log.html | 15:41 |
slaweq | right, thx lajoskatona too :) | 15:41 |
lajoskatona | bye | 15:42 |
*** obondarev has quit IRC | 15:46 | |
*** ralonsoh has left #openstack-meeting-3 | 15:47 | |
*** macz_ has joined #openstack-meeting-3 | 15:51 | |
*** macz_ has quit IRC | 15:51 | |
*** macz_ has joined #openstack-meeting-3 | 15:52 | |
*** ralonsoh has joined #openstack-meeting-3 | 16:00 | |
*** psachin has quit IRC | 16:13 | |
*** e0ne has joined #openstack-meeting-3 | 16:18 | |
*** mlavalle has quit IRC | 17:07 | |
*** mlavalle has joined #openstack-meeting-3 | 17:07 | |
*** slaweq has quit IRC | 17:10 | |
*** artom has quit IRC | 17:10 | |
*** e0ne has quit IRC | 17:12 | |
*** artom has joined #openstack-meeting-3 | 17:30 | |
*** e0ne has joined #openstack-meeting-3 | 17:33 | |
*** e0ne has quit IRC | 17:35 | |
*** eolivare has quit IRC | 17:47 | |
*** ralonsoh has quit IRC | 18:02 | |
*** jamesmcarthur has quit IRC | 18:32 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 18:34 | |
*** jamesmcarthur has quit IRC | 18:39 | |
*** ianychoi_ has quit IRC | 18:46 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 19:17 | |
*** jamesmcarthur has quit IRC | 19:22 | |
*** e0ne has joined #openstack-meeting-3 | 19:35 | |
*** e0ne has quit IRC | 19:39 | |
*** slaweq has joined #openstack-meeting-3 | 19:44 | |
*** slaweq has quit IRC | 20:03 | |
*** e0ne has joined #openstack-meeting-3 | 20:05 | |
*** e0ne has quit IRC | 20:18 | |
*** e0ne has joined #openstack-meeting-3 | 20:19 | |
*** e0ne has quit IRC | 20:34 | |
*** e0ne_ has joined #openstack-meeting-3 | 20:34 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 20:36 | |
*** jamesmcarthur has quit IRC | 20:40 | |
*** e0ne_ has quit IRC | 20:40 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 20:40 | |
*** raildo has quit IRC | 22:05 | |
*** jamesmcarthur has quit IRC | 23:16 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 23:31 | |
*** jamesmcarthur has quit IRC | 23:35 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 23:35 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!