Tuesday, 2022-05-31

*** tbachman_ is now known as tbachman03:53
opendevreviewyatin proposed openstack/neutron master: Switch Fips fullstack/functional tests to py3.8  https://review.opendev.org/c/openstack/neutron/+/84325205:32
opendevreviewyatin proposed openstack/neutron-tempest-plugin master: Skip tempest jobs on functional roles/playbooks changes  https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/84398905:50
opendevreviewyatin proposed openstack/neutron master: Switch Fips fullstack/functional tests to py3.8  https://review.opendev.org/c/openstack/neutron/+/84325205:52
opendevreviewyatin proposed openstack/neutron-tempest-plugin master: Skip tempest jobs on functional roles/playbooks changes  https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/84398906:02
opendevreviewyatin proposed openstack/neutron master: Skip non-functional jobs on functional roles/playbooks changes  https://review.opendev.org/c/openstack/neutron/+/84399206:02
opendevreviewyatin proposed openstack/neutron master: Switch Fips fullstack/functional tests to py3.8  https://review.opendev.org/c/openstack/neutron/+/84325206:03
opendevreviewyatin proposed openstack/neutron stable/yoga: Switch fips scenario jobs to Centos stream 9  https://review.opendev.org/c/openstack/neutron/+/84382406:17
opendevreviewyatin proposed openstack/neutron stable/yoga: [DNM] Test yoga switch c9-stream  https://review.opendev.org/c/openstack/neutron/+/84399406:37
opendevreviewMerged openstack/neutron stable/train: [Train Only] Do not run grenade-skip-level job  https://review.opendev.org/c/openstack/neutron/+/84169807:26
opendevreviewyatin proposed openstack/neutron master: [DNM] Test multinode ovn grenade with fixes  https://review.opendev.org/c/openstack/neutron/+/83614107:43
lucasagomesralonsoh, thanks so much for the review at https://review.opendev.org/c/openstack/neutron/+/84031608:20
lucasagomesralonsoh, I replied to the comments inline08:20
ralonsohlucasagomes, checking now08:20
lucasagomesno rush! Thank u08:20
ykarellajoskatona, can you readd workflow on https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/83805308:29
ykarelsomehow it didn't went to gate after depends-on are merged08:30
lajoskatonaykarel: let's see if flapping it helps08:30
ykarellajoskatona, it worked, Thanks08:31
lajoskatonaykarel: recheck was it I think08:31
ykarelrecheck shouldn't be needed i think08:32
ykarelif +W and zuul+1 are there08:32
ykarellucasagomes, can you please check https://review.opendev.org/c/openstack/networking-ovn/+/84339108:35
fricklerralonsoh: fyi I'm seeing sdk network job ooming since yesterday, the timing with your sqla fix seems at least suspicous, do you know if some memore impact is expected? e.g. https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_b7b/843968/1/check/openstacksdk-functional-devstack-networking/b7b0921/controller/logs/syslog.txt08:36
frickler*memory08:36
ralonsohfrickler, no, should be the opposite08:37
lucasagomesykarel, will do08:38
ralonsohfrickler, what fix are you talking about?08:39
ykarelThanks lucasagomes 08:39
fricklerralonsoh: I was mainly thinking about https://review.opendev.org/c/openstack/neutron/+/842468 , because iiuc that has been the fix for some unstable failures we saw earlier08:40
fricklerralonsoh: but in fact it could also happen the other way round: neutron faster => tempest does more things in parallel => (b)oom08:41
fricklermaybe I should try to serialize tempest in that job to see if it helps08:43
ralonsohfrickler, there are OOM in jobs executed 4 days ago08:43
ralonsohhttps://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_6dd/843448/1/check/openstacksdk-functional-devstack-networking/6ddf259/controller/logs/syslog.txt08:44
ralonsohfrickler, and this job is running with designate and octavia08:45
ralonsohthis is a lot08:45
fricklerralonsoh: interested, that job oomed and still testing passed. so maybe those ooms aren't as relevant as I thought08:46
ralonsohfrickler, in neutron we stop cinder and switft08:47
ralonsohhttps://github.com/openstack/neutron/blob/master/zuul.d/tempest-multinode.yaml#L125-L13508:47
ralonsohmaybe that could be done in sdk too08:47
ralonsohat least in this job08:47
fricklerralonsoh: yes, sounds like a good idea08:47
fricklerswift was already disabled, trying without cinder now08:52
opendevreviewFernando Royo proposed openstack/ovn-octavia-provider stable/yoga: Fix request to OVN NB DB API  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/84401209:06
opendevreviewFernando Royo proposed openstack/ovn-octavia-provider stable/xena: Fix request to OVN NB DB API  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/84401309:07
opendevreviewFernando Royo proposed openstack/ovn-octavia-provider stable/wallaby: Fix request to OVN NB DB API  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/84401409:09
ralonsohlucasagomes, if you have 1 min: https://review.opendev.org/c/openstack/neutron/+/84324709:11
ralonsohthanks in advance09:11
lucasagomesralonsoh, sure will take a look09:12
opendevreviewRodolfo Alonso proposed openstack/neutron stable/yoga: [Trunk] Check if parent port belongs to OVN to activate  https://review.opendev.org/c/openstack/neutron/+/84401609:19
opendevreviewRodolfo Alonso proposed openstack/neutron stable/xena: [Trunk] Check if parent port belongs to OVN to activate  https://review.opendev.org/c/openstack/neutron/+/84401709:19
opendevreviewRodolfo Alonso proposed openstack/neutron stable/wallaby: [Trunk] Check if parent port belongs to OVN to activate  https://review.opendev.org/c/openstack/neutron/+/84401809:19
opendevreviewRodolfo Alonso proposed openstack/neutron stable/victoria: [Trunk] Check if parent port belongs to OVN to activate  https://review.opendev.org/c/openstack/neutron/+/84401909:20
opendevreviewRodolfo Alonso proposed openstack/neutron stable/ussuri: [Trunk] Check if parent port belongs to OVN to activate  https://review.opendev.org/c/openstack/neutron/+/84402009:20
opendevreviewMerged openstack/neutron master: Check the Chassis_Private nb_cfg_timestamp with current value  https://review.opendev.org/c/openstack/neutron/+/84247109:20
*** sean-k-mooney2 is now known as sean-k-mooney09:49
*** tbachman_ is now known as tbachman09:57
opendevreviewLajos Katona proposed openstack/tap-as-a-service master: Switch away from Mock auto_spec=True  https://review.opendev.org/c/openstack/tap-as-a-service/+/82144510:09
opendevreviewRodolfo Alonso proposed openstack/neutron master: [sqlalchemy-20] Add the needed DB context decorators in ``db.api``  https://review.opendev.org/c/openstack/neutron/+/84402410:28
ralonsohfolks, if you have time, please check10:43
ralonsohhttps://review.opendev.org/c/openstack/neutron/+/84325610:43
ralonsohhttps://review.opendev.org/c/openstack/neutron/+/84402410:43
ralonsohthanks in advance10:43
opendevreviewFernando Royo proposed openstack/ovn-octavia-provider master: Fix way of calculate LB status after HM event  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/84330810:43
opendevreviewyatin proposed openstack/neutron stable/yoga: [DNM] Test yoga fips job  https://review.opendev.org/c/openstack/neutron/+/84399410:52
sahido/ ralonsoh, a gentle notice to let you know that i have replied to your comment https://review.opendev.org/c/openstack/neutron/+/839478/10:53
ralonsohsahid, sure, let me check10:53
sahidthank you, no hurry at all :-)10:54
opendevreviewFernando Royo proposed openstack/ovn-octavia-provider master: Fix way of calculate LB status after HM event  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/84330811:10
ralonsohsahid, you should push all patches one in top of other11:10
ralonsohand the server side patches should be pushed first11:10
ralonsohthen the agent ones (DHCP, OVS, etc)11:11
opendevreviewMerged openstack/networking-ovn stable/train: Revert "Use Port_Binding up column to set Neutron port status"  https://review.opendev.org/c/openstack/networking-ovn/+/84339111:16
opendevreviewMerged openstack/ovn-octavia-provider master: Fix Load balancer remains on PENDING_CREATE  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/84238212:19
sahidralonsoh: let me double check, my understanding is that, at that point there are no server side change, the whole point is to make in-memory datastructure able to accept different mapping, from 1:1 to 1:n, input/output of rpc should not change12:45
sahidbut I may have missed something, do you have specific pointer that you can share with me?12:46
opendevreviewMerged openstack/neutron stable/yoga: Remove session active check in "_add_segment_host_mapping_for_segment"  https://review.opendev.org/c/openstack/neutron/+/84362412:48
ralonsohsahid, for example: this should never happen12:51
ralonsohhttps://review.opendev.org/c/openstack/neutron/+/839479/7/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py12:51
ralonsohwe can't try to update a segmentation ID if the network has several segments12:52
sahidhum, yes i'm totally agree, the behavior stay the same here12:54
sahidi'm very sorry i can see that you are trying to show me something but i'm not able to see it :-)12:54
* sahid has connection issue13:01
opendevreviewSlawek Kaplonski proposed openstack/neutron-lib master: Rehome ovsfw constants and utils modules  https://review.opendev.org/c/openstack/neutron-lib/+/83956413:02
slaweqralonsoh lajoskatona mlavalle hi, when You will have few minutes, please check ^^13:03
slaweqthx in advance13:03
ralonsohslaweq, sure13:09
lajoskatonaslaweq: I will check it13:11
slaweqthx a lot13:25
opendevreviewFernando Royo proposed openstack/ovn-octavia-provider stable/yoga: Fix Load balancer remains on PENDING_CREATE  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/84405513:37
opendevreviewFernando Royo proposed openstack/ovn-octavia-provider stable/xena: Fix Load balancer remains on PENDING_CREATE  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/84405613:38
opendevreviewFernando Royo proposed openstack/ovn-octavia-provider stable/wallaby: Fix Load balancer remains on PENDING_CREATE  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/84405713:38
opendevreviewFernando Royo proposed openstack/ovn-octavia-provider stable/victoria: Fix Load balancer remains on PENDING_CREATE  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/84405813:39
*** whoami-rajat__ is now known as whoami-rajat13:42
opendevreviewFernando Royo proposed openstack/ovn-octavia-provider stable/ussuri: Fix Load balancer remains on PENDING_CREATE  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/84405913:45
opendevreviewRodolfo Alonso proposed openstack/neutron master: [sqlalchemy-20] Add the needed DB context decorators in ``db.api``  https://review.opendev.org/c/openstack/neutron/+/84402413:49
lajoskatona#startmeeting networking14:00
opendevmeetMeeting started Tue May 31 14:00:24 2022 UTC and is due to finish in 60 minutes.  The chair is lajoskatona. Information about MeetBot at http://wiki.debian.org/MeetBot.14:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.14:00
opendevmeetThe meeting name has been set to 'networking'14:00
mlavalleo/14:00
lajoskatonao/14:00
isabek__hi14:00
ralonsohhi14:00
haleybhi14:00
slaweqhi14:00
bcafarelo/14:01
lajoskatonaLet's start it :-)14:02
lajoskatona#topic Announcements14:02
amotokihi14:02
rubasovo/14:02
elvirahi!14:02
obondarevhi14:02
lajoskatonaThe usual Zed schedule: https://releases.openstack.org/zed/schedule.html14:02
lajoskatonaAnd I repeat the release countdown mail for week R-19, May 23 - 27: http://lists.openstack.org/pipermail/openstack-discuss/2022-May/028616.html14:02
lajoskatonaas this one was the last, and I treat this as stll actual14:03
ykarelhi14:03
lajoskatonafor relase things, please keep an eye on create EOL tags for neutron-vpnaas: #link https://review.opendev.org/c/openstack/releases/+/84316714:04
lajoskatonaIt's actually hanging because Dmitriy Rabotyagov ( noonedeadpunk ) asked to keep Victoria alive14:04
lajoskatonaand elodilles asked to double check old legacy jobs and delete them before eoling any branch14:05
lajoskatonaI would like to ask your opinion before sending out mail about EOL queens, rocky, stein branches for stadiums14:06
ralonsohI have no objection14:07
bcafarelas far as I remember these branches for stadium were *really* quiet for a while already14:07
lajoskatonaas neutron-dynamic-routing already closed perhaps till train, and vpnaas is on its way to EOL also some branch14:07
lajoskatonabcafarel: exactly and perhaps we can safe some CPU cycles with the deletion of those old periodic jobs14:07
lajoskatonaif we have any for them14:07
mlavalle+114:08
slaweq+1 from me14:08
lajoskatonaok, thanks14:08
bcafarel+1 also asking for EOL sounds good we will see if there is any interest for these branches14:08
lajoskatonaI will send out mails about it14:08
obondarev+114:08
amotoki+114:08
ykarel+114:08
lajoskatonaNext announcement:14:09
lajoskatonaPropose Yatin Karel, ykarel for Neutron core team14:09
lajoskatonahttp://lists.openstack.org/pipermail/openstack-discuss/2022-May/028659.html14:09
lajoskatonaI close the voting and welcome ykarel in the team:-)14:10
ralonsohykarel congrats!14:10
bcafarelcongratulations ykarel!!!14:10
amotokiykarel: congrats14:10
mlavallecongrats to the new core team member. Welcome!14:10
elviracongratulations ykarel!14:10
lajoskatonaykarel: thanks for your help with keeping things running :-)14:10
slaweqykarel congrats!14:10
ykarelThanks all \o/14:11
obondarevwelcome ykarel!14:11
lajoskatonaIs there any questions, comments for announcements?14:12
lajoskatonathen let's move on14:12
lajoskatona#topic Bugs14:13
lajoskatonaReport from bcafarel: #link http://lists.openstack.org/pipermail/openstack-discuss/2022-May/028738.html14:13
lajoskatonaI saw perhaps 2 without owner:14:13
lajoskatonaNeutron RBAC not sharing subnet - #link https://bugs.launchpad.net/neutron/+bug/197560314:13
bcafarelthis one has potential fix at https://review.opendev.org/c/openstack/neutron/+/843871 but needs review (amorin noted it may re-introduce old bug)14:15
slaweqTBH for me it's not even a bug but more like improvement14:15
lajoskatonaThe question is something like this: I have a router from tenant A, and a subnet on a shared (with network rbac API) net from tenant B, if I try to add the subnet to router it fails14:15
slaweqas we never said that subnets are supported by RBAC14:16
ralonsohslaweq, subnets should mimic the network RBAC14:16
ralonsohbut yes, this should be consider an improvement14:16
lajoskatonaralonsoh: yeah that was my first idea also, but I feel gaps which I don't see exactly here :-)14:16
amotokiI think the workaround is to create a port in the shared subnet and then add it to a router.14:16
amotokithe difference is a gateway is used or not.14:16
slaweqI think it's similar to what we have with SG and SG rules14:17
lajoskatonaamotoki: sounds interesting14:17
slaweqit's similar problem14:17
ralonsoh^^ right14:17
mlavalleso make net / subnets behavior parallel to sg / sg rules as far as rbac14:17
lajoskatonaI will check this workaround and discuss it with amorin and check how sg sg rule sharing works to see the difference14:18
lajoskatonabut I agree to have both work the same way14:18
lajoskatonaok, thanks I check it with amorin and check it more14:19
mlavallemaybe continue the conersation in amorin's patch?14:19
lajoskatonamlavalle: sure I will check that also (I just seen that amorin pushed a patch)14:19
mlavalleI want to know what happens :-)14:19
lajoskatonamlavalle: :-) being informed is important14:20
lajoskatonaThe next bug which I found:14:21
lajoskatonadifference in execution time between admin/non-admin call - #link https://bugs.launchpad.net/neutron/+bug/197582814:21
lajoskatonathis is let's say the 2nd part of https://bugs.launchpad.net/neutron/+bug/1973349 (Slow queries after upgrade to Xena )14:22
ralonsohI still need to reproduce it and check why is this happening14:22
ralonsohthe first part is solved14:22
lajoskatonaralonsoh: thanks, yes I was looking for the patch for it14:23
ralonsohhttps://review.opendev.org/c/openstack/neutron/+/84176114:23
lajoskatonathanks for checking it14:23
mlavalleis this latest bug with master?14:23
ralonsohno idea, I still need to check it14:23
lajoskatonamlavalle: the original bug was reported for Xena14:24
mlavalleyeah, I realize that, but this latter bug doesn't specify14:25
lajoskatonamlavalle: my mistake, I just blindly copy-pasted the 2nd question from the original one14:25
mlavalleok, I will assume Xena14:26
mlavallelet's move on14:26
lajoskatonabcafarel: is there anything more to discuss from last week's bugs?14:26
bcafarellajoskatona: all good I had the same 2 bugs in my "to mention" list - others have patches merged or well in the review process14:26
opendevreviewyatin proposed openstack/neutron master: [DNM][FT] debug logs  https://review.opendev.org/c/openstack/neutron/+/84379114:27
lajoskatonabcafarel: thanks, sounds good14:27
lajoskatonaok, let's move14:27
lajoskatonaThis week haleyb is the deputy and next week amotoki will be.14:27
lajoskatonaamotoki: is that works for you?14:27
amotokilajoskatona: works for me14:27
lajoskatonaamotoki: ok, thanks :-)14:27
lajoskatona#topic On Demand Agenda14:28
lajoskatonaIs there anything you would like to discuss?14:28
amotokii have one small thing14:28
lajoskatonaamotoki: please tell us14:29
amotokiregarding vpnaas, mnaser proposed the removal of feature/lbaasv2. it is a part of branch cleanup14:29
amotokihttps://lists.openstack.org/pipermail/openstack-discuss/2022-May/028683.html14:29
amotokiit looks fine to drop the branch without tagging the head14:29
amotokias it was covered by the corresponding branch in the neutron repo completely (as already mentioned in the ML thread).14:29
amotokiI would like to double check it here in our meeting14:30
amotokithought?14:30
lajoskatonaamotoki: good that you mentioned it. thanks14:30
lajoskatonaI just checked your comments, and your memories looks correct, it really looks like it was a step to cut out fwaas14:31
amotokilajoskatona: exactly14:31
amotokiwe applied the same process when we split out advanced services. it is true for vpnaas, fwaas, lbaas and dynamic-routing14:32
lajoskatonathis week when I checked other stadiums found similar branches so I have to double check, and perhaps we can remove those also, I will mention them in the mail for EOL-ing old branches14:32
amotokilajoskatona: +114:32
lajoskatonaif there's no more topics we can close for today14:34
liuyulong#link https://review.opendev.org/q/topic:packet_rate_limit Hi guys, request for review again, it is fine to get in now. Thank you for your time. : )14:34
lajoskatonaliuyulong: welcome, I will check again for sure the hanging ones14:34
liuyulongNew features with no harm to existing code, so it is safe to get merged.14:35
liuyulonglajoskatona, Thank you. : )14:35
opendevreviewFernando Royo proposed openstack/ovn-octavia-provider stable/ussuri: Fix Load balancer remains on PENDING_CREATE  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/84405914:37
lajoskatonaLet's save ~23 minutes then:-)14:37
bcafarel\o/14:37
lajoskatona#endmeeting14:37
opendevmeetMeeting ended Tue May 31 14:37:22 2022 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)14:37
opendevmeetMinutes:        https://meetings.opendev.org/meetings/networking/2022/networking.2022-05-31-14.00.html14:37
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/networking/2022/networking.2022-05-31-14.00.txt14:37
opendevmeetLog:            https://meetings.opendev.org/meetings/networking/2022/networking.2022-05-31-14.00.log.html14:37
slaweqo/14:37
lajoskatonao/14:37
ralonsohbye14:37
rubasovo/14:37
amotokio/14:37
mlavalleo/14:37
ykarelo/14:37
elvirao/14:37
obondarevo/14:38
*** elvira1 is now known as elvira14:46
slaweq#startmeeting neutron_ci15:00
opendevmeetMeeting started Tue May 31 15:00:11 2022 UTC and is due to finish in 60 minutes.  The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot.15:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
opendevmeetThe meeting name has been set to 'neutron_ci'15:00
bcafarelo/ again15:00
slaweqralonsoh lajoskatona bcafarel ykarel obondarev mlavalle ping, CI meeting is starting15:01
ralonsohhi sorry15:01
obondarevhi15:01
ykarelo/15:01
mlavalleo/15:01
lajoskatonaHi15:02
slaweqok, lets start as we have quorum already15:02
slaweqGrafana dashboard: https://grafana.opendev.org/d/f913631585/neutron-failure-rate?orgId=115:02
slaweq#topic Actions from previous meetings15:03
slaweqmlavalle  to propose making things not supported framework in Neutron15:03
mlavalledidn't make progress on that last week. I'll work on it this week15:03
slaweqok15:03
slaweq#action mlavalle  to propose making things not supported framework in Neutron15:04
slaweqlets not forget about it :)15:04
slaweqnext one15:04
slaweqykarel will propose to use other cirros image to avoid kernel panics15:04
ykarelDone https://review.opendev.org/q/I34f3bbf7d30ddce23758ffb513abff0500b1fad615:04
ykarelmerged till wallaby15:05
slaweqthx a lot15:05
ykareldo we need to backport to older branches too15:05
opendevreviewRodolfo Alonso proposed openstack/neutron master: [WIP] Skip "PortBindingChassisEvent" if revision number changes  https://review.opendev.org/c/openstack/neutron/+/84214715:05
ykarelfor singlenodes jobs also it was backported till wallaby, so i did same to multinodes15:05
slaweqI think it's enough15:06
ykarelk15:06
slaweqnext one15:06
slaweqykarel to check fips issues in periodic jobs https://zuul.openstack.org/build/8a3af48f193141feb6e5dd496e66e58a15:06
ykareli checked that and pushed https://review.opendev.org/c/openstack/neutron/+/843245 to switch those jobs to c9-stream15:07
ykarelbut faced couple of issues and reported https://bugs.launchpad.net/neutron/+bug/197632315:07
ykareland to unblock this job until all issues in c9-stream are fixed pushed https://review.opendev.org/c/openstack/neutron/+/84325215:07
ykarelto use python3.8 in c8-stream itself15:07
ykarelthis is working fine15:07
lajoskatonaykarel: nice one15:08
ykarelalso noticed scenario fips job in yoga broken due to py3.6+ tempest master15:08
slaweqykarel thx, I can assign that bug to myself and work on this centos9 stream issues15:08
ykarelpushed https://review.opendev.org/c/openstack/neutron/+/843824 15:08
ykarelslaweq, okk, i didn't digged much, just checked functional issues are reproducable locally15:09
slaweqk, I will deploy box with c9s and will work on it15:10
slaweqfor now using py38 and c8s should be enough IMO15:10
ykarelack15:10
slaweq#action slaweq to fix functiona/fullstack failures on centos 9 stream: https://bugs.launchpad.net/neutron/+bug/197632315:10
slaweqso last AI from last week:15:11
slaweqlajoskatona to update UT periodic jobs to use at least py3815:11
lajoskatonaI checked, but was slow and gmann fixed it before me:15:11
lajoskatonahttps://review.opendev.org/c/openstack/openstack-zuul-jobs/+/84264615:11
slaweqthx gmann and lajoskatona :)15:12
lajoskatonaI just run after the events :-)15:12
slaweqok, so that were all AI from last week15:12
slaweqI think we can move on15:13
slaweq#topic Stable branches15:13
slaweqany news here bcafarel15:13
bcafarellet's see, wallaby and newer are good15:13
bcafarelfor older branches you probably saw the gate issue mail (dropped py36 in tempest etc) - thanks gmann for working on these fixes15:13
gmanndevstack patches merged now15:14
bcafarelhttps://review.opendev.org/c/openstack/neutron-tempest-plugin/+/838053 is close to merge for ussuri/victoria then we will need https://review.opendev.org/c/openstack/neutron/+/843781 for ussuri15:14
gmannyeah15:14
ykareltrain should also be good one of my patch merged today15:14
gmannyeah train is already pinned before15:14
lajoskatonagmann: thanks15:14
slaweqthx for working on this15:15
slaweqanything else regarding stable branches or can we move on?15:16
bcafarelrest is good :) we can move on15:16
slaweqthx15:16
slaweq#topic Stadium projects15:17
slaweqlajoskatona anything new here?15:17
lajoskatonanothing extra from me15:17
slaweq++15:17
slaweqno news is good news generally15:17
slaweqat least in that meeting :)15:17
lajoskatonaas mentioned on previous meeting I will send out to EOl old branches15:17
lajoskatonaslaweq: agree :-)15:17
ykarelis issue with networking-sfc known?15:17
ykareli saw it too affected by sqlalchemy 2 changes15:17
slaweqykarel what issue exactly?15:18
ralonsohyes15:18
ralonsohit is reported15:18
lajoskatonaykarel: I saw tempest failure, is that you mean?15:18
ralonsohhttps://bugs.launchpad.net/neutron/+bug/197636015:18
ykarelyes i meant ^ one15:18
ykarelseen in neutron-tempest-plugin patch15:18
ralonsohI'll push a patch tomorrow (but you can take it, if you want)15:19
lajoskatonathanks, I can check this one15:19
ralonsohcool15:19
slaweq++15:19
ykareli can check but tomorrow only15:19
lajoskatonathis morning I hoped it is temporary glitch, and havent cheked the logs in detail15:20
ralonsohnope, it is legit15:20
ykarelralonsoh, ok i will assign myself and push a patch in my morning15:20
ralonsohykarel++15:20
slaweqthx ykarel and ralonsoh15:21
slaweqI think we can move on to the next topic15:21
slaweq#topic Grafana15:21
slaweqfirst of all we need to remove emove lower-constraints and py36 jobs from the graphs15:21
slaweqanyone wants to do this?15:21
ralonsohI can15:22
slaweqthx ralonsoh15:22
slaweq#action ralonsoh to remove lower-constraints and py36 jobs from the graphs in grafana15:22
slaweqother than that I still see that functional tests job is our biggest pain15:22
slaweqgood thing is that our scenario jobs are really good recently15:23
slaweqfor functional tests still our biggest issue is the one with timeouts during ha router's state transition15:24
slaweqso I was thinking today that maybe we can temporary mark all tests which are doing such transition as unstable15:24
slaweqwdyt?15:24
ralonsohfine for me15:24
obondarev+115:24
bcafarel+1 that's our biggest offender currently15:24
mlavalle+115:24
ykarel+115:24
lajoskatona+115:25
slaweqso I will propose patch tomorrow15:25
slaweq#action slaweq to mark functional l3 ha tests as unstable temporary15:25
slaweqanything else regarding grafana?15:25
slaweqor can we move on?15:25
mlavallelet's move on15:26
lajoskatona+115:26
slaweq#topic Rechecks15:26
slaweqrechecks in last weeks were mostly below 1 in average:15:27
slaweq| 2022-17 |   0.77   |... (full message at https://matrix.org/_matrix/media/r0/download/matrix.org/DzfbWLzrhYzumKNEejtutJsy)15:27
slaweqso it's still pretty good IMO15:27
slaweqGate failure bugs: https://tinyurl.com/2p9x6yr2 - we have 27 bugs opened, -1 from last week15:27
slaweqthx for working on some of them15:27
slaweqlast topic for today15:28
slaweq#topic Periodic15:28
slaweqwe have couple of jobs broken there15:28
slaweqfirst one:15:28
slaweqpropose-translation-update is broken15:28
slaweqhttps://zuul.openstack.org/build/5504f6afb3ce46fdad29afd9e0b59e1915:28
slaweqit seems that it's broken since 29.0515:29
slaweqhttps://zuul.openstack.org/buildset/779c07f580cb42fabeba7ad5e6640a1c15:29
ralonsohI'll check installing it manually. Maybe this is just a problem with some pypi versions15:29
ykareli heard it's related to py3.615:29
ralonsohcan we move it to 38?15:30
ykarelthere are some constraints that i hear15:30
slaweqralonsoh probably we should :)15:30
ykarelfrickler likely have more context on ^15:30
ykarelbut it's a known issue, not just for neutron15:30
slaweqykarel ok, thx. So lets monitor it for now :)15:31
lajoskatonaykarel: so perhaps common soultion will be for it15:31
ykarelyes15:31
slaweqnext one is about openstack-tox-py39-with-oslo-master which is also broken15:32
ralonsohdo you have a link?15:32
slaweqhttps://zuul.openstack.org/build/7aef47045c9649a58d28d87e86839f1e15:32
ykarelERROR: InterpreterNotFound: python3.915:33
ykarelas it's running on ubuntu-focal15:33
slaweqyeah15:33
slaweqbut it's strange for me15:33
slaweqsimilar job with neutron-lib master is fine https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_687/periodic/opendev.org/openstack/neutron/master/openstack-tox-py39-with-neutron-lib-master/6875d5b/job-output.txt15:33
slaweqalso on focal15:34
ralonsohhttps://review.opendev.org/c/openstack/openstack-zuul-jobs/+/84264615:35
ralonsohthat was added 9 days ago15:35
ralonsohwhen moving from 36 to 3915:35
slaweqyeah together with other jobs15:35
slaweqlike the one with neutron-lib-master15:36
ralonsohactually there is a comment from frickler saying "This doesn't work, bionic lacks py39."15:36
lajoskatonayes as both is on focal it is strange15:36
ralonsohbut in focal, the default interpreter is 38, right?15:37
ralonsohyou need to manually install 3915:37
lajoskatonayou are right,15:37
slaweqok, I will compare those jobs and check why it's working differently15:37
lajoskatonaso in one case we got an image with preinstalled py39?15:37
slaweqand I will report bug for it15:37
ralonsohthanks15:37
slaweq#action slaweq to report bug and check failing openstack-tox-py39-with-oslo-master periodic job15:38
slaweqlast one:15:38
slaweqneutron-ovn-tempest-ovs-master-fedora is broken, but it seems that it's not related to Neutron15:38
slaweqthere is one test failing there since at least few days15:38
slaweqbut it's not really neutron related test15:38
slaweqso maybe we should simply blacklist that test?15:38
slaweqhttps://zuul.openstack.org/build/f265a35aa43649d1baa291d9e711b35915:39
ralonsohwhat's the issue? a missing image?15:39
slaweqmaybe we can ask glance/nova teams if they know that issue already15:39
slaweqralonsoh I didn't check it but my guess is that this test is creating image from running vm and can't find it later15:40
ralonsohthat's curious: this image disappears in a gap of 2 seconds15:40
ralonsohbut yes15:40
ralonsohNova folks could provide more info15:40
mlavalle+115:41
slaweqI will talk with them tomorrow and I will report bug if necessary15:41
lajoskatona+115:41
ykarel+115:41
ralonsohbecause this is not breaking the CI, we can leave it15:41
slaweq#action slaweq to talk with nova team about issue in15:41
opendevreviewMerged openstack/os-vif master: Delete trunk bridges to avoid race with Neutron  https://review.opendev.org/c/openstack/os-vif/+/84149915:41
slaweq* issue in neutron-ovn-tempest-ovs-master-fedora15:41
slaweqok, that's all what I had for today15:42
slaweqanything else You want to discuss?15:42
slaweqahh, sorry15:42
ralonsohtwo topics15:42
ralonsohquick15:42
slaweqone last thing15:42
slaweqbut ralonsoh go on with Yours15:42
ralonsohplease, go on15:42
slaweq#topic On Demand agenda15:43
slaweqthx15:43
slaweqI will be fast15:43
slaweqnext week I will be in Berlin15:43
slaweqshould I cancel ci meeting?15:43
slaweqor do You want to do it?15:43
ralonsohok to cancel it15:43
slaweqI will not have time to attend probably15:43
mlavalle+115:43
ykarel+115:43
lajoskatonagood that you mention it, I will be there too, so I will cancel the team meeting15:44
slaweq++15:44
slaweqthx15:44
mlavalleok15:44
mlavalleno meetings next Tuesday15:44
slaweqok, ralonsoh: Your turn 😃15:44
ralonsohthanks15:44
ralonsohabout the sqlalchemy issues, please add the [sqlachemy-20] prefix in the description15:44
ralonsohand sorry for so many of them15:44
ralonsohbut they are difficult to spot15:44
ralonsohand second15:45
ralonsohos-ken UT is based on "nose" library15:45
ralonsohtotally unsupported in py31015:45
ralonsohand "nose2" is not a replacement15:45
ralonsohso the idea is to move UT to unittest15:45
ralonsohof course, as usual, this is not trivial nor easy15:45
ralonsohbut we have time for this15:45
ralonsohthat's all15:45
lajoskatonaralonsoh: good catch15:45
ralonsohbtw, I'll open a bug for this15:46
slaweqralonsoh++15:46
slaweqplease remember that we use storyboard for os-ken bugs15:46
ralonsohsure15:46
slaweqabout prefix [sqlachemy-20]15:46
slaweqdo You want it to be added to bug titles in LP?15:46
slaweqor to the patches?15:47
ralonsohyes15:47
ralonsohjust to group the "shame"...15:47
slaweqor both?15:47
ralonsohLP is fine, I think15:47
mlavalleok15:47
slaweqmaybe better would be to add such tag to the bugs in LP?15:47
slaweqinstead of title's prefix15:47
ralonsohagree with this too15:47
ralonsohperfect then15:47
lajoskatona+1 for tag15:48
slaweqok, so lets add tag sqlalchemy-20 for such bugs15:48
slaweqif there is nothing else for today, I think we can finish this meeting15:49
ykareljust one thing15:49
ykareli have pushed some patches to devstack and grenade to make ovn-grenade job green, testing in https://review.opendev.org/c/openstack/neutron/+/83614115:49
slaweqsure ykarel15:49
ykarelplease check these, this will also be needed for tick-tick upgrades15:49
slaweq++ thx a lot15:49
slaweqI will check them tomorrow15:49
ykareland also one backport from lajoskatona https://review.opendev.org/c/openstack/neutron/+/83768115:50
ykarel^ needed for stable/wallaby too as pyroute2 updated there15:50
mlavalleI'll check the backport15:50
slaweqme too15:51
slaweqok, now I think we can finish the meeting :)15:52
slaweqthx for attending15:52
slaweqhave a great week and see You all online15:52
bcafarelo/15:52
ralonsohbye!15:52
slaweqand lajoskatona see You in Berlin in person finally :)15:53
lajoskatonao/15:53
ralonsohhehehe15:53
mlavalleo/15:53
slaweq#endmeeting15:53
opendevmeetMeeting ended Tue May 31 15:53:12 2022 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:53
opendevmeetMinutes:        https://meetings.opendev.org/meetings/neutron_ci/2022/neutron_ci.2022-05-31-15.00.html15:53
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/neutron_ci/2022/neutron_ci.2022-05-31-15.00.txt15:53
opendevmeetLog:            https://meetings.opendev.org/meetings/neutron_ci/2022/neutron_ci.2022-05-31-15.00.log.html15:53
lajoskatonaslaweq: sure :-)15:53
mlavallehave a nice trip slaweq and lajoskatona 15:53
slaweqwe need to go for some beer :)15:53
slaweqthx mlavalle15:53
opendevreviewFernando Royo proposed openstack/networking-ovn stable/train: Fix Load balancer remains on PENDING_CREATE  https://review.opendev.org/c/openstack/networking-ovn/+/84410316:14
opendevreviewMerged openstack/ovn-octavia-provider master: Fix way of calculate LB status after HM event  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/84330816:28
opendevreviewPedro Henrique Pereira Martins proposed openstack/python-neutronclient master: Add support to floating ip port forwarding  https://review.opendev.org/c/openstack/python-neutronclient/+/83772517:35
opendevreviewJakub Libosvar proposed openstack/neutron stable/yoga: [OVN][Migration] More robust checks on stop-agents  https://review.opendev.org/c/openstack/neutron/+/84407418:05
opendevreviewJakub Libosvar proposed openstack/neutron stable/xena: [OVN][Migration] More robust checks on stop-agents  https://review.opendev.org/c/openstack/neutron/+/84407518:05
opendevreviewJakub Libosvar proposed openstack/neutron stable/wallaby: [OVN][Migration] More robust checks on stop-agents  https://review.opendev.org/c/openstack/neutron/+/84407618:05
opendevreviewMerged openstack/neutron master: [Trunk] Check if parent port belongs to OVN to activate  https://review.opendev.org/c/openstack/neutron/+/84324719:55
opendevreviewMerged openstack/neutron-tempest-plugin master: Pin neutron-tempest-plugin for ussuri/victoria jobs  https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/83805319:55

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!