Monday, 2024-08-26

opendevreviewyatin proposed openstack/neutron-tempest-plugin master: Revert "Make neutron-tempest-plugin-sfc job non-voting temporary"  https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/92706804:05
fricklerhaleyb: slaweq: what's your timefram to get neutron-lib done? technically that lib should be frozen now, so any missing patches would need a FFE applied. cf. https://review.opendev.org/c/openstack/releases/+/92676406:17
opendevreviewyatin proposed openstack/neutron-fwaas stable/2024.1: create default security group using an independent context  https://review.opendev.org/c/openstack/neutron-fwaas/+/92707406:32
opendevreviewyatin proposed openstack/neutron-fwaas stable/2023.2: create default security group using an independent context  https://review.opendev.org/c/openstack/neutron-fwaas/+/92707506:33
opendevreviewyatin proposed openstack/neutron-fwaas stable/2023.1: create default security group using an independent context  https://review.opendev.org/c/openstack/neutron-fwaas/+/92707606:33
opendevreviewRodolfo Alonso proposed openstack/neutron master: DNM == Make RPC event cast synchronous with the event  https://review.opendev.org/c/openstack/neutron/+/92692206:56
ralonsohfrickler, we can continue without this patch, I'll comment on the releases patch07:11
opendevreviewRodolfo Alonso proposed openstack/neutron master: Monkey patch the system libraries before calling them  https://review.opendev.org/c/openstack/neutron/+/92537607:13
opendevreviewRodolfo Alonso proposed openstack/neutron master: DNM == Test neutron-tempest-plugin-openvswitch (2)  https://review.opendev.org/c/openstack/neutron/+/92678807:13
opendevreviewRodolfo Alonso proposed openstack/neutron-lib master: Add API extension ``quota-check-limit-default``  https://review.opendev.org/c/openstack/neutron-lib/+/92677707:21
*** elodilles_pto is now known as elodilles07:24
ralonsohslaweq, lajoskatona ^^ I think the UT is now fixed. As frickler commented, n-lib should be freeze now so, regardless if you merge this patch, I think we should continue with https://review.opendev.org/c/openstack/releases/+/92676407:27
ralonsohthanks for waiting!07:27
slaweqralonsoh lajoskatona hi, please check https://review.opendev.org/c/openstack/networking-sfc/+/917972 when You will have a minute, it should be good to go now as gate is finally fixed07:31
ralonsohsure07:31
slaweqralonsoh I think that UT on your neutron-lib patch are still failing07:31
ralonsohslaweq, let me check07:31
ralonsohslaweq, no, is working now07:32
ralonsohhttps://zuul.opendev.org/t/openstack/status#92677707:32
slaweqahh, ok07:32
slaweqI just checked results in zuul, but I didn't check that it is still running07:32
slaweqsorry07:32
ralonsohslaweq, done both SFC patches07:33
slaweqthank You07:33
slaweqralonsoh regarding Your neutron-lib patch, I personally think that You can ask for exception maybe and we can still try to include it in the final release of neutron-lib for 2024.207:36
slaweqor if not, You can propose temporary same extension in neutron repo and use it there for 2024.207:37
slaweqand remove if from neutron repo once we will have it released in next neutron-lib version07:37
ralonsohslaweq, the second is better. This feature is not a hard requirement (actually that should be for the slurp version)07:39
ralonsohI'll add the extension in the neutron code, thanks!07:39
slaweqor if we don't want  to go with that change in neutron in 2024.2 we should probably not merge neutron-lib patch now, as api-ref document https://docs.openstack.org/api-ref/network/v2/index.html is always rendered from master branch, so if we will merge that patch to neutron-lib but it will not be in the 2024.2, api-ref will be wrong for that release07:39
ralonsohright, both should in sync07:40
ralonsohso I prefer to delay both patches07:40
opendevreviewRodolfo Alonso proposed openstack/neutron master: Make RPC event cast synchronous with the event  https://review.opendev.org/c/openstack/neutron/+/92692207:41
opendevreviewRodolfo Alonso proposed openstack/neutron master: Monkey patch the system libraries before calling them  https://review.opendev.org/c/openstack/neutron/+/92537607:42
opendevreviewRodolfo Alonso proposed openstack/neutron master: DNM == Test neutron-tempest-plugin-openvswitch (2)  https://review.opendev.org/c/openstack/neutron/+/92678807:43
*** liuxie is now known as liushy07:55
lajoskatonaralonsoh, slaweq: Sorry for being out of sync, For neutron-lib (https://review.opendev.org/c/openstack/neutron-lib/+/926777 ) what is the way of going with it? or let's wait for haleyb ?08:19
ralonsohlajoskatona, it is too late to have it in the code freeze, so I would just approve https://review.opendev.org/c/openstack/releases/+/92676408:20
ralonsohthis code can be in the next release, there is no problem08:20
lajoskatonaralonsoh: ack08:20
*** ykarel_ is now known as ykarel08:36
opendevreviewMerged openstack/networking-sfc master: Remove executable from python files which don't really needs it  https://review.opendev.org/c/openstack/networking-sfc/+/91797109:31
opendevreviewMerged openstack/networking-sfc master: Add pre-commit configuration  https://review.opendev.org/c/openstack/networking-sfc/+/91797209:31
opendevreviewRodolfo Alonso proposed openstack/neutron master: Add new "tagging" API method: create (POST)  https://review.opendev.org/c/openstack/neutron/+/92472410:13
opendevreviewRodolfo Alonso proposed openstack/neutron master: Bump ``oslo.serialization`` to version 5.5.0  https://review.opendev.org/c/openstack/neutron/+/92709810:19
opendevreviewRodolfo Alonso proposed openstack/neutron master: Make RPC event cast synchronous with the event  https://review.opendev.org/c/openstack/neutron/+/92692210:22
opendevreviewRodolfo Alonso proposed openstack/neutron master: Monkey patch the system libraries before calling them  https://review.opendev.org/c/openstack/neutron/+/92537610:22
opendevreviewRodolfo Alonso proposed openstack/neutron master: DNM == Test neutron-tempest-plugin-openvswitch (2)  https://review.opendev.org/c/openstack/neutron/+/92678810:22
opendevreviewyatin proposed openstack/neutron-tempest-plugin master: [pagination tests] Do not fail on zero resources  https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/92710311:14
opendevreviewyatin proposed openstack/neutron-tempest-plugin master: [pagination tests] Do not fail on zero resources  https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/92710311:34
opendevreviewRodolfo Alonso proposed openstack/neutron-tempest-plugin master: Revert "Switch networking-sfc job to be run with eventlet"  https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/92710911:39
opendevreviewRodolfo Alonso proposed openstack/neutron-tempest-plugin master: Revert "Switch networking-sfc job to be run with eventlet"  https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/92710911:40
opendevreviewRodolfo Alonso proposed openstack/neutron master: Make RPC event cast synchronous with the event  https://review.opendev.org/c/openstack/neutron/+/92692212:40
opendevreviewRodolfo Alonso proposed openstack/neutron master: Monkey patch the system libraries before calling them  https://review.opendev.org/c/openstack/neutron/+/92537612:41
opendevreviewRodolfo Alonso proposed openstack/neutron master: [WSGI] Move all OVN jobs to use WSGI API module  https://review.opendev.org/c/openstack/neutron/+/92431712:41
opendevreviewChris Buggy proposed openstack/ovn-octavia-provider stable/2024.1: Error log for missing certs with NB and SB DBs  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/92711412:42
opendevreviewGhanshyam proposed openstack/neutron master: Remove default override for RBAC config options  https://review.opendev.org/c/openstack/neutron/+/92608512:43
opendevreviewGhanshyam proposed openstack/neutron master: DNM debugging designate job  https://review.opendev.org/c/openstack/neutron/+/92694512:43
mlavalleykarel: ci meeting in ~45 minutes, right?13:14
* mlavalle trying to learn new habits :-)13:15
ykarelmlavalle, yes right13:21
opendevreviewMerged openstack/neutron master: Log a warning if pid file could not be read in l3-agent  https://review.opendev.org/c/openstack/neutron/+/92656613:25
tridentHey! Didn't see https://bugs.launchpad.net/ubuntu/+source/neutron/+bug/2077430 mentioned in the latest bug deputy report. Is there a reason for that or was it somehow missed?13:57
ralonsohtrident, this is not the neutron launchpad, but the Ubuntu one13:58
ralonsohtrident, please fill the bug in https://bugs.launchpad.net/neutron/13:58
tridentralonsoh: Damn, I see that now. Sorry, will nudge Damian about filing it in the right place! Thanks!13:59
ykarel#startmeeting neutron_ci14:02
opendevmeetMeeting started Mon Aug 26 14:02:02 2024 UTC and is due to finish in 60 minutes.  The chair is ykarel. Information about MeetBot at http://wiki.debian.org/MeetBot.14:02
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.14:02
opendevmeetThe meeting name has been set to 'neutron_ci'14:02
ykarelPing list: bcafarel, lajoskatona, haleyb, slawek, mlavalle, mtomaska, ralonsoh, jlibosva, elvira14:02
mlavalle\o14:02
slaweqo/14:02
ralonsohhello14:02
lajoskatonao/14:02
lajoskatonais this an IRC or a viceo meeting today?14:04
ykarelHello everyone this is our first meeting since Meeting time change, it's IRC today14:04
ykarelWe can start with the topics14:04
ykarel#topic Actions from previous meetings14:04
ykarelralonsoh to check failures in postgres job14:04
ralonsohI'm still reviewing that, sorry14:05
ralonsoh(I didn't have much time)14:05
ykarelk thx14:05
ykarelwill reassing for this week14:05
ykarel#action ralonsoh to check failures in postgres job14:05
ykarelslawek to check for sfc failures in coming weeks and have some conclusion for dalmatian release14:05
ykarelhttps://review.opendev.org/q/topic:%22bug/2068727%2214:05
slaweqfix is merged already14:06
slaweqand gate for networking-sfc is fixed now14:06
lajoskatonathanks, good news14:06
ykareli proposed to revert non-voting to job back to voting14:06
slaweqthx ykarel 14:06
ralonsohand I proposed https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/92710914:06
ralonsohon top of the RPC change14:06
ykarelthx slaweq ralonsoh 14:06
slaweqthx ralonsoh 14:07
ykarelthats it from previous week action items14:07
ykarel#topic Stable branches14:07
ykarelBernard is out for couple of weeks14:07
ykarelIn general there was not much activity on stable14:08
ykarelovs-rally job broken, needs backports https://review.opendev.org/q/topic:%22bug/2076430%2214:08
lajoskatonasmall thing: on some stable branches the rally job is failing14:08
ykarelpostgres periodic job broken, rodolfo looking into that14:08
lajoskatonaahh, yes that one14:08
ykareltox-py311(non-voting) broken post move to ubuntu-noble https://review.opendev.org/c/opendev/base-jobs/+/92636014:08
ykarellajoskatona, yes would require release for oslo serialization backports to clear that14:09
ykarel#topic Stadium projects14:09
lajoskatonaykarel: ack, when https://review.opendev.org/c/openstack/oslo.serialization/+/927026 is merged to 2023.1, I will propose releasa patch14:09
ykarellajoskatona, thx14:10
ykarel#info finally neutron-sfc green14:10
ykarelneutron-vpnaas had a failure https://zuul.openstack.org/build/5991943b070f46608c524fe8d884774614:10
lajoskatonavpnaas job failed, not sure if it was just an accident or have to fix it14:10
lajoskatonaI just quickly checked before the meeting14:10
ykarellajoskatona, can you check if it's one time thing or a real issue14:10
lajoskatonasure, please add the AP for my nam14:11
lajoskatonaname---^14:11
ykarel#action lajoskatona to check neutron-vpnaas periodic failure14:11
ykarelthx14:11
lajoskatonajust a quick question for Ubuntu Noble 14:11
lajoskatonaall jobs were changed?14:11
lajoskatonaI mean to use nobe node-set?14:12
ykarelmost of the jobs we set nodeset explicitly 14:12
ykarelso not all changed, only the ones which do not set nodeset explicitly14:12
lajoskatonaack, I suppose we have time for those to change after the release?14:12
ykarelthe failure is seen in stable release, i not digged much14:13
ykareljob is non voting there, but would be good to clear that, i added it for later section, we can check there14:14
lajoskatonaack14:14
ykarel#topic Rechecks14:14
ykareloverall good here, bare rechecks 0/814:15
ykarelLet's check out failures14:16
ykarel#topic fullstack/functional14:16
ykareltest_fip_connection_for_address_scope14:16
ykarelseen twice14:16
ykarelhttps://7a8791b91414025d7f9e-ee680e3b8cf506c3665caad0d1bd3d66.ssl.cf2.rackcdn.com/periodic/opendev.org/openstack/neutron/master/neutron-functional-with-sqlalchemy-master/4cfe98e/testr_results.html14:16
ykarelhttps://c972f4bb262ae2d5c5d6-598e1d61c0aab85aa3b67b337ca2c556.ssl.cf2.rackcdn.com/periodic/opendev.org/openstack/neutron/master/neutron-functional-with-uwsgi-fips/9d219de/testr_results.html14:16
ykarel    The test was re enabled last year https://review.opendev.org/c/openstack/neutron/+/896728 and we hit the failures some times14:16
ykarelany volunteer to check it further?14:17
ralonsohI'll do it14:17
ykarelthx ralonsoh 14:17
ykarel#action ralonsoh to check test_fip_connection_for_address_scope ft failure14:17
ykareltest_agent_delete14:17
ykarelFails like KeyError: 'e7284c3b-5cce-48b0-bf97-5e12e80071ef'14:17
ykarelalso seen twice14:17
ykarelhttps://3635896206e8229762ea-81b7edb0863976b5a5111fb4b7624783.ssl.cf1.rackcdn.com/925376/2/check/neutron-functional-with-uwsgi/9b6f08b/testr_results.html14:17
ykarelhttps://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_50c/926079/4/gate/neutron-functional-with-uwsgi/50c72c0/testr_results.html14:18
ralonsohI can check it too14:18
ykarelthx ralonsoh 14:18
ykarel#action ralonsoh to check test_agent_delete ft failure14:19
ykarel#topic Tempest/Scenario14:19
ykarelstill saw a failure with pagination api test after recent fix14:19
ykarelpushed https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/92710314:19
ykarelplease have a look14:19
ykarel#topic Periodic14:19
ykarelhttps://zuul.openstack.org/builds?job_name=tox-py311&project=openstack/neutron failing since switch to ubuntu-noble14:20
ykarelAny volunteer to check/clear that?14:20
ralonsohI'll do it14:20
ykarelwe may need to override nodeset or switch to openstack-tox-py31114:20
ykarellikely require additional backport for bandit which was done in stable/2023.214:21
ykarelthx much ralonsoh 14:21
ykarel#action ralonsoh to check tox-py311 failures14:21
ykarel#topic Grafana14:21
ykarelhttps://grafana.opendev.org/d/f913631585/neutron-failure-rate14:21
ykarellet's have a quick look here too14:21
ykareloverall looks good, check queue has couple of spikes, but from what i checked most of those were patch specifics14:23
lajoskatonaand the py311 failure is also visible and discussed already14:24
ykarelyes but that was on stable branch so different dashboard we seeing above14:25
ykarel#topic On Demand14:25
ykarelanything else you would like to raise here?14:26
mlavalleI have a topic / concern14:26
ykarelyes please14:26
mlavalleI think that when we fall to standard time in the northern hemisphere, red Hatters will have a meeting clash between this one and the internal one we have on Mondays14:27
mlavallejust a heads up14:27
slaweqyes, You are right mlavalle, I noticed it last week when I added this meeting to my calendar14:28
ralonsohwe can propose that change in November (Nov 4 is the first clash)14:28
ralonsohthe quorum of this meeting is reduced enough to be flexible on this14:29
ykarelthx mlavalle for raising it, yes let's revisit that time14:29
mlavallethat's all from me14:30
ykarelok then let's close early and have every one 30 minutes back14:30
ykarelthx everyone for joining14:30
ykarel#endmeeting14:30
opendevmeetMeeting ended Mon Aug 26 14:30:56 2024 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)14:30
opendevmeetMinutes:        https://meetings.opendev.org/meetings/neutron_ci/2024/neutron_ci.2024-08-26-14.02.html14:30
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/neutron_ci/2024/neutron_ci.2024-08-26-14.02.txt14:30
opendevmeetLog:            https://meetings.opendev.org/meetings/neutron_ci/2024/neutron_ci.2024-08-26-14.02.log.html14:30
ralonsohbye!14:30
mlavalle\o14:31
slaweqo/14:31
lajoskatonao/14:31
opendevreviewRodolfo Alonso proposed openstack/neutron stable/2023.1: [stable-only][2023.1] Remove CI job "tox-py311"  https://review.opendev.org/c/openstack/neutron/+/92715715:02
ralonsohhaleyb, ^ please check this patch15:03
opendevreviewChris Buggy proposed openstack/ovn-octavia-provider stable/2023.1: Error log for missing certs with NB and SB DBs  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/92717415:58
opendevreviewIhar Hrachyshka proposed openstack/neutron-tempest-plugin master: refactor: don't require host= for check_connectivity  https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/92718216:48
opendevreviewIhar Hrachyshka proposed openstack/neutron master: DNM add ovs-master job with neutron-plugin enabled  https://review.opendev.org/c/openstack/neutron/+/92718617:16
ihrachyshaleyb: remember on Thu you said we have an experimental job that would validate a tempest scenario against ovn master? neutron-ovn-tempest-ovs-master. I think it's not it: yes, it builds ovn from master; but it doesn't run tempest plugin scenarios.17:20
ihrachysseeing if I can achieve that with https://review.opendev.org/c/openstack/neutron/+/92718617:21
ihrachysalso curiously docs claim that -ovs-master jobs will run plugin scenarios: https://docs.openstack.org/neutron/latest/contributor/testing/ci_scenario_jobs.html#tempest-jobs-running-in-neutron-experimental-ci17:23
opendevreviewIhar Hrachyshka proposed openstack/neutron master: docs: ovs-master jobs do NOT run plugin scenarios  https://review.opendev.org/c/openstack/neutron/+/92718717:26
opendevreviewMerged openstack/neutron master: Remove dependencies for windows support  https://review.opendev.org/c/openstack/neutron/+/92706117:30
opendevreviewIhar Hrachyshka proposed openstack/neutron master: DNM try ovs-master with nested snat scenario and ovn=23.09 - should pass  https://review.opendev.org/c/openstack/neutron/+/92719117:35
opendevreviewIhar Hrachyshka proposed openstack/neutron-tempest-plugin master: DNM: introduce a config knob to determine if nested snat is on  https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/92719917:59
samcat116Hi folks, we are seeing some intermitent 504 gateway timeout errrors from Neutron on a 2023.2 based cloud. We have around 1500vms and 2000 networks with nearly 8k ports. We're running OVN with non DVR. Given that OVN means there shouldn't be workers spawned for these sorts of things, any ideas where to look? no clear indicators in the neutron server logs for things. One thing we are noticing is that northd is doing a leader18:48
samcat116election every few minutes. Would that cause a recompute and strain on the control plane?18:48
opendevreviewChris Buggy proposed openstack/ovn-octavia-provider stable/2023.2: Error log for missing certs with NB and SB DBs  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/92720319:34
opendevreviewIhar Hrachyshka proposed openstack/neutron master: DNM try ovs-master with nested snat scenario and ovn=23.09 - should pass  https://review.opendev.org/c/openstack/neutron/+/92719119:38
ihrachyshaleyb: fyi the new nested snat scenario PASSED in neutron-tempest-plugin-ovn job at https://review.opendev.org/c/openstack/neutron/+/927186 and the job seems to compile ovn but using a 22.03 branch revision. so looks like this works with 22.03 too?19:51
opendevreviewIhar Hrachyshka proposed openstack/neutron-tempest-plugin master: DNM: introduce a config knob to determine if nested snat is on  https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/92719920:01
otherwiseguyhaleyb: does https://review.opendev.org/c/openstack/neutron/+/926656 seem to handle the issue you were having?20:31
opendevreviewTerry Wilson proposed openstack/neutron-tempest-plugin master: Remove unstable_test from FIP test_east_west  https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/61855721:08
opendevreviewTerry Wilson proposed openstack/neutron-tempest-plugin master: Remove unstable_test from FIP test_east_west  https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/61855721:15
opendevreviewMerged openstack/neutron-tempest-plugin master: Revert "Make neutron-tempest-plugin-sfc job non-voting temporary"  https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/92706821:30
opendevreviewIhar Hrachyshka proposed openstack/neutron master: DNM Remove linuxbridge driver  https://review.opendev.org/c/openstack/neutron/+/92721623:13
opendevreviewIhar Hrachyshka proposed openstack/neutron-tempest-plugin master: Implement nested snat validation test scenario  https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/92694023:20
opendevreviewMiguel Lavalle proposed openstack/neutron master: User defined router flavor driver with no LSP  https://review.opendev.org/c/openstack/neutron/+/91780023:24
opendevreviewIhar Hrachyshka proposed openstack/neutron master: Add ovs-master job with neutron-plugin enabled  https://review.opendev.org/c/openstack/neutron/+/92721923:31
opendevreviewIhar Hrachyshka proposed openstack/neutron-tempest-plugin master: Implement nested snat validation test scenario  https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/92694023:34
opendevreviewIhar Hrachyshka proposed openstack/neutron-tempest-plugin master: Update snat_rules_apply_to_nested_networks with ovn details  https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/92722023:37
opendevreviewIhar Hrachyshka proposed openstack/neutron master: Introduce ovs-lts jobs that run against the latest ovn LTS branch  https://review.opendev.org/c/openstack/neutron/+/92722123:43

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!