Tuesday, 2020-12-08

*** spatel has quit IRC00:03
openstackgerritBrian Haley proposed openstack/ovn-octavia-provider master: Fix gate failure  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/76587200:07
openstackgerritBrian Haley proposed openstack/ovn-octavia-provider master: Fix gate failure  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/76587200:12
openstackgerritBrian Haley proposed openstack/ovn-octavia-provider master: Fix gate failure  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/76587200:19
openstackgerritBrian Haley proposed openstack/ovn-octavia-provider master: Fix gate failure  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/76587200:29
*** macz_ has quit IRC00:46
*** zzzeek has quit IRC00:47
*** zzzeek has joined #openstack-neutron00:49
*** openstackgerrit has quit IRC00:58
*** sapd1 has joined #openstack-neutron01:14
*** sapd1 has quit IRC01:19
*** sapd1 has joined #openstack-neutron01:21
*** sapd1 has quit IRC01:25
*** openstackgerrit has joined #openstack-neutron01:32
openstackgerritTerry Wilson proposed openstack/networking-ovn stable/train: Ensure ovsdb_probe_interval set before connect()  https://review.opendev.org/c/openstack/networking-ovn/+/76589601:32
*** tbachman has quit IRC02:01
*** tbachman_ has joined #openstack-neutron02:02
*** zzzeek has quit IRC02:13
*** zzzeek has joined #openstack-neutron02:14
*** zzzeek has quit IRC02:28
*** zzzeek has joined #openstack-neutron02:29
*** zzzeek has quit IRC02:34
*** hemanth_n has joined #openstack-neutron02:36
*** zzzeek has joined #openstack-neutron02:36
*** hemanth_n has quit IRC02:49
*** tamas_erdei has joined #openstack-neutron02:54
*** terdei has quit IRC02:57
*** hemanth_n has joined #openstack-neutron03:29
*** hemanth_n has quit IRC03:33
*** zzzeek has quit IRC03:44
*** zzzeek has joined #openstack-neutron03:44
*** hamalq_ has quit IRC03:45
*** rcernin has quit IRC03:46
*** hemanth_n has joined #openstack-neutron03:48
*** rcernin has joined #openstack-neutron03:50
*** sapd1 has joined #openstack-neutron03:58
*** zzzeek has quit IRC04:26
*** zzzeek has joined #openstack-neutron04:27
*** zzzeek has quit IRC04:41
*** zzzeek has joined #openstack-neutron04:45
*** jlibosva has joined #openstack-neutron04:53
*** jlibosva has quit IRC04:57
*** ratailor has joined #openstack-neutron05:03
*** lajoskatona has joined #openstack-neutron05:22
*** rcernin has quit IRC05:39
*** ociuhandu has joined #openstack-neutron05:40
*** ociuhandu has quit IRC05:44
*** benj_ has quit IRC06:04
*** benj_ has joined #openstack-neutron06:05
*** rcernin has joined #openstack-neutron06:08
*** gcheresh has joined #openstack-neutron06:24
*** elod_pto has joined #openstack-neutron06:31
*** waleedm has joined #openstack-neutron06:37
*** elod_pto has quit IRC06:38
*** zzzeek has quit IRC06:41
*** hamalq has joined #openstack-neutron06:44
*** zzzeek has joined #openstack-neutron06:45
*** rcernin has quit IRC06:45
*** elod_pto has joined #openstack-neutron06:45
*** rcernin has joined #openstack-neutron07:01
*** zzzeek has quit IRC07:03
*** zzzeek has joined #openstack-neutron07:05
*** lxkong has quit IRC07:09
*** zzzeek has quit IRC07:24
*** rcernin has quit IRC07:25
*** abdysn has joined #openstack-neutron07:26
*** zzzeek has joined #openstack-neutron07:28
*** jlibosva has joined #openstack-neutron07:30
openstackgerritMamduh proposed openstack/os-vif stable/train: Refactor code of linux_net to more cleaner and increase performace  https://review.opendev.org/c/openstack/os-vif/+/76591207:37
openstackgerritMamduh proposed openstack/os-vif stable/stein: Refactor code of linux_net to more cleaner and increase performace  https://review.opendev.org/c/openstack/os-vif/+/76591407:52
*** lpetrut has joined #openstack-neutron07:55
*** tmorin has joined #openstack-neutron08:03
*** luksky has joined #openstack-neutron08:04
*** slaweq has joined #openstack-neutron08:08
*** rpittau|afk is now known as rpittau08:10
*** tesseract has joined #openstack-neutron08:13
*** bengates has joined #openstack-neutron08:21
*** jlibosva has quit IRC08:28
*** jlibosva has joined #openstack-neutron08:29
*** ociuhandu has joined #openstack-neutron08:35
hemanth_nhi looking for reviews on https://review.opendev.org/c/openstack/neutron/+/752248 initial reviews are done with +2 .. appreciate further reviews.. thanks08:40
*** baojg has quit IRC08:44
*** ociuhandu has quit IRC08:44
openstackgerritRico Lin proposed openstack/neutron master: Switch to openstack-python3-wallaby-jobs  https://review.opendev.org/c/openstack/neutron/+/76592308:51
openstackgerritRico Lin proposed openstack/neutron master: Add openstack-python3-wallaby-jobs-arm64 job  https://review.opendev.org/c/openstack/neutron/+/74210108:53
*** zzzeek has quit IRC08:57
*** zzzeek has joined #openstack-neutron08:59
*** lxkong has joined #openstack-neutron09:00
*** tmorin has quit IRC09:05
*** baojg has joined #openstack-neutron09:05
*** baojg has quit IRC09:08
*** baojg has joined #openstack-neutron09:09
*** lucasagomes has joined #openstack-neutron09:10
openstackgerritSlawek Kaplonski proposed openstack/neutron master: Implement secure RBAC for trunk API  https://review.opendev.org/c/openstack/neutron/+/76539009:10
*** hamalq has quit IRC09:10
*** hamalq has joined #openstack-neutron09:14
*** hamalq_ has joined #openstack-neutron09:16
*** hamalq has quit IRC09:18
*** fnordahl has joined #openstack-neutron09:19
*** tmorin has joined #openstack-neutron09:20
*** hamalq_ has quit IRC09:20
openstackgerritSlawek Kaplonski proposed openstack/neutron master: Implement secure RBAC for subnet pool API  https://review.opendev.org/c/openstack/neutron/+/76539109:21
openstackgerritSlawek Kaplonski proposed openstack/neutron master: Implement secure RBAC for the subnet API  https://review.opendev.org/c/openstack/neutron/+/76539209:27
*** ociuhandu has joined #openstack-neutron09:28
openstackgerritSlawek Kaplonski proposed openstack/neutron master: Implement secure RBAC for the segment API  https://review.opendev.org/c/openstack/neutron/+/76539309:31
*** tmorin has quit IRC09:38
*** tmorin has joined #openstack-neutron09:56
*** baojg has quit IRC09:57
*** baojg has joined #openstack-neutron09:58
*** hamalq has joined #openstack-neutron10:00
openstackgerritSlawek Kaplonski proposed openstack/neutron master: Implement secure RBAC for security group API  https://review.opendev.org/c/openstack/neutron/+/76539410:00
openstackgerritLajos Katona proposed openstack/neutron master: [Docs] Guide about running and debugging tempest tests  https://review.opendev.org/c/openstack/neutron/+/76595810:04
*** hamalq has quit IRC10:04
openstackgerritBernard Cafarelli proposed openstack/neutron master: Update major release checklist  https://review.opendev.org/c/openstack/neutron/+/76595910:06
openstackgerritLajos Katona proposed openstack/neutron master: [Docs] Guide about running and debugging tempest tests  https://review.opendev.org/c/openstack/neutron/+/76595810:10
zigoWhere should I file bugs about neutron-dynamic-routing ?10:14
openstackgerritSlawek Kaplonski proposed openstack/neutron master: Implement secure RBAC for the router API  https://review.opendev.org/c/openstack/neutron/+/76539510:14
openstackgerritMamduh proposed openstack/os-vif stable/rocky: Refactor code of linux_net to more cleaner and increase performace  https://review.opendev.org/c/openstack/os-vif/+/76596210:21
lajoskatonazigo: https://launchpad.net/neutron10:30
zigolajoskatona: Is there a way to tell it's for neutron-d-r ?10:30
lajoskatonazigo: I suppose add to the subject/sumamry line that its n-d-r and there's a tag (https://docs.openstack.org/neutron/latest/contributor/policies/bugs.html#proposing-new-tags ) l3-bgp which you can use10:34
zigoBug filled: https://bugs.launchpad.net/neutron/+bug/190723210:35
openstackLaunchpad bug 1907232 in neutron "dynamic-routing: "dragent add speaker" is buggy" [Undecided,New]10:35
*** zzzeek has quit IRC10:41
*** zzzeek has joined #openstack-neutron10:42
*** jangutter has joined #openstack-neutron10:44
*** jangutter_ has quit IRC10:48
openstackgerritFlavio Fernandes proposed openstack/neutron master: Rely on worker count for HashRing caching  https://review.opendev.org/c/openstack/neutron/+/76587411:01
*** dviroel has joined #openstack-neutron11:10
*** ociuhandu has quit IRC11:14
*** ociuhandu has joined #openstack-neutron11:15
openstackgerritMamduh proposed openstack/os-vif stable/queens: Refactor code of linux_net to more cleaner and increase performace  https://review.opendev.org/c/openstack/os-vif/+/76594111:17
openstackgerritMamduh proposed openstack/os-vif stable/ussuri: Fix - os-vif fails to get the correct UpLink Representor  https://review.opendev.org/c/openstack/os-vif/+/76596711:22
openstackgerritMamduh proposed openstack/os-vif stable/train: Fix - os-vif fails to get the correct UpLink Representor  https://review.opendev.org/c/openstack/os-vif/+/76597011:24
*** ociuhandu has quit IRC11:25
*** ociuhandu has joined #openstack-neutron11:36
openstackgerritMamduh proposed openstack/os-vif stable/stein: Fix - os-vif fails to get the correct UpLink Representor  https://review.opendev.org/c/openstack/os-vif/+/76597411:37
slaweqlajoskatona: bcafarel: new CI failure: https://bugs.launchpad.net/neutron/+bug/190724211:42
openstackLaunchpad bug 1907242 in neutron "ERROR: No matching distribution found for wrapt==1.11.* in the CI jobs" [Critical,Confirmed]11:42
slaweq:/11:42
slaweqI don't understand why it happens like that in the gate11:42
slaweqlocally when I tried it works fine for me11:42
slaweq:/11:42
openstackgerritMamduh proposed openstack/os-vif stable/rocky: Fix - os-vif fails to get the correct UpLink Representor  https://review.opendev.org/c/openstack/os-vif/+/76597711:46
lajoskatonaslaweq: This morning thought it was just a glitch in some mirror or similar11:49
slaweqlajoskatona: I also though that11:49
slaweqbut if You will check logstash query it seems that it happens on many different providers11:50
bcafarel:/11:52
*** sapd1 has quit IRC11:52
bcafarelslaweq: just fired it up locally, as you said it passes though I see it picked wrapt==1.12.111:53
lajoskatonaslaweq: gibi pointed to infra where was some discussion (http://eavesdrop.openstack.org/irclogs/%23openstack-infra/latest.log.html) to bump l-c.txt11:55
openstackgerritMamduh proposed openstack/os-vif stable/queens: Fix - os-vif fails to get the correct UpLink Representor  https://review.opendev.org/c/openstack/os-vif/+/76598311:55
slaweqbcafarel: I had exactly same thing11:56
slaweqit passed with wrapt 1.12.111:57
slaweqbut when I installed 1.11.1 in the same venv, it was fine too11:57
*** gcheresh has quit IRC11:57
bcafareloh so buming l-c.txt may not be the fix then? :(11:58
*** raildo has joined #openstack-neutron11:58
*** tbachman_ has quit IRC11:58
*** hamalq has joined #openstack-neutron12:01
*** gcheresh has joined #openstack-neutron12:03
*** hamalq has quit IRC12:05
*** baojg has quit IRC12:07
*** baojg has joined #openstack-neutron12:07
*** ociuhandu has quit IRC12:09
*** ociuhandu has joined #openstack-neutron12:25
*** ratailor has quit IRC12:29
*** ociuhandu has quit IRC12:30
openstackgerritLajos Katona proposed openstack/neutron master: lower-constraints: Bump wrapt to 1.10.11  https://review.opendev.org/c/openstack/neutron/+/76598812:31
lajoskatonaslaweq, bcafarel: ^---- let's see if l-c bump has a chance or it's not enough12:32
slaweqlajoskatona: thx12:40
*** sapd1 has joined #openstack-neutron12:40
*** ociuhandu has joined #openstack-neutron12:40
*** ociuhandu has quit IRC12:41
*** ociuhandu has joined #openstack-neutron12:45
*** ociuhandu has quit IRC12:49
*** ociuhandu has joined #openstack-neutron12:58
*** Luzi has joined #openstack-neutron13:00
*** ociuhandu has quit IRC13:02
*** gcheresh has quit IRC13:02
*** ociuhandu has joined #openstack-neutron13:02
openstackgerritSlawek Kaplonski proposed openstack/neutron master: Add script which can clean patch ports between bridges  https://review.opendev.org/c/openstack/neutron/+/76599413:03
*** ociuhandu has quit IRC13:09
kklimonda_If I delete ovn's nb and sb databases, will neutron synchronize everything on restart?13:10
*** zzzeek has quit IRC13:10
*** zzzeek has joined #openstack-neutron13:11
numanskklimonda_, neutron folks can better answer it, but from my previous experience, neutron supports regenerates the ovn nb db in 2 ways. 1. Use neutron-ovn-db-sync-util. 2. Restart neutron with a config option to repair the db.13:11
*** gcheresh has joined #openstack-neutron13:12
numanskklimonda_, https://opendev.org/openstack/neutron/src/branch/master/neutron/conf/plugins/ml2/drivers/ovn/ovn_conf.py#L8613:12
numanskklimonda_, So even if for some reason, the ovn nb db is inconsistent with the neutron db, you can definitely regenerate it back. Although it may take some time if the deployment has lot of resources.13:14
kklimonda_thanks, I'll have to take a look at the ovn-sync util - I think last time I've tried using it, it bailed out with some weird exceptions. But if one of those options will make full sync then I'll just debug issues if needed13:15
kklimonda_yeah, it's a pretty small deployment for now, and not yet production, so I'm not worried about time it takes to synchronize everything13:16
*** zzzeek has quit IRC13:16
*** zzzeek has joined #openstack-neutron13:18
*** spatel has joined #openstack-neutron13:19
*** tbachman has joined #openstack-neutron13:23
*** zzzeek has quit IRC13:26
*** zzzeek has joined #openstack-neutron13:28
*** tbachman_ has joined #openstack-neutron13:32
*** tbachman has quit IRC13:33
*** tbachman_ is now known as tbachman13:33
bcafarellajoskatona: looks like 1.10.11 did not change lot - maybe try with some 1.12? to see if it changes result13:33
bcafarelhttps://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_c4f/765988/1/check/openstack-tox-pep8/c4f89a4/job-output.txt13:34
lajoskatonabcafarel: hmmm, I selected 1.10.11 as that seemed to be used in a lot of project's l-c file13:35
lajoskatonabcafarel: yeah and I just checked l-c job and pep8 and it failed with 2 different mirrors13:36
lajoskatonabcafarel: 1.12 support py38, so can be good13:38
bcafarellajoskatona: yay, going in modern land :)13:38
*** ociuhandu has joined #openstack-neutron13:39
bcafarelnot sure it will be proper fix, but at least if it helps it could make it a bit clearer13:39
openstackgerritLajos Katona proposed openstack/neutron master: lower-constraints: Bump wrapt to 1.10.11  https://review.opendev.org/c/openstack/neutron/+/76598813:40
*** ociuhandu has quit IRC13:43
*** obondarev has joined #openstack-neutron13:49
*** hemanth_n has quit IRC13:50
bcafarelwell it was worth the try...13:53
*** elvira has joined #openstack-neutron13:53
*** ociuhandu has joined #openstack-neutron13:55
*** elvira has quit IRC13:58
*** ociuhandu has quit IRC14:00
bcafarelpep8 installdeps: -c/home/zuul/src/opendev.org/openstack/requirements/upper-constraints.txt, -r/home/zuul/src/opendev.org/openstack/neutron/requirements.txt, -r/home/zuul/src/opendev.org/openstack/neutron/test-requirements.txt14:00
bcafarelhmm changing l-c will probably not impact that one then14:00
*** elvira has joined #openstack-neutron14:01
*** hamalq has joined #openstack-neutron14:02
bcafarelhttps://github.com/PyCQA/astroid/releases 2.4.0 has "Relax upper bound on wrapt"14:02
mlavalleslaweq: no meeting today?14:02
*** slaweq has quit IRC14:03
bcafarellajoskatona: slaweq: it may be time to bump astroid then (hoping there is not too many new errors)14:03
*** slaweq has joined #openstack-neutron14:04
*** sapd1 has quit IRC14:05
*** tmorin has quit IRC14:05
*** hamalq has quit IRC14:07
haleybbcafarel: i started seeing gate failures last night and never did figure it out for the ovn-provider, strange error like "ERROR: Could not find a version that satisfies the requirement pylint>=2.6.0" - but i know there is a pylint 2.6.0 :-/14:10
bcafarel:/14:10
bcafarelhaleyb: I wonder if resolvers in pip changed recently then, at least for astroid it looks similar to our error: https://github.com/PyCQA/astroid/issues/75514:11
*** tmorin has joined #openstack-neutron14:11
haleybbcafarel: i did see a wrapt failure too in a neutron change14:12
openstackgerritBernard Cafarelli proposed openstack/neutron master: Bump astroid test requirement to 2.4.0  https://review.opendev.org/c/openstack/neutron/+/76600014:12
lajoskatonahaleyb: yeah that's in neutron, but other projects has similar issues with other dependencies14:12
slaweqhaleyb: bcafarel  frickler just told me that he was able to reproduce that locally14:12
slaweqplease check on #opendev channel14:13
haleyback, i just eventually went to bed figuring it was a mirror problem or something14:13
*** ociuhandu has joined #openstack-neutron14:14
slaweqhaleyb: I don't think it's mirror issue as problem with wrapt was on many different providers14:15
*** hamalq has joined #openstack-neutron14:17
*** ociuhandu has quit IRC14:19
openstackgerritMerged openstack/neutron-tempest-plugin master: Make neutron-tempest-plugin-bgpvpn-bagpipe voting again  https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/76159414:20
*** hamalq has quit IRC14:22
*** nweinber has joined #openstack-neutron14:28
*** ociuhandu has joined #openstack-neutron14:30
openstackgerritBrian Haley proposed openstack/ovn-octavia-provider master: Fix gate failure  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/76587214:35
*** tkajinam has quit IRC14:47
*** tkajinam has joined #openstack-neutron14:47
openstackgerritBrian Haley proposed openstack/ovn-octavia-provider master: Fix gate failure  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/76587214:49
*** ociuhandu has quit IRC14:50
openstackgerritBernard Cafarelli proposed openstack/neutron master: Bump astroid test requirement to 2.4.0  https://review.opendev.org/c/openstack/neutron/+/76600014:53
openstackgerritBrian Haley proposed openstack/ovn-octavia-provider master: Fix gate failure  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/76587215:03
openstackgerritBernard Cafarelli proposed openstack/neutron master: Bump astroid test requirement to 2.4.0  https://review.opendev.org/c/openstack/neutron/+/76600015:05
openstackgerritFlavio Fernandes proposed openstack/ovn-octavia-provider master: Remove work around change for test_port_forwarding  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/76601415:07
openstackgerritFlavio Fernandes proposed openstack/ovn-octavia-provider master: Remove work around change for test_port_forwarding  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/76601415:13
*** obondarev has quit IRC15:13
openstackgerritBrian Haley proposed openstack/ovn-octavia-provider master: Fix gate failure  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/76587215:17
*** tkajinam has quit IRC15:18
*** ociuhandu has joined #openstack-neutron15:21
*** ociuhandu has quit IRC15:26
jlibosvalucasagomes: hi, I removed WIP from https://review.opendev.org/c/openstack/neutron/+/752906 based on our findings yesterday15:27
*** Luzi has quit IRC15:31
lucasagomeshaleyb, ^15:42
*** macz_ has joined #openstack-neutron15:44
haleyblucasagomes: ack, just did a recheck to make sure zuul is still happy15:47
lucasagomessounds good15:47
lucasagomesthanks15:47
jlibosvathanks15:47
jlibosvaotherwiseguy: do you think we should still merge https://review.opendev.org/c/openstack/neutron/+/753847 or shall we understand the race first?15:48
*** macz_ has quit IRC15:48
sean-k-mooneyslaweq: by the way if you are checking out that image i dont think it has cloud init so if you boot it you log in with root and no password by default15:48
otherwiseguyjlibosva: we don't understand the race?15:48
*** macz_ has joined #openstack-neutron15:48
slaweqsean-k-mooney: :/15:49
slaweqthat's not good15:49
jlibosvaotherwiseguy: is it related to the hash ring caching?15:49
sean-k-mooneyslaweq: it wont bring up networking by default so you have to run the inital setup script15:49
otherwiseguyjlibosva: shouldn't be.15:49
slaweqit would probably require a lot of changes from us15:49
jlibosvaotherwiseguy: then I shouldn't have used "we"15:49
sean-k-mooneyslaweq: the plan was to have disimage builder just  instlal cloud-init/glean15:49
sean-k-mooneywhich woudl do everythign we need15:49
slaweqsean-k-mooney: and for that Your patches are needed15:50
sean-k-mooneyi was just having issue with the initramfs finding the root disk15:50
otherwiseguyjlibosva: this one is that a Row object being passed in and used in multiple threads can be modified by a transaction in one thread, then in the RowEventHandler thread when it is run--after being matched on a condition--could be modified so that it doesn't match that condition before we call run().15:50
sean-k-mooneyslaweq: yep again that is more of a long term solution15:50
slaweqagree15:50
otherwiseguyjlibosva: So when you try to take an action based on some external id changing etc., the row that you pass in and try to grab that value in that you matched on ends up throwing an exception because it isn't there.15:51
sean-k-mooneywe could use something like ubuntu or fedora but they are boot much much larger and need more ram15:51
slaweqsean-k-mooney: and without nested virt it is slow like a hell15:51
slaweq:/15:51
slaweqwe were using ubuntu in neutron-tempest-plugin some time ago15:51
otherwiseguySo this uses an immutable object for passing into the RowEventHandler so that transactions in other threads don't affect it.15:51
slaweqand 3h timeout wasn't enough often15:52
sean-k-mooneyslaweq: ya alpine was built for embeded usecase like network aplinces so it really light weight15:52
otherwiseguyjlibosva: Someday, we will get enough fixes in that don't also break CI for CI to be fixed to allow fixes in. :P15:52
sean-k-mooneyso hopefully would not have that problem15:52
slaweqhopefully15:53
openstackgerritBrian Haley proposed openstack/ovn-octavia-provider master: Fix gate failure  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/76587215:54
jlibosvaotherwiseguy: I think my brain just raised an exception after trying to understand the race and after reading that last sentence15:55
otherwiseguyjlibosva: lol. it needs more 'fixes'. Maybe: Someday we will merge enough fixes in that don't need fixing so that we can fix CI to allow fixes in.15:56
otherwiseguyjlibosva: I am tired of race conditions.15:57
otherwiseguyMy brain can't handle too much more of them.15:57
jlibosvalet's make everything serial15:57
jlibosvamaybe they won't notice15:57
otherwiseguy:D15:57
* otherwiseguy converts neutron to functional programming style w/ no side effects15:58
otherwiseguyLike db writes :p15:58
otherwiseguyOr interacting with users.15:58
otherwiseguyI think that would cut down on bugs.15:58
slaweqjlibosva: otherwiseguy what an interesting discussion :P15:59
otherwiseguyslaweq: I can't be held responsible--my brain is partially melted.15:59
otherwiseguyEvery time I think I'm almost done getting a patch merged/backported and ready for a customer fix, upstream CI finds a new way to break.16:01
*** ociuhandu has joined #openstack-neutron16:01
jlibosvaotherwiseguy: which is better than customer finding it :)16:01
jlibosvaotherwiseguy: so back to my original question - you understand the race condition. Do you still want to merge it? It's approved but I'm afraid it's gonna destabilize the CI16:02
otherwiseguyjlibosva: I must have missed why it is going to destabilize CI.16:03
jlibosvaotherwiseguy: it introduces test failures, doesn't it?16:04
openstackgerritBrian Haley proposed openstack/ovn-octavia-provider master: Fix gate failure  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/76587216:04
sean-k-mooneyslaweq: is there a bug for this by the way16:04
otherwiseguyNot to my knowledge.16:04
otherwiseguyjlibosva: ^16:04
slaweqotherwiseguy: You should play a bit with migration to new engine facade16:04
* otherwiseguy looks again16:04
slaweqevery time You fix one failing UT other 10 starts failing ;)16:04
slaweqsean-k-mooney: nope, I didn't report anything16:05
openstackgerritSlawek Kaplonski proposed openstack/neutron master: Switch to new engine facade for l3_hamode_db leftovers  https://review.opendev.org/c/openstack/neutron/+/76492016:05
otherwiseguyjlibosva: I see the test_distributed_lock failure, but that is happening elsewhere too, right?16:05
sean-k-mooneyok ill just push a quick patch so and ill file one depening on gibi's reponce16:05
jlibosvaotherwiseguy: I thought you said with this patch it fails much more often16:05
otherwiseguyI reproduce it about 1% of the time without this patch.16:05
*** ociuhandu has quit IRC16:05
otherwiseguyjlibosva: at one time I thought that it might be causing it somehow, but then I reproduced it without. I've seen it hit a few times. I can see if it happens faster with that patch applied, though.16:06
jlibosvaotherwiseguy: can or can't ?16:07
otherwiseguyWe could also rebase it on the patch that supposedly fixes that issue.16:07
jlibosvaotherwiseguy: which one is that?16:08
otherwiseguyI can reproduce it without the frozen row patch. I can also test the patch locally with --until-fail to see if it happens more often with the frozen row patch.16:09
otherwiseguyjlibosva: https://review.opendev.org/c/openstack/neutron/+/765874/16:09
otherwiseguyis the thing that should fix test_distributed_lock16:10
jlibosvaotherwiseguy: you just told me few minutes back it's not related to that :-D16:10
jlibosva16:49:16        jlibosva │ otherwiseguy: is it related to the hash ring caching?16:10
jlibosva16:49:22    otherwiseguy │ jlibosva: shouldn't be.16:10
otherwiseguythe frozen row patch isn't related to it. it just happens to be held up by the failing test that that fixes.16:11
otherwiseguyat least occasionally held up.16:11
otherwiseguyit's hit that failure a couple of times and the rechecks are annoying.16:11
otherwiseguybut other patches have hit it as well--it's just unknown whether the frozen row patch hits it more often than other patches.16:12
otherwiseguysorry, this has been very confusing. :p16:12
otherwiseguyjlibosva: ^16:13
openstackgerritBrian Haley proposed openstack/ovn-octavia-provider master: Fix gate failure  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/76587216:13
zigoHi there ! When I add a floating IP to a VM (I'm using floating IP routed over the next hop of a segment), I get this error message in neutron-rpc-server:16:14
zigoERROR oslo_messaging.rpc.server neutron.services.segments.exceptions.HostNotConnectedToAnySegment: Host pub1-compute-6.infomaniak.ch is not connected to any segments on routed provider network '19e9adf5-ab0d-4f4b-badf-e770e002f199'.  It should be connected to one.16:14
zigoThough my compute node is well on the matching physical network of the segment, so I don't get why I have that.16:15
zigoCan anyone give me a clue on where to search ?16:15
*** hamalq has joined #openstack-neutron16:18
*** ociuhandu has joined #openstack-neutron16:22
otherwiseguyjlibosva: maybe my use of the words 'not related' is problematic. More precise would be "The frozen row patch is definitely not causing the race condition."16:22
openstackgerritBernard Cafarelli proposed openstack/neutron master: Update requirements for recent pip failures  https://review.opendev.org/c/openstack/neutron/+/76600016:23
*** hamalq has quit IRC16:23
jlibosvaotherwiseguy: my concern was to not make the CI stability worse but you said we don't have a proof it makes it fail more often, right?16:25
otherwiseguybcafarel: Is your new upload going to fix the ERROR: Could not find a version that satisfies the requirement PyYAML>=5.3.1 (from bandit) with your astroid/wrapt fix?16:25
otherwiseguyjlibosva: we don't. but it should be something that I can check fairly quickly once my devstack vm is rebuilt.16:26
bcafarelotherwiseguy: not yet, that one and psutil one I still need to dig where they come from :/16:26
otherwiseguyjlibosva: I'm certainly not opposed to just rebasing it onto the other race condition fix either.16:26
otherwiseguybcafarel++16:26
otherwiseguynot that CI quality could be made worse at this particular moment. :D16:28
jlibosvaotherwiseguy: rebasing sounds good :) yet another patch to get in before my "after update agent fix"16:28
jlibosvalol16:28
openstackgerritBrian Haley proposed openstack/ovn-octavia-provider master: Fix gate failure  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/76587216:28
openstackgerritBernard Cafarelli proposed openstack/neutron master: Update requirements for recent pip failures  https://review.opendev.org/c/openstack/neutron/+/76600016:40
bcafarelslaweq: hopefully psutil should pass with this one ^ now to look at PyYAML16:41
*** jlibosva has quit IRC16:42
openstackgerritBrian Haley proposed openstack/ovn-octavia-provider master: Fix gate failure  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/76587216:44
openstackgerritLajos Katona proposed openstack/neutron master: lower-constraints: Bump wrapt to 1.12.0  https://review.opendev.org/c/openstack/neutron/+/76598816:44
*** dulek has quit IRC16:44
*** lpetrut has quit IRC16:48
*** waleedm has quit IRC16:50
*** ociuhandu has quit IRC16:51
*** dulek has joined #openstack-neutron16:53
*** hamalq has joined #openstack-neutron16:56
*** lucasagomes has quit IRC17:00
*** bengates has quit IRC17:01
*** hamalq has quit IRC17:01
*** hamalq has joined #openstack-neutron17:06
bcafarelhaleyb: looks like we have similar changes in our WIP patches for that pip issue :)17:07
haleybbcafarel: yes, and i'm just waiting for the lower-constraints job to pass so i can reduce it to just what's needed17:08
haleybthen will probably roll into another patch17:09
haleybwhat a mess17:09
*** ociuhandu has joined #openstack-neutron17:11
*** elvira has quit IRC17:13
openstackgerritBrian Haley proposed openstack/ovn-octavia-provider master: Fix gate failure  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/76587217:18
*** dtantsur has joined #openstack-neutron17:35
dtantsurhi folks! is neutron affected by the new pip resolver?17:35
dtantsurseeing ut failures on https://review.opendev.org/c/openstack/requirements/+/76578517:35
bcafareldtantsur: yes :( fixing them in https://review.opendev.org/c/openstack/neutron/+/766000 but it is not at green state yet17:37
dtantsurgot it, thanks!17:38
* dtantsur subscribes17:38
*** rpittau is now known as rpittau|afk17:43
openstackgerritBrian Haley proposed openstack/ovn-octavia-provider master: Fix gate failure  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/76587217:47
*** abdysn has quit IRC17:54
*** lajoskatona has quit IRC18:00
*** dtantsur is now known as dtantsur|afk18:05
*** jangutter_ has joined #openstack-neutron18:14
*** jangutter has quit IRC18:18
*** jangutter_ has quit IRC18:22
*** tesseract has quit IRC18:22
*** jangutter has joined #openstack-neutron18:23
*** ociuhandu_ has joined #openstack-neutron18:24
*** ociuhandu has quit IRC18:27
*** ociuhandu_ has quit IRC18:28
openstackgerritBrian Haley proposed openstack/ovn-octavia-provider master: Fix gate failure  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/76587218:38
*** jangutter_ has joined #openstack-neutron18:40
*** jangutter_ has quit IRC18:41
*** jangutter_ has joined #openstack-neutron18:42
*** jangutter has quit IRC18:42
*** dave-mccowan has joined #openstack-neutron18:59
*** dave-mccowan has quit IRC19:04
*** luksky has quit IRC19:51
openstackgerritBernard Cafarelli proposed openstack/neutron master: Update requirements for recent pip failures  https://review.opendev.org/c/openstack/neutron/+/76600019:53
openstackgerritBernard Cafarelli proposed openstack/neutron master: Update requirements for recent pip failures  https://review.opendev.org/c/openstack/neutron/+/76600020:01
*** luksky has joined #openstack-neutron20:05
*** jangutter has joined #openstack-neutron20:06
*** jangutter_ has quit IRC20:09
openstackgerritBrian Haley proposed openstack/ovn-octavia-provider master: Fix gate failure  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/76587220:14
openstackgerritBernard Cafarelli proposed openstack/neutron master: Update requirements for recent pip failures  https://review.opendev.org/c/openstack/neutron/+/76600020:15
bcafarellast whack-a-mole round for me tonight ^20:16
openstackgerritBrian Haley proposed openstack/ovn-octavia-provider master: Fix gate failure  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/76587220:22
openstackgerritBrian Haley proposed openstack/ovn-octavia-provider master: Fix gate failure  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/76587220:31
openstackgerritBrian Haley proposed openstack/ovn-octavia-provider master: Fix gate failure  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/76587220:40
openstackgerritSlawek Kaplonski proposed openstack/neutron master: Switch to new engine facade for IpamPluggableBackend and Ipam driver  https://review.opendev.org/c/openstack/neutron/+/66286920:46
rm_workDoes python-neutronclient support mTLS (providing a client cert/key)?21:12
rm_workit seems with HTTPClient it does not: https://github.com/openstack/python-neutronclient/blob/master/neutronclient/client.py#L419-L435 (no cert passed through)21:12
rm_workbut maybe via the SessionClient?21:12
*** gcheresh has quit IRC21:12
rm_workah, looks like the answer is yes21:20
bcafarelhaleyb++ thanks for pointer I will take a look tomorrow at that enum fix in OSC21:24
haleybbcafarel: ack.  have you found a way to test things locally?  I always get success but zuul does not agree21:25
bcafarelhaleyb: yes I was running the commands from http://lists.openstack.org/pipermail/openstack-discuss/2020-December/019285.html21:25
bcafareliterations take time now that it goes further :( but at least it is much farther than wiating for CI21:26
haleybbcafarel: thanks, i'll see if that works21:29
*** tmorin has quit IRC21:31
*** jakeyip has quit IRC21:33
*** mattia_ has joined #openstack-neutron21:41
*** mattia has quit IRC21:42
*** sorrison has joined #openstack-neutron21:51
*** ebbex has quit IRC21:55
*** ebbex has joined #openstack-neutron21:55
*** rcernin has joined #openstack-neutron21:59
*** luksky has quit IRC22:18
*** spatel has quit IRC22:19
*** luksky has joined #openstack-neutron22:32
openstackgerritBernard Cafarelli proposed openstack/neutron master: Update requirements for recent pip failures  https://review.opendev.org/c/openstack/neutron/+/76600022:34
openstackgerritBrian Haley proposed openstack/ovn-octavia-provider master: Fix gate failure  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/76587222:45
*** admin0 has joined #openstack-neutron22:45
admin0hi all .. can you let me know what is causing this ? https://gist.githubusercontent.com/a1git/851649fa6f76ebd6e4782f3d1c707501/raw/8970bdd6d4367df81474166f9aaed35c07c52013/gistfile1.txt22:45
admin0this actually stops the linuxbrige-agent, without which nova cannot spawn any new instances22:46
openstackgerritBernard Cafarelli proposed openstack/neutron master: Update requirements for recent pip failures  https://review.opendev.org/c/openstack/neutron/+/76600022:52
*** tkajinam has joined #openstack-neutron23:01
*** nweinber has quit IRC23:32
*** hoonetorg has quit IRC23:36
*** gthiemonge has quit IRC23:40
*** hoonetorg has joined #openstack-neutron23:40
*** gthiemonge has joined #openstack-neutron23:43

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!