opendevreview | Merged openstack/neutron master: Use neutron-lib payloads for PORT_FORWARDING https://review.opendev.org/c/openstack/neutron/+/802990 | 01:56 |
---|---|---|
amotoki | hi, I am watching jobs results of https://review.opendev.org/c/openstack/neutron-lib/+/792774 (bgp association API definition) for a neutron-lib release, | 05:56 |
amotoki | but neutron-functional-with-uwsgi is failing with too high rate. 6 of 7 runs failed. | 05:56 |
amotoki | does the job fail frequently like this or is it new? | 05:57 |
lajoskatona | amotoki: as I checked it is failing with similar pattern, not always the same test, but from the group neutron.tests.functional.plugins.ml2.drivers.ovn.mech_driver.ovsdb | 06:32 |
lajoskatona | amotoki: Hi | 06:32 |
amotoki | lajoskatona: yeah, I saw it too. | 06:32 |
lajoskatona | amotoki: not always that group of tests, I checked a few more runs | 06:33 |
amotoki | I checked the recent 5 failures and 4 of 5 failed during create_default_drop_port_group() | 06:41 |
amotoki | 5 failures in https://review.opendev.org/c/openstack/neutron-lib/+/792774 | 06:42 |
amotoki | an example is https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_8b7/792774/26/gate/neutron-functional-with-uwsgi/8b71a70/testr_results.html | 06:45 |
opendevreview | Lajos Katona proposed openstack/tap-as-a-service master: Tests: remove tempest plugin from taas repository https://review.opendev.org/c/openstack/tap-as-a-service/+/804707 | 06:54 |
*** rpittau|afk is now known as rpittau | 07:08 | |
lajoskatona | amotoki: we have a bug for similar issues: https://bugs.launchpad.net/neutron/+bug/1938766 | 07:24 |
lajoskatona | amotoki: and the patch to add more logs is hanging in the gate: https://review.opendev.org/c/openstack/neutron/+/803936 | 07:24 |
amotoki | lajoskatona: I think the bug you mentioned is not the root cause of the failure which is happening currently. | 07:26 |
amotoki | lajoskatona: _collect_processes_logs and self.mech_driver.nb_ovn.ovsdb_connection.stop are both called as cleanup. | 07:26 |
amotoki | lajoskatona: looking at https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_8b7/792774/26/gate/neutron-functional-with-uwsgi/8b71a70/testr_results.html, the first failure happend in create_default_drop_port_group | 07:27 |
amotoki | but we can use this bug to track the issue | 07:28 |
amotoki | I will comment what I checked in that bug. | 07:29 |
obondarev | amotoki: are you talking about https://bugs.launchpad.net/neutron/+bug/1938766? | 07:40 |
obondarev | seems name should be updated to reflect actual issue | 07:41 |
amotoki | obondarev: yes, I just added my comment. I confirmed create_default_drop_port_group() failed in all cases with "No such file or directory" | 07:42 |
amotoki | obondarev: I will update the title of the bug. | 07:42 |
obondarev | amotoki: cool, thank you. But the failure is "KeyError: UUID('<..>')" isn't it? | 07:43 |
obondarev | "No such file or directory" is a cleanup failure | 07:43 |
amotoki | obondarev: exactly | 07:43 |
obondarev | amotoki: your comment says: "create_default_drop_port_group() fails in all failures with "No such file or directory: '/tmp/tmps9cyr99c/ovn_northd.log'"" | 07:45 |
obondarev | should it be "create_default_drop_port_group() fails in all failures with KeyError"? | 07:45 |
obondarev | or am I missing something? | 07:46 |
amotoki | obondarev: previousy the bug title is about "No such file or directory", so I checked all failured linked in the description and confirmed "No such file or directory" happend when create_default_drop_port_group failed. | 07:47 |
amotoki | this is what I would like to say in the sentence. | 07:47 |
obondarev | amotoki: ok got it | 07:48 |
amotoki | I now updated the bug title to "neutron-functional-with-uwsgi fails with "KeyError: UUID" during create_default_drop_port_group" so I believe we are in the same page. | 07:48 |
obondarev | great, thanks! | 07:48 |
*** redrobot1 is now known as redrobot | 07:59 | |
ralonsoh | amotoki, obondarev hi. The problem reported in the LP description | 08:07 |
ralonsoh | KeyError: UUID('c9570a47-64da-4360-9c94-12ba459344c2') | 08:07 |
ralonsoh | is due to the "create_default_drop_port_group" failure | 08:07 |
ralonsoh | and that happens if the ovs controller didn't start correctly | 08:07 |
amotoki | ralonsoh: yeah, I updated so :) | 08:08 |
ralonsoh | this is why https://review.opendev.org/c/openstack/neutron/+/803936 was submitted | 08:08 |
ralonsoh | obondarev, lajoskatona https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/805057, if you have some time | 08:17 |
ralonsoh | obondarev, I didn't see your vote, thanks | 08:17 |
lajoskatona | ralonsoh: sure, will check | 08:18 |
obondarev | ralonsoh: thanks for working on this | 08:19 |
ralonsoh | yw | 08:19 |
opendevreview | Balazs Gibizer proposed openstack/neutron master: Add limitation about QoS min bw for PF less SRIOV platforms https://review.opendev.org/c/openstack/neutron/+/798294 | 08:37 |
opendevreview | Rodolfo Alonso proposed openstack/neutron-tempest-plugin master: Create a 384MB flavor for advance image https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/805057 | 09:37 |
ralonsoh | hi folks, can you check https://review.opendev.org/c/openstack/neutron-specs/+/799198 ? | 09:51 |
amotoki | ralonsoh: sure | 09:56 |
opendevreview | Merged openstack/neutron-lib master: Introduce new bgp_associations API definition https://review.opendev.org/c/openstack/neutron-lib/+/792774 | 10:37 |
opendevreview | Rodolfo Alonso proposed openstack/neutron-lib master: Add network_ip_availability pagging support https://review.opendev.org/c/openstack/neutron-lib/+/803050 | 10:39 |
opendevreview | Lajos Katona proposed openstack/neutron master: WIP: Add functional tests for ECMP routes https://review.opendev.org/c/openstack/neutron/+/805052 | 11:44 |
opendevreview | Lajos Katona proposed openstack/neutron master: WIP: Add functional tests for ECMP routes https://review.opendev.org/c/openstack/neutron/+/805052 | 11:46 |
masterpe[m] | What is the best way to failover a neutron router? | 12:02 |
opendevreview | Thiago Paiva Brito proposed openstack/neutron stable/ussuri: Randomize segmentation ID assignation https://review.opendev.org/c/openstack/neutron/+/804999 | 12:41 |
opendevreview | sean mooney proposed openstack/os-vif master: extend per-port bridge support to vhost-user https://review.opendev.org/c/openstack/os-vif/+/805214 | 13:13 |
opendevreview | Rodolfo Alonso proposed openstack/neutron-tempest-plugin master: Create a 384MB flavor for advance image https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/805057 | 13:33 |
amotoki | gibi: hi, we are cutting a new relase of neutron-lib as this week is non-client-lib freeze. do we need https://review.opendev.org/c/openstack/neutron-lib/+/805010 in Xena? it was not listed in the meeting but I am doing double-check. | 13:39 |
amotoki | gibi: you looks the owner of bp/qos-minimum-guaranteed-packet-rate | 13:39 |
gibi | amotoki: hi! it is a good to have patch. As far as I understand if it not par to the neutron-lib release then we can keep that code in neutron in Xena. If you still can included that in the latest neutron-lib that would be good | 13:40 |
opendevreview | Rodolfo Alonso proposed openstack/neutron-lib master: Add network_ip_availability pagging support https://review.opendev.org/c/openstack/neutron-lib/+/803050 | 13:44 |
kklimonda | dalvarez: would https://review.opendev.org/c/openstack/neutron/+/791997 be a candidate for backport to stable releases? If not, I have a patch for ussuri (and probably victoria+wallaby) to fix this mechanism - it was broken by the patch that changed uuid used by metadata proxy from datapath to neutron network, where readiness check wasn't updated and now it waits 15 seconds on every "up port" event from ovn | 13:44 |
amotoki | gibi: thanks for clarfication. my understanding is same. the current neutron-lib func job is not so stable, so I would like to wait one more recheck and see how it goes. If fails, I think it is better to cut a release neutron-lib as-is. | 13:47 |
opendevreview | sean mooney proposed openstack/os-vif master: Use TCP keepalives for ovsdb connections https://review.opendev.org/c/openstack/os-vif/+/805223 | 13:49 |
gibi | amotoki: that is totally OK to me | 13:51 |
amotoki | gibi: thanks | 13:51 |
ralonsoh | kklimonda, I think this patch could be backported | 13:51 |
ralonsoh | (it could be useful to have a LP bug to track it) | 13:52 |
kklimonda | thanks, I'll create LP bug and backports | 13:54 |
opendevreview | Oleg Bondarev proposed openstack/neutron master: Pass binding:vnic_type in case of bulk port creation https://review.opendev.org/c/openstack/neutron/+/804746 | 14:08 |
opendevreview | Mamatisa Nurmatov proposed openstack/neutron master: Remove shim in securitygroups_db https://review.opendev.org/c/openstack/neutron/+/804394 | 14:11 |
*** jlibosva is now known as Guest4825 | 14:30 | |
outbrito | Good day folks! I'm having some trouble trying to execute tox -e pep8 on the ussuri branch on my local clone... https://paste.opendev.org/show/808204/ | 14:39 |
outbrito | Is this a known issue? | 14:39 |
opendevreview | sean mooney proposed openstack/os-vif master: Use TCP keepalives for ovsdb connections https://review.opendev.org/c/openstack/os-vif/+/805223 | 15:01 |
opendevreview | Oleg Bondarev proposed openstack/neutron master: Handle all portbinding attrs in case of bulk port creation https://review.opendev.org/c/openstack/neutron/+/804746 | 15:21 |
opendevreview | Merged openstack/neutron-lib master: Add util to generate resource request group UUID https://review.opendev.org/c/openstack/neutron-lib/+/805010 | 15:27 |
dalvarez | kklimonda: i believe it is a candidate yeah | 15:28 |
dalvarez | kklimonda: feel free to propose, if your patch is not too complicated and you rather take that approach, that's fine as well | 15:29 |
*** rpittau is now known as rpittau|afk | 15:51 | |
opendevreview | Krzysztof Klimonda proposed openstack/neutron stable/ussuri: [ovn][metadata] Remove metadata readiness mechanism https://review.opendev.org/c/openstack/neutron/+/805317 | 23:11 |
kklimonda | dalvarez: I prefer your approach, just by a virtue of decreasing a number of writes to southbound db | 23:17 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!