| opendevreview | Lucas Alvares Gomes proposed openstack/neutron master: Split Hash Ring probing from the maintenance task https://review.opendev.org/c/openstack/neutron/+/860233 | 08:00 |
|---|---|---|
| sahid | lajoskatona: o/ have you been able to make running functional tests that need sudo? | 08:34 |
| opendevreview | Sahid Orentino Ferdjaoui proposed openstack/neutron master: dhcp: make device manager to clean only not used devices https://review.opendev.org/c/openstack/neutron/+/840419 | 08:43 |
| opendevreview | Sahid Orentino Ferdjaoui proposed openstack/neutron master: dhcp: add/use cleanup stale devices API https://review.opendev.org/c/openstack/neutron/+/840420 | 08:43 |
| opendevreview | Sahid Orentino Ferdjaoui proposed openstack/neutron master: dhcp: support multiple segmentations per network https://review.opendev.org/c/openstack/neutron/+/840421 | 08:43 |
| opendevreview | Sahid Orentino Ferdjaoui proposed openstack/neutron master: db: add segment_index to the unique constraint https://review.opendev.org/c/openstack/neutron/+/841459 | 08:43 |
| opendevreview | Sahid Orentino Ferdjaoui proposed openstack/neutron master: segment: enable multisegments support for host https://review.opendev.org/c/openstack/neutron/+/841838 | 08:43 |
| opendevreview | Merged openstack/neutron master: Remove some unnecessary list comprehensions https://review.opendev.org/c/openstack/neutron/+/860503 | 08:59 |
| lajoskatona | sahid: Hi | 09:24 |
| opendevreview | Merged openstack/ovn-octavia-provider stable/ussuri: [stable-only] Cap virtualenv for py37 https://review.opendev.org/c/openstack/ovn-octavia-provider/+/859625 | 09:26 |
| opendevreview | Merged openstack/ovn-octavia-provider stable/ussuri: Avoid LB ERROR status on delete when LS/LR are already deleted https://review.opendev.org/c/openstack/ovn-octavia-provider/+/859534 | 09:27 |
| lajoskatona | sahid: I think this is the relevant doc for you: https://docs.openstack.org/neutron/latest/contributor/testing/testing.html#id3 | 09:30 |
| labedz_ | lajoskatona: ralonsoh: if you have a minute to take a look onto this backport: https://review.opendev.org/c/openstack/neutron/+/860246/2 - need it to merge whole chain | 09:54 |
| *** labedz_ is now known as labedz | 09:54 | |
| lajoskatona | labedz_: checking | 09:55 |
| ralonsoh | ok | 09:56 |
| opendevreview | Lajos Katona proposed openstack/neutron master: CI: Add neutron-ovs-grenade-multinode-tick-tick job to check queue https://review.opendev.org/c/openstack/neutron/+/860541 | 09:56 |
| opendevreview | Krzysztof Tomaszewski proposed openstack/neutron master: Spread OVN metadata agent heartbeat response in time https://review.opendev.org/c/openstack/neutron/+/860471 | 10:00 |
| labedz | lajoskatona: ralonsoh : thx | 10:04 |
| labedz | about to "frozen" rows to avoid | 10:05 |
| labedz | sh*t | 10:05 |
| labedz | about https://review.opendev.org/c/openstack/neutron/+/860471: what is your general opinion about that solution? | 10:06 |
| ralonsoh | labedz, SbGlobalUpdateEvent.run is already executed on a thread | 10:09 |
| ralonsoh | I don't like the idea of spawning another thread on it | 10:09 |
| ralonsoh | I understand the problem here: sb_global is updated and then 150 nodes try to, at the same time, update the "chassis" register | 10:10 |
| ralonsoh | but I'm trying to find a better solution (if that exists) | 10:10 |
| opendevreview | Dr. Jens Harbott proposed openstack/neutron-tempest-plugin master: DNM: Test custom cirros image https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/854910 | 10:15 |
| ralonsoh | labedz, what version of OVN are you using? do you have chassis_private table? | 10:17 |
| ralonsoh | that should reduce the impact on the DB update because the pubsub messages will be sent only to specific chassis | 10:17 |
| labedz | ralonsoh: 21.06 with chassis_private tables | 10:19 |
| labedz | ralonsoh: but still it hit SBDB | 10:19 |
| ralonsoh | and how many nodes do you have? how much time does it take to process those updates? | 10:19 |
| labedz | so first - this is Ussuri, so heartbeats without AgentCache (which I just backported) | 10:21 |
| labedz | which should help a lot | 10:21 |
| ralonsoh | right | 10:21 |
| labedz | ralonsoh: then 150+ hosts takes OVN SBDB about 20s to 'do' all metadata agents updates | 10:22 |
| labedz | with >80%CPU (one core of course) | 10:22 |
| ralonsoh | that seems too much for 150 messages to be processed | 10:23 |
| labedz | and propagated to all registered monitors? | 10:25 |
| labedz | I see a lot of OVNSB DB index updates flying around | 10:25 |
| labedz | additionaly neutron workers are also impacted (as they are also monitoring changes on SBDB) | 10:29 |
| labedz | but maybe you are right that enabling AgentCache will do the job - just it's blow on the cold :) | 10:29 |
| opendevreview | Merged openstack/neutron master: Bump minimum OVN version to v21.06.0 https://review.opendev.org/c/openstack/neutron/+/860078 | 10:33 |
| opendevreview | Merged openstack/neutron master: Since OVN 20.06, config is stored in "Chassis.other_config" https://review.opendev.org/c/openstack/neutron/+/859642 | 11:22 |
| opendevreview | Merged openstack/neutron master: Split Hash Ring probing from the maintenance task https://review.opendev.org/c/openstack/neutron/+/860233 | 11:23 |
| opendevreview | Merged openstack/neutron stable/ussuri: Simplify OVN Agent API implementation https://review.opendev.org/c/openstack/neutron/+/860246 | 12:00 |
| opendevreview | Lucas Alvares Gomes proposed openstack/neutron stable/zed: Split Hash Ring probing from the maintenance task https://review.opendev.org/c/openstack/neutron/+/860562 | 12:35 |
| opendevreview | Lucas Alvares Gomes proposed openstack/neutron stable/yoga: Split Hash Ring probing from the maintenance task https://review.opendev.org/c/openstack/neutron/+/860563 | 12:35 |
| opendevreview | Lucas Alvares Gomes proposed openstack/neutron stable/xena: Split Hash Ring probing from the maintenance task https://review.opendev.org/c/openstack/neutron/+/860564 | 12:35 |
| opendevreview | Lucas Alvares Gomes proposed openstack/neutron stable/wallaby: Split Hash Ring probing from the maintenance task https://review.opendev.org/c/openstack/neutron/+/860565 | 12:36 |
| opendevreview | Lucas Alvares Gomes proposed openstack/neutron stable/victoria: Split Hash Ring probing from the maintenance task https://review.opendev.org/c/openstack/neutron/+/860566 | 12:36 |
| opendevreview | Lucas Alvares Gomes proposed openstack/neutron stable/ussuri: Split Hash Ring probing from the maintenance task https://review.opendev.org/c/openstack/neutron/+/860567 | 12:36 |
| opendevreview | Lajos Katona proposed openstack/neutron master: Try to update port status to DOWN port not bound to host https://review.opendev.org/c/openstack/neutron/+/827728 | 12:37 |
| opendevreview | Lajos Katona proposed openstack/neutron master: CI: Add tick-tick grenade jobs to check queue https://review.opendev.org/c/openstack/neutron/+/860541 | 12:56 |
| opendevreview | Krzysztof Tomaszewski proposed openstack/neutron master: Spread OVN metadata agent heartbeat response in time https://review.opendev.org/c/openstack/neutron/+/860471 | 13:01 |
| *** dasm|off is now known as dasm | 13:31 | |
| sahid | quick question, when configuring devstack to run functional tests, should we set local.con in devstack? | 13:33 |
| sahid | also should we use sudo? | 13:34 |
| sahid | sudo FORCE=yes MYSQL_PASSWORD=password IS_GATE=False ./tools/configure_for_func_testing.sh ~/devstack -i | 13:34 |
| ykarel | sahid, local.conf not required to be created | 13:50 |
| ykarel | and AFAIR sudo is not required | 13:50 |
| ykarel | also i have set the variables as above when running those tests locally in past | 13:51 |
| ykarel | s/have set/have not set/ | 13:52 |
| sahid | ack ykarel let me make a new try using lts and fresh install following devstack guide but without launching the ./stack | 13:53 |
| sahid | things are very sensible :-) | 13:54 |
| ykarel | sahid, yes that should work, for me steps https://docs.openstack.org/neutron/latest/contributor/testing/testing.html#id3 worked | 13:56 |
| ykarel | but i have not used that from some time | 13:56 |
| ykarel | and seems tox -edsvm-functional may work with already deployed devstack setup and without running ./tools/configure_for_func_testing.sh ~/devstack | 13:58 |
| sahid | i tried them but i was not able to run sudo tests, they all get skipped | 13:58 |
| ykarel | with dsvm-functional or functional? with dsvm-functional those should run | 13:58 |
| ykarel | anyway try with fresh vm, and if u still see issues with those steps you can create launchpad bug so it can be fixed :) | 13:59 |
| *** iurygregory_ is now known as iurygregory | 14:04 | |
| opendevreview | Terry Wilson proposed openstack/ovsdbapp stable/zed: Fix logging exception while handling transaction exception https://review.opendev.org/c/openstack/ovsdbapp/+/860454 | 14:38 |
| opendevreview | Terry Wilson proposed openstack/ovsdbapp stable/yoga: Fix logging exception while handling transaction exception https://review.opendev.org/c/openstack/ovsdbapp/+/860455 | 14:46 |
| opendevreview | Terry Wilson proposed openstack/ovsdbapp stable/xena: Fix logging exception while handling transaction exception https://review.opendev.org/c/openstack/ovsdbapp/+/860456 | 14:46 |
| opendevreview | Terry Wilson proposed openstack/ovsdbapp stable/wallaby: Fix logging exception while handling transaction exception https://review.opendev.org/c/openstack/ovsdbapp/+/860457 | 14:46 |
| opendevreview | Terry Wilson proposed openstack/ovsdbapp stable/victoria: Fix logging exception while handling transaction exception https://review.opendev.org/c/openstack/ovsdbapp/+/860458 | 14:47 |
| opendevreview | Terry Wilson proposed openstack/ovsdbapp stable/ussuri: Fix logging exception while handling transaction exception https://review.opendev.org/c/openstack/ovsdbapp/+/860459 | 14:47 |
| opendevreview | Terry Wilson proposed openstack/ovsdbapp stable/train: Fix logging exception while handling transaction exception https://review.opendev.org/c/openstack/ovsdbapp/+/860460 | 14:47 |
| lajoskatona | frickler, ralonsoh: I see an sqlalchemy2.0 like issue also: https://a5b63e09f034db844580-ea5b6d57baa1d0c2bb40e5e53ebb92ee.ssl.cf1.rackcdn.com/860556/1/check/tempest-integrated-compute/81f472d/controller/logs/screen-q-svc.txt | 15:09 |
| lajoskatona | frickler, ralonsoh: just FYI, perhaps good to keep an eye on this one also.... | 15:09 |
| ralonsoh | lajoskatona, no, is the same error | 15:09 |
| ralonsoh | Oct 06 12:26:56.174044 ubuntu-focal-rax-iad-0031482724 neutron-server[87243]: ERROR neutron.api.v2.resource File "/usr/local/lib/python3.8/dist-packages/ovs/db/idl.py", line 1316, in __getattr__ | 15:09 |
| ralonsoh | Oct 06 12:26:56.174044 ubuntu-focal-rax-iad-0031482724 neutron-server[87243]: ERROR neutron.api.v2.resource column = self._table.columns[column_name] | 15:09 |
| ralonsoh | Oct 06 12:26:56.174044 ubuntu-focal-rax-iad-0031482724 neutron-server[87243]: ERROR neutron.api.v2.resource KeyError: 'other_config' | 15:09 |
| ralonsoh | Oct 06 12:26:56.174044 ubuntu-focal-rax-iad-0031482724 neutron-server[87243]: ERROR neutron.api.v2.resource | 15:09 |
| ralonsoh | the "other_config" patch | 15:09 |
| lajoskatona | ralonoh: ok, I see now the other-config line | 15:09 |
| frickler | lajoskatona: I though sqla at first, too, but too old OVN is the reason | 15:09 |
| lajoskatona | frickler, ralonsoh: thanks for quick reaction | 15:10 |
| opendevreview | Rodolfo Alonso proposed openstack/neutron master: Revert "Since OVN 20.06, config is stored in "Chassis.other_config"" https://review.opendev.org/c/openstack/neutron/+/860461 | 15:33 |
| ozzzo_work | We sometimes have an issue where a VM gets deleted but the port is still attached to it. To fix that we go into the GUI and clear "Device ID", "Device Owner", and "Binding: Host" and then click "Update" | 15:39 |
| ozzzo_work | Is there a way to do that from CLI? I tried things like: os port set --device "" <ID> but it doesn't seem to work | 15:40 |
| ralonsoh | ozzzo_work, if you delete a VM, there should not be any related binding | 15:41 |
| ralonsoh | please, check the Neutron server logs | 15:41 |
| ralonsoh | to see if there is any error | 15:41 |
| ralonsoh | (correction: there "must" be a "ml2_port_bindings" record, by the vif_details, host and status should be updated) | 15:42 |
| opendevreview | Rodolfo Alonso proposed openstack/neutron-tempest-plugin master: Add "devstack-tempest" job to "neutron-tempest-plugin-jobs" https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/860589 | 16:06 |
| opendevreview | Rodolfo Alonso proposed openstack/neutron master: [OVS][QoS] Add QoS support for Trunk service, OVS driver https://review.opendev.org/c/openstack/neutron/+/839523 | 16:15 |
| opendevreview | Merged openstack/neutron stable/ussuri: Add support for deleting ml2/ovn agents https://review.opendev.org/c/openstack/neutron/+/860247 | 16:39 |
| opendevreview | Merged openstack/ovn-octavia-provider master: [OVN] Pin OVS version for OVN master https://review.opendev.org/c/openstack/ovn-octavia-provider/+/858365 | 17:28 |
| *** dasm is now known as dasm|off | 18:22 | |
| opendevreview | Merged openstack/neutron master: Revert "Since OVN 20.06, config is stored in "Chassis.other_config"" https://review.opendev.org/c/openstack/neutron/+/860461 | 18:33 |
| opendevreview | Merged openstack/neutron master: Update grenade skip level jobs for new release https://review.opendev.org/c/openstack/neutron/+/859991 | 18:33 |
| opendevreview | Sahid Orentino Ferdjaoui proposed openstack/neutron master: dhcp: make device manager to clean only not used devices https://review.opendev.org/c/openstack/neutron/+/840419 | 18:35 |
| opendevreview | Sahid Orentino Ferdjaoui proposed openstack/neutron master: dhcp: add/use cleanup stale devices API https://review.opendev.org/c/openstack/neutron/+/840420 | 18:35 |
| opendevreview | Sahid Orentino Ferdjaoui proposed openstack/neutron master: dhcp: support multiple segmentations per network https://review.opendev.org/c/openstack/neutron/+/840421 | 18:35 |
| opendevreview | Sahid Orentino Ferdjaoui proposed openstack/neutron master: db: add segment_index to the unique constraint https://review.opendev.org/c/openstack/neutron/+/841459 | 18:35 |
| opendevreview | Sahid Orentino Ferdjaoui proposed openstack/neutron master: segment: enable multisegments support for host https://review.opendev.org/c/openstack/neutron/+/841838 | 18:35 |
| opendevreview | Elod Illes proposed openstack/networking-bagpipe stable/yoga: DNM: check stable/yoga https://review.opendev.org/c/openstack/networking-bagpipe/+/860400 | 19:45 |
| opendevreview | Elod Illes proposed openstack/networking-bagpipe stable/yoga: DNM: check stable/yoga https://review.opendev.org/c/openstack/networking-bagpipe/+/860400 | 19:53 |
| *** dasm|off is now known as dasm | 20:49 | |
| *** dasm is now known as dasm|off | 22:15 | |
| opendevreview | Merged openstack/neutron master: Fix misplaced comparison constant warnings https://review.opendev.org/c/openstack/neutron/+/860504 | 23:07 |
| opendevreview | Miguel Lavalle proposed openstack/networking-ovn stable/train: ovn-migration: Remove second tripleo-update call https://review.opendev.org/c/openstack/networking-ovn/+/860610 | 23:29 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!