| *** spatel has quit IRC | 00:04 | |
| openstackgerrit | Merged openstack/neutron-vpnaas master: Bump default tox env from py37 to py38 https://review.opendev.org/722847 | 00:10 |
|---|---|---|
| *** Nel1x has joined #openstack-neutron | 00:14 | |
| *** ociuhandu has joined #openstack-neutron | 00:26 | |
| *** ociuhandu has quit IRC | 00:36 | |
| *** ociuhandu has joined #openstack-neutron | 00:38 | |
| *** ociuhandu has quit IRC | 00:43 | |
| *** slaweq has joined #openstack-neutron | 01:01 | |
| *** slaweq has quit IRC | 01:05 | |
| *** gthiemon1e has quit IRC | 01:05 | |
| *** gthiemonge has joined #openstack-neutron | 01:06 | |
| *** slaweq has joined #openstack-neutron | 01:06 | |
| *** slaweq has quit IRC | 01:10 | |
| *** slaweq has joined #openstack-neutron | 01:16 | |
| *** slaweq has quit IRC | 01:21 | |
| *** gregwork has quit IRC | 01:33 | |
| *** spatel has joined #openstack-neutron | 01:50 | |
| *** spatel has quit IRC | 01:54 | |
| openstackgerrit | Merged openstack/neutron-vpnaas master: Add Python3 victoria unit tests https://review.opendev.org/722057 | 02:07 |
| *** gthiemonge has quit IRC | 02:09 | |
| *** gthiemonge has joined #openstack-neutron | 02:09 | |
| *** HenryG has joined #openstack-neutron | 02:16 | |
| *** ramishra has joined #openstack-neutron | 02:20 | |
| openstackgerrit | Merged openstack/neutron stable/train: Workaround in NetworkSegmentRange OVO until "project_id" migration https://review.opendev.org/722656 | 02:23 |
| *** spatel has joined #openstack-neutron | 02:23 | |
| *** sapd1_x has joined #openstack-neutron | 03:12 | |
| *** sapd1_x has quit IRC | 03:17 | |
| *** sapd1_x has joined #openstack-neutron | 03:31 | |
| *** yamamoto has joined #openstack-neutron | 03:35 | |
| *** yamamoto has quit IRC | 03:38 | |
| *** jangutter has quit IRC | 03:44 | |
| *** jangutter has joined #openstack-neutron | 03:45 | |
| *** ociuhandu has joined #openstack-neutron | 03:56 | |
| *** ociuhandu has quit IRC | 04:02 | |
| *** ygk_12345 has joined #openstack-neutron | 04:17 | |
| *** ygk_12345 has left #openstack-neutron | 04:17 | |
| openstackgerrit | manjunathpayala proposed openstack/networking-odl master: BGPVPN missing networks in ODL https://review.opendev.org/709989 | 04:26 |
| *** ratailor has joined #openstack-neutron | 04:31 | |
| *** sapd1_x has quit IRC | 04:40 | |
| *** gcheresh has joined #openstack-neutron | 04:51 | |
| *** sapd1_x has joined #openstack-neutron | 04:54 | |
| *** jmlowe has quit IRC | 05:00 | |
| *** spatel has quit IRC | 05:01 | |
| *** jmlowe has joined #openstack-neutron | 05:03 | |
| *** ociuhandu has joined #openstack-neutron | 05:23 | |
| *** ociuhandu has quit IRC | 05:33 | |
| *** Nel1x has quit IRC | 05:37 | |
| *** tmorin has joined #openstack-neutron | 06:04 | |
| *** waleedm has joined #openstack-neutron | 06:11 | |
| *** slaweq has joined #openstack-neutron | 06:12 | |
| *** ratailor has quit IRC | 06:19 | |
| *** ratailor has joined #openstack-neutron | 06:19 | |
| *** rpittau|afk is now known as rpittau | 06:33 | |
| *** jlibosva has joined #openstack-neutron | 06:33 | |
| *** ociuhandu has joined #openstack-neutron | 06:38 | |
| *** ircuser-1 has quit IRC | 06:42 | |
| *** waleedm_ has joined #openstack-neutron | 06:47 | |
| *** waleedm_ has quit IRC | 06:48 | |
| *** waleedm__ has joined #openstack-neutron | 06:48 | |
| *** waleedm has quit IRC | 06:50 | |
| *** waleedm_ has joined #openstack-neutron | 06:52 | |
| *** waleedm__ has quit IRC | 06:57 | |
| *** waleedm__ has joined #openstack-neutron | 06:57 | |
| *** waleedm_ has quit IRC | 07:00 | |
| *** waleedm__ has quit IRC | 07:03 | |
| *** ccamposr has joined #openstack-neutron | 07:06 | |
| *** ccamposr__ has joined #openstack-neutron | 07:08 | |
| *** ccamposr has quit IRC | 07:11 | |
| *** sapd1_x has quit IRC | 07:18 | |
| *** gcheresh has quit IRC | 07:30 | |
| *** sapd1_x has joined #openstack-neutron | 07:30 | |
| *** jakeyip has joined #openstack-neutron | 07:36 | |
| jakeyip | Hi all. I'm trying to use neutron-ovn-db-sync-util to sync our neutron db into OVN, but I'm running into issues as our DB is quite big. I wonder if anybody has done something like this before? | 07:36 |
| slaweq | dalvarez: jlibosva: hi, maybe You can help with ^^ :) | 07:37 |
| jlibosva | slaweq: hi | 07:37 |
| jlibosva | jakeyip: do you have any traces? is it ovsdb commands timing out? | 07:38 |
| dalvarez | jakeyip: did you report a bug in launchpad recently? rings a bell | 07:40 |
| dalvarez | jakeyip: jlibosva https://bugs.launchpad.net/networking-ovn/+bug/1871272 | 07:40 |
| openstack | Launchpad bug 1871272 in networking-ovn "Failure running neutron-ovn-db-sync-util" [Undecided,New] | 07:40 |
| jakeyip | yes that's the bug | 07:41 |
| dalvarez | jakeyip: jlibosva i saw your message in launchpad but you wrote 'ignore my last message' so I'm curious if it's all the time around the DHCP options sync area | 07:41 |
| jlibosva | the duplicated SG is also a known issue I think | 07:42 |
| dalvarez | also jakeyip there should be no threads involved iirc so everything is pretty linear | 07:42 |
| jakeyip | Well, we've hacked around the code a bit. One observation is that generally it runs slower and slower with more and more records until it is committing one transaction every few minutes | 07:43 |
| dalvarez | jakeyip: jlibosva it would be great to have full logs of the tool if you're ok with sharing | 07:45 |
| *** gcheresh has joined #openstack-neutron | 07:45 | |
| dalvarez | jakeyip: if so, we can try to determine where the bottleneck is | 07:45 |
| jakeyip | dalvarez: I can revert all our changes and start off with clean upstream code and we start from there? | 07:45 |
| dalvarez | jakeyip: that'd be awesome, log in DEBUG mode and attach logs to the LP bug | 07:46 |
| dalvarez | jakeyip: we need to detemrine which is the bottleneck of these calls: https://github.com/openstack/networking-ovn/blob/stable/train/networking_ovn/ovn_db_sync.py#L90 | 07:47 |
| dalvarez | jakeyip: also it'd help if you run it first in LOG mode to see if the issue is actually the writes | 07:47 |
| dalvarez | but we can build up from your first run and see | 07:48 |
| *** jpena|off is now known as jpena | 07:49 | |
| jakeyip | LOG mode works. It's the writes. | 07:50 |
| *** ociuhandu has quit IRC | 07:51 | |
| dalvarez | jakeyip: cool, i imagined the routers/router ports part was the most expensive as the txn could have zillions of commands | 07:51 |
| dalvarez | jakeyip: also to get a rough estimate... how many number of ports are we talking about? | 07:52 |
| dalvarez | maybe ovsdbapp cannot handle things like: https://github.com/openstack/networking-ovn/blob/stable/train/networking_ovn/ovn_db_sync.py#L1141 | 07:53 |
| dalvarez | where 2K ports are added... we may need to break things down a bit where needed | 07:53 |
| dalvarez | jakeyip: some numbers would help: #of ports, lrps, routers, networks, acls, port groups | 07:53 |
| dalvarez | you can pull those from the log mode | 07:53 |
| jakeyip | cool. I've sent up a (truncated) log. let me know if that is useful? | 07:55 |
| *** ociuhandu has joined #openstack-neutron | 08:00 | |
| jakeyip | the sync doesn't seem to progress. It is currently at ` Running txn n=83 command(idx=37750)` and size of the northbound db on disk doesn't grow | 08:00 |
| openstackgerrit | Bernard Cafarelli proposed openstack/networking-ovn stable/train: Remove testing OVS/OVN master branch in Train https://review.opendev.org/696581 | 08:03 |
| jakeyip | dalvarez: we have code that breaks down the transaction into chunks. if you are interested I can send it up for comments. | 08:03 |
| jlibosva | bcafarel: thank you sir :) | 08:04 |
| bcafarel | :) | 08:04 |
| bcafarel | jlibosva: np I was checking the open stable backports and the merge conflict looked easy to fix! | 08:04 |
| jlibosva | bcafarel: believe it or not but I was looking at it this morning too :) | 08:05 |
| jlibosva | that's why I recognized the summary here in the chat | 08:05 |
| openstackgerrit | manjunathpayala proposed openstack/networking-odl master: BGPVPN missing networks in ODL https://review.opendev.org/709989 | 08:15 |
| *** stingrayza has quit IRC | 08:15 | |
| *** stingrayza has joined #openstack-neutron | 08:18 | |
| *** sapd1_x has quit IRC | 08:20 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/networking-midonet master: Imported Translations from Zanata https://review.opendev.org/700311 | 08:26 |
| dalvarez | jakeyip: wow command(idx=37750) ! jakeyip can you see the txn being sent to NB ovsdb-server ? in other words, is ovsdb-server not replying back or ovsdbapp not even sending the commands to the server | 08:27 |
| dalvarez | jakeyip: so this doesnt finish in your log: 2020-05-04 17:22:20.223 5935 DEBUG networking_ovn.ovn_db_sync [req-c2feb096-df73-44de-874e-e00caea3a7b5 - - - - -] Port-Group-SYNC: transaction started @ 2020-05-04 17:22:20.223388 sync_port_groups | 08:29 |
| dalvarez | is that right? | 08:29 |
| dalvarez | jakeyip: apparently the server is returning "OVSDB transaction returned TRY_AGAIN" | 08:30 |
| dalvarez | jakeyip: i left a comment | 08:31 |
| openstackgerrit | Merged openstack/neutron stable/stein: Fix queries to retrieve allocations with network_segment_range https://review.opendev.org/721679 | 08:32 |
| *** stingrayza has quit IRC | 08:32 | |
| *** sapd1_x has joined #openstack-neutron | 08:34 | |
| openstackgerrit | Dirk Mueller proposed openstack/neutron stable/pike: Revert iptables TCP checksum-fill code https://review.opendev.org/719909 | 08:35 |
| *** dtantsur|afk is now known as dtantsur | 08:43 | |
| *** stingrayza has joined #openstack-neutron | 08:49 | |
| jakeyip | dalvarez: thanks for your help! really appreciated it. I've replied to you. | 08:52 |
| *** salmankhan has joined #openstack-neutron | 09:00 | |
| *** stingrayza has quit IRC | 09:03 | |
| *** salmankhan1 has joined #openstack-neutron | 09:04 | |
| *** salmankhan has quit IRC | 09:05 | |
| *** salmankhan1 is now known as salmankhan | 09:05 | |
| *** stingrayza has joined #openstack-neutron | 09:07 | |
| *** waleedm has joined #openstack-neutron | 09:15 | |
| *** abdysn has joined #openstack-neutron | 09:15 | |
| dalvarez | jakeyip: always fails around '2020-04-06 23:33:38.954 3072 ERROR neutron_ovn_db_sync_util for row in self._tables['DHCP_Options']' ? | 09:18 |
| dalvarez | around DHCP_Options? kinda coming down to my first question in the bug :p | 09:18 |
| *** lpetrut has joined #openstack-neutron | 09:25 | |
| *** stingrayza has quit IRC | 09:29 | |
| jakeyip | dalvarez: no, that part is in `sync_networks_ports_and_dhcp_opts()`. without our patch it doesn't get to that point | 09:30 |
| *** jangutter has quit IRC | 09:32 | |
| openstackgerrit | Flavio Fernandes proposed openstack/neutron master: port_forwarding: extend support for OVN usage https://review.opendev.org/724445 | 09:41 |
| dalvarez | jakeyip: your patch == chunks for txns? and with your patch you hit the self._tables['DHCP_Options']' dictr change error?? | 09:43 |
| openstackgerrit | Arie Bregman proposed openstack/networking-ovn stable/train: Added OSP 16.1 to plugin spec https://review.opendev.org/725222 | 09:47 |
| jakeyip | es our patch is chunks for txn. We haven't hit that for a while after our patch | 09:48 |
| dalvarez | jakeyip: i think im a bit lost sorry :) when you say "we haven't hit that" what do you mean by 'that'; the dhcp_options dup dict? jakeyip im trying to understand where the problem is, without your patch probelm seems to be ovsdb_server and RETRY? | 09:49 |
| dalvarez | jakeyip: and with your patch what's the problem? dup dicts, and randomly on different tables? any patterns? | 09:50 |
| jakeyip | dalvarez: sorry it's confusing because there are multiple errors | 09:50 |
| jakeyip | 1) without any patches, OVSDB will return TRY_AGAIN over and over, it never completes | 09:50 |
| *** yamamoto has joined #openstack-neutron | 09:50 | |
| *** ociuhandu has quit IRC | 09:51 | |
| jakeyip | 2) with out patches, there are duplicate keys randomly. most commonly in ACLs. running the sync over and over again will result in different key erroring | 09:51 |
| *** ociuhandu has joined #openstack-neutron | 09:52 | |
| jakeyip | s/2) with out/2) with our/ | 09:52 |
| *** waleedm has quit IRC | 09:52 | |
| *** ociuhandu has quit IRC | 09:57 | |
| jakeyip | I haven't post logs of those errors because it might make things more confusing. | 09:57 |
| *** yamamoto has quit IRC | 09:58 | |
| dalvarez | jakeyip: ack got it, can you add your patch for reference as well?seems that it's needed | 09:58 |
| *** ociuhandu has joined #openstack-neutron | 10:00 | |
| jakeyip | Sure. might take a while because we are working on stein and now networking-ovn is in neutron :) | 10:01 |
| *** stingrayza has joined #openstack-neutron | 10:01 | |
| *** ralonsoh has joined #openstack-neutron | 10:03 | |
| *** gcheresh has quit IRC | 10:04 | |
| dalvarez | jakeyip: seems like they dict key is the main cause due to so many things happening at the same time so the in-memory copy of the db hits some race condition | 10:05 |
| dalvarez | otherwiseguy: ^ interesting issue | 10:05 |
| dalvarez | huh | 10:05 |
| dalvarez | jakeyip: you're using raft, can you verify if this thing happens without raft? | 10:06 |
| jakeyip | without clustered db? | 10:06 |
| dalvarez | jakeyip: right, active/passive or just one instance... it's kinda weird that you see reconnections right when the issue happens right? | 10:07 |
| dalvarez | May 04 18:38:36 jake-ovn-train ovsdb-server[4573]: ovs|01959|reconnect|DBG|tcp:127.0.0.1:51024: connecting... | 10:07 |
| dalvarez | ERR|tcp:127.0.0.1:51036: no response to inactivity probe after 5 seconds, disconnecting | 10:07 |
| dalvarez | jakeyip: i'd also suggest bumping the probe intervals | 10:07 |
| *** armax has joined #openstack-neutron | 10:09 | |
| jakeyip | I started off with a single non-clustered db, I moved on to clustered and v2.12 in hope that the optimisations can help. e.g. https://www.slideshare.net/hanzhou1978/large-scale-overlay-networks-with-ovn-problems-and-solutions slide 17 | 10:12 |
| *** rpittau is now known as rpittau|bbl | 10:14 | |
| dalvarez | jakeyip: yeah, also i noticed some bugs around the raft clustering on very busy systems that i can't really help with... if you observed the same thing on a non clustered db, perhaps we can ignore this for now | 10:16 |
| dalvarez | jakeyip: i suggested to bump the remote probe intervals in the LP and retry ... reconnections are costly in large dbs but IIRC RAFT makes them easier by sending things that actually changed since the disconnection | 10:17 |
| dalvarez | but as i said, not very familiar with this part | 10:17 |
| dalvarez | jakeyip: seems to me that reconnections can be noisy so bumping the interval could help determine the root cause, i think that anybways we need to make it more resilient | 10:17 |
| jakeyip | do you know where this probe interval setting is? I'm having trouble finding it | 10:18 |
| jakeyip | dalvarez: is that a ovsdb setting or neutron setting? | 10:19 |
| *** abhishek has joined #openstack-neutron | 10:29 | |
| *** abhishek has quit IRC | 10:44 | |
| openstackgerrit | Merged openstack/neutron-fwaas-dashboard master: Imported Translations from Zanata https://review.opendev.org/723835 | 10:46 |
| *** gcheresh has joined #openstack-neutron | 10:53 | |
| dalvarez | jakeyip: ovsdb -> https://bugs.launchpad.net/tripleo/+bug/1836604 | 10:54 |
| openstack | Launchpad bug 1836604 in tripleo "OVN: bump the ovn-remote-probe-interval for ovn-controller" [Undecided,Fix released] - Assigned to Kamil Sambor (ksambor) | 10:54 |
| *** njohnston has joined #openstack-neutron | 11:01 | |
| openstackgerrit | Jakub Libosvar proposed openstack/networking-ovn stable/train: [ovn] Add PortBinding delete event for external ports https://review.opendev.org/725231 | 11:11 |
| openstackgerrit | Merged openstack/neutron master: Fix dhcpv6-statefull typo https://review.opendev.org/724861 | 11:11 |
| *** slaweq_ has joined #openstack-neutron | 11:18 | |
| *** slaweq has quit IRC | 11:21 | |
| *** ociuhandu has quit IRC | 11:29 | |
| *** ociuhandu has joined #openstack-neutron | 11:30 | |
| *** jpena is now known as jpena|lunch | 11:30 | |
| jakeyip | dalvarez: hm, I saw that, but it seems like that's for ovn-controller? the sync script has it's own client I think. | 11:33 |
| *** ociuhandu has quit IRC | 11:35 | |
| *** yamamoto has joined #openstack-neutron | 11:37 | |
| *** yamamoto has quit IRC | 11:37 | |
| *** nweinber has joined #openstack-neutron | 11:45 | |
| dalvarez | jakeyip: right, i think that the sync script doesnt even have the probe interval or it has it set to 5s? we changed that at some point iirc | 11:59 |
| dalvarez | we need otherwiseguy ^ | 11:59 |
| openstackgerrit | Slawek Kaplonski proposed openstack/neutron master: Change format of the dnsmasq's host file https://review.opendev.org/725246 | 12:03 |
| *** abdysn has quit IRC | 12:04 | |
| *** dmellado has quit IRC | 12:10 | |
| *** ociuhandu has joined #openstack-neutron | 12:11 | |
| *** sapd1_x has quit IRC | 12:16 | |
| *** dmellado has joined #openstack-neutron | 12:16 | |
| *** ociuhandu has quit IRC | 12:17 | |
| openstackgerrit | Merged openstack/neutron-fwaas-dashboard master: Cleanup py27 support https://review.opendev.org/720792 | 12:21 |
| *** rpittau|bbl is now known as rpittau | 12:22 | |
| *** ociuhandu has joined #openstack-neutron | 12:30 | |
| *** jpena|lunch is now known as jpena | 12:31 | |
| openstackgerrit | Andreas Jaeger proposed openstack/networking-bgpvpn master: Add Python3 victoria unit tests https://review.opendev.org/722040 | 12:52 |
| openstackgerrit | Andreas Jaeger proposed openstack/networking-bgpvpn master: Cleanup py27 support https://review.opendev.org/720794 | 12:53 |
| *** spatel has joined #openstack-neutron | 12:53 | |
| *** jamesden_ is now known as jamesdenton | 13:07 | |
| openstackgerrit | Thomas Morin proposed openstack/networking-bgpvpn master: test-requirements: upgrade min version of networking-bagpipe https://review.opendev.org/725263 | 13:09 |
| *** yamamoto has joined #openstack-neutron | 13:11 | |
| *** yamamoto has quit IRC | 13:16 | |
| *** ociuhandu has quit IRC | 13:20 | |
| *** ociuhandu has joined #openstack-neutron | 13:21 | |
| *** tbachman has joined #openstack-neutron | 13:21 | |
| *** ociuhandu has quit IRC | 13:25 | |
| *** KeithMnemonic has joined #openstack-neutron | 13:31 | |
| *** ociuhandu has joined #openstack-neutron | 13:36 | |
| *** ralonsoh has quit IRC | 13:37 | |
| *** salmankhan1 has joined #openstack-neutron | 13:39 | |
| *** salmankhan has quit IRC | 13:40 | |
| *** salmankhan1 is now known as salmankhan | 13:40 | |
| openstackgerrit | Flavio Fernandes proposed openstack/neutron master: port_forwarding: extend support for OVN usage https://review.opendev.org/724445 | 13:42 |
| *** lpetrut has quit IRC | 13:49 | |
| *** ralonsoh has joined #openstack-neutron | 13:49 | |
| *** ratailor has quit IRC | 13:53 | |
| openstackgerrit | Rodolfo Alonso Hernandez proposed openstack/neutron stable/train: Use dict .get() to avoid a KeyError in the segment plugin https://review.opendev.org/725278 | 13:59 |
| openstackgerrit | Rodolfo Alonso Hernandez proposed openstack/neutron stable/stein: Default (shared) network segment range is not mandatory https://review.opendev.org/721686 | 14:02 |
| openstackgerrit | Rodolfo Alonso Hernandez proposed openstack/neutron master: Open Victoria DB branch https://review.opendev.org/721207 | 14:03 |
| otherwiseguy | dalvarez: jakeyip: to my knowledge, the only way to get TRY_AGAIN is if we are running a Command that calls verify() which basically means "let me know if a row I'm modifying has been modified already from the values it has that I have cached". In this case, it returns TRY_AGAIN so we can re-run the command. So unless there are multiple connections modifying the db at the same time, it should be impossible to get | 14:07 |
| otherwiseguy | TRY_AGAIN. | 14:07 |
| openstackgerrit | Rodolfo Alonso Hernandez proposed openstack/ovsdbapp master: Add "inactivity_probe" parameter to "enable_connection_uri" https://review.opendev.org/720785 | 14:08 |
| otherwiseguy | I haven't tried to see what happens if you call a command with verify() and in the same transaction do multiple modifications of the same row, though. | 14:08 |
| zigo | What's the correct procedure for upgrading OpenVSwitch in a compute ? | 14:09 |
| zigo | Even after restarting OVS and ovs-agent, I still don't get connectivity to my VM... :/ | 14:09 |
| otherwiseguy | dalvarez: jakeyip: (I should clarify that it isn't just that verify() the row changed, but that a specific column in the row has changed) | 14:10 |
| dalvarez | otherwiseguy: worth noting that jakeyip is using raft | 14:17 |
| dalvarez | not sure if that plays a role | 14:17 |
| otherwiseguy | dalvarez: shouldn't | 14:17 |
| dalvarez | right | 14:17 |
| otherwiseguy | dalvarez: doesn't meant that it *doesn't* though :D | 14:17 |
| dalvarez | yeah :D that's why i mentioned it to you | 14:17 |
| dalvarez | :p | 14:17 |
| otherwiseguy | But yeah, biggest issue is probably just "really long transaction and timeout" | 14:18 |
| otherwiseguy | dalvarez: might also be that finishing up the indexed lookups patch makes this issue go away since big db with lots of operations/commands doing O(n) lookups | 14:39 |
| dalvarez | otherwiseguy: that'd help for sure, im not sure what bottleneck are we hiting... i wouldnt expect multiple writers so i dont know where this 'dict' altered thing can occur | 14:46 |
| otherwiseguy | dalvarez: I'll try to create a quick test of calling verify() and modifying a row's column twice in the same transaction. | 14:47 |
| *** mlavalle has joined #openstack-neutron | 14:48 | |
| openstackgerrit | Andreas Jaeger proposed openstack/networking-bgpvpn master: DNM: Debug jobs https://review.opendev.org/725293 | 14:54 |
| dalvarez | otherwiseguy: not sure if there's an easy way for jakeyip to share the neutron db and we can explore :? that'll help i believe | 14:54 |
| otherwiseguy | dalvarez: it should also be noted, that TRY_AGAIN doesn't actually *matter*, it is perfectly valid response and we should handle it normally by just running the command again. | 15:04 |
| otherwiseguy | dalvarez: jakeyip: doing a quick test calling db_set() twice on Logical_Switch.external_ids in the same transaction works fine, so I wouldn't expect a TRY_AGAIN w/o multiple connections going. ovn_db_sync doesn't do something silly like run multiple workers if they are defined for the driver... | 15:11 |
| otherwiseguy | even if it did, was thinking it held an ovsdb lock | 15:12 |
| otherwiseguy | ok, can verify it doesn't. that would have been weird. :p | 15:17 |
| openstackgerrit | Michał Dulko proposed openstack/neutron stable/ussuri: Add Octavia file in devstack/lib https://review.opendev.org/725302 | 15:20 |
| otherwiseguy | dalvarez: jakeyip: i did notice several connections to port 6641 when running ovn-db-sync, had an old checkout of neutron though from I think before we did some work to get rid of l3 connection. re-stacking to see what it looks like on master. | 15:26 |
| otherwiseguy | but if there are some commands running against l3 connection and others running against driver connection that modify same columns maybe they could step on each other occasionally? still seems unlikely since we call commit_block() so block waiting for a response from the server. and I don't think we register events, so shouldn't have that thread to worry about. | 15:34 |
| *** ociuhandu has quit IRC | 15:38 | |
| *** ociuhandu has joined #openstack-neutron | 15:39 | |
| *** ociuhandu has quit IRC | 15:44 | |
| openstackgerrit | Merged openstack/neutron master: Add py38 package metadata https://review.opendev.org/724989 | 15:57 |
| otherwiseguy | dalvarez: I did just run into a bug introduced by getting rid of the l3 connection--db_sync_util assumes that when looking up the connection with mechanism_manager that it will be under 'ovn', but for sync util it is 'ovn-sync'. | 16:00 |
| *** ociuhandu has joined #openstack-neutron | 16:04 | |
| *** rpittau is now known as rpittau|afk | 16:08 | |
| *** ociuhandu has quit IRC | 16:09 | |
| openstackgerrit | Terry Wilson proposed openstack/neutron master: Fix ovn-db-sync-util after removing l3 ovsdb connection https://review.opendev.org/725309 | 16:10 |
| *** ircuser-1 has joined #openstack-neutron | 16:19 | |
| openstackgerrit | Andreas Jaeger proposed openstack/networking-midonet master: Add Python3 victoria unit tests https://review.opendev.org/723725 | 16:20 |
| openstackgerrit | manjunathpayala proposed openstack/networking-odl master: BGPVPN missing networks in ODL https://review.opendev.org/709989 | 16:20 |
| *** gcheresh has quit IRC | 16:22 | |
| openstackgerrit | Merged openstack/neutron-vpnaas stable/ussuri: Fix unsubscriptable-object error https://review.opendev.org/725145 | 16:22 |
| *** ociuhandu has joined #openstack-neutron | 16:27 | |
| openstackgerrit | Flavio Fernandes proposed openstack/neutron master: port_forwarding: extend support for OVN usage https://review.opendev.org/724445 | 16:27 |
| *** ociuhandu has quit IRC | 16:38 | |
| *** ociuhandu has joined #openstack-neutron | 16:38 | |
| openstackgerrit | Flavio Fernandes proposed openstack/neutron master: WIP (DNM): ovn port forwarding rfe https://review.opendev.org/723863 | 16:42 |
| *** ociuhandu has quit IRC | 16:50 | |
| *** dtantsur is now known as dtantsur|afk | 16:57 | |
| *** jpena is now known as jpena|off | 17:04 | |
| *** ralonsoh has quit IRC | 17:07 | |
| *** salmankhan has quit IRC | 17:21 | |
| *** CeeMac has joined #openstack-neutron | 17:21 | |
| *** hoonetorg has quit IRC | 17:23 | |
| *** ociuhandu has joined #openstack-neutron | 17:25 | |
| *** jlibosva has quit IRC | 17:28 | |
| *** ociuhandu has quit IRC | 17:33 | |
| openstackgerrit | Roman Safronov proposed openstack/neutron master: Add OSP16.1 choice to migration plugin spec https://review.opendev.org/725351 | 17:34 |
| *** maciejjozefczyk has joined #openstack-neutron | 17:45 | |
| *** maciejjozefczyk has quit IRC | 17:53 | |
| *** maciejjozefczyk has joined #openstack-neutron | 17:57 | |
| *** jlibosva has joined #openstack-neutron | 17:59 | |
| *** jlibosva has quit IRC | 18:03 | |
| openstackgerrit | Merged openstack/neutron master: Remove unused method "_make_fixed_ip_dict" https://review.opendev.org/724804 | 18:06 |
| openstackgerrit | Corey Bryant proposed openstack/networking-bagpipe master: Monkey patch original current_thread _active https://review.opendev.org/725361 | 18:19 |
| *** Jeffrey4l has quit IRC | 18:23 | |
| *** ociuhandu has joined #openstack-neutron | 18:23 | |
| *** Jeffrey4l has joined #openstack-neutron | 18:31 | |
| openstackgerrit | Corey Bryant proposed openstack/networking-sfc master: Monkey patch original current_thread _active https://review.opendev.org/725367 | 18:32 |
| *** Jeffrey4l has quit IRC | 18:36 | |
| *** Jeffrey4l has joined #openstack-neutron | 18:43 | |
| *** maciejjozefczyk has quit IRC | 18:45 | |
| openstackgerrit | Harald Jensås proposed openstack/neutron master: Use dhcp-host tag support when supported https://review.opendev.org/725369 | 18:56 |
| *** ociuhandu has quit IRC | 18:58 | |
| *** jlibosva has joined #openstack-neutron | 18:59 | |
| *** hoonetorg has joined #openstack-neutron | 19:00 | |
| *** jlibosva has quit IRC | 19:03 | |
| *** munimeha1 has joined #openstack-neutron | 19:16 | |
| *** ociuhandu has joined #openstack-neutron | 19:34 | |
| dalvarez | otherwiseguy: ops good catch! | 19:39 |
| dalvarez | tthe mechanism manager | 19:39 |
| openstackgerrit | Harald Jensås proposed openstack/neutron master: Use dhcp-host tag support when supported https://review.opendev.org/725369 | 19:44 |
| *** gcheresh has joined #openstack-neutron | 19:46 | |
| *** lseki has joined #openstack-neutron | 19:51 | |
| *** tmorin has quit IRC | 20:08 | |
| openstackgerrit | Brian Haley proposed openstack/ovn-octavia-provider master: Re-home OvnProviderHelper class https://review.opendev.org/724427 | 20:08 |
| *** nweinber has quit IRC | 20:14 | |
| *** threestrands has joined #openstack-neutron | 20:34 | |
| openstackgerrit | Harald Jensås proposed openstack/neutron master: Use dhcp-host tag support when supported https://review.opendev.org/725369 | 20:37 |
| openstackgerrit | Corey Bryant proposed openstack/networking-sfc master: Monkey patch original current_thread _active https://review.opendev.org/725367 | 20:38 |
| openstackgerrit | Corey Bryant proposed openstack/networking-bagpipe master: Monkey patch original current_thread _active https://review.opendev.org/725361 | 20:39 |
| openstackgerrit | Brian Haley proposed openstack/ovn-octavia-provider master: Re-home unit tests https://review.opendev.org/724428 | 20:40 |
| openstackgerrit | Flavio Fernandes proposed openstack/neutron master: port_forwarding: extend support for OVN usage https://review.opendev.org/724445 | 20:45 |
| openstackgerrit | Flavio Fernandes proposed openstack/neutron master: WIP (DNM): ovn port forwarding rfe https://review.opendev.org/723863 | 20:53 |
| *** ociuhandu has quit IRC | 20:57 | |
| *** jlibosva has joined #openstack-neutron | 21:00 | |
| *** jlibosva has quit IRC | 21:06 | |
| *** slaweq_ has quit IRC | 21:08 | |
| *** ociuhandu has joined #openstack-neutron | 21:10 | |
| openstackgerrit | Nate Johnston proposed openstack/neutron-tempest-plugin master: [WIP] Add cleanups for trunks https://review.opendev.org/724934 | 21:11 |
| *** slaweq_ has joined #openstack-neutron | 21:14 | |
| *** gcheresh has quit IRC | 21:15 | |
| *** slaweq_ has quit IRC | 21:19 | |
| openstackgerrit | Nate Johnston proposed openstack/neutron-tempest-plugin master: [WIP] Add cleanups for trunks https://review.opendev.org/724934 | 21:19 |
| openstackgerrit | Brian Haley proposed openstack/ovn-octavia-provider master: Re-home ovsdb event classes https://review.opendev.org/725398 | 21:19 |
| *** ociuhandu has quit IRC | 21:22 | |
| *** ociuhandu has joined #openstack-neutron | 21:23 | |
| *** ociuhandu has quit IRC | 21:27 | |
| openstackgerrit | Corey Bryant proposed openstack/neutron-dynamic-routing master: Monkey patch original current_thread _active https://review.opendev.org/725403 | 21:31 |
| openstackgerrit | Brian Haley proposed openstack/ovn-octavia-provider master: Re-home unit tests https://review.opendev.org/724428 | 21:32 |
| openstackgerrit | Brian Haley proposed openstack/ovn-octavia-provider master: Re-home ovsdb event classes https://review.opendev.org/725398 | 21:34 |
| openstackgerrit | Merged openstack/neutron master: Migrate neutron grenade jobs to be native Zuul v3 https://review.opendev.org/725073 | 21:47 |
| openstackgerrit | Brian Haley proposed openstack/ovn-octavia-provider master: WIP: Include functional tests in coverage results https://review.opendev.org/713996 | 21:53 |
| openstackgerrit | Brian Haley proposed openstack/ovn-octavia-provider master: Re-home ovsdb event classes https://review.opendev.org/725398 | 22:06 |
| openstackgerrit | Nate Johnston proposed openstack/neutron master: [WIP] Try timing port actions https://review.opendev.org/724787 | 22:11 |
| *** rcernin has joined #openstack-neutron | 22:22 | |
| *** spatel has quit IRC | 22:49 | |
| *** jlibosva has joined #openstack-neutron | 23:03 | |
| *** jlibosva has quit IRC | 23:08 | |
| *** ccamposr has joined #openstack-neutron | 23:17 | |
| *** ccamposr__ has quit IRC | 23:20 | |
| *** mlavalle has quit IRC | 23:25 | |
| *** munimeha1 has quit IRC | 23:26 | |
| openstackgerrit | Merged openstack/neutron-vpnaas stable/ussuri: Update .gitreview for stable/ussuri https://review.opendev.org/722054 | 23:33 |
| *** dconde has joined #openstack-neutron | 23:36 | |
| *** dconde has quit IRC | 23:38 | |
| *** dconde has joined #openstack-neutron | 23:40 | |
| openstackgerrit | Merged openstack/neutron-vpnaas stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri https://review.opendev.org/722055 | 23:43 |
| *** dconde has quit IRC | 23:45 | |
| *** dconde_ has joined #openstack-neutron | 23:49 | |
| *** dconde_ has quit IRC | 23:49 | |
| *** dconde has joined #openstack-neutron | 23:50 | |
| *** sorrison has joined #openstack-neutron | 23:53 | |
| *** dconde has quit IRC | 23:54 | |
| *** dconde has joined #openstack-neutron | 23:54 | |
| *** dconde has quit IRC | 23:55 | |
| *** dconde has joined #openstack-neutron | 23:55 | |
| *** dconde has quit IRC | 23:55 | |
| *** dconde has joined #openstack-neutron | 23:57 | |
| *** dconde has quit IRC | 23:58 | |
| *** dconde has joined #openstack-neutron | 23:59 | |
| *** dconde has quit IRC | 23:59 | |
| *** dconde has joined #openstack-neutron | 23:59 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!