*** JamesBenson has quit IRC | 00:08 | |
*** JamesBenson has joined #openvswitch | 00:09 | |
*** grive has quit IRC | 00:20 | |
*** grive has joined #openvswitch | 00:20 | |
*** thaller_ has quit IRC | 00:32 | |
*** thaller__ has joined #openvswitch | 00:32 | |
*** acidfu has quit IRC | 01:12 | |
*** acidfu has joined #openvswitch | 01:28 | |
*** acidfu has quit IRC | 01:34 | |
*** JamesBenson has quit IRC | 01:35 | |
*** grive has quit IRC | 02:13 | |
*** grive has joined #openvswitch | 02:13 | |
*** armax has quit IRC | 02:17 | |
*** acidfu has joined #openvswitch | 02:34 | |
*** JamesBenson has joined #openvswitch | 03:05 | |
*** JamesBen_ has joined #openvswitch | 03:09 | |
*** JamesBenson has quit IRC | 03:10 | |
*** dcbw has quit IRC | 03:25 | |
*** zhouhan_ has quit IRC | 03:49 | |
*** zhouhan has joined #openvswitch | 03:50 | |
*** zhouhan_ has joined #openvswitch | 03:52 | |
*** zhouhan has quit IRC | 03:55 | |
*** zhouhan has joined #openvswitch | 03:56 | |
*** zhouhan_ has quit IRC | 03:58 | |
*** JamesBen_ has quit IRC | 04:39 | |
*** anilvenkata has joined #openvswitch | 04:39 | |
*** osmanlicilegi has quit IRC | 04:40 | |
*** osmanlicilegi has joined #openvswitch | 04:40 | |
*** osmanlicilegi has quit IRC | 04:40 | |
*** osmanlicilegi has joined #openvswitch | 04:41 | |
*** anilvenkata_ has joined #openvswitch | 04:42 | |
*** anilvenkata has quit IRC | 04:44 | |
*** acidfu has quit IRC | 04:51 | |
*** acidfu has joined #openvswitch | 04:52 | |
*** JamesBenson has joined #openvswitch | 05:00 | |
*** acidfu has quit IRC | 05:08 | |
*** JamesBenson has quit IRC | 05:32 | |
*** JamesBenson has joined #openvswitch | 05:33 | |
*** JamesBenson has quit IRC | 05:38 | |
*** jaicaa has quit IRC | 05:49 | |
*** dholler has joined #openvswitch | 05:49 | |
*** jaicaa has joined #openvswitch | 05:52 | |
*** eelco has joined #openvswitch | 05:56 | |
*** links has joined #openvswitch | 06:34 | |
*** JamesBenson has joined #openvswitch | 06:38 | |
*** JamesBenson has quit IRC | 06:43 | |
*** JamesBenson has joined #openvswitch | 07:06 | |
*** ralonsoh has joined #openvswitch | 07:11 | |
*** JamesBenson has quit IRC | 07:24 | |
*** zhouhan has quit IRC | 07:38 | |
*** zhouhan has joined #openvswitch | 07:38 | |
*** darkemon has joined #openvswitch | 08:08 | |
*** thaller_ has joined #openvswitch | 08:33 | |
*** thaller__ has quit IRC | 08:35 | |
*** darkemon has quit IRC | 08:53 | |
*** rcernin has quit IRC | 10:01 | |
*** JamesBenson has joined #openvswitch | 11:00 | |
*** JamesBenson has quit IRC | 12:04 | |
*** JamesBenson has joined #openvswitch | 12:19 | |
*** JamesBenson has quit IRC | 12:23 | |
*** dholler has quit IRC | 12:36 | |
*** dholler has joined #openvswitch | 12:37 | |
*** ralonsoh has quit IRC | 12:51 | |
*** ralonsoh has joined #openvswitch | 12:52 | |
*** rcernin has joined #openvswitch | 13:00 | |
*** rcernin has quit IRC | 13:04 | |
*** dholler has quit IRC | 13:07 | |
*** dholler has joined #openvswitch | 13:08 | |
*** seliopou has quit IRC | 13:14 | |
*** seliopou has joined #openvswitch | 13:16 | |
*** armax has joined #openvswitch | 13:20 | |
*** JamesBenson has joined #openvswitch | 13:25 | |
*** dcbw has joined #openvswitch | 13:32 | |
*** acidfu has joined #openvswitch | 14:00 | |
*** links has quit IRC | 14:04 | |
*** ralonsoh has quit IRC | 14:41 | |
*** ralonsoh has joined #openvswitch | 14:42 | |
*** dcbw has quit IRC | 15:21 | |
*** dcbw has joined #openvswitch | 15:21 | |
*** eelco has quit IRC | 15:25 | |
*** anilvenkata_ has quit IRC | 15:32 | |
*** blp has joined #openvswitch | 17:08 | |
blp | Hi! I made it to the meeting today. | 17:14 |
---|---|---|
zhouhan | Hi blp! | 17:16 |
*** Ankur1 has joined #openvswitch | 17:16 | |
*** Ankur150 has joined #openvswitch | 17:16 | |
flaviof | hi all! | 17:17 |
Ankur1 | Hi | 17:17 |
numans | Hi all | 17:17 |
numans | blp, Hi. | 17:17 |
imaximets | Hi | 17:17 |
numans | I think mmichelson will not be joining. | 17:17 |
numans | I'll start the meeting | 17:18 |
numans | #startmeeting ovn_community_development_discussion | 17:18 |
openstack | Meeting started Thu Sep 3 17:18:07 2020 UTC and is due to finish in 60 minutes. The chair is numans. Information about MeetBot at http://wiki.debian.org/MeetBot. | 17:18 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 17:18 |
openstack | The meeting name has been set to 'ovn_community_development_discussion' | 17:18 |
numans | Who wants to go firat | 17:18 |
numans | s/firat/first | 17:18 |
zhouhan | I can go first | 17:19 |
numans | sure | 17:19 |
zhouhan | I improved the nb_cfg mechanism with timestamp which measures end to end latency more accurately | 17:19 |
zhouhan | With that, I retested the incremental flow installation patch series, and can measure the actual latency improvement (in addition to CPU cost). | 17:20 |
_lore_ | hi all | 17:20 |
zhouhan | I could also spin up 3k HVs with 30k lports in scale test, with only 15 farm nodes, thanks to all the ovn-controller CPU improvements. | 17:21 |
zhouhan | with this env, the processing time of both ovn-northd and all ovn-controllers, the end to end latency is reduced by 30%. | 17:21 |
zhouhan | If considering ovn-controllers only (the total time spent on processing SB lflow change by all HVs), the latency reduced by 60%. | 17:22 |
numans | zhouhan, that's great. | 17:22 |
flaviof | zhouhan: does that use the private_chassis table? Is that relevant in your test? | 17:22 |
numans | zhouhan, does your testing also include your ofctrl I-P patches ? | 17:22 |
zhouhan | And now the total e2e latency is 1.5 seconds, which is not bad considering the scale 3K HVs and 30k lports | 17:22 |
zhouhan | flaviof: yes, private_chassis table, with timestamp | 17:23 |
flaviof | zhouhan: nice! | 17:23 |
zhouhan | numans: yes, the 30% and 60% improvement I mentioned is for the ofctrl I-P patches. | 17:23 |
numans | ok | 17:24 |
blp | I have a new 3990X desktop that I'm going to use for benchmarking OVN. It should do a good job. | 17:24 |
zhouhan | numans: please take a look when you have time. #link https://patchwork.ozlabs.org/project/openvswitch/list/?series=197009 | 17:24 |
numans | zhouhan, ack. If I understand you store the timestamp in the db right ? | 17:25 |
numans | blp, cool. | 17:25 |
zhouhan | For the nb_cfg improvements, it is: #link https://patchwork.ozlabs.org/project/ovn/list/?series=198962 | 17:25 |
zhouhan | I also submitted a patch that optionally avoids checking lsp_is_up for programming ARP responder flows | 17:26 |
zhouhan | I think in most cases we don't need this check, and it would largely reduce the cost of the control plane, for port creation and binding - around half of the cost | 17:27 |
numans | zhouhan, ok. So the option is added per ls ? or lsp ? or globally ? | 17:27 |
numans | I didn't see the patch yet | 17:28 |
zhouhan | numans: globally | 17:28 |
numans | zhouhan, ok. sounds good | 17:28 |
zhouhan | numans: the patch is here #link https://patchwork.ozlabs.org/project/ovn/patch/1599099225-113525-1-git-send-email-hzhou@ovn.org/ | 17:29 |
numans | ack | 17:29 |
zhouhan | I am also thinking of adding support for directly specifying port-binding chassis from NB, to avoid port-binding updates from chassises. I think this may be useful for some use cases, probably k8s? (at least it is useful for me) | 17:29 |
*** gregwork has quit IRC | 17:29 | |
zhouhan | That's my update :) | 17:30 |
numans | Thanks. Who wants to go next | 17:30 |
flaviof | zhouhan: specifying port-binding chassis from NB instead of .... ? | 17:31 |
Ankur1 | Can i go next? | 17:31 |
zhouhan | oh, I forgot one thing. For e2e latency 1.5 sec, 1 sec is in ovn-northd. | 17:31 |
zhouhan | Thanks blp for the update on DDlog progress | 17:31 |
zhouhan | I think it is the next biggest improvement for the e2e latency | 17:32 |
zhouhan | flaviof: instead of updating from chassis to SB. | 17:32 |
zhouhan | sorry Ankur1. Please go ahead. | 17:32 |
flaviof | zhouhan: ack. Ankur1 sorry for the interrupt | 17:33 |
Ankur1 | Thanks a lot zhouhan. No problem at all flaviof. | 17:34 |
Ankur1 | Just wanted to highlight a couple of problem statements we are working on and wanted to get some opinion on one of the solutions. | 17:34 |
Ankur1 | a. We are getting plenty of scenarios where there is a need to support multiple distributed gateway router ports per logical router. | 17:34 |
Ankur1 | Does not look like a trivial scenario to solve, but just wanted to highlight we have started some efforts around this. | 17:34 |
*** acidfu has quit IRC | 17:35 | |
blp | zhouhan: I'm embarrassed that I haven't had progress updates in a while. | 17:35 |
Ankur1 | b. Flushing of CT zones: As of now the logic is tied with the existence of datapath. However, there are scenarios where datapath is still existent but CT zone should be flushed (for example if just remove all the NAT rules from a router). | 17:36 |
*** thaller has joined #openvswitch | 17:37 | |
Ankur1 | For b. i submitted a patch some time back, however patch was handling the LB case, hence we abandoned it. | 17:37 |
Ankur1 | As of now, to make CT FLUSH by ZONE more generic, we are thinking if we can add something like CT_FLUSH_BY <ZONE, CT_MARK>, where CT_MARK indicates if a CT entry is because of NAT or LB (or some other feature). | 17:37 |
Ankur1 | Its the CT_FLUSH_BY <ZONE, CT_MARK> where wanted to seek some opinions and thoughts here. | 17:38 |
numans | Ankur1, for LB, we already set ct_label[1] | 17:38 |
*** thaller_ has quit IRC | 17:38 | |
numans | ct_label.natted is the logical field | 17:38 |
Ankur1 | Cool, let us say CT_FLUSH_BY <ZONE, CT_LABEL>.. | 17:39 |
numans | Ankur1, I'm not sure If I'm following what CT_FLUSH_By <..> would do. | 17:40 |
numans | May be you can send an email to the ML about your proposal and we could discuss there. | 17:41 |
numans | thanks for the efforts for all these features. | 17:41 |
Ankur1 | Sure, what i mean is that as of now we have CT_FLUSH_BY <ZONE>, and we are thinking if we make is more granular CT_FLUSH_BY <ZONE, LABEL>, where LABEL identifies a feature. | 17:42 |
Ankur1 | We want to achieve following: | 17:42 |
Ankur1 | a. Trigger CT ZONE flush through config detach/attach rather than datapath delete/add. | 17:42 |
Ankur1 | b. Do CT ZONE FLUSH by feature, so that we are flushing the whole zone, but rather just for a feature, like NAT, LB etc. | 17:42 |
Ankur1 | Sure, i will send out more details in ML. Just wanted to provide a summary here :) | 17:42 |
Ankur1 | Thats all from my side. | 17:42 |
numans | Ankur1, cool. | 17:42 |
zhouhan | thanks Ankur1. a) sounds reasonable. I tried to do it once, but it seemed tricky in the code. So I instead worked around it by creating multiple routers and peering them with static routes. It would be great if the code can be improved to support the use case. | 17:43 |
zhouhan | blp: no worries, as long as it is in progress :) numans and I wondered if we need a temporary I-P for northd before DDlog version is ready, which was why I wanted to know where we are in the DDlog progress first. | 17:43 |
zhouhan | numans: do you want to talk about your idea, since blp is here today | 17:45 |
blp | numans: Please tell me about it. | 17:45 |
numans | My idea was to add a simple I-P engine which would not recompute for unnecessary db changes to start with - like nb_cfg change. | 17:46 |
blp | So, here's what needs to happen for the DDlog OVN: | 17:46 |
blp | 1. Benchmark. | 17:47 |
blp | 2. Update to whatever hasn't made it in. | 17:47 |
blp | That's all, I think. | 17:47 |
blp | It would be easier to maintain if folks were OK with merging it before #1 and #2 happened. | 17:47 |
blp | #2 in particular is a treadmill. | 17:47 |
numans | blp, by merging you mean replacing the c version ? or we have both in parallel ? | 17:48 |
blp | Having both in parallel. | 17:48 |
zhouhan | blp: yes, I feel #2 is hard, too, since ovn-northd is still changing very often. | 17:48 |
blp | That's the way it is in the current fork: both versions get built. | 17:49 |
numans | It sounds good to me. | 17:49 |
numans | And we can switch over to ddlog as default when we have (1) comparable to 'C'. | 17:49 |
blp | OK, then I will plan to post patches in the next few weeks. | 17:49 |
zhouhan | Sounds good to me, too, as long as there are no major issues (except the feature gap) | 17:50 |
blp | The feature gap is really just whatever has been added in the last few months. | 17:50 |
numans | zhouhan, blp when we have feature gap addressed, we can have the patch submitters to update both the versions | 17:51 |
zhouhan | I assume the benchmark should be better than C, according to some very basic testing I did last year (and now a year past) | 17:51 |
numans | otherwise we will always have delta between the two | 17:51 |
blp | I am sure that some tuning and iteration will be needed, because this is the biggest DDlog program that has been written, much bigger than any other. | 17:52 |
zhouhan | "when we have feature gap addressed" - maybe this is the hardest part. How to achieve that/ | 17:52 |
numans | zhouhan, may be we can dedicate the next release to ddlog ? | 17:53 |
numans | after branching for 20.09 | 17:53 |
zhouhan | blp: last year my test showed it 90% more efficient than the C version. Even without further tuning, I assume it shouldn't degrade too much after adding more features recently, right? | 17:53 |
blp | zhouhan: You are probably right. | 17:53 |
zhouhan | numans: I am ok with that. | 17:54 |
zhouhan | would a feature freeze for ovn-northd helpful? | 17:54 |
blp | zhouhan: At some point, yes. | 17:54 |
numans | zhouhan, I actually meant that. once we branch for 20.09, we can work on closing the gaps and until then no new features. | 17:55 |
zhouhan | numans: sounds good to me, but not sure about the broad community :) | 17:55 |
numans | zhouhan, we can discuss on this in ML. | 17:56 |
zhouhan | sure | 17:56 |
numans | blp, thanks for all the efforts | 17:57 |
flaviof | blp: hi! stupid q on ddlog: rust dependency will be part of ovn, but not needed for ovs codebase at all, right? I hear the compiling will take longer with rust. Is that noticeable to you? | 17:57 |
blp | flaviof: OVS will not need rust. | 17:57 |
blp | flaviof: For now, it will be an optional dependency for OVN. Without Rust, you won't get the DDlog version. | 17:57 |
flaviof | ack. #link http://www.openvswitch.org/support/ovscon2019/day1/1553-OVS-OVN'19%20-%20DDlog%20in%20OVN.pdf ovscon talk on ddlog changes | 17:58 |
* zhouhan have to drop off in 1 min, will read your discussion offline | 17:58 | |
flaviof | blp: thanks! | 17:58 |
blp | flaviof: Compiling definitely takes noticeably longer. Most of the time, incremental compilation is not much slower, but the first build takes longer. | 17:58 |
flaviof | blp: fair enough. it is one time cost vs runtime gains. a good trade | 17:59 |
numans | zhouhan, bye | 17:59 |
numans | blp, anything else on the ddlog topic ? If not, I can go next real quick | 18:00 |
flaviof | blp on next ovscon I anticipate an update on that talk that Mark+Dumitru gave. ;) | 18:00 |
blp | numans: That is all I have. | 18:00 |
numans | thanks. | 18:00 |
numans | I can go next real quick. | 18:01 |
numans | I submitted the patch series to cache lflow expr matches/expr tree. | 18:01 |
numans | #link https://patchwork.ozlabs.org/project/ovn/list/?series=199144 | 18:01 |
numans | I was behind reviews. I started reviewing some of the patches. | 18:01 |
numans | I also submitted a patch to handle cluster db upgrades for run_xx_ovsdb ovn-ctl commands. | 18:01 |
numans | #link https://patchwork.ozlabs.org/project/ovn/patch/20200903130400.1971690-1-numans@ovn.org/ | 18:02 |
numans | Request to take a look at these patches. | 18:02 |
numans | That's all from me. | 18:02 |
numans | who wants to go next ? | 18:03 |
_lore_ | I can go next? | 18:04 |
_lore_ | very quick | 18:04 |
_lore_ | I posted some ovs/ovn patch for review | 18:04 |
_lore_ | ovs: I added some debug code for raft | 18:04 |
*** Ankur150 has quit IRC | 18:05 | |
_lore_ | ovn: | 18:05 |
_lore_ | - dhcp decline msg support for dhcp | 18:05 |
_lore_ | - running ovs_db with valgrind/strace | 18:05 |
_lore_ | - a fix for IPv6 empty_lp controller_event | 18:06 |
_lore_ | now I restarted working on ovn-scale code | 18:06 |
_lore_ | that's all from my side, thx | 18:06 |
*** acidfu has joined #openvswitch | 18:07 | |
numans | _lore_, thanks. | 18:09 |
numans | anyone else ? | 18:10 |
numans | If not we can probably end the meeting. | 18:10 |
flaviof | I was on pto last week; not much to report other than small nits on ovn-fake-multinode | 18:11 |
flaviof | #link https://github.com/ovn-org/ovn-fake-multinode/pull/36 | 18:11 |
flaviof | that is all from me :) | 18:11 |
numans | flaviof, thanks for the PR. | 18:11 |
numans | Ok. Everyone. Let's end the meeting. | 18:12 |
numans | Bye | 18:12 |
flaviof | bye all! | 18:12 |
numans | #endmeeting | 18:12 |
openstack | Meeting ended Thu Sep 3 18:12:41 2020 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 18:12 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/ovn_community_development_discussion/2020/ovn_community_development_discussion.2020-09-03-17.18.html | 18:12 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/ovn_community_development_discussion/2020/ovn_community_development_discussion.2020-09-03-17.18.txt | 18:12 |
openstack | Log: http://eavesdrop.openstack.org/meetings/ovn_community_development_discussion/2020/ovn_community_development_discussion.2020-09-03-17.18.log.html | 18:12 |
*** blp has quit IRC | 18:12 | |
_lore_ | bye | 18:16 |
flaviof | bb _lore_ ! | 18:17 |
*** acidfu has quit IRC | 18:43 | |
*** fab23 has quit IRC | 18:53 | |
*** fab23 has joined #openvswitch | 19:00 | |
*** acidfu has joined #openvswitch | 19:00 | |
*** acidfu has quit IRC | 19:05 | |
*** Ankur1 has left #openvswitch | 19:12 | |
*** ralonsoh has quit IRC | 19:30 | |
*** slaweq has quit IRC | 20:20 | |
*** slaweq has joined #openvswitch | 20:26 | |
*** rebrec has quit IRC | 20:46 | |
*** JamesBenson has quit IRC | 20:51 | |
*** JamesBenson has joined #openvswitch | 21:08 | |
*** dcbw has quit IRC | 21:25 | |
*** rcernin has joined #openvswitch | 23:25 | |
*** donhw_ has quit IRC | 23:25 | |
*** donhw has joined #openvswitch | 23:28 | |
*** rcernin has quit IRC | 23:31 | |
*** rcernin has joined #openvswitch | 23:31 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!