Thursday, 2016-02-18

*** aginwala has joined #openstack-neutron-ovn00:00
*** jckasper has quit IRC00:01
*** fzdarsky has quit IRC00:04
*** fzdarsky has joined #openstack-neutron-ovn00:06
*** brad_behle has joined #openstack-neutron-ovn01:18
*** fzdarsky has quit IRC01:18
*** nghosh has quit IRC01:42
*** jckasper has joined #openstack-neutron-ovn01:57
*** jckasper has joined #openstack-neutron-ovn01:57
*** aginwala has quit IRC02:06
*** aginwala has joined #openstack-neutron-ovn02:09
*** aginwala has quit IRC02:09
*** aginwala has joined #openstack-neutron-ovn02:10
*** s3wong has quit IRC02:23
*** azbiswas has quit IRC02:36
*** azbiswas has joined #openstack-neutron-ovn02:36
*** aginwala has quit IRC02:40
*** azbiswas has quit IRC02:41
*** salv-orl_ has quit IRC03:04
*** gangil has quit IRC03:18
*** gizmoguy has quit IRC03:19
*** gizmoguy has joined #openstack-neutron-ovn03:20
*** yamamoto has joined #openstack-neutron-ovn03:41
*** azbiswas has joined #openstack-neutron-ovn04:03
*** brad_behle has quit IRC04:17
*** azbiswas has quit IRC04:27
*** azbiswas has joined #openstack-neutron-ovn04:28
*** azbiswas has quit IRC04:32
*** jckasper has quit IRC04:33
*** jckasper has joined #openstack-neutron-ovn04:33
*** azbiswas has joined #openstack-neutron-ovn04:56
*** azbiswas has quit IRC05:01
*** allan_h has joined #openstack-neutron-ovn05:04
*** allan_h has quit IRC05:11
*** gal_ is now known as gsagie05:44
*** aginwala has joined #openstack-neutron-ovn06:24
*** fzdarsky has joined #openstack-neutron-ovn06:34
*** numans has joined #openstack-neutron-ovn06:46
*** fzdarsky has quit IRC06:52
*** fzdarsky has joined #openstack-neutron-ovn06:54
*** azbiswas has joined #openstack-neutron-ovn07:08
*** armax has quit IRC07:09
*** arosen121 has joined #openstack-neutron-ovn07:21
*** arosen12 has quit IRC07:24
*** arosen12 has joined #openstack-neutron-ovn07:28
*** gongysh has joined #openstack-neutron-ovn07:29
*** arosen121 has quit IRC07:30
*** salv-orlando has joined #openstack-neutron-ovn07:44
*** azbiswas_ has joined #openstack-neutron-ovn07:49
*** azbiswas has quit IRC07:51
*** pcaruana has joined #openstack-neutron-ovn08:05
*** fzdarsky has quit IRC08:08
*** gongysh has quit IRC08:09
*** numans has quit IRC08:22
*** numans has joined #openstack-neutron-ovn08:33
*** gangil has joined #openstack-neutron-ovn08:56
*** gangil has joined #openstack-neutron-ovn08:56
*** palexster has quit IRC09:27
*** palexster has joined #openstack-neutron-ovn09:27
*** aginwala has quit IRC09:33
*** arosen12 has quit IRC09:40
*** openstackgerrit has quit IRC10:02
*** openstackgerrit has joined #openstack-neutron-ovn10:03
*** salv-orl_ has joined #openstack-neutron-ovn10:03
*** roeyc has joined #openstack-neutron-ovn10:03
*** salv-orlando has quit IRC10:06
*** gal_ has joined #openstack-neutron-ovn10:06
*** gsagie has quit IRC10:10
*** azbiswas_ has quit IRC10:24
*** palexster has quit IRC10:45
*** palexster has joined #openstack-neutron-ovn10:46
*** gal_ is now known as gsagie10:50
*** gsagie has quit IRC10:55
*** roeyc has quit IRC11:00
*** yamamoto has quit IRC11:03
*** fzdarsky has joined #openstack-neutron-ovn11:20
*** roeyc has joined #openstack-neutron-ovn11:41
*** yamamoto has joined #openstack-neutron-ovn11:48
*** yamamoto_ has joined #openstack-neutron-ovn11:49
*** yamamoto has quit IRC11:53
*** yamamoto_ has quit IRC11:57
*** fzdarsky has quit IRC11:57
*** salv-orl_ has quit IRC12:03
*** yamamoto has joined #openstack-neutron-ovn12:11
*** roeyc has quit IRC12:14
*** roeyc has joined #openstack-neutron-ovn12:17
*** rtheis has joined #openstack-neutron-ovn12:18
*** yamamoto has quit IRC12:22
*** yamamoto has joined #openstack-neutron-ovn12:23
*** azbiswas has joined #openstack-neutron-ovn12:25
*** elurkki_ is now known as elurkki12:25
*** salv-orlando has joined #openstack-neutron-ovn12:26
*** yamamoto has quit IRC12:27
*** azbiswas has quit IRC12:30
*** gangil has quit IRC12:34
*** yamamoto has joined #openstack-neutron-ovn12:46
*** gsagie has joined #openstack-neutron-ovn13:12
*** thumpba has joined #openstack-neutron-ovn13:15
*** allan_h has joined #openstack-neutron-ovn13:23
*** allan_h has quit IRC13:34
*** yamamoto has quit IRC13:42
*** yamamoto has joined #openstack-neutron-ovn13:45
*** yamamoto has quit IRC13:47
*** yamamoto has joined #openstack-neutron-ovn13:47
*** yamamoto has quit IRC13:47
Sam-I-Ammoo.13:48
*** yamamoto has joined #openstack-neutron-ovn13:49
*** yamamoto has quit IRC13:59
*** azbiswas has joined #openstack-neutron-ovn14:04
*** jckasper has quit IRC14:05
*** thumpba has quit IRC14:09
*** jckasper has joined #openstack-neutron-ovn14:28
*** fzdarsky has joined #openstack-neutron-ovn14:37
*** gongysh has joined #openstack-neutron-ovn14:45
*** yamamoto has joined #openstack-neutron-ovn14:59
*** fzdarsky_ has joined #openstack-neutron-ovn15:02
*** azbiswas has quit IRC15:03
*** allan_h has joined #openstack-neutron-ovn15:20
*** gongysh has quit IRC15:22
*** azbiswas has joined #openstack-neutron-ovn15:32
*** fzdarsky_ has quit IRC15:43
*** fzdarsky has quit IRC15:43
*** numans has quit IRC15:44
*** allan_h has quit IRC15:45
*** thumpba has joined #openstack-neutron-ovn15:49
*** fzdarsky has joined #openstack-neutron-ovn15:50
*** fzdarsky_ has joined #openstack-neutron-ovn15:50
*** azbiswas_ has joined #openstack-neutron-ovn15:51
*** yamamoto has quit IRC15:52
*** azbiswas has quit IRC15:54
*** fzdarsky has quit IRC15:56
*** fzdarsky_ has quit IRC15:56
*** salv-orl_ has joined #openstack-neutron-ovn16:03
*** salv-orlando has quit IRC16:06
*** Guest99081 is now known as ioni16:07
*** ioni has quit IRC16:07
*** ioni has joined #openstack-neutron-ovn16:07
*** fzdarsky_ has joined #openstack-neutron-ovn16:07
*** fzdarsky has joined #openstack-neutron-ovn16:07
*** armax has joined #openstack-neutron-ovn16:10
openstackgerritMerged openstack/networking-ovn: Network availability zone deployment support  https://review.openstack.org/28128416:11
*** allan_h has joined #openstack-neutron-ovn16:11
*** armax has quit IRC16:14
*** pcaruana has quit IRC16:15
*** regXboi has joined #openstack-neutron-ovn16:16
*** yamamoto has joined #openstack-neutron-ovn16:21
*** armax has joined #openstack-neutron-ovn16:22
*** fzdarsky has quit IRC16:24
*** fzdarsky_ has quit IRC16:24
*** Mic22 has joined #openstack-neutron-ovn16:30
*** brad_behle has joined #openstack-neutron-ovn16:35
azbiswas_russellb: An update regarding https://bugs.launchpad.net/networking-ovn/+bug/154518916:38
openstackLaunchpad bug 1545189 in networking-ovn "Port create results OVSDB transaction timeout: O(N) ACL recreation in North DB" [High,Confirmed] - Assigned to Amitabha Biswas (azbiswas)16:38
azbiswas_Our folks encountered this timeout a couple of times in a real deployment scenario - so it can happen in realistic scenarios.16:39
azbiswas_I'm testing with a patch that eliminates the timeout, have gotten to a much larger number of ports than before.16:40
*** fzdarsky has joined #openstack-neutron-ovn16:40
*** fzdarsky_ has joined #openstack-neutron-ovn16:41
russellbazbiswas_: sounds like good progress!16:41
*** fzdarsky_ has quit IRC16:41
*** fzdarsky__ has joined #openstack-neutron-ovn16:41
*** fzdarsky__ has quit IRC16:41
azbiswas_yeah, but now realizing there are other loops in that area (without db transactions) that are consuming a bunch of time16:42
*** fzdarsky_ has joined #openstack-neutron-ovn16:42
azbiswas_so debugging that16:42
azbiswas_I'm at 500 ports on a provider network16:42
*** aginwala has joined #openstack-neutron-ovn16:51
russellbazbiswas_: related, there's going to be a really nice simplification and optimization of provider networks merged soon16:58
russellbazbiswas_: which you could consider testing with if you'd like.16:58
russellbazbiswas_: you need 2 patches to test it, though.  first you need https://patchwork.ozlabs.org/patch/582095/ for OVN.  and then https://review.openstack.org/#/c/266186/ for networking-ovn, though that one needs a rebase16:59
russellbfor 500 ports on a provider network, it's going to be a really big difference16:59
azbiswas_sounds good17:00
azbiswas_I'll try out the combined patches17:00
*** s3wong has joined #openstack-neutron-ovn17:00
russellbfor 500 ports, old/existing code results in 7000 logical flows in OVN17:01
russellbnew method with patches, 1555 logical flows17:01
azbiswas_sounds about right17:01
azbiswas_oh!, that's huge17:01
azbiswas_that should reduce some load on that ovn-controller as well.17:02
*** s3wong has quit IRC17:06
*** aginwala has quit IRC17:07
azbiswas_russellb: It's the _acl_remote_match_ip that's causing the O(N^2) behavior in the _update_acls_for_security_group routine. I'm not sure if we can get rid of that. With N=500 in a provider network, that's big chunk of processing time in creating 1 new port.17:35
azbiswas_I'm going to file a separate bug for that O(N^2) behavior and deal with it at a later point since it's a pre-existing condition in the code.17:46
russellbyes, that's because of remote_group_id17:47
russellbit's painful ....17:47
russellbthere's probably a way to improve it somewhat17:47
azbiswas_I'll look into possibly optimizing it after I submit the fix for ovsdb timeout now that i've a better idea of the ACL implementation.17:57
regXboirussellb: speaking of things - now that I've got the incremental flow processing working, I'm likely going to abandon it as impractical18:03
regXboi:(18:03
*** numans has joined #openstack-neutron-ovn18:04
russellbazbiswas_: nice work :)18:04
russellbregXboi: that happens sometimes, but the silver lining is usually a better understanding of the code, which can lead to new ideas for improvement18:04
regXboilet me lay out the reasoning and the problem that leads me to thinking about abandonment18:05
*** roeyc has quit IRC18:06
regXboiincremental processing should not skip a logical flow record that hits a continue statement in lflow_run18:06
regXboiso right now, the incremental processing resets its starting point to that record18:06
regXboi*BUT* the amount of time for the prereq for a record to be processed can be extreme - I ran a test case this morning where it was over 80 seconds18:07
regXboiand that's just not worth it :(18:07
russellbi think the general idea still has merit18:08
russellbi don't have the code in my head right now to really comment18:08
russellbi started looking at doing something similar in ovn-northd and it wasn't as easy in practice as it was in my head :-)18:09
regXboioh, the idea has merit, but it may run afoul on the rocks of cold reality18:09
regXboiI understand - the whole persistent flow storage patch is ... well ... ugly18:09
regXboiFYI, what's the procedure for abandoning a patch - just send an email saying "abandoned" and why?18:10
russellbyeah, roughly18:10
regXboiok18:10
russellbnothing formal18:11
russellbif you make an account on https://patchwork.ozlabs.org/project/openvswitch/list/ you can mark it as abandoned there too18:11
russellbor a project admin will do it later18:11
* regXboi makes a note18:11
regXboioh yeah - I did find that the ovn e2e test cases create race conditions in terms of what the different hypervisors see18:11
russellbhttps://patchwork.ozlabs.org/project/openvswitch/list/?submitter=6824418:11
*** azbiswas_ is now known as azbiswas18:12
russellbOVN meeting in #openvswitch in 3 minutes18:12
*** aginwala has joined #openstack-neutron-ovn18:13
*** zhouhan has joined #openstack-neutron-ovn18:13
*** gangil has joined #openstack-neutron-ovn18:20
*** gangil has joined #openstack-neutron-ovn18:20
*** aginwala has quit IRC18:23
*** aginwala has joined #openstack-neutron-ovn18:27
*** gsagie has quit IRC18:31
*** chandrav has joined #openstack-neutron-ovn18:33
*** s3wong has joined #openstack-neutron-ovn18:49
*** fzdarsky has quit IRC18:50
*** fzdarsky_ has quit IRC18:51
Sam-I-Amrussellb: after the meeting, can i bug you about ovn architecture bits?18:54
russellbit's going to cost you18:57
russellb(yes you can)18:57
russellbfeel free to bring it up in #openvswitch too18:57
russellbmay be others still around and interested, depending on topic18:57
Sam-I-Amrussellb: i'm trying to improve the architectural diagram19:00
Sam-I-Amwhat connects to what where19:00
Sam-I-Amlooking at a recent email on dev, the nb and sb processes spawn off unique ovsdb-server instances?19:01
*** fzdarsky has joined #openstack-neutron-ovn19:01
*** fzdarsky_ has joined #openstack-neutron-ovn19:02
russellbSam-I-Am: not yet, but technically it could be done that way19:04
russellbSam-I-Am: and soon, our ovn-ctl helper may set things up that way by default19:04
Sam-I-Amwhere would conf.db end up in that case?19:04
Sam-I-Ama third instance?19:04
russellbyes, if that host was also running ovs-vswitchd19:05
Sam-I-Ami see a conf.db on the database node here19:05
Sam-I-Amits not running vswitchd19:05
*** azbiswas has quit IRC19:05
*** azbiswas has joined #openstack-neutron-ovn19:06
russellbif it's not running vswitchd, then conf.db isn't necessary, but it's not harmful either19:06
Sam-I-Amhmmm19:06
zhouhanrussellb: now the option --remote=db:Open_vSwitch,Open_vSwitch,manager_options requires conf.db19:07
russellbzhouhan: that's right19:07
zhouhanbut that would be just a small change to remove it19:07
russellboh, hm19:07
Sam-I-Amrussellb: on the compute node with vswitch... it talks to ovn-controller19:07
russellbyeah, but it's convenient to be able to just update the db for manager config19:08
russellbzhouhan: i wish that, and the ssl config, were in a separate db schema19:08
russellbSam-I-Am: correct19:08
zhouhanyes19:08
Sam-I-Amwhat role does ovsdb play on the compute node if it just has conf.db ?19:08
Sam-I-Amseems like ovs gets most of its bits from ovn-controller19:09
russellbconf.db is the database required for ovs-vswitchd19:09
Sam-I-Amwell, ovn-controller pushes them down19:09
russellbovn-controller is a client of that db19:09
russellbbut so is nova19:09
russellbnova creates ports in the db for VMs19:09
*** azbiswas has quit IRC19:10
russellbthere's 2 pieces to configuring OVS, the DB, conf.d (bridges, ports, related config) and OpenFlow for configuring forwarding rules19:10
russellbsorry if i'm saying stuff you know19:11
Sam-I-Ami always find i dont know much :/19:11
Sam-I-Amso ovs-vsctl reads out of conf.db?19:12
russellbyep!19:12
russellbovs-vsctl is basically the client utility for conf.db (or the Open_vSwitch OVSDB schema)19:13
russellbsimilarly, ovn-nbctl is the client utility for the OVN_Northbound OVSDB schema19:13
russellband ovn-sbctl for OVN_Southbound OVSDB schema19:13
russellbthey're just handy wrappers around interacting with a particular db schema19:13
russellba specific instance of ovsdb-server can host one or more databases based on one of those schemas19:15
Sam-I-Amovn-controller talks to conf.db via the ovsdb-server and back up to ovsdb-server on the db node?19:15
*** fzdarsky_ has quit IRC19:15
Sam-I-Ammore specifically, the sb database on the db node19:15
russellbovn-controller talks to the local ovsdb-server for conf.db (Open_vSwitch db) as that database is node-local config19:15
russellbovn-controller also talks to ovsdb-server on whatever host is running the central OVN_Southbound database19:16
russellbyes19:16
*** fzdarsky has quit IRC19:16
russellbovn-controller is basically a client of 3 interfaces, those 2, plus it uses the OpenFlow programming interface of ovs-vswitchd19:16
Sam-I-Ammmmmm19:18
Sam-I-Amrussellb: i'll put a working copy of this diagram up somewhere19:19
*** sramamurthy has joined #openstack-neutron-ovn19:19
russellbok19:21
russellbascii right?19:22
russellb:-p19:22
Sam-I-Amrussellb: lolololololol19:22
russellbi've switched to 3-d ascii diagrams19:24
*** aginwala has quit IRC19:25
Sam-I-Amrussellb: http://apps1-dfw.osdt.ionosphere80.com/misc/scenario-ovn-architecture1.png19:35
Sam-I-Amthats sort of where i'm going19:35
russellblooking good19:36
russellbminor thing ... red line between networking-ovn and ovn-northd should be between networking-ovn and the OVN_Northbound db19:36
russellband ovn-northd should have lines to both OVN_Northbound and OVN_Southbound19:36
russellbthat's going to be great19:37
*** aginwala has joined #openstack-neutron-ovn19:38
Sam-I-Amrussellb: done!19:41
Sam-I-Amkind of wondering if i need to break out ovs-vswitchd into more bits19:42
Sam-I-Amlike... its openflow controller and db stuff is really control plane... but the routing/switching/acl is data plane19:42
russellbyeah, depends how deep down the rabbit hole you want to go19:46
russellbvswitch, vrouter, and access control seems good enough to me19:46
russellbexplaining the breakdown between control plane and data plane is probably too much detail for this diagram19:47
Sam-I-Ami think i called it 'ovs data plane' because 'ovs switch' felt redundant19:51
Sam-I-Ambbiab, appt19:52
russellbcya19:52
*** numans has quit IRC19:58
*** lsp42 has quit IRC20:00
*** brad_behle_ has joined #openstack-neutron-ovn20:06
*** gangil has quit IRC20:11
*** lsp42 has joined #openstack-neutron-ovn20:11
*** brad_behle has quit IRC20:12
*** aginwala has quit IRC20:16
*** azbiswas has joined #openstack-neutron-ovn20:19
*** lsp42 has quit IRC20:20
*** allan_h has quit IRC20:22
sramamurthyHi I am seeing a problem with provider networks and acls20:23
sramamurthyI wanted to bounce it here prior to filing a bug20:24
sramamurthyThe ovn plugin is configuring acls agains the provider network20:25
sramamurthybut it should really configure it on the 2-port lswitch20:26
sramamurthycorresponding to the port on the provider network20:26
*** aginwala has joined #openstack-neutron-ovn20:27
sramamurthy        cmd = self._ovn.add_acl(             lswitch=utils.ovn_name(port['network_id']),             lport=port['id'],20:28
sramamurthyThe switch derived from the port must be specialcased for20:28
sramamurthyprovider network ports20:28
sramamurthyto point to the 2-port lswitch20:28
sramamurthy??20:29
*** allan_h has joined #openstack-neutron-ovn20:35
*** allan_h has quit IRC20:36
russellbsramamurthy: there is an open bug for that20:40
russellbsramamurthy: and we decided to not fix it, in favor of some OVN work to get rid of the need for the 2-port lswitch20:40
russellbonce we get back to only having a single OVN lswitch per provider network, it'll be fixed as a side effect20:40
sramamurthyyea the current design is awkward because, the lswitch for the provider net doesnt have any ports but has ACLs referring to them20:42
sramamurthythe 2 port switch has ports but no ACLs, and even if we put the ACLs there for the port20:43
sramamurthythe ACLs would refer to ports not in the lswitch20:43
russellbyes, ACLs are put on the wrong lswitch20:43
russellbthe ACLs shouldn't be referring to lports by name anymore20:43
russellbso if we moved them, they should work fine20:44
russellbjust not worth the effort since that lswitch is going away20:44
sramamurthyIs it worth patching the plugin to make the SG work on provider networks in the interim ?20:44
russellbi'd review/merge it if someone wanted to do it20:44
russellbbut i'm hoping we'll merge the alternative in the next week20:45
sramamurthyI can volunteer for it20:45
russellbok20:45
sramamurthyif the merge is 1 week away then it may not be worth the effort20:45
russellb https://patchwork.ozlabs.org/patch/582095/ for OVN.  and then https://review.openstack.org/#/c/266186/ for networking-ovn, though that one needs a rebase20:46
russellb^^^ the patches in question20:46
sramamurthythanks..20:46
russellbsramamurthy: sorry for the trouble20:49
sramamurthy@russelb, thanks for the quick resolution..20:50
*** lsp42 has joined #openstack-neutron-ovn20:53
*** thumpba has quit IRC20:53
*** lsp42 has quit IRC20:57
russellbsramamurthy: https://bugs.launchpad.net/networking-ovn/+bug/153922721:09
openstackLaunchpad bug 1539227 in networking-ovn "Security group not enforced on physical networks" [Critical,In progress] - Assigned to Han Zhou (zhouhan)21:09
*** lrichard_ has quit IRC21:13
*** lsp42 has joined #openstack-neutron-ovn21:24
*** lsp42 has quit IRC21:28
*** lsp42 has joined #openstack-neutron-ovn21:37
*** gangil has joined #openstack-neutron-ovn21:41
*** gangil has joined #openstack-neutron-ovn21:41
*** lsp42 has quit IRC21:49
*** lsp42 has joined #openstack-neutron-ovn22:00
*** salv-orlando has joined #openstack-neutron-ovn22:03
*** allan_h has joined #openstack-neutron-ovn22:03
*** salv-orl_ has quit IRC22:05
*** rtheis has quit IRC22:05
*** aginwala has quit IRC22:14
*** aginwala has joined #openstack-neutron-ovn22:16
*** lsp42 has quit IRC22:16
*** lsp42 has joined #openstack-neutron-ovn22:30
*** zhouhan has quit IRC22:35
*** lsp42 has quit IRC22:35
*** allan_h has quit IRC22:35
*** lsp42 has joined #openstack-neutron-ovn22:45
*** yamamoto has quit IRC22:49
*** brad_behle_ has quit IRC22:50
*** lsp42 has quit IRC22:56
*** aginwala has quit IRC23:02
*** lsp42 has joined #openstack-neutron-ovn23:03
*** aginwala has joined #openstack-neutron-ovn23:06
*** jhfeng has joined #openstack-neutron-ovn23:07
*** lsp42 has quit IRC23:09
*** lsp42 has joined #openstack-neutron-ovn23:14
*** jckasper has quit IRC23:16
*** regXboi has quit IRC23:17
*** yamamoto has joined #openstack-neutron-ovn23:17
*** jckasper has joined #openstack-neutron-ovn23:17
*** jckasper has quit IRC23:21
*** yamamoto has quit IRC23:31
*** chandrav has quit IRC23:43
*** openstackgerrit has quit IRC23:47
*** openstackgerrit_ is now known as openstackgerrit23:47
*** openstackgerrit_ has joined #openstack-neutron-ovn23:47
*** openstackgerrit_ is now known as openstackgerrit23:48
*** openstackgerrit_ has joined #openstack-neutron-ovn23:49
*** jckasper has joined #openstack-neutron-ovn23:51
*** lsp42 has quit IRC23:53
*** jckasper has quit IRC23:55
*** openstackgerrit_ has quit IRC23:55
*** openstackgerrit_ has joined #openstack-neutron-ovn23:56

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!