Thursday, 2016-07-07

*** ramamurthy has quit IRC00:02
*** banix has joined #openstack-neutron-ovn00:27
*** salv-orl_ has quit IRC00:42
*** banix has quit IRC00:48
*** chandrav has quit IRC00:51
*** ramamurthy has joined #openstack-neutron-ovn00:56
*** doonhammer has quit IRC01:06
*** banix has joined #openstack-neutron-ovn01:07
*** banix has quit IRC01:45
*** mickeys has joined #openstack-neutron-ovn02:03
*** jckasper has quit IRC02:07
*** jckasper has joined #openstack-neutron-ovn02:08
*** jckasper has quit IRC02:13
*** salv-orlando has joined #openstack-neutron-ovn02:19
*** salv-orlando has quit IRC02:26
*** rtheis has quit IRC02:35
*** salv-orlando has joined #openstack-neutron-ovn02:55
*** salv-orlando has quit IRC02:59
*** mickeys has quit IRC03:00
*** mickeys has joined #openstack-neutron-ovn03:01
*** mickeys has quit IRC03:05
*** yamamot__ has joined #openstack-neutron-ovn03:10
*** salv-orlando has joined #openstack-neutron-ovn03:29
*** salv-orlando has quit IRC03:36
*** ramamurthy has quit IRC03:38
*** yamamot__ has quit IRC04:24
*** yamamot__ has joined #openstack-neutron-ovn04:28
*** salv-orlando has joined #openstack-neutron-ovn04:39
*** salv-orlando has quit IRC04:47
*** salv-orlando has joined #openstack-neutron-ovn04:49
*** mickeys has joined #openstack-neutron-ovn05:02
*** mickeys has quit IRC05:05
*** mickeys has joined #openstack-neutron-ovn05:06
*** mickeys has quit IRC05:10
*** yamamot__ has quit IRC05:52
*** banix has joined #openstack-neutron-ovn05:58
*** jckasper has joined #openstack-neutron-ovn06:12
*** jckasper has quit IRC06:17
*** banix has quit IRC06:22
*** armax has quit IRC06:30
*** yamamot__ has joined #openstack-neutron-ovn06:33
*** salv-orlando has quit IRC07:51
*** salv-orlando has joined #openstack-neutron-ovn07:52
*** mickeys has joined #openstack-neutron-ovn07:54
*** mickeys has quit IRC07:58
*** arosen12 has quit IRC07:59
*** gongysh has joined #openstack-neutron-ovn08:02
*** fzdarsky has joined #openstack-neutron-ovn08:10
*** openstackgerrit has quit IRC08:18
*** openstackgerrit has joined #openstack-neutron-ovn08:18
*** pcaruana has joined #openstack-neutron-ovn08:30
*** salv-orlando has quit IRC09:03
*** roeyc has joined #openstack-neutron-ovn09:09
*** gongysh has quit IRC09:52
*** yamamot__ has quit IRC09:54
*** gongysh has joined #openstack-neutron-ovn10:00
*** jckasper has joined #openstack-neutron-ovn10:03
*** jckasper has quit IRC10:08
openstackgerritBabu Shanmugam proposed openstack/networking-ovn: Grenade plugin for testing OVN migration from ML2/OVS  https://review.openstack.org/33582510:17
*** salv-orlando has joined #openstack-neutron-ovn10:22
*** gongysh has quit IRC10:26
*** chandrav has joined #openstack-neutron-ovn10:41
*** salv-orl_ has joined #openstack-neutron-ovn10:43
*** fzdarsky is now known as fzdarsky|lunch10:45
*** salv-orlando has quit IRC10:46
*** rtheis has joined #openstack-neutron-ovn10:58
*** salv-orlando has joined #openstack-neutron-ovn11:04
*** salv-orlando has quit IRC11:04
*** salv-orl_ has quit IRC11:07
*** roeyc has quit IRC11:33
*** ramamurthy has joined #openstack-neutron-ovn11:58
*** dkehn_ has joined #openstack-neutron-ovn12:22
*** fzdarsky|lunch is now known as fzdarsky12:23
*** dkehn__ has quit IRC12:25
*** rtheis has quit IRC12:29
*** banix has joined #openstack-neutron-ovn12:31
*** roeyc has joined #openstack-neutron-ovn12:34
*** jckasper has joined #openstack-neutron-ovn13:05
*** jckasper has quit IRC13:07
*** jckasper has joined #openstack-neutron-ovn13:08
*** jckasper has quit IRC13:08
*** jckasper has joined #openstack-neutron-ovn13:09
*** rtheis has joined #openstack-neutron-ovn13:32
*** dkehn has joined #openstack-neutron-ovn13:40
*** dkehn_ has quit IRC13:41
*** chandrav has quit IRC14:00
*** numans has joined #openstack-neutron-ovn14:02
*** mlavalle has joined #openstack-neutron-ovn14:17
*** lrichard has quit IRC14:38
*** lrichard has joined #openstack-neutron-ovn14:38
*** salv-orlando has joined #openstack-neutron-ovn14:44
*** salv-orl_ has joined #openstack-neutron-ovn14:45
*** banix has quit IRC14:46
openstackgerritRichard Theis proposed openstack/networking-ovn: WIP: Use OVN address set to implement remote security groups  https://review.openstack.org/31899514:49
*** salv-orlando has quit IRC14:49
*** jckasper has quit IRC14:53
*** jckasper has joined #openstack-neutron-ovn14:54
*** jckasper has quit IRC14:55
*** jckasper has joined #openstack-neutron-ovn14:56
*** banix has joined #openstack-neutron-ovn15:01
*** mickeys has joined #openstack-neutron-ovn15:01
*** gongysh has joined #openstack-neutron-ovn15:06
*** regXboi has joined #openstack-neutron-ovn15:08
regXboiyo, russellb - you around?15:09
russellbI am!15:09
russellb\o/15:09
regXboiaddress sets is crashing on deletes15:09
*** ramamurthy has quit IRC15:09
regXboirtheis is seeing tempest failures because of this15:10
regXboiit looks like a double destroy15:10
russellbah yes, i heard / saw15:10
russellbanything i can do to help?15:10
regXboipush the ovs patch when I get it crafted submitted??? :)15:10
*** doonhammer has joined #openstack-neutron-ovn15:10
russellbha, sure15:10
regXboiI'm still trying to figure out how the second entry is getting into the SSET15:11
russellbhave you figured out an easy way to reproduce?15:11
regXboistand up devstack and run rally at it15:11
regXboiwhen rally tears down stuff - boom15:11
regXboiso I think deletes is the key15:11
*** ramamurthy has joined #openstack-neutron-ovn15:12
*** banix has quit IRC15:13
regXboiI think I'm going to dump the sset list in the interim15:16
*** banix has joined #openstack-neutron-ovn15:16
regXboibecause the logs say it's not pulling the symbol out of sset, but I'm still not 100% sure :)15:16
openstackgerritRichard Theis proposed openstack/networking-ovn: WIP: Use OVN address set to implement remote security groups  https://review.openstack.org/31899515:19
russellbok, hopefully we can narrow it down to a test case we can add to the ovs test suite15:19
regXboithat's where I'm trying to get to15:19
regXboibecause we don't actually test deleting an address set15:20
regXboiok... looking at the logs, the problem is where we try and pull the name out of the SSET when removing the node15:25
regXboiit looks like we aren't getting rid of it15:25
regXboione more run to triple check that statement15:25
*** dkehn__ has joined #openstack-neutron-ovn15:25
*** doonhammer has quit IRC15:26
*** dkehn has quit IRC15:28
*** ramamurthy has quit IRC15:35
regXboihmm, the sset is getting really screwed up15:37
russellbi'll jump in once i finish this expense report ...15:40
russellb... and eat lunch15:40
russellb:)15:40
*** doonhammer has joined #openstack-neutron-ovn15:40
regXboirussellb: question for you as/after you eat lunch - should the local_address_sets have multiple entries for the same name?15:43
russellbi honestly don't remember the code at all15:44
russellbso you're ahead of me15:44
regXboiok, that's fair15:44
regXboiit looks like it's persisted, but not persisted15:44
*** pcaruana has quit IRC15:49
regXboiwell... I should say it's getting corrupted, because looking through for the symbol that leads to the crash, I eventually see it existing in local_address_sets multiple times15:49
*** gongysh has quit IRC15:50
regXboioh I see why15:50
regXboiwhen the address set changes, we don't remove the old entry from local_address_sets, we just re-add it15:51
regXboiand boom15:51
*** roeyc1 has joined #openstack-neutron-ovn15:51
*** roeyc has quit IRC15:51
*** regXboi has quit IRC15:55
*** regXboi has joined #openstack-neutron-ovn15:55
*** azbiswas has joined #openstack-neutron-ovn15:57
regXboiand that fixes it15:59
regXboirussellb: the issue is we need to change the value of the address set, and then make sure that there is only one entry for the name in the address set afterwards16:00
regXboiI'm not 100% sure how to write a test to *do* that, but that's the bug16:00
*** yamamoto has joined #openstack-neutron-ovn16:03
*** regXboi has quit IRC16:06
*** regXboi has joined #openstack-neutron-ovn16:06
*** azbiswas_ has joined #openstack-neutron-ovn16:07
*** armax has joined #openstack-neutron-ovn16:09
*** azbiswas has quit IRC16:10
*** ramamurthy has joined #openstack-neutron-ovn16:20
*** dkehn__ is now known as dkehn_16:20
*** azbiswas_ has quit IRC16:21
*** azbiswas has joined #openstack-neutron-ovn16:24
regXboirussellb: https://patchwork.ozlabs.org/patch/64596716:25
regXboithat's the one liner16:25
*** azbiswas has quit IRC16:38
*** azbiswas has joined #openstack-neutron-ovn16:42
*** regXboi has quit IRC16:49
*** regXboi has joined #openstack-neutron-ovn16:51
*** azbiswas has quit IRC16:54
*** roeyc1 has quit IRC17:02
*** azbiswas has joined #openstack-neutron-ovn17:04
*** azbiswas_ has joined #openstack-neutron-ovn17:12
*** azbiswas has quit IRC17:13
*** xiaohhui has quit IRC17:20
*** s3wong has joined #openstack-neutron-ovn17:31
*** fzdarsky is now known as fzdarsky|afk17:32
*** xiaohhui has joined #openstack-neutron-ovn17:36
*** chandrav has joined #openstack-neutron-ovn17:38
*** salv-orlando has joined #openstack-neutron-ovn17:38
*** salv-orl_ has quit IRC17:39
regXboirussellb: for the test case, I think what we need to do is create/update/delete and then make sure the ovn-controller is still running17:39
russellbyep, makes sense17:40
russellbor create update delete twice17:40
russellbwith validation throughout17:40
russellbor something17:40
regXboiwell the bug is in update17:40
regXboiupdate leads to two entries17:40
regXboiand then delete forces it out17:40
regXboiand boom17:40
regXboirussellb: what I don't see is how to do the update and destroy?  do  Ineed to do a find to get the record?17:48
regXboior is that returned by create?17:49
*** numans has quit IRC17:52
*** salv-orlando has quit IRC17:55
russellbOK17:58
russellblet's see here.17:58
*** salv-orlando has joined #openstack-neutron-ovn17:58
*** igordcard has quit IRC17:59
*** igordcard has joined #openstack-neutron-ovn17:59
regXboiok I see how to do this, I think18:01
*** zhouhan has joined #openstack-neutron-ovn18:02
regXboiwell, I'm not 100% sure how to check that ovn-controller is still running18:02
regXboiother than a hack18:02
*** yamamoto has quit IRC18:03
*** yamamoto has joined #openstack-neutron-ovn18:03
*** regXboi has quit IRC18:06
*** regXboi has joined #openstack-neutron-ovn18:06
regXboihmm, all I need is a way to test that the controller is still running18:07
regXboiI've got the rest18:07
russellbregXboi: maybe run ovs-appctl?18:07
russellbwith ........ the version command?18:08
russellband make sure the command returns successfully?18:08
russellbi assume it returns non-zero if it fails to connect18:08
regXboithat should do it18:08
regXboilet me try and see18:08
russellbok18:08
*** yamamoto has quit IRC18:09
regXboialrighty, lets see if this test does the right thing before the patch18:17
*** fzdarsky|afk has quit IRC18:20
regXboihmmm18:21
regXboiwhat starts ovn-controller in the test suite?18:21
russellbovn_attach18:23
regXboiah thanks18:24
russellbsee tests/ofproto-macros.at18:24
russellbor more useful, example uses18:24
regXboiI'm looking at the eamples :)18:24
regXboiexamples even18:25
flaviofregXboi: so the crash is that insert in local_address_sets fails as 'duplicate key', right?18:27
regXboiflaviof: the issue is that when the address set gets updated, it gets added to the hash a second time18:27
regXboiand then when it gets destroyed, we end up with a double destroy in the controller and boom18:28
flaviofregXboi: ack.  the fix looks right to me (https://patchwork.ozlabs.org/patch/645967/).18:28
regXboioh it's right18:28
regXboiI just need the test18:28
regXboiwhich I almost have18:28
flaviofack.18:28
regXboiwell, that check didn't quite work18:29
flaviofregXboi: you are checking if northd is still alive after the update?18:30
regXboiovn-controller18:30
regXboithat's where the explosion takes place18:30
regXboiovn-northd is just a simple copy IIRC18:31
flaviofthat is right. lfow.c is part of ovn-controller18:32
*** armax_ has joined #openstack-neutron-ovn18:32
flaviofis it crashing and getting re-spun?18:32
regXboinot in devstack gate18:33
regXboirussellb: got it - updated patch with test coming shortly18:33
russellbyay18:33
*** armax has quit IRC18:34
*** armax_ is now known as armax18:34
*** azbiswas_ has quit IRC18:36
*** azbiswas has joined #openstack-neutron-ovn18:38
*** banix has quit IRC18:38
regXboiand it's now at patchworks - https://patchwork.ozlabs.org/patch/64601618:38
*** banix has joined #openstack-neutron-ovn18:38
*** chandrav has quit IRC18:41
openstackgerritMerged openstack/networking-ovn: Update OVN reference architecture documentation  https://review.openstack.org/31191818:46
russellbsleep 1 :-/18:48
* russellb wonders if there's any better way ...18:48
lrichardrussellb: I've done some experiments that show many of the sleeps make no difference (hundreds of iterations, wide range of loadavg, running tests in parallel, et.)18:52
russellblrichard: nice18:52
lrichardrussellb: I'd like to remove some, but first I'd like to see the tests work with the sleeps :)18:53
russellbmakes sense :)18:53
russellbyes, a stable starting point would be nice18:53
russellbregXboi: pushed to master18:55
russellbrtheis: address sets crash fix now in master18:55
regXboiwoot ... thx russellb18:55
rtheisrussellb: thank you18:56
*** armax_ has joined #openstack-neutron-ovn19:01
*** armax has quit IRC19:03
*** armax_ is now known as armax19:03
*** yamamoto has joined #openstack-neutron-ovn19:05
*** chandrav has joined #openstack-neutron-ovn19:06
*** yamamoto has quit IRC19:10
*** salv-orlando has quit IRC19:12
*** woodburn has quit IRC19:16
*** regXboi has quit IRC19:23
*** doonhammer has quit IRC19:29
*** regXboi has joined #openstack-neutron-ovn19:31
openstackgerritRussell Bryant proposed openstack/networking-ovn: faq: Update HA to reflect ovsdb replication.  https://review.openstack.org/33920119:35
*** doonhammer has joined #openstack-neutron-ovn19:39
*** zhouhan has quit IRC19:52
*** mickeys has quit IRC20:00
*** yamamoto has joined #openstack-neutron-ovn20:07
russellbany networking-ovn reviews that need priority?20:10
russellbi'm sure the answer is yes, but which one(s) heh20:10
*** yamamoto has quit IRC20:12
*** jckasper has quit IRC20:12
*** jckasper has joined #openstack-neutron-ovn20:13
*** mickeys has joined #openstack-neutron-ovn20:15
*** jckasper has quit IRC20:18
rtheisrussellb: There are several WIPs.  Hopefully, the address set one will be ready soon.  https://review.openstack.org/#/c/322488/ is getting close20:20
rtheisI haven't got back to looking at https://review.openstack.org/#/c/332434/20:20
rtheisAnd also https://review.openstack.org/#/c/335825/20:20
rtheisFYI: I'll be out starting tomorrow and through next week on vacation20:22
russellbnice, enjoy!20:23
*** doonhammer has quit IRC20:24
*** azbiswa__ has joined #openstack-neutron-ovn20:26
*** doonhammer has joined #openstack-neutron-ovn20:26
*** azbiswas has quit IRC20:27
rtheisthx20:28
*** banix has quit IRC20:32
*** azbiswa__ has quit IRC20:40
*** azbiswas has joined #openstack-neutron-ovn20:42
*** salv-orlando has joined #openstack-neutron-ovn20:44
*** salv-orlando has quit IRC20:46
*** salv-orlando has joined #openstack-neutron-ovn20:46
*** banix has joined #openstack-neutron-ovn20:48
*** azbiswas has quit IRC20:49
*** azbiswas has joined #openstack-neutron-ovn20:53
*** azbiswas has quit IRC21:05
*** azbiswas has joined #openstack-neutron-ovn21:06
openstackgerritRichard Theis proposed openstack/networking-ovn: WIP: Use OVN address set to implement remote security groups  https://review.openstack.org/31899521:08
*** yamamoto has joined #openstack-neutron-ovn21:09
russellbrtheis: fingers crossed for a pass this time?  :)21:09
rtheisregXboi: did a recheck and it passed21:09
rtheisI've updated the patch with some more unit tests21:09
russellbnice21:10
*** azbiswas has quit IRC21:14
*** yamamoto has quit IRC21:14
*** azbiswas has joined #openstack-neutron-ovn21:16
*** doonhammer has quit IRC21:19
*** azbiswas has quit IRC21:21
openstackgerritRamu Ramamurthy proposed openstack/networking-ovn: WIP - VM metadata access with native-dhcp  https://review.openstack.org/31530521:22
*** azbiswas has joined #openstack-neutron-ovn21:24
*** mamulsow has joined #openstack-neutron-ovn21:25
*** doonhammer has joined #openstack-neutron-ovn21:30
*** mickeys has quit IRC21:38
*** doonhammer has quit IRC21:38
*** regXboi has quit IRC21:41
*** azbiswas has quit IRC21:41
*** banix has quit IRC21:42
*** azbiswas has joined #openstack-neutron-ovn21:43
*** lrichard has quit IRC21:45
*** azbiswas_ has joined #openstack-neutron-ovn21:56
*** rtheis has quit IRC21:56
*** azbiswas has quit IRC21:58
*** mickeys has joined #openstack-neutron-ovn22:00
*** banix has joined #openstack-neutron-ovn22:04
*** jckasper has joined #openstack-neutron-ovn22:06
*** yamamoto has joined #openstack-neutron-ovn22:10
*** doonhammer has joined #openstack-neutron-ovn22:13
*** yamamoto has quit IRC22:16
openstackgerritRichard Theis proposed openstack/networking-ovn: WIP: Use OVN address set to implement remote security groups  https://review.openstack.org/31899522:16
*** salv-orlando has quit IRC22:30
*** salv-orlando has joined #openstack-neutron-ovn22:34
*** salv-orlando has quit IRC22:39
*** ramamurthy has quit IRC22:42
*** banix has quit IRC22:49
*** azbiswas_ has quit IRC22:59
*** azbiswas has joined #openstack-neutron-ovn23:00
*** salv-orlando has joined #openstack-neutron-ovn23:01
*** azbiswas has quit IRC23:04
*** salv-orlando has quit IRC23:09
*** yamamoto has joined #openstack-neutron-ovn23:12
*** yamamoto has quit IRC23:17
*** mickeys has quit IRC23:23
*** ramamurthy has joined #openstack-neutron-ovn23:25
*** lrichard has joined #openstack-neutron-ovn23:32
*** ramamurthy has quit IRC23:32
*** azbiswas has joined #openstack-neutron-ovn23:33
*** salv-orlando has joined #openstack-neutron-ovn23:35
*** azbiswas has quit IRC23:45
*** salv-orlando has quit IRC23:47
*** azbiswas has joined #openstack-neutron-ovn23:49
*** azbiswas has quit IRC23:58
*** chandrav has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!