Wednesday, 2017-03-08

*** bobmel has joined #openstack-net-bgpvpn00:01
*** bobmel has quit IRC00:06
*** bobmel has joined #openstack-net-bgpvpn02:02
*** bobmel has quit IRC02:07
*** bobmel has joined #openstack-net-bgpvpn04:03
*** bobmel has quit IRC04:07
*** bobmel has joined #openstack-net-bgpvpn06:04
*** bobmel has quit IRC06:09
*** bobmel has joined #openstack-net-bgpvpn06:22
*** bobmel has quit IRC06:27
*** bobmel has joined #openstack-net-bgpvpn06:43
*** bobmel_ has joined #openstack-net-bgpvpn06:46
*** bobmel_ has quit IRC06:48
*** bobmel has quit IRC06:49
*** bobmel has joined #openstack-net-bgpvpn06:50
*** bobmel_ has joined #openstack-net-bgpvpn07:00
*** bobmel has quit IRC07:02
*** matrohon has joined #openstack-net-bgpvpn07:51
*** tmorin has joined #openstack-net-bgpvpn08:01
*** tmorin has quit IRC08:13
*** openstackgerrit has quit IRC09:03
*** mickeys has quit IRC09:14
*** tmorin has joined #openstack-net-bgpvpn10:00
*** openstackgerrit has joined #openstack-net-bgpvpn10:01
openstackgerritThomas Morin proposed openstack/networking-bgpvpn master: bagpipe driver: cleanup, remove OVSInterceptBridge  https://review.openstack.org/42593310:01
*** mickeys has joined #openstack-net-bgpvpn10:15
*** mickeys has quit IRC10:19
*** mickeys has joined #openstack-net-bgpvpn11:16
*** mickeys has quit IRC11:20
*** matrohon has quit IRC11:25
*** bobmel_ has quit IRC11:27
*** mickeys has joined #openstack-net-bgpvpn12:16
*** mickeys has quit IRC12:21
*** matrohon has joined #openstack-net-bgpvpn13:33
pcarvervks1: hi. are you still around?13:52
*** mickeys has joined #openstack-net-bgpvpn14:00
*** mickeys has quit IRC14:04
pcarvertmorin: got a few minutes?14:09
tmorinhi Paul14:09
tmorinyes I do14:09
pcarverI've finally got some time free of meetings and I'm tackling this change to use the API definition from neutron-lib14:10
pcarverI'm looking for suggestions on the best way to start troubleshooting.14:10
pcarverspecifically whether I should start in with a debugger or if there are easier things to try first14:10
pcarverThe py27 tox results are not especially helpful14:11
pcarverI have Devstack running with my modified bgpvpn code and commands like neutron net-list work but neutron bgpvpn-list fails with a not very useful output14:12
tmorinpcarver: I need to know your starting point14:12
tmorinok14:12
tmorinwhat I would first do is run "tox -epy27"14:12
tmorinthen dig into each failing test14:12
tmorinto dig, one thing I have found useful is the following:14:12
tmorina) go into the py27 venv:   source .tox/py27/bin/activate14:13
pcarverAll the tests are failing with what looks like a fairly generic server error14:13
tmorinb) run: python -m unittest -v full.path.to.test_which_is_failing14:14
pcarverI tried activating the py27 env and running ipython and importing my modified .py file but I wasn't sure if I was heading down a useful path14:14
tmorinwhat is the issue you get ?14:14
tmorinpcarver: it could help detecting some basic errors, but other errors may not be14:14
tmorin.. may not be detected by just importing the file14:14
pcarverso first off, running "neutron bgpvpn-list" with a running devstack gives "The resource could not be found.<br /><br />"14:14
pcarverI'm re-running py27 now so I can copy and paste the error message to you. I've forgotten the exact wording I was seeing yesterday.14:15
pcarverBTW, how long does py27 take for you? They just migrated me to a new laptop and running in VirtualBox with four vCPUs still seems to me to take a long time. This new machine should be pretty decent.14:17
pcarverIt's a Core i7 at 2.7GHz with 32GB RAM and an SSD and I've given the Devstack VM 8GB. I haven't timed py27 but it sure seems to take a long time.14:19
* tmorin running tox -ep27 to give pcarver a timing...14:19
pcarverThe run right now is probably extra slow because I deleted .tox again just to make sure I wasn't getting tripped up by that14:19
pcarveroh, this is different than what I was seeing yesterday. Yesterday I was seeing a bunch of successful tests and a bunch of failed tests with all the failures looking like pretty much the same error about a server response14:21
pcarverToday after deleting .tox I'm seeing something different. I'll post a paste14:21
tmorinyes, the longest part of the run is cloning the neutron repo....14:22
*** malos has joined #openstack-net-bgpvpn14:22
pcarverhttp://paste.openstack.org/show/601943/14:23
pcarverI'm going to checkout master and re-run to make sure I'm still getting success on master14:23
pcarverok, now I'm seeing approximately the same error shown in that paste when I run py27 with a checkout of master for networking-bgpvpn. I was getting success yesterday.14:25
tmorinI know the reason for this error:  ImportError: cannot import name context14:27
tmorinyou need a recent master of net-bgpvpn that has a change required to follow a change in neutron master14:28
tmorin(was merged two days ago : https://review.openstack.org/#/c/422266/ )14:28
pcarverok, so I should pull master and then rebase my change on top of it?14:29
tmorinyep14:33
pcarvertmorin: ok, after rebasing py27 works on master again. The not very helpful message on all of the failing bgpvpn test cases on my modified branch is "webob.exc.HTTPClientError: The server could not comply with the request since it is either malformed or otherwise incorrect."14:45
pcarverso I assume I've got some fairly basic mistake that is just preventing the bgpvpn code from running14:45
tmorinthen I would run a single test in the venv with "python -m unittest -v full.path.to.test_which_is_failing"14:46
pcarverand so my question is, are there any easy things I should check before I start using a debugger to step through14:46
tmorinthe above ^14:46
tmorinbecause it may let you see error messages that tox is eating14:46
pcarverok, I'll try that14:47
pcarvertmorin: I've got to go deal with someone else right now, but there seems to be something related to BaGPipe that I'll need to figure out.14:51
pcarverI get this error from tox on my branch of networking-bgpvpn "Could not load networking_bgpvpn.neutron.services.service_drivers.bagpipe.bagpipe.BaGPipeBGPVPNDriver"14:51
tmorinyou should be able to get a more detailed error log14:51
pcarverno, I take it back. I get that same error on master but the test passes14:51
tmorinwhich test is giving that ??14:52
pcarverI'll continue after I finish with this other person. The test I selected (at random out of the failing ones) is networking_bgpvpn.tests.unit.services.test_plugin.TestBGPVPNServicePlugin.test_bgpvpn_router_assoc_create14:52
tmorinseems fishy...14:52
tmorinand does python -m unittest -v ... gives you a more detailed log ?14:53
tmorinok14:53
tmoringo ahead with the other person, I can also do things in parallel :)14:53
pcarverhttp://paste.openstack.org/show/601950/14:53
*** matrohon has quit IRC15:23
*** matrohon has joined #openstack-net-bgpvpn15:42
tmorinhmm.. harder to investigate indeed15:51
tmorinI guess the API validation framework in neutron is failing to validate the bgpvpn creation, but the error is not reported to us ...15:52
openstackgerritMerged openstack/networking-bgpvpn master: Switch to use stable data_utils  https://review.openstack.org/44277616:12
*** mickeys has joined #openstack-net-bgpvpn17:11
*** tmorin has quit IRC17:14
pcarvertmorin: This is very puzzling. I've been poking around in a debugger and everything looks quite reasonable in networking_bgpvpn/neutron/extensions/bgpvpn.py17:44
pcarverI think the next thing I'm going to do is back out my changes and add them a few at a time to see if I can isolate something specific that triggers the failures.17:46
*** matrohon has quit IRC18:03
*** mickeys has quit IRC23:13

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!