Thursday, 2014-03-20

kevinbentonmarun: ready https://review.openstack.org/#/c/80413/00:01
*** julim has quit IRC00:03
marunkevinbenton: ok00:04
openstackgerritEvgeny Fedoruk proposed a change to openstack/neutron: Add 2-leg configuration to Radware LBaaS Driver  https://review.openstack.org/6900900:04
*** ijw has joined #openstack-neutron00:05
*** julim has joined #openstack-neutron00:05
kfox1111so, neutron-server is stuck, but its not doing anything with mysql...00:15
*** hogepodge has quit IRC00:15
kevinbentonkfox1111: is it logging anything?00:16
kfox1111no. I don't have debug level logging turned on though.00:18
kfox1111Would the message its choking on still be in the qpid queue or does it take it off before doing it?00:20
*** ijw has quit IRC00:21
*** zhipeng has quit IRC00:21
*** suresh12 has quit IRC00:21
kevinbentonkfox1111: i think it will have taken it off00:21
kevinbentonkfox1111: what operation were you doing when it happened?00:22
kfox1111hmm... thats why it probably recovers right after being restarted...00:22
*** zhipeng has joined #openstack-neutron00:22
kfox1111no clue. big enough cloud that lots of things are happening.00:22
kfox1111Its happening randomly between once and 3 times a day now. :/00:22
kevinbentonkfox1111: hmmm. is it the reference plugin?00:22
kfox1111core_plugin = neutron.plugins.linuxbridge.lb_neutron_plugin.LinuxBridgePluginV200:23
kfox1111rpc_backend = neutron.openstack.common.rpc.impl_qpid00:23
kfox1111havana from rdo.00:23
*** ijw has joined #openstack-neutron00:23
*** hogepodge has joined #openstack-neutron00:24
kevinbentonis turning on debugging an option? it sounds like something is causing a deadlock00:24
kevinbentonit would be useful to have the log of what it was doing last when it froze up00:25
*** hogepodge has quit IRC00:25
*** baoli has quit IRC00:25
kfox1111yeah. I will probably turn up the logs tomorrow morning. :/00:25
*** baoli has joined #openstack-neutron00:26
*** thuc has quit IRC00:26
kevinbentonkfox1111: sorry i couldn't be of more help without it. a few to many unknowns00:26
*** thuc has joined #openstack-neutron00:26
kfox1111hmm... and now the linuxbridge agent has 72.6k messages stuck in its queue. :/00:26
*** xianghui has joined #openstack-neutron00:26
kevinbentonis it slowly draining them?00:27
*** BuSerD has quit IRC00:27
kfox1111nope. stuck.00:27
kevinbentonwhat message is at the head of the queue?00:27
kfox1111ok. just restarted it... seems happier now...00:27
kfox1111gota recreate my stacks now. :/00:28
kevinbentoni wonder if there is some malformed message that blocks up the queue processor00:28
*** suresh12 has joined #openstack-neutron00:28
*** matsuhashi has joined #openstack-neutron00:29
kfox1111could be. I straced the neutron-server process but it seemed to be pretty idle.00:29
*** zhipeng has quit IRC00:30
marunkevinbenton: fyi the change is being bumped to 2nd in the queue00:30
kevinbentonmarun: awesome. like a fast-pass at six flags.... only for a patch00:31
*** thuc has quit IRC00:31
kevinbentonkfox1111: well once you get some debug logs, feel free to ping me tomorrow00:31
*** ijw has quit IRC00:31
kfox1111k. thanks.00:32
kfox1111hmm.. the bridge agent queue seems to be filling up again...00:32
kfox1111I'm seeing lots of:00:32
kfox11112014-03-19 17:32:36.401 41084 INFO neutron.agent.securitygroups_rpc [-] Refresh firewall rules00:32
kfox1111in the logs.00:32
*** manishg has quit IRC00:33
kfox1111I'm seeing it drail a little and add more. slowly increasing. :/00:34
kfox1111327...00:34
kfox1111335...00:34
*** salv-orlando has joined #openstack-neutron00:35
kfox1111357...00:35
kfox1111This seems to be a problem. Is there a way to tell where the messages came from?00:35
kfox1111I'm guessing they are a ll firewall refresh maybe.00:35
*** ijw has joined #openstack-neutron00:35
kevinbentoni don't think you should be getting that many messages to refresh the firewall unless a port change occurs or security group change occurs00:36
kfox1111yeah, I don't think there are too many of those... But it looks like its trying over and over to refresh, and getting backlogged.00:37
*** dguitarbite_ has quit IRC00:38
kfox1111536. 534.. 541...00:38
kevinbentonkfox1111: is there an easy way to look at the current messages in the queues?00:38
kevinbentonwith quid?00:39
kevinbentonqpid*00:39
kfox1111not sure....00:39
*** dguitarbite has joined #openstack-neutron00:40
kevinbentonkfox1111: i have to head out. i'll be back around tomorrow00:41
kfox1111k. me too. thanks for the help.00:41
*** suresh12 has quit IRC00:42
*** devlaps has quit IRC00:47
*** suresh12 has joined #openstack-neutron00:47
*** yamahata has joined #openstack-neutron00:48
*** kfox1111 has quit IRC00:50
*** ijw has quit IRC00:52
*** ijw has joined #openstack-neutron00:52
*** ijw_ has joined #openstack-neutron00:55
salv-orlandomarun: you still around?00:56
salv-orlandoSo I've looked you amended the patch for the semaphore to accommodate rkukura complains about that patch interfering with his work… but does moving the semaphore within a function called by get_device_details solve the problem?00:57
*** ijw has quit IRC00:57
salv-orlandokevinbenton: you've updated the patch but not the commit message. Now we have a commit message that does something and a patch that does something else...00:58
salv-orlandoand most importantly something I forgot to ask earlier… why does get_device_details update a port a status??????00:59
marunsalv-orlando: I was asking the same thing… it feels wrong and and rkukura is proposing to do yet more of that (wrt binding)00:59
salv-orlandoyeah I don't want to comment on that work before I see the code however01:00
salv-orlandoI don't think we have a spec or whatever to discuss01:00
marunsalv-orlando: my fault on not forcing an update to the commit message.01:00
marunsalv-orlando: do you want to stop the gate?01:01
salv-orlandomarun… if we can get kevinbenton to do that we can both reapprove01:01
kevinbentonsalv-orlando: i can update it01:01
marunsalv-orlando: we pushed it to the top of the queue so it might be running already01:01
*** armax has left #openstack-neutron01:01
*** alagalah has quit IRC01:02
salv-orlandowell, just remember to not go back to that change and say "WTF" when you see the change does not do what the commit message says01:02
marunsalv-orlando: it was bob's comment that prompted moving the lock inside the method, so that it wouldn't be held indefinitely in the case of the change he's working on.01:02
marunsalv-orlando: yeah, I need to be nicer about wtf's in general :(01:02
marunit'll bite me in the a** at some point01:02
salv-orlandomarun: I'd rather get a genuine wtf rather than a fake "thanks for submitting this"01:03
marunsalv-orlando: so, do you want to stop the gate?01:03
salv-orlandoanyway… a change which alters again binding behaviour in ml2, and promotes a loop in get_device_details as suggested by bob at first glance sounds like something we should not merge so late in the release cycle.01:03
kevinbentonactually, what will happen if i update the commit message now? infra recognizes a trivial update01:03
salv-orlandokevinbenton: the patch will be bounced anyway out of the gate01:04
marunsalv-orlando: I would tend to agree.01:04
salv-orlandomarun: anyway, nothing can be said so far… I guess01:04
kevinbentonsalv-orlando: shall i do it for the sanctity of good commit messages?01:04
marunsalv-orlando: if we don't have a spec or patch in review by now, i don't know how it could possibly go into icehouse01:04
marunkevinbenton: *sigh* I guess yeah, do it.01:05
salv-orlandokevinbenton: it's not pedantry it's just that some developers like me look at commit message history to understand what's going on01:05
salv-orlandowe can get infra people to re-promote it to the top of the gate queue01:05
salv-orlandoor who know zuul might be so kind to keep in the top01:05
marunkevinbenton: my only relunctance is that it was my lack of care that approved it and i'll have to admit as much to ingra01:05
kevinbentonsalv-orlando: i didn't say it was pedantry :-)01:05
marunkevinbenton: so, do it.01:05
*** leseb has joined #openstack-neutron01:05
marun(arg, need to take a break, spalling errers everiwhare01:06
salv-orlandomarun: but at the end of the day, did you figured out why get_device_details updates the port status?01:06
marunsalv-orlando: no01:07
marunsalv-orlando: I was complaining to rkukura that modifying things in something that looks like an accessor violates a fundamental tenant of oo design01:07
marunsalv-orlando: but that conversation never came to a resolution01:07
salv-orlandomarun: is that really a need for a resolution?01:08
marunsalv-orlando: instead i asked him to ensure that I was a reviewer on his new patch01:08
marunsalv-orlando: well, I mean that the conversation was derailed about just getting something working.01:09
salv-orlandomarun: I also wondered how moving the lock into a method called by get_device_details rather than in get_device_details itself would solve the problem he had with semaphore not allowing his patch to work. But I guess we need to wait and see.01:09
*** leseb has quit IRC01:10
openstackgerritKevin Benton proposed a change to openstack/neutron: Add a semaphore to some ML2 operations  https://review.openstack.org/8041301:10
kevinbentonsalv-orlando: so i think he was concerned that get_device_details could have long calls in it depending on the drivers or something along those lines01:11
kevinbentonsalv-orlando: so he wanted to avoid getting the semaphore until as late as possible01:11
marunsalv-orlando: so, updated patch submitted.01:11
salv-orlandothanks01:11
marunsalv-orlando: do you want to re-approve or are you sufficiently concerned that you don't want it to merge as is?01:12
salv-orlandomarun, kevinbenton - I've give my +201:12
marunsalv-orlando: ok.01:12
marunsalv-orlando: we can always reverse if needed.01:12
salv-orlandoI went over the code and get_device_details should not hit the DB lock until the semaphore is hit01:12
*** _cjones_ has quit IRC01:13
salv-orlandowhen the semaphore is hit, it should yield again, and then it should eventually allow delete_port to complete and release the lock01:13
kevinbentonsalv-orlando: yes, if it can't get the sem, it will yield01:14
marunsalv-orlando: am I supposed to wait until checks pass before I approved or does that happen automatically now?01:14
kevinbentonsalv-orlando: i believe that's automatic. gate won't start until checks pass01:15
salv-orlandomarun: you should wait for checks or tell infra we've just updated the commit message so they won't yell at you01:15
salv-orlandothe funny thing is that delete_port is doing select .. for update before deleting in order to avoid postgres errors with read committed isolation levels01:15
marunsalv-orlando: ok, i should unapprove then?01:15
salv-orlandomarun: even if you approved as kevinbenton said, it's now going to the check queue anyway01:15
marunthat's an unfortunate kind of funnhy01:15
marunsalv-orlando: Can I leave it to you to get infra to push it to the top of queue when the checks pass?01:16
salv-orlandomarun: I would love to but it's 1.20 AM my time and this might be slip in the morning01:17
marunsalv-orlando: ah, ok.01:17
marunsalv-orlando: I'll keep responsibility then.01:17
salv-orlandook thanks01:17
salv-orlandoanyway, we basically have a situation where we either screw postgres or mysql. Something not right somewhere ;)01:17
kevinbentonmarun: i can tell them when it's ready if you want since i watch the jenkins notifications01:17
marunkevinbenton: much appreciated01:18
marunsalv-orlando: I've been slowly trying to educate myself about these locking/isolation issues.  I'm finding it a slog.01:18
marunsalv-orlando: and eventlet is not helping01:19
marunsalv-orlando: talking with comstud about the issue at length I'm going to work on a transaction wrapper that can detect when a yield is happening so that we can track them down.01:19
marunsalv-orlando: It's unlikely that this type of problem won't recur in different places in the future.01:20
salv-orlandomarun: sure I already know about 3 more places01:20
salv-orlandomarun: one is the place you fixed01:20
salv-orlandoanother is update vips01:20
marunsalv-orlando: ah right, the vips01:20
marunsalv-orlando: I was seeing that in the logstash query01:21
jaypipessbalukoff: done with your audit, eh? ;)01:21
salv-orlandoand the last one is written on a piece of paper I have in my bag, and I don't remember now01:21
kevinbentonsalv-orlando: create_port ....01:21
salv-orlandomarun: interestingly they're unlikely to be critical01:21
salv-orlandonope kevinbenton, it shows up during a SELECT on ports01:21
salv-orlandobut if you've seen them in create_port too01:21
salv-orlandothat's another place to look for01:21
marunsalv-orlando: anything that touches ports can be affected by a SELECT FOR UPDATE01:22
salv-orlandomarun: still we don't want lock wait timeouts ever01:22
marunsalv-orlando: preventing yields should hold us until we have a better solution01:22
marunsalv-orlando: from what i hear asyncio holds promise for python3, and there is a backport to python201:22
marunsalv-orlando: it would require a rewrite, though.01:22
salv-orlandomarun: right. At the end of the day it's not a db programming problem. It's an eventlet issue.01:23
kevinbentonsalv-orlando: in create_port the deadlock is on ip allocation01:23
marunsalv-orlando: it's explicit, not implicit.01:23
salv-orlandokevinbenton: marun sorted that out because it was deadlock between allocate ip and deallocate ip01:23
kevinbentonsalv-orlando: see http://paste.openstack.org/show/68417/01:23
marunsalv-orlando: agreed01:23
kevinbentonsalv-orlando: oh okay01:23
salv-orlandokevinbenton: well… unless they keep showing up of course01:24
salv-orlandomarun: so replacing eventlet should be on the agenda, but it does not just depend on neutron alone.01:24
marunkevinbenton: that is from feb 21.01:24
kevinbentonsalv-orlando: that's an old one from the bug report so it could be fixed01:24
salv-orlandoI think oslo.rpc too should move way01:24
marunsalv-orlando: agreed01:24
salv-orlandoand the wsgi framework01:24
marunkevinbenton: https://review.openstack.org/#/c/81196/01:25
marunkevinbenton: that merged today, should fix that contention due to removal of SELECT FOR UPDATE on IPAllocation01:25
kevinbentonmarun: excellent01:25
marunsalv-orlando: I hope there's discussion at the summit about this.01:26
kevinbentonmarun: that would be good i think01:27
marunsalv-orlando: I think asyncio would be a lot of work, but it would provide forward-looking compatibility for python3 and a switch to explicit concurrency would go a long way towards preventing people from doing silly things.01:27
salv-orlandoI actually hope the discussion happens before the summit, so that people will be able to assign actionable items ther01:27
salv-orlandoe01:27
kevinbentonit's not very intuitive what causes the problem01:27
marunsalv-orlando: agreed01:27
*** networkstatic has quit IRC01:27
*** alexpilotti_ has joined #openstack-neutron01:28
HenryGsalv-orlando: sorry to interrupt, question regarding https://review.openstack.org/4029601:28
HenryGI have rebased and am testing01:28
salv-orlandoHenryG: listening01:28
HenryGGetting a lot of "OperationalError: no such table"01:29
salv-orlandomarun: are already aware of this: https://www.mail-archive.com/openstack-dev@lists.openstack.org/msg15979.html ?01:29
HenryGHow should the unit tests be loading the db/tables now?01:29
salv-orlandoHenryG: I think… if my memory does not fail me...01:30
*** alexpilotti has quit IRC01:30
*** alexpilotti_ is now known as alexpilotti01:30
salv-orlandothat they should be now inheriting from this class: https://review.openstack.org/#/c/40296/6/neutron/tests/unit/testlib_api.py01:30
salv-orlandoSqlTestCase01:30
HenryGsalv-orlando: thanks, will look into that01:31
salv-orlandoand if they call register_models, they should not do that anymore01:31
marunsalv-orlando: hmmm,  couldn't we use transactions to empty the tables rather than dropping/creating on every test?01:32
*** alagalah has joined #openstack-neutron01:32
*** samuelbercovici has quit IRC01:32
*** jobewan has joined #openstack-neutron01:33
marunsalv-orlando: also, iirc, we're not using in-memory db for unit tests01:34
marunsalv-orlando: or maybe I've missed something.01:34
marunsalv-orlando: where is the db url defined for the tests?01:34
marunsalv-orlando: is it in tests/etc/ ?01:34
*** sbalukoff has quit IRC01:34
salv-orlandomarun, it used to use 'sqlite://' but honestly I have not looked at that in ages01:35
salv-orlandowe had initially code that emptied tables, I don't remember why it got changed01:35
salv-orlandoI do apologise, but I'm going to disconnect now01:35
HenryGIt is still 'sqlite://', in neutron/tests/etc/neutron.conf.test01:35
salv-orlandogood night ;)01:35
*** salv-orlando has quit IRC01:35
HenryGsalv-orlando: you shouldn't be up at this hour anyway01:36
marunHenryG: sqlite:// is not in memory, btw01:36
marunHenryG: that would be sqlite:///:memory:01:37
*** thuc has joined #openstack-neutron01:37
HenryGmarun: I understand, I was just confirming the current status of things01:37
marunHenryG: ah, sorry01:37
openstackgerritLee Li proposed a change to openstack/neutron: NsxApiException should return str  https://review.openstack.org/8168501:38
*** xuhanp has joined #openstack-neutron01:39
HenryGmarun: Items to add to your refactor etherpad: empty tables by transactions; use in-memory DB ?01:39
*** SumitNaiksatam has quit IRC01:39
*** xianghui has quit IRC01:39
*** xianghui has joined #openstack-neutron01:39
marunHenryG: I think the former is worth doing, but the latter I'm not sure about.01:39
marunHenryG: I think switching from in-memory db was due to memory issues caused by it.01:39
marunHenryG: On second thought, it should be there so that we can at least investigate.01:40
marunHenryG: I'm afraid I have little progress beyond getting the functional job fixed.01:40
marunHenryG: working on bugs has seemed more important, but that's a rational that could keep me from doing anything else!01:40
*** alagalah has quit IRC01:41
HenryGmarun: np. I am also caught up in bugs right now.01:41
*** thuc has quit IRC01:42
marunHenryG: thanks for the pointers, I've updated the etherpad.01:42
HenryGmarun: But I will start asking annoying questions sooner or later :)01:42
HenryGYesterday I set up floobits. A pretty cool thingy.01:43
*** zhipeng has joined #openstack-neutron01:43
*** alexpilotti has quit IRC01:44
*** dvorkinista has quit IRC01:44
marunHenryG: I'm going to try to do a walkthrough for a bunch of folks at once using floobits.01:44
marunHenryG: want to try out the terminal sharing for that01:45
marunHenryG: I'm hoping it will prove better that screen sharing for tiny text.01:45
HenryGmarun: sounds like a good idea. Let me know if you need a guinea pig01:46
*** sfox has joined #openstack-neutron01:46
marunHenryG: the cool thing about floobits is you can be the guinea pig yourself..01:46
marunlog in via 2 different browsers, or a browser and an editor, viola!01:47
marunHenryG: when you find yourself wanting to work on code, though, i'm happy to make time.01:47
HenryGmarun: Great, thanks. The first thing I want to understand is your retargetable api test. Although, I guess maybe step back and get an overview of the concept and goals first.01:50
*** ijw_ has quit IRC01:51
*** manishg has joined #openstack-neutron01:53
*** chandan_kumar has joined #openstack-neutron01:53
*** manishg_ has joined #openstack-neutron01:56
*** manishg has quit IRC01:58
*** shakamunyi has joined #openstack-neutron02:00
marunwould you like to schedule a time?02:01
*** manishg_ has quit IRC02:02
marunHenryG: ^02:03
* HenryG looks at his schedule ...02:04
*** ijw has joined #openstack-neutron02:04
HenryGmarun: tomorrow is a bit full until about 4:30 pm eastern. Friday is wide open.02:07
marunHenryG: Friday works better for me too02:08
marunHenryG: I can be available between noon and 2:30 eastern02:09
HenryGmarun: great, let's do 1:00 eastern02:09
marunHenryG: Ok, sounds good.02:10
*** ijw has quit IRC02:11
*** thuc has joined #openstack-neutron02:12
*** alagalah has joined #openstack-neutron02:12
*** alagalah has quit IRC02:17
*** SumitNaiksatam has joined #openstack-neutron02:22
*** thuc_ has joined #openstack-neutron02:25
*** dvorkinista has joined #openstack-neutron02:25
*** thuc has quit IRC02:28
openstackgerritjun xie proposed a change to openstack/neutron: Use different name for the same constraint  https://review.openstack.org/8148802:29
*** thuc_ has quit IRC02:31
*** thuc has joined #openstack-neutron02:32
*** banix has joined #openstack-neutron02:33
openstackgerritA change was merged to openstack/neutron: Show neutron API request body with debug enabled  https://review.openstack.org/8110902:34
*** networkstatic has joined #openstack-neutron02:34
*** networkstatic has quit IRC02:35
*** mwagner__ is now known as mwagner__zzzz02:37
*** sfox has quit IRC02:40
*** dvorkinista has quit IRC02:45
openstackgerritIsaku Yamahata proposed a change to openstack/neutron: tests/unit: refactor reading neutron.conf.test  https://review.openstack.org/7641802:48
openstackgerritIsaku Yamahata proposed a change to openstack/neutron: tests/unit: clean up notification driver  https://review.openstack.org/7613902:48
*** dvorkinista has joined #openstack-neutron02:48
*** tomoe_ has joined #openstack-neutron02:50
*** dvorkinista has quit IRC02:51
*** dvorkinista has joined #openstack-neutron02:53
*** dvorkinista has quit IRC02:54
*** suresh12 has quit IRC02:54
*** thuc has quit IRC02:59
*** thuc has joined #openstack-neutron03:00
*** tomoe_ has quit IRC03:00
*** thuc has quit IRC03:04
*** xianghui has quit IRC03:04
*** tomoe_ has joined #openstack-neutron03:05
*** sfox has joined #openstack-neutron03:18
*** chandan_kumar has quit IRC03:22
*** harlowja is now known as harlowja_away03:23
*** thuc has joined #openstack-neutron03:24
*** dvorkinista has joined #openstack-neutron03:25
*** sbalukoff has joined #openstack-neutron03:26
*** dvorkinista has quit IRC03:27
*** dvorkinista has joined #openstack-neutron03:28
*** tomoe_ has quit IRC03:29
*** jecarey has joined #openstack-neutron03:30
*** dvorkinista has quit IRC03:33
openstackgerritHenry Gessau proposed a change to openstack/neutron: Remove auto-generation of db schema from models at startup  https://review.openstack.org/4029603:45
*** matsuhashi has quit IRC03:47
openstackgerritHenry Gessau proposed a change to openstack/neutron: Remove auto-generation of db schema from models at startup  https://review.openstack.org/4029603:57
*** arosen1 has quit IRC04:02
*** tomoe_ has joined #openstack-neutron04:08
*** saju_m has joined #openstack-neutron04:12
*** banix has quit IRC04:12
*** Akshik has joined #openstack-neutron04:12
*** tomoe_ has quit IRC04:19
*** tomoe_ has joined #openstack-neutron04:19
*** thuc has quit IRC04:20
*** thuc has joined #openstack-neutron04:21
*** sweston has joined #openstack-neutron04:21
*** tomoe_ has quit IRC04:24
*** thuc has quit IRC04:25
*** matsuhashi has joined #openstack-neutron04:31
openstackgerritYuuichi Fujioka proposed a change to openstack/neutron: change to allow setting ip address of floating ip  https://review.openstack.org/7028604:36
openstackgerritA change was merged to openstack/neutron: Imported Translations from Transifex  https://review.openstack.org/8118504:38
openstackgerritA change was merged to openstack/neutron: Change report_interval from 4 to 30, agent_down_time from 9 to 75  https://review.openstack.org/8082904:39
*** yfujioka has joined #openstack-neutron04:40
*** thuc has joined #openstack-neutron04:41
*** thuc has quit IRC04:49
*** xianghui has joined #openstack-neutron04:49
openstackgerritHenry Gessau proposed a change to openstack/neutron: Remove auto-generation of db schema from models at startup  https://review.openstack.org/4029604:52
*** Akshik_ has joined #openstack-neutron04:56
*** Akshik has quit IRC05:00
*** yfujioka has quit IRC05:02
*** carl_baldwin has joined #openstack-neutron05:08
*** chandan_kumar has joined #openstack-neutron05:10
*** suresh12 has joined #openstack-neutron05:11
*** carl_baldwin has quit IRC05:17
*** chandan_kumar has quit IRC05:17
*** sridhar has joined #openstack-neutron05:17
*** yongli has joined #openstack-neutron05:19
openstackgerritA change was merged to openstack/neutron: Don't use root to list namespaces  https://review.openstack.org/8109805:20
*** pradipta_away is now known as pradipta05:25
*** amotoki has joined #openstack-neutron05:29
*** tomoe_ has joined #openstack-neutron05:31
oda-gamotoki: ping05:31
*** tomoe_ has joined #openstack-neutron05:32
*** vkozhukalov_ has joined #openstack-neutron05:33
*** tomoe_ has quit IRC05:41
amotokioda-g: pong05:42
oda-gamotoki: Would you have a look at https://review.openstack.org/#/c/79858/ ? I clarified the coverage of the patch in the commit message.05:42
amotokioda-g: will look it later. I am now discussing in another channel.05:44
oda-gamotoki: I see.05:44
*** irenab has joined #openstack-neutron05:46
*** gdubreui has quit IRC05:47
*** tomoe_ has joined #openstack-neutron05:56
*** thuc has joined #openstack-neutron05:57
*** networkstatic has joined #openstack-neutron05:57
*** thuc has quit IRC06:02
*** saju_m has quit IRC06:02
*** nati_ueno has joined #openstack-neutron06:03
*** saju_m has joined #openstack-neutron06:04
oda-gnati_ueno: ping06:04
openstackgerritKevin Benton proposed a change to openstack/neutron: Add decorator to prevent eventlet from yielding  https://review.openstack.org/8170906:04
*** saju_m has quit IRC06:07
*** saju_m has joined #openstack-neutron06:08
nati_uenooda-g: pong06:09
oda-gnati_ueno: Would you approve https://review.openstack.org/#/c/79858/ again ? I fixed the commit message to clarify the coverage of the patch that is pointed out from Motoki-san.06:10
nati_uenooda-g: let me check06:10
*** tomoe_ has quit IRC06:13
*** jlibosva has joined #openstack-neutron06:18
*** vkozhukalov_ has quit IRC06:19
openstackgerritKevin Benton proposed a change to openstack/neutron: Add decorator to prevent eventlet from yielding  https://review.openstack.org/8170906:20
*** sridhar has quit IRC06:23
*** sfox has quit IRC06:27
openstackgerritJenkins proposed a change to openstack/neutron: Imported Translations from Transifex  https://review.openstack.org/8171306:28
*** matsuhashi has quit IRC06:28
*** matsuhashi has joined #openstack-neutron06:30
*** tomoe_ has joined #openstack-neutron06:32
*** saju_m has quit IRC06:35
*** networkstatic has quit IRC06:35
*** sfox has joined #openstack-neutron06:35
*** sridhar has joined #openstack-neutron06:41
*** irenab has quit IRC06:43
obondarevamotoki: ping06:47
openstackgerritberlin proposed a change to openstack/neutron: Fix duplicate name of NVP LBaaS objs not allowed on vShield Edge  https://review.openstack.org/7390506:50
openstackgerritNachi Ueno proposed a change to openstack/neutron: Add enable_security_group option  https://review.openstack.org/6728106:50
*** nati_ueno has quit IRC06:51
*** suresh12 has quit IRC06:58
*** bvandenh has joined #openstack-neutron06:59
*** oda-g has quit IRC07:00
*** sweston has quit IRC07:02
*** bashok has joined #openstack-neutron07:06
*** bvandenh has quit IRC07:07
*** tomoe_ has quit IRC07:11
*** jlibosva has joined #openstack-neutron07:12
*** tomoe_ has joined #openstack-neutron07:12
*** shakamunyi has quit IRC07:15
*** jlibosva has quit IRC07:16
*** Akshik_ has quit IRC07:19
*** Akshik_ has joined #openstack-neutron07:19
*** Akshik has joined #openstack-neutron07:22
*** Akshik_ has quit IRC07:22
*** rotbeard has joined #openstack-neutron07:23
*** arosen1 has joined #openstack-neutron07:25
*** lukego has joined #openstack-neutron07:27
*** sfox has quit IRC07:29
*** bvandenh has joined #openstack-neutron07:29
*** zhipeng has quit IRC07:36
*** jobewan has quit IRC07:38
*** nati_ueno has joined #openstack-neutron07:39
*** shakamunyi has joined #openstack-neutron07:41
*** arosen1 has quit IRC07:41
*** zhipeng has joined #openstack-neutron07:43
*** jlibosva has joined #openstack-neutron07:43
*** ramishra has joined #openstack-neutron07:43
*** leseb has joined #openstack-neutron07:44
*** skraynev_afk is now known as skraynev07:45
*** shakamunyi has quit IRC07:45
*** irenab has joined #openstack-neutron07:46
*** vkozhukalov_ has joined #openstack-neutron07:49
*** mrsnivvel has joined #openstack-neutron07:51
*** leseb has quit IRC07:52
*** Jabadia has joined #openstack-neutron07:53
*** saju_m has joined #openstack-neutron07:56
*** arosen1 has joined #openstack-neutron08:01
*** irenab has quit IRC08:01
*** Jabadia has quit IRC08:05
*** suresh12 has joined #openstack-neutron08:08
*** Jabadia has joined #openstack-neutron08:10
*** suresh12 has quit IRC08:12
*** ajo has joined #openstack-neutron08:13
*** Jabadia has quit IRC08:20
*** Jabadia has joined #openstack-neutron08:21
*** Akshik_ has joined #openstack-neutron08:25
*** jgallard has joined #openstack-neutron08:28
*** Akshik has quit IRC08:29
*** jgallard has quit IRC08:33
*** jgallard has joined #openstack-neutron08:33
*** zhipeng has quit IRC08:34
*** SumitNaiksatam has quit IRC08:35
*** shakamunyi has joined #openstack-neutron08:42
*** shakamunyi has quit IRC08:46
*** nati_ueno has quit IRC08:47
*** ygbo has joined #openstack-neutron08:48
*** Akshik_ has quit IRC08:48
*** morganfainberg is now known as morganfainberg_Z08:54
*** ihrachys|afk is now known as ihrachys08:57
*** leseb has joined #openstack-neutron08:58
*** nati_ueno has joined #openstack-neutron08:58
*** nati_uen_ has joined #openstack-neutron08:59
*** bada_ has quit IRC08:59
*** bada_ has joined #openstack-neutron09:00
*** nati_ueno has quit IRC09:03
*** dguitarbite has quit IRC09:04
*** jp_at_hp has joined #openstack-neutron09:04
*** Akshik has joined #openstack-neutron09:06
*** Akshik_ has joined #openstack-neutron09:07
*** Akshik has quit IRC09:11
*** amuller has joined #openstack-neutron09:13
openstackgerritOleg Bondarev proposed a change to openstack/neutron: agent report_states tests should consider parallel execution  https://review.openstack.org/8174009:23
*** safchain has joined #openstack-neutron09:27
*** ramishra has quit IRC09:30
*** orion195 has quit IRC09:35
*** roeyc has joined #openstack-neutron09:35
*** safchain has quit IRC09:37
openstackgerritA change was merged to openstack/neutron: Cisco plugin fails with ParseError no elem found  https://review.openstack.org/8130409:41
openstackgerritA change was merged to openstack/neutron: return false or true according to binding result  https://review.openstack.org/8145709:42
*** shakamunyi has joined #openstack-neutron09:43
*** tomoe_ has quit IRC09:45
*** arosen1 has quit IRC09:47
*** shakamunyi has quit IRC09:47
*** safchain has joined #openstack-neutron09:50
*** SumitNaiksatam has joined #openstack-neutron09:53
*** yamahata has quit IRC10:02
*** overlayer has joined #openstack-neutron10:03
*** djoreilly has joined #openstack-neutron10:04
*** bada_ has quit IRC10:15
*** rwsu has quit IRC10:18
*** safchain has quit IRC10:18
*** safchain has joined #openstack-neutron10:20
*** xuhanp has quit IRC10:21
openstackgerritA change was merged to openstack/neutron: NSX: Fix router-interface-delete returns 404 when router not in nsx  https://review.openstack.org/8017710:22
*** ramishra has joined #openstack-neutron10:25
*** geekinutah has quit IRC10:25
*** geekinutah has joined #openstack-neutron10:25
*** pcm_ has joined #openstack-neutron10:29
*** pcm_ has quit IRC10:31
*** pcm_ has joined #openstack-neutron10:31
*** afazekas has joined #openstack-neutron10:31
*** rwsu has joined #openstack-neutron10:33
*** nati_uen_ has quit IRC10:43
*** shakamunyi has joined #openstack-neutron10:43
*** nati_ueno has joined #openstack-neutron10:44
*** shakamunyi has quit IRC10:48
*** nati_ueno has quit IRC10:48
*** yamahata has joined #openstack-neutron10:53
openstackgerritYaguang Tang proposed a change to openstack/python-neutronclient: Make neutronclient parse keystone v3 endpoints correctly  https://review.openstack.org/8176710:54
openstackgerritshihanzhang proposed a change to openstack/neutron: Prevent dhcp port deletion from the API  https://review.openstack.org/8176810:59
*** chandankumar_ has quit IRC11:00
*** chandankumar has joined #openstack-neutron11:01
*** matsuhashi has quit IRC11:01
*** ihrachys is now known as ihrachys|lunch11:02
*** roeyc has quit IRC11:08
*** leseb has quit IRC11:14
*** leseb has joined #openstack-neutron11:15
*** devvesa has joined #openstack-neutron11:17
*** leseb has quit IRC11:19
openstackgerritOleg Bondarev proposed a change to openstack/neutron: agent report_states tests should consider parallel execution  https://review.openstack.org/8174011:23
*** matsuhashi has joined #openstack-neutron11:24
*** jgallard has quit IRC11:25
*** mflobo has joined #openstack-neutron11:27
*** xianghui has quit IRC11:33
*** markmcclain has joined #openstack-neutron11:35
*** markmcclain1 has joined #openstack-neutron11:35
*** markmcclain1 has quit IRC11:35
*** overlayer has quit IRC11:36
*** markmcclain1 has joined #openstack-neutron11:36
*** alexpilotti has joined #openstack-neutron11:37
*** overlayer has joined #openstack-neutron11:37
*** markmcclain1 has quit IRC11:37
*** markmcclain has quit IRC11:39
*** markmcclain has joined #openstack-neutron11:41
*** safchain_ has joined #openstack-neutron11:42
*** safchain has quit IRC11:42
*** shakamunyi has joined #openstack-neutron11:44
*** irenab has joined #openstack-neutron11:45
*** salv-orlando has joined #openstack-neutron11:47
*** shakamunyi has quit IRC11:48
*** dave_tucker_zzz is now known as dave_tucker11:55
HenryGsalv-orlando: markmcclain: https://review.openstack.org/40296 <--- success! But ...11:56
salv-orlandoHenryG… But?11:57
HenryGsalv-orlando: markmcclain: quotas table migration is missing from ML2. Not sure how to fix.11:57
salv-orlandoquotas have always been pesky. I would not rule that it does not work with migrations even in master11:58
markmcclainHenryG: we'll probably have to add a quota migration to make it work correctly11:59
*** banix has joined #openstack-neutron11:59
*** overlayer has quit IRC12:00
HenryGmarkmcclain: I did that in the patch, don't know if I got it right.12:05
HenryGhttps://review.openstack.org/#/c/40296/9/neutron/db/migration/alembic_migrations/versions/5ac71e65402c_ml2_initial.py12:05
HenryGalso, extradhcpopts table migration needed fixing12:06
*** matsuhashi has quit IRC12:08
*** crc32 has joined #openstack-neutron12:09
*** saju_m has quit IRC12:09
*** sballe has quit IRC12:12
*** matsuhashi has joined #openstack-neutron12:12
*** sballe has joined #openstack-neutron12:12
openstackgerritAnn Kamyshnikova proposed a change to openstack/neutron: WIP Implement test  https://review.openstack.org/7652012:13
openstackgerritAnn Kamyshnikova proposed a change to openstack/neutron: WIP Add testing for database from oslo  https://review.openstack.org/7651912:13
*** tomoe_ has joined #openstack-neutron12:14
*** matsuhashi has quit IRC12:18
*** matsuhashi has joined #openstack-neutron12:24
*** saju_m has joined #openstack-neutron12:26
*** dvorkinista has joined #openstack-neutron12:30
*** banix has quit IRC12:31
*** dvorkinista has quit IRC12:35
*** xuhanp has joined #openstack-neutron12:35
*** devvesa has quit IRC12:40
*** leseb has joined #openstack-neutron12:40
*** roeyc has joined #openstack-neutron12:41
openstackgerritshihanzhang proposed a change to openstack/neutron: Prevent dhcp port deletion from the API  https://review.openstack.org/8176812:42
*** vkozhukalov_ has quit IRC12:42
*** shakamunyi has joined #openstack-neutron12:45
*** tongli has joined #openstack-neutron12:47
*** matsuhashi has quit IRC12:47
*** shakamunyi has quit IRC12:49
sballeCould somebody confirm taht the LBaaS weekly meeting is still at 9amEST?  or 1400 UTC onIRC channel: #openstack-meeting12:50
*** saju_m has quit IRC12:53
*** vkozhukalov has joined #openstack-neutron12:58
*** jgallard has joined #openstack-neutron13:00
*** ramishra has quit IRC13:00
*** dguerri has joined #openstack-neutron13:01
*** ramishra has joined #openstack-neutron13:02
*** thuc has joined #openstack-neutron13:03
*** mwagner__zzzz is now known as mwagner_13:04
*** thuc_ has joined #openstack-neutron13:04
*** saju_m has joined #openstack-neutron13:06
*** thuc has quit IRC13:07
*** overlayer has joined #openstack-neutron13:08
HenryGsalv-orlando: markmcclain: I see the missing quotas table issue with the openvswitch legacy plugin too. Not at all clear to me how to fix that.13:13
salv-orlandoHenryG: cool I'll check and fle a bug if necessary13:14
markmcclainsballe: remember the LBaaS starts in 45mins13:15
markmcclainUTC does not shift to summer time13:16
sballemarkmcclain, thanks. I had forgotten. ;-)13:16
*** changbl has quit IRC13:16
*** ihrachys|lunch is now known as ihrachys13:17
markmcclainHenryG: :( need to think on what is the right way for that13:18
*** ramishra has quit IRC13:20
*** saju_m has quit IRC13:23
*** pradipta is now known as pradipta_away13:23
openstackgerritA change was merged to openstack/neutron: Add a semaphore to some ML2 operations  https://review.openstack.org/8041313:25
dguerrihello, is there a way to retrieve all the ports of a given agent (API and/or CLI)?13:30
*** shakamunyi has joined #openstack-neutron13:32
openstackgerritA change was merged to openstack/neutron: NEC plugin: Honor Retry-After response from OFC  https://review.openstack.org/8147213:33
*** peristeri has joined #openstack-neutron13:33
HenryGsalv-orlando: markmcclain: missing quotas table for linuxbridge legacy plugin too. :(13:36
*** salv-orlando has quit IRC13:38
*** saju_m has joined #openstack-neutron13:39
*** dave_tucker is now known as dave_tucker_zzz13:43
*** ramishra has joined #openstack-neutron13:44
*** yamahata has quit IRC13:48
*** saju_m has quit IRC13:48
*** yamahata has joined #openstack-neutron13:49
*** dave_tucker_zzz is now known as dave_tucker13:58
*** sbalukoff1 has joined #openstack-neutron13:58
*** sbalukoff has quit IRC14:01
*** jorgem has joined #openstack-neutron14:02
openstackgerritHareesh Puthalath proposed a change to openstack/neutron: Include cisco plugin in migration plugins with ovs  https://review.openstack.org/8040614:02
*** ramishra has quit IRC14:03
*** ramishra has joined #openstack-neutron14:03
*** sbalukoff1 is now known as sbalukoff14:07
openstackgerritRobert Kukura proposed a change to openstack/neutron: ML2: Remove validate_port_binding() and unbind_port()  https://review.openstack.org/7951114:07
*** ramishra has quit IRC14:08
*** tvardeman has joined #openstack-neutron14:08
*** ramishra has joined #openstack-neutron14:09
*** blogan has joined #openstack-neutron14:09
*** Jianyong has joined #openstack-neutron14:10
*** devvesa has joined #openstack-neutron14:10
*** Akshik_ has quit IRC14:14
*** Xtnn has joined #openstack-neutron14:17
*** ramishra_ has joined #openstack-neutron14:17
*** carlp has joined #openstack-neutron14:17
*** ramishra has quit IRC14:17
*** nati_ueno has joined #openstack-neutron14:19
*** Xtnn has left #openstack-neutron14:19
*** ramishra_ has quit IRC14:19
*** irenab has quit IRC14:19
*** ramishra has joined #openstack-neutron14:20
*** ramishra has quit IRC14:24
*** Jianyong has quit IRC14:24
*** ryanpetrello has joined #openstack-neutron14:26
*** liudong_ has joined #openstack-neutron14:27
*** ryanpetrello has left #openstack-neutron14:28
*** thuc_ has quit IRC14:30
*** thuc has joined #openstack-neutron14:31
sdaguewho is handling lbaas bugs?14:32
sdaguebecause currently it's randomly falling over in the gate a bit14:32
sdagueand I'm pretty close to just disabling either the service or the tempest tests on it14:33
sdaguehttp://logs.openstack.org/78/81778/1/check/check-tempest-dsvm-neutron/0a85d7c/console.html#_2014-03-20_13_43_58_797  as an example14:33
*** armax has joined #openstack-neutron14:35
*** thuc has quit IRC14:35
HenryGsdague: lbaas meeting going on in #openstack-meeting right now.14:35
*** sfox has joined #openstack-neutron14:37
devvesa#openstack-meeting-314:44
*** salv-orlando has joined #openstack-neutron14:45
*** dvorkinista has joined #openstack-neutron14:49
enikanorov__sdague: hi14:52
enikanorov__sdague: we're looking into it14:52
obondarevsdague: there is a bug https://bugs.launchpad.net/tempest/+bug/129460314:52
*** carl_baldwin has joined #openstack-neutron14:52
*** nati_ueno has quit IRC14:52
sdaguethis is not a tempest bug14:53
*** dvorkinista has quit IRC14:53
sdagueat least not as far as I can tell14:53
sdagueplease merge bugs and make it critical on the neutron side14:54
obondarevsdague: 1294603 is opened for both tempest and neutron side14:54
sdagueobondarev: ok, it's not a tempest bug14:55
*** leseb has quit IRC14:55
obondarevsdague: probably disabling the test would be the best option at the moment14:55
*** mwagner is now known as mwagner_notHere14:55
sdagueI think we should disable lbaas instead14:56
obondarevsdague: to unlock the gate while we are working on the bug14:56
sdaguewe really shouldn't be running a service that we don't have testing on14:56
markmcclainobondarev: can you propose skipping that test14:56
obondarevsdague: why?14:56
*** thuc has joined #openstack-neutron14:56
obondarevmarkmcclain: you mean submit a patch for skipping?14:56
*** otherwiseguy has joined #openstack-neutron14:56
sdaguebecause we should ensure everything we're running in the gate is actually being tested14:56
markmcclainobondarev: yes14:57
obondarevsdague: that test was merged a couple of days ago14:57
obondarevmarkmcclain: ok will do14:57
sdagueobondarev: what is testing that lbaas is working besides that test?14:58
obondarevsdague: yes, and there are no changes to lbaas since that test was merged14:59
sdagueobondarev: I understand that14:59
sdagueit means lbaas always wasn't working14:59
sdaguenow we just test it to know14:59
sdaguethat it randomly breaks a lot14:59
obondarevsdague: not sure, need to investigate more on this14:59
sdaguewhich is why I asked the question about what other tests are validating that lbaas is working correctly in the gate15:00
obondarevsdague: only api tests15:00
sdagueobondarev: and those don't test actual lbaas functionality, right?15:01
obondarevsdague: correct15:01
sdaguewhich means lbaas is, and has been, broken15:01
*** thuc has quit IRC15:02
sdagueso we can take a skip for now to relieve the gate, but if we don't have a fix within a week, I think we should stop running the service in the gate entirely15:02
*** thuc has joined #openstack-neutron15:02
*** thedodd has joined #openstack-neutron15:02
*** nati_ueno has joined #openstack-neutron15:03
enikanorov__sdague: why so?15:03
sdagueenikanorov: because it doesn't work15:04
obondarevsdague: will try to address the issue within a week15:04
enikanorov__grep "skip_because(bug=" * -r | wc -l15:05
enikanorov__4115:05
enikanorov__sure will try to fix that15:05
enikanorov__*we'll15:05
*** mwagner_ has quit IRC15:06
*** leseb has joined #openstack-neutron15:10
*** overlayer has quit IRC15:12
sdagueI also think a big issue is the review that turned it on slipped the skip removal in the middle of a refactor - https://review.openstack.org/#/c/71898/15:13
*** bashok has quit IRC15:13
*** overlayer has joined #openstack-neutron15:14
enikanorov__sdague: https://review.openstack.org/#/c/81831/15:14
sdagueyep, +A15:14
sdaguethanks15:14
*** liudong_ has quit IRC15:15
*** banix has joined #openstack-neutron15:15
enikanorov__sdague: it was intentional, because adding floating IP fixed the root caused of why it was skipped15:15
*** yfried1 has quit IRC15:16
sdagueenikanorov__: except, it didn't15:17
*** networkstatic has joined #openstack-neutron15:18
*** changbl has joined #openstack-neutron15:18
enikanorov__well, it did/ it worked well untill few days ago15:18
*** networkstatic has quit IRC15:20
salv-orlandoit *merged* a few days ago (cheeky comment)15:20
enikanorov__>:E15:20
*** carl_baldwin_ has joined #openstack-neutron15:22
*** carl_baldwin has quit IRC15:22
*** carl_baldwin_ is now known as carl_baldwin15:22
*** yfried has joined #openstack-neutron15:24
*** sfox has quit IRC15:24
*** sfox1 has joined #openstack-neutron15:24
*** Jabadia has quit IRC15:27
sdagueenikanorov: look at logstash - http://logstash.openstack.org/#eyJmaWVsZHMiOltdLCJzZWFyY2giOiJtZXNzYWdlOlwiRkFJTDogdGVtcGVzdC5zY2VuYXJpby50ZXN0X2xvYWRfYmFsYW5jZXJfYmFzaWMuVGVzdExvYWRCYWxhbmNlckJhc2ljLnRlc3RfbG9hZF9iYWxhbmNlcl9iYXNpY1wiIEFORCBmaWxlbmFtZTpjb25zb2xlLmh0bWwiLCJ0aW1lZnJhbWUiOiJhbGwiLCJncmFwaG1vZGUiOiJjb3VudCIsIm9mZnNldCI6MCwidGltZSI6eyJ1c2VyX2ludGVydmFsIjowfSwic3RhbXAiOjEzOTUzMjkxMzE0MTJ915:27
sdaguethis has been failing since the test was turned on15:27
*** Jabadia has joined #openstack-neutron15:27
sdague220 fails in 14 days15:27
sdagueso this isn't just the last couple of days15:27
*** krtaylor has quit IRC15:27
*** shakamunyi has quit IRC15:29
openstackgerritA change was merged to openstack/neutron: BigSwitch: Widen range of HTTPExceptions caught  https://review.openstack.org/7906415:30
*** Jabadia has quit IRC15:31
kevinbentonhas the gate failure rate reduced since https://review.openstack.org/#/c/80413/ merged?15:32
kevinbentondue to db lock issues15:32
*** overlayer has quit IRC15:36
openstackgerritenikanorov proposed a change to openstack/neutron: Fix typo in lbaas agent exception message  https://review.openstack.org/8183515:36
*** banix has quit IRC15:38
*** sbalukoff has quit IRC15:39
enikanorov__sdague: the failure patterns are different. looking into older ones15:40
enikanorov__the spike of test failures happened 1-2 days ago15:40
openstackgerritAvishay Balderman proposed a change to openstack/neutron: LBaaS L7 Rules Implementation  https://review.openstack.org/6172115:42
*** otherwiseguy has quit IRC15:43
openstackgerritKevin Benton proposed a change to openstack/neutron: Add decorator to prevent eventlet from yielding  https://review.openstack.org/8170915:43
openstackgerritA change was merged to openstack/neutron: ML2 BigSwitch: Don't modify parent context  https://review.openstack.org/8136015:44
openstackgerritA change was merged to openstack/neutron: Allow CIDRs with non-zero masked portions  https://review.openstack.org/8113715:46
openstackgerritA change was merged to openstack/neutron: Process ICMP type for iptables firewall  https://review.openstack.org/7883515:46
*** crc32 has quit IRC15:46
openstackgerritA change was merged to openstack/neutron: BigSwitch: Use eventlet.sleep in watchdog  https://review.openstack.org/8013015:47
sdaguekevinbenton: it's probably too early to tell15:47
*** claudiub_ has joined #openstack-neutron15:48
kevinbentonsdague: is this an appropriate query for that?15:48
kevinbentonhttp://logstash.openstack.org/#eyJmaWVsZHMiOltdLCJzZWFyY2giOiJtZXNzYWdlOlwiTG9jayB3YWl0IHRpbWVvdXQgZXhjZWVkZWRcIiBBTkQgZmlsZW5hbWU6Y29uc29sZS5odG1sIiwidGltZWZyYW1lIjoiYWxsIiwiZ3JhcGhtb2RlIjoiY291bnQiLCJvZmZzZXQiOjAsInRpbWUiOnsidXNlcl9pbnRlcnZhbCI6MH0sInN0YW1wIjoxMzk1MzMwMzA4ODE0fQ==15:48
*** devlaps has joined #openstack-neutron15:49
sdaguekevinbenton: I don't think so15:50
sdaguehttp://status.openstack.org/elastic-recheck/index.html has the logstash link we are tracking15:50
openstackgerritNachi Ueno proposed a change to openstack/neutron: Add enable_security_group option  https://review.openstack.org/6728115:53
kevinbentonsdague: i see. thx15:54
*** rossella_s has quit IRC15:54
sdagueI have not "yet" directly noticed that failure in the gate since the merge, which is something15:55
*** alagalah has joined #openstack-neutron15:55
sdaguebut it's all statistics, so we need to build enough data to know for sure15:55
*** rossella_s has joined #openstack-neutron15:56
kevinbentonright15:56
claudiub_hello15:56
claudiub_if i could take a bit of your time to review a small bug fix, i'd appreciate it. :)15:57
claudiub_~20-30 lines.15:57
claudiub_https://review.openstack.org/#/c/81382/15:58
*** networkstatic has joined #openstack-neutron15:58
*** devvesa has quit IRC15:58
*** YorikSar has joined #openstack-neutron16:00
*** xuhanp has quit IRC16:03
*** carl_baldwin has quit IRC16:05
*** carl_baldwin_ has joined #openstack-neutron16:05
*** carl_baldwin has joined #openstack-neutron16:05
*** shakamunyi has joined #openstack-neutron16:06
*** devvesa has joined #openstack-neutron16:06
*** otherwiseguy has joined #openstack-neutron16:07
*** carl_baldwin has quit IRC16:09
*** shakamunyi has quit IRC16:10
*** carl_baldwin has joined #openstack-neutron16:11
*** leseb has quit IRC16:12
*** sfox1 has quit IRC16:12
*** carl_baldwin has quit IRC16:13
*** _cjones_ has joined #openstack-neutron16:16
*** manishg has joined #openstack-neutron16:17
openstackgerritKevin Benton proposed a change to openstack/neutron: Add decorator to prevent eventlet from yielding  https://review.openstack.org/8170916:19
*** yfried has quit IRC16:20
*** thuc has quit IRC16:23
*** thuc has joined #openstack-neutron16:23
*** thuc has quit IRC16:28
*** thuc has joined #openstack-neutron16:28
*** SumitNaiksatam has quit IRC16:28
*** banix has joined #openstack-neutron16:30
*** yfried has joined #openstack-neutron16:31
*** banix has quit IRC16:32
*** sballe has quit IRC16:34
*** dims has quit IRC16:37
*** leseb has joined #openstack-neutron16:43
*** thuc has quit IRC16:43
*** thuc_ has joined #openstack-neutron16:43
*** SumitNaiksatam has joined #openstack-neutron16:43
*** overlayer has joined #openstack-neutron16:43
*** YorikSar has left #openstack-neutron16:44
*** leseb has quit IRC16:44
*** leseb has joined #openstack-neutron16:44
*** leseb has quit IRC16:47
*** leseb has joined #openstack-neutron16:47
*** dims has joined #openstack-neutron16:49
*** suresh12 has joined #openstack-neutron16:50
*** suresh12 has quit IRC16:51
*** carl_baldwin has joined #openstack-neutron16:51
*** otherwiseguy has quit IRC16:52
*** spandhe has joined #openstack-neutron16:57
*** leseb has quit IRC16:58
*** leseb has joined #openstack-neutron16:58
*** roeyc has quit IRC16:59
*** changbl has quit IRC17:02
*** leseb has quit IRC17:02
*** sfox has joined #openstack-neutron17:04
*** devvesa has quit IRC17:05
*** mwagner_ has joined #openstack-neutron17:07
*** nati_ueno has quit IRC17:08
*** nati_ueno has joined #openstack-neutron17:08
*** dvorkinista has joined #openstack-neutron17:09
*** skraynev is now known as skraynev_afl17:10
*** skraynev_afl is now known as skraynev_afk17:10
*** nati_ueno has quit IRC17:12
*** dvorkinista has quit IRC17:13
*** carl_baldwin has quit IRC17:14
*** vkozhukalov has quit IRC17:17
*** carl_baldwin has joined #openstack-neutron17:18
*** jobewan has joined #openstack-neutron17:18
jogosdague kevinbenton: it looks like there were gate hits for the bug17:20
kevinbentonjogo: do you have a link to a log?17:21
jogokevinbenton: http://logs.openstack.org/08/74508/4/gate/gate-tempest-dsvm-neutron/6f857b4/logs/screen-q-svc.txt17:21
jogohttp://logs.openstack.org/91/81091/1/gate/gate-tempest-dsvm-sahara-neutron/e5bf7db/logs/screen-q-svc.txt17:21
*** leseb has joined #openstack-neutron17:23
*** otherwiseguy has joined #openstack-neutron17:23
*** morganfainberg_Z is now known as morganfainberg17:23
*** claudiub_ has quit IRC17:23
kevinbentonjogo: thx. looks like it's a vip issue17:24
kevinbentonjogo: need another lock...17:24
*** tomoe_ has quit IRC17:24
*** tomoe_ has joined #openstack-neutron17:25
*** krtaylor has joined #openstack-neutron17:27
*** tomoe_ has quit IRC17:29
enikanorov__jogo: kevinbenton: what bug are you discussing?17:30
jogoenikanorov__: top bug on http://status.openstack.org/elastic-recheck/gate.html17:30
*** afazekas has quit IRC17:30
kevinbentonenikanorov__: the eventlet/mysql deadlock issues17:31
enikanorov__i see17:31
*** banix has joined #openstack-neutron17:34
*** changbl has joined #openstack-neutron17:34
jogokevinbenton: if you have another patch that will help, once its in gate queue ping me or sdague and you we can help get that patch to the top of the gate (by asking infra very nicely)17:36
*** sbalukoff has joined #openstack-neutron17:38
kevinbentonjogo: sounds good17:39
*** crc32 has joined #openstack-neutron17:39
jogobecause if we can't fix this soon ... well we are in trouble17:39
jogoany ideas of what happend on mar 12 to cause this bug?17:39
*** banix has quit IRC17:41
kevinbentonjogo: it's hard to tell. something that causes a thread to yield after it has a DB lock17:42
kevinbentonjogo: and mar 12 could have just been a change that adjusted the timing in the tests to expose it17:42
kevinbentonjogo: the bug could have been there for quite a while17:43
jogokevinbenton: right17:45
*** carl_baldwin has quit IRC17:45
*** tomoe_ has joined #openstack-neutron17:45
*** banix has joined #openstack-neutron17:47
*** dfarrell07 has joined #openstack-neutron17:48
*** banix has quit IRC17:49
*** ygbo has quit IRC17:49
openstackgerritmark mcclain proposed a change to openstack/neutron: Disable XML tests on Py26  https://review.openstack.org/8186517:50
jogoI69fe9cff4b550240215329e1082a63cd11617faa17:51
jogoIfed2505a97ceca56c4cedd22efa49adcdf3317b817:52
*** banix has joined #openstack-neutron17:53
jogoboth are in the right time period (roughly)17:53
*** banix has quit IRC17:54
jogonot sure if they made things worse or not17:55
jogokevinbenton: ^^17:55
kevinbentonjogo: the disassociate one possibly just by changing the order of DB transactions17:55
*** safchain_ has quit IRC17:55
jogoso if other neutron cores agree with you, and its safe to revert ... I think its worth trying17:58
kevinbentonjogo: it's hard to tell. is there a mechanism to launch several simultaneous checks?17:59
jogokevinbenton: no :/ but with how frequent this bug is you can just run recheck a few times18:00
jogoother option is to push up afew duplicate patches18:00
kevinbentonjogo: give me a few mins, working on the vip issue18:05
*** ijw has joined #openstack-neutron18:06
jogokevinbenton: well if the fix works, thats always better then a revert18:07
*** fouxm has quit IRC18:08
*** tomoe_ has quit IRC18:08
*** leseb has quit IRC18:08
*** tomoe_ has joined #openstack-neutron18:09
*** jorgem has quit IRC18:09
*** jorgem has joined #openstack-neutron18:11
*** tomoe_ has quit IRC18:13
*** amuller has quit IRC18:15
*** otherwiseguy has quit IRC18:16
marunjogo: hmmm, looking at those patches now18:19
*** yfried has quit IRC18:20
kevinbentonsalv-orlando: ping18:20
marunjogo: the fact that disassociation now occurs after a lock is acquired could be a problem18:21
salv-orlandokevinbenton: ping18:21
marunkevinbenton: so is the problem just for the vips?18:21
marunkevinbenton: or is there still contention on the ports table?18:21
kevinbentonmarun: i think the vip update_status operation can be blocked by a lock on the port table18:21
kevinbentonmarun: it's joined to it via port_id18:22
marunthat would do it.18:22
kevinbentonsalv-orlando, marun: i have another patch for you to look at18:22
salv-orlandojogo: I try to gues… disassociate_floating_ips change and updatE_floating_ip_status18:22
openstackgerritKevin Benton proposed a change to openstack/neutron: Add semaphore to LB VIP status update  https://review.openstack.org/8187718:22
salv-orlandoreverts are already unde review for both18:23
marunthat second patch won't affect anything b/c the metaplugin is not tested in gate18:23
salv-orlandomarun: yeah not metaplugin18:23
marunsalv-orlando: both of which?18:23
kevinbentonsalv-orlando, marun: https://review.openstack.org/8187718:23
marunsalv-orlando: I69fe9cff4b550240215329e1082a63cd11617faa I get18:23
salv-orlandothe two patches we attempt to revert in the past18:23
salv-orlandobut have seen lock timeout failures in the past 4 hours?18:23
*** yfried has joined #openstack-neutron18:23
salv-orlandonot from what I gather18:24
salv-orlandojogo: log stash still reports last failure at 12:28 GMT today18:25
salv-orlandoand the patch supposed to fix merged shortly after18:25
jogohttp://logs.openstack.org/08/74508/4/gate/gate-tempest-dsvm-neutron/6f857b4/logs/screen-q-svc.txt18:25
jogothere appear to be noticably less18:25
jogooh wait that is a successfull run18:26
*** packet has joined #openstack-neutron18:26
jogosalv-orlando: now I see the same thing yu do18:26
jogo12:2818:26
jogoonce I ignore successful runs18:26
salv-orlandojogo: successful runs with lock wait timeout errors18:26
*** jlibosva has quit IRC18:26
salv-orlandoare mostly because of a similar problem in the bit kevinbenton addresses in 8187718:27
jogoahh cool18:27
jogoso things are looking promising!18:27
jogowe also have the libvirt fix in and that is looking good too18:27
*** jorgem has quit IRC18:29
enikanorov__kevinbenton: commented on https://review.openstack.org/#/c/81877/18:31
*** thuc_ has quit IRC18:32
*** claudiub_ has joined #openstack-neutron18:32
*** thuc has joined #openstack-neutron18:33
*** markmcclain has quit IRC18:34
*** jorgem has joined #openstack-neutron18:34
kevinbentonenikanorov__: is everyone comfortable with a change like that at this time?18:34
enikanorov__kevinbenton: it should be safe change if it passes UTs (and I'm sure it will)18:35
kevinbentonalso, synchronization doesn't need to work across servers. the problem is specific to threads in same pool18:35
*** jgallard has quit IRC18:35
*** manishg_ has joined #openstack-neutron18:37
*** thuc has quit IRC18:37
*** manishg has quit IRC18:39
*** manishg_ is now known as manishg18:39
enikanorov__kevinbenton: so, if ports are locked, could not the same issue appear on another server where semaphore isn't locked?18:40
enikanorov__disjoining tables will solve tis once and for all18:40
*** stefanb has joined #openstack-neutron18:40
*** alagalah has quit IRC18:42
openstackgerritenikanorov proposed a change to openstack/neutron: Return meaningful error message on pool creation error  https://review.openstack.org/8188318:44
stefanbis the device_owner property of a port something that can be set by a client or is it being set when the port is connected to 'something' ?18:44
*** alagalah has joined #openstack-neutron18:44
stefanbspecifically I would like to create a port for a VM where IP spoofing is disabled; I see code in neutron not applying spoofing rules if the device_owner starts with 'network:'18:46
stefanbThe code to create such a port would be located inside nova; it would be similar to the cloud-pipe code18:47
kevinbentonenikanorov__: on another server, it would just block until the other server with the lock finishes what it's doing18:47
kevinbentonenikanorov__: the port fix is better18:48
enikanorov__kevinbenton: port fix is what?18:48
kevinbentonenikanorov__: what you suggested18:48
kevinbentonenikanorov__: because it should just eliminate the contention18:48
enikanorov__yep18:48
enikanorov__kevinbenton: can you explain the issue with mysql and eventlet? so as i understand, when you query the row, it blocks on port table and greenthread yields; does it take control back?18:50
kevinbentonenikanorov__: the issue is that the greenthread doesn't yield when mysql blocks18:52
*** manishg has quit IRC18:53
enikanorov__so it's there stuck forever?18:53
enikanorov__for particular query or what?18:53
kevinbentonenikanorov__: until the mysql lock on that table is released18:53
kevinbentonenikanorov__: at least this is the problem with any UPDATE statements18:54
enikanorov__i see. is the root cause of such behavior known?18:54
*** banix has joined #openstack-neutron18:55
kevinbentonenikanorov__: yes, it's a fundamental issue with mysql/eventlet. the mysql call goes into a mysql C library that eventlet doesn't understand so it can't recognize blocking calls and yield18:55
kevinbentonhttps://docs.google.com/drawings/d/13A2x4AWbf8zmzeGApUmYVlBrW8CMTPFTCBGSP_nTzDA/edit?usp=sharing18:55
enikanorov__thanks for the details18:56
kevinbentonenikanorov__:18:56
kevinbentonsee diagram18:56
*** sfox has quit IRC18:56
*** manishg has joined #openstack-neutron18:56
*** dvorkini_ has joined #openstack-neutron18:56
enikanorov__yeah18:56
armaxthe lock is per row, afaik18:56
*** armitage81 has joined #openstack-neutron18:57
kevinbentonenikanorov__: shoot. i have a meeting for an hour or so. can you look at how i will disable the join in the patch without changing get_by_id?18:57
armaxso locking the entire table is caused by the scope of the query18:57
enikanorov__kevinbenton: sure, i'll update your patch18:57
*** armitage81 has quit IRC18:57
*** armitage81 has joined #openstack-neutron18:57
*** sfox has joined #openstack-neutron18:58
*** jorgem has quit IRC19:00
*** sfox has quit IRC19:02
*** jorgem has joined #openstack-neutron19:03
*** thuc has joined #openstack-neutron19:04
rkukurakevinbenton: Wish I had seen that drawing before!19:06
*** rotbeard has quit IRC19:06
mesteryrkukura kevinbenton: +100019:07
claudiub_hello.19:08
claudiub_could anyone help me with a review for a small bug fix (3-4 lines of code) on neutron? :)19:09
claudiub_https://review.openstack.org/#/c/81382/19:09
mesteryclaudiub_: Does the same fix need to be made to the Hyper-V ML2 driver?19:11
*** thuc_ has joined #openstack-neutron19:12
claudiub_no, it is strictly hyper-v related19:12
*** thuc has quit IRC19:12
claudiub_the way the security groups ACLs are added to a hyper-v switch port19:12
mesteryOK, cool. Just was curious because of the Hyper-V neutron agent is there too.19:12
HenryGmestery: Looks like the claudiub_ change is to the agent only, so should cover ML2 use case too?19:14
mesteryHenryG: Yes, noticed that as well :)19:14
*** vkozhukalov has joined #openstack-neutron19:15
claudiub_thx guys for the help. :)19:17
*** kfox1111 has joined #openstack-neutron19:25
kfox1111I have a sytem that is constantly neutron.agent.securitygroups_rpc refreshing firewall rules. What would cause that?19:26
*** aveiga has joined #openstack-neutron19:32
*** packet has quit IRC19:33
*** packet has joined #openstack-neutron19:34
openstackgerritenikanorov proposed a change to openstack/neutron: Get rid of additional db contention on fetching VIP  https://review.openstack.org/8187719:36
enikanorov__kevinbenton: ^^19:36
*** overlayer has quit IRC19:41
*** vu has joined #openstack-neutron19:46
*** sballe has joined #openstack-neutron19:48
*** djoreilly has quit IRC19:48
kevinbentonsalv-orlando, marun: ^^19:49
kfox1111kevinbenton: hi.19:51
kfox1111what process inserts firewall refresh rpc's in linuxbridge-agent's queue?19:51
*** alagalah has quit IRC19:56
*** alagalah has joined #openstack-neutron19:57
*** otherwiseguy has joined #openstack-neutron19:58
*** thuc_ has quit IRC19:58
*** thuc has joined #openstack-neutron19:58
*** dvorkinista has joined #openstack-neutron19:59
*** thuc_ has joined #openstack-neutron19:59
*** dvorkini_ has quit IRC20:00
*** markwash has joined #openstack-neutron20:01
kevinbentonkfox1111: one sec. i believe any port changes will notify agents and they will check to see if their port is modified, and if so, refresh the firewall20:01
kevinbentonkfox1111: the other i thought was just a rule change20:02
*** markwash has quit IRC20:02
*** markwash has joined #openstack-neutron20:02
*** thuc has quit IRC20:03
marunkevinbenton: looking20:04
kfox1111I don't think either of those should be happening at the frequency I'm seeing them. I'm seeing so many its not able to keep up.20:05
kevinbentonkfox1111: so are they messages on the bus, or just locally showing firewall_refresh in the agent logs?20:07
kevinbentonkfox1111: because the agent can refresh itself20:07
kfox1111good question. the queue is getting backed up. the only thing in the logs is firewall_refresh, which is constantly spitting out.20:09
kfox1111let me turn up debugging and see what happens.20:09
enikanorov__kevinbenton: marun: salv-orlando: need to update the patch, i see an issue, sorry20:09
kevinbentonkfox1111: it might be worth turning up the debugging on the server too to see what it's sending20:10
kevinbentonenikanorov__: ok20:11
openstackgerritA change was merged to openstack/neutron: NSX: Sync do not pass around model object  https://review.openstack.org/7450820:11
kfox1111I'm seeing lots of stuff going on now...20:11
kevinbentonkfox1111: http://paste.openstack.org/20:12
kfox1111Is there anything in here that is sensitive?20:12
kfox1111also, how much do you want?20:12
kevinbentonkfox1111:  neutron.openstack.common.rpc.amqp20:14
*** thuc has joined #openstack-neutron20:14
kevinbentonkfox1111: grep for those ones20:14
kfox1111k.20:14
kevinbentonkfox1111: those should be safe from sensitive stuff20:15
claudiub_hey guys, i also have a backport patch for some time, could you please take a look at it? :)20:15
claudiub_https://review.openstack.org/#/c/63775/20:15
kfox1111http://pastebin.com/mK4ypQT820:15
kfox1111same thing over and over.20:15
*** overlayer has joined #openstack-neutron20:16
kfox1111hmm.. the messages look like its looping over each port...20:17
*** thuc_ has quit IRC20:18
kfox1111grepping for linux.utils,20:18
kfox1111its calling iptables-save and iptables-restore alot.20:18
*** thuc has quit IRC20:18
kfox1111hmm... this is interesting. top is showing neutron-server on the core being between 14 and 30% cpu load continuously...20:19
kfox1111maybe that is related.20:19
kfox1111neutron-linuxbridge-agent looks like its about similarly loaded too.20:20
openstackgerritenikanorov proposed a change to openstack/neutron: Get rid of additional db contention on fetching VIP  https://review.openstack.org/8187720:20
kevinbentonkfox1111: this pastebin  is from the server, right?20:21
*** mflobo_ has joined #openstack-neutron20:22
kfox1111from linuxbridge-agent. you want neutron-server?20:22
kfox1111http://pastebin.com/7ghQYf3Y <- neutron-server amqp debugging logs.20:24
*** mflobo has quit IRC20:25
sballeenikanorov, I am trying to understand if the neutron LBaaS scheduler could schedule LBaaS e.g. HA proxies the same way that Nova can schedule VMs?20:26
sballeI am looking at this: https://wiki.openstack.org/wiki/Neutron/LBaaS/Architecture/Scheduler and I am not clear on he answer20:27
kevinbentonkfox1111: i wonder if the constant port updates from the dhcp-agent are the problem20:27
kevinbentonin the linuxbridge-agent20:27
*** julim has quit IRC20:28
kfox1111hmm... let me look at the dhcp-agent...20:29
enikanorov__pcm_: hi. replied to your comment: https://review.openstack.org/#/c/79599/20:29
kfox1111hmm....20:29
kfox1111its in a slightly bad way... lets see...20:30
kfox1111I'm seeing this about every 10 seconds:20:31
kfox1111http://pastebin.com/RLNiJ6gm20:31
kevinbentonkfox1111: i would say that's the root cause20:33
kfox1111oh, interesting...20:33
kfox11113e4d979e-c5cc-4414-9c03-e08831259276 is our external network.20:33
kevinbentonkfox1111: dhcp agent failing to start20:33
kfox1111it looks like someone added a ipv6 subnet to it...20:33
kfox1111eeep. and dhcp is enabled on it. thats probably it...20:34
kfox1111how do I use neutron subnet-update to turn off dhcp?20:35
*** banix has quit IRC20:35
kfox1111hmm.. ok. using an argument the same name as the table row worked.20:37
*** carl_baldwin has joined #openstack-neutron20:37
*** rwsu has quit IRC20:37
kfox1111its not dhcp agaent is not spewing anymore...20:38
*** armitage81 has quit IRC20:38
*** aveiga has quit IRC20:39
kfox1111ah... neutron server load is much down now.20:40
kfox1111thanks for the debugging help...20:40
*** crc32 has quit IRC20:41
kevinbentonkfox1111: hey, sorry about the delay. you should have been able to do it from the horizon interface for the subnet20:43
*** fouxm has joined #openstack-neutron20:45
*** peristeri has quit IRC20:45
*** dims has quit IRC20:46
*** mwagner_ has quit IRC20:46
kfox1111Ah, I see. I was trying to edit from the project's tab, and it wasn't giving me any editing boxes for it. But if  Igo to the admin tab, then I can do it.20:47
kfox1111yeah. the queue seems to be drained nicely now. I think that was it.20:47
*** armitage81 has joined #openstack-neutron20:52
*** armitage81 has quit IRC20:53
*** armitage81 has joined #openstack-neutron20:53
*** marun has quit IRC20:53
kfox1111thanks again for all the help.20:53
kevinbentonkfox1111: no prob. glad you got it fixed20:54
*** alagalah has quit IRC20:57
*** ajo has quit IRC20:57
*** krtaylor has quit IRC20:57
kfox1111hmm... now on to figuring out why the load ballancer is not passing stuff through...20:58
*** dvorkinista has quit IRC21:01
*** dims has joined #openstack-neutron21:01
kfox1111everything looks to be hooked up right.21:02
*** thuc has joined #openstack-neutron21:03
*** zhipeng has joined #openstack-neutron21:04
*** rwsu has joined #openstack-neutron21:04
*** jaypipes has quit IRC21:07
*** tongli has quit IRC21:07
*** dvorkinista has joined #openstack-neutron21:08
kfox1111hmm... does a vip have a security group associated with it?21:09
*** lukego has quit IRC21:09
*** dvorkinista has quit IRC21:09
*** carl_baldwin has quit IRC21:09
*** carl_baldwin has joined #openstack-neutron21:09
*** carl_baldwin has quit IRC21:11
kevinbentonkfox1111: unfortunately i don't know anything about the load balancer config, so someone else will have to help you out with that one21:11
kfox1111I had this working at one point.... For some reason, if I ip netns exec into the namespace, the load ballancer is working fine. If I try and curl to the load ballancer from one of the hosts the load ballancer talks to, it cant talk to the load ballancer. very strange.21:12
kfox1111I can ping the load ballancer though.21:12
*** carl_baldwin has joined #openstack-neutron21:12
kevinbentonmarun, salv-orlando: did you get a chance to look at the 3rd patch uploaded by enikanorov__?21:14
*** jaypipes has joined #openstack-neutron21:14
kfox1111yeah. the load balancer is not even seeing the request.21:15
*** rudrarugge has joined #openstack-neutron21:15
*** thuc has quit IRC21:15
*** thuc has joined #openstack-neutron21:16
*** ijw has quit IRC21:16
kfox1111yeah... doing the ping from qdhcp-the_network to the load ballancer fails too.21:17
rudraruggei have a couple of questions on the behavior of security groups in neutron21:19
*** mlavalle has joined #openstack-neutron21:19
rudrarugge"default" security group is created for a project and has two rules: #1 allow ingress from same SG #2 allow all egress21:19
rudraruggecan these two rules be edited/deleted?21:20
kfox1111rudrarugge: yes.21:20
*** carlp has quit IRC21:21
rudraruggeopenstack does not allow delete of default security group - is this understanding correct?21:23
kfox1111I'm not sure. I just know you can change whats in it just like any other group.21:23
*** tvardeman has quit IRC21:24
*** carl_baldwin has quit IRC21:24
rudraruggearosen: can you confirm this information for security groups. looking at the doc that you have published for port of SG from nova to quantum/neutron21:24
*** vkozhukalov has quit IRC21:25
rudraruggewhat is the behavior if all rules from the default security group are deleted?21:25
*** banix has joined #openstack-neutron21:25
rudraruggeanyone?21:26
*** jorgem1 has joined #openstack-neutron21:27
kfox1111I beleive its completely additive permissions. So 100% blocked I think.21:27
rudraruggethanks kfox111121:29
*** jorgem has quit IRC21:29
*** banix has quit IRC21:29
kfox1111sure. :)21:29
*** vu has quit IRC21:32
*** dvorkinista has joined #openstack-neutron21:34
rudraruggeBased on the following link looks like the default rules in the default security group cannot be edited/deleted in neutron http://www.gossamer-threads.com/lists/openstack/dev/36779?page=last21:35
kfox1111I believe they are talking about the rules that all new tenant networks get. Not that you can't delete the rules in the security group after its created. But I don't think I've ever tried it.21:39
kfox1111Only one way to find out... :)21:39
*** aveiga has joined #openstack-neutron21:47
*** networkstatic is now known as networkstatic_zZ21:51
openstackgerritA change was merged to openstack/neutron: BigSwitch: Sync workaround for port del deadlock  https://review.openstack.org/8068821:52
rms_13rudrarugge: Do you think it would be a good idea to make default sg optional/configurable?21:54
rudraruggedefault sg is fine for each project and preventing delete of default sg is also fine21:55
rudraruggeits the behavior of the rules that i am curious about: are the 2 default rules implicit or explicit. can users edit/delete the rules? what is the behavior if the rules are deleted21:56
kfox1111it should be the same as any other group.21:56
arosenrudrarugge:  kfox1111 that is correct if you remove all the egress rules an instance can no longer send out.21:56
kfox1111it just pre-create's it for the user from whta I understand.21:56
kfox1111Its like /etc/skel on a unix box.21:56
arosenrudrarugge:  users can delete all rules.21:57
kfox1111on user create, it just copies /etc/skel to /home/username21:57
kfox1111the user is free to do whatever they want with it afterwards.21:57
rudraruggearosen: if all default rules are deleted then its in locked down mode21:57
arosenrudrarugge:  yup21:57
rudraruggearosen: thanks21:58
arosenrudrarugge:  sure np!21:58
rudraruggearosen: can user delete default sg?21:58
arosenrudrarugge:  on the admin can21:58
arosenevery instance that's created gets a default security group21:58
*** jgrimm has quit IRC21:59
arosenif you precreate the ports in neutron though with --no-security-groups you can launch an instance without a security group.21:59
arosenNova by default addds the default sg21:59
rudraruggegot it22:00
rudraruggethanks22:00
*** alagalah has joined #openstack-neutron22:00
arosenrudrarugge:  same behavior as ec2 btw (or should be)22:02
aroseni confirmed that it was when we were figuring out how it should work.22:02
manishgarosen, what do you mean by 'preceate ports' ? do you mean when creating an instance I can specify now '--no-security-groups' and it will (via compute) translate into port-create (w/ no-security-group option)?22:05
arosenmanishg:  i mean: neutron port-create --no-security-groups <network>; then nova boot --nic port-id=<port>22:07
arosenmanishg:  otherwise nova adds them.22:07
*** marun has joined #openstack-neutron22:07
manishgarosen.  got it.  and for havana, there seems to be also 'port-update --no-security-groups' .  wondering in case it wasn't precreated then would port-update also work?22:07
arosenmanishg:  yea you can always update the port(s) and remove them or add them at anytime.22:08
manishgdon't recall the no-security-groups option in grizzly.22:08
arosenmanishg:  i don't think we had added those bits to the python-neutronclient but it would have worked via curl in grizzly as well.22:08
manishgarosen: ah, ok.  thanks.  would be good to have an option for this when creating an instance instead of pre-creating and/or updating.  do you know if there is any effort in that direction?22:10
*** ajo has joined #openstack-neutron22:13
*** pcm_ has quit IRC22:13
*** dvorkinista has quit IRC22:15
*** banix has joined #openstack-neutron22:18
arosenmanishg:  yup, there is a way to do this if you're plugin implements the port_security_enabled extension22:20
*** jorgem1 has quit IRC22:20
*** Sukhdev has joined #openstack-neutron22:20
arosenbasically you can create a network with; neutron net-create --port-security-enabled=False blah; then ports created on it won't have a security group22:20
arosenalso you're able to launch instances on it even though it doesn't have a subnet.22:20
arosenmanishg:  anyways, in nova's v3 api we're not going to have nova proxy calls and create ports in neutron. When this happens we'll be able to let neutron decide if something needs a security group or not.22:21
arosenright now nova automatically adds 'default' for you.22:22
arosenif you don't provide one.22:22
*** overlayer has quit IRC22:22
*** sungju_ has joined #openstack-neutron22:23
*** ajo has quit IRC22:24
manishgarosen: thanks.  yeah, that's what we noticed (that nova adds the default automatically) and so had to change code to avoid using security groups.  Didn't see any option in net-create for disabling security groups at the time (in grizzly) for the subnet.22:25
*** sungju- has joined #openstack-neutron22:25
arosenmanishg: yea i believe this is only supported if you're using NSX22:25
*** nati_ueno has joined #openstack-neutron22:26
*** sungju_ has quit IRC22:27
*** armax has quit IRC22:28
*** blogan has quit IRC22:28
*** gdubreui has joined #openstack-neutron22:29
*** thuc_ has joined #openstack-neutron22:31
*** thuc has quit IRC22:34
*** thuc_ has quit IRC22:35
*** thuc has joined #openstack-neutron22:36
*** alagalah has quit IRC22:39
*** thuc has quit IRC22:45
*** thuc has joined #openstack-neutron22:46
*** manishg has quit IRC22:47
*** changbl has quit IRC22:47
*** dfarrell07 has quit IRC22:54
*** rudrarugge has quit IRC22:57
*** jobewan has quit IRC22:57
*** ajo has joined #openstack-neutron22:58
*** networkstatic_zZ is now known as networkstatic22:58
*** salv-orlando has quit IRC23:06
*** salv-orlando has joined #openstack-neutron23:07
*** zzelle has joined #openstack-neutron23:07
*** mlavalle has quit IRC23:12
*** armax has joined #openstack-neutron23:13
*** ijw has joined #openstack-neutron23:15
*** ajo has quit IRC23:15
*** thedodd has quit IRC23:17
*** banix has quit IRC23:19
*** claudiub_ has quit IRC23:30
kfox1111ok. so the lbaas instance seems to have the default security group associated with it, which is totally wrong. :/23:33
*** mwagner_notHere has quit IRC23:37
openstackgerritAaron Rosen proposed a change to openstack/python-neutronclient: Allow user ID for authentication  https://review.openstack.org/7859623:37
*** banix has joined #openstack-neutron23:43
kfox1111yeah. thats the problem.23:44
kfox1111how do you port-update the security group?23:44
kfox1111400-{u'NeutronError': {u'message': u"Invalid input for operation: '6' is not an integer or uuid.", u'type': u'InvalidInput', u'detail': u''}}23:44
*** aveiga has quit IRC23:49
*** alagalah has joined #openstack-neutron23:50
openstackgerritNachi Ueno proposed a change to openstack/neutron: Add enable_security_group option  https://review.openstack.org/6728123:50
*** alagalah has quit IRC23:54
*** alexpilotti has quit IRC23:55
*** zzelle has quit IRC23:56
*** nati_ueno has quit IRC23:56
*** nati_ueno has joined #openstack-neutron23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!