openstackgerrit | Michael Johnson proposed openstack/octavia master: Look for diskimage-builder not dib-utils when building amps https://review.openstack.org/443220 | 00:07 |
---|---|---|
openstackgerrit | Michael Johnson proposed openstack/octavia master: Look for diskimage-builder not dib-utils when building amps https://review.openstack.org/443220 | 00:07 |
*** catintheroof has quit IRC | 00:46 | |
*** ducttape_ has quit IRC | 00:54 | |
johnsom | https://review.openstack.org/443336 | 00:59 |
johnsom | That is so hacky I feel ashamed for posting it.... | 01:00 |
*** ducttape_ has joined #openstack-lbaas | 01:13 | |
*** sanfern has quit IRC | 01:31 | |
*** ducttape_ has quit IRC | 01:35 | |
*** ducttape_ has joined #openstack-lbaas | 01:38 | |
*** ducttape_ has quit IRC | 01:49 | |
rm_work | johnsom: i thought you just needed to add "command -v $DIB_PYTHON || " to the beginning of python_path | 02:19 |
rm_work | if it's set, great, otherwise do what it did before | 02:19 |
rm_work | hunting for the package is super hacky and might still not do what you intended | 02:19 |
johnsom | I tried that first, it failed | 02:20 |
rm_work | ah, hmm | 02:20 |
johnsom | It is the version for inside the image | 02:20 |
rm_work | well i just commented that. so bleh | 02:20 |
rm_work | aah, crap | 02:20 |
rm_work | this isn't outside | 02:21 |
rm_work | there should also be a thing for that, i think? | 02:21 |
rm_work | how does anything else do it | 02:21 |
johnsom | See the results of the first patch... | 02:21 |
johnsom | Yeah, I spent way too much of my afternoon noodling on this | 02:22 |
johnsom | There must be a better way, I just don't know what it is... | 02:22 |
johnsom | It is an outside agent that installs the module and the requirements. We have to figure out which version they used. Their gates are all py2 on trusty, some of our gates are py3 on xenial | 02:24 |
*** gongysh has joined #openstack-lbaas | 02:28 | |
johnsom | Making risotto so may be off and on for a bit | 02:28 |
rm_work | johnsom: so.... uhh | 02:28 |
rm_work | one thing might be | 02:29 |
rm_work | just ignore this temporarily so we can fix the REST of the gate | 02:29 |
rm_work | since py3 isn't voting | 02:29 |
rm_work | IMO | 02:29 |
rm_work | take off the depends-on and just ... roll with the patch as-is | 02:29 |
johnsom | Yeah, I could live with that | 02:29 |
johnsom | Yeah, the depends doesn't work anyway | 02:29 |
rm_work | ok i'm going to do that | 02:29 |
johnsom | Ok, ping me and I will run vote on it | 02:30 |
johnsom | I certainly have reviewed and tested it enough | 02:30 |
openstackgerrit | Adam Harwell proposed openstack/octavia master: Look for diskimage-builder not dib-utils when building amps https://review.openstack.org/443220 | 02:30 |
rm_work | just changed the commit message, looks like your changes since i touched it last was net-zero | 02:31 |
johnsom | Crumb, even the ugly fix didn't work | 02:37 |
johnsom | It still picked py3 when the module was installed with py2 | 02:37 |
johnsom | Oh, I am dumb | 02:38 |
johnsom | || true triggers to get around the -e which in turn changes the $? | 02:38 |
rm_work | err | 02:40 |
rm_work | let me look again | 02:40 |
rm_work | LOL yes | 02:41 |
rm_work | if you use true like that | 02:41 |
rm_work | it will always work | 02:41 |
rm_work | that's the point | 02:41 |
rm_work | you exactly DO NOT want || true | 02:41 |
rm_work | :P | 02:41 |
rm_work | i am dumb too for not catching that | 02:41 |
rm_work | though i was more focused on 'why not the simple way' | 02:41 |
rm_work | if this is INSIDE the amp, it's less hacky | 02:42 |
rm_work | because no chance you will have a random yaml module sitting around | 02:43 |
rm_work | which is what i was thinking about | 02:43 |
rm_work | so maybe it'll be ok now | 02:43 |
johnsom | Fixed. Also, I won't shame you if you push that in to get the py2 gates going again | 02:43 |
rm_work | johnsom: enjoy your risotto | 02:43 |
rm_work | yes, +2 plz :P | 02:43 |
johnsom | I did already | 02:43 |
rm_work | ah you did | 02:43 |
rm_work | ^_^ | 02:43 |
rm_work | yeah i ... uhh | 02:43 |
rm_work | it's a gatefix | 02:43 |
rm_work | I can self-merge | 02:44 |
rm_work | right? ^_^ | 02:44 |
johnsom | Yeah, the PTL gives his blessing | 02:44 |
rm_work | kk | 02:44 |
rm_work | i'll do that assuming testing is fine | 02:44 |
*** ducttape_ has joined #openstack-lbaas | 02:50 | |
*** armax has joined #openstack-lbaas | 02:54 | |
*** ducttape_ has quit IRC | 02:55 | |
*** sanfern has joined #openstack-lbaas | 02:57 | |
*** amotoki has joined #openstack-lbaas | 02:57 | |
*** amotoki has quit IRC | 03:09 | |
*** ducttape_ has joined #openstack-lbaas | 03:18 | |
*** fnaval has joined #openstack-lbaas | 03:18 | |
*** ducttape_ has quit IRC | 03:19 | |
*** ducttape_ has joined #openstack-lbaas | 03:20 | |
*** ducttape_ has quit IRC | 03:20 | |
*** ducttape_ has joined #openstack-lbaas | 03:20 | |
*** bbzhao has quit IRC | 03:31 | |
*** bzhao has joined #openstack-lbaas | 03:32 | |
*** amotoki has joined #openstack-lbaas | 03:32 | |
*** amotoki has quit IRC | 03:46 | |
*** sanfern has quit IRC | 04:00 | |
*** amotoki has joined #openstack-lbaas | 04:02 | |
rm_work | ok diltram what do you think about https://review.openstack.org/#/c/437200/ ? | 04:06 |
rm_work | I guess I could do more DB checks or something to make sure none of the objects exist... | 04:06 |
*** amotoki has quit IRC | 04:10 | |
*** KeithMnemonic has quit IRC | 04:14 | |
*** links has joined #openstack-lbaas | 04:17 | |
*** amotoki has joined #openstack-lbaas | 04:24 | |
*** ducttape_ has quit IRC | 04:28 | |
*** kobis has joined #openstack-lbaas | 04:35 | |
*** fnaval has quit IRC | 04:40 | |
*** fnaval has joined #openstack-lbaas | 04:45 | |
*** kobis has quit IRC | 04:58 | |
*** sanfern has joined #openstack-lbaas | 05:00 | |
*** sanfern has quit IRC | 05:00 | |
*** sanfern has joined #openstack-lbaas | 05:00 | |
*** sanfern has quit IRC | 05:01 | |
openstackgerrit | Merged openstack/octavia master: Look for diskimage-builder not dib-utils when building amps https://review.openstack.org/443220 | 05:11 |
*** gongysh has quit IRC | 05:16 | |
*** ducttape_ has joined #openstack-lbaas | 05:28 | |
*** ducttape_ has quit IRC | 05:32 | |
*** fnaval has quit IRC | 05:40 | |
*** armax has quit IRC | 05:50 | |
*** kobis has joined #openstack-lbaas | 05:51 | |
*** kobis has quit IRC | 05:55 | |
*** gongysh has joined #openstack-lbaas | 06:01 | |
*** links has quit IRC | 06:04 | |
*** sanfern has joined #openstack-lbaas | 06:10 | |
*** links has joined #openstack-lbaas | 06:16 | |
*** kobis has joined #openstack-lbaas | 06:19 | |
*** gcheresh_ has joined #openstack-lbaas | 06:21 | |
*** belharar has joined #openstack-lbaas | 06:22 | |
*** ducttape_ has joined #openstack-lbaas | 06:29 | |
*** ducttape_ has quit IRC | 06:33 | |
*** armax has joined #openstack-lbaas | 06:39 | |
*** rcernin has joined #openstack-lbaas | 06:44 | |
*** links has quit IRC | 06:58 | |
*** amotoki_ has joined #openstack-lbaas | 07:01 | |
*** amotoki has quit IRC | 07:03 | |
*** armax has quit IRC | 07:06 | |
*** ducnc has joined #openstack-lbaas | 07:10 | |
*** yamamoto has quit IRC | 07:14 | |
*** links has joined #openstack-lbaas | 07:15 | |
*** tesseract has joined #openstack-lbaas | 07:22 | |
*** ducttape_ has joined #openstack-lbaas | 07:30 | |
*** csomerville has joined #openstack-lbaas | 07:31 | |
*** cody-somerville has quit IRC | 07:31 | |
openstackgerrit | ZhaoBo proposed openstack/octavia master: Support vip bandwidth limitation https://review.openstack.org/441912 | 07:32 |
*** ducttape_ has quit IRC | 07:35 | |
*** anilvenkata has joined #openstack-lbaas | 07:35 | |
*** ducttape_ has joined #openstack-lbaas | 08:30 | |
*** ducttape_ has quit IRC | 08:35 | |
*** eezhova has joined #openstack-lbaas | 08:37 | |
openstackgerrit | Tuan Luong-Anh proposed openstack/octavia master: Indicating the location tests directory in oslo_debug_helper https://review.openstack.org/443503 | 08:55 |
*** eezhova has quit IRC | 09:05 | |
*** krypto has joined #openstack-lbaas | 09:10 | |
*** krypto has joined #openstack-lbaas | 09:10 | |
*** Dave____ has joined #openstack-lbaas | 09:24 | |
*** Dave has quit IRC | 09:29 | |
*** Dave____ is now known as Dave | 09:29 | |
*** ducttape_ has joined #openstack-lbaas | 09:31 | |
*** ducttape_ has quit IRC | 09:36 | |
*** anilvenkata has quit IRC | 09:36 | |
*** sanfern has quit IRC | 09:45 | |
*** eezhova has joined #openstack-lbaas | 09:55 | |
*** sanfern has joined #openstack-lbaas | 10:03 | |
*** sanfern has quit IRC | 10:08 | |
*** krypto has quit IRC | 10:29 | |
*** gongysh has quit IRC | 10:44 | |
*** krypto has joined #openstack-lbaas | 10:58 | |
*** krypt0N has joined #openstack-lbaas | 11:00 | |
*** krypto has quit IRC | 11:02 | |
*** belharar has quit IRC | 11:07 | |
*** krypto has joined #openstack-lbaas | 11:18 | |
*** krypt0N has quit IRC | 11:18 | |
*** yamamoto has joined #openstack-lbaas | 11:29 | |
*** amotoki_ has quit IRC | 12:07 | |
*** amotoki has joined #openstack-lbaas | 12:08 | |
*** amotoki_ has joined #openstack-lbaas | 12:09 | |
*** kobis has quit IRC | 12:12 | |
*** amotoki has quit IRC | 12:13 | |
*** amotoki_ has quit IRC | 12:14 | |
*** yamamoto has quit IRC | 12:21 | |
*** yamamoto has joined #openstack-lbaas | 12:21 | |
*** amotoki has joined #openstack-lbaas | 12:26 | |
*** krypto has quit IRC | 12:31 | |
*** krypto has joined #openstack-lbaas | 12:31 | |
*** gongysh has joined #openstack-lbaas | 12:43 | |
*** krypt0N has joined #openstack-lbaas | 13:00 | |
*** krypto has quit IRC | 13:03 | |
*** yamamoto has quit IRC | 13:07 | |
*** sanfern has joined #openstack-lbaas | 13:13 | |
*** yamamoto has joined #openstack-lbaas | 13:13 | |
*** yamamoto has quit IRC | 13:16 | |
*** yamamoto has joined #openstack-lbaas | 13:17 | |
*** yamamoto has quit IRC | 13:21 | |
*** yamamoto has joined #openstack-lbaas | 13:25 | |
*** chlong_ has joined #openstack-lbaas | 13:33 | |
*** ducttape_ has joined #openstack-lbaas | 13:41 | |
*** gongysh has quit IRC | 14:08 | |
*** amotoki has quit IRC | 14:08 | |
*** matt-borland has joined #openstack-lbaas | 14:13 | |
*** ducttape_ has quit IRC | 14:19 | |
*** krypto has joined #openstack-lbaas | 14:21 | |
*** krypto has quit IRC | 14:21 | |
*** krypto has joined #openstack-lbaas | 14:21 | |
*** krypt0N has quit IRC | 14:22 | |
*** yamamoto has quit IRC | 14:23 | |
*** kobis has joined #openstack-lbaas | 14:23 | |
*** sanfern has quit IRC | 14:26 | |
*** sanfern has joined #openstack-lbaas | 14:26 | |
rm_work | wtf is with http://logs.openstack.org/36/443336/3/check/gate-diskimage-builder-pep8-ubuntu-xenial/3ee647b/console.html#_2017-03-09_02_41_13_138795 | 14:34 |
*** links has quit IRC | 14:35 | |
rm_work | still think these can merge: https://review.openstack.org/434518 | 14:36 |
rm_work | https://review.openstack.org/#/c/437200/ | 14:36 |
rm_work | https://review.openstack.org/#/c/431179/ | 14:36 |
rm_work | would love to see those merge... spending a lot of time dealing with tracking them upstream and downstream T_T | 14:42 |
*** kobis has quit IRC | 14:42 | |
*** strigazi has quit IRC | 14:44 | |
*** strigazi has joined #openstack-lbaas | 15:04 | |
*** armax has joined #openstack-lbaas | 15:04 | |
*** ducttape_ has joined #openstack-lbaas | 15:05 | |
*** chlong_ has quit IRC | 15:17 | |
*** gcheresh_ has quit IRC | 15:17 | |
*** yamamoto has joined #openstack-lbaas | 15:23 | |
*** fnaval has joined #openstack-lbaas | 15:26 | |
*** yamamoto has quit IRC | 15:29 | |
*** ducttape_ has quit IRC | 15:51 | |
*** rcernin has quit IRC | 15:58 | |
*** KeithMnemonic has joined #openstack-lbaas | 15:58 | |
*** links has joined #openstack-lbaas | 16:07 | |
*** ducttape_ has joined #openstack-lbaas | 16:15 | |
*** kobis has joined #openstack-lbaas | 16:16 | |
*** eezhova has quit IRC | 16:18 | |
openstackgerrit | German Eichberger proposed openstack/neutron-lbaas master: Octavia Proxy Plugin https://review.openstack.org/418530 | 16:24 |
*** yamamoto has joined #openstack-lbaas | 16:26 | |
*** yamamoto has quit IRC | 16:30 | |
*** ducttape_ has quit IRC | 16:37 | |
diltram | rm_work: looks good :) | 16:46 |
diltram | even some basic checks will change a lot in this case | 16:46 |
diltram | when we don't have anything real testing it | 16:46 |
johnsom | Active/Active meeting starting on the hour.... | 16:53 |
diltram | johnsom: it suppose to be right now | 16:55 |
diltram | like in 5 minutes | 16:55 |
johnsom | Yep | 16:55 |
diltram | resheduled? | 16:55 |
diltram | rescheduled? | 16:56 |
johnsom | No | 16:56 |
*** matt-borland has quit IRC | 16:56 | |
johnsom | 17:00 UTC... | 16:57 |
diltram | so it's gonna be in 1 hour or 3 minutes? | 16:57 |
johnsom | In 3 minutes | 16:57 |
*** matt-borland has joined #openstack-lbaas | 16:57 | |
diltram | ok :P | 16:57 |
nmagnezi | johnsom, tried to join, but looks like webex does not like linux | 17:05 |
nmagnezi | "Your browser, browser version, or operating system is currently unsupported." | 17:05 |
*** yamamoto has joined #openstack-lbaas | 17:26 | |
*** yamamoto has quit IRC | 17:32 | |
*** ducttape_ has joined #openstack-lbaas | 17:37 | |
*** ducttape_ has quit IRC | 17:38 | |
*** ducttape_ has joined #openstack-lbaas | 17:38 | |
*** kobis has quit IRC | 17:39 | |
*** tesseract has quit IRC | 17:42 | |
*** KeithMnemonic has quit IRC | 17:47 | |
*** ducttape_ has quit IRC | 17:49 | |
*** eezhova has joined #openstack-lbaas | 18:01 | |
*** eezhova has quit IRC | 18:02 | |
*** links has quit IRC | 18:04 | |
*** eezhova has joined #openstack-lbaas | 18:05 | |
*** SumitNaiksatam has joined #openstack-lbaas | 18:05 | |
johnsom | Good stuff for Act/ACt | 18:10 |
*** krypto has quit IRC | 18:15 | |
johnsom | Wow, all of our talks got accepted per the web site. | 18:23 |
johnsom | We are going to be busy | 18:23 |
*** eezhova has quit IRC | 18:27 | |
*** yamamoto has joined #openstack-lbaas | 18:28 | |
*** gcheresh_ has joined #openstack-lbaas | 18:31 | |
*** yamamoto has quit IRC | 18:33 | |
openstackgerrit | Lubosz Kosnik (diltram) proposed openstack/octavia master: Allow to create vip in lb-mgmt-net https://review.openstack.org/431179 | 18:33 |
*** armax has quit IRC | 18:38 | |
xgerman | johnsom - hu? | 18:43 |
xgerman | all talks? | 18:43 |
johnsom | All of them | 18:44 |
johnsom | Hands on included | 18:44 |
*** ducttape_ has joined #openstack-lbaas | 18:50 | |
*** ducttape_ has quit IRC | 18:55 | |
*** kobis has joined #openstack-lbaas | 19:13 | |
*** armax has joined #openstack-lbaas | 19:17 | |
*** SumitNaiksatam has quit IRC | 19:19 | |
*** yamamoto has joined #openstack-lbaas | 19:30 | |
*** kobis has quit IRC | 19:34 | |
*** yamamoto has quit IRC | 19:35 | |
*** ducttape_ has joined #openstack-lbaas | 19:51 | |
*** ducttape_ has quit IRC | 19:56 | |
*** eandersson has joined #openstack-lbaas | 20:01 | |
eandersson | Any news on lbaas being added to the openstack client? | 20:01 |
johnsom | Yes, it is in plan for Pike. We created our repository today. https://governance.openstack.org/tc/reference/projects/octavia.html | 20:02 |
johnsom | python-octaviaclient | 20:02 |
openstackgerrit | Merged openstack/octavia master: Switch to use exec_command instead of mount/umount https://review.openstack.org/442726 | 20:14 |
*** kobis has joined #openstack-lbaas | 20:21 | |
*** yamamoto has joined #openstack-lbaas | 20:31 | |
*** yamamoto has quit IRC | 20:35 | |
*** gcheresh_ has quit IRC | 20:39 | |
*** chlong_ has joined #openstack-lbaas | 20:47 | |
openstackgerrit | Merged openstack/neutron-lbaas master: Switch to use stable data_utils https://review.openstack.org/442768 | 20:48 |
openstackgerrit | Merged openstack/neutron-lbaas master: Switch to use exec_command instead of mount/umount https://review.openstack.org/442721 | 20:49 |
*** ducttape_ has joined #openstack-lbaas | 20:52 | |
*** kobis has quit IRC | 20:54 | |
*** ducttape_ has quit IRC | 20:56 | |
*** matt-borland has quit IRC | 21:02 | |
*** matt-borland has joined #openstack-lbaas | 21:03 | |
*** yamamoto has joined #openstack-lbaas | 21:32 | |
*** yamamoto has quit IRC | 21:38 | |
*** itsuugo has joined #openstack-lbaas | 21:41 | |
*** itsuugo is now known as aojea_ | 21:47 | |
*** aojea_ is now known as aojea | 21:50 | |
*** aojea has quit IRC | 21:51 | |
*** aojea has joined #openstack-lbaas | 21:52 | |
*** ducttape_ has joined #openstack-lbaas | 21:52 | |
*** ducttape_ has quit IRC | 21:57 | |
openstackgerrit | Adam Harwell proposed openstack/octavia master: Fix cascade delete flow (pool quota requirements missing) https://review.openstack.org/437200 | 22:03 |
rm_work | weird | 22:03 |
rm_work | needs +A again | 22:03 |
eandersson | That's awesome johnsom. | 22:16 |
*** ducttape_ has joined #openstack-lbaas | 22:28 | |
*** kobis has joined #openstack-lbaas | 22:30 | |
*** kobis has quit IRC | 22:31 | |
*** matt-borland has quit IRC | 22:35 | |
rm_work | johnsom: still around? | 22:38 |
johnsom | Yep, in a meeting now though | 22:39 |
rm_work | k | 22:39 |
*** catintheroof has joined #openstack-lbaas | 22:39 | |
rm_work | wtf is going on with https://review.openstack.org/#/c/443336/ -- first it randomly failed on pep8 for no discernable reason, now it failed on the trusty functional check, then rechecked and passed that but failed on centos? >_> | 22:45 |
rm_work | are the *voting* jobs for DIB unreliable? | 22:46 |
ThiagoCMC | Hey guys, does Octavia works as a container, instead of a VM? | 22:46 |
ThiagoCMC | Maybe LXD instead of KVM? | 22:46 |
rm_work | it's in active development to use lxd | 22:46 |
ThiagoCMC | That's awesome! | 22:46 |
rm_work | ThiagoCMC: diltram is working on it, hopefully it will work "soon" | 22:46 |
ThiagoCMC | :-D | 22:47 |
johnsom | rm_work The pep8 issue I understood, it has a check for the '-e' I disabled. So I pushed a fix for that, but the other randoms, yeah, concerning.... Not 100% sure why the trusty gate failed with an issue pulling fedora packages.... | 22:50 |
johnsom | Also, off my call now so.... | 22:50 |
rm_work | i'm looking at the session stuff currently | 22:50 |
rm_work | i don't see why the lock session wouldn't pick up the thing that was flushed right before it in the normal session | 22:50 |
rm_work | but somehow it doesn't | 22:50 |
rm_work | or it locks | 22:51 |
rm_work | :/ | 22:51 |
johnsom | Ok. So, Yeah, that is the question. It *was* picking it up with the flush for me. Maybe we need to call an expire (or something similar) on the lock session? SqlAlchemy has so many nuances with it's session management. | 22:52 |
rm_work | yeah i was looking | 22:52 |
*** eezhova has joined #openstack-lbaas | 22:52 | |
rm_work | checking how exactly the row is created | 22:52 |
johnsom | That query for update is still the first command in the lock_session right? That could throw it off if not. | 22:53 |
rm_work | like, it's already flushing inside the transaction | 22:53 |
rm_work | so the outer flush should be superfluous | 22:53 |
rm_work | ah the update returns the quota object | 22:54 |
rm_work | err | 22:54 |
rm_work | maybe that's ok? it's not a locking get() | 22:54 |
rm_work | hmm | 22:54 |
johnsom | So here is how it is supposed to work: | 22:54 |
rm_work | do we need a transaction for the lock-session query.withforupdate? | 22:56 |
johnsom | if there is no quota for the project, use the context session to create an empty project_id row for quotas. This is an autocommit session, so it should commit immediately. I flush the session to make sure. Then below, using the lock session(non-autocommit) I query for update that row, which should lock that row to do the quota check. | 22:56 |
johnsom | lock_session is a transaction session | 22:57 |
rm_work | oh wait, that's exactly what we removed in this patch | 22:57 |
rm_work | right | 22:57 |
rm_work | can we uhh... flush the lock session right before? | 22:59 |
*** ducttape_ has quit IRC | 22:59 | |
johnsom | So, is your use case still "It locks up when there is no entry yet for some project_id in the quota table. So, If you clear out the quota table completely (like from a new DB create or manually), then try to do a single-create as your first call, it will lock in the API. | 23:01 |
johnsom | If you do any other thing first to get an entry created, for example do an LB create (and delete it or not, doesn't matter), then you will have a row in `quota` and doing a single-create will proceed." | 23:01 |
johnsom | If anything it would be an expire, but that should be the first query on that session, so there shouldn't be any stale data | 23:03 |
*** armax has quit IRC | 23:04 | |
*** ducttape_ has joined #openstack-lbaas | 23:04 | |
rm_work | hmm | 23:05 |
*** aojea has quit IRC | 23:05 | |
rm_work | ah | 23:06 |
rm_work | that update is a subtransaction | 23:07 |
rm_work | so it commits out of the subtransaction | 23:07 |
rm_work | but it's still in a parent transaction | 23:07 |
rm_work | see repositories.py line 494+3 | 23:07 |
rm_work | johnsom: ^^ | 23:08 |
johnsom | What about it? | 23:08 |
rm_work | so we have like | 23:09 |
rm_work | session / lock_session | 23:09 |
johnsom | Oh, there is another lock_session there | 23:09 |
rm_work | then we make session(1) and create the row and flush | 23:09 |
rm_work | oh? | 23:09 |
johnsom | line 496, that is probably a problem | 23:10 |
rm_work | anyway, the new row is now in "session(0)" but THAT is still not flushed? | 23:10 |
rm_work | errr what about it? | 23:10 |
johnsom | Oh, we took it out, nevermind. I'm looking at master in one window and the patch in another. So, that was already fixed | 23:11 |
rm_work | oh nm i am wrong, it uses that one | 23:11 |
rm_work | we're not in a subtransaction | 23:11 |
rm_work | fff | 23:11 |
rm_work | lost again | 23:12 |
johnsom | Ok, so I just loaded up the code the way I think it should be and I want to try to repro | 23:12 |
johnsom | Just follow those previous comments? | 23:12 |
rm_work | yeah | 23:13 |
rm_work | it gets the deadlock on .first() | 23:14 |
johnsom | Yeah, I bet I know what is happening. It deadlocks on listener right? | 23:15 |
rm_work | err | 23:16 |
rm_work | quotas = lock_session.query(models.Quotas).filter_by( | 23:16 |
rm_work | project_id=project_id).with_for_update().first() | 23:16 |
rm_work | it deadlocks on the .first() | 23:16 |
rm_work | i split it up | 23:16 |
rm_work | into multiple lines to check | 23:16 |
johnsom | Yeah, but doing a single call create, it will pass the LB check, but lock on the listener check | 23:16 |
rm_work | err | 23:17 |
rm_work | it locks on the very first check | 23:17 |
johnsom | The second call into check_quota_met | 23:17 |
rm_work | no | 23:17 |
rm_work | first | 23:17 |
rm_work | also: | 23:17 |
rm_work | 2017-03-09 16:17:00.210 19422 DEBUG octavia.db.repositories [req-1aa34152-9085-41cb-b676-8c64fcb46443 - - - - -] q1: <octavia.db.models.Quotas object at 0x4f23a50> check_quota_met /opt/octavia/env/lib/python2.7/site-packages/octavia/db/repositories.py:287 | 23:17 |
rm_work | 2017-03-09 16:17:00.210 19422 DEBUG octavia.db.repositories [req-1aa34152-9085-41cb-b676-8c64fcb46443 - - - - -] q2: None check_quota_met /opt/octavia/env/lib/python2.7/site-packages/octavia/db/repositories.py:288 | 23:17 |
rm_work | q1 = session.query(models.Quotas).filter_by(project_id=project_id).first() | 23:18 |
rm_work | q2 = lock_session.query(models.Quotas).filter_by(project_id=project_id).first() | 23:18 |
rm_work | LOG.debug("q1: {}".format(q1)) | 23:18 |
rm_work | LOG.debug("q2: {}".format(q2)) | 23:18 |
rm_work | I put that right before the get for update | 23:18 |
rm_work | the lock_session can't see the row | 23:18 |
rm_work | and it is definitely the FIRST run of check_quotas | 23:19 |
rm_work | *check_quota_met | 23:19 |
rm_work | I have a ton of debug logging in there | 23:19 |
rm_work | i'd know if it ran more than once | 23:19 |
johnsom | I think we are talking about two different things. Can you send me the curl you are using to repro? | 23:20 |
rm_work | curl -s -X POST -H Content-type:application/json -H "X-Auth-Token:$TOKEN" -d '{"name": "test_singlecreate_lb", "vip": {"network_id": "'$NETWORK'"}, "listeners": [{"name": "test_listener", "protocol": "HTTP", "protocol_port": 80, "default_pool": {"name":"test_pool", "protocol": "HTTP", "lb_algorithm": "ROUND_ROBIN", "members": [{"ip_address": "'$MEMBER1_IP'", "protocol_port": 80}, {"ip_address": "'$MEMBER2_IP'", "protocol_port": | 23:20 |
rm_work | 80}]}}]}' http://${OCTAVIA_IP}:${OCTAVIA_PORT}/v1/loadbalancers | 23:20 |
johnsom | Thanks | 23:20 |
rm_work | i can screenshare | 23:21 |
*** chlong_ has quit IRC | 23:21 | |
rm_work | the problem very clearly seems to be that we are not seeing the object be flushed | 23:23 |
*** eezhova has quit IRC | 23:24 | |
rm_work | ah yeah it's definitely because we session.begin above | 23:25 |
rm_work | we flush but it does nothing | 23:26 |
rm_work | we need to commit | 23:26 |
rm_work | umm | 23:26 |
johnsom | You removed the lock_session change right? | 23:26 |
rm_work | why are we even doing this session.begin | 23:26 |
rm_work | yes | 23:26 |
rm_work | hold up | 23:26 |
rm_work | i might have it | 23:27 |
johnsom | That command does not fail for me | 23:29 |
rm_work | yep | 23:29 |
rm_work | i got it | 23:29 |
rm_work | pushing up the fix | 23:29 |
rm_work | are you using auth? | 23:30 |
johnsom | No | 23:31 |
rm_work | and did you clear your quotas table? | 23:31 |
johnsom | Yes | 23:31 |
rm_work | <_< | 23:31 |
rm_work | without auth it doesn't use quotas | 23:31 |
rm_work | remember? | 23:31 |
johnsom | Right, darn, noauth. Ugh | 23:31 |
rm_work | yeah this is it | 23:32 |
rm_work | pushing up | 23:32 |
rm_work | outer session is pointless | 23:35 |
*** yamamoto_ has joined #openstack-lbaas | 23:35 | |
openstackgerrit | Adam Harwell proposed openstack/octavia master: Fix quota lock on single_create with auth enabled https://review.openstack.org/434518 | 23:35 |
rm_work | and actually is essentially a second lock-session for these purposes | 23:35 |
rm_work | isn't necessary' | 23:35 |
rm_work | https://review.openstack.org/#/c/434518/6/octavia/db/repositories.py | 23:36 |
rm_work | see removal of session on 495/493 | 23:36 |
rm_work | maybe this is clearer: https://review.openstack.org/#/c/434518/5..6/octavia/db/repositories.py | 23:36 |
johnsom | You were just removing that subtransaction? | 23:37 |
rm_work | i really wish de-indent was less badly shown | 23:37 |
rm_work | removing that session.begin | 23:37 |
rm_work | because the update() does its own | 23:37 |
rm_work | and having an outer one here | 23:37 |
johnsom | I agree, it is pointless, but I had to put it in to work around a sqlalchemy bug.... | 23:37 |
rm_work | means there's nothing committed | 23:37 |
rm_work | when it's inside check_quota_met it has this session and a lock_session | 23:38 |
rm_work | when it creates the row in session, it isn't committed yet | 23:38 |
rm_work | because it is in a parent transaction | 23:38 |
rm_work | so lock_session can't see it | 23:38 |
rm_work | no amount of flushing will help | 23:38 |
johnsom | Ah, that kind of makes sense, but session is autocommit, it should commit instantly... | 23:39 |
rm_work | the whole point of session vs lock_session is that one commits immediately | 23:39 |
rm_work | err | 23:39 |
rm_work | autocommit only works if you *don't* session.begin() | 23:39 |
johnsom | I wish I could remember the sqlalchemy bug that caused me to re-add that. I know it was a late night, I couldn't figure out why the heck it wasn't working right and when I added that the bug went away. | 23:40 |
rm_work | maybe because of the way the lock_session was working then? | 23:40 |
rm_work | because we've changed quite a bit | 23:40 |
*** yamamoto_ has quit IRC | 23:40 | |
rm_work | lock_session used to be ... kinda inside this transaction? | 23:41 |
rm_work | anyway if you test with that it'll work | 23:41 |
johnsom | Yeah, loading it up now | 23:42 |
rm_work | is diltram or xgerman around? | 23:45 |
johnsom | not sure. | 23:45 |
rm_work | i am, as usual, impatient to get these freaking things merged | 23:45 |
rm_work | have one that needs a +A again because jenkins didn't auto-rebase correctly? | 23:45 |
rm_work | not sure why | 23:45 |
rm_work | wait sonar failed why | 23:46 |
rm_work | ugh sec | 23:46 |
rm_work | forgot to redo tests | 23:46 |
rm_work | one of them relies on that session i think | 23:46 |
rm_work | fixing | 23:46 |
johnsom | Yeah, ok, that is working for me | 23:47 |
rm_work | lol yeah the one that i changed the test | 23:47 |
*** ducttape_ has quit IRC | 23:48 | |
xgerman | wassup | 23:50 |
* xgerman goes back to playing with kids | 23:50 | |
rm_work | ahh ok | 23:53 |
rm_work | I see the issue | 23:54 |
rm_work | ok so we need a sub-transaction but not THERE | 23:54 |
rm_work | sec | 23:54 |
rm_work | oh or we can just use the lock-session I think | 23:54 |
rm_work | wait, we are | 23:54 |
rm_work | wtf | 23:54 |
rm_work | this test is ... behaving oddly | 23:57 |
*** ducttape_ has joined #openstack-lbaas | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!