Wednesday, 2013-09-04

*** dims has quit IRC00:00
*** bearhands is now known as comstud00:00
*** danwent has quit IRC00:01
*** hemna_ is now known as hemnafk00:02
*** noorul`` has quit IRC00:02
*** faramir has joined #openstack-dev00:03
*** amotoki_ has quit IRC00:06
*** amotoki_ has joined #openstack-dev00:06
*** jasdeepH has quit IRC00:07
*** armax has left #openstack-dev00:07
*** danwent has joined #openstack-dev00:08
*** alok_ has quit IRC00:09
*** lbragstad has joined #openstack-dev00:11
*** amotoki_ has quit IRC00:12
*** dkranz has joined #openstack-dev00:12
*** shanewang_away is now known as shanewang00:13
*** colinmcnamara has joined #openstack-dev00:14
*** jasdeepH has joined #openstack-dev00:16
*** michchap has joined #openstack-dev00:16
*** dims has joined #openstack-dev00:16
gyeeayoung, dolphm, morganfainberg, can you guys please take a look at https://review.openstack.org/#/c/40036/00:18
gyeewould be nice if it make the m3 cut today00:18
morganfainberggyee, you'll never guess what i was just looking at00:18
gyeemorganfainberg, I am trying to give nachi a lift00:19
gyeewant to gether all the inputs00:19
*** sushils has quit IRC00:19
gyeegather all the inputs so do the patch in one shot00:19
*** galstrom_zzz is now known as galstrom00:20
*** jhesketh_ has joined #openstack-dev00:21
ayounggyee, lookinj00:21
ayoungah, he fixed the pep8...00:22
ayounggyee, I need some background on this one00:22
ayoungwhat is the problem here?00:23
*** sthaha has joined #openstack-dev00:24
*** sthaha has quit IRC00:24
*** sthaha has joined #openstack-dev00:24
*** safchain has quit IRC00:24
*** otherwiseguy has joined #openstack-dev00:25
*** rwsu is now known as rwsu-away00:26
*** dstanek has quit IRC00:27
*** nati_uen_ has quit IRC00:28
*** fbo_away has quit IRC00:29
*** stevemar has joined #openstack-dev00:29
ayoungmorganfainberg, do you get what he means by Protocol Agnostic?00:29
morganfainbergayoung, not really sure what he means by that00:29
morganfainbergayoung, i am guessing it's HMAC signature, which is protocol (e.g. EC2?) agnostic?00:30
morganfainbergayoung, but i think i'm missing the use case.  (hasn't clicked for me yet)00:31
*** shakayumi has quit IRC00:31
morganfainberggyee, any insight you could provide?00:31
*** galstrom is now known as galstrom_zzz00:32
*** sridevi has joined #openstack-dev00:33
morganfainbergayoung, https://blueprints.launchpad.net/keystone/+spec/generic-signature-validation looks like there is a lot of description there00:33
*** Ryan_Lane has quit IRC00:33
*** jamielennox|away is now known as jamielennox00:34
*** diogogmt has joined #openstack-dev00:35
*** flaper87 is now known as flaper87|afk00:36
ayoungmorganfainberg, full of sound and fury00:36
ayoungmorganfainberg, thing is, I like the cleanup in that patch all by itself00:36
morganfainbergayoung, aye00:36
morganfainbergayoung, much nicer setup.00:37
*** tjones has quit IRC00:37
ayoungHMAC is Hash Based Message Authentication Code, which is really what we do in PKI messages:  and one weakness there is that it is limited to MD5 for now00:37
ayoungBUt I don't think he means "Algorithm Agnostic"00:38
*** rfolco has quit IRC00:38
*** tjones has joined #openstack-dev00:38
ayoungand he talks about middleware, but that really shold be in the Keystone client00:38
*** safchain has joined #openstack-dev00:39
ayoungmorganfainberg, do we need to support additional HMAC based authentication?  I want to get away from all this custom authN stuff.00:39
morganfainbergayoung, it would remove the need for a special S3 and special EC2 mechanism, it looks like00:40
ayoungmorganfainberg, but we don't use those to authenticate to Keystone00:41
ayoungoh, the contrib extensions00:41
morganfainbergayoung, yes.00:41
ayoungI thought that stuff was legacy00:41
ayoungmorganfainberg, do we want to continue to extend that?00:42
ayoungI kindof fail to see the burning need for this.00:42
morganfainbergayoung, i think there is still some interest in it, but i don't see a need to continue to extend.  the current ec2 middleware hasn't worked since nova removed the "FLAG" import00:42
ayoungHeh00:42
morganfainbergayoung, minimal interest != need to support.00:42
ayoungI think I acked that patch00:43
ayoungso...pocket veto?00:43
ayoungOr do we ack it to get the nicer code layout?00:43
morganfainbergayoung, thing is, i kinda want the cleanup :P00:43
gyeemorganfainberg, ayoung, sorry I got pulled away for a meeting, back now00:43
ayoungOK,  help me build a rationalization00:43
ayounggyee, what is the burning use case for it00:43
ayounggyee, we like the code cleanup, but can't see justification for the patch itself...help us understand00:44
gyeeayoung, signature-based authentication00:44
ayounggyee, do we need that?00:44
ayoungTO keystone?00:44
gyeewe need a generic HMAC base signature authentication00:44
ayoungNO we don't00:44
morganfainberggyee, for example, the middleware for ec2 (in keystone) hasn't worked … at least since the patch nova removed the FLAGS import.00:44
ayounggyee, maybe *you* do, though?00:45
morganfainbergwhich, iirc was the primary consumer of that.00:45
gyeeayoung, not just ec200:45
gyeeany HMAC-based signatures00:45
ayoungand, is EC2 HMAC, or is it PKI?  I thought EC2 was based on asymmetric keys?00:45
gyeeAWS, S3, formpost, tempurl, etc00:46
gyeeHMAC is symmetric key00:46
ayoungI know that.00:46
ayoungI thought EC2 was asym00:46
*** jasondotstar has joined #openstack-dev00:46
gyeeEC2 is HMAC-based00:46
*** dstanek has joined #openstack-dev00:46
morganfainberggyee, right00:47
ayoungSo EC2 Auth is not based on EC2 Keyspairs?  What a clever naming scheme00:48
gyeeEC2 keypairs is a bad name00:48
gyeeaccess key ID is not a key00:48
gyeeaccess key ID is more like a user ID00:49
*** Tross has left #openstack-dev00:49
*** hugokuo has left #openstack-dev00:49
ayounggyee, OK, so we get a V3 version of EC2 and Swift this way.00:49
morganfainberggyee, makes it easier to implement .. what ayoung said00:50
*** rfolco has joined #openstack-dev00:50
gyeeayoung, right, with this, we can essentially implement any kind of HMAC-based signature validation at middleware00:50
ayounggyee, this is burning?00:50
gyeeayoung, hell yeah00:50
ayounggyee, please expound why?00:51
gyeeso we can start working on HMAC-based middlewares00:51
morganfainberggyee, you mean an update to say http://git.openstack.org/cgit/openstack/keystone/tree/keystone/middleware/ec2_token.py ?00:52
ayounggyee, middlewares?  THose should be in keystone client, not in Keystone server00:53
*** vladimir3p has quit IRC00:53
*** sridevi has quit IRC00:53
gyeemoranfainberg, ayoung, but we need this working before we can work on keystoneclient side00:53
*** nos_ has joined #openstack-dev00:54
*** nos_ has quit IRC00:54
*** hugokuo has joined #openstack-dev00:55
*** nosnos has joined #openstack-dev00:55
*** changbl has quit IRC00:55
ayounggyee, who needs this?  Is new HMAC based middlewares a high demand Item?00:56
morganfainberggyee, so there is a demand to maintain the EC2/S3 or new HMAC middlewares?00:56
gyeemorganfainberg, correct, https://github.com/openstack/keystone/blob/master/keystone/middleware/ec2_token.py will just be calling the auth plugin for v300:56
morganfainbergayoung, damn it, you beat me to the question again.00:57
gyeeayoung, I know HP needs it :)00:57
*** jasondotstar has quit IRC00:57
stevemargyee: anyone else? :)00:58
gyeestevemar, I don't have access to the customers list00:59
*** Ruetobas has joined #openstack-dev00:59
ayounggyee, more info please...Why does HP need it?00:59
gyeeayoung, uh, because we use openstack?01:00
*** yjiang5 is now known as yjiang5_away01:00
ayounggyee, thing is, I don;t think this code supports EC2 as is01:00
*** freedomhui has joined #openstack-dev01:00
stevemargyee: i meant more as... any other folks mentioned they would want this (like rax, nebula, etc)01:00
*** changbl has joined #openstack-dev01:00
morganfainberggyee, ec2 code is moribund at this point (the middleware) that is.01:01
*** giroro_ has joined #openstack-dev01:01
gyeemorganfainberg, we're going to fix it01:01
ayounggyee, if this came in with a working swift and ec2 implementation, complete with unit tests, I might be more favorable01:02
*** mars has quit IRC01:02
gyeestevemar, I can ask but their lawyers may say no :)01:02
gyeeayoung, can't work on middleware till this one is there01:03
gyeeunless you want it as multiple patches01:03
*** Ruetobas has quit IRC01:04
gyeemorganfainberg, nova doesn't support euca2ools anymore?01:04
ayounggyee, you are asking me to buy a pig in a poke.  I don't know that this code as is does anything useful, and the only justification you give me is something HP confidential.  How would you react if the roles were reversed?01:04
*** giroro_ has quit IRC01:04
morganfainberggyee, not sure.01:04
gyeeayoung, how do we support HMAC-based sig authentication today?01:06
morganfainberggyee, iirc we don't.01:06
gyeepretty much all extensions01:06
morganfainbergwell, contrib extensions01:06
ayounggyee, but that would not change with this patch01:07
gyeeall I am saying is, with this we don't need extensions01:07
ayoungmaybe it would if it went in in H1 and then the Swift etc patches followed01:07
*** colinmcnamara has quit IRC01:07
ayoungbut putting it in the night of the deadline with no functioning mechanisms seems fooloish01:07
morganfainberggyee, would it be viable to push this for Icehouse-1?01:07
ayounggyee, I think you are wrong01:08
gyeeI1 is fine01:08
ayoungI think we would still need additional code at least for EC201:08
ayoungfrom what I've seen01:08
gyeeayoung, nope01:08
morganfainbergit seems like the likelyhood of hitting H-final with anything useful out of it (besides the code-cleanup) is slim01:08
ayounggyee, I'm more than happy to have it in I001:08
ayoungbut with working implementations for Swift and EC2, can be dependent patches01:09
gyeeayoung, that's fine, the earlier it gets in, the earlier we can make middleware changes01:09
ayoungdeal01:09
morganfainbergayoung ++01:09
*** safchain has quit IRC01:09
gyeeayoung, morganfainberg, sure, I suppose we can make middleware changes in parallel01:10
gyeethat would give you guys more context on why the patch is needed01:10
morganfainberggyee, yes, i am on board with that01:11
*** Ruetobas has joined #openstack-dev01:11
gyeesorry I can disclosed any more without the corporate lawyers all over my ass01:11
gyeecan't01:11
ayounggyee, statements like that make me want to whip out the -2 gun and start shooting at your reviews01:12
*** Mandell has quit IRC01:12
morganfainberggyee, i can understand corporate lawyer issues, but it makes it hard to review/see what the benefit (or need) is for a given featureset01:12
morganfainberggyee, especially an AuthN or AuthZ addition at the 11th hour01:13
ayoungnow, that being said, anyone want to look at some PKI code cleanups?01:13
gyeemorganfainberg, ayoung, yeah, lets do this on etherpad and whiteboard01:13
*** erkules_ has joined #openstack-dev01:14
*** SumitNaiksatam has quit IRC01:14
morganfainberggyee, that makes sense.01:14
morganfainberggyee, good plan01:14
ayounghttps://review.openstack.org/#/c/43768/ gyee morganfainberg01:14
gyeewow, what's a commit message01:15
ayoungand https://review.openstack.org/#/c/43767/401:15
ayounggyee, I know, he's a little terse01:15
morganfainbergayoung, wow.01:16
gyeehttps://review.openstack.org/#/c/43767 is a no brainer01:16
*** jhesketh has quit IRC01:16
morganfainberggyee, agreed01:16
*** erkules has quit IRC01:16
*** jhesketh has joined #openstack-dev01:16
*** angdraug has quit IRC01:17
morganfainberggyee, the other one looks sane, it's mostly code htat should land in oslo soon01:17
morganfainberggyee, ayoung, i want to once over it of course.01:18
ayoungjdennis1, is a pretty good python coder.  With he wouldn't be so stingy with the wordcount on his commit messages, though.01:18
ayoungplease do01:19
ayoungI'd almost classify it as a bug fix, but of course, it goes beyond that01:19
morganfainbergyes.01:19
*** amotoki_ has joined #openstack-dev01:20
ayounggyee, you should know this code.  I think you and I both have worked on it over time01:21
*** tjones has quit IRC01:22
gyeeayoung, I only claim the credit when something is working :)01:22
ayounghe made the mistake of reusing a bug id...but an earlier commit claimed it...must have been a partial fix01:22
*** tjones has joined #openstack-dev01:23
gyeeayoung, the stuff in keystone.common.utils will be part of oslo?01:23
*** briancurtin has joined #openstack-dev01:24
*** amotoki_ has quit IRC01:24
ayounggyee, my bad, I was thinking of the Cert setup stuff you did in examples.01:24
ayounggyee, I don;t know if he has submitted it there or not01:24
ayounggyee, he has no outstanding reviews to oslo01:25
morganfainbergayoung, the commit message says it's supposed to go to oslo01:25
morganfainberg"soon"01:25
morganfainbergsorry "near future"01:25
ayoungmorganfainberg, right.  But then, once it does, it has to be merged down again, a system I am starting to think is not right for code that can have security implications01:26
morganfainbergayoung, i'm not a huge fan of it.01:26
*** dolphm has quit IRC01:26
ayounganyway...it seems pretty straightforward.01:27
morganfainbergayoung, i know we shun eventlet, but isn't the reason make_dirs etc is farmed out to shutils is so eventlet can patch/non-blocking run?  or am i mis-remembering things?01:27
morganfainberg*shun might be a strong word01:28
*** freedomhui has quit IRC01:28
ayoungmorganfainberg, I shun it...but let me see if I can find a reference01:29
ayoungmorganfainberg, but..that is probably reason enough not to push this one in tonight01:29
ayounglet me add that this is a bug fix, so we can probably get it in after tonight, assuming we straighten out the bug report01:29
morganfainbergayoung, i might be totally mis-remembering. but i'd rather be 2x sure rather than having to revert.01:30
morganfainbergayoung, exactly, bug fix = easier than blueprint on this timeline.01:30
ayoungjdennis1, you here?01:30
gyeemorganfainberg, but this is CLI change, why eventlet concern?01:31
morganfainberggyee oh01:31
morganfainberggyee, no concern for CLi01:31
ayoungYeah, this is in Keystone, but will only be invoked by keystone manage01:32
morganfainberggyee, good point01:32
morganfainbergayoung, then strike that last concern.01:32
ayoung*whack*01:32
ayoungconcern struck.  Hard.01:32
morganfainbergayoung, i think you killed it01:32
gyeeheh01:32
*** freedomhui has joined #openstack-dev01:32
ayoung*whack*01:33
ayoungjust to be sure01:33
gyeehe's not breathing01:33
ayoung*whack*01:33
*** markwash has joined #openstack-dev01:33
ayounghe might be really good at holding his breath01:33
morganfainberglol01:33
ayoungOK,  anything else?  We've got 3.5 hours until midnight01:34
stevemarayoung: says you, morgan has 6.5 hrs til then01:34
morganfainbergayoung: https://review.openstack.org/#/c/44776/ might be worth sneaking in01:35
morganfainberghttpd not working, kindof bad imo01:35
*** bfschott has joined #openstack-dev01:35
morganfainbergbut it's a bug, so, could delay01:35
ayoungmorganfainberg, heh  https://review.openstack.org/#/c/40444/01:35
stevemarmorganfainberg: seems like a no brainer01:35
*** martine has joined #openstack-dev01:36
morganfainbergayoung, that was the one that was blocking until credential table stuff right?01:36
ayoungO hells yeah01:36
ayoungmorganfainberg, yeah, by me01:36
morganfainbergayoung, right.01:36
*** martine is now known as Guest15401:36
ayoungI was slacking in updating the review01:37
morganfainbergyeah that one by jdennis1 looks good, approving.01:38
stevemarayoung, morganfainberg: are you guys looking for easy to approve things to get in?01:38
morganfainbergstevemar, not so much easy, things that should get in01:38
stevemarah01:38
ayoungmorganfainberg, I know that 40444 is needed by heat01:39
ayounglike to get that in01:39
stevemarwell, easy AND should go in: https://review.openstack.org/#/c/44543/01:39
morganfainberglooking now01:39
*** litong has joined #openstack-dev01:39
morganfainbergstevemar, only thing i was curious on for the man page was date/version01:39
morganfainbergstevemar other than that, it looks good to me01:39
stevemaroh yeah, you mentioned that during the meeting01:40
ayoungok, can you create a token from a key pair?  YOu can...this might be a no-go01:40
*** SumitNaiksatam has joined #openstack-dev01:40
*** HenryG has joined #openstack-dev01:42
gyeeayoung, you can01:42
ayoungmorganfainberg, can you check my logic on that01:42
morganfainbergayoung, looking at it now,01:42
morganfainbergayoung, it's looking like you can.01:42
ayoungSo that is the problem with delegation....you can never lose track of the fact that you are delegating.01:43
morganfainbergyep.01:43
ayoungDamnit, wish he had pinged me earlier01:43
*** jasdeepH has quit IRC01:43
*** tjones has quit IRC01:44
ayoungshardy_afk, you around?01:44
*** zz_Guest12172 is now known as leif01:45
*** leif is now known as Guest8410301:45
*** pabelanger has joined #openstack-dev01:46
*** nati_ueno has quit IRC01:48
*** nati_ueno has joined #openstack-dev01:48
*** adalbas has quit IRC01:51
*** ayoung has quit IRC01:52
*** insanidade has joined #openstack-dev01:52
*** Guest84103 is now known as zz_Guest8410301:55
*** galstrom_zzz is now known as galstrom01:55
*** giroro_ has joined #openstack-dev01:56
*** alexxu has joined #openstack-dev01:57
*** trey_h has joined #openstack-dev01:57
*** freedomhui has quit IRC01:57
*** Ruetobas has quit IRC01:58
*** Ruetobas has joined #openstack-dev01:59
*** d34dh0r53 has joined #openstack-dev01:59
*** tjones has joined #openstack-dev01:59
*** yaguang has joined #openstack-dev01:59
*** dolphm has joined #openstack-dev02:00
*** giroro_ has quit IRC02:00
*** d34dh0r53 has quit IRC02:01
*** freedomhui has joined #openstack-dev02:01
*** Guest154 is now known as martine_02:03
*** jbresnah_ has quit IRC02:04
*** colinmcnamara has joined #openstack-dev02:04
*** gyee has quit IRC02:04
*** Ruetobas has quit IRC02:07
*** trey_h has quit IRC02:08
*** stevemar has quit IRC02:08
*** trey_h has joined #openstack-dev02:08
*** Ruetobas has joined #openstack-dev02:10
*** dolphm has quit IRC02:10
*** galstrom is now known as galstrom_zzz02:11
*** ayoung has joined #openstack-dev02:11
*** dperaza1 has quit IRC02:12
*** trey_h has quit IRC02:13
*** mdenny has joined #openstack-dev02:13
*** Ruetobas has quit IRC02:14
*** tjones has quit IRC02:14
*** MIDENN_ has quit IRC02:17
*** briancurtin has quit IRC02:17
*** kushal has joined #openstack-dev02:17
*** pixelbeat has quit IRC02:17
*** melwitt1 has quit IRC02:19
*** novas0x2a|laptop has quit IRC02:22
*** rcleere has joined #openstack-dev02:22
*** gongysh has joined #openstack-dev02:23
*** markmcclain has joined #openstack-dev02:23
*** dstanek has quit IRC02:29
*** colinmcnamara has quit IRC02:29
*** briancurtin has joined #openstack-dev02:29
*** edmund has joined #openstack-dev02:30
*** jasdeepH has joined #openstack-dev02:30
*** stevemar has joined #openstack-dev02:33
stevemarmorganfainberg: is the keystone talk over?02:34
morganfainbergstevemar, it's been a bit quiet for a bit02:34
stevemarmorganfainberg: mind if i ask you a q?02:35
morganfainbergstevemar, not at all02:35
stevemarmorganfainberg: is it possible to 'rename' a table column? in a sql migration?02:35
*** schwicht has quit IRC02:36
morganfainbergstevemar, sure it is, but sqlite support iirc you need to do a new table, select into it, and rename the table.02:36
stevemarinitially, i had the oauth table column "requested_roles", dolphm is asking if i can rename it t just roles02:36
*** sungju has joined #openstack-dev02:36
stevemardarn, not 'easy' :P02:37
*** sungju has quit IRC02:37
morganfainbergstevemar, https://sqlalchemy-migrate.readthedocs.org/en/latest/changeset.html#column-alter02:37
stevemarmorganfainberg: i thought you were going to give me a link to github of an example in nova, you seem to know every line of that project :P02:38
morganfainbergstevemar, no i'm just good at searching ;)02:38
*** kushal has quit IRC02:38
morganfainbergstevemar, i used to work mostly with nova and horizon last year.02:38
*** admiyo has joined #openstack-dev02:38
*** admiyo has quit IRC02:39
*** jasdeepH has quit IRC02:40
*** nati_ueno_2 has joined #openstack-dev02:42
*** nati_ueno has quit IRC02:46
*** nosnos_ has joined #openstack-dev02:47
*** shang has joined #openstack-dev02:47
*** nosnos has quit IRC02:49
*** dims has quit IRC02:51
*** freedomhui has quit IRC02:53
*** freedomhui has joined #openstack-dev02:53
*** danwent has quit IRC02:54
*** radez is now known as radez_g0n302:55
*** nosnos_ has quit IRC02:55
*** nosnos has joined #openstack-dev02:55
*** anteaya has quit IRC02:58
*** kushal has joined #openstack-dev03:00
*** otherwiseguy has quit IRC03:01
*** freedomhui has quit IRC03:01
stevemarmorganfainberg: give https://review.openstack.org/#/c/44509/ a review?03:02
ayoungstevemar, there is a helper function03:02
stevemarayoung: whatcha mean? one already exists?03:03
ayoungstevemar, I think so03:03
ayounglooking03:03
stevemarayoung ... really? i'll change things up if thats the case03:04
ayoungstevemar, sorry, it is for renaming a table03:04
stevemarayoung: oh, whoops, the last link was for a patch to change tests stuff03:05
ayoungstevemar, we need to stop doing sql Alchemy migrations for sqlite....messing us up.03:05
ayoungOK I'm off to bed.  gnight03:05
*** ayoung has quit IRC03:05
stevemarman he types fast03:05
*** admiyo has joined #openstack-dev03:06
*** kiall has quit IRC03:07
morganfainbergstevemar, ayoung?03:07
morganfainbergstevemar, yeah he does.03:07
stevemarmorganfainberg: yeah, he wrote 4 lines in 1 second03:07
*** mkollaro has quit IRC03:08
stevemari was half way through writing a reply and he came back with 3 replies03:08
stevemaranywho03:08
morganfainbergstevemar, i make an effort not to type that fast if I can avoid it.  tends to be too much for people to take in.03:08
morganfainbergstevemar, _generate_pase_config to tests.core eh?03:08
stevemarthanks for being nice to slow folks like myself03:08
stevemarmorganfainberg: yeah, noticed it was something fabio and i had in common03:09
stevemarand i was a comment gyee had made03:09
morganfainbergstevemar, slow? no, hard to follow via text in IM/IRC when you type crazy fast.03:09
stevemarnah, mostly slow03:09
morganfainbergnah.03:09
stevemarhehe03:09
morganfainbergyou end up with 3 conversations going at once.  not fun.03:09
*** jasdeepH has joined #openstack-dev03:10
*** martine_ has quit IRC03:11
*** paragan has joined #openstack-dev03:12
*** dstanek has joined #openstack-dev03:12
*** xchu has joined #openstack-dev03:12
*** tsmithgc has quit IRC03:14
*** jimfehlig has joined #openstack-dev03:20
*** jbresnah_ has joined #openstack-dev03:25
*** nati_ueno_2 has quit IRC03:25
*** nati_ueno has joined #openstack-dev03:26
morganfainbergstevemar, commented on your _generate_paste_config patchset03:26
*** tjones has joined #openstack-dev03:28
*** kiall has joined #openstack-dev03:29
stevemarmorganfainberg: cool, i get what you mean, i'll try and make it happen03:31
morganfainbergstevemar, since we're going for less duplicated code in this instance, why not get the rest of the duplicated stuff out of there? ;)03:32
*** freedomhui has joined #openstack-dev03:34
*** rcleere has quit IRC03:34
*** basha has joined #openstack-dev03:37
*** basha has quit IRC03:40
*** novas0x2a|laptop has joined #openstack-dev03:47
stevemarmorganfainberg http://paste.openstack.org/show/4571503:54
stevemari think i managed to get rid of just about all duplicated code :P03:54
*** phschwartz has quit IRC03:59
*** clarkb has quit IRC03:59
*** mikal has quit IRC03:59
*** aloga has quit IRC03:59
*** toabctl has quit IRC03:59
*** garyk has joined #openstack-dev03:59
*** mikal_ has joined #openstack-dev03:59
*** clarkb has joined #openstack-dev03:59
*** toabctl has joined #openstack-dev04:00
*** phschwartz has joined #openstack-dev04:00
*** garyk1 has quit IRC04:01
*** aditirav has joined #openstack-dev04:02
*** aditirav has joined #openstack-dev04:02
*** mikal_ is now known as mikal04:03
*** gongysh has quit IRC04:03
*** prekarat has joined #openstack-dev04:04
*** aloga has joined #openstack-dev04:05
*** prekarat has quit IRC04:06
*** prekarat1 has joined #openstack-dev04:06
*** noorul``` is now known as noorul04:06
morganfainbergstevemar, https://review.openstack.org/#/c/43611/2 merge conflict on that one.04:09
stevemarmorganfainberg: cool, i'll fix that one up04:09
stevemarmorganfainberg, something isn't working when I try to push too much into core.py (in my other patch)04:10
morganfainbergstevemar, how so?04:10
stevemarnot sure, the app isn't being served04:11
*** markmcclain has quit IRC04:11
stevemarwhen i try to put a breakpoint in core.py, it's not stopping :P04:11
morganfainbergstevemar, you putting a breakpoint in your new IF-Statement?04:12
*** sridevi has joined #openstack-dev04:12
morganfainbergstevemar, i'd need to see the code to help more than very limitedly.04:13
*** nati_ueno_2 has joined #openstack-dev04:14
*** Mandell has joined #openstack-dev04:14
stevemarmorganfainberg updated: https://review.openstack.org/#/c/43611/204:17
*** dstanek has quit IRC04:17
*** nati_ueno has quit IRC04:17
stevemarmorganfainberg, breakpoint is outside the IF :P - don't worry, just griping about it :P04:18
morganfainbergstevemar, ok, let me know if you need any help04:18
stevemarprobably not working because it's past midnight04:18
stevemarmachines turn against me at that time04:18
*** radez_g0n3 has quit IRC04:19
morganfainberglol04:19
*** radez_g0n3 has joined #openstack-dev04:20
*** sridevi has quit IRC04:21
*** dstanek has joined #openstack-dev04:22
stevemarmorganfainberg one of your patches failed jenkins04:23
stevemarhttp://logs.openstack.org/76/44776/2/gate/gate-tempest-devstack-vm-full/fef150e/console.html04:23
stevemarthe bug! https://bugs.launchpad.net/tempest/+bug/118267904:23
uvirtbotLaunchpad bug 1182679 in tempest "tempest.thirdparty.boto tests fail with TearDownException" [High,Incomplete]04:23
*** sridevi has joined #openstack-dev04:23
stevemarmorganfainberg, damn, you already knew04:24
morganfainbergstevemar, though i copy/pasta failed, i've typo'd reverify a couple times :P copied the one w/ "no bug" instead of the one i wanted. *shrug* oh well.04:24
*** SergeyLukjanov has joined #openstack-dev04:25
*** basha has joined #openstack-dev04:25
*** mars has joined #openstack-dev04:30
*** mars has joined #openstack-dev04:30
*** zz_Guest84103 is now known as zz_zz_Guest8410304:34
*** vartom7 has joined #openstack-dev04:35
*** reed has quit IRC04:38
*** vipul is now known as vipul-away04:44
*** yongli has joined #openstack-dev04:44
*** dstanek has quit IRC04:45
*** vipul-away is now known as vipul04:50
*** Ryan_Lane has joined #openstack-dev04:51
*** boris-42 has joined #openstack-dev04:51
stevemarmorganfainberg: for the tests related patch, i managed to move some of the logic to the test_v3 file... that okie?04:53
stevemaralso, it seems to have really slowed down the tests..., maybe it's just my system04:54
morganfainbergstevemar, i don't see a problem with it, i just didn't want each extension to have to run that specific code.04:54
stevemarfair enough04:54
*** vbian has joined #openstack-dev04:54
morganfainbergstevemar, hrm, not sure how an if check on something that should be none in most cases wouild cause a significant slow-down04:54
stevemarjust ran fabio's tests, and they are taking about 10s each04:54
morganfainbergstevemar, wow.04:55
stevemarrunning mine now, and it's going much slower than usual04:55
morganfainbergstevemar, post up your change (maybe WIP) and i'll try it on my devstack?04:55
stevemari've got a check in there to make sure it doesn't run unless EXTENSION_TO_ADD is specified04:55
morganfainbergstevemar, still seems odd that it's that much slower04:56
stevemaruploading them now04:57
stevemarbah, need to rebase04:57
morganfainbergstevemar, http://paste.openstack.org/show/45717/ is what i see before your patchset.04:58
morganfainbergso slow(ish) compared to some of the other tests.04:59
morganfainbergbut nothing that is far different than the previous runs of those tests04:59
*** dstanek has joined #openstack-dev05:01
*** radsy has quit IRC05:01
*** openmike has joined #openstack-dev05:02
*** aditirav has quit IRC05:02
*** aditirav has joined #openstack-dev05:02
*** nati_ueno has joined #openstack-dev05:02
stevemarmorganfainberg https://review.openstack.org/#/c/44509/205:05
*** nati_ueno_2 has quit IRC05:05
stevemartook me 640seconds05:05
stevemarit usually took ~30 seconds05:05
stevemar(for oauth tests)05:05
morganfainbergstevemar, py27? or just a limited test set05:06
stevemari dunno05:06
stevemargoing to try and find out how other tests are running05:06
morganfainbergstevemar, also are you using live sql tests? or just stock like tox -epy27?05:06
stevemarcause this is painfully slow05:06
morganfainbergor you're using run_tests?05:06
stevemarrun_tests05:06
*** AnilV4 has joined #openstack-dev05:08
morganfainbergstevemar, you're also causing a sizable amount of failures in things based on test_v3 it looks like: AttributeError: 'VersionTestCase' object has no attribute 'EXTENSION_TO_ADD'05:10
stevemarmorganfainberg: yep, i'm seeing that now... guess that happens when I only run the tests i'm interested in05:10
morganfainbergstevemar, i need to look at something regarding how teardown works.05:11
morganfainbergstevemar, might need to move the cache region cleanup into setUp().05:12
morganfainbergstevemar, not sure what is up in your env, but tests seem to be running fine here.05:15
stevemarmorganfainberg booourns05:15
morganfainbergstevemar, maybe grinding into swap?05:16
*** vartom7 has quit IRC05:16
stevemarmorganfainberg i looked at that, but swap seems fairly clear05:17
stevemari dunno, i'm going to do run_tests.sh -u, seems like some libraries were upgraded05:17
morganfainbergstevemar, fyi i use tox -epy27 or tox -epep8 for my tests these days05:18
morganfainbergstevemar, iirc that is what jenkins uses.05:18
stevemarprobably a good day05:18
morganfainbergalso, when checking for failed unit tests:  tox -epy27 -- -x05:18
morganfainberg(stops on first failed test)05:19
*** dstanek_ has quit IRC05:23
*** danwent has joined #openstack-dev05:23
*** briancurtin has quit IRC05:24
stevemarmorganfainberg: yep, knew that05:24
*** o_petit has joined #openstack-dev05:24
morganfainbergstevemar, anyways. i'm going to go home.05:24
morganfainbergstevemar, 1hr till midnight.05:24
morganfainbergtime to sleep (or some such)05:24
stevemarmorganfainberg: have fun05:24
stevemar:P05:25
*** sushils has joined #openstack-dev05:25
*** jbresnah_ has quit IRC05:25
*** dstanek has quit IRC05:28
*** vipul is now known as vipul-away05:29
*** Adri2000 has joined #openstack-dev05:31
*** Adri2000 has quit IRC05:31
*** Adri2000 has joined #openstack-dev05:31
*** gongysh has joined #openstack-dev05:32
*** jbresnah_ has joined #openstack-dev05:35
*** colinmcnamara has joined #openstack-dev05:35
*** sumanthns has joined #openstack-dev05:36
*** vbian has quit IRC05:36
*** openstack has joined #openstack-dev14:54
*** openstackstatus has joined #openstack-dev14:54
*** romcheg has quit IRC14:54
*** jmontemayor has quit IRC14:56
*** anniec has joined #openstack-dev14:57
*** trey_h_ has joined #openstack-dev14:57
*** imsurit has joined #openstack-dev14:58
*** basha has joined #openstack-dev15:00
*** salv-mobile has joined #openstack-dev15:00
bourkedoes anyone know why when I base my change off another change in gerrit, typing git review also seems to update the dependant change?15:01
*** trey_h has quit IRC15:01
*** edmund has joined #openstack-dev15:01
*** jmontemayor has joined #openstack-dev15:01
*** reidrac has quit IRC15:02
dolphmstevemar: i am! i'm second guessing holding off on your change though15:02
*** aeperezt has quit IRC15:02
dolphmstevemar: A) it's pre-featureproposalfreeze and B) it looks like it'd be nice to have to make backporting tests to stable/havana easier15:02
*** aeperezt has joined #openstack-dev15:03
dolphmbknudson: ayoung: wishlist item for tests that could merge today... https://review.openstack.org/#/c/44509/15:03
*** jprovazn has quit IRC15:03
stevemardolphm: i was wondering why it was put on the short list for icehouse15:03
ayoungdolphm, looking15:03
*** spzala has joined #openstack-dev15:03
*** jprovazn has joined #openstack-dev15:04
*** yjiang5 has joined #openstack-dev15:04
*** basha has quit IRC15:04
dolphmstevemar: only because it's unnecessary for havana15:05
ayoungstevemar, dolphm, service_v3?  That doesn't belong in core.  Why was that carried along?15:05
stevemardolphm: understandable15:05
*** d34dh0r53 has joined #openstack-dev15:05
*** sthaha has quit IRC15:06
stevemarayoung: oh referring to: https://review.openstack.org/#/c/44509/4/keystone/tests/core.py15:06
dolphmayoung: what do you mean? that's just a line from the pipeline, right?15:06
*** jprovazn has quit IRC15:06
*** xga has joined #openstack-dev15:06
*** xga_ has quit IRC15:06
*** bdpayne has joined #openstack-dev15:07
stevemardolphm: yes15:07
ayoungdolphm, I think it is specific to *a* generated paste config, but should not be there for all of them15:07
ayoungright?15:07
ayoungit is specific to extensions15:08
*** jimfehlig has joined #openstack-dev15:08
dolphmayoung: it's in the default v3 pipeline, and that's it15:08
*** trey_h_ has quit IRC15:08
*** senk has joined #openstack-dev15:08
dolphmayoung: it's the v3 application factory15:08
stevemarayoung: it's just changing this line https://github.com/openstack/keystone/blob/master/etc/keystone-paste.ini#L6715:08
*** datsun180b_ has joined #openstack-dev15:08
*** jasdeepH has joined #openstack-dev15:08
stevemarto be $extension_name service_v315:08
*** trey_h has joined #openstack-dev15:09
dolphmi.e. injecting the extension to be tested as the last extension in the pipeline15:09
ayoungdolphm, I'm just not sure that only extensions should be using this mechanism, but it can stay as is...I might be scope creeping it15:09
ayoungdolphm, there are many tests that could benefit from test specific config files.15:09
*** datsun180b has quit IRC15:09
*** datsun180b_ is now known as datsun180b15:09
*** d34dh0r53 has quit IRC15:10
ayoungBut this is a good start15:10
dolphmayoung: you mean test-specific pipelines?15:10
dolphmayoung: since our conf is separate now, we already test that differently15:11
*** bdpayne has quit IRC15:11
*** martyntaylor has quit IRC15:11
*** senk1 has joined #openstack-dev15:11
ayoungdolphm, I was thinking more along the lines of things like LDAP and SQL Urls15:11
ayoungwe have a lot of duplication.15:12
*** xga_ has joined #openstack-dev15:12
*** xchu has joined #openstack-dev15:12
*** jtomasek has quit IRC15:12
*** drewland_ has quit IRC15:12
*** senk has quit IRC15:13
*** reed has joined #openstack-dev15:13
*** henrynash has joined #openstack-dev15:13
*** gargya has joined #openstack-dev15:14
*** xga has quit IRC15:14
dolphmayoung: ah, that should be handled through the conf hierarchy thing we do15:15
dolphmayoung: conf extending conf15:15
*** salv-mobile has quit IRC15:16
*** bdpayne has joined #openstack-dev15:16
*** otherwiseguy has joined #openstack-dev15:17
*** drewlander has joined #openstack-dev15:18
*** romcheg has joined #openstack-dev15:21
dolphmayoung: (did you want to +1/-1 on that?)15:22
*** kmartin has quit IRC15:22
*** datsun180b has quit IRC15:23
*** datsun180b has joined #openstack-dev15:23
*** kiall has quit IRC15:24
*** mlavalle has quit IRC15:24
*** dkehn has quit IRC15:25
*** gyee has joined #openstack-dev15:25
*** trey_h has quit IRC15:25
*** trey_h has joined #openstack-dev15:26
*** jtomasek has joined #openstack-dev15:27
*** nati_ueno has quit IRC15:27
*** shanewang is now known as shanewang_away15:28
*** jimfehlig has quit IRC15:28
*** nati_ueno has joined #openstack-dev15:28
*** danwent has joined #openstack-dev15:28
*** kmartin has joined #openstack-dev15:30
*** mlavalle has joined #openstack-dev15:30
*** edmund1 has joined #openstack-dev15:31
*** edmund has quit IRC15:31
dolphmayoung: this is another "big" bug fix that should merge today https://review.openstack.org/#/c/42826/15:31
*** pmathews has joined #openstack-dev15:31
*** ruhe has joined #openstack-dev15:31
*** sumanthns has joined #openstack-dev15:32
*** nati_ueno has quit IRC15:32
*** dkehn has joined #openstack-dev15:34
*** galstrom_zzz is now known as galstrom15:34
*** guardian_ has quit IRC15:35
*** sumanthns has quit IRC15:37
*** basha has joined #openstack-dev15:37
*** mestery_ has joined #openstack-dev15:37
*** prekarat has quit IRC15:38
stevemardolphm: ping15:38
*** bswartz has joined #openstack-dev15:39
*** gimps_ has joined #openstack-dev15:40
*** mestery has quit IRC15:40
*** dkehn has quit IRC15:40
ayoungdolphm, why should changing my default membership remove me from a project?15:41
*** dkehn has joined #openstack-dev15:41
*** dolphm_ has joined #openstack-dev15:41
ayoungdolphm, I think the bug report is wrong15:43
dolphm_ayoung: how so?15:43
*** mestery_ is now known as mestery15:43
ayoungdolphm_, what they are changin in the user object is the default tenant.15:43
ayoungSay I want to change my default tenant from p1 to p2...I should not be removed from p115:43
*** vipul is now known as vipul-away15:44
ayoungI think they are right in saying "we should create an user-project role association for p2 if it does not exist"15:44
dolphm_ayoung: you should lose _member_ on p1 if it's called through the v2 api15:44
*** kiall has joined #openstack-dev15:44
ayoungbut not in saying "in spite of changing successfully tenant/project id for a existing user, the user still belongs to the original tenant / project. That means, updating tenant / project id for a user is invalid."15:45
*** gargya_ has joined #openstack-dev15:45
ayoungdolphm, you can be a member of more than one tenant, even in v2, no?15:45
dolphm_ayoung: yes, but not via a user's default tenancy15:45
*** dolphm has quit IRC15:45
*** basha has quit IRC15:45
*** zz_zz_Guest84103 is now known as leif15:46
*** leif is now known as Guest6147015:46
ayoungdolphm_, So you think that changing a default tenancy should remove the _member_ role in the old project?  Is that documented?  Or was that a side effect of how it used to work when we had multiple ways to associated15:47
*** paragan has quit IRC15:47
ayoungassociate users with projects15:47
*** gargya has quit IRC15:47
*** gargya_ is now known as gargya15:47
*** freedomhui has quit IRC15:47
dolphm_ayoung: yeah, that was the point of the _member_ role... to provide an explicit role assignment on an implicit v2 role grant (default tenancy)15:47
dolphm_ayoung: we don't need the same contruct on v2 because default_project_id doesn't implicitly grant authz15:48
*** bdpayne has quit IRC15:49
*** vipul-away is now known as vipul15:50
*** yaguang has quit IRC15:50
*** changbl has joined #openstack-dev15:51
*** imsurit has quit IRC15:51
ayoungdolphm_, it wasn't just on default tenancy.  THe tenant  used to have a list of user_memebers.  I think that was separate from the default_tenant_id as well.  I don't know if that relationship would have been modified by changing the user's default tenant_id, I think not.  But I can look back in git to see...15:52
*** FunnyLookinHat has quit IRC15:52
*** gimps has quit IRC15:53
*** dhellmann is now known as dhellmann_15:55
*** gimps has joined #openstack-dev15:56
*** openfly has left #openstack-dev15:57
*** basha has joined #openstack-dev15:58
*** briancurtin has quit IRC15:59
*** jistr has quit IRC15:59
*** markwash has quit IRC15:59
*** jmontemayor has quit IRC16:00
*** dina_belova has quit IRC16:00
*** jimfehlig has joined #openstack-dev16:00
*** tstevenson has joined #openstack-dev16:00
*** jcoufal has quit IRC16:00
dstanekdolphm_: re: dogpile cache, i was thinking that on_arguments could be replaced with a lazy implementation16:00
*** datsun180b_ has joined #openstack-dev16:01
*** Ruetobas has quit IRC16:01
ayoungdolphm_, so,  looks like we never did anything with user membership based on what was passed in for an update  https://github.com/openstack/keystone/blob/b1bfca2501ad11a861c9064b97b7fa06fc6d958e/keystone/identity/backends/sql.py#L71016:01
ayoungthat is the last commit prior to my change which added _member_16:01
dolphm_dstanek: ++, but it looked like more? (there's three imports from dogpile and several are used at startup)16:02
henrynashdolphm: ping me when you are OK to talk filtering….I am sure we can get this done and resolved today16:02
*** xchu has quit IRC16:02
dolphm_ayoung: that's the bug, no?16:02
dolphm_henrynash: have an update?16:03
*** datsun180b has quit IRC16:03
*** datsun180b_ is now known as datsun180b16:03
henrynashdolphm: so just wanted to talk though your idea of passing a list of dicts16:03
*** briancurtin has joined #openstack-dev16:03
*** vartom7 has joined #openstack-dev16:03
ayoungdolphm_, I don't think there is any compelling reason to remove a user from a project just because we change their default project.  It is counterintuitive.  I can see that setting a users default project automatcially enrolls them in that project.  BUt not the reverse.16:04
dstanekdolphm_: the only other one that's used at import time is proxy and that can be lazy as well16:04
*** Ruetobas has joined #openstack-dev16:04
*** xga_ has quit IRC16:04
*** briancurtin has quit IRC16:04
dolphm_dstanek: hmm.. i thought i saw more; want to attempt an impl?16:04
dstanekthat's not the right long term solution, but it could be a temp fix16:04
*** briancurtin has joined #openstack-dev16:05
dstanekdolphm_: sure thing16:05
*** xga has joined #openstack-dev16:05
dolphm_ayoung: you have to be more specific than that... you certainly wouldn't remove every role assignment, or just any random role assignment16:05
dolphm_ayoung: the only reason they have the _member_ role is because they were created with default tenancy16:05
*** devvesa has quit IRC16:05
*** jaybuff has joined #openstack-dev16:05
dolphm_ayoung: so they should lose the _member_ assignemnt when default tenancy changes16:05
henrynashdolphm: so larger issue I had with this was whether we need to differentiate between filters and other things that we might pass (e.g. paginating directives) as well being able to tell the driver which filters we actually support16:06
*** briancurtin has quit IRC16:06
henrynashdolphm: and while I know that pagination may get booted off the table etc.16:06
henrynashdolphm: the attempt was to design something that had legs and could be adapted16:06
*** briancurtin has joined #openstack-dev16:06
ayoungdolphm_, no, they were created to replace the direct member_of value of the tenant.  Not for default16:06
jaybuffmordred: what happened to cookiecutter-openstack under openstack-dev?   I found it on https://github.com/emonty/cookiecutter-openstack is that the best one to use?16:07
insanidadequestion: I'd like to restart the services in my Openstack installation (devstack). I've used unstack.sh first. What should I do next? stack.sh ?16:07
dolphm_henrynash: on your first point, do you mean like domain_id in list_projects()?16:07
mordredjaybuff: it hasn't gotten merged yet16:07
*** briancurtin has left #openstack-dev16:07
mordredjaybuff: https://review.openstack.org/4253016:07
mordredjaybuff: but - feel free to use the emonty one for now16:07
dolphm_henrynash: if so, i agree. but i would think the solution is two discrete driver methods ... list_projects(hints=None) and list_projects_in_domain(domain_id, hints=None)16:08
jaybuffmordred: ah, cool, so it was never on openstack-dev.  Thanks, I used it and it worked great.16:08
mordredjaybuff: woot!16:08
mordredjaybuff: as soon as that lands, I'll send out a mailing list thing letting people know about it16:08
*** yjiang5 has left #openstack-dev16:08
*** SergeyLukjanov has quit IRC16:08
*** tstevenson has quit IRC16:08
*** mmagr has quit IRC16:08
dolphm_henrynash: treating domain_id as optional to the driver was bad design on my part (at least, i *think* i wrote that)... but anyway, your change illustrates that pretty well16:09
*** Ruetobas has quit IRC16:09
henrynashdolphm: which is interesting, since the driver method used to take domain_id=None…i.e. an optional driver id, which I folded into the hints/directves16:09
*** nati_ueno has joined #openstack-dev16:09
henrynashdolphm: add16:09
henrynashdolphm: ahh, right16:09
*** yassine has quit IRC16:09
*** zbitter has joined #openstack-dev16:09
henrynashdolphm: the other thing is that, do we let any name, value pair that arrives in the url go into the hints?16:10
*** diogogmt has joined #openstack-dev16:11
*** ayoung has quit IRC16:11
primeministerpdansmith: ping16:11
henrynashdolphm: i.e. we could just let them all be in hints, and if a driver finds it doesn't udnertand one of them it just skips it…..16:11
*** odyssey4me has quit IRC16:12
dolphm_henrynash: i'd rather explicitly build 'hints' (or whatever) in the controller, rather than passing any random garbage down to drivers16:12
*** FunnyLookinHat has joined #openstack-dev16:13
dolphm_henrynash: domain_id in the query string is basically a different call to the driver, and should have it's own driver method16:13
*** zaneb has quit IRC16:13
dolphm_henrynash: *or* if it's low cost to implement it in the controller and not have the driver worry about it, we can do that16:13
*** hartsocks has joined #openstack-dev16:14
*** Ruetobas has joined #openstack-dev16:14
*** hartsocks has left #openstack-dev16:14
henrynashdolphm: oh sure, not saying that….but do you say the url has tentsize=100 (where tentszie is not a known field) to so still build it into hints?16:14
*** o_petit has quit IRC16:14
dolphm_henrynash: i wouldn't16:14
*** boris-42 has quit IRC16:14
*** vuil has joined #openstack-dev16:14
dolphm_henrynash: sounds like a problem for the controller to either implement or ignore?16:14
dolphm_henrynash: and maybe ignore.. because it's not a contract attribute16:15
*** mlavalle has quit IRC16:15
*** tsmithgc has joined #openstack-dev16:15
henrynashdolphm: which I wasn't….until gyee popped up and said that he really wanted access to the other items from the url…so rather than pass the whoel querystting down, I, but any url items into a separate dict that could also be iterated16:16
henrynashdolphm:…all part of the ListDierective16:16
dolphm_henrynash: side note... i thought it was interesting that (it appears) you implemented (maybe unintentionally) support for name__startswith=Hen&name__contains=nr ... e.g. multiple filters on the same field16:16
dolphm_henrynash: if so, add a test to ensure that works :)16:16
*** zbitter is now known as zaneb16:17
*** angdraug has joined #openstack-dev16:17
dolphm_henrynash: it sounds like he should be implementing an api extension, not a custom driver16:17
henrynashdolphm: that was certainly the design, I haven't fully fleshed out the inexact testing since it is switched off16:17
*** amotoki has quit IRC16:17
*** o_petit has joined #openstack-dev16:17
*** basha has quit IRC16:17
dolphm_gyee: (i've only heard you ask for a specific solution rather than actually presenting a use case)16:17
*** vartom8 has joined #openstack-dev16:17
gyeedolphm_, I have customer drivers that make use of the query parameters16:18
dolphm_gyee: that's still not a use case, that's just saying "i'm implementing an API in the driver"16:19
dolphm_which is ... broken16:19
gyeemuch easier to pass the query string down the driver than having to write a bunch of boilerplate code in contrib16:19
dolphm_gyee: still not presenting a use case16:19
*** o_petit has quit IRC16:20
gyeedolphm_, what's the easier way to implement GET /domains?HP-<filtername>=...16:20
*** safchain_ has quit IRC16:20
gyeeeither customer driver or contrib16:20
*** vartom7 has quit IRC16:20
*** topshare has joined #openstack-dev16:20
dolphm_gyee: that looks like a really small piece of middleware at first glance, but i still don't know what you're doing16:21
*** ruhe has quit IRC16:21
gyeedolphm_, we support more filter options than standard keystone provides16:21
*** MaxV has quit IRC16:21
gyeeI need to figure out a way to do that without having to reimplement keystone itself16:22
gyeeI can write a bunch of boilerplate code in contrib or simple make use of what's already there in my custom driver16:23
dolphm_gyee: middleware has access to both the query string and the response from keystone - that would be the lowest cost way to implement a new filter in terms of long term maintenance cost16:23
gyeedolphm_, but I need a way to pass them down to the driver16:23
*** corXi has quit IRC16:23
*** jaybuff has quit IRC16:24
gyeeI would rather not having to modify/monkeypatch the interface16:24
dolphm_gyee: it sounds like you're literally writing an api extension and entirely implementing in a driver, which is broken and unmaintainable16:25
gyeeits a simple change in henry's patch, just save the query string and make them accessible in the driver16:25
dolphm_gyee: you don't need to push your broken architecture back into henry's patch16:25
dstanekjust created a new devstack instance, checked out master in /opt/stack/keystone and have failing tests :-(16:25
dolphm_dstanek: can you paste the failure?16:26
gyeedolphm_, how would you implement custom filters?16:26
*** shinylasers has quit IRC16:26
dolphm_gyee: intercept calls to the resource you care about 'GET' '/domains' on the pipeline you care about 'api_v3' and intercept and rewrite the wsgi response based on the query parameters in the wsgi environment16:27
dstanekdolphm_: there are a few hundred failures, but http://paste.openstack.org/show/45750/ happens a lot16:27
dolphm_gyee: that's pretty much how json<-->xml middleware works16:27
gyeedolphm_, I need to pass them into the database drivers16:28
dolphm_gyee: it's a little more complex than you need because it's rewriting both requests AND responses16:28
gyeefor performance reasons16:28
*** fbo is now known as fbo_away16:28
dolphm_gyee: then the next step would be to call your custom driver16:29
gyeedolphm_, I would have to implement/extend the core interfaces16:29
dolphm_gyee: i.e. intercept the request rather than the response16:29
*** jpich has quit IRC16:29
*** shinylasers has joined #openstack-dev16:29
dolphm_gyee: yes, that's totally catered by design16:29
gyeedolphm_, I can easiler intercept the request and response16:29
gyeeproblem is I need to pass the query parameters down to the database drivers16:30
*** kiall has quit IRC16:30
gyeevia the Manager interface16:30
dstaneki remember seing somethere that _ is magically put in a module's namespace...what does that?16:30
dolphm_gyee: please stop trying to push your broken architecture as some sort of magic solution to a problem it sounds like you don't actually understand... we have better things to do today16:32
*** JordanP has quit IRC16:32
*** MaxV has joined #openstack-dev16:33
*** atiwari has joined #openstack-dev16:33
*** senk1 has quit IRC16:33
dolphm_dstanek: that just changed within the past week.. i think keystone.__init__ ? or keystone-all16:33
dolphm_bknudson: i think you refactored how _() is created?16:34
*** pmathews has quit IRC16:35
gyeedolphm_, I am trying to a solution, no magic16:35
henrynashdolphm: can we also agree what we call this thing we are debating (I only want to change the name ONE more time :-) ).  hints?  list_hints? list_directives?16:36
gyeeto fine a solution16:36
*** sridevi has joined #openstack-dev16:36
*** sridevi has quit IRC16:36
*** jruzicka has quit IRC16:37
*** stevemar has quit IRC16:37
*** MaxV has quit IRC16:37
*** networkstatic has joined #openstack-dev16:38
*** dkehn has quit IRC16:38
dolphm_henrynash: sure...16:38
dolphm_henrynash: between hints and list_hints... do you only expect list_* methods to consume hints?16:39
dolphm_henrynash: (or directives vs list_directives)16:39
henrynashdolphm: I can't quite think of a non-list case, to be honest…all others should be real api parameters...16:40
dolphm_henrynash: agree16:40
henrynashdolphm_: so list_hints?16:41
*** AlexR has joined #openstack-dev16:41
dolphm_henrynash: i don't know whether that should affect anything ;) i was just curious about what you were thinking16:41
*** kiall has joined #openstack-dev16:41
*** kiall has quit IRC16:41
*** kiall has joined #openstack-dev16:41
*** AlexR has quit IRC16:41
*** senk has joined #openstack-dev16:41
*** AlexR has joined #openstack-dev16:41
dolphm_henrynash: i'm between just 'hints' or 'directives' or '<some unknown alternative>'16:41
*** AlexR has quit IRC16:42
*** pmathews has joined #openstack-dev16:42
*** johnthetubaguy has quit IRC16:42
dolphm_henrynash: and i lean towards hints because there's precedent, and it doesn't remind me of hitler16:42
henrynashdolphm: I wasn't 100% sold on directives….since a driver can chose to ignore16:42
*** imsurit has joined #openstack-dev16:42
*** colinmcnamara has joined #openstack-dev16:42
dolphm_henrynash: just go with 'hints' then16:43
*** senk1 has joined #openstack-dev16:43
henrynashdolphm_: ok, done16:43
dolphm_henrynash: *if* you need a new module in keystone.common at the end of the day ... 'driver_hints' ?16:43
*** jbresnah_ has joined #openstack-dev16:43
henrynashdolphm_: ok, nice16:43
*** AlexR has joined #openstack-dev16:43
dolphm_henrynash: but in reality, hints are built by the controller according to a proprietary api, and provided in a standard format to the drivers16:44
*** shinylasers has quit IRC16:44
*** nshaikh has left #openstack-dev16:44
henrynashdolphm_: (agreed)….on the subject of structure, complexity do lists or dicts etc.16:44
*** senk1 has quit IRC16:44
dolphm_henrynash: so if there's something 'common' about them that's not api-specific, it would be something to read / traverse hints? or validate them?16:44
dstanekdolphm_: bknudson: found it (the _ change) in 2fe72a016:44
henrynashdolphm_: so if we have a  simple list of dicts (which I did think about), then could do:16:45
*** kbrierly has joined #openstack-dev16:45
henrynasha) All dicts are filters16:45
*** senk has quit IRC16:45
*** jhesketh has quit IRC16:45
*** abhishekkr has quit IRC16:46
henrynashb) We could have a  'type' field in the dict that today said 'filter', but would allow us to add other things that weren't filters in the futre16:46
dolphm_henrynash: what would be an example of an alternative type?16:47
henrynashwhich is kind of a simpler way of doing what I did with multiple doctor dicts :-)16:47
*** xga has quit IRC16:47
henrynashdolphm_: pagination hints16:47
*** bswartz has quit IRC16:47
AlexRHello everyone, could you help me with git? I'm having troubles updating my change. I did this before, but now it does not work. So I made changes in my branch, I did 'commit -a --amend', and when I do 'git review' I get the following message: Errors running git rebase -i remotes/gerrit/master error: could not apply fdb8d8f... Additional variable APACHE_SERVER_NAME added When you have resolved this problem run "git rebase --continue".16:47
AlexRIf you would prefer to skip this patch, instead run "git rebase --skip". To check out the original branch and stop rebasing run "git rebase --abort". Could not apply fdb8d8f... Additional variable APACHE_SERVER_NAME added16:47
*** asavu has joined #openstack-dev16:47
henrynashdolphm_: if we do them16:47
dolphm_henrynash: that sounds good16:47
*** tjones has joined #openstack-dev16:47
dolphm_henrynash: i also liked your choice of 'comparate'16:48
dolphm_henrynash: i found that interesting because i spent several weeks on a project fussing over similar terminology before i found & settled on the word 'comparate' (which i didn't know existed before that)16:49
*** prekarat has joined #openstack-dev16:49
henrynashdolphm_: ..and the other thing we *could* do is have type called 'extra' or 'other" which is where we placed the name & value of things from the url that were not filters (or paginators)…..but this goes to the discussion you are having with gyee16:50
*** dkehn has joined #openstack-dev16:50
henrynashdolphm_: (actually I think i used 'comparator'…)16:50
*** shinylasers has joined #openstack-dev16:50
dolphm_henrynash: bah, that's what i meant16:50
dolphm_henrynash: yeah, it doens't make sense to pass garbage down to the driver if the controller doesn't know what it is16:51
*** kiall has quit IRC16:52
dolphm_henrynash: for example, it would make sense for the v2 api to filter on tenantId and it would make sense for the v3 api to filter on default_project_id, but one or both of those is going to be meaningless to the driver... because it's api-specific that doesn't belong at that layer16:53
*** derekh has quit IRC16:53
*** johnthetubaguy has joined #openstack-dev16:53
*** ruhe has joined #openstack-dev16:54
henrynashdolphm_: I agree, I think it is only useful for customer drivers and extensions….16:54
dolphm_henrynash: gyee: LDAP bug fix- https://review.openstack.org/#/c/43524/ (bknudson: thank you!)16:54
*** johnthetubaguy1 has joined #openstack-dev16:54
*** johnthetubaguy1 has quit IRC16:54
*** topshare has quit IRC16:54
henrynashdolphm_: at least with this structure we can add something like that if we convince ourselves we need it16:54
*** nati_ueno has quit IRC16:55
*** pschaef has quit IRC16:55
*** kiall has joined #openstack-dev16:55
*** marios has quit IRC16:55
henrynashdolphm_: ok, working on a new patch....16:55
gyeedolphm_, henrynash, I guess I'll have to monkeypatch listdirectives in contrib16:55
*** anniec has quit IRC16:55
*** nati_ueno has joined #openstack-dev16:55
*** anniec has joined #openstack-dev16:55
*** AlexR has quit IRC16:56
*** xga has joined #openstack-dev16:57
*** jaypipes has quit IRC16:57
*** vartom8 has quit IRC16:57
*** colinmcnamara has quit IRC16:57
*** nati_ueno has quit IRC16:57
*** nati_ueno has joined #openstack-dev16:57
*** johnthetubaguy has quit IRC16:58
*** nati_ueno has quit IRC16:58
*** nati_ueno has joined #openstack-dev16:59
*** colinmcnamara has joined #openstack-dev16:59
*** markwash has joined #openstack-dev16:59
*** kaushikc has joined #openstack-dev17:00
*** ruhe has quit IRC17:00
*** jbresnah_ has quit IRC17:01
*** jbresnah_ has joined #openstack-dev17:01
*** danpb has quit IRC17:02
*** imsurit has quit IRC17:02
*** SumitNaiksatam has quit IRC17:02
*** Ryan_Lane has joined #openstack-dev17:03
*** Ryan_Lane has quit IRC17:03
dolphm_gyee: ... i'm going to pretend you've already read and understood this code but i'm going to link you to it so i can be more confident in my delusion https://github.com/openstack/keystone/blob/master/keystone/middleware/core.py#L143-L17117:03
*** nati_ueno has quit IRC17:03
*** Shaan7 has quit IRC17:04
*** Shaan7 has joined #openstack-dev17:04
gyeedolphm_, oh yeah, been there :)17:05
*** ayoung has joined #openstack-dev17:05
*** ruhe has joined #openstack-dev17:08
*** boris-42 has joined #openstack-dev17:08
gyeeI have a number of options, catching the response and apply my own filters on top is one of them17:08
*** Mandell has joined #openstack-dev17:08
gyeeperformance would suck, but yeah, its an option nevertheless17:08
*** senk has joined #openstack-dev17:10
dolphm_gyee: best to prematurely optimize with an unmaintainable solution then?17:11
*** xga has quit IRC17:11
gyeedolphm_, I need to figure out a solution this is both maintainable and have decent performance17:12
gyeeperformance comes from drivers17:12
morganfainbergdolphm_, the use of the decorator requires dogpile.cache to be a hard requirement =/17:13
morganfainbergdolphm_ (sorry just saw the email thread).17:13
dolphm_dstanek: ^17:13
*** jcoufal has joined #openstack-dev17:13
morganfainbergdolphm_, i'll respond there as well.17:14
morganfainberg(email)17:14
*** sumanthns has joined #openstack-dev17:14
bknudsonI'd think given python's dynamic nature there wouldn't be any hard requirements?17:14
dolphm_bknudson: AFAICT, it would at least a bit of a pain to avoid17:14
morganfainbergbknudson, decorators are handled at import time, it's really hard to work around.17:14
dstanekmorganfainberg: dolphm_: i have a POC for making the decorator and proxy lazy, but i'm waiting to post until i get my devstack issues worked out17:15
dstanekneed to make sure the tests pass :-)17:15
morganfainbergthough if it is an issue, i could write an abstraction layer to lazy load dogpile today17:15
morganfainbergdolphm_, not sure how much work it would be thouhg.17:15
*** jaypipes has joined #openstack-dev17:16
dolphm_dstanek: can you post a diff at least? i'm fearing the final solution would be fairly complex for havana vs shipping with dogpile as hard requirement17:16
dolphm_(and once we ship with dogpile as a hard requirement, we might as well keep it as such?)17:16
*** nati_ueno has joined #openstack-dev17:17
morganfainbergdolphm_, i was hoping to get to a point where we could make cache a default option in I.17:17
dolphm_morganfainberg: that's what dstanek is tackling right now17:17
*** mrunge has quit IRC17:17
dolphm_morganfainberg: default to caching enabled? against what backend?17:17
*** otherwiseguy has quit IRC17:17
morganfainbergdolphm_, thats part of the work that would be needed, but i'm not sure yet :P, like i said hope17:18
dolphm_morganfainberg: well, what are you thinking? defaulting to a more intelligent in-memory backend?17:19
morganfainbergdolphm_, that was the first path to go down.17:19
*** stevemar has joined #openstack-dev17:19
dolphm_morganfainberg: defaulting to memcached might also be reasonable17:19
morganfainbergdolphm_, work on something that could handle expiring the cache rather than ballooning the memory useage.17:19
morganfainbergdolphm_, that was my second thought17:20
dolphm_morganfainberg: i'd be curious if any other projects need memcached (or something else suitable) out of the box17:20
*** tjones has left #openstack-dev17:20
dolphm_(i can't think of any)17:20
morganfainbergdolphm_, AFAIK not needed out of the box.17:20
markwashttx: around? I'm still trying to put together an understanding of how clients release schedules need to coincide with the openstack release cycle17:21
stevemaranyone know if you can edit a summit sessions after it's been created?17:22
*** SumitNaiksatam has joined #openstack-dev17:22
morganfainbergdstanek, if you need any help with making the dogpile.cache decorator a bit more lazy, let me know.17:22
*** SumitNaiksatam has quit IRC17:23
*** kiall has quit IRC17:23
*** jruzicka has joined #openstack-dev17:23
dstanekdolphm_: sure, let me stash all my other experiments17:24
*** SumitNaiksatam has joined #openstack-dev17:24
*** SumitNaiksatam has quit IRC17:24
dstanekmorganfainberg: thanks, i'll let you know when my code is posted17:24
*** feleouet has quit IRC17:24
dolphm_markwash: i don't follow any schedule at all.. just release as deemed necessary / beneficial17:25
*** jmontemayor has joined #openstack-dev17:25
dolphm_markwash: at the same time, i'm aware that distros will probably stick with whatever happens to be available at the time of a service release17:25
markwashdolphm_: okay cool. . I was hoping that during FF I could focus some people on a client cleanup push17:25
morganfainbergdstanek, for what it's worth, it should be in the requirements.txt for keystone?17:26
dolphm_markwash: fwiw, i had the same thought last cycle but it didn't work out due to RC bugs + FFE taking up more time than expected17:26
*** pmathews has quit IRC17:27
*** prekarat has quit IRC17:28
markwashdolphm_: hmm that seems likely to be something I'll have to contend with as well :-)17:29
*** drewlander has quit IRC17:29
*** pmathews has joined #openstack-dev17:30
dolphm_stevemar: ping17:30
*** kiall_ has joined #openstack-dev17:31
*** kiall_ has quit IRC17:31
*** kiall_ has joined #openstack-dev17:31
*** bdpayne has joined #openstack-dev17:32
*** jcoufal has quit IRC17:33
dolphm_dtroyer: stevemar: this merged scary fast the other day https://github.com/openstack/python-keystoneclient/commit/661d6cf783d1586e435196f38ffb1b2361b8fe25 and i was wondering if i should revise to be 'pending deprecation' rather than actually a hard dep (in other words, *should* people actually be directed to openstackclient yet?)17:33
dolphm_s/hard dep/full deprecation/17:33
*** jruzicka has quit IRC17:34
stevemardolphm: pong17:34
*** epim has joined #openstack-dev17:35
*** dolphm_ has quit IRC17:35
stevemardolphm: that did get merged scary fast17:35
*** Guest61470 is now known as zz_Guest6147017:35
*** dolphm has joined #openstack-dev17:36
*** bdpayne_ has joined #openstack-dev17:36
dolphmstevemar: (sorry, i d/c for a minute)17:36
stevemardolphm: np, was saying that it did get merged scary fast17:36
*** bdpayne has quit IRC17:36
dolphmstevemar: a 'pending deprecation' warning is long overdue :(17:37
stevemardolphm, true, want to change it to 'pending' ?17:37
dolphmstevemar: you tell me if it should, or leaving it as-is just means python-keystoneclient shouldn't see a release until <target date>17:38
*** radez_g0n3 is now known as radez17:39
dolphmstevemar: at the moment, this is a bit of a blocker http://pasteraw.com/9tn8my5hhe3e0bumbvgd1at69xli9r17:39
*** dkehn has quit IRC17:40
*** dkehn has joined #openstack-dev17:40
stevemardolphm: nice17:40
dolphmstevemar: https://bugs.launchpad.net/python-openstackclient/+bug/122083117:41
uvirtbotLaunchpad bug 1220831 in python-openstackclient "AttributeError: 'module' object has no attribute 'BasicFileKeyring'" [Undecided,New]17:42
*** rcrit has quit IRC17:42
stevemardolphm: well, using openstack client for v3 stuff is still 'blocked' by keystoneclient v3 auth work17:43
dstanekdolphm: morganfainberg: here is the general idea: https://review.openstack.org/#/c/45086/17:43
stevemardolphm: but as fas as v2 goes, it's pretty solid17:43
stevemardolphm: so the message is fine in that regard17:43
dstanekwill need a bit more more to make sure everything still works and the tests pass17:43
*** alop has joined #openstack-dev17:44
dolphmstevemar: all i'm looking for is parity with keystoneclient's v2 shell17:44
dolphmstevemar: everything else is a bonus17:45
stevemardolphm: then i think the message is safe17:45
dolphmdstanek: is that a draft review? i get a 40417:45
*** kaushikc has quit IRC17:45
dstanekdolphm: yes, can only i see those?17:46
dolphmdstanek: you have to invite people to them17:46
dolphmdstanek: alternatively Work In Progress means it won't merge as-is, but it's public17:46
*** eglynn is now known as eglynn-is-hungry17:46
*** jaypipes has quit IRC17:48
stevemardolphm: can you edit design sessions after you create them?17:48
dolphmstevemar: yes17:48
stevemardolphm: excellent, i will create one for .... talking about federated identity .... dun dun dun17:49
dolphmstevemar: dun dun dun dun dun ...17:49
*** jaypipes has joined #openstack-dev17:49
dolphmstevemar: should probably make that an end-of-day thing so we can continue in "alternative venue"17:50
*** krtaylor has quit IRC17:50
dolphmstevemar: FYI, keystone session should be broken up over several days :D17:50
dstanekdolphm: morganfainberg: http://bit.ly/17zNECN17:51
stevemardolphm: not just 1! yay!17:51
dstanekis there an OpenStack shortener?17:51
dolphmdstanek: not that i'm aware of, but that's not a bad idea17:51
*** jruzicka has joined #openstack-dev17:51
dolphmdstanek: would be interesting to make link stats public17:51
*** sumanthns has quit IRC17:51
dolphmdstanek: maybe required ATC to create links...17:52
*** jruzicka has quit IRC17:52
*** jruzicka has joined #openstack-dev17:52
*** lucasagomes has quit IRC17:53
*** jaypipes has quit IRC17:53
*** yjiang5_away is now known as yjiang517:53
*** ruhe has quit IRC17:53
stevemardolphm: wondering if I should create a session for web ui for oauth...17:54
*** gargya has quit IRC17:54
dolphmstevemar: for horizon?17:54
stevemardolphm: it would have to live there right?17:54
dolphmstevemar: if you're talking about a horizon UI17:54
*** eharney has quit IRC17:55
*** rcrit has joined #openstack-dev17:55
stevemardolphm: m'yeah17:55
*** jtomasek has quit IRC17:55
*** jaypipes has joined #openstack-dev17:56
*** tstevenson has joined #openstack-dev17:57
*** openmike has joined #openstack-dev17:57
dtroyerdolphm: what stevemar said. I'm not ready to tell the general user base to use OSC yet as I think it needs more shakedown, but I do want it to get some use where we can get constructive feedback and bug reports.17:57
stevemar++17:58
dtroyerdolphm:    That error is fairly new (to me anyway), I'll tackle it next, once I get the requirements properly updated.17:58
dolphmdtroyer: i'll suggest revising to 'pending deprecation' then, which should direct adventurous users in your direction17:59
*** xqueralt is now known as xqueralt-afk17:59
dstanekin Keystone there is a pattern of having logic in a core module and importing core.* into the package init18:00
dstanekis there anything wrong with having some logic in the package init?18:01
*** jprovazn has joined #openstack-dev18:01
*** Ryan_Lane has joined #openstack-dev18:02
*** Ryan_Lane has quit IRC18:03
TheSheepdstanek: hard to import it from other submodules18:03
*** ndipanov is now known as ndipanov_afk18:03
dolphmdstanek: some projects do it, but a lot of developers find it confusing/surprising to see anything actually implemented there18:03
*** Ryan_Lane has joined #openstack-dev18:03
TheSheepdstanek: you can get a circular dependence18:03
henrynashdolphm: new patch posted18:07
henrynashdolphm: still a bit of cleanup to do…but essentially all there18:08
dstanekmorganfainberg: it looks like some of the functions in keystone.common.cache.core exist just for tests - is that a correct observation?18:09
*** mlavalle has joined #openstack-dev18:10
*** Mandell has quit IRC18:10
*** dina_belova has joined #openstack-dev18:11
*** SergeyLukjanov has joined #openstack-dev18:11
notmynamerussellb: the core swift devs on your review stats page is not up-to-date18:11
russellbhttps://github.com/openstack-infra/reviewstats/blob/master/projects/swift.json18:12
russellbnotmyname: just update that file and 'git review' it18:12
russellbmaybe someday i will make it get team info from gerrit, heh18:13
dolphmhenrynash: looking18:13
*** romcheg has quit IRC18:13
*** romcheg has joined #openstack-dev18:14
notmynamerussellb: done, thanks https://review.openstack.org/#/c/45088/18:14
stevemardolphm, lbragstad: https://review.openstack.org/#/c/43610/18:14
*** vuil has quit IRC18:14
*** xqueralt-afk is now known as xqueralt18:15
russellbnotmyname: approved thanks18:15
lbragstadstevemar: cool, checking18:15
*** jruzicka has quit IRC18:15
*** novas0x2a|laptop has quit IRC18:15
*** dina_belova has quit IRC18:16
*** melwitt has joined #openstack-dev18:16
dolphmhenrynash: better!18:17
dolphmhenrynash: why does case_sensitive default to False? that conflicts with comparator='equals' a bit18:17
*** Mandell has joined #openstack-dev18:17
*** basha has joined #openstack-dev18:20
*** dubsquared has joined #openstack-dev18:20
ayoungstevemar, personally, I want to run Horizon with mod_auth_kerb and S4U2Proxy for it to fetch its tokens.18:21
morganfainbergdstanek, have you tried running with cache on with your diff?18:23
ayoungstevemar, BTW: https://review.openstack.org/#/c/29105/  I need to rewrite that as an extension18:24
morganfainbergdstanek, because the on_arguments decorator has some side effects such as setting .invalidate, .set, and .refresh on the decorated methods.18:24
stevemarayoung: that sounds insanely cool, what happened to it?18:24
*** zaitcev has joined #openstack-dev18:26
*** comay has joined #openstack-dev18:26
*** asavu has quit IRC18:26
*** nati_ueno has quit IRC18:27
*** nati_ueno has joined #openstack-dev18:27
*** jaypipes has quit IRC18:28
dstanekmorganfainberg: no not yet, but i did realize that this reaches deeper than i thought18:29
*** anniec has quit IRC18:29
*** hartsocks has joined #openstack-dev18:29
dstanekfor example keystone.service expects a cache region to have already been created18:29
*** hartsocks has left #openstack-dev18:29
morganfainbergdstanek, yep.  because the decorator does other magic.  I needed to ensure that the decorator could do the work (wrap the methods) at import time.18:30
dstaneki think that could be removed with the lazy impl, but there are probably others18:30
dstanekmorganfainberg: does the cache region really need to exist before the managers are created?18:31
morganfainbergdstanek, yes, since the decorator has side effects.18:31
*** eglynn-is-hungry has quit IRC18:31
morganfainbergdstanek, and the decorator is tied to the cache region.18:31
*** anniec has joined #openstack-dev18:32
morganfainbergdstanek: https://bitbucket.org/zzzeek/dogpile.cache/src/67665a304cf284d127f323eab4d6c827032a08f7/dogpile/cache/region.py?at=master#cl-75918:32
*** xqueralt is now known as xqueralt-afk18:32
morganfainbergdstanek, specifically the locally defined methods invalidate, set, refresh.  we would need to re-implement a lot of that logic18:32
*** bdpayne_ has quit IRC18:33
morganfainbergdstanek, not opposed, but i'm not sure how beneficial it would be to re-impl that vs. just writing our own caching system/layer18:33
*** cdub has quit IRC18:33
*** cdub_ has quit IRC18:33
*** cdub has joined #openstack-dev18:34
*** cdub_ has joined #openstack-dev18:34
*** utlemming has quit IRC18:34
dstanekmorganfainberg: i was hoping to create the region in a lazy way - really i would create a fake version of the decorator the implements invalidate, set and refresh18:34
*** nati_ueno has quit IRC18:35
*** kiall_ has quit IRC18:35
dstanekmorganfainberg: is having our own caching layer the direction we are going?18:35
*** nati_ueno has joined #openstack-dev18:36
morganfainbergdstanek, i am hoping to move the keystone.common.cache stuff into oslo eventually, i think it's important to have caching that we control18:36
morganfainbergwe as in, implementation within openstack18:36
ayoungstevemar, -2 by dolph, I updated it, but never pinged him to remove the -2 and was abandonded.  I'll bring back for Icehouse18:36
*** jculp has joined #openstack-dev18:36
*** novas0x2a|laptop has joined #openstack-dev18:36
dolphmmorganfainberg: dstanek: catching up... this sounds like waaay more trouble than explaining to people that "yes, you need to install dogpile even if you don't want to cache anything"18:36
*** utlemming has joined #openstack-dev18:37
morganfainbergdolphm, that was my thought when I based this on the original example implementation we were talking about.18:37
ayoungstevemar, what will make it ultra cool, though, it HTML forms that explain what values are required and why.  We bascially need a GET for each post.18:37
*** Shaan7 has quit IRC18:38
dolphmayoung: you could build an entire standalone project (a la python-openstackclient) to build HTML forms for all of openstack's web services18:38
dolphmayoung: you should name it horizon18:38
ayoungdolphm, nope18:38
*** kiall has joined #openstack-dev18:38
dolphm;)18:38
ayoungdolphm, I do not believe in server side scripting18:38
morganfainbergdstanek, dolphm, i think it is easier to just leave it as a hard dep.  the overhead is fairly minimal for using it, it does need ot be installed though.18:39
*** aditirav has quit IRC18:39
morganfainbergayoung, so… not a fan of nodejs?18:39
ayoungdolphm, Horizon should be a web service...a facade for the rest of openstack...with an optional Javascript file that provides the web functionality18:39
dstanekmorganfainberg: i would agree18:39
*** aditirav has joined #openstack-dev18:39
dolphmayoung: that's ... kind of what it is18:39
ayoungmorganfainberg, nodejs is exactly the opposite of what I like18:39
*** nati_ueno has quit IRC18:40
morganfainbergdstanek, i also checked, the overhead of using it is fairly minimal with the default configuration.  the no-op backend does a lot to help with that.  there is some serialization, but keystone is largely single-threaded so that doesn't matter.18:40
bknudsonI thought keystone was a big wsgi script?18:40
ayoungdolphm, but Horizon should get its forms from the other projects...which we will start doing in Icehouse I think18:40
*** sarob has joined #openstack-dev18:40
morganfainbergbknudson, lol18:40
ayoungbknudson, it is18:41
*** jcoufal has joined #openstack-dev18:41
*** jaypipes has joined #openstack-dev18:43
ayoungstevemar, I really don't like the way I was generating the HTML in that patch.  Strings concatination is not the right approach.  I started using lxml, but never finished it18:44
*** welldannit has joined #openstack-dev18:44
morganfainbergdstanek / dolphm, so we're good with just telling people "you should install dogpile.cache18:46
morganfainberg"18:46
morganfainbergeven if not caching?18:46
*** dhellmann_ is now known as dhellmann18:46
*** mlavalle has quit IRC18:48
*** yolanda has quit IRC18:49
ttxmarkwash: pong18:49
markwashttx: I think dolphm might have answered my questions18:50
ttxstevemar: yes you can (edit sessions once they are submitted)18:50
ttxmarkwash: ok then18:50
stevemarttx: thx, dolphm helped me out!18:50
ttxdolphm: I see I can take a long vacation and you'll cover for me :)18:51
dolphmttx: o/18:51
* dolphm runs away now that ttx is back18:51
dstanekmorganfainberg: dolphm: i think we have to be18:51
dolphmmorganfainberg: sounds like that ^18:52
dolphmmorganfainberg: i don't think it's a big deal, but obviously some subset of users will be annoyed18:52
*** colinmcnamara has quit IRC18:52
dolphmthere will always be one18:53
morganfainbergdolphm, ok. that is enough for me.18:53
dolphmdstanek: so, once you get your tests going, you're going to move keystone to testr, right :D18:53
*** jpr has joined #openstack-dev18:54
dolphmdstanek: https://bugs.launchpad.net/keystone/+bug/117792418:54
uvirtbotLaunchpad bug 1177924 in keystone "Use testr instead of nose as the unittest runner." [Wishlist,Confirmed]18:54
jprhi.  I have a basic question18:54
jpri'm trying to compare the block storage API features in Essex and Grizzly.18:55
*** fbo_away is now known as fbo18:55
dolphmdstanek: AFAIK, the pain there is how keystone reads in conf files from keystone/tests/ and expects to be able to access etc/ in a similar fashion18:55
*** reed has quit IRC18:55
jprI can find all the block storage v2.0 info online at api.openstack.org for Grizzly info but I can't seem to find any legacy documentation for Essex.18:56
jprIs there a way to get at the old docs.18:57
*** zz_Guest61470 is now known as leif18:58
*** leif is now known as Guest4219418:59
*** gyee has quit IRC19:00
*** eglynn-is-hungry has joined #openstack-dev19:01
jprsorry going to #openstack19:01
*** SumitNaiksatam has joined #openstack-dev19:04
*** epim has quit IRC19:05
*** epim has joined #openstack-dev19:06
*** dstanek has quit IRC19:07
*** SergeyLukjanov has quit IRC19:07
*** xga has joined #openstack-dev19:07
*** otherwiseguy has joined #openstack-dev19:08
*** dina_belova has joined #openstack-dev19:11
*** xga has quit IRC19:11
*** basha has quit IRC19:12
*** kiall has quit IRC19:12
*** sandeepr_ltp has joined #openstack-dev19:13
*** openmike has quit IRC19:14
*** vipul is now known as vipul-away19:14
*** vipul-away is now known as vipul19:14
*** corXi has joined #openstack-dev19:15
*** dina_belova has quit IRC19:16
*** shinylasers has quit IRC19:17
*** jpr1 has joined #openstack-dev19:17
*** shinylasers has joined #openstack-dev19:17
*** jpr has quit IRC19:20
*** jpr1 has left #openstack-dev19:21
*** garyk has quit IRC19:24
*** amscanne_ has joined #openstack-dev19:25
*** dstanek has joined #openstack-dev19:27
*** amscanne has quit IRC19:28
*** networkstatic has quit IRC19:29
*** vipul is now known as vipul-away19:29
*** NobodyCam has joined #openstack-dev19:29
*** anniec has quit IRC19:31
*** sdague has left #openstack-dev19:31
*** eharney has joined #openstack-dev19:32
*** bauzas has quit IRC19:32
*** jculp has quit IRC19:32
*** pasquier-s has quit IRC19:33
*** yjiang5 is now known as yjiang5_away19:33
*** vipul-away is now known as vipul19:34
*** sdague has joined #openstack-dev19:36
*** anniec has joined #openstack-dev19:37
*** nrs_ has quit IRC19:37
*** redbo has quit IRC19:38
*** dosaboy_ has joined #openstack-dev19:40
*** redbo has joined #openstack-dev19:40
*** nrs_ has joined #openstack-dev19:40
*** asavu has joined #openstack-dev19:41
*** mmagr has joined #openstack-dev19:41
dolphmstevemar: looking19:41
*** dosaboy has quit IRC19:42
*** kiall has joined #openstack-dev19:43
dolphmstevemar: dammit, in the sql driver they're just role_id's right? what's kind of data are you persisting there?19:43
stevemardolphm... making me remember now... 1 sec19:44
*** ociuhandu has quit IRC19:44
*** jcoufal has quit IRC19:46
*** pasquier-s has joined #openstack-dev19:47
stevemardolphm: it's a jsondump of a subset of self.identity_api.list_roles()19:47
dolphmstevemar: entire role objects?!19:48
ayoungmhu, the problem is not in your code for https://review.openstack.org/#/c/40444/19:48
*** jasdeepH has quit IRC19:48
*** bauzas has joined #openstack-dev19:49
stevemardolphm: yes, that way when the keystone token is issued, it can just use that part19:50
stevemardolphm: but now i'm guessing that is bad, since you included an exclamation mark19:50
dolphmstevemar: !!19:50
*** jvrbanac has joined #openstack-dev19:51
dolphmstevemar: it's a completely utter nightmare how much garbage is tossed into the token table. this will have the exact same fate19:51
dolphmstevemar: and you're already having to second guess what you put in there, so it's already begun19:51
stevemardolphm: change it to just ids?19:52
dolphmstevemar: i was expecting a json-encoded list of strings, worst case... role_ids = ["123", "234", "abc"]19:52
dolphmstevemar: at least then, there's not too much room for mis-interpretation or bloat19:53
stevemardolphm: easy enough change, i'll change the column name to role_ids too19:53
ayoungstevemar, dolphm, check me on this...I might just be paranoid...if this patch goes through, will the EC2 API  allow an end run around security : token for ec2 creds not indicating delegation?   https://review.openstack.org/#/c/40444/19:54
*** colinmcnamara has joined #openstack-dev19:55
*** anniec has quit IRC19:55
dolphmayoung: looking...19:55
ayoungdolphm, I think I was being paranoid...I'd like to let that one get in, as the HEAT team needs it19:56
*** jprovazn has quit IRC19:56
dolphmayoung: they need a new api today?19:56
ayoungdolphm, this was languishing for a while19:56
ayoungI had -2ed it, and never saw that they updateed it19:57
*** shinylasers has quit IRC19:57
dolphmayoung: OS-EC2-FROM-TOKEN?19:57
ayounglast night, I gave it a once over, but then got paranoid19:57
ayoungyeah, that is wrong19:57
*** jruzicka has joined #openstack-dev19:58
ayoungdolphm, I think I am going to remove the -219:58
dolphmayoung: i think someone asked about this on list... i didn't understand why the use case required a new api19:58
ayoungdolphm, they need ec2 Credentials for access to vms, and the vms use the credentials to get tokens to perform actions on behalf of the users...19:59
ayoungits all "set up this rule and let it execute at 2am" type stuff19:59
*** portante is now known as portante|afk20:00
*** portante|afk is now known as portante20:00
*** rcleere has joined #openstack-dev20:02
*** romcheg has quit IRC20:02
*** gyee has joined #openstack-dev20:02
dolphmayoung: that doesn't explain the new api20:02
ayoungdolphm, they need to create an ec2 credential from a trust.20:03
*** mlavalle has joined #openstack-dev20:03
*** yjiang5 has joined #openstack-dev20:04
ayoungthey do that by way of a token20:04
ayoungdolphm, yeah...looks like they could have just extended the create20:05
*** shinylasers has joined #openstack-dev20:05
*** basha has joined #openstack-dev20:05
*** basha has quit IRC20:05
insanidadewould anyone please take a look at this problem? http://paste.openstack.org/show/45770/20:06
*** nati_ueno has joined #openstack-dev20:06
insanidadethat was copied from teh l3 agent screen during a stack.sh in devstack.20:06
insanidadeis that a serious problem ?20:07
sdaguejgriffith: you have to stop +Aing this patch before it goes through jenkins..... :P20:07
sdaguehttps://review.openstack.org/#/c/45093/20:07
ayoungshardy, is there any reason that should have a separate API?  Seems gratuitous to me?20:07
*** maheshp has quit IRC20:09
dolphmayoung: if the token has impersonation, then the existing api looks like it'll do the same thing20:12
*** henrynash has quit IRC20:12
*** dina_belova has joined #openstack-dev20:12
*** henrynash has joined #openstack-dev20:13
morganfainbergdolphm, also, it seems odd that they would use the same trust (explicit) token, seems to me that they would want the keypair to persist longer than the time on the token (something like the length of the trust?)20:13
morganfainbergdolphm, or am i mis-understanding the usecase20:13
jgriffithsdague: so we gate on README files now?20:14
jgriffithsdague: makes a lot of sense20:14
sdaguejgriffith: commit message20:14
*** radez is now known as radez_g0n320:14
dolphmmorganfainberg: where are you seeing that issue?20:14
jgriffithsdague: fair enough20:14
jgriffithsorry bout that20:14
sdagueit failed hacking in the commit message, so it was blocking everything behind it20:14
morganfainbergdolphm, line 104 https://review.openstack.org/#/c/40444/10/keystone/contrib/ec2/controllers.py20:15
morganfainbergdolphm, if creds have the token_id, it returns that speciifc token?20:15
morganfainbergdolphm, that would raise TokenNotFound if the token is expired.20:15
dolphmmorganfainberg: ah, good catch20:15
sdagueno worries, just trying to catch you before it happens again, because I actually fixed it once, then there was a patch 3 which broke it again20:16
dolphm... every line in this patch seems unnecessary if impersonation=True20:16
*** dvarga has quit IRC20:16
stevemardolphm: would [{'id':"123"}, {'id': "234"}] be okay to save ? instead of the one you mentioned?20:16
jgriffithsdague: yeah, it's a good thing we block on things like a period at the end of the first line in a commit mesg20:17
*** dina_belova has quit IRC20:17
jgriffithsdague: sorry...20:17
jgriffithsdague: I'm in a bit of a funk today20:17
sdaguejgriffith: no worries :)20:17
sdagueyou can turn that off in cinder if you like20:17
jgriffithsdague: nah, I like the consistency20:17
jgriffithsdague: just in fowl mood.  Think I'll get lunch and all will be better20:18
sdagueok, cool beans20:18
jgriffithsdague: in all seriousness, thanks for catching it and fixing it up20:18
*** garyk has joined #openstack-dev20:18
sdagueno prob20:18
*** jaypipes has quit IRC20:19
sdaguejust trying to maximize everyone's throughput on the gate queue today, as it's been a busy one20:19
ayoungshardy, can you address morganfainberg 's questions?20:19
ayoungsdake, or any any other HEAT devs ?20:20
*** nati_uen_ has joined #openstack-dev20:20
dolphmstevemar: that still has the same problem as tokens20:20
dolphmstevemar: ... room for bloat to slip in20:21
stevemarm'alright20:21
stevemaralright alright20:21
*** amscanne_ has quit IRC20:22
morganfainbergstevemar, why not just store the "ID" in a list?  seems like un-needed overhead to do '{'id:' <blah}'  if you're only storing id20:24
stevemarmorganfainberg, cause it came in that way via the request, didn't want to loop through it again20:24
stevemarmorganfainberg, no biggie though20:24
morganfainbergstevemar: as in didn't want to loop through in a for x in blah?20:25
stevemaryeah,20:25
stevemarbut i think i'm doing it anyway, when checking that the user has the role20:25
stevemarso it's actually a non-issue20:25
morganfainbergstevemar, perhaps.  maybe use a set if you want a better lookup on 'if X in blah'20:25
morganfainbergbut it's not a huge win unless you're iterating a lot20:25
* stevemar nods20:26
dolphmmorganfainberg: ++20:26
stevemari'm already using a set, to compare with user's roles20:26
dolphmstevemar: ++ for that20:26
stevemarso i'm just calling list()20:26
morganfainbergstevemar, sets are awesome :)20:26
stevemarindeed20:26
dolphmstevemar: i liked your issubset()20:26
dolphm(or whatever that method is called)20:26
stevemaris was pretty neat20:26
morganfainbergi like using sets for difference sets.20:27
morganfainbergget me everything in x that isn't in y20:27
morganfainbergbut haven't had a usecase for that in keystone yet20:27
morganfainberg(personal usecase that is)20:27
*** nati_ue__ has joined #openstack-dev20:28
dolphmstevemar: one of the problems with persisting role objects and then just regurgitating them is that everything but the ID is mutable, so in effect you're just storing stale data in a table right next to the latest data20:28
stevemardolphm: alright, i think i've got the impl down20:29
stevemardolphm: leaving soon to head out for the evening, and i want to add some tests for this, so can I have it ready for you tmrw morning?20:30
*** nati_uen_ has quit IRC20:30
dolphmstevemar: not acceptable20:30
stevemardolphm: i've been under the assumption there is a deadline of friday for this?20:30
dolphmstevemar: put what you have up for review, deadline is today20:30
stevemard'oh20:30
*** Guest85374 has quit IRC20:31
dolphmstevemar: more accurately, i'm done with havana in an hour :)20:31
morganfainbergdolphm, hehe.20:31
dolphmstevemar: https://wiki.openstack.org/wiki/Havana_Release_Schedule FeatureFreeze (Sep 4)20:31
*** fbo is now known as fbo_away20:31
stevemaroh jeez20:32
dolphmstevemar: you can probably fix it faster than me, but i'm motivated to get this in if you need to go20:32
stevemardolphm: no, it's fine, just double checking things before i submit20:33
dolphmstevemar: sweeet20:33
dolphmhenrynash: how far out is a revision? 39 things in gate right now means we need to join that queue ASAP to make havana :)20:35
*** jasdeepH has joined #openstack-dev20:35
henrynashworking on it right now…30 mins20:35
*** sushils has quit IRC20:35
*** ayoung is now known as ayoung-afk20:36
*** waa has quit IRC20:36
henrynashdolphm: how important is it to move the hints build out of the __init__ and into a function in the V3 controller class?20:37
dolphmbknudson: i saw you commented on henry's review... i should go read those?20:37
dolphms/i should/should i/20:37
dolphmhenrynash: is that not an easy change?20:38
henrynashdolphm: mechanical…just got to change all the places it is called…I can do it...20:38
bknudsondolphm: I wouldn't bother reading my comments if I was you20:39
dolphmbknudson: lol ok20:39
*** portante is now known as portante|afk20:39
*** mmagr has quit IRC20:40
*** sgordon has quit IRC20:42
stevemardolphm: i sincerely hope this works, running tests now, had to make a last minute change to /access_tokens/{id}/roles and /roles/{role_id}20:43
dolphmhenrynash: automechanical! find keystone -type f -exec sed -i 's/driver_hints\.Hints/self.build_driver_hints/g' {} \;20:44
dolphmhenrynash: disclaimer- probably made a typo20:45
henrynashdolphm: processing stuff now..20:45
*** Ryan_Lane has quit IRC20:49
*** waa has joined #openstack-dev20:50
*** Ryan_Lane has joined #openstack-dev20:50
*** Ryan_Lane has quit IRC20:51
*** Ryan_Lane has joined #openstack-dev20:51
*** dstanek has quit IRC20:52
*** tmclaugh[work] has quit IRC20:52
*** dims has quit IRC20:53
*** romcheg has joined #openstack-dev20:53
*** jcoufal has joined #openstack-dev20:54
shardyayoung-afk, morganfainberg: sorry in meetings20:54
morganfainbergshardy, no worries. had a question about the EC2 keypair from tokens20:54
stevemardolphm: new patch!20:54
dolphmmorganfainberg: https://review.openstack.org/#/c/43610/20:55
shardymorganfainberg: yes, Heat wants to be able to create an ec2 keypair from a trust, which doesn't expire, so we can deploy credentials in instances, for authentication with Heat APIs20:55
*** gimps_ has quit IRC20:55
*** nati_ue__ has quit IRC20:55
*** dims has joined #openstack-dev20:55
morganfainbergshardy, then the current patch needs work, max lifespan on the keypair is life of the token.  so default of 8640020:55
*** nati_uen_ has joined #openstack-dev20:55
morganfainbergdolphm, looking at stevemar's patchset now20:56
*** rcleere has quit IRC20:56
shardymorganfainberg: essentially we want something derived from the user owning the stack, but which has no real roles to do anything, ie implicitly untrusted in-instance ec2 keypair, which is used for signing requests to our CFN API20:56
morganfainbergshardy, makes perfect sense.  i was pretty sure that was the intent20:56
shardymorganfainberg: ok, cool20:57
*** maheshp has joined #openstack-dev20:57
*** danwent has quit IRC20:57
dolphmstevemar: sort of out of scope now, but if you want to change it for icehouse, you can totally drop  _format_role_entity()20:58
dolphmstevemar: dropping certain attributes made sense when they were provided as a nested object, but since they have their own first class api resource /roles ... it makes sense to include them20:58
stevemardolphm: yeah, agreed, i wanted to drop it20:59
dolphmstevemar: i wouldn't argue if you did it now, but it'd also be api backwards compatible to do it later21:00
*** noslzzp has quit IRC21:00
*** xqueralt-afk is now known as xqueralt21:00
dolphmstevemar: whoa, you're getting the user's roles from the wrong place user_token['metadata'].copy()21:01
*** asavu has quit IRC21:01
stevemardolphm: what? how is that wrong? that's where i've been getting it this whole time21:02
dolphmstevemar: that *might* work, but it'll certainly produce bugs as that's some of the untested garbage that gets inexplicably jammed into the token backend and then regurgitated back out the api21:02
dolphmstevemar: i haven't caught it until now :(21:03
stevemarwhere should I be getting it from?21:03
dolphmstevemar: assignment_api21:03
*** dprince has quit IRC21:03
dolphmstevemar: you're also requiring the authorizing user's token to be carrying the roles they're delegating... which is interesting, but undocumented21:04
morganfainbergstevemar, it's more sane to always ask for the authoritative data.21:04
stevemarso get user_id from there, and call get users roles?21:04
morganfainbergdolphm, i think there is a comment in token provider about not doing that (roles in metatdata) for at least one type of token.21:04
morganfainbergmight be v221:04
dolphmstevemar: list_roles_something_something(user_id, project_id) ?21:04
dolphmstevemar: i guess it's still get_metadata()21:04
dolphmmorganfainberg: the source of a lot of these problems is that a lot of our api tests check for the presence of data, but almost none check for the lack of unexpected data... so this kind of stuff constantly slips through21:06
*** romcheg has left #openstack-dev21:06
*** pcm_ has quit IRC21:06
morganfainbergdolphm, stevemar: assignment_api.get_roles_for_user_and_project(user_id, tenant_id)21:06
dolphmand then people like stevemar assumes it's part of the api.21:06
stevemaryep21:06
dolphmmorganfainberg: oh sweet21:06
stevemarstevemar assumes nothing!21:06
dolphmstevemar: it's not your fault :(21:06
morganfainbergdolphm, i'll toss a BP up to clean that up and/or work on tests.21:06
dolphmmorganfainberg: i don't even know how to go about tackling it, other than doing a major api revision at the same time :(21:07
morganfainbergdolphm, at least we could implement tests for it21:07
morganfainberglack of data that is.21:07
*** kiall has quit IRC21:07
dolphmmorganfainberg: asserting it exists? or asserting we don't make more mistakes21:07
morganfainbergmaybe better commenting.21:08
stevemardolphm: give me 1 sec21:08
stevemardolphm: then i'll update with new patch21:08
morganfainbergdolphm, i'll think about that.  if it is assumed to exist for _some_ things, likely it should always exist.21:08
dolphmhttps://wiki.openstack.org/wiki/Governance/Proposed/APIManagement-sampleGuidelines21:09
*** bdpayne has joined #openstack-dev21:09
dolphmBackwards-incompatible changes (e.g., no longer supporting a resource, changing representation formats) are introduced by incrementing the version identifier. Bumping the version should be done very rarely. When the version is bumped, the most recent version must be supported for at least [n] releases afterwards, preferably longer, and the sunset of the API version needs to be widely announced.21:09
*** Ryan_Lane has quit IRC21:10
bknudson[n] releases... that's a long time.21:10
*** Ryan_Lane has joined #openstack-dev21:10
dolphmhenrynash: 30 minutes is up! ;)21:10
bknudsonwhen can we drop v2?21:10
henrynashdolphm; Nearly there21:10
*** martine_ has quit IRC21:10
*** anniec has joined #openstack-dev21:11
stevemardolphm: so trying to get the project id... from the token, but just a tenant object is showing, that normal?21:11
dolphmbknudson: i'd like to consider everything but v2 auth deprecated as of ... now? last release?21:11
dolphmbknudson: i imagine we can easily (and should) support v2 auth via middleware for a while longer21:11
dolphmbknudson: (just rewrite v2 requests into v3 auth requests, and vice versa)21:12
bknudsondolphm: I keep telling people to use the openstack client, but then it turns out that nobody ships it.21:12
morganfainbergdolphm ++, deprecate v2 would be nice.21:12
*** dubsquared has quit IRC21:12
*** dina_belova has joined #openstack-dev21:12
bknudsonI can't convince our own team to ship it until other distros do.21:12
dolphmstevemar: uhh... well... a v2 token would have a tenant...21:13
stevemar... but i'm running v3 tests, so why would it there be a tenant21:13
dolphmbknudson: soon https://github.com/openstack/python-keystoneclient/commit/661d6cf783d1586e435196f38ffb1b2361b8fe2521:13
*** NobodyCam_ has joined #openstack-dev21:14
bknudsondolphm: I'm hoping that will convince somebody.21:14
*** NobodyCam_ has quit IRC21:14
*** sushils has joined #openstack-dev21:14
*** alunduil has quit IRC21:14
*** ndipanov_afk is now known as ndipanov21:15
*** amscanne has joined #openstack-dev21:16
dolphmbknudson: although it should be relaxed a tiny bit... https://review.openstack.org/#/c/45127/21:16
dolphmbknudson: only because openstackclient isn't ready for primetime today21:17
stevemardolphm: this is what i'm seeing http://paste.openstack.org/raw/45779/21:17
*** dina_belova has quit IRC21:17
*** Ryan_Lane has quit IRC21:17
*** Ryan_Lane1 has joined #openstack-dev21:17
*** marun has quit IRC21:17
dolphmstevemar: all i see is redundant garbage21:18
*** garyk1 has joined #openstack-dev21:19
dolphmstevemar: indented that.. http://pasteraw.com/7gzms6aj90orpnlgxvn12xsozdzysxm21:19
*** Ryan_Lane1 is now known as Ryan_Lane21:20
*** garyk has quit IRC21:20
*** Ryan_Lane has quit IRC21:20
*** Ryan_Lane has joined #openstack-dev21:20
*** maheshp has quit IRC21:20
morganfainbergdolphm, i think the token spec might be a little loose, we should probably look at building a test that validates we don't add more misc data to the tokens as is21:20
stevemardolphm: thx, i was trying to do that21:20
morganfainbergwithout intent21:20
dolphmstevemar: jsonutils21:20
dolphmmorganfainberg: +++21:20
*** maheshp has joined #openstack-dev21:20
morganfainbergerm, duplicated/misc/unneeded data21:20
stevemardolphm: so, should I dig into token data? or just ... stick with tenant?21:20
dolphmstevemar: d['token_data']['token']['project']['id'] indicates the token's scope21:21
stevemardolphm: or check project in token data first? then default to tenant if it doesn't exist21:21
stevemargotcha, so no21:21
morganfainbergdolphm, reminds me. needed to ask you a quick question.21:21
dolphmstevemar: (where are you putting this project id?)21:21
dolphmmorganfainberg: o/21:22
stevemardolphm: i'm not putting it anywhere, i'm trying to get the project id for the list_users_roles_....21:22
*** dstanek has joined #openstack-dev21:22
dolphmstevemar: then you'd use the project ID from the request token, right?21:22
dolphmstevemar: you want to know what roles the authorizing user has on the requested project id21:22
stevemarffs, this is what i get for rushing21:23
*** marun has joined #openstack-dev21:23
dolphmstevemar: lol i think it's *interesting* that you're using the authorizing user's supplied token, but then you'd need to check that the token is scoped to the requested_project_id21:24
dolphmstevemar: i think you can safely assume the token is valid21:24
stevemarugh, embarassing, i'm rushing like crazy21:24
*** jcoufal has quit IRC21:25
*** maheshp has quit IRC21:25
dolphmstevemar: interesting does not mean wrong, it means my brain is unable to comprehend consequences at the moment :P21:25
stevemardolphm: re-running the tests once more21:26
*** SumitNaiksatam has quit IRC21:26
*** jbresnah_ is now known as jbresnah21:28
*** amscanne has quit IRC21:29
*** amscanne has joined #openstack-dev21:30
*** maheshp has joined #openstack-dev21:32
*** jamielennox|away is now known as jamielennox21:32
*** epim has quit IRC21:33
*** epim has joined #openstack-dev21:33
*** sarob has quit IRC21:34
*** sarob has joined #openstack-dev21:35
*** anniec has quit IRC21:36
dolphmhenrynash: *poke*21:36
henrynashdolphm: running unittests21:37
*** anniec has joined #openstack-dev21:38
*** radsy has joined #openstack-dev21:39
*** sarob has quit IRC21:39
*** osphy has joined #openstack-dev21:40
*** portante|afk is now known as portante21:40
*** kiall has joined #openstack-dev21:40
icchaclarkb: https://review.openstack.org/#/c/43368/ jenkins not rerunning tests, anything I can do?21:40
icchaanteaya: ^21:41
stevemardolphm: new patch21:41
henrynashdolphm: so have posted new patch21:42
dolphmyay21:42
clarkbiccha: http://status.openstack.org/zuul/ the jobs are running21:42
henrynashdolphm: there is still an issue that mark_filter_satisfied doesn't really do what we want21:42
anteayaiccha: looking21:42
henrynashdolphm: the consequence is that although the filter will get implemented in the SQL (for example), the controller  will still reapply the filter (with no effect, of course)21:43
icchathanks clarkb anteaya21:43
henrynashdolphm: I need to fix that, but mayeb that could be a fix applied after21:43
*** topol has quit IRC21:43
*** jruzicka has quit IRC21:43
*** xqueralt is now known as xqueralt-afk21:44
dolphmhenrynash: ++21:44
dolphmhenrynash: kinda sorta late, but what if we didn't fall back on the controller to do the work?21:44
clarkbiccha: the gate has a higher priority than the check queue21:45
anteayaiccha: should finish in ~10 minutes21:45
dolphmhenrynash: either the driver satisfies the hints or the client gets more data than expected21:45
henrynashdolphm: meaning, if the driver doesn't do it, no filtering?21:45
clarkbiccha: you may see that check tests happen more slowly as the gate queue is currently busy21:45
dolphmhenrynash: right21:45
henrynashdolphm: kind of an odd thing from an api point of view…the filter *might* work21:46
henrynashdolphm: what's the advantage?21:46
*** stevemar has quit IRC21:46
ayoung-afkhenrynash, I'm ok with that approach21:47
henrynashayoung-afk: with the filter not working depending on the driver (which would be the effect)?21:48
*** dstanek has quit IRC21:49
ayoung-afkhenrynash, yeah..it would actually hide less, and thus performance issues would be clearer...might even help prevent some21:49
*** BStokes has joined #openstack-dev21:49
dolphmmorganfainberg: https://review.openstack.org/#/c/43610/21:50
*** neoXsys has quit IRC21:50
dolphmhenrynash: it's just a thought that i'm certainly not opposed to21:51
*** SumitNaiksatam has joined #openstack-dev21:51
*** ewindisch has joined #openstack-dev21:51
*** ewindisch is now known as ericw21:51
morganfainbergdolphm, +2'd21:51
*** mrodden has quit IRC21:52
*** ericw is now known as ewindisch21:52
morganfainbergdolphm, didn't approve because jenkins hadn't responded yet.21:52
dolphmmorganfainberg: ah shit21:52
*** portante is now known as portante|afk21:52
dolphmmorganfainberg: unset approved!21:52
*** lbragstad has quit IRC21:52
morganfainbergdolphm, i didn't approve ;)21:52
morganfainbergoh21:52
morganfainbergyou haha21:52
dolphmmorganfainberg: i did21:52
morganfainbergyeah =/21:52
dolphmmorganfainberg: i think that only kills everything after it in the gate, which was nothing21:53
*** shardy is now known as shardy_afk21:53
*** ewindisch is now known as ewindisch-21:53
morganfainbergit still runs a verify thought the gate iirc21:53
morganfainbergjust wont merge.21:53
*** datsun180b has quit IRC21:54
*** sdake_ has quit IRC21:54
henrynashdolphm: well it's certainly a one line change to stop the controller filtering…although I still worry about the api21:54
henrynash(the impact that sometimes it filters)21:54
dolphmhenrynash: i'm just thinking it's not unreasonable to put the burden on the driver to satisfy hints -- or not21:55
*** guardian_ has joined #openstack-dev21:56
*** kbringard has quit IRC21:56
dolphmhenrynash: bunch of inconsistency over where hints are required or not21:57
dolphmhenrynash: every other method signature in https://review.openstack.org/#/c/43257/36/keystone/assignment/core.py21:57
henrynashdolphm: well, all the list ones define it...21:58
henrynashdolphm: where is it inconstant?21:58
dolphmhenrynash: list_projects(self, hints) vs list_user_projects(self, user_id, hints=None)21:58
dolphmhenrynash: required in the first, optional kwarg in the second21:59
henrynashdolphm: hmm, damn, yes the call INTO the manager should have it optional, the call to the driver should require it22:00
dolphmhenrynash: that's reasonable, as long as it's consistent!22:00
dolphmhenrynash: that's the only file i've seen so far with inconsistency in that regard22:01
dolphmhenrynash: typo in line 49 https://review.openstack.org/#/c/43257/36/keystone/tests/filtering.py22:04
dolphms/Big/Bug/22:04
*** trey_h has quit IRC22:05
henrynashdolphmL got it22:05
*** trey_h has joined #openstack-dev22:06
dolphmhenrynash: why do you have to copy the query string here? https://review.openstack.org/#/c/43257/36/keystone/trust/controllers.py22:06
henrynashdolphm: I can undo those changes now, yes22:07
dolphmhenrynash: your current change failed py27 tests22:08
henrynashdolphm: yep, got it22:08
*** gmurphy_gone is now known as gmurphy22:08
*** spzala has quit IRC22:09
*** asavu has joined #openstack-dev22:10
*** trey_h has quit IRC22:11
*** flaper87 is now known as flaper87|afk22:11
*** dina_belova has joined #openstack-dev22:13
*** anniec has quit IRC22:13
dolphmhenrynash: Hints.__init__ still exists22:16
*** ndipanov has quit IRC22:16
*** jayg is now known as jayg|g0n322:16
henrynashdolphm:  oops, sort meant to delete, will do22:16
*** tstevenson has quit IRC22:16
*** anniec has joined #openstack-dev22:17
*** anniec has quit IRC22:17
*** dina_belova has quit IRC22:18
dolphmhenrynash: i'm being asked to walk out the door :P22:18
*** boris-42 has quit IRC22:19
henrynashdolphm: ?22:19
dolphmhenrynash: dinner time!22:19
*** boris-42 has joined #openstack-dev22:19
*** jmontemayor has quit IRC22:19
henrynashdolphm: ok!!! new patch in about 10 mins22:19
dolphmhenrynash: it looks like you still have a bunch of calls to driver_hints.Hints()22:20
henrynashdolphm: is that bad?22:20
*** anniec has joined #openstack-dev22:20
dolphmwell, that's the code you're about to delete, right?22:21
dolphmhenrynash: i mean, not empty inits22:21
henrynashhmmm22:21
henrynashI guess I need to remove the ()22:21
dolphmhenrynash: err, let me comment on them in the review to illustrate..22:22
henrynashdolphm: ok...22:22
*** donaldh has quit IRC22:23
*** burt has quit IRC22:25
dolphmhenrynash: http://pasteraw.com/hs2coq5qksvh4yvd1vwyldxl4la29ek22:25
*** sarob has joined #openstack-dev22:25
henrynashdolphm: ok22:27
henrynashdolphm: thx22:27
*** changbl has quit IRC22:27
*** otherwiseguy has quit IRC22:28
*** eglynn-is-hungry is now known as eglynn22:28
*** eglynn is now known as eglynn-is-tired22:28
*** danwent has joined #openstack-dev22:29
*** sarob has quit IRC22:30
*** prad_ has quit IRC22:31
*** jhesketh has joined #openstack-dev22:32
*** eharney has quit IRC22:32
*** jhesketh__ has joined #openstack-dev22:32
insanidadeanyone around who could give some basic hints on the way an agent works?22:32
*** thedodd has quit IRC22:32
*** guardian_ has quit IRC22:33
*** sarob has joined #openstack-dev22:33
*** FunnyLookinHat has quit IRC22:35
*** atiwari has quit IRC22:38
*** sarob has quit IRC22:41
*** sarob has joined #openstack-dev22:41
*** sheeprine has quit IRC22:43
*** dhellmann is now known as dhellmann_22:43
*** nati_ueno has quit IRC22:44
*** shakayumi has joined #openstack-dev22:44
*** sarob has quit IRC22:45
*** Guest42194 is now known as zz_Guest4219422:45
*** maheshp has quit IRC22:45
*** networkstatic has joined #openstack-dev22:47
*** bdpayne has quit IRC22:51
dolphmhenrynash: i'm off to dinner22:52
*** sarob has joined #openstack-dev22:53
*** galstrom is now known as galstrom_zzz22:53
henrynashdolphm: ok, final unit tests running now…will post in a few22:53
henrynashdolphm: have fixed up all issues raised since last patch22:54
*** asavu has quit IRC22:54
*** gordc has quit IRC22:54
*** eglynn-is-tired has quit IRC22:55
*** sushils has quit IRC22:55
*** sushils has joined #openstack-dev22:55
*** sarob_ has joined #openstack-dev22:56
*** sdake_ has joined #openstack-dev22:56
henrynashdolphm: patch posted22:58
*** _cerberus_ has quit IRC22:58
*** sarob has quit IRC22:59
*** sheeprine has joined #openstack-dev23:00
*** sheeprine has joined #openstack-dev23:00
*** sarob_ is now known as sarob23:02
*** fbo_away is now known as fbo23:03
henrynashmorganfainberg, bknudson: if your around and good look at https://review.openstack.org/#/c/43257/37 - have fixed up most comments, unless it is major, happy to follow up with fixes once we get it in23:05
henrynashmorganfainberg, bknudson: looking for at least one +2 and then dolphm can do the rest23:06
*** zz_Guest42194 is now known as leif23:07
*** reed has joined #openstack-dev23:07
*** leif is now known as Guest2838523:07
*** jbresnah has quit IRC23:09
morganfainberghenrynash, only 37 patchsets?  I don't know…23:09
morganfainberghenrynash, looking at it now.23:09
*** edmund1 has quit IRC23:10
bknudsonit's only 1000 lines of code.23:10
morganfainberghenrynash, but i might get pushed into a meeting here.23:10
henrynashmorganfainberg: I know, getting a boy to do a man's job etc. etc.23:10
*** jbresnah has joined #openstack-dev23:12
*** dina_belova has joined #openstack-dev23:13
*** Ruetobas has quit IRC23:14
*** jimfehlig has quit IRC23:14
*** fbo is now known as fbo_away23:15
*** MaxV has joined #openstack-dev23:16
*** mlavalle has left #openstack-dev23:17
*** dina_belova has quit IRC23:18
*** Ruetobas has joined #openstack-dev23:19
*** alunduil has joined #openstack-dev23:23
*** alexxu has joined #openstack-dev23:23
*** MaxV has quit IRC23:24
*** pmathews has quit IRC23:24
*** sdake_ has quit IRC23:24
*** MaxV has joined #openstack-dev23:26
*** mdenny has quit IRC23:27
*** dims has quit IRC23:29
*** hemna is now known as hemnafk23:30
*** diogogmt has quit IRC23:33
*** gongysh has joined #openstack-dev23:36
*** welldannit has quit IRC23:37
*** kbrierly has quit IRC23:38
*** jbresnah has quit IRC23:38
henrynashmorganfainberg: me, being the boy, in that expression (in case you were confused, or insulted!)23:39
*** michchap has joined #openstack-dev23:40
henrynashbknudson: if you are around, if you think https://review.openstack.org/#/c/43257/37 is in good enough shape then if you could help push it along with a +2 that would be great23:41
bknudsonhenrynash: I'll take a look at it.23:41
henrynashbknudson: its just about to pop out of jenkins23:42
henrynashbknudson: there are still a few fixes we will want to apply after H3, but in general I think it is in good shape23:43
morganfainberghenrynash, i see at first pass a doc nit.23:43
*** jbresnah has joined #openstack-dev23:44
*** jhesketh has quit IRC23:44
morganfainberghenrynash, nothing is standing out, but i've been busy in meetings so i can only really +1 it at the moment.23:44
henrynashmorganfainberg: every little helps :-)23:44
morganfainbergstill back looking at it, but if bknudson beats me to +2 .. so be it :)23:44
henrynashmorganfainberg: 2 x +2s would be even better of course :-)23:45
bknudsonmorganfainberg: I'm not a fast reviewer23:45
morganfainbergbknudson, i know but with the amount of distraction on this end, i might not get through it until tomorrow :P23:45
henrynashmorganfainberg: we wouldn't hold it for nits (would follow up and fix)23:45
morganfainbergwhich would be bad.23:45
morganfainberghenrynash, aye i published the +1 and nit, just so you see it23:46
henrynashmorganfainberg: ok, thx23:46
*** dims has joined #openstack-dev23:47
*** alop has quit IRC23:48
*** MaxV has quit IRC23:52
*** jasdeepH has quit IRC23:53
*** eglynn-is-tired has joined #openstack-dev23:56
henrynashdolphm: you back?23:58
*** epim has quit IRC23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!