Friday, 2016-01-22

*** witlessb has quit IRC00:28
*** SlickNik has left #openstack-sahara01:03
*** Poornima has joined #openstack-sahara03:11
*** links has joined #openstack-sahara03:26
openstackgerritjaveme proposed openstack/sahara: Move notifications options into oslo_messaging_notifications  https://review.openstack.org/27005503:37
*** links has quit IRC03:40
*** links has joined #openstack-sahara03:48
*** links has quit IRC04:04
*** vgridnev has joined #openstack-sahara04:08
*** links has joined #openstack-sahara04:16
*** agireud has quit IRC04:20
*** coolsvap|away has joined #openstack-sahara04:21
*** coolsvap|away is now known as coolsvap04:22
*** agireud has joined #openstack-sahara04:22
*** links has quit IRC04:27
*** links has joined #openstack-sahara04:27
*** links has quit IRC04:50
*** links has joined #openstack-sahara04:57
openstackgerritVitaly Gridnev proposed openstack/sahara: Use internal auth url to communicate with swift  https://review.openstack.org/26900104:59
*** links has quit IRC05:13
*** links has joined #openstack-sahara05:21
*** sgotliv has joined #openstack-sahara05:23
*** vgridnev has quit IRC05:24
*** links has quit IRC05:36
*** links has joined #openstack-sahara05:37
*** vgridnev has joined #openstack-sahara05:47
*** links has quit IRC05:59
openstackgerritMerged openstack/sahara-image-elements: Updated from global requirements  https://review.openstack.org/27113306:00
*** links has joined #openstack-sahara06:01
*** Poornima has quit IRC06:05
*** hdd has quit IRC06:11
*** links has quit IRC06:22
*** links has joined #openstack-sahara06:23
*** coolsvap is now known as coolsvap|away06:26
*** Poornima has joined #openstack-sahara06:27
*** vgridnev has quit IRC06:33
*** nkrinner has joined #openstack-sahara06:38
*** links has quit IRC06:46
*** links has joined #openstack-sahara06:50
*** hdd has joined #openstack-sahara06:50
*** vgridnev has joined #openstack-sahara06:54
*** links has quit IRC07:09
*** links has joined #openstack-sahara07:09
openstackgerritMerged openstack/sahara-specs: [Spec]Remove-plugin-vanilla-v2.6.0  https://review.openstack.org/25986407:15
*** hdd has quit IRC07:15
*** esikachev has joined #openstack-sahara07:26
*** rcernin has joined #openstack-sahara07:31
*** links has quit IRC07:31
*** links has joined #openstack-sahara07:48
*** links has quit IRC07:54
openstackgerritVitaly Gridnev proposed openstack/sahara-specs: Add an option to sahara-image-create to generate bare metal images  https://review.openstack.org/26972807:55
openstackgerritEvgeny Sikachev proposed openstack/sahara: Remove scenario tests and related files  https://review.openstack.org/27116807:56
*** vgridnev has quit IRC08:20
*** links has joined #openstack-sahara08:22
*** links has quit IRC08:35
*** _degorenko|afk is now known as degorenko08:48
openstackgerritMerged openstack/sahara-ci-config: Cleanup /tmp/sahara-scenario dir  https://review.openstack.org/27089708:51
*** witlessb has joined #openstack-sahara09:17
*** vgridnev has joined #openstack-sahara09:25
openstackgerritEvgeny Sikachev proposed openstack/sahara: Remove scenario tests and related files  https://review.openstack.org/27116809:26
*** Poornima is now known as Poornima|L010:13
openstackgerritDenis Egorenko proposed openstack/sahara-ci-config: Remove pin for pip and tox  https://review.openstack.org/27122110:21
*** tosky has joined #openstack-sahara10:33
*** sgotliv has quit IRC10:37
*** Poornima|L0 is now known as Poornima10:42
*** vgridnev has quit IRC10:44
openstackgerritEvgeny Sikachev proposed openstack/sahara-ci-config: Add openstack/sahara-scenario project to zuul  https://review.openstack.org/26815010:48
*** vgridnev has joined #openstack-sahara10:48
openstackgerritDenis Egorenko proposed openstack/sahara-ci-config: Rewrite local.sh with openstack client  https://review.openstack.org/24404411:03
openstackgerritEvgeny Sikachev proposed openstack/sahara: Remove scenario tests and related files  https://review.openstack.org/27116811:05
openstackgerritMerged openstack/sahara-ci-config: Remove pin for pip and tox  https://review.openstack.org/27122111:46
*** openstackgerrit has quit IRC11:47
*** openstackgerrit has joined #openstack-sahara11:48
*** openstackgerrit has quit IRC12:33
*** openstackgerrit has joined #openstack-sahara12:33
*** vgridnev has quit IRC13:01
*** vgridnev has joined #openstack-sahara13:16
*** vgridnev has quit IRC13:19
*** vgridnev has joined #openstack-sahara13:23
openstackgerritEvgeny Sikachev proposed openstack/sahara-ci-config: Add $ZUUL_BRANCH to sahara get_dependency  https://review.openstack.org/27129413:46
*** nkrinner has quit IRC14:01
openstackgerritEvgeny Sikachev proposed openstack/sahara-ci-config: Use master of sahara-scenario for stable branches  https://review.openstack.org/26967914:16
openstackgerritEvgeny Sikachev proposed openstack/sahara-ci-config: Use master of sahara-scenario for stable branches  https://review.openstack.org/26967914:18
openstackgerritEvgeny Sikachev proposed openstack/sahara-ci-config: Use master of sahara-scenario for stable branches  https://review.openstack.org/26967914:19
*** tmckay has joined #openstack-sahara14:24
*** Poornima has quit IRC14:27
vgridnevelmiko, I have question about CONCERNING14:33
vgridnevthis the status that cloudera will give to Sahara14:33
vgridnevit's not actual sahara state14:33
elmikovgridnev: ok, yea, i figured these were internal states that we are capturing14:35
elmikoi just thought the word sounded a little off14:35
vgridnevanyway we can't change that14:35
elmikoah, is that what cloudera reports, "CONCERNING"?14:36
elmikook, well. thanks for the explanation, it helps14:36
*** crobertsrh has joined #openstack-sahara14:39
openstackgerritTrevor McKay proposed openstack/sahara: Where filter is not done correctly on programmatic selection  https://review.openstack.org/27133214:44
openstackgerritEvgeny Sikachev proposed openstack/sahara-ci-config: Add sahara-ci to sahara-scenario  https://review.openstack.org/26815014:44
openstackgerritEvgeny Sikachev proposed openstack/sahara-ci-config: Add sahara-ci to sahara-scenario  https://review.openstack.org/26815014:48
*** pcaruana has joined #openstack-sahara14:49
openstackgerritEvgeny Sikachev proposed openstack/sahara-ci-config: Add sahara-ci to sahara-scenario  https://review.openstack.org/26815014:51
openstackgerritEvgeny Sikachev proposed openstack/sahara-ci-config: Add sahara-ci to sahara-scenario  https://review.openstack.org/26815014:54
elmikoanyone here ever run into issues running `tox -r -epy34` ? i'm seeing some strange errors about missing jinja2...14:55
tmckayI don't think I have a machine with python 3 installed, actually14:58
tmckayI probably should14:59
openstackgerritEmilien Macchi proposed openstack/puppet-sahara: drop mock dependency  https://review.openstack.org/27135315:00
elmikoi just don't understand what is going on with this...15:00
* elmiko sighs15:01
tmckayelmiko, did you blow tox away and let it recreate?15:01
* tmckay probably, I always do that first :)15:01
elmikoyea, tried that. -r will recreate the venv15:01
elmikomaybe i should actually delete the directory and try again15:01
*** egafford has joined #openstack-sahara15:13
*** hdd has joined #openstack-sahara15:14
openstackgerritVitaly Gridnev proposed openstack/sahara-specs: Cluster verifications spec  https://review.openstack.org/27015615:19
openstackgerritDenis Egorenko proposed openstack/sahara-ci-config: Pass image name var to tox env  https://review.openstack.org/27138215:39
openstackgerritEvgeny Sikachev proposed openstack/sahara-ci-config: Add sahara-ci to sahara-scenario  https://review.openstack.org/26815015:40
openstackgerritDave Walker proposed openstack/sahara: Bump stable/kilo next version to 2015.1.4  https://review.openstack.org/27139815:43
openstackgerritEvgeny Sikachev proposed openstack/sahara-ci-config: Add sahara-ci to sahara-scenario  https://review.openstack.org/26815015:43
openstackgerritMerged openstack/sahara-ci-config: Use master of sahara-scenario for stable branches  https://review.openstack.org/26967915:47
openstackgerritVitaly Gridnev proposed openstack/sahara: Fix anti-affinity handling in heat engine  https://review.openstack.org/27140215:51
*** esikachev has quit IRC15:52
openstackgerritMerged openstack/sahara: Remove scenario tests and related files  https://review.openstack.org/27116815:57
openstackgerritVitaly Gridnev proposed openstack/sahara: Fix anti-affinity handling in heat engine  https://review.openstack.org/27140215:58
*** vgridnev has quit IRC16:07
*** rcernin has quit IRC16:15
*** hdd has quit IRC16:24
*** degorenko is now known as _degorenko|afk16:41
*** rcernin has joined #openstack-sahara16:54
*** crobertsrh has quit IRC16:56
openstackgerritMerged openstack/sahara-image-elements: Add a bare metal image generation option to sahara-image-create  https://review.openstack.org/26982117:24
*** esikachev has joined #openstack-sahara17:43
-openstackstatus- NOTICE: Restarting zuul due to a memory leak17:51
*** hdd has joined #openstack-sahara18:08
*** esikachev has quit IRC18:12
*** crobertsrh has joined #openstack-sahara18:14
*** tosky has quit IRC18:16
*** esikachev has joined #openstack-sahara18:52
openstackgerritTrevor McKay proposed openstack/sahara: Remove overlap of 'is_default' and 'is_protected' for templates  https://review.openstack.org/27148419:05
*** rcernin has quit IRC19:12
openstackgerritTrevor McKay proposed openstack/sahara: Change 'ignore_default' to 'ignore_prot_on_def'  https://review.openstack.org/27149119:28
openstackgerritChad Roberts proposed openstack/sahara-dashboard: Reorganizing job and cluster guide pages  https://review.openstack.org/27047819:32
*** witlessb has quit IRC19:36
openstackgerritMerged openstack/sahara-specs: Add an option to sahara-image-create to generate bare metal images  https://review.openstack.org/26972819:46
*** witlessb has joined #openstack-sahara19:50
openstackgerritTrevor McKay proposed openstack/sahara: Add 'is_protected' field to all default templates  https://review.openstack.org/27150419:59
*** raildo is now known as raildo-afk20:02
*** witlessb has quit IRC20:03
*** pcaruana has quit IRC20:14
*** witlessb has joined #openstack-sahara20:18
*** tellesnobrega is now known as tellesnobrega_af20:22
*** tellesnobrega_af is now known as tellesnobrega20:29
*** egafford has quit IRC20:31
openstackgerritTrevor McKay proposed openstack/sahara: Add 'is_protected' field to all default templates  https://review.openstack.org/27150420:41
*** esikachev has quit IRC20:42
openstackgerritVitaly Gridnev proposed openstack/sahara: Fix anti-affinity handling in heat engine  https://review.openstack.org/27140221:01
openstackgerritVitaly Gridnev proposed openstack/sahara: Add release notes for sahara master  https://review.openstack.org/25521421:09
*** crobertsrh has quit IRC21:14
*** egafford has joined #openstack-sahara21:29
tmckayegafford, hey21:29
egaffordtmckay: Hello21:29
tmckayegafford, looks like we don't have any "is_protected" handling in Horizon. Does that ring a bell?21:31
egaffordtmckay: I've been using Horizon increasingly infrequently, but I can check.21:31
tmckaymine might be out of date21:32
openstackgerritMichael McCune proposed openstack/sahara: Add release notes for external key manager usage  https://review.openstack.org/27152921:32
elmikotmckay: have you integrate the new sahara-dashboard stuff?21:33
tmckayelmiko, no, I as trying to resurrect an old VM. I've got sahara running locally but horizon is old (it's messed up now because I did a pull :) )21:34
tmckayguess I should visit the ui dev pages21:34
elmikoyea, or maybe setup a new devstack vm or something21:35
tmckayelmiko, I was looking around for UI "is_protected" knobs on templates21:35
elmikoall the horizon related code has been moved (back) into the sahara-dashboard repo21:35
elmikoyea, i thought we had those put in, but it may only be in the new repo21:35
tmckayokay. Well, I can at least grep in there21:35
tmckaygotcha21:36
elmikothat's probably the next step21:36
elmikohmm, looks like maybe not21:36
tmckayelmiko, https://github.com/openstack/sahara-dashboard.git ?21:38
elmikoyes21:38
* tmckay checks blueprints and bugs21:38
* tmckay and specs21:39
elmikoi'm not seeing it in the code or the open reviews. i guess it hasn't been done yet21:39
tmckayelmiko, yeah, bummer :)21:39
elmikoyea, sorry21:39
tmckayelmiko, with the def temp change, horizon will tell you that you can't delete it because it's protected now (which is right, as opposed to is a default)21:40
elmikodoh!21:40
tmckaybut there is no happy check box to unprotect and try again, heh21:40
elmikooh man...21:40
elmiko#FridayProblems21:40
tmckaywell, there is always the CLI. I should be able to prove it from there21:41
tmckayI have not tried to wrangle horizon for a while21:41
elmikoyea, gonna have to relearn a little ;)21:41
elmikoalthough, setting it up through devstack is very easy now21:41
tmckayelmiko, ack.  I'll have to ping crobertsrh, if we don't have "protected" toggles on the radar for mitaka I think we should21:42
elmiko+121:42
tmckayflags were added in Liberty, I think21:42
tmckayelmiko, hmm, liberty spec calls for it ... I'll keep hunting21:43
elmikomaybe that one detail slipped under the rug, didn't we get the "is default" checkboxes in place?21:46
*** pcaruana has joined #openstack-sahara21:48
*** rcernin has joined #openstack-sahara21:52
tmckayelmiko, not sure21:55
tmckayelmiko, oh snap! I did it from the CLI with JSON on standard in. I turned off protected on a def cluster template and it's def worker, modified some fields, then deleted them both22:04
tmckayso, I guess it works22:04
tmckayyou can now mess up your def template set from the standard CLI if you try22:04
elmikoneat!22:05
elmiko\o/22:05
tmckaynot what was originally intended, but it's logically consistent.22:06
elmikocool22:07
tmckayelmiko, and if you mess it up, you can still wipe out a def template set from sahara-templates and recreate it22:07
elmikogood to know22:07
tmckayI need to add some doc stuff about this ... best practice, etc22:08
elmiko+122:08
*** jriveram has joined #openstack-sahara22:34
*** rcernin has quit IRC22:53
jriveramHi guys, excuse me I have a question, someone knows about this error?23:07
jriveram2016-01-22 22:58:24.196 384 ERROR sahara.service.trusts [req-fec0ab7d-0543-4cb1-9e51-bbb5b661f796 3c38286c75c04597a17ce1275eee9360 31bf185547854efaa208764243db8348 - - -] [instance: none, cluster: 4432d5c6-96cd-488d-8cab-d744159bb525] Unable to create trust (reason: Expecting to find id or name in user - the server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed23:07
jriveramwhen I execute sahara cluster-create23:07
jriveramthe cluster is apparently created, but in error status, and with that results in logs23:08
elmikohmm23:10
elmikoyea, looks like an issue with the user you are using to make that request23:11
elmikoor, could be something with the way sahara is communicating with keystone23:11
elmikojriveram: let me look at our source for a second, i may be able to help23:12
jriveramelmiko: let me review first the user and the communication to authenticate23:13
elmikojriveram: i can explain what is going on with sahara at that point, but i may not be able to diagnose your issue :/23:14
elmikobasically, sahara will create a "trust" between the currently logged in user and another user for the purpose of controlling cluster resources during creation23:14
elmikothis is in case the user logs out but sahara needs to remove the cluster, maybe because it errored out or something.23:15
jriveramok, I understand23:15
elmikoso, to do that, there are a couple things that need to happen23:15
elmiko1. keystone v3 needs to be used23:15
*** jamielennox is now known as jamielennox|away23:15
elmiko2. the sahara admin user needs the ability to create and delegate trusts23:15
elmikoso, if your keystone install has some sort of ACL on the sahara admin user, that may be preventing the trust from happening23:16
elmikoor if the user you are authenticating as doesn't have permission to give a trust, that could affect this as well23:16
jriveramyes, I am using keystone v323:16
elmikodoes that make sense?23:16
elmikok23:16
jriveramand I need to review the second thing23:16
jriveramelmiko: I understand, it makes sense :)23:17
elmikocool, i'll look a little more. maybe i can find something else23:17
elmikojriveram: what version of sahara are you using?23:17
jriveram0.11.123:17
elmikohmm, i'm not seeing that in our tags. is that what the server reports?23:18
egaffordelmiko: I think that's a client version.23:18
* egafford has been stalking this conversation.23:18
elmikoah, gotcha23:19
egaffordjriveram: I suggest that you also check your keystone logs before going too deep; the block that causes that exception does nothing but call keystone (repeatedly.)23:19
elmikogood idea23:19
jriveramgood egafford :) hehe23:19
elmikogiven the error message from keystone, it is definitely something to do with the user value that is passed to keystone23:20
egaffordIt seems by far the most likely that you're failing on trust creation, though you could be failing on user lookup of either the admin or tenant user.23:20
egaffordelmiko: +123:20
elmikoand the thing is, i've seen that error before. but it usually has to do with a mis-typed name on my part, or an issue with being able to generate the trust23:21
elmikolike, wrong auth endpoint or somesuch23:21
elmikoor keystone not having trusts enabled23:21
elmikowell, not for the user anyway23:21
egaffordelmiko: Looking at the user, actually, it could be a failure to create the trustor client.23:22
egaffords/user/error message/23:22
*** shakamunyi has quit IRC23:22
elmikoright23:22
jriveramok23:23
elmikohmm, could mean that the trustor can't issue trusts?23:23
elmikoi dunno, it really depends what is going on with keystone. checking those logs is spot on23:23
jriveramthanks elmiko: and egafford ... looking keystone logs23:24
egaffordI think this might well be the first point in the flow that the admin user is relevant. jriveram, I'd definitely look at a) keystone logs, and b) double-check your Sahara admin user, password, auth_uri, and identity_uri settings.23:24
elmikonp jriveram, good luck23:24
elmikoegafford: +123:24
elmikoi have a feeling this is when creating the trust for the periodic task23:24
elmikowhich means the trustor is the admin23:25
jriveramok egafford I will follow that way23:25
egaffordelmiko: Yeah, that's definitely what's happening.23:25
egaffords/definitely/almost definitely/.23:25
elmikoif there were an issue with the trustee, the auth calls would have failed much sooner23:25
jriveramthanks elmiko23:25
egaffordelmiko: Just so.23:25
jriveramI will continue with that and I am going to comment you my results23:25
elmikoegafford: the other thing to consider as well, depending on the complexity of the install the sahara admin user may have a restricted set of privileges with the keystone ACL23:26
egaffordelmiko: Yeah, that's totally possible.23:26
egaffordI hear that keystone can, you know, regulate permissions to do tasks.23:26
elmikoi should really investigate that and create some docs, if necessary23:26
elmikohaha23:26
egaffordjriveram: Is this a devstack POC env? A complex production env? Something in between?23:27
jriveramgood, that sounds really useful23:27
jriveramIt is a POC basically23:27
egaffordOk, so it's fairly unlikely that you're running up against complex custom keystone ACLs.23:28
egaffordUnless deep weirdness is going on.23:28
egafford(One can never rule out deep weirdness.)23:28
elmikonever23:28
jriveramhehe23:28
elmikoit does make me think that the service admin user should be double checked for accuracy and permissions though23:29
egaffordelmiko: Yeah, maybe just try to create a context on startup.23:29
egaffordWe are wholly dependent on it to be useful at this point.23:29
elmikotrue23:29
elmikodoing a check on start might help to find config issues much earlier23:30
egaffordMight well be a buncha things like that that we could fail faster on.23:33
*** egafford has quit IRC23:43
*** hdd_ has joined #openstack-sahara23:56
*** hdd has quit IRC23:56

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!