*** witlessb has quit IRC | 00:28 | |
*** SlickNik has left #openstack-sahara | 01:03 | |
*** Poornima has joined #openstack-sahara | 03:11 | |
*** links has joined #openstack-sahara | 03:26 | |
openstackgerrit | javeme proposed openstack/sahara: Move notifications options into oslo_messaging_notifications https://review.openstack.org/270055 | 03:37 |
---|---|---|
*** links has quit IRC | 03:40 | |
*** links has joined #openstack-sahara | 03:48 | |
*** links has quit IRC | 04:04 | |
*** vgridnev has joined #openstack-sahara | 04:08 | |
*** links has joined #openstack-sahara | 04:16 | |
*** agireud has quit IRC | 04:20 | |
*** coolsvap|away has joined #openstack-sahara | 04:21 | |
*** coolsvap|away is now known as coolsvap | 04:22 | |
*** agireud has joined #openstack-sahara | 04:22 | |
*** links has quit IRC | 04:27 | |
*** links has joined #openstack-sahara | 04:27 | |
*** links has quit IRC | 04:50 | |
*** links has joined #openstack-sahara | 04:57 | |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Use internal auth url to communicate with swift https://review.openstack.org/269001 | 04:59 |
*** links has quit IRC | 05:13 | |
*** links has joined #openstack-sahara | 05:21 | |
*** sgotliv has joined #openstack-sahara | 05:23 | |
*** vgridnev has quit IRC | 05:24 | |
*** links has quit IRC | 05:36 | |
*** links has joined #openstack-sahara | 05:37 | |
*** vgridnev has joined #openstack-sahara | 05:47 | |
*** links has quit IRC | 05:59 | |
openstackgerrit | Merged openstack/sahara-image-elements: Updated from global requirements https://review.openstack.org/271133 | 06:00 |
*** links has joined #openstack-sahara | 06:01 | |
*** Poornima has quit IRC | 06:05 | |
*** hdd has quit IRC | 06:11 | |
*** links has quit IRC | 06:22 | |
*** links has joined #openstack-sahara | 06:23 | |
*** coolsvap is now known as coolsvap|away | 06:26 | |
*** Poornima has joined #openstack-sahara | 06:27 | |
*** vgridnev has quit IRC | 06:33 | |
*** nkrinner has joined #openstack-sahara | 06:38 | |
*** links has quit IRC | 06:46 | |
*** links has joined #openstack-sahara | 06:50 | |
*** hdd has joined #openstack-sahara | 06:50 | |
*** vgridnev has joined #openstack-sahara | 06:54 | |
*** links has quit IRC | 07:09 | |
*** links has joined #openstack-sahara | 07:09 | |
openstackgerrit | Merged openstack/sahara-specs: [Spec]Remove-plugin-vanilla-v2.6.0 https://review.openstack.org/259864 | 07:15 |
*** hdd has quit IRC | 07:15 | |
*** esikachev has joined #openstack-sahara | 07:26 | |
*** rcernin has joined #openstack-sahara | 07:31 | |
*** links has quit IRC | 07:31 | |
*** links has joined #openstack-sahara | 07:48 | |
*** links has quit IRC | 07:54 | |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara-specs: Add an option to sahara-image-create to generate bare metal images https://review.openstack.org/269728 | 07:55 |
openstackgerrit | Evgeny Sikachev proposed openstack/sahara: Remove scenario tests and related files https://review.openstack.org/271168 | 07:56 |
*** vgridnev has quit IRC | 08:20 | |
*** links has joined #openstack-sahara | 08:22 | |
*** links has quit IRC | 08:35 | |
*** _degorenko|afk is now known as degorenko | 08:48 | |
openstackgerrit | Merged openstack/sahara-ci-config: Cleanup /tmp/sahara-scenario dir https://review.openstack.org/270897 | 08:51 |
*** witlessb has joined #openstack-sahara | 09:17 | |
*** vgridnev has joined #openstack-sahara | 09:25 | |
openstackgerrit | Evgeny Sikachev proposed openstack/sahara: Remove scenario tests and related files https://review.openstack.org/271168 | 09:26 |
*** Poornima is now known as Poornima|L0 | 10:13 | |
openstackgerrit | Denis Egorenko proposed openstack/sahara-ci-config: Remove pin for pip and tox https://review.openstack.org/271221 | 10:21 |
*** tosky has joined #openstack-sahara | 10:33 | |
*** sgotliv has quit IRC | 10:37 | |
*** Poornima|L0 is now known as Poornima | 10:42 | |
*** vgridnev has quit IRC | 10:44 | |
openstackgerrit | Evgeny Sikachev proposed openstack/sahara-ci-config: Add openstack/sahara-scenario project to zuul https://review.openstack.org/268150 | 10:48 |
*** vgridnev has joined #openstack-sahara | 10:48 | |
openstackgerrit | Denis Egorenko proposed openstack/sahara-ci-config: Rewrite local.sh with openstack client https://review.openstack.org/244044 | 11:03 |
openstackgerrit | Evgeny Sikachev proposed openstack/sahara: Remove scenario tests and related files https://review.openstack.org/271168 | 11:05 |
openstackgerrit | Merged openstack/sahara-ci-config: Remove pin for pip and tox https://review.openstack.org/271221 | 11:46 |
*** openstackgerrit has quit IRC | 11:47 | |
*** openstackgerrit has joined #openstack-sahara | 11:48 | |
*** openstackgerrit has quit IRC | 12:33 | |
*** openstackgerrit has joined #openstack-sahara | 12:33 | |
*** vgridnev has quit IRC | 13:01 | |
*** vgridnev has joined #openstack-sahara | 13:16 | |
*** vgridnev has quit IRC | 13:19 | |
*** vgridnev has joined #openstack-sahara | 13:23 | |
openstackgerrit | Evgeny Sikachev proposed openstack/sahara-ci-config: Add $ZUUL_BRANCH to sahara get_dependency https://review.openstack.org/271294 | 13:46 |
*** nkrinner has quit IRC | 14:01 | |
openstackgerrit | Evgeny Sikachev proposed openstack/sahara-ci-config: Use master of sahara-scenario for stable branches https://review.openstack.org/269679 | 14:16 |
openstackgerrit | Evgeny Sikachev proposed openstack/sahara-ci-config: Use master of sahara-scenario for stable branches https://review.openstack.org/269679 | 14:18 |
openstackgerrit | Evgeny Sikachev proposed openstack/sahara-ci-config: Use master of sahara-scenario for stable branches https://review.openstack.org/269679 | 14:19 |
*** tmckay has joined #openstack-sahara | 14:24 | |
*** Poornima has quit IRC | 14:27 | |
vgridnev | elmiko, I have question about CONCERNING | 14:33 |
vgridnev | this the status that cloudera will give to Sahara | 14:33 |
vgridnev | it's not actual sahara state | 14:33 |
elmiko | vgridnev: ok, yea, i figured these were internal states that we are capturing | 14:35 |
elmiko | i just thought the word sounded a little off | 14:35 |
vgridnev | anyway we can't change that | 14:35 |
elmiko | ah, is that what cloudera reports, "CONCERNING"? | 14:36 |
elmiko | ok, well. thanks for the explanation, it helps | 14:36 |
*** crobertsrh has joined #openstack-sahara | 14:39 | |
openstackgerrit | Trevor McKay proposed openstack/sahara: Where filter is not done correctly on programmatic selection https://review.openstack.org/271332 | 14:44 |
openstackgerrit | Evgeny Sikachev proposed openstack/sahara-ci-config: Add sahara-ci to sahara-scenario https://review.openstack.org/268150 | 14:44 |
openstackgerrit | Evgeny Sikachev proposed openstack/sahara-ci-config: Add sahara-ci to sahara-scenario https://review.openstack.org/268150 | 14:48 |
*** pcaruana has joined #openstack-sahara | 14:49 | |
openstackgerrit | Evgeny Sikachev proposed openstack/sahara-ci-config: Add sahara-ci to sahara-scenario https://review.openstack.org/268150 | 14:51 |
openstackgerrit | Evgeny Sikachev proposed openstack/sahara-ci-config: Add sahara-ci to sahara-scenario https://review.openstack.org/268150 | 14:54 |
elmiko | anyone here ever run into issues running `tox -r -epy34` ? i'm seeing some strange errors about missing jinja2... | 14:55 |
tmckay | I don't think I have a machine with python 3 installed, actually | 14:58 |
tmckay | I probably should | 14:59 |
openstackgerrit | Emilien Macchi proposed openstack/puppet-sahara: drop mock dependency https://review.openstack.org/271353 | 15:00 |
elmiko | i just don't understand what is going on with this... | 15:00 |
* elmiko sighs | 15:01 | |
tmckay | elmiko, did you blow tox away and let it recreate? | 15:01 |
* tmckay probably, I always do that first :) | 15:01 | |
elmiko | yea, tried that. -r will recreate the venv | 15:01 |
elmiko | maybe i should actually delete the directory and try again | 15:01 |
*** egafford has joined #openstack-sahara | 15:13 | |
*** hdd has joined #openstack-sahara | 15:14 | |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara-specs: Cluster verifications spec https://review.openstack.org/270156 | 15:19 |
openstackgerrit | Denis Egorenko proposed openstack/sahara-ci-config: Pass image name var to tox env https://review.openstack.org/271382 | 15:39 |
openstackgerrit | Evgeny Sikachev proposed openstack/sahara-ci-config: Add sahara-ci to sahara-scenario https://review.openstack.org/268150 | 15:40 |
openstackgerrit | Dave Walker proposed openstack/sahara: Bump stable/kilo next version to 2015.1.4 https://review.openstack.org/271398 | 15:43 |
openstackgerrit | Evgeny Sikachev proposed openstack/sahara-ci-config: Add sahara-ci to sahara-scenario https://review.openstack.org/268150 | 15:43 |
openstackgerrit | Merged openstack/sahara-ci-config: Use master of sahara-scenario for stable branches https://review.openstack.org/269679 | 15:47 |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Fix anti-affinity handling in heat engine https://review.openstack.org/271402 | 15:51 |
*** esikachev has quit IRC | 15:52 | |
openstackgerrit | Merged openstack/sahara: Remove scenario tests and related files https://review.openstack.org/271168 | 15:57 |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Fix anti-affinity handling in heat engine https://review.openstack.org/271402 | 15:58 |
*** vgridnev has quit IRC | 16:07 | |
*** rcernin has quit IRC | 16:15 | |
*** hdd has quit IRC | 16:24 | |
*** degorenko is now known as _degorenko|afk | 16:41 | |
*** rcernin has joined #openstack-sahara | 16:54 | |
*** crobertsrh has quit IRC | 16:56 | |
openstackgerrit | Merged openstack/sahara-image-elements: Add a bare metal image generation option to sahara-image-create https://review.openstack.org/269821 | 17:24 |
*** esikachev has joined #openstack-sahara | 17:43 | |
-openstackstatus- NOTICE: Restarting zuul due to a memory leak | 17:51 | |
*** hdd has joined #openstack-sahara | 18:08 | |
*** esikachev has quit IRC | 18:12 | |
*** crobertsrh has joined #openstack-sahara | 18:14 | |
*** tosky has quit IRC | 18:16 | |
*** esikachev has joined #openstack-sahara | 18:52 | |
openstackgerrit | Trevor McKay proposed openstack/sahara: Remove overlap of 'is_default' and 'is_protected' for templates https://review.openstack.org/271484 | 19:05 |
*** rcernin has quit IRC | 19:12 | |
openstackgerrit | Trevor McKay proposed openstack/sahara: Change 'ignore_default' to 'ignore_prot_on_def' https://review.openstack.org/271491 | 19:28 |
openstackgerrit | Chad Roberts proposed openstack/sahara-dashboard: Reorganizing job and cluster guide pages https://review.openstack.org/270478 | 19:32 |
*** witlessb has quit IRC | 19:36 | |
openstackgerrit | Merged openstack/sahara-specs: Add an option to sahara-image-create to generate bare metal images https://review.openstack.org/269728 | 19:46 |
*** witlessb has joined #openstack-sahara | 19:50 | |
openstackgerrit | Trevor McKay proposed openstack/sahara: Add 'is_protected' field to all default templates https://review.openstack.org/271504 | 19:59 |
*** raildo is now known as raildo-afk | 20:02 | |
*** witlessb has quit IRC | 20:03 | |
*** pcaruana has quit IRC | 20:14 | |
*** witlessb has joined #openstack-sahara | 20:18 | |
*** tellesnobrega is now known as tellesnobrega_af | 20:22 | |
*** tellesnobrega_af is now known as tellesnobrega | 20:29 | |
*** egafford has quit IRC | 20:31 | |
openstackgerrit | Trevor McKay proposed openstack/sahara: Add 'is_protected' field to all default templates https://review.openstack.org/271504 | 20:41 |
*** esikachev has quit IRC | 20:42 | |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Fix anti-affinity handling in heat engine https://review.openstack.org/271402 | 21:01 |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Add release notes for sahara master https://review.openstack.org/255214 | 21:09 |
*** crobertsrh has quit IRC | 21:14 | |
*** egafford has joined #openstack-sahara | 21:29 | |
tmckay | egafford, hey | 21:29 |
egafford | tmckay: Hello | 21:29 |
tmckay | egafford, looks like we don't have any "is_protected" handling in Horizon. Does that ring a bell? | 21:31 |
egafford | tmckay: I've been using Horizon increasingly infrequently, but I can check. | 21:31 |
tmckay | mine might be out of date | 21:32 |
openstackgerrit | Michael McCune proposed openstack/sahara: Add release notes for external key manager usage https://review.openstack.org/271529 | 21:32 |
elmiko | tmckay: have you integrate the new sahara-dashboard stuff? | 21:33 |
tmckay | elmiko, no, I as trying to resurrect an old VM. I've got sahara running locally but horizon is old (it's messed up now because I did a pull :) ) | 21:34 |
tmckay | guess I should visit the ui dev pages | 21:34 |
elmiko | yea, or maybe setup a new devstack vm or something | 21:35 |
tmckay | elmiko, I was looking around for UI "is_protected" knobs on templates | 21:35 |
elmiko | all the horizon related code has been moved (back) into the sahara-dashboard repo | 21:35 |
elmiko | yea, i thought we had those put in, but it may only be in the new repo | 21:35 |
tmckay | okay. Well, I can at least grep in there | 21:35 |
tmckay | gotcha | 21:36 |
elmiko | that's probably the next step | 21:36 |
elmiko | hmm, looks like maybe not | 21:36 |
tmckay | elmiko, https://github.com/openstack/sahara-dashboard.git ? | 21:38 |
elmiko | yes | 21:38 |
* tmckay checks blueprints and bugs | 21:38 | |
* tmckay and specs | 21:39 | |
elmiko | i'm not seeing it in the code or the open reviews. i guess it hasn't been done yet | 21:39 |
tmckay | elmiko, yeah, bummer :) | 21:39 |
elmiko | yea, sorry | 21:39 |
tmckay | elmiko, with the def temp change, horizon will tell you that you can't delete it because it's protected now (which is right, as opposed to is a default) | 21:40 |
elmiko | doh! | 21:40 |
tmckay | but there is no happy check box to unprotect and try again, heh | 21:40 |
elmiko | oh man... | 21:40 |
elmiko | #FridayProblems | 21:40 |
tmckay | well, there is always the CLI. I should be able to prove it from there | 21:41 |
tmckay | I have not tried to wrangle horizon for a while | 21:41 |
elmiko | yea, gonna have to relearn a little ;) | 21:41 |
elmiko | although, setting it up through devstack is very easy now | 21:41 |
tmckay | elmiko, ack. I'll have to ping crobertsrh, if we don't have "protected" toggles on the radar for mitaka I think we should | 21:42 |
elmiko | +1 | 21:42 |
tmckay | flags were added in Liberty, I think | 21:42 |
tmckay | elmiko, hmm, liberty spec calls for it ... I'll keep hunting | 21:43 |
elmiko | maybe that one detail slipped under the rug, didn't we get the "is default" checkboxes in place? | 21:46 |
*** pcaruana has joined #openstack-sahara | 21:48 | |
*** rcernin has joined #openstack-sahara | 21:52 | |
tmckay | elmiko, not sure | 21:55 |
tmckay | elmiko, oh snap! I did it from the CLI with JSON on standard in. I turned off protected on a def cluster template and it's def worker, modified some fields, then deleted them both | 22:04 |
tmckay | so, I guess it works | 22:04 |
tmckay | you can now mess up your def template set from the standard CLI if you try | 22:04 |
elmiko | neat! | 22:05 |
elmiko | \o/ | 22:05 |
tmckay | not what was originally intended, but it's logically consistent. | 22:06 |
elmiko | cool | 22:07 |
tmckay | elmiko, and if you mess it up, you can still wipe out a def template set from sahara-templates and recreate it | 22:07 |
elmiko | good to know | 22:07 |
tmckay | I need to add some doc stuff about this ... best practice, etc | 22:08 |
elmiko | +1 | 22:08 |
*** jriveram has joined #openstack-sahara | 22:34 | |
*** rcernin has quit IRC | 22:53 | |
jriveram | Hi guys, excuse me I have a question, someone knows about this error? | 23:07 |
jriveram | 2016-01-22 22:58:24.196 384 ERROR sahara.service.trusts [req-fec0ab7d-0543-4cb1-9e51-bbb5b661f796 3c38286c75c04597a17ce1275eee9360 31bf185547854efaa208764243db8348 - - -] [instance: none, cluster: 4432d5c6-96cd-488d-8cab-d744159bb525] Unable to create trust (reason: Expecting to find id or name in user - the server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed | 23:07 |
jriveram | when I execute sahara cluster-create | 23:07 |
jriveram | the cluster is apparently created, but in error status, and with that results in logs | 23:08 |
elmiko | hmm | 23:10 |
elmiko | yea, looks like an issue with the user you are using to make that request | 23:11 |
elmiko | or, could be something with the way sahara is communicating with keystone | 23:11 |
elmiko | jriveram: let me look at our source for a second, i may be able to help | 23:12 |
jriveram | elmiko: let me review first the user and the communication to authenticate | 23:13 |
elmiko | jriveram: i can explain what is going on with sahara at that point, but i may not be able to diagnose your issue :/ | 23:14 |
elmiko | basically, sahara will create a "trust" between the currently logged in user and another user for the purpose of controlling cluster resources during creation | 23:14 |
elmiko | this is in case the user logs out but sahara needs to remove the cluster, maybe because it errored out or something. | 23:15 |
jriveram | ok, I understand | 23:15 |
elmiko | so, to do that, there are a couple things that need to happen | 23:15 |
elmiko | 1. keystone v3 needs to be used | 23:15 |
*** jamielennox is now known as jamielennox|away | 23:15 | |
elmiko | 2. the sahara admin user needs the ability to create and delegate trusts | 23:15 |
elmiko | so, if your keystone install has some sort of ACL on the sahara admin user, that may be preventing the trust from happening | 23:16 |
elmiko | or if the user you are authenticating as doesn't have permission to give a trust, that could affect this as well | 23:16 |
jriveram | yes, I am using keystone v3 | 23:16 |
elmiko | does that make sense? | 23:16 |
elmiko | k | 23:16 |
jriveram | and I need to review the second thing | 23:16 |
jriveram | elmiko: I understand, it makes sense :) | 23:17 |
elmiko | cool, i'll look a little more. maybe i can find something else | 23:17 |
elmiko | jriveram: what version of sahara are you using? | 23:17 |
jriveram | 0.11.1 | 23:17 |
elmiko | hmm, i'm not seeing that in our tags. is that what the server reports? | 23:18 |
egafford | elmiko: I think that's a client version. | 23:18 |
* egafford has been stalking this conversation. | 23:18 | |
elmiko | ah, gotcha | 23:19 |
egafford | jriveram: I suggest that you also check your keystone logs before going too deep; the block that causes that exception does nothing but call keystone (repeatedly.) | 23:19 |
elmiko | good idea | 23:19 |
jriveram | good egafford :) hehe | 23:19 |
elmiko | given the error message from keystone, it is definitely something to do with the user value that is passed to keystone | 23:20 |
egafford | It seems by far the most likely that you're failing on trust creation, though you could be failing on user lookup of either the admin or tenant user. | 23:20 |
egafford | elmiko: +1 | 23:20 |
elmiko | and the thing is, i've seen that error before. but it usually has to do with a mis-typed name on my part, or an issue with being able to generate the trust | 23:21 |
elmiko | like, wrong auth endpoint or somesuch | 23:21 |
elmiko | or keystone not having trusts enabled | 23:21 |
elmiko | well, not for the user anyway | 23:21 |
egafford | elmiko: Looking at the user, actually, it could be a failure to create the trustor client. | 23:22 |
egafford | s/user/error message/ | 23:22 |
*** shakamunyi has quit IRC | 23:22 | |
elmiko | right | 23:22 |
jriveram | ok | 23:23 |
elmiko | hmm, could mean that the trustor can't issue trusts? | 23:23 |
elmiko | i dunno, it really depends what is going on with keystone. checking those logs is spot on | 23:23 |
jriveram | thanks elmiko: and egafford ... looking keystone logs | 23:24 |
egafford | I think this might well be the first point in the flow that the admin user is relevant. jriveram, I'd definitely look at a) keystone logs, and b) double-check your Sahara admin user, password, auth_uri, and identity_uri settings. | 23:24 |
elmiko | np jriveram, good luck | 23:24 |
elmiko | egafford: +1 | 23:24 |
elmiko | i have a feeling this is when creating the trust for the periodic task | 23:24 |
elmiko | which means the trustor is the admin | 23:25 |
jriveram | ok egafford I will follow that way | 23:25 |
egafford | elmiko: Yeah, that's definitely what's happening. | 23:25 |
egafford | s/definitely/almost definitely/. | 23:25 |
elmiko | if there were an issue with the trustee, the auth calls would have failed much sooner | 23:25 |
jriveram | thanks elmiko | 23:25 |
egafford | elmiko: Just so. | 23:25 |
jriveram | I will continue with that and I am going to comment you my results | 23:25 |
elmiko | egafford: the other thing to consider as well, depending on the complexity of the install the sahara admin user may have a restricted set of privileges with the keystone ACL | 23:26 |
egafford | elmiko: Yeah, that's totally possible. | 23:26 |
egafford | I hear that keystone can, you know, regulate permissions to do tasks. | 23:26 |
elmiko | i should really investigate that and create some docs, if necessary | 23:26 |
elmiko | haha | 23:26 |
egafford | jriveram: Is this a devstack POC env? A complex production env? Something in between? | 23:27 |
jriveram | good, that sounds really useful | 23:27 |
jriveram | It is a POC basically | 23:27 |
egafford | Ok, so it's fairly unlikely that you're running up against complex custom keystone ACLs. | 23:28 |
egafford | Unless deep weirdness is going on. | 23:28 |
egafford | (One can never rule out deep weirdness.) | 23:28 |
elmiko | never | 23:28 |
jriveram | hehe | 23:28 |
elmiko | it does make me think that the service admin user should be double checked for accuracy and permissions though | 23:29 |
egafford | elmiko: Yeah, maybe just try to create a context on startup. | 23:29 |
egafford | We are wholly dependent on it to be useful at this point. | 23:29 |
elmiko | true | 23:29 |
elmiko | doing a check on start might help to find config issues much earlier | 23:30 |
egafford | Might well be a buncha things like that that we could fail faster on. | 23:33 |
*** egafford has quit IRC | 23:43 | |
*** hdd_ has joined #openstack-sahara | 23:56 | |
*** hdd has quit IRC | 23:56 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!