*** dstanek has joined #openstack-keystone | 00:14 | |
*** openstackgerrit has joined #openstack-keystone | 00:30 | |
*** RockKuo has quit IRC | 00:42 | |
*** marcoemorais has quit IRC | 01:21 | |
*** zhiyan_ is now known as zhiyan | 01:32 | |
*** mberlin1 has joined #openstack-keystone | 01:57 | |
*** dims_ has quit IRC | 01:57 | |
*** dims_ has joined #openstack-keystone | 01:58 | |
*** mberlin has quit IRC | 01:58 | |
ayoung | jamielennox, I made one of those mistakes you make when you play as admin: I de-allocated the keytab for HTTP on the IPA server | 02:04 |
---|---|---|
ayoung | having a hard time figuring out how to get it set up correctly again | 02:04 |
jamielennox | ayoung: heh - i'm certainly not the one to ask | 02:05 |
ayoung | jamielennox, I know...just figured you'd enjoy the irony | 02:05 |
*** Chicago has joined #openstack-keystone | 02:05 | |
jamielennox | so does it work with both running in httpd? | 02:05 |
ayoung | jamielennox, this is the IPA server | 02:06 |
ayoung | Oh yeah I got that working | 02:06 |
ayoung | I ned to create a WSGI group for each | 02:06 |
jamielennox | what we were talking about yesterday | 02:06 |
ayoung | so two for horizon and 3 for keystone. main, admin and krb | 02:07 |
jamielennox | cool | 02:07 |
ayoung | I was trying to provision a Kerberos keytab for the horizon server, accidentally re-request a keytab for the IPA server | 02:07 |
ayoung | and now I have two broken keytabs | 02:07 |
ayoung | I went back to the IPA server and ran: | 02:07 |
ayoung | ipa-getkeytab -s $HOSTNAME -p HTTP/ipa.cloudlab.freeipa.org -k /tmp/ipa.keytab | 02:08 |
ayoung | then mv /tmp/ipa.keytab /etc/http/conf which is where it seems to go, chowned it...but some permission problem | 02:08 |
ayoung | did a restorecon just for luck | 02:08 |
ayoung | hell, I'll restart apache just for grins | 02:10 |
jamielennox | ayoung: filed cross-project summit session: http://summit.openstack.org/cfp/details/205 | 02:11 |
jamielennox | not particularly happy with the wording but at least it's there | 02:12 |
ayoung | jamielennox, looks good. You can continue to wordsmith | 02:12 |
*** stevemar has joined #openstack-keystone | 02:16 | |
*** stevemar has quit IRC | 02:16 | |
*** stevemar has joined #openstack-keystone | 02:17 | |
*** amcrn has quit IRC | 02:21 | |
jamielennox | ayoung: want to do some simple +a's for me ? | 02:22 |
ayoung | No I want to unf(*&^ my server | 02:22 |
jamielennox | lol | 02:23 |
jamielennox | np | 02:23 |
ayoung | jamielennox, in a minute | 02:24 |
jamielennox | ayoung: it's fine, just messing with some stuff that they are useful for | 02:24 |
ayoung | post the links here and I'll get to them shortly | 02:25 |
nkinder | ayoung: I added you to an OSSN review for a bug you are familiar with - https://review.openstack.org/#/c/84601/ | 02:27 |
*** stevemar has quit IRC | 02:27 | |
nkinder | ayoung: take note that OSSNs are now being reviewed in gerrit! | 02:27 |
ayoung | nkinder, you know anything about Kerberos and HTTPD? | 02:27 |
ayoung | nkinder, yeah I saw that | 02:27 |
ayoung | nkinder, I messed up the ipa.keytab file for my ipa server | 02:27 |
nkinder | ayoung: I might... Depends... | 02:27 |
nkinder | define messed up | 02:28 |
ayoung | I have a new keytab, and I checked that I can use it to kinit like this | 02:28 |
nkinder | kinit -kt ... | 02:28 |
nkinder | so that works? | 02:28 |
ayoung | kinit -V -k -t /tmp/ipa.keytab HTTP/ipa.cloudlab.freeipa.org@IPA.CLOUDLAB.FREEIPA.ORG | 02:28 |
ayoung | so i did | 02:28 |
ayoung | sudo mv /tmp/ipa.keytab /etc/httpd/conf/ipa.keytab | 02:28 |
ayoung | sudo chown apache:apache /etc/httpd/conf/ipa.keytab | 02:29 |
nkinder | ah! | 02:29 |
ayoung | but if I try to do any Kerberos operations against the server I get | 02:29 |
nkinder | ls -lZ /etc/httpd/conf/ipa.keytab | 02:29 |
nkinder | what's the selinux context? | 02:29 |
nkinder | mv is evil | 02:29 |
ayoung | OK, just did a restorecon | 02:29 |
ayoung | nope | 02:29 |
ayoung | [Wed Apr 02 02:29:41.560955 2014] [auth_kerb:error] [pid 15593] [client 10.10.61.119:45309] gss_accept_sec_context() failed: Unspecified GSS failure. Minor code may provide more information (, Wrong principal in request), referer: https://ipa.cloudlab.freeipa.org/ipa/ui/index.html | 02:30 |
ayoung | neew ERROR! | 02:30 |
nkinder | ok, so the old error was something else? | 02:31 |
ayoung | nkinder, yeah, could not get auth for ... | 02:31 |
nkinder | ayoung: ok, one step forward then | 02:31 |
nkinder | ayoung: did you muck with the hostname for this system? | 02:31 |
*** RockKuo has joined #openstack-keystone | 02:32 | |
ayoung | nope | 02:32 |
ayoung | I just looked in the kdc log | 02:32 |
nkinder | ayoung: you restarted httpd after fixing the selinux context? | 02:32 |
ayoung | http://fpaste.org/90814/39640594/ was triggered by my last apache request | 02:32 |
ayoung | yes | 02:32 |
nkinder | heh, kdc log was my next question | 02:32 |
ayoung | before I was geting this, no longer : [Wed Apr 02 02:12:50.525805 2014] [auth_kerb:error] [pid 14523] [client 10.10.61.119:45138] Failed to obtain credentials for principal HTTP/ipa.cloudlab.freeipa.org: Generic preauthentication failure (-1765328174), referer: https://ipa.cloudlab.freeipa.org/ipa/ui/index.html | 02:33 |
nkinder | ayoung: ok, kdc is fine from it's point of view | 02:33 |
ayoung | let me kdestroy on the web browerser machine | 02:34 |
nkinder | it's issuing a ticket, but it's up to the client to decrypt it at that point. | 02:34 |
ayoung | nkinder, I think it was a bad service ticket | 02:35 |
ayoung | kdestroy/kinit seemed to fix things | 02:35 |
ayoung | whew | 02:35 |
nkinder | ayoung: it's happy now? | 02:35 |
ayoung | that was nasty | 02:35 |
ayoung | yep | 02:35 |
nkinder | cool. Stop using mv | 02:35 |
nkinder | :) | 02:35 |
ayoung | nkinder, heh, I did a restorecon on an earlier attempt, but I think I had the principal wrong | 02:36 |
ayoung | I was operating as the "fedora" user, not as root, so I didn't want to allocate in place: didn't have perms in /etc/httpd/conf | 02:36 |
ayoung | OK..last thing...let me try this on the horizon boxz | 02:36 |
nkinder | ayoung: I filed a bug on that 500 error when no headers were present for a v2 token request. | 02:36 |
nkinder | ayoung: ...then I tried to reproduce it on Havana, and it works fine. | 02:37 |
ayoung | HA! | 02:37 |
nkinder | ayoung: looks like we fixed it since Essex | 02:37 |
ayoung | Nice. | 02:37 |
nkinder | ayoung: yeah, the bugs that resolve themselves are great | 02:37 |
ayoung | things that go away by themselves come back by themselves, I've found | 02:38 |
*** gyee has quit IRC | 02:39 | |
ayoung | nkinder, OK, same general problem on Horizon....no SELinux (Permisive) getting a Permission denied. I just did the kini from the CLI and its ok...keystab here is owned by fedora:wheel | 02:40 |
ayoung | let me make sure I have the filename right | 02:40 |
nkinder | ayoung: this is the keytab for httpd? | 02:41 |
ayoung | nkinder, yeah...I htink the problem is not the keytab | 02:41 |
nkinder | ayoung: who does httpd run as? | 02:41 |
ayoung | [Wed Apr 02 02:41:43.753084 2014] [auth_kerb:error] [pid 13277] [client 10.10.61.119:49071] Failed to obtain credentials for principal HTTP/ayoungdevstack20.cloudlab.freeipa.org: Generic preauthentication failure (-1765328174) | 02:42 |
ayoung | [Wed Apr 02 02:41:43.768572 2014] [auth_kerb:error] [pid 13277] [client 10.10.61.119:49071] gss_acquire_cred() failed: Unspecified GSS failure. Minor code may provide more information (, Permission denied) | 02:42 |
ayoung | fedora:wheel under devstack | 02:42 |
ayoung | I lied | 02:42 |
ayoung | that is the wsgi app... | 02:42 |
ayoung | OK | 02:42 |
nkinder | should be owned by apache | 02:42 |
ayoung | yep...no diff though | 02:43 |
ayoung | heh pebcak | 02:43 |
ayoung | Yeah, helps the chown the right file | 02:44 |
ayoung | I'm good. | 02:44 |
*** lbragstad has joined #openstack-keystone | 02:45 | |
ayoung | jamielennox, you were first in the queue | 02:45 |
nkinder | ayoung: so horizon is working now? | 02:45 |
ayoung | nkinder, you need to put some sort of check on the Gerrit. You are going to get a slew of "whitespace" reviews. If there is red on a review, its like the reveiwers can't see anything else | 02:46 |
ayoung | https://review.openstack.org/#/c/84601/1/notes/OSSN-0009 | 02:46 |
ayoung | nkinder, yeah, horizon is kerberosed...still using the user-id password, too. But baby steps | 02:46 |
ayoung | I'll start the real work now... | 02:46 |
nkinder | ayoung: yeah, checks are needed.... | 02:47 |
nkinder | ayoung: new patch coming... | 02:47 |
ayoung | nkinder, its OK, I've already +1ed and noted the whitespace. | 02:48 |
ayoung | treat my +1 as sticky, or I can hit it again if you need | 02:48 |
ayoung | jamielennox, what did you need +As on? | 02:51 |
jamielennox | ayoung: um | 02:53 |
jamielennox | https://review.openstack.org/#/c/82412/ | 02:54 |
jamielennox | https://review.openstack.org/#/c/78127/ | 02:54 |
jamielennox | https://review.openstack.org/#/c/77492/ | 02:55 |
jamielennox | they are all really easy | 02:55 |
jamielennox | and all have a +2 on them | 02:55 |
jamielennox | and the last one lets me close off a blueprint | 02:55 |
*** david-lyle has joined #openstack-keystone | 02:56 | |
ayoung | jamielennox, done | 02:57 |
jamielennox | that was fast | 02:57 |
ayoung | jamielennox, I'd looked at most of them at some point | 02:57 |
jamielennox | yea - and the hard parts had all been done for them | 02:58 |
ayoung | ++ | 02:58 |
jamielennox | cool - and you got the keystone one i missed as well | 02:58 |
ayoung | nkinder, BTW, I ended up publishing the PKI blog post | 03:00 |
ayoung | http://adam.younglogic.com/2014/04/pki-for-oslo-messaging/ jamielennox you might be interested as well | 03:01 |
nkinder | ayoung: cool. I'm working on a post for "ssl everywhere" stuff | 03:01 |
ayoung | nice | 03:01 |
ayoung | we really need certmonger to play well with that | 03:01 |
ayoung | and that means educating other CA's how to register and fetch | 03:02 |
jamielennox | ayoung: finishing listening in on a meeting, but i'll have a look soon | 03:03 |
jamielennox | i am definetly interested - i don't think there is such a problem with signing | 03:03 |
jamielennox | it's just a question of key distribution and group membership | 03:04 |
ayoung | we can discuss...I'm fading | 03:04 |
*** david-lyle has quit IRC | 03:14 | |
*** dims_ has quit IRC | 03:15 | |
*** dims_ has joined #openstack-keystone | 03:18 | |
*** vilobhmm has joined #openstack-keystone | 03:18 | |
*** harlowja is now known as harlowja_away | 03:24 | |
jamielennox | ayoung: is the point to start trying to tie it to LDAP? | 03:30 |
jamielennox | i've always had LDAP as a possible backend for KDS - though i'm not sure that works for symmetric keyst | 03:30 |
*** morganfainberg is now known as morganfainberg_Z | 03:34 | |
*** marcoemorais has joined #openstack-keystone | 04:01 | |
*** marcoemorais has quit IRC | 04:03 | |
openstackgerrit | A change was merged to openstack/python-keystoneclient: Sync config fixture object from oslo.incubator https://review.openstack.org/82412 | 04:06 |
*** marcoemorais has joined #openstack-keystone | 04:40 | |
openstackgerrit | A change was merged to openstack/keystone: Make service catalog include service name https://review.openstack.org/78127 | 04:55 |
*** jamielennox is now known as jamielennox|away | 05:55 | |
openstackgerrit | Jenkins proposed a change to openstack/keystone: Imported Translations from Transifex https://review.openstack.org/83955 | 06:01 |
*** vilobhmm has quit IRC | 06:06 | |
*** henrynash has joined #openstack-keystone | 06:06 | |
*** jamielennox|away is now known as jamielennox | 06:11 | |
*** jaosorior has joined #openstack-keystone | 06:21 | |
*** lbragstad has quit IRC | 06:28 | |
*** saju_m has joined #openstack-keystone | 06:39 | |
*** lbragstad has joined #openstack-keystone | 06:39 | |
*** flaper87|afk is now known as flaper87 | 07:14 | |
*** marekd|away is now known as marekd | 07:24 | |
*** jroovers has joined #openstack-keystone | 07:26 | |
*** marcoemorais has quit IRC | 07:27 | |
*** zhiyan is now known as zhiyan_ | 07:35 | |
*** saju_m has quit IRC | 07:42 | |
*** florentflament has joined #openstack-keystone | 07:43 | |
*** jroovers|afk has joined #openstack-keystone | 07:46 | |
*** jroovers has quit IRC | 07:49 | |
*** jroovers|afk has quit IRC | 07:50 | |
*** jroovers has joined #openstack-keystone | 07:51 | |
*** saju_m has joined #openstack-keystone | 07:52 | |
*** zoresvit has quit IRC | 07:56 | |
*** zoresvit has joined #openstack-keystone | 07:59 | |
*** leseb has joined #openstack-keystone | 08:09 | |
openstackgerrit | Jose Castro Leon proposed a change to openstack/keystone: Initial kerberos plugin implementation. https://review.openstack.org/74317 | 08:10 |
openstackgerrit | Marek Denis proposed a change to openstack/python-keystoneclient: Add CRUD operations for Identity Providers. https://review.openstack.org/83337 | 08:14 |
openstackgerrit | Marek Denis proposed a change to openstack/python-keystoneclient: Add CRUD operations for Fedration Mapping Rules. https://review.openstack.org/83742 | 08:27 |
openstackgerrit | Marek Denis proposed a change to openstack/python-keystoneclient: Add CRUD operations for Identity Providers. https://review.openstack.org/83337 | 08:28 |
openstackgerrit | Marek Denis proposed a change to openstack/python-keystoneclient: Add CRUD operations for Federated Protocols. https://review.openstack.org/83829 | 08:30 |
*** saju_m has quit IRC | 08:48 | |
*** saju_m has joined #openstack-keystone | 08:49 | |
*** roeyc has joined #openstack-keystone | 08:50 | |
openstackgerrit | A change was merged to openstack/python-keystoneclient: Tests should use identity_uri by default https://review.openstack.org/77492 | 08:56 |
*** chandankumar_ has joined #openstack-keystone | 08:59 | |
*** leseb has quit IRC | 09:01 | |
*** leseb has joined #openstack-keystone | 09:02 | |
*** leseb_ has joined #openstack-keystone | 09:04 | |
*** leseb has quit IRC | 09:07 | |
openstackgerrit | Jose Castro Leon proposed a change to openstack/python-keystoneclient: Initial kerberos plugin implementation. https://review.openstack.org/74974 | 09:17 |
*** saju_m has quit IRC | 09:24 | |
*** saju_m has joined #openstack-keystone | 09:26 | |
*** saju_m has quit IRC | 09:31 | |
*** saju_m has joined #openstack-keystone | 09:42 | |
*** henrynash has quit IRC | 09:45 | |
*** jaosorior has quit IRC | 09:50 | |
*** leseb_ has quit IRC | 10:03 | |
*** leseb has joined #openstack-keystone | 10:04 | |
*** jroovers has quit IRC | 10:04 | |
*** jroovers|afk has joined #openstack-keystone | 10:04 | |
*** leseb has quit IRC | 10:08 | |
*** chandankumar_ has quit IRC | 10:11 | |
*** leseb has joined #openstack-keystone | 10:18 | |
*** jroovers has joined #openstack-keystone | 10:18 | |
*** jroovers|afk has quit IRC | 10:22 | |
*** leseb has quit IRC | 10:22 | |
*** RockKuo_iPad has joined #openstack-keystone | 10:29 | |
*** RockKuo_iPad has quit IRC | 10:30 | |
*** RockKuo_iPad has joined #openstack-keystone | 10:30 | |
*** RockKuo_iPad has quit IRC | 10:32 | |
*** RockKuo_iPad has joined #openstack-keystone | 10:33 | |
*** leseb has joined #openstack-keystone | 10:34 | |
*** leseb_ has joined #openstack-keystone | 10:36 | |
*** leseb has quit IRC | 10:38 | |
*** leseb_ has quit IRC | 10:41 | |
*** kun_huang has joined #openstack-keystone | 10:41 | |
*** RockKuo_iPad has quit IRC | 10:42 | |
*** roeyc has left #openstack-keystone | 10:42 | |
*** RockKuo has quit IRC | 10:47 | |
*** zoresvit has quit IRC | 11:07 | |
*** openstackgerrit has quit IRC | 11:08 | |
*** openstackgerrit has joined #openstack-keystone | 11:08 | |
*** leseb has joined #openstack-keystone | 11:11 | |
*** leseb has quit IRC | 11:15 | |
*** flaper87 has left #openstack-keystone | 11:19 | |
*** kun_huang has quit IRC | 11:44 | |
*** leseb has joined #openstack-keystone | 11:44 | |
*** topol has joined #openstack-keystone | 11:59 | |
*** henrynash has joined #openstack-keystone | 12:03 | |
openstackgerrit | Marek Denis proposed a change to openstack/python-keystoneclient: Add CRUD operations for Fedration Mapping Rules. https://review.openstack.org/83742 | 12:03 |
*** dims_ has quit IRC | 12:13 | |
*** bknudson has quit IRC | 12:13 | |
*** saju_m has quit IRC | 12:17 | |
*** kun_huang has joined #openstack-keystone | 12:26 | |
*** dims_ has joined #openstack-keystone | 12:27 | |
*** bknudson has joined #openstack-keystone | 12:33 | |
openstackgerrit | Jose Castro Leon proposed a change to openstack/python-keystoneclient: Initial kerberos plugin implementation. https://review.openstack.org/74974 | 12:37 |
*** chandankumar_ has joined #openstack-keystone | 12:39 | |
*** saju_m has joined #openstack-keystone | 12:48 | |
*** kun_huang has quit IRC | 12:50 | |
*** chandankumar_ has quit IRC | 12:51 | |
*** kun_huang has joined #openstack-keystone | 12:54 | |
*** chandan_kumar has quit IRC | 12:55 | |
*** henrynash has quit IRC | 12:59 | |
*** henrynash has joined #openstack-keystone | 13:09 | |
*** henrynash has quit IRC | 13:15 | |
*** leseb has quit IRC | 13:17 | |
*** leseb has joined #openstack-keystone | 13:17 | |
*** leseb has quit IRC | 13:22 | |
*** stevemar has joined #openstack-keystone | 13:24 | |
*** leseb has joined #openstack-keystone | 13:25 | |
*** joesavak has joined #openstack-keystone | 13:27 | |
*** RockKuo has joined #openstack-keystone | 13:32 | |
dolphm | i'd like to backport this to milestone-proposed if anyone can review the master patch :) https://review.openstack.org/#/c/84425/ | 13:35 |
*** saju_m has quit IRC | 13:36 | |
*** dstanek has quit IRC | 13:40 | |
openstackgerrit | ayoung proposed a change to openstack/python-keystoneclient: Example Initialization scripts https://review.openstack.org/82687 | 13:46 |
*** chandan_kumar has joined #openstack-keystone | 13:49 | |
ayoung | dolphm, looks like a bug | 13:52 |
ayoung | dropped or [] | 13:52 |
ayoung | it could be | 13:53 |
ayoung | self.auth['identity'].get('methods,[]) | 13:53 |
dolphm | ayoung: i noticed that as well - i didn't comment on it because i couldn't think of a scenario where methods would be expected to be anything else | 13:53 |
ayoung | I would like to keep the "methods" collection optional for the external case. | 13:54 |
dolphm | ayoung: 'methods': '' or 'methods': null or 'methods': 0 would all behave differently with .get('methods', []) vs ['methods'] or [] | 13:54 |
ayoung | ah, true | 13:55 |
dolphm | ayoung: what is methods in the external case, if not 'methods': ['external'] ? | 13:55 |
ayoung | dolphm, I don't think that is currently required | 13:55 |
ayoung | dolphm, link in a sec | 13:56 |
ayoung | http://git.openstack.org/cgit/openstack/keystone/tree/keystone/auth/controllers.py#n405 | 13:56 |
ayoung | dolphm, external does not look at the body of the request except I think to get the project | 13:57 |
ayoung | http://git.openstack.org/cgit/openstack/keystone/tree/keystone/auth/plugins/external.py#n44 | 13:57 |
ayoung | dolphm, I'm actually just testing out Jose's Kerberos patch. I don;t think he adds 'external' in there | 14:01 |
bknudson | methods wasn't optional | 14:02 |
bknudson | you'd get a KeyError if methods wasn't in auth['identity'] | 14:02 |
bknudson | I guess it would turn an empty string into a list | 14:03 |
bknudson | dolphm: I had a couple of comments on https://review.openstack.org/#/c/84425/, but I think it's good as is. | 14:05 |
*** dstanek has joined #openstack-keystone | 14:06 | |
*** richm has joined #openstack-keystone | 14:14 | |
dolphm | bknudson: replied to both your comments | 14:17 |
dolphm | bknudson: in short, order matters from a spec perspective, but we're not taking advantage of that today (AFAIK?) | 14:17 |
bknudson | dolphm: maybe calls with duplicated methods should be rejected? | 14:18 |
bknudson | as in a 403 Forbidden | 14:18 |
bknudson | because I don't think we know what they meant... if the order matters | 14:19 |
dolphm | bknudson: i was just about to say it could be a 400 | 14:19 |
bknudson | I'm also fine with this as is... so I'll +a | 14:20 |
bknudson | unless someone else is looking at it? | 14:20 |
ayoung | dolphm, UGh. So, in reviewing Jose's compiler patch, I see a python33 failure that is probably not something we can work around. ImportError: No module named 'compiler' in the request-kerberos module. I'm guessing requests-kerberos is not Py33 | 14:30 |
ayoung | https://github.com/requests/requests-kerberos yep "Actually, we don't support 3.3." | 14:31 |
dolphm | ayoung: what's compiler? | 14:31 |
dolphm | ayoung: https://github.com/requests/requests-kerberos/issues/30 | 14:32 |
dolphm | ayoung: fixed since hte last release? | 14:32 |
*** chandankumar_ has joined #openstack-keystone | 14:40 | |
*** david-lyle has joined #openstack-keystone | 14:43 | |
ayoung | dolphm, cool. I'll submit the change to add requests-kerberos to global requirements, too | 14:45 |
ayoung | dolphm, although...I guess I should do >= next release? | 14:46 |
ayoung | current looks like 0.4, so would it make sense to d | 14:47 |
ayoung | o | 14:47 |
ayoung | requests-kerberos>=0.5 | 14:47 |
*** thedodd has joined #openstack-keystone | 14:50 | |
dolphm | ayoung: not sure that would pass gating for openstack/requirements as it couldn't be mirrored | 14:54 |
*** doddstack has joined #openstack-keystone | 14:54 | |
ayoung | dolphm, I'll hold off on it until the upstream is released | 14:54 |
dolphm | ayoung: maybe propose and leave as WIP if you want to wait until 0.5 is released | 14:54 |
ayoung | ++ | 14:54 |
stevemar | ayoung, let jose know in the form of a comment :O | 14:54 |
ayoung | https://review.openstack.org/#/c/84740/ stevemar I did. But I can't seem to add him to this review | 14:56 |
*** thedodd has quit IRC | 14:57 | |
stevemar | ayoung, i just didit for ya | 14:58 |
*** d0ugal has joined #openstack-keystone | 15:03 | |
*** _TheDodd_ has joined #openstack-keystone | 15:05 | |
*** david_lyle_ has joined #openstack-keystone | 15:07 | |
*** doddstack has quit IRC | 15:07 | |
*** dklyle has joined #openstack-keystone | 15:08 | |
*** dklyle has quit IRC | 15:10 | |
*** dklyle has joined #openstack-keystone | 15:10 | |
*** david-lyle has quit IRC | 15:10 | |
*** dklyle is now known as david-lyle | 15:11 | |
*** david_lyle_ has quit IRC | 15:11 | |
*** dstanek has quit IRC | 15:20 | |
*** openstackgerrit has quit IRC | 15:21 | |
*** openstackgerrit has joined #openstack-keystone | 15:21 | |
*** leseb has quit IRC | 15:28 | |
*** leseb has joined #openstack-keystone | 15:28 | |
*** gokrokve has joined #openstack-keystone | 15:30 | |
*** jsavak has joined #openstack-keystone | 15:32 | |
*** leseb has quit IRC | 15:33 | |
*** joesavak has quit IRC | 15:35 | |
*** ilives has joined #openstack-keystone | 15:36 | |
*** joesavak has joined #openstack-keystone | 15:36 | |
*** jsavak has quit IRC | 15:39 | |
*** leseb has joined #openstack-keystone | 15:40 | |
*** Vic has joined #openstack-keystone | 15:51 | |
*** topol has quit IRC | 15:54 | |
*** marekd is now known as marekd|away | 15:56 | |
*** zhiyan_ is now known as zhiyan | 15:59 | |
*** jsavak has joined #openstack-keystone | 16:01 | |
*** joesavak has quit IRC | 16:05 | |
openstackgerrit | Ilya Pekelny proposed a change to openstack/keystone: Sync test_migrations https://review.openstack.org/80618 | 16:14 |
openstackgerrit | Ilya Pekelny proposed a change to openstack/keystone: Redundant unique constraint https://review.openstack.org/84447 | 16:14 |
openstackgerrit | Ilya Pekelny proposed a change to openstack/keystone: Corresponding `nullable` value. https://review.openstack.org/84446 | 16:14 |
openstackgerrit | Ilya Pekelny proposed a change to openstack/keystone: Compatible server default value in the models. https://review.openstack.org/84445 | 16:14 |
openstackgerrit | Ilya Pekelny proposed a change to openstack/keystone: Explicit foreign key indexes. https://review.openstack.org/84444 | 16:14 |
openstackgerrit | Ilya Pekelny proposed a change to openstack/keystone: Make it possible to use multiprocess file locks https://review.openstack.org/84448 | 16:14 |
openstackgerrit | Ilya Pekelny proposed a change to openstack/keystone: Comparision of database models and migrations. https://review.openstack.org/80630 | 16:14 |
*** chandankumar_ has quit IRC | 16:20 | |
openstackgerrit | A change was merged to openstack/keystone: Sanitizes authentication methods received in requests. https://review.openstack.org/84425 | 16:29 |
*** mberlin has joined #openstack-keystone | 16:30 | |
*** d0ugal has quit IRC | 16:30 | |
*** leseb has quit IRC | 16:30 | |
*** leseb has joined #openstack-keystone | 16:31 | |
*** mberlin1 has quit IRC | 16:31 | |
*** d0ugal has joined #openstack-keystone | 16:32 | |
*** d0ugal has quit IRC | 16:33 | |
bknudson | I forgot about trusts when we were talking about V3 features that other projects could use | 16:35 |
bknudson | I think heat is using them already | 16:35 |
*** leseb has quit IRC | 16:35 | |
bknudson | and nova probably should be... nova has an issue where if it takes a long time to boot an image and using neutron it will fail. | 16:35 |
bknudson | due to their token expiring | 16:36 |
*** marcoemorais has joined #openstack-keystone | 16:36 | |
*** Vic has quit IRC | 16:41 | |
*** ilives has quit IRC | 16:42 | |
*** bknudson has quit IRC | 16:47 | |
*** zhiyan is now known as zhiyan_ | 16:51 | |
*** gokrokve has quit IRC | 16:52 | |
*** jroovers has quit IRC | 16:56 | |
*** leseb has joined #openstack-keystone | 17:02 | |
*** gokrokve has joined #openstack-keystone | 17:06 | |
*** afaranha has left #openstack-keystone | 17:15 | |
*** morganfainberg_Z is now known as morganfainberg | 17:23 | |
*** huats_ has quit IRC | 17:26 | |
*** huats has joined #openstack-keystone | 17:27 | |
*** harlowja_away is now known as harlowja | 17:35 | |
*** gokrokve_ has joined #openstack-keystone | 17:37 | |
*** gokrokve has quit IRC | 17:38 | |
*** jroovers has joined #openstack-keystone | 17:48 | |
*** jroovers|afk has joined #openstack-keystone | 17:50 | |
*** topol has joined #openstack-keystone | 17:52 | |
*** jroovers has quit IRC | 17:53 | |
*** _TheDodd_ has quit IRC | 17:55 | |
*** leseb has quit IRC | 17:55 | |
*** afaranha has joined #openstack-keystone | 17:56 | |
*** bknudson has joined #openstack-keystone | 18:02 | |
*** kun_huang has quit IRC | 18:02 | |
*** patelna has joined #openstack-keystone | 18:05 | |
*** vilobhmm_ has joined #openstack-keystone | 18:07 | |
*** leseb has joined #openstack-keystone | 18:07 | |
*** dstanek has joined #openstack-keystone | 18:08 | |
*** vilobhmm___ has joined #openstack-keystone | 18:11 | |
*** vilobhmm_ has quit IRC | 18:12 | |
*** vilobhmm___ has quit IRC | 18:17 | |
*** chandankumar_ has joined #openstack-keystone | 18:41 | |
*** chandankumar_ has quit IRC | 18:55 | |
*** _TheDodd_ has joined #openstack-keystone | 18:56 | |
*** gokrokve_ has quit IRC | 18:56 | |
*** rwsu has quit IRC | 19:01 | |
*** rwsu has joined #openstack-keystone | 19:07 | |
*** jroovers|afk has quit IRC | 19:10 | |
*** gokrokve has joined #openstack-keystone | 19:12 | |
*** nkinder has quit IRC | 19:19 | |
*** leseb has quit IRC | 19:21 | |
*** leseb has joined #openstack-keystone | 19:22 | |
dstanek | dolphm, stevemar, bknudson: why is everyone being cautious on https://review.openstack.org/#/c/79211/3? | 19:22 |
bknudson | dstanek: I don't know... I guess it's hard to tell always when something isn't used. | 19:25 |
*** gokrokve has quit IRC | 19:25 | |
bknudson | dstanek: I noticed that it wasn't used when there were some changes going in for migrations to use oslo-incubator db | 19:25 |
*** leseb has quit IRC | 19:26 | |
bknudson | because it was clearly broken beforehand and the changes were leaving it broken | 19:26 |
dstanek | bknudson: was that ever used? | 19:26 |
bknudson | dstanek: never used as far as I can tell | 19:26 |
stevemar | dstanek, yeah, echoing bknudson, just wary is all, but i guess it can go | 19:27 |
*** gokrokve has joined #openstack-keystone | 19:27 | |
*** gokrokve has quit IRC | 19:29 | |
*** nkinder has joined #openstack-keystone | 19:33 | |
*** leseb has joined #openstack-keystone | 19:37 | |
dstanek | i'm not very familiar with how our database sync and plugins work together - it i add a plugin to the pipeline will it's models by synced to the database by keystone-manager? | 19:39 |
bknudson | dstanek: you have to keystone-manage db_sync --extension <whatever> | 19:42 |
bknudson | dstanek: http://git.openstack.org/cgit/openstack/keystone/tree/keystone/contrib/example/configuration.rst#n31 | 19:43 |
bknudson | dstanek: that goes -- http://git.openstack.org/cgit/openstack/keystone/tree/keystone/cli.py#n64 | 19:43 |
dstanek | bknudson: ah, that's right - i remember now - thanks! | 19:43 |
bknudson | dstanek: which goes here -- http://git.openstack.org/cgit/openstack/keystone/tree/keystone/common/sql/migration_helpers.py#n117 | 19:44 |
bknudson | and that loads the sql package in the extension directly; doesn't call the extension's db_sync | 19:44 |
bknudson | dstanek: note that we also have a db_sync in the other backends that isn't used as expected... http://git.openstack.org/cgit/openstack/keystone/tree/keystone/identity/backends/sql.py | 19:46 |
bknudson | since they all wind up doing the same thing... we only have 1 migrations db for identity, assignment, etc. | 19:46 |
dstanek | what calls the db_sync in the identity manager? | 19:47 |
bknudson | well, it used to be keystone-manage db_sync ... I'm not sure if that's the case anymore. | 19:47 |
bknudson | I wonder when that changed... was it with the oslo-incubator db change... | 19:48 |
bknudson | dstanek: here it is in grizzly: http://git.openstack.org/cgit/openstack/keystone/tree/keystone/cli.py?h=stable/havana&id=grizzly-eol#n44 | 19:50 |
bknudson | I think it was the change to provide migrations for extensions | 19:50 |
*** leseb has quit IRC | 19:51 | |
bknudson | dstanek: yep, that was it -- https://github.com/openstack/keystone/commit/10ef682f46e34e4e19d467c9b0e45f4f8838a134 | 19:52 |
bknudson | dstanek: should probably get rid of the db_sync's in the other backends, too. | 19:52 |
dolphm | bknudson: i believe ayoung wanted to use that functionality, but never did (and i'm not aware of any plans to) | 19:52 |
dstanek | bknudson: i have them all deleted locally and am running the tests to see what happens :-) | 19:52 |
dolphm | bknudson: isn't there a keystone-manage --extension argument? or did that already get cut | 19:53 |
ayoung | no, that is there, and should stay there, and this is good thing, ja? | 19:53 |
dstanek | dolphm: for db_sync? there is an --extension | 19:53 |
bknudson | dolphm: there is an extension argument... it looks for a sql package in the extension and doesn't call the db_sync | 19:53 |
ayoung | keystone-manage --db_sync --extension | 19:53 |
dolphm | bknudson: dstanek: http://pasteraw.com/lmb0jjugewg1eepr6la7cqr4j7ejcwf | 19:54 |
ayoung | it calls the db_sync for the extension | 19:54 |
dolphm | ayoung: which is unused atm? | 19:54 |
ayoung | dolphm, you need to run it explicitly if you want the revocation events | 19:54 |
*** leseb has joined #openstack-keystone | 19:54 | |
bknudson | the db_sync for the extension isn't called. | 19:54 |
ayoung | I had a question about that, actually, whether the behavior when callewd with no args should be to migrate all extensions | 19:55 |
bknudson | ayoung: it loads the repo path directly -- here's the original change: https://github.com/openstack/keystone/commit/10ef682f46e34e4e19d467c9b0e45f4f8838a134#diff-0e7a49790c0f3bba431b128f9b6138fdR77 | 19:55 |
ayoung | bknudson, did you look at the name on that review? | 19:56 |
ayoung | er, commit | 19:56 |
bknudson | ayoung: yes, but you're saying it calls the extension db_sync which it never did | 19:56 |
ayoung | there have been some changes on top of that...let me read up so I know your issue | 19:56 |
ayoung | yes it does | 19:56 |
bknudson | ayoung: it does migration.db_version_control(version=None, repo_path=repo_path) , not extension.db_sync() | 19:57 |
ayoung | ah..... | 19:57 |
ayoung | I see the difference | 19:57 |
ayoung | bknudson, yes, I think you are right. I misread what you were saying | 19:57 |
ayoung | bknudson, absolutely, that is a vestige that predates me on the project and should go away | 19:57 |
bknudson | ayoung: I like the change... it makes more sense than calling db_sync on all the backends... since they were all the same repo anyways. | 19:58 |
ayoung | bknudson, I just +2ed yours | 19:58 |
dolphm | ayoung: thanks for chiming in :) | 20:00 |
*** gokrokve has joined #openstack-keystone | 20:00 | |
*** baffle has joined #openstack-keystone | 20:01 | |
dolphm | ayoung: bknudson: dstanek: +2/+A | 20:01 |
dstanek | nice | 20:01 |
dstanek | can the rest of the db_sync methods be deleted too? | 20:02 |
bknudson | dstanek: yes, do you have that change? | 20:02 |
ayoung | they are not used. they can all die | 20:02 |
stevemar | all the db_sync methods for all backends? | 20:03 |
dstanek | bknudson: yeah, i can commit and push | 20:04 |
dstanek | test run should be finishing up soon | 20:04 |
bknudson | this should up our coverage % | 20:05 |
dolphm | i didn't really read what this is doing, but based on the commit message, we should steal it https://review.openstack.org/#/c/84241/ | 20:11 |
dolphm | would have prevented bug 1299349 | 20:12 |
uvirtbot | Launchpad bug 1299349 in neutron "upstream-translation-update Jenkins job failing" [High,In progress] https://launchpad.net/bugs/1299349 | 20:12 |
bknudson | dolphm: I think it's submitted already | 20:12 |
bknudson | dolphm: https://review.openstack.org/#/c/84211/ | 20:12 |
dolphm | bknudson: awesome! | 20:12 |
dstanek | bknudson, ayoung: the extension migrations commit is the one that removed the calls to db_sync right? | 20:13 |
ayoung | dstanek, nope | 20:13 |
ayoung | dstanek, I think they all stayed there. THe extensions migrations worked around them | 20:13 |
ayoung | ignored them,really | 20:14 |
bknudson | dstanek: which db_sync, the extensions or the backends? | 20:14 |
dstanek | backends | 20:15 |
dstanek | https://github.com/openstack/keystone/commit/10ef682f46e34e4e19d467c9b0e45f4f8838a134#diff-0e7a49790c0f3bba431b128f9b6138fdL64 | 20:15 |
bknudson | dstanek: https://github.com/openstack/keystone/commit/10ef682f46e34e4e19d467c9b0e45f4f8838a134#diff-0e7a49790c0f3bba431b128f9b6138fdL64 | 20:15 |
dstanek | i thought that's what line 64 was doing | 20:15 |
ayoung | not really | 20:15 |
ayoung | only the first one of those had any effect | 20:15 |
bknudson | dstanek: it used to call db_sync on all the backends and then it was changed to do migration.db_sync directly | 20:15 |
ayoung | the others were duplicating the effort | 20:15 |
bknudson | y, it was weird. | 20:16 |
ayoung | bknudson, I think the original intention was that the backend code would control its own repo, which is what we moved to with extensions | 20:16 |
ayoung | but it was never implemented that way | 20:16 |
openstackgerrit | David Stanek proposed a change to openstack/keystone: Removes unused db_sync methods https://review.openstack.org/84851 | 20:17 |
dstanek | tests are not completed locally, but hey... | 20:17 |
bknudson | parallel testing bug?? http://logs.openstack.org/12/84012/1/check/gate-keystone-python26/8cbc353/console.html | 20:19 |
stevemar | bknudson, i thought i found one too.. | 20:21 |
stevemar | https://bugs.launchpad.net/keystone/+bug/1300581 | 20:21 |
uvirtbot | Launchpad bug 1300581 in keystone "test_revoke.RevokeTreeTests.test_cleanup fails" [Critical,Triaged] | 20:21 |
stevemar | if itworker-2 ? worker-3? | 20:22 |
stevemar | if it says worker-# does that mean it's being done in parallel? | 20:23 |
bknudson | tags: worker-2 | 20:23 |
bknudson | stevemar: we enabled concurrent testing by default, so they should all be parallel | 20:24 |
stevemar | based on the number of cores a machine has right? | 20:24 |
bknudson | stevemar: it's probably whatever the machine reports for # cpus | 20:25 |
bknudson | they don't run in the same process space. | 20:25 |
bknudson | but share the filesystem | 20:26 |
bknudson | e.g., the python-keystoneclient git repos | 20:26 |
morganfainberg | bknudson, all the keystoneclient tests should be on the same worker | 20:26 |
morganfainberg | bknudson, _should_ | 20:26 |
bknudson | we probably need a lock? although I thought the keystoneclient tests were supposed to run in 1 worker... | 20:26 |
morganfainberg | bknudson, in theory the grouping should force them on the same worker so you don't have git issues | 20:27 |
*** lbragstad has quit IRC | 20:27 | |
*** lbragstad has joined #openstack-keystone | 20:27 | |
dolphm | "I currently have an opportunity for a remote, work from home, contract. The customer is looking for someone with a background developing for Openstack Keystone, with strong skills in Python development." -recruiter | 20:27 |
morganfainberg | dolphm, @recruiterbro worthy? | 20:28 |
morganfainberg | :P | 20:28 |
dolphm | morganfainberg: needs too much context for recruiterbro lol | 20:28 |
morganfainberg | dolphm, true | 20:28 |
bknudson | here it is -- http://git.openstack.org/cgit/openstack/keystone/tree/.testr.conf#n10 | 20:28 |
bknudson | group_regex=.*(test_cert_setup|test_keystoneclient).+ -- puts them in 1 worker? | 20:28 |
morganfainberg | bknudson, my understanding is it should | 20:28 |
morganfainberg | bknudson, it groups based upon the first match group | 20:29 |
*** patelna_ has joined #openstack-keystone | 20:29 | |
morganfainberg | bknudson, are you seeing issues with the keystoneclient git checkouts causing failures? | 20:29 |
bknudson | morganfainberg: look at http://logs.openstack.org/12/84012/1/check/gate-keystone-python26/8cbc353/console.html | 20:30 |
bknudson | from keystoneclient.v2_0 import client as ks_client -- ImportError: No module named v2_0 | 20:30 |
morganfainberg | bknudson, i saw that w/o concurrent tests | 20:30 |
morganfainberg | oh the pathspec | 20:30 |
morganfainberg | sorry scorlls down | 20:30 |
bknudson | so somehow keystoneclient doesn't have v2_0?? | 20:30 |
morganfainberg | hm. | 20:31 |
morganfainberg | wonder if checkout_vendor is doing something dumb | 20:31 |
morganfainberg | i'll bet that isn't getting properly grouped in | 20:31 |
bknudson | morganfainberg: maybe could see it by causing checkout_vendor to raise ... then that would cause all the tests to fail and could see if they're in the same worker | 20:31 |
*** joesavak has joined #openstack-keystone | 20:32 | |
morganfainberg | bknudson, i haven't been able to duplicate that specifically (even w/ 8 workers) fwiw. | 20:32 |
*** patelna has quit IRC | 20:32 | |
morganfainberg | bknudson, that would be good to know | 20:32 |
morganfainberg | bknudson, the revoke_api one steve reported seems like some odd parallel issue | 20:33 |
*** jsavak has quit IRC | 20:34 | |
*** RockKuo_TW has joined #openstack-keystone | 20:35 | |
morganfainberg | i see how the revoke_api one is failing. | 20:36 |
morganfainberg | or.. not | 20:36 |
*** RockKuo has quit IRC | 20:38 | |
*** leseb has quit IRC | 20:41 | |
openstackgerrit | David Stanek proposed a change to openstack/keystone: Check that all po/pot files are valid https://review.openstack.org/84211 | 20:43 |
*** leseb has joined #openstack-keystone | 20:47 | |
ayoung | hmmm, running in HTTPD, and all I am getting for debug info is the LDAP. Getting a token (which works in the35357 and 5000 keystone wsgi servers) gets me <title>500 Internal Server Error</title> | 20:53 |
ayoung | httpd log shows | 20:53 |
ayoung | [Wed Apr 02 20:52:33.106253 2014] [core:error] [pid 7760] [client 10.10.61.119:39040] Premature end of script headers: admin | 20:54 |
ayoung | [Wed Apr 02 20:52:33.106604 2014] [:error] [pid 7754] [remote 10.10.61.119:13846] mod_wsgi (pid=7754): Exception occurred processing WSGI script '/var/www/cgi-bin/keystone/admin'. | 20:54 |
ayoung | [Wed Apr 02 20:52:33.106667 2014] [:error] [pid 7754] [remote 10.10.61.119:13846] IOError: failed to write data | 20:54 |
ayoung | Somehow I am not getting the error messages. What is next in debugging? | 20:54 |
ayoung | for the log file I have log_file=/var/log/keystone/keystone_log and I see the LDAP logging in there (and the initial config) from both HTTPD and Eventelt | 20:55 |
bknudson | I usually look for the apache error logs | 20:55 |
ayoung | debug=true | 20:56 |
ayoung | bknudson, that is what I just spewed in here | 20:56 |
ayoung | only those 3 lines are produced | 20:56 |
ayoung | I'm using CURL, and the only difference between a successful call and a non-successful is whether I target the eventlet url or the HTTPD. Oh, one other thing, V2.0 works OK, this is only V3 | 20:57 |
dstanek | ayoung: it looks like maybe an uncause exception that kills the process. can you confirm? | 20:58 |
ayoung | dstanek, how? | 20:58 |
dstanek | ayoung: take a look at the pids, run a few requests and see if they are different (best way i can think of) | 20:58 |
dstanek | ayoung: http://git.openstack.org/cgit/openstack/keystone/tree/keystone/service.py#n67 | 21:00 |
dstanek | looks like that will try to log the exception and die | 21:00 |
ayoung | dstanek, so, it looks like the pids are not changing | 21:01 |
dstanek | not sure why you don't see the traceback | 21:01 |
dstanek | ayoung: i think line 74 should really be LOG.exception because i have to imagine you'd want the traceback even if you are not in debug mode | 21:02 |
*** patelna has joined #openstack-keystone | 21:02 | |
ayoung | dstanek, true | 21:02 |
ayoung | but I have debug enabled...I think. I should be seeing a lot more spew, though | 21:03 |
*** patelna_ has quit IRC | 21:05 | |
ayoung | All I am getting is LDAP debugging. There must be something misconfigured | 21:05 |
dstanek | it's odd that we'd want to exit in this situation | 21:07 |
*** topol has quit IRC | 21:08 | |
*** _TheDodd_ has quit IRC | 21:09 | |
ayoung | dstanek, OK, I am also seeing notifications and caching log messages, I am guessing that this path is just dropping the message. | 21:10 |
dstanek | ayoung: that's pretty strange; nothing in the apache error log? | 21:11 |
ayoung | dstanek, nope. The Keystone log is directed elsewhere, and that seems to be working. | 21:11 |
ayoung | /var/log/keystone/keystone_log gets cache logging, and then nothing | 21:12 |
ayoung | I can stick some debug into the token creationg code...but need to go be dad for a while | 21:12 |
*** ayoung is now known as ayoung_AFK | 21:12 | |
morganfainberg | dolphm, about to propose the sync fix for https://bugs.launchpad.net/oslo/+bug/1301036 | 21:12 |
uvirtbot | Launchpad bug 1301036 in oslo "openstack.common.db.sqlalchemy.migration utf8 table check issue on initial migration" [Critical,In progress] | 21:12 |
*** bvandenh has joined #openstack-keystone | 21:12 | |
morganfainberg | dolphm, will propose the same patch to milestone-proposed as well | 21:13 |
bknudson | dstanek: looks like https://review.openstack.org/#/c/84851/ ran into the same problem I did. | 21:13 |
dstanek | bknudson: yeah, i just saw that | 21:14 |
dstanek | did you create a bug for it? | 21:14 |
bknudson | dstanek: no, I'm in the middle of other work | 21:14 |
dstanek | bknudson: np, i'll do it | 21:15 |
bknudson | do you guys realize how many security vulnerabilities there are in openstack?? | 21:15 |
dstanek | sounds like a lot | 21:15 |
*** joesavak has quit IRC | 21:19 | |
*** bvandenh has quit IRC | 21:20 | |
openstackgerrit | Morgan Fainberg proposed a change to openstack/keystone: Sync from oslo db.sqlalchemy.migration https://review.openstack.org/84869 | 21:30 |
bknudson | morganfainberg: I've already got the change ^ -- https://review.openstack.org/#/c/83966/ | 21:33 |
bknudson | oh, yours has extra stuff now. | 21:33 |
bknudson | I'll need to re-sync | 21:33 |
morganfainberg | bknudson, ah. | 21:38 |
morganfainberg | bknudson, https://review.openstack.org/#/c/84870/ specifically for RC2 bug | 21:38 |
morganfainberg | bknudson, mine is a very specific target that affects RC2 (blocker) | 21:39 |
*** stevemar has quit IRC | 21:51 | |
openstackgerrit | A change was merged to openstack/keystone: Remove unused db_sync from extensions https://review.openstack.org/79211 | 21:56 |
*** david-lyle has quit IRC | 22:11 | |
*** leseb has quit IRC | 22:17 | |
*** leseb has joined #openstack-keystone | 22:18 | |
*** leseb has quit IRC | 22:22 | |
*** harlowja has quit IRC | 22:35 | |
*** harlowja has joined #openstack-keystone | 22:36 | |
*** dstanek has quit IRC | 22:38 | |
*** dstanek has joined #openstack-keystone | 22:39 | |
*** dims_ has quit IRC | 22:40 | |
*** harlowja has quit IRC | 22:54 | |
*** harlowja has joined #openstack-keystone | 22:55 | |
*** dims_ has joined #openstack-keystone | 22:56 | |
*** bada has quit IRC | 23:26 | |
*** andreaf2 has joined #openstack-keystone | 23:41 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!