Wednesday, 2017-10-11

*** markvoelker has quit IRC02:54
*** markvoelker has joined #openstack-interop04:55
*** markvoelker has quit IRC05:30
*** markvoelker has joined #openstack-interop06:26
*** georgk has joined #openstack-interop06:57
*** markvoelker has quit IRC07:00
*** pcaruana has joined #openstack-interop07:13
*** nikhil has quit IRC07:34
*** markvoelker has joined #openstack-interop07:57
*** pcaruana has quit IRC08:27
*** markvoelker has quit IRC08:30
*** pcaruana has joined #openstack-interop08:31
*** markvoelker has joined #openstack-interop09:28
*** markvoelker has quit IRC10:01
-openstackstatus- NOTICE: The CI system will be offline starting at 11:00 UTC (in just under an hour) for Zuul v3 rollout: http://lists.openstack.org/pipermail/openstack-dev/2017-October/123337.html10:08
*** MarkBaker has joined #openstack-interop10:43
*** markvoelker has joined #openstack-interop10:58
*** mrhillsman has quit IRC11:03
*** MarkBaker has quit IRC11:04
*** mrhillsman has joined #openstack-interop11:05
*** markvoelker has quit IRC11:30
*** tobberydberg__ has joined #openstack-interop11:51
*** tobberydberg__ has quit IRC11:55
*** MarkBaker has joined #openstack-interop12:06
*** markvoelker has joined #openstack-interop12:18
-openstackstatus- NOTICE: Due to unrelated emergencies, the Zuul v3 rollout has not started yet; stay tuned for further updates13:05
*** zhipeng has joined #openstack-interop13:52
*** zhipeng has quit IRC14:04
*** zhipeng has joined #openstack-interop14:04
*** georgk has quit IRC14:36
*** georgk has joined #openstack-interop14:56
*** MarkBaker has quit IRC15:05
*** galstrom_zzz is now known as galstrom15:13
*** zhipeng has quit IRC15:19
*** zhipeng has joined #openstack-interop15:19
*** Rockyg has joined #openstack-interop15:56
*** zhipeng has quit IRC15:57
*** pcaruana has quit IRC15:59
Rockyghey!17:01
*** lbragstad has joined #openstack-interop17:01
markvoelkerlbragstad: So, basically...17:01
egluteo/17:01
markvoelkertempest.api.identity.v3.test_projects.IdentityV3ProjectsTest.test_list_projects_returns_only_authorized_projects is a test we've included in the interop guidelines in the past17:02
markvoelkerHowever it got a flag thrown on it because it requires two user accounts17:02
markvoelkerThere was some discussion about maybe finding some tests for the "identity-v3-list-projects" capability that don't require two accounts and don't require admin credentials17:03
markvoelkerOr refactoring the existing test17:03
markvoelkerBut I think luzc wasn't sure if there's been any forward motion on that.17:03
lbragstadit appears the second account is needed to ensure keystone doesn't leak information it shouldn't be17:04
eglutelbragstad is there a way to separate those two test cases?17:05
markvoelkerYep.  I think (memory hazy, been a while since I looked at this) the discussion was maybe we need a test that just tests "can I get a list of projects" and "can I NOT get a list of other projects" was a separate thing.17:06
markvoelkerluzC might be more current on this but I think she's not around at the moment17:06
lbragstadok - this is probably a dumb question17:07
lbragstadis there a requirement that we can't standup a dummy user on a dummy project to ensure the other test user doesn't get the dummy project in the respone?17:07
lbragstadresponse*?17:07
Rockygwhat about trying to get list of admin projects?  That should also be a no go for a non-admin user17:08
markvoelkerWell, think of it from the point of view of an end user who wants to verify that a given cloud (let's say, a public cloud) actually is interoperable as it claims.17:08
markvoelkerIn that case I can't necessarily set up a "dummy user" without incurring additional cost17:09
lbragstadwhat about when we test interop for instances?17:09
markvoelkerOr in a private cloud case (say, where identity is tied to an LDAP server somewhere) I may not be allowed to create an alternate identity17:09
* markvoelker has to run to a meeting momentarily, but eglute and rockyg may be able to continue this discussion17:10
lbragstadmarkvoelker: thanks for the context17:10
eglutethanks markvoelker17:10
eglutelbragstad i think there is no question about extra testing, just that for interop purposes, we need the tests be tied to one user17:11
lbragstadcan the tests be tied to a single account?17:12
lbragstador project?17:12
egluteso how hard would it be to separate the two test cases into two separate tests? or perhaps there is a test already that tests the same?17:12
eglutesingle account single user..17:12
eglutethough, if it is same account/project might work. except for ldap example17:13
lbragstadyeah- in that case, the test needs to accept input from whoever is running it and assume things are setup17:13
eglutelbragstad correct17:14
RockygYup.17:14
*** nikhil has joined #openstack-interop17:14
lbragstadi don't see a way to get around that if you want to ensure keystone is filtering sensitive information17:14
lbragstadi have another dumb question17:15
eglutewe like all questions here!17:15
lbragstadwhen these tests are run, is only a username and password required?17:15
Rockygno question is dumb except the one unasked17:15
eglutelbragstad i believe so, let me see17:15
RockygI suspect account might also be part of the equation.17:16
Rockygbut couldn't a user create multiple projects on a single acct, single vm?17:16
lbragstadi guess that depends on what you consider an account17:16
lbragstadis an account a instance or a project that owns resource that a user is billed for?17:17
* lbragstad usually associates the term "account" to the later17:17
Rockyggood question.  it might depend on the cloud config17:17
RockygBut, if the latter, couldn't ther be nested projects?17:18
eglutehm, i am trying to find docs for refstack setup17:18
lbragstadthere can be nested projects17:18
lbragstadbut - you can also have a domain (or "top-level" project) that acts similarly17:18
Rockygyes.  Then singlue user can create dummy user(s) in their own account and test for isolation in sub projects17:19
eglutelbragstad this is what ppl run to submit results to us: https://github.com/openstack/refstack-client17:19
eglutehttps://docs.openstack.org/tempest/latest/configuration.html#pre-provisioned-credentials17:19
egluteso one account and one user?17:20
Rockygyeah.  The domain user *should* be what is used for "single user, single account" but I don't think that concept is in interop tests yet.17:20
lbragstadhttps://github.com/openstack/refstack-client/blob/master/refstack_client/scripts/prep_cloud.py#L223-L24417:20
lbragstadit looks like the ability exists https://github.com/openstack/refstack-client/blob/master/refstack_client/scripts/prep_cloud.py#L241-L24417:21
egluteyes, it is not about the ability17:21
egluteit is about the requirement that only one user + account be used for interop17:21
lbragstadi'd imagine that is going to limit what you can include for interop tests17:22
eglutelbragstad it does!17:22
lbragstadbecause it won't have the necessary environment to guarantee a certain level of security17:22
RockygSo, the user, though can create users within their own account, though.  That should not be an extra cost to an account17:22
eglutelbragstad interop is not testing security, not right now anyways17:22
Rockygsucks, doesn't it?17:23
eglutehttps://github.com/openstack/interop/blob/master/working_materials/interop_test_spec.rst17:23
Rockygthis would also be a great forum discussion...17:23
lbragstadso - another question that will help me understand this17:24
eglutego ahead!17:24
lbragstadwhy does interop want to include https://github.com/openstack/tempest/blob/master/tempest/api/identity/v3/test_projects.py#L26 as a required test?17:24
eglutewe want to test "identity-v3-list-projects"17:25
eglutehttps://github.com/openstack/interop/blob/master/2017.09.json#L1070-L109317:25
egluteso, we need a test that would test that capability17:25
egluteif there is another test that is testing that, it would be great17:26
lbragstadok - so do you want to test GET /v3/projects or GET /v3/auth/projects ?17:27
lbragstad\https://developer.openstack.org/api-ref/identity/v3/index.html#authentication-and-token-management17:27
lbragstador https://developer.openstack.org/api-ref/identity/v3/index.html#projects17:27
egluteprobably just get projects17:28
eglute"List projects a user belongs to"17:28
egluteso "get projects" is probably it17:29
lbragstadif that's the case, then GET /v3/auth/projects will do that17:29
lbragstadwhich returns the list of project I, as a user, have a role assignment on17:29
eglutecool.. and tehre is a different tempest test for it correct?17:29
Rockygcool!17:29
lbragstadchecking17:32
eglutethank you lbragstad17:32
lbragstadyeah - the test that you were looking at uses a different URL https://github.com/openstack/tempest/blob/4f5e426d10452db85925d02f35074932aae115db/tempest/lib/services/identity/v3/users_client.py#L64-L7717:34
lbragstadspecifically - https://github.com/openstack/tempest/blob/4f5e426d10452db85925d02f35074932aae115db/tempest/lib/services/identity/v3/users_client.py#L7117:34
lbragstadit doesn't look like a test exists for that17:34
RockygI've gotta run to work, but it looks like we will get a usable solution this round or next.  I love it when we all move forward through a little discussion!17:34
Rockyglooks like we just need to write the test, then.17:34
lbragstadyeah - looks like it17:34
eglutelbragstad thanks for looking. Do you think a new test is a possibility?17:35
lbragstadeglute: yeah - probably, might be worth checking with the tempest folks but i assume it would live in either https://github.com/openstack/tempest/blob/master/tempest/api/identity/v3/test_projects.py or https://github.com/openstack/tempest/blob/master/tempest/api/identity/v3/test_tokens.py since it's technically an authentication API17:36
eglutethanks lbragstad. This new test is on our wish list :)17:37
lbragstadeglute: no problem17:38
egluteI need to run as well. I will update our keystone patch in a bit with the above discussion. If you find a volunteer to write this new test, let us know!17:39
*** MarkBaker has joined #openstack-interop17:55
*** georgk has quit IRC18:27
*** Rockyg has quit IRC18:46
*** MarkBaker has quit IRC19:09
*** MarkBaker has joined #openstack-interop20:37
*** MarkBaker has quit IRC21:05
*** galstrom is now known as galstrom_zzz22:29

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!