Wednesday, 2021-06-23

*** akekane_ is now known as abhishekk05:51
*** jpena|off is now known as jpena06:56
*** rpittau|afk is now known as rpittau07:07
*** bhagyashris_ is now known as bhagyashris08:27
opendevreviewSlawek Kaplonski proposed openstack/devstack master: Stop creating userrc_early  https://review.opendev.org/c/openstack/devstack/+/78041709:48
opendevreviewSlawek Kaplonski proposed openstack/devstack master: Deploy Neutron with enforced new RBAC rules  https://review.opendev.org/c/openstack/devstack/+/79745009:48
slaweqfrickler thx for link to Your patch yesterday09:49
slaweqI put mine https://review.opendev.org/c/openstack/devstack/+/797450 on top of Yours and devstack (almost) deployed for me09:49
slaweqnow the issue is in the tempest09:49
slaweqI will open new LP for tempest for that right now09:50
opendevreviewLee Yarwood proposed openstack/tempest master: zuul: Add a full CentOS 8 stream job to the check and gate queues  https://review.opendev.org/c/openstack/tempest/+/79761409:50
opendevreviewLukas Piwowarski proposed openstack/tempest master: Fix test_network_quota_exceeding test  https://review.opendev.org/c/openstack/tempest/+/79746609:57
opendevreviewLee Yarwood proposed openstack/tempest master: zuul: Add a full CentOS 8 stream job to the check and gate queues  https://review.opendev.org/c/openstack/tempest/+/79761410:00
slaweqgmann kopecmartin yoctozepto maybe You will be interested to check https://bugs.launchpad.net/tempest/+bug/193332310:28
*** pojadhav is now known as pojadhav|afk10:41
*** jpena is now known as jpena|lunch11:30
opendevreviewRodolfo Alonso proposed openstack/tempest master: Use "resolvectl dns" to retrieve the DNS nameservers  https://review.opendev.org/c/openstack/tempest/+/79477611:31
*** dviroel|out is now known as dviroel11:37
kopecmartinslaweq: oh ... thanks for filling out the bug12:18
opendevreviewLukas Piwowarski proposed openstack/tempest master: Fix test_network_quota_exceeding test  https://review.opendev.org/c/openstack/tempest/+/79746612:30
*** pojadhav|afk is now known as pojadhav12:32
*** jpena|lunch is now known as jpena12:33
opendevreviewRodolfo Alonso proposed openstack/devstack master: Make explicit the network backend used in the CI jobs  https://review.opendev.org/c/openstack/devstack/+/79763813:05
opendevreviewRodolfo Alonso proposed openstack/tempest master: Make explicit the network backend used in the CI jobs  https://review.opendev.org/c/openstack/tempest/+/79763913:05
*** sboyron is now known as Guest32214:44
gmannTheJulia: register_service_client is implemented in only few plugins like manila or sahara may be15:48
gmannTheJulia: this is designate-tempest-plugin exaple for os_admin https://github.com/openstack/designate-tempest-plugin/blob/b18605ab79647eeac2901ccbcb5d530bf26ca0af/designate_tempest_plugin/tests/scenario/v2/test_zones_transfer.py#L3215:50
gmannslaweq: yeah, verify-config is not yet moved to new RBAC, I will check what all things needs to be done together 15:53
gmannslaweq: I am trying those in my patches for other services also https://review.opendev.org/q/topic:%2522secure-rbac%2522+(status:open+OR+status:merged)+project:openstack/devstack+owner:gmann%2540ghanshyammann.com15:53
TheJuliagmann: looks like barbican is the most... proper15:54
TheJuliaoddly, and maybe it is due to style, searching for some examples with codesearch has not been yeilding good results which has ment lots of digging :(15:55
gmannany one you can check. many plugins use that way15:55
gmannyeah codesearch sometime very specific on regex 15:55
TheJuliait looks like there is just lots of inconsistent style15:56
gmannfor consistency we recommended register_service_client  style but only plugins did progress on that. this is something we need to do on plugin side15:57
gmann*only two plugins15:57
TheJuliaout of curiosity when was that implemented as a style for tempest?15:59
*** jpena is now known as jpena|off16:00
gmannit is since very long, I think 3-4 years back or even more older 16:03
johnsomTheJulia Not 100% sure what you are looking for, but Octavia has a fairly complete client setup: https://github.com/openstack/octavia-tempest-plugin/blob/master/octavia_tempest_plugin/tests/test_base.py#L16516:03
gmannyes, ocyavia is also one example of doing it in legacy way16:05
johnsomlol, legacy. Ok, so I guess we missed a memo as well. What is the new way?16:05
TheJuliagmann: ahh, yeah, that would explain it since ironic... if memory serves... was one of the first since our entrance into tempest was refused16:06
TheJuliajohnsom: I might have a decently clean example in a little bit16:07
* TheJulia crosses fingers16:07
johnsomYeah, same for us. One of the first true plugins16:07
gmannjohnsom: :) this is what we recommend via  get_service_clientsway - https://github.com/openstack/tempest/blob/7e96c8e854386f43604ad098a6ec7606ee676145/tempest/test_discover/plugins.py#L12116:07
TheJuliajohnsom:  https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/797521 is the direction I'm heading with ironic, although I've yet to get it to work, it feels very close16:08
*** rpittau is now known as rpittau|afk16:08
gmannjohnsom: this way you just need to register the service client info in tempest and tempest take care of creating the credential manager etc and make if accessible from Tempest in plugins16:08
gmannotherwise plugins needs to override client_manager  and take care of credential manager or so16:10
johnsomHmm, we have this: https://github.com/openstack/octavia-tempest-plugin/blob/master/octavia_tempest_plugin/plugin.py#L5416:10
gmannjohnsom: ohk, i missed that, in that case you might not need this one https://github.com/openstack/octavia-tempest-plugin/blob/master/octavia_tempest_plugin/tests/test_base.py#L9216:10
johnsomI think we are doing that.  We set that up, then the os_admin.<client> things become available.16:11
mtreinishTheJulia: there used to be ironic tests in tempest. A really long time ago: https://opendev.org/openstack/tempest/commit/62b1ed19def65ecf34cdedf0a3b3439ebb7d1d09 16:11
johnsomPlus the other credentials we need16:11
mtreinishit was before the big tent and before we started doing plugins16:11
mtreinishit was removed here: https://opendev.org/openstack/tempest/commit/66cded2553a90ce2b29b4dae442e1bce95895f5316:12
gmannjohnsom: if get_service_clients registering all the octavia service client  in tempest then you  do not need to override client_manager  .16:12
TheJuliamtreinish: I had no idea!16:12
TheJuliamtreinish: thanks!16:13
gmannjohnsom: I can check sometime later by removing that and it should work.16:13
johnsomgmann lol, yeah, dead code, never referenced, at least from our code16:13
mtreinishhah, I mean it was 8yrs ago. I barely remember it. I more remember the baremetal config option in the tempest.conf than anything16:13
gmannjohnsom: but good to know you are doing the new style. something I can ref to other plugins also and encourage to do that way16:14
gmannmtreinish: and lot of discussion while moving :)16:14
TheJuliaI guess the unfortunate continuation of that was also the negative impact on anything plugin based getting picked up in interop test profiles since they had to be explicitly run the plugin AIUI16:14
TheJuliamtreinish: also o/, it has been a long time16:15
gmannwe have designate and heat plugins tests running in interop certification tests16:15
TheJuliaw/r/t ironic, I really don't care about interop or value, I just have someone that complains because ironic is not there16:16
TheJuliaand when asked, nobody really knows the secret sauce required to bridge the gap short of I guess whatever designate and heat explicitly did16:16
* TheJulia shrugs16:17
johnsomgmann https://review.opendev.org/c/openstack/octavia-tempest-plugin/+/797715 We will see if it's really dead code or there is another issue.16:18
johnsomMy guess is that it's just old cruft16:18
gmannjohnsom: ack, will monitor this.16:20
gmannjohnsom: I think you need to pass the auth_provider also in get_service_clients  so that octavia service clients are init with that auth_provider pointing to octavia endpoints. 16:22
gmannlet's see the result16:22
gmannah you are passing octavia_config there. should be ok16:25
gouthamrgmann: i don't see register_service_client in manila-tempest-plugin, just get_service_clients: https://opendev.org/openstack/manila-tempest-plugin/src/branch/master/manila_tempest_tests/plugin.py#L59-L7516:27
gmanngouthamr: in that case that patch might not be merged. let me check16:28
gmanngouthamr: oh, it is get_service_clients so all good. 16:28
gouthamrawesome :) thought we needed something new here 16:29
gmanngouthamr: no,  I remember manila was first plugin we tried this new way of registering the service client from plugins16:30
gouthamrgmann: ah i see! :)16:33
*** gfidente is now known as gfidente|afk16:34
TheJuliagmann: do you have a decent example of the auth_provider that you were talking about to johnsom 16:51
gmannTheJulia: you mean for get_service_clients case or client_manager  overreidden case?16:54
TheJuliaeither, get_services_clients. Specifically I'm getting an exception16:56
TheJuliahttps://www.irccloud.com/pastebin/2DvQ9fay/16:56
gmannare you passing all the param like this https://github.com/openstack/octavia-tempest-plugin/blob/master/octavia_tempest_plugin/plugin.py#L5416:58
TheJuliagmann: explicitly https://github.com/openstack/octavia-tempest-plugin/blob/master/octavia_tempest_plugin/plugin.py#L55-L57 ?17:01
TheJuliaI guess that has the params in it?17:01
gmannyeah that config param should have 'service' config option17:02
TheJuliaso if I don't need nor want it configurable dynamically, it should just match the service plugin name right?17:04
TheJuliaor... ?!17:04
gmann'catalog_type' which is names as service in tempest17:04
TheJuliaahh, okay17:07
johnsomgmann Looks like we are missing something: https://cbff25b854b00bc0ff99-8ce5690b0835baabd00baac02d43f418.ssl.cf5.rackcdn.com/797715/1/check/octavia-v2-dsvm-scenario/7c7c774/job-output.txt18:17
johnsomAttributeError: 'Manager' object has no attribute 'loadbalancer_client'18:17
TheJuliajohnsom: you might need to extend the path or you might have a mismatch, if you look at my ironic-tempest-plugin patch you can see I had to define the paths out and then have to also reconcile the name elsewhere. I've gotten pretty far, now hitting fun stuff like can't use scoepd admin to create a network20:03
TheJuliawell, system scoped20:03
gmannno, its how octavia is accessing the client I think. johnsom you do register the client but you access the client from how you register in your client manager20:06
gmannlet me update and try20:06
gmannjohnsom: updated the patch, I think I covered all but let's see if anything else missing20:18
johnsomgmann Thank you!21:05
johnsomHmmm, still a naming/path issue probably: AttributeError: 'Manager' object has no attribute 'load_balancer_v2'21:08
gmannjohnsom: yeah, let me check21:09
johnsomI can pull that down now and do a little debug21:10
johnsomOh, ok, if you have an idea I can hold on21:10
gmannjohnsom: it should be available in name you are registering here https://github.com/openstack/octavia-tempest-plugin/blob/master/octavia_tempest_plugin/plugin.py#L6021:11
gmannhere tempest replace - and . with _21:11
*** dviroel is now known as dviroel|out21:13
johnsomIt appears to be 'load-balancer_v2'21:16
gmannyeah - should be replaced with _21:17
johnsomSo, changed that in the "name" field in the get_service_clients, got farther. Now: AttributeError: 'ClientsFactory' object has no attribute 'ListenerClient'21:19
johnsomI will interate on this and let you know if I hit another puzzling issue.21:19
johnsomiterate, sigh.21:19
johnsomI assume the client_names list needs updating21:20
johnsomHmm, I think we need to import those in the __init__?21:25
johnsom    testtools.runtest.MultipleExceptions: (<class 'AttributeError'>, AttributeError("Invalid class name, ListenerClient is not found in <module 'octavia_tempest_plugin.services.load_balancer.v2' from '/opt/stack/.local/lib/python3.8/site-packages/octavia_tempest_plugin/services/load_balancer/v2/__init__.py'>"), <traceback object at 0x7f2437041ec0>)21:25
johnsomDetails: {'type': 'HTTPNotFound', 'message': 'The resource could not be found.', 'detail': ''}21:52
johnsomI think the params removed here are a problem: https://review.opendev.org/c/openstack/octavia-tempest-plugin/+/797715/2/octavia_tempest_plugin/clients.py#b6621:53
gmannthese param should be loaded form here 22:01
gmannhttps://github.com/openstack/octavia-tempest-plugin/blob/master/octavia_tempest_plugin/plugin.py#L5522:01
johnsomauth_provider is missing I think22:01
gmannauth_provider  will be prepared by Tempest.22:03
gmannjohnsom: ah, we need to add those client in __init__ also https://github.com/openstack/octavia-tempest-plugin/blob/master/octavia_tempest_plugin/services/load_balancer/v2/__init__.py22:05
johnsomYeah, I did that locally for this testing22:05
gmannadd all the client in __all__ like done here https://github.com/openstack/tempest/blob/master/tempest/lib/services/compute/__init__.py#L6822:05
gmannohk22:05
johnsomI  can post what I have....22:05
gmannyeah that will help22:06
johnsomgmann https://review.opendev.org/c/openstack/octavia-tempest-plugin/+/79771522:18
johnsomOh, forgot the - -> _22:19
johnsomThere we go22:20
johnsomHmm, maybe my local test stack had an issue. It appears to be running in zuul. Let's see22:52
gmannit still not finding few clients22:59

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!