| *** brinzhang_ has quit IRC | 00:13 | |
| *** hamalq has quit IRC | 01:27 | |
| *** Yarboa has quit IRC | 01:43 | |
| *** Yarboa has joined #openstack-qa | 01:45 | |
| openstackgerrit | Wenping Song proposed openstack/tempest master: Use py3 as the default runtime for tox https://review.opendev.org/c/openstack/tempest/+/787014 | 01:57 |
|---|---|---|
| *** ajitha has joined #openstack-qa | 02:27 | |
| *** elod has joined #openstack-qa | 02:38 | |
| *** rcernin has quit IRC | 02:58 | |
| *** rcernin has joined #openstack-qa | 03:13 | |
| *** rh-jelabarre has quit IRC | 03:27 | |
| *** rcernin has quit IRC | 03:27 | |
| *** Yarboa has quit IRC | 03:33 | |
| *** Yarboa has joined #openstack-qa | 03:35 | |
| *** rcernin has joined #openstack-qa | 03:36 | |
| *** rcernin has quit IRC | 03:39 | |
| *** rcernin has joined #openstack-qa | 03:39 | |
| *** vishalmanchanda has joined #openstack-qa | 04:23 | |
| *** gcheresh has joined #openstack-qa | 04:44 | |
| *** ysandeep|away is now known as ysandeep | 05:24 | |
| openstackgerrit | zhangboye proposed openstack/tempest-lib master: Use py3 as the default runtime for tox https://review.opendev.org/c/openstack/tempest-lib/+/787075 | 05:46 |
| openstackgerrit | zhangboye proposed openstack/tempest master: Use py3 as the default runtime for tox https://review.opendev.org/c/openstack/tempest/+/787076 | 05:48 |
| openstackgerrit | zhangboye proposed openstack/tempest-stress master: Use py3 as the default runtime for tox https://review.opendev.org/c/openstack/tempest-stress/+/787077 | 05:48 |
| *** slaweq has quit IRC | 05:55 | |
| *** yamamoto has quit IRC | 05:56 | |
| *** ralonsoh has joined #openstack-qa | 06:03 | |
| *** artom has quit IRC | 06:04 | |
| *** artom has joined #openstack-qa | 06:04 | |
| openstackgerrit | zhangboye proposed openstack/stackviz master: Use py3 as the default runtime for tox https://review.opendev.org/c/openstack/stackviz/+/787085 | 06:06 |
| *** sboyron has joined #openstack-qa | 06:09 | |
| *** artom has quit IRC | 06:10 | |
| *** artom has joined #openstack-qa | 06:11 | |
| *** lpiwowar has joined #openstack-qa | 06:11 | |
| *** artom has quit IRC | 06:12 | |
| *** artom has joined #openstack-qa | 06:15 | |
| *** artom has quit IRC | 06:16 | |
| *** artom has joined #openstack-qa | 06:16 | |
| *** artom has quit IRC | 06:17 | |
| *** artom has joined #openstack-qa | 06:17 | |
| *** eolivare has joined #openstack-qa | 06:28 | |
| *** brinzhang has joined #openstack-qa | 06:29 | |
| *** yamamoto has joined #openstack-qa | 06:31 | |
| *** artom has quit IRC | 06:37 | |
| *** artom has joined #openstack-qa | 06:37 | |
| *** yamamoto has quit IRC | 06:38 | |
| *** yamamoto has joined #openstack-qa | 06:38 | |
| *** artom has quit IRC | 06:47 | |
| *** artom has joined #openstack-qa | 06:48 | |
| *** lpiwowar has quit IRC | 06:51 | |
| *** lpiwowar has joined #openstack-qa | 06:51 | |
| *** dmellado has quit IRC | 07:03 | |
| *** rcernin has quit IRC | 07:15 | |
| *** artom has quit IRC | 07:16 | |
| *** artom has joined #openstack-qa | 07:17 | |
| *** artom has quit IRC | 07:18 | |
| *** artom has joined #openstack-qa | 07:18 | |
| *** artom has quit IRC | 07:19 | |
| *** artom has joined #openstack-qa | 07:20 | |
| *** artom has quit IRC | 07:23 | |
| *** artom has joined #openstack-qa | 07:24 | |
| *** rpittau|afk is now known as rpittau | 07:35 | |
| *** slaweq_ is now known as slaweq | 07:36 | |
| *** yamamoto has quit IRC | 07:40 | |
| *** tosky has joined #openstack-qa | 07:45 | |
| *** yamamoto has joined #openstack-qa | 07:49 | |
| *** jpena|off is now known as jpena | 07:58 | |
| *** lucasagomes has joined #openstack-qa | 08:01 | |
| *** yamamoto has quit IRC | 08:03 | |
| *** rcernin has joined #openstack-qa | 08:17 | |
| *** gfidente|afk is now known as gfidente | 08:27 | |
| *** rcernin has quit IRC | 08:39 | |
| *** yamamoto has joined #openstack-qa | 08:43 | |
| *** Yarboa has quit IRC | 08:43 | |
| *** Yarboa has joined #openstack-qa | 08:45 | |
| *** artom has quit IRC | 08:48 | |
| *** artom has joined #openstack-qa | 08:49 | |
| openstackgerrit | zhangboye proposed openstack/patrole master: Use py3 as the default runtime for tox https://review.opendev.org/c/openstack/patrole/+/787169 | 08:54 |
| *** yamamoto has quit IRC | 08:57 | |
| *** ysandeep is now known as ysandeep|afk | 09:14 | |
| *** Yarboa has quit IRC | 09:38 | |
| *** Yarboa has joined #openstack-qa | 09:44 | |
| *** vishalmanchanda has quit IRC | 09:52 | |
| *** ysandeep|afk is now known as ysandeep | 10:03 | |
| *** rpittau is now known as rpittau|bbl | 10:04 | |
| *** rcernin has joined #openstack-qa | 10:10 | |
| *** ccamposr__ has quit IRC | 10:14 | |
| *** ccamposr__ has joined #openstack-qa | 10:14 | |
| *** rcernin has quit IRC | 10:17 | |
| *** yamamoto has joined #openstack-qa | 10:19 | |
| *** dtantsur|afk is now known as dtantsur | 10:23 | |
| *** rcernin has joined #openstack-qa | 10:24 | |
| *** yamamoto has quit IRC | 10:25 | |
| *** sshnaidm has joined #openstack-qa | 10:35 | |
| sshnaidm | hi, is devstack error in master known? "table `broute' is incompatible, use 'nft' tool." | 10:35 |
| sshnaidm | https://zuul.opendev.org/t/openstack/build/b1ca9983e4214ee18664caf19ec1b320/log/job-output.txt#10938-10939 | 10:36 |
| frickler | sshnaidm: that's not an error, just a warning during worlddump.py. we should however clean this up at some point. your real error is https://zuul.opendev.org/t/openstack/build/b1ca9983e4214ee18664caf19ec1b320/log/job-output.txt#10922-10923 | 10:45 |
| *** vishalmanchanda has joined #openstack-qa | 10:49 | |
| sshnaidm | frickler, I see.. does it happen in other jobs? This should be a default devstack.. | 10:52 |
| *** yamamoto has joined #openstack-qa | 10:57 | |
| *** rcernin has quit IRC | 10:58 | |
| *** yamamoto has quit IRC | 11:03 | |
| yoctozepto | sshnaidm: whoa, it failed installing nova? | 11:11 |
| yoctozepto | not good | 11:11 |
| frickler | sshnaidm: well worlddump is only executed when devstack failed, so you don't see it regularly, but you should see that warning for every devstack failure | 11:12 |
| *** rcernin has joined #openstack-qa | 11:23 | |
| *** jpena is now known as jpena|lunch | 11:31 | |
| *** Roamer` has joined #openstack-qa | 11:47 | |
| *** artom has quit IRC | 11:48 | |
| *** rcernin has quit IRC | 11:55 | |
| *** rh-jelabarre has joined #openstack-qa | 12:19 | |
| *** HeroicHitesh has joined #openstack-qa | 12:21 | |
| *** jpena|lunch is now known as jpena | 12:33 | |
| *** rpittau|bbl is now known as rpittau | 12:37 | |
| *** rcernin has joined #openstack-qa | 12:42 | |
| *** rcernin has quit IRC | 12:46 | |
| *** HeroicHitesh has quit IRC | 12:50 | |
| johnsom | sshnaidm Many projects see that warning | 12:53 |
| *** paras333 has quit IRC | 12:58 | |
| *** HeroicHitesh has joined #openstack-qa | 13:00 | |
| *** whoami-rajat_ has joined #openstack-qa | 13:06 | |
| *** HeroicHitesh has quit IRC | 13:10 | |
| *** whoami-rajat_ is now known as whoami-rajat | 13:15 | |
| *** HeroicHitesh has joined #openstack-qa | 13:15 | |
| frickler | there even is a bug report for it, just needs someone to come up with a patch https://bugs.launchpad.net/devstack/+bug/1885198 | 13:23 |
| openstack | Launchpad bug 1885198 in devstack "table `broute' is incompatible, use 'nft' tool" [Undecided,New] | 13:23 |
| *** paras333 has joined #openstack-qa | 13:37 | |
| *** gcheresh has quit IRC | 13:38 | |
| *** vishalmanchanda has quit IRC | 13:39 | |
| *** vishalmanchanda has joined #openstack-qa | 13:47 | |
| *** artom has joined #openstack-qa | 13:49 | |
| *** pleia2 has left #openstack-qa | 13:52 | |
| *** gcheresh has joined #openstack-qa | 14:25 | |
| icey | The tempest default os_admin account can no longer list roles in keystone with scope errors. How to I fix that? Here is my tempest config: http://paste.ubuntu.com/p/V3xRjMBHD2/ | 14:38 |
| icey | I'm running into this on Ussuri | 14:38 |
| *** rcernin has joined #openstack-qa | 14:42 | |
| johnsom | I guess the question here is does non-dynamic tempest credentials support scopes? | 14:43 |
| icey | I can run manyh of the smoke tests successfully, but I'm failing to run `octavia_tempest_plugin.tests.scenario.v2.test_traffic_ops.TrafficOperationsScenarioTest` with 'You are not authorized to perform the requested action: identity:list_role_assignments.' | 14:44 |
| icey | if I'm reading the docs correctly, use_dynamic_credentials defaults to True | 14:45 |
| *** rcernin has quit IRC | 14:48 | |
| tosky | icey: you may try to ask to the octavia team, they maintain that test | 14:48 |
| tosky | please note this is the PTG week and many teams are busy in meetings | 14:49 |
| icey | tosky: I'm aware it's PTG week, and I've been bugging the octavia folks for the past few hours :) | 14:49 |
| icey | tosky: also, nearing my EoD so not really urgent | 14:49 |
| johnsom | Yeah, this isn't test related. It's os_admin can no longer list roles in keystone. | 14:52 |
| johnsom | It seems they have some overrides in tempest.conf for the admin credential and I think that is where os_admin is going wrong with the scopes stuff | 14:52 |
| icey | I'm generally happy to remove whatever overrides I can, as most of these were probably inherited / copy pasted through the yeaars | 14:53 |
| gmann | icey: HeroicHitesh you are using dynamic creds or pre-provisioned ? | 15:06 |
| gmann | johnsom: ^^ | 15:06 |
| icey | gmann: I've tried both | 15:06 |
| gmann | HeroicHitesh: please ignore | 15:06 |
| gmann | icey: dynamic cred should work. | 15:06 |
| icey | gmann: the pastebin above is the full tempest config | 15:06 |
| gmann | ok | 15:07 |
| icey | the only things configured in the auth section are admin_username, admin_password, and admin_domain_name in my latest try | 15:07 |
| gmann | icey: and what is your test 'credentials ' | 15:08 |
| gmann | credentials = [system_admin] ? | 15:08 |
| icey | don't seem to have that set | 15:09 |
| gmann | icey: ohk, you are running existing test or any new/modified one? | 15:09 |
| icey | existing | 15:10 |
| icey | gmann: I've got to drop, would love to continue this discussion, along with implementing any suggestions in the AM :) | 15:10 |
| gmann | icey: this one right? TrafficOperationsScenarioTest | 15:10 |
| icey | gmann: yeah | 15:11 |
| icey | I can run 89 other smoke tests as well but they don't hit this, for some reason | 15:11 |
| gmann | icey: sure, I will be available after first 4 hrs of PTG tomorrow so we can catch up that time. | 15:11 |
| icey | due to my child having a skinned knee, I suddenly have a few more minutes to work on this :-P | 15:12 |
| gmann | :) | 15:12 |
| icey | and, you say the first 4 hours tomorrow, do you mean the 04-07 UTC? | 15:13 |
| icey | or one of the latter times? | 15:13 |
| icey | where can I put in `credentials = [system_admin]` ? | 15:13 |
| gmann | icey: sorry 13:00 to 17: UTC http://ptg.openstack.org/ptg.html | 15:13 |
| gmann | icey: i can see it is here https://github.com/openstack/octavia-tempest-plugin/blob/67ecd6757dd62fda909428dce46815ae7584a1fd/octavia_tempest_plugin/tests/test_base.py#L74 | 15:14 |
| icey | gmann: yeah, I was just about to comment that I thought I recalled seeing it in a test somewhere, rather than in config | 15:14 |
| gmann | icey: and you have this enabled? CONF.enforce_scope.octavia: | 15:14 |
| gmann | i cannot see in your tempst conf | 15:14 |
| icey | gmann: and I'm generally offline by 17:00 UTC, as my wife would be upset with me working until 19:00 | 15:14 |
| icey | I don't have it set - I can try it and see if it works | 15:14 |
| gmann | icey: yeah, that config is needed and i am sure that should work | 15:15 |
| johnsom | It's not the test that is failing here, it is this line: https://github.com/openstack/octavia-tempest-plugin/blob/67ecd6757dd62fda909428dce46815ae7584a1fd/octavia_tempest_plugin/tests/test_base.py#L146 | 15:15 |
| johnsom | os_admin can't get a list of role assignments. The log showed a scope warning from what I saw | 15:15 |
| johnsom | For whatever reason, in that run os_admin no longer has access to that keystone API | 15:16 |
| gmann | ok, so no system scope in pic but keystone complain about scope check failure right? | 15:16 |
| gmann | do you have error msg link? | 15:17 |
| icey | same error when adding in the enforce_scope | 15:17 |
| johnsom | icey will have to answer, I don't have the full logs | 15:17 |
| icey | I have tons of logs - let me pastebin some keystone ones :) | 15:17 |
| gmann | is it happening in upstream gate? | 15:18 |
| icey | http://paste.ubuntu.com/p/JJzt53x6f6/ | 15:18 |
| icey | gmann: not that I know of | 15:18 |
| icey | gmann: I'm hitting it running tempest on Bionic with Ussuri from the cloud archive | 15:18 |
| gmann | icey: ok, can you check if you have [oslo_policy]enforce_scope set in kesytone.conf | 15:19 |
| johnsom | No, this does not occur for upstream gate or local runs. | 15:19 |
| gmann | i see | 15:19 |
| johnsom | That is why I think the [auth] overrides is the issue | 15:19 |
| gmann | from log it seems keystone is configured with scope enable | 15:19 |
| icey | keystone.conf does not include an oslo_policy section | 15:19 |
| gmann | that is why Tempest non system os_admin complain on role list | 15:20 |
| gmann | humm | 15:20 |
| gmann | is enforce_scope is false for service then oslo.policy just add warning for scope check and does not fail | 15:20 |
| gmann | s/is/if | 15:20 |
| gmann | i see, its warning only on scope thigs: (py.warnings): 2021-04-20 15:16:35,375 WARNING /usr/lib/python3/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:create_system_grant_for_user failed scope check. The token used to make the request was domain scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required | 15:21 |
| gmann | warnings.warn(msg) | 15:21 |
| gmann | icey: any other error you see in keystone log? | 15:21 |
| gmann | (keystone.server.flask.application): 2021-04-20 15:16:42,089 WARNING Could not find project: None. | 15:22 |
| icey | that's another interesting one - this last few errors are fomr the last tempest run where I just ran the single test | 15:23 |
| gmann | icey: you have admin project name as commented in your temest conf # admin_project_name = admin | 15:23 |
| gmann | so project Tempest pass to keystone is none | 15:23 |
| icey | gmann: it has the same error with it - I've been just commenting out stuff to se if it works | 15:23 |
| icey | I can re-add that line | 15:23 |
| gmann | yeah, we can see what erroe it give with correct project name | 15:24 |
| icey | still got the same three errors | 15:24 |
| gmann | can you please paste those | 15:25 |
| icey | http://paste.ubuntu.com/p/zkkbGDWrpv/ | 15:26 |
| *** dmellado has joined #openstack-qa | 15:26 | |
| icey | should I enable default_credentials_domain_name as well? | 15:27 |
| icey | rather, done that | 15:27 |
| icey | no change | 15:28 |
| icey | nor by enabling CONF.identity.admin_domain_scope | 15:30 |
| icey | for reference, my admin credentials do still work happily with the openstack CLi to do admin tasks | 15:31 |
| icey | mhm, I have two different `admin` projects, wonder if that's the issue | 15:33 |
| icey | heh - deleted one, and apparently it was the wrong one - I'll rebuild this cloud and keep digging in the morning | 15:34 |
| gmann | icey: ok | 15:35 |
| gmann | but issue is keystone get project as 'none' which should not be case | 15:35 |
| gmann | icey: these are min things we need in auth section https://zuul.opendev.org/t/openstack/build/c32b8ae5395843398939c05a05f1065d/log/controller/logs/tempest_conf.txt#42-45 | 15:38 |
| gmann | which you have in your tempest conf also | 15:38 |
| *** dmellado has quit IRC | 15:48 | |
| *** rcernin has joined #openstack-qa | 15:50 | |
| *** dmellado has joined #openstack-qa | 15:52 | |
| *** rcernin has quit IRC | 15:55 | |
| *** lucasagomes has quit IRC | 16:09 | |
| *** dmellado has quit IRC | 16:10 | |
| *** dmellado_ has joined #openstack-qa | 16:10 | |
| *** gcheresh has quit IRC | 16:11 | |
| *** dmellado_ is now known as dmellado | 16:11 | |
| *** HeroicHitesh has quit IRC | 16:26 | |
| *** paras333 has quit IRC | 16:35 | |
| openstackgerrit | Archit Modi proposed openstack/whitebox-tempest-plugin master: WIP: rbd direct download https://review.opendev.org/c/openstack/whitebox-tempest-plugin/+/786979 | 16:38 |
| openstackgerrit | Archit Modi proposed openstack/whitebox-tempest-plugin master: WIP: rbd direct download https://review.opendev.org/c/openstack/whitebox-tempest-plugin/+/786979 | 16:41 |
| *** hamalq has joined #openstack-qa | 16:45 | |
| *** hamalq has quit IRC | 16:47 | |
| *** hamalq has joined #openstack-qa | 16:48 | |
| *** gfidente is now known as gfidente|afk | 16:52 | |
| *** dviroel is now known as dviroel|lunch | 16:54 | |
| *** rpittau is now known as rpittau|afk | 16:59 | |
| *** jpena is now known as jpena|off | 17:08 | |
| *** ysandeep is now known as ysandeep|away | 17:20 | |
| *** eolivare has quit IRC | 17:22 | |
| *** lpiwowar has quit IRC | 17:23 | |
| *** ralonsoh has quit IRC | 17:31 | |
| openstackgerrit | Merged openstack/devstack-plugin-ceph stable/ussuri: Set RBD default features based on distro https://review.opendev.org/c/openstack/devstack-plugin-ceph/+/786784 | 17:39 |
| openstackgerrit | Radosław Piliszek proposed openstack/devstack-plugin-ceph stable/train: Set RBD default features based on distro https://review.opendev.org/c/openstack/devstack-plugin-ceph/+/786787 | 17:40 |
| *** dviroel|lunch is now known as dviroel | 17:44 | |
| *** brinzhang has quit IRC | 17:49 | |
| *** rcernin has joined #openstack-qa | 17:51 | |
| *** dtantsur is now known as dtantsur|afk | 17:52 | |
| *** rcernin has quit IRC | 17:56 | |
| *** iurygregory has quit IRC | 18:15 | |
| *** sboyron has quit IRC | 18:24 | |
| *** iurygregory has joined #openstack-qa | 18:33 | |
| *** ajitha has quit IRC | 18:56 | |
| *** vishalmanchanda has quit IRC | 19:09 | |
| *** slaweq has quit IRC | 19:16 | |
| *** slaweq has joined #openstack-qa | 19:18 | |
| openstackgerrit | Archit Modi proposed openstack/whitebox-tempest-plugin master: WIP: rbd direct download https://review.opendev.org/c/openstack/whitebox-tempest-plugin/+/786979 | 19:21 |
| yoctozepto | zbr ++ for cleaning the hacking review queue | 19:23 |
| yoctozepto | you beat me to it :-) | 19:23 |
| *** lbragstad has quit IRC | 19:26 | |
| *** gcheresh has joined #openstack-qa | 19:34 | |
| *** paras333_ has joined #openstack-qa | 19:39 | |
| *** slaweq has quit IRC | 19:42 | |
| *** rcernin has joined #openstack-qa | 19:45 | |
| *** lbragstad has joined #openstack-qa | 19:49 | |
| *** gcheresh has quit IRC | 19:55 | |
| *** dviroel is now known as dviroel|afk | 20:01 | |
| *** lbragstad has quit IRC | 20:20 | |
| *** slaweq has joined #openstack-qa | 20:35 | |
| *** lbragstad has joined #openstack-qa | 20:36 | |
| openstackgerrit | Merged openstack/devstack-plugin-ceph stable/train: Set RBD default features based on distro https://review.opendev.org/c/openstack/devstack-plugin-ceph/+/786787 | 20:45 |
| *** rcernin has quit IRC | 20:48 | |
| *** paras333_ has quit IRC | 20:50 | |
| *** slaweq has quit IRC | 20:52 | |
| *** dviroel|afk is now known as dviroel | 20:53 | |
| *** rcernin has joined #openstack-qa | 21:30 | |
| *** paras333 has joined #openstack-qa | 21:34 | |
| *** rcernin has quit IRC | 21:38 | |
| *** paras333 has quit IRC | 21:39 | |
| *** whoami-rajat has quit IRC | 21:46 | |
| *** yamamoto has joined #openstack-qa | 22:01 | |
| *** yamamoto has quit IRC | 22:15 | |
| *** yamamoto has joined #openstack-qa | 22:16 | |
| *** rcernin has joined #openstack-qa | 22:21 | |
| *** amodi has quit IRC | 22:22 | |
| *** rcernin has quit IRC | 22:26 | |
| *** rcernin has joined #openstack-qa | 22:39 | |
| *** rcernin has quit IRC | 22:44 | |
| *** rcernin has joined #openstack-qa | 22:46 | |
| *** rcernin has quit IRC | 22:53 | |
| *** rcernin has joined #openstack-qa | 22:53 | |
| openstackgerrit | Merged openstack/tempest master: Add waiter for test_live_migration_with_trunk https://review.opendev.org/c/openstack/tempest/+/786465 | 23:17 |
| *** tosky has quit IRC | 23:17 | |
| *** rh-jlabarre has joined #openstack-qa | 23:45 | |
| *** rh-jelabarre has quit IRC | 23:47 | |
| *** rh-jlabarre has quit IRC | 23:50 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!