| *** rh-jelabarre has quit IRC | 00:07 | |
| *** rh-jelabarre has joined #openstack-qa | 00:08 | |
| *** rh-jelabarre has quit IRC | 00:12 | |
| *** slaweq has joined #openstack-qa | 00:14 | |
| *** markvoelker has joined #openstack-qa | 00:16 | |
| *** hongbin has joined #openstack-qa | 00:18 | |
| *** slaweq has quit IRC | 00:25 | |
| *** markvoelker has quit IRC | 00:49 | |
| *** slaweq has joined #openstack-qa | 01:11 | |
| *** slaweq has quit IRC | 01:25 | |
| *** hongbin has quit IRC | 01:39 | |
| *** hongbin has joined #openstack-qa | 01:41 | |
| *** hongbin_ has joined #openstack-qa | 01:45 | |
| *** hongbin has quit IRC | 01:45 | |
| *** markvoelker has joined #openstack-qa | 01:46 | |
| *** rh-jelabarre has joined #openstack-qa | 02:08 | |
| *** slaweq has joined #openstack-qa | 02:16 | |
| *** markvoelker has quit IRC | 02:19 | |
| *** slaweq has quit IRC | 02:24 | |
| *** slaweq has joined #openstack-qa | 03:14 | |
| *** vegasq has joined #openstack-qa | 03:16 | |
| *** markvoelker has joined #openstack-qa | 03:16 | |
| *** slaweq has quit IRC | 03:24 | |
| *** ramishra has joined #openstack-qa | 03:41 | |
| *** vegasq has quit IRC | 03:43 | |
| *** markvoelker has quit IRC | 03:48 | |
| *** slaweq has joined #openstack-qa | 04:16 | |
| *** ank_ has joined #openstack-qa | 04:20 | |
| *** slaweq has quit IRC | 04:24 | |
| *** ramishra has quit IRC | 04:59 | |
| *** rh-jelabarre has quit IRC | 05:04 | |
| *** ramishra has joined #openstack-qa | 05:07 | |
| *** slaweq has joined #openstack-qa | 05:15 | |
| *** Luzi has joined #openstack-qa | 05:19 | |
| *** slaweq has quit IRC | 05:24 | |
| *** spsurya has joined #openstack-qa | 05:41 | |
| *** ramishra_ has joined #openstack-qa | 05:48 | |
| *** ramishra has quit IRC | 05:51 | |
| *** sridharg has joined #openstack-qa | 06:02 | |
| *** markvoelker has joined #openstack-qa | 06:16 | |
| *** aojea has joined #openstack-qa | 06:17 | |
| *** aojea has quit IRC | 06:22 | |
| *** hongbin has joined #openstack-qa | 06:25 | |
| *** hongbin has quit IRC | 06:25 | |
| *** hongbin_ has quit IRC | 06:27 | |
| *** ekcs has joined #openstack-qa | 06:41 | |
| *** bdperkin has quit IRC | 06:42 | |
| *** adrianreza has quit IRC | 06:42 | |
| *** johnsom has quit IRC | 06:42 | |
| *** icey has quit IRC | 06:42 | |
| *** johnsom has joined #openstack-qa | 06:42 | |
| *** icey has joined #openstack-qa | 06:43 | |
| *** adrianreza has joined #openstack-qa | 06:43 | |
| *** ccamposr has joined #openstack-qa | 06:47 | |
| *** ccamposr__ has joined #openstack-qa | 06:48 | |
| *** markvoelker has quit IRC | 06:48 | |
| *** ramishra_ has quit IRC | 06:50 | |
| *** ccamposr has quit IRC | 06:51 | |
| *** ramishra has joined #openstack-qa | 06:59 | |
| *** rcernin has quit IRC | 07:00 | |
| *** larainema has quit IRC | 07:02 | |
| *** slaweq has joined #openstack-qa | 07:43 | |
| *** markvoelker has joined #openstack-qa | 07:46 | |
| *** kopecmartin|off is now known as kopecmartin | 07:47 | |
| *** rpittau has joined #openstack-qa | 07:54 | |
| *** gcheresh has joined #openstack-qa | 07:57 | |
| *** e0ne has joined #openstack-qa | 08:02 | |
| *** ramishra has quit IRC | 08:03 | |
| *** ramishra has joined #openstack-qa | 08:09 | |
| *** aojea has joined #openstack-qa | 08:10 | |
| *** markvoelker has quit IRC | 08:19 | |
| *** e0ne has quit IRC | 08:24 | |
| *** iurygregory has joined #openstack-qa | 08:31 | |
| *** gkadam has joined #openstack-qa | 08:34 | |
| *** tosky has joined #openstack-qa | 08:36 | |
| *** gfidente has joined #openstack-qa | 08:48 | |
| *** jpena|off is now known as jpena | 09:03 | |
| *** markvoelker has joined #openstack-qa | 09:16 | |
| *** shardy has joined #openstack-qa | 09:24 | |
| *** ramishra has quit IRC | 09:38 | |
| *** ramishra has joined #openstack-qa | 09:40 | |
| *** markvoelker has quit IRC | 09:49 | |
| *** dtantsur|afk is now known as dtantsur | 09:57 | |
| *** e0ne has joined #openstack-qa | 10:13 | |
| *** openstackgerrit has quit IRC | 10:21 | |
| *** MrRon has joined #openstack-qa | 10:39 | |
| MrRon | Hello together. | 10:39 |
|---|---|---|
| MrRon | gmann: are you out there ? | 10:40 |
| MrRon | gmann: I read your answer to my question regarding tempest regex on http://eavesdrop.openstack.org/irclogs/%23openstack-qa/%23openstack-qa.2019-01-17.log.html. | 10:40 |
| gmann | MrRon: hi | 10:41 |
| gmann | MrRon: that worked ? | 10:41 |
| MrRon | gmann: I tried right now without .api as regex, but needed to add black-regex to skip scenario tests. | 10:41 |
| *** ramishra has quit IRC | 10:41 | |
| MrRon | gmann: unfortunately, not | 10:41 |
| *** ramishra has joined #openstack-qa | 10:41 | |
| MrRon | gmann: The command is now: tempest run --regex neutron_tempest_plugin --black-regex scenario -w 4 but still only 231 tests ran, out of 500+ | 10:42 |
| gmann | 500+ test you mean only in neutron_tempest_plugin ? | 10:43 |
| MrRon | 500+ in neutron_tempest_plugin.api, yes | 10:43 |
| MrRon | you can check with tempest run -l | grep neutron_tempest_plugin.api | wc | 10:44 |
| MrRon | 553 tests | 10:45 |
| MrRon | but my tempest run command only runs the mentioned 231...somehow. and I don't get it right now why | 10:45 |
| gmann | MrRon: try this, it should work ^neutron_tempest_plugin\.api | 10:45 |
| MrRon | gmann: OK. I'll try | 10:46 |
| *** markvoelker has joined #openstack-qa | 10:46 | |
| MrRon | gmann: test is running. I'll know in a few minutes :) | 10:48 |
| gmann | MrRon: sure | 10:54 |
| *** markvoelker has quit IRC | 11:19 | |
| MrRon | gmann: Now tempest runs 278 tests, but still not the number which I expect :). | 11:19 |
| gmann | MrRon: humm it should run all API tests. same is running on gate | 11:24 |
| gmann | can you check number of skip tests and reason | 11:24 |
| *** aojea_ has joined #openstack-qa | 11:32 | |
| *** ank_ has quit IRC | 11:40 | |
| MrRon | gmann: only 15 tests are skipped, most of them because I disabled IPv6 tests. | 11:53 |
| gmann | MrRon: humm, this is same regex run in api test job - http://logs.openstack.org/78/630778/1/check/neutron-tempest-plugin-api/f6e44a3/testr_results.html.gz | 11:55 |
| MrRon | gmann: that html report looks nice. I'll run tempest again with subunit to check again which tests are not running. btw: should I quote the regex ? | 11:59 |
| gmann | MrRon: u can try, this is what job use - tempest run --regex '^neutron_tempest_plugin\.api' | 12:04 |
| MrRon | gmann: thanks I'll try | 12:05 |
| *** markvoelker has joined #openstack-qa | 12:16 | |
| *** aojea_ has quit IRC | 12:26 | |
| *** rh-jelabarre has joined #openstack-qa | 12:29 | |
| *** markvoelker has quit IRC | 12:49 | |
| MrRon | gmann: weird. still all the same result. I got only 279 tests.mmh | 13:02 |
| MrRon | I try now with -w 1 to check if it has something to do with concurrency | 13:04 |
| MrRon | (I provided a list of seeded users) | 13:04 |
| MrRon | gmann: my gut feeling says that it has something to do with the concurrency, because I see in your html report that neutron_tempest_plugin.api.admin.test_external_network_extension has 12 tests passed and in my case an fail of 1 with the setupclass: Insufficient number of users provided. TagFilterNetworkTestJSON have allocated all the credentials for this allocation request | 13:12 |
| MrRon | The same is for some non-admin tests | 13:14 |
| MrRon | gmann: Do you run the tests serially or parallel ? | 13:14 |
| gmann | MrRon: parallel. on that job we run with concurrency 4 | 13:32 |
| MrRon | gmann: And I believe you run it with dynamic_credentials = true ? | 13:36 |
| gmann | yes | 13:36 |
| gmann | MrRon: but if you have insufficient cred in account.yaml then, it should fail instead of not picking the tests | 13:37 |
| MrRon | gmann: Yes, it fails with a count of 1 for the test class because setUpClass is failing, all the subtests are not performed then and not counted in | 13:38 |
| MrRon | gmann: I thought 8 users and 1 admin would be enough for the account.yaml, seems that it is still not enough | 13:38 |
| MrRon | gmann: for example neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest has 20 tests, but on my html report I see only 1, and that is the setUpClass fail | 13:39 |
| MrRon | This applies to many other tests it seems | 13:40 |
| MrRon | Right now I run with concurrency = 1, I'll see that is the result :) | 13:40 |
| gmann | MrRon: ok so that explain. test are failing in setUpClass | 13:49 |
| MrRon | gmann: Indeed, the number is rising to 428 now | 13:49 |
| gmann | MrRon: FYI, all tests in same class always being run under same user and serially | 13:50 |
| MrRon | gmann: Yes, I saw that in the docu today | 13:50 |
| MrRon | gmann: So either I changed to dynamic_creds or add more users. But I have no idea how much. I thought the docu said 2 times more of workers you wanna use. So in my case 4 workers x2 = 8 users | 13:52 |
| frickler | MrRon: I think you'd also need 8 admin users, since admin-needing tests may as well run in parallel | 13:54 |
| frickler | there's also some tests that don't work at all with pre-provisioned creds | 13:54 |
| gmann | yeah but those should be in skip list. | 13:58 |
| gmann | MrRon what is the error u get in setUpClass fail ? | 13:59 |
| MrRon | The error is tempest.lib.exceptions.InvalidCredentials: Invalid Credentials Details: Insufficient number of users provided. TagFilterNetworkTestJSON have allocated all the credentials for this allocation request | 13:59 |
| MrRon | That is the error for an admin test | 13:59 |
| MrRon | the same error occours also for some non-admin test cases | 14:00 |
| MrRon | frickler: Yes you are right, I read something in the docu that 1 admin per 2 users should be pre-provisioned, eventually I need that, but it's weird that the same error comes up with non-admin users and I have pre-provisioned 8 users | 14:01 |
| *** mriedem has joined #openstack-qa | 14:02 | |
| gmann | MrRon: did you try with concurrency 2 or 1 | 14:05 |
| MrRon | Yes, the count went up to 428, which is already better | 14:07 |
| MrRon | I tried with concurrency = 1 | 14:07 |
| MrRon | Eventually I will use that, it takes longer but it is more safe | 14:08 |
| gmann | yeah that make more test to run serially | 14:08 |
| MrRon | can I somehow check afterwards which users were really used? | 14:09 |
| MrRon | I mean I can grep in the logs I think.... | 14:09 |
| gmann | MrRon: you need to increase the cred for all ~500 test run in parallel per test class. in our gate job we use 17 users + 7 admin for total ~1200 tests | 14:10 |
| MrRon | gmann: oha :). ok. I understand. | 14:11 |
| gmann | MrRon: you can check logs with string "allocated creds:" and "returned allocated creds:" | 14:12 |
| MrRon | gmann: I checked already with tempest verify-config and I see only 1 user: 2019-01-21 14:05:18.053 133 INFO tempest.lib.common.preprov_creds [-] verify_tempest_config allocated creds: {'username': 'neutron-tempestuser4', 'project_name': 'neutron-tempest4', 'domain_name': 'tempest'} | 14:13 |
| MrRon | gmann: I think it should return all of my 8 users, right ? | 14:14 |
| *** openstackgerrit has joined #openstack-qa | 14:14 | |
| openstackgerrit | Matt Riedemann proposed openstack-dev/devstack stable/rocky: Restrict database access to nova-compute in singleconductor mode https://review.openstack.org/632095 | 14:14 |
| gmann | MrRon: no, verify_tempest_config only use single primary cred to check the config things | 14:19 |
| gmann | MrRon: you can check tempest.log after you run tests, that can give all of your cred are used and before any test returned the cred other test requested one | 14:20 |
| *** Luzi has quit IRC | 14:26 | |
| openstackgerrit | Matt Riedemann proposed openstack-dev/devstack stable/queens: Restrict database access to nova-compute in singleconductor mode https://review.openstack.org/632100 | 14:28 |
| *** mvkr has quit IRC | 14:33 | |
| *** e0ne has quit IRC | 14:36 | |
| *** e0ne has joined #openstack-qa | 14:41 | |
| *** kmalloc has joined #openstack-qa | 14:44 | |
| MrRon | gmann: yes you are right. most of my 8 users are used. | 14:44 |
| *** shardy has quit IRC | 14:46 | |
| *** shardy has joined #openstack-qa | 14:46 | |
| MrRon | gmann: OK. to sumarize. I know now why the tests are not counted fully. I have trouble with my pre creds. I can add more or run serial. | 14:47 |
| MrRon | gmann: I thank you very much for your help! | 14:47 |
| gmann | MrRon: ok. i think you can increase the users then. or divide the run with more small number of tests using regex. | 14:47 |
| gmann | MrRon: np! | 14:47 |
| MrRon | gmann: Have a nice day :) | 14:48 |
| MrRon | see u later | 14:48 |
| gmann | MrRon: you too. its night for me here :) | 14:48 |
| MrRon | gmann: oh. then have a good night :) | 14:49 |
| gmann | :) | 14:49 |
| MrRon | gmann: where are you from? I'm from europe. | 14:50 |
| gmann | I am based on Tokyo currently | 14:50 |
| MrRon | oha. sounds interesting. I wasn't there yet. Big city. greetings from Berlin... | 14:51 |
| gmann | thanks. you should visit then :) | 14:53 |
| *** dave-mccowan has joined #openstack-qa | 14:55 | |
| openstackgerrit | Lee Yarwood proposed openstack/tempest master: Add SCSI rescan and lsblk output https://review.openstack.org/631257 | 14:56 |
| *** iurygregory is now known as iury|brb | 14:59 | |
| *** iury|brb is now known as iurygregory | 15:03 | |
| *** vegasq has joined #openstack-qa | 15:04 | |
| *** dave-mccowan has quit IRC | 15:12 | |
| *** vegasq_ has joined #openstack-qa | 15:17 | |
| *** vegasq has quit IRC | 15:20 | |
| *** agurenko has joined #openstack-qa | 15:31 | |
| *** mriedem has quit IRC | 15:32 | |
| *** agurenko has quit IRC | 15:39 | |
| *** temka has quit IRC | 15:50 | |
| *** whoami-rajat has quit IRC | 15:55 | |
| *** mriedem has joined #openstack-qa | 15:57 | |
| *** gcheresh has quit IRC | 15:58 | |
| openstackgerrit | Nicolas Helgeson proposed openstack/tempest master: Current naming convention is uninformative. https://review.openstack.org/631076 | 16:19 |
| *** ramishra has quit IRC | 16:24 | |
| *** gcheresh has joined #openstack-qa | 16:40 | |
| *** whoami-rajat has joined #openstack-qa | 16:41 | |
| *** gkadam has quit IRC | 16:45 | |
| *** sridharg has quit IRC | 16:49 | |
| openstackgerrit | Merged openstack/tempest master: Check network connectivity of the instance before and after live migration https://review.openstack.org/534250 | 16:50 |
| openstackgerrit | Merged openstack-dev/devstack master: Restrict database access to nova-compute in singleconductor mode https://review.openstack.org/631811 | 16:50 |
| *** ccamposr__ has quit IRC | 16:53 | |
| *** gcheresh has quit IRC | 16:55 | |
| *** e0ne has quit IRC | 16:58 | |
| *** rpittau has quit IRC | 16:59 | |
| *** aojea has quit IRC | 17:00 | |
| *** shardy has quit IRC | 17:15 | |
| *** dtantsur is now known as dtantsur|afk | 17:16 | |
| *** shardy has joined #openstack-qa | 17:17 | |
| *** kopecmartin is now known as kopecmartin|off | 17:21 | |
| *** shardy has quit IRC | 17:25 | |
| *** shardy has joined #openstack-qa | 17:25 | |
| *** dulek has joined #openstack-qa | 17:25 | |
| dulek | Hey, I could use some reviews on https://review.openstack.org/#/c/626885/ - it's making it possible to deploy etcd3 with ramdisk for etcd data. | 17:26 |
| dulek | We need that to increase reliability when running K8s with that etcd on Kuryr-Kubernetes gates. | 17:26 |
| MrRon | gmann: fyi. I fixed it with more users and admins. Seems that 3 more admins made the thing. 1 per concurrency then I believe :) | 17:29 |
| *** MrRon has quit IRC | 17:29 | |
| *** vegasq_ has quit IRC | 17:50 | |
| *** mriedem has quit IRC | 17:50 | |
| *** vegasq has joined #openstack-qa | 17:50 | |
| *** gfidente has quit IRC | 17:51 | |
| *** vegasq_ has joined #openstack-qa | 17:53 | |
| *** vegasq has quit IRC | 17:55 | |
| *** shardy has quit IRC | 18:05 | |
| *** artom has joined #openstack-qa | 18:05 | |
| *** openstackgerrit has quit IRC | 18:07 | |
| *** ccamposr has joined #openstack-qa | 18:09 | |
| *** jpena is now known as jpena|off | 18:13 | |
| *** markvoelker has joined #openstack-qa | 18:16 | |
| *** ccamposr has quit IRC | 18:30 | |
| *** bdperkin has joined #openstack-qa | 18:38 | |
| *** markvoelker has quit IRC | 18:50 | |
| *** mvkr has joined #openstack-qa | 18:56 | |
| -openstackstatus- NOTICE: The error causing post failures on jobs has been corrected. It is safe to recheck these jobs. | 19:17 | |
| *** rh-jelabarre has quit IRC | 19:31 | |
| *** openstackgerrit has joined #openstack-qa | 19:32 | |
| openstackgerrit | Nicolas Helgeson proposed openstack/tempest master: Current naming convention is uninformative. https://review.openstack.org/631076 | 19:32 |
| *** mriedem has joined #openstack-qa | 19:35 | |
| *** aojea has joined #openstack-qa | 19:38 | |
| *** aojea has quit IRC | 19:38 | |
| *** aojea has joined #openstack-qa | 19:39 | |
| *** markvoelker has joined #openstack-qa | 19:46 | |
| openstackgerrit | Trevor McCasland proposed openstack/tempest master: Ensure volume is deleted after build error https://review.openstack.org/632153 | 19:49 |
| *** rh-jelabarre has joined #openstack-qa | 19:50 | |
| *** aojea has quit IRC | 20:10 | |
| *** whoami-rajat has quit IRC | 20:15 | |
| *** bdperkin has quit IRC | 20:19 | |
| *** markvoelker has quit IRC | 20:20 | |
| *** ianw is now known as ianw_pto | 20:26 | |
| *** rh-jelabarre has quit IRC | 20:33 | |
| *** rh-jelabarre has joined #openstack-qa | 20:36 | |
| *** e0ne has joined #openstack-qa | 20:57 | |
| openstackgerrit | Trevor McCasland proposed openstack/tempest master: Ensure volume is deleted after build error https://review.openstack.org/632153 | 21:01 |
| *** aojea has joined #openstack-qa | 21:02 | |
| *** ssbarnea|bkp2 has joined #openstack-qa | 21:17 | |
| *** markvoelker has joined #openstack-qa | 21:17 | |
| *** ssbarnea|rover has quit IRC | 21:18 | |
| *** markvoelker has quit IRC | 21:49 | |
| *** e0ne has quit IRC | 21:51 | |
| *** rcernin has joined #openstack-qa | 21:54 | |
| *** markvoelker has joined #openstack-qa | 22:08 | |
| *** spsurya has quit IRC | 22:09 | |
| *** aojea has quit IRC | 22:36 | |
| *** mriedem has quit IRC | 22:51 | |
| *** e0ne has joined #openstack-qa | 23:34 | |
| *** slaweq has quit IRC | 23:35 | |
| *** e0ne has quit IRC | 23:39 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!