| rm_work | I believe this change just broke my testing, and I'm trying to figure out why: https://review.openstack.org/#/c/504345/ | 00:06 |
|---|---|---|
| rm_work | Tests I was running about an hour ago (before it merged) were passing, now all fail with: 'TempestRun' object has no attribute '_create_stestrepository' | 00:06 |
| rm_work | like, the failure is before anything can even start | 00:07 |
| openstackgerrit | Andrea Frittoli proposed openstack-dev/devstack master: Orchestrate run-devstack for multinode https://review.openstack.org/528074 | 00:08 |
| openstackgerrit | Andrea Frittoli proposed openstack-dev/devstack master: Add multinode extra settings in devstack conf https://review.openstack.org/545696 | 00:08 |
| *** yamamoto has joined #openstack-qa | 00:08 | |
| openstackgerrit | Andrea Frittoli proposed openstack/tempest master: Write tempest-multinode-full as zuulv3 native https://review.openstack.org/545724 | 00:09 |
| rm_work | seems obvious from the commit | 00:13 |
| rm_work | the function is still called (line 164) but ... isn't there | 00:14 |
| *** yamamoto has quit IRC | 00:14 | |
| *** lbragstad has quit IRC | 00:18 | |
| *** tosky has quit IRC | 00:21 | |
| *** fnaval has joined #openstack-qa | 00:23 | |
| rm_work | chandankumar: ^^ | 00:24 |
| rm_work | masayukig: ^^ | 00:24 |
| rm_work | andreaf: ^^ | 00:27 |
| mtreinish | rm_work: push a patch removing that function call. You don't need to manually call stestr init, so it just got missed. We probably should also add a unit test covering that if branch because clearly we don't have any coverage there | 00:31 |
| *** dmellado has joined #openstack-qa | 00:33 | |
| rm_work | mtreinish: like so? | 00:35 |
| openstackgerrit | Adam Harwell proposed openstack/tempest master: Remove leftover call to _create_stestrrepository https://review.openstack.org/546822 | 00:35 |
| openstackgerrit | Adam Harwell proposed openstack/tempest master: Remove leftover call to _create_stestrepository https://review.openstack.org/546822 | 00:36 |
| mnaser | grenade is failing in stable/queens which is blocking entire nova gate. https://review.openstack.org/#/c/546828/ is a backported proposed fix | 00:45 |
| gmann_ | andreaf: +A | 00:46 |
| openstackgerrit | Mohammed Naser proposed openstack-dev/grenade stable/pike: Handle a stestr results directory https://review.openstack.org/546831 | 00:46 |
| openstackgerrit | Mohammed Naser proposed openstack-dev/grenade stable/ocata: Handle a stestr results directory https://review.openstack.org/546832 | 00:46 |
| openstackgerrit | Mohammed Naser proposed openstack-dev/grenade stable/newton: Handle a stestr results directory https://review.openstack.org/546833 | 00:46 |
| mnaser | https://review.openstack.org/#/q/Ic1fa3a98b6bcd151c489b078028687892655a19b if possible :) | 00:46 |
| *** d0ugal has quit IRC | 00:47 | |
| mnaser | http://logs.openstack.org/00/546200/2/gate/neutron-grenade/dbcbf60/logs/grenade.sh.txt.gz (look at failure at end, WARNING long file) | 00:47 |
| mnaser | mtreinish: thank you | 00:51 |
| melwitt | dtroyer: hey, looking for grenade core review this change that's blocking us from getting our rc3 squared away https://review.openstack.org/#/c/546828/ if you could please take a look | 00:56 |
| melwitt | (it's a backport to queens) | 00:56 |
| *** d0ugal has joined #openstack-qa | 00:58 | |
| *** stevebaker has joined #openstack-qa | 01:03 | |
| *** yamamoto has joined #openstack-qa | 01:10 | |
| *** yamamoto has quit IRC | 01:16 | |
| mtreinish | melwitt: I gave it the fast +A | 01:25 |
| mtreinish | rm_work: +2 | 01:26 |
| rm_work | yeah just saw, thanks | 01:26 |
| rm_work | right now i just forced my test automation to pull the SHA before it merged | 01:27 |
| mtreinish | rm_work: I'll +A it when the gate comes back, unless someone beats me to it | 01:27 |
| mtreinish | melwitt: fwiw, you can always poke dansmith for grenade reviews too :) | 01:28 |
| *** kiennt26 has joined #openstack-qa | 01:31 | |
| *** yangyapeng has quit IRC | 01:33 | |
| *** yangyapeng has joined #openstack-qa | 01:33 | |
| *** slaweq has quit IRC | 01:34 | |
| *** slaweq has joined #openstack-qa | 01:35 | |
| *** esberglu has quit IRC | 01:35 | |
| *** yangyapeng has quit IRC | 01:38 | |
| *** slaweq has quit IRC | 01:39 | |
| *** pzchen has joined #openstack-qa | 01:40 | |
| *** Kevin_Zheng has joined #openstack-qa | 01:40 | |
| *** salv-orlando has joined #openstack-qa | 01:41 | |
| *** salv-orlando has quit IRC | 01:46 | |
| *** lbragstad has joined #openstack-qa | 01:56 | |
| melwitt | mtreinish: yeah, I did after trying dtroyer but he's off for the day. so thanks :) | 02:09 |
| *** yamamoto has joined #openstack-qa | 02:12 | |
| *** yamamoto has quit IRC | 02:18 | |
| *** dave-mccowan has joined #openstack-qa | 02:27 | |
| *** zhongjun has joined #openstack-qa | 02:27 | |
| openstackgerrit | Liang Hao proposed openstack/tempest master: Move share code to _create_server_with_group https://review.openstack.org/544192 | 02:29 |
| *** mriedem has quit IRC | 02:32 | |
| *** dave-mccowan has quit IRC | 02:58 | |
| openstackgerrit | Liang Hao proposed openstack/tempest master: Move share code to _create_server_with_group https://review.openstack.org/544192 | 03:02 |
| *** lbragstad has quit IRC | 03:04 | |
| *** yamamoto has joined #openstack-qa | 03:14 | |
| *** ramishra has joined #openstack-qa | 03:19 | |
| *** yamamoto has quit IRC | 03:20 | |
| *** mriedem has joined #openstack-qa | 03:23 | |
| openstackgerrit | Liang Hao proposed openstack/tempest master: Move share code to _create_server_with_group https://review.openstack.org/544192 | 03:26 |
| openstackgerrit | Merged openstack-dev/devstack master: Make the apache-logs-conf role even less verbose https://review.openstack.org/546747 | 03:27 |
| openstackgerrit | Merged openstack-dev/devstack master: Suppress more stats tasks https://review.openstack.org/546779 | 03:27 |
| *** yamamoto has joined #openstack-qa | 03:37 | |
| *** dave-mccowan has joined #openstack-qa | 03:38 | |
| *** ramishra has quit IRC | 03:41 | |
| *** salv-orlando has joined #openstack-qa | 03:43 | |
| *** ramishra has joined #openstack-qa | 03:43 | |
| *** salv-orlando has quit IRC | 03:49 | |
| openstackgerrit | Merged openstack/tempest master: Enable tempest-full on stable/pike https://review.openstack.org/546196 | 03:57 |
| openstackgerrit | Merged openstack-dev/grenade stable/pike: Handle a stestr results directory https://review.openstack.org/546831 | 03:57 |
| *** mriedem has quit IRC | 03:57 | |
| *** slaweq has joined #openstack-qa | 03:59 | |
| *** d0ugal has quit IRC | 04:00 | |
| *** gkadam has quit IRC | 04:01 | |
| *** gkadam has joined #openstack-qa | 04:02 | |
| *** slaweq has quit IRC | 04:04 | |
| *** dave-mccowan has quit IRC | 04:09 | |
| *** d0ugal has joined #openstack-qa | 04:27 | |
| *** gkadam has quit IRC | 04:41 | |
| *** salv-orlando has joined #openstack-qa | 04:45 | |
| *** salv-orlando has quit IRC | 04:49 | |
| *** gkadam has joined #openstack-qa | 04:51 | |
| *** pgadiya has joined #openstack-qa | 04:53 | |
| *** sridharg has joined #openstack-qa | 04:58 | |
| *** rosmaita has quit IRC | 05:06 | |
| *** slaweq has joined #openstack-qa | 05:25 | |
| *** slaweq has quit IRC | 05:30 | |
| openstackgerrit | Jens Harbott (frickler) proposed openstack-infra/devstack-gate master: Add neutron-tempest-plugin-api job https://review.openstack.org/529000 | 05:37 |
| *** salv-orlando has joined #openstack-qa | 05:45 | |
| *** salv-orlando has quit IRC | 05:50 | |
| *** jogo has quit IRC | 06:03 | |
| *** cloud-liang has joined #openstack-qa | 06:14 | |
| *** salv-orlando has joined #openstack-qa | 06:19 | |
| *** slaweq has joined #openstack-qa | 06:27 | |
| *** slaweq has quit IRC | 06:31 | |
| *** gcheresh_ has joined #openstack-qa | 06:32 | |
| *** gcheresh has joined #openstack-qa | 06:37 | |
| *** gcheresh_ has quit IRC | 06:37 | |
| *** alexchadin has joined #openstack-qa | 06:41 | |
| *** salv-orlando has quit IRC | 06:51 | |
| *** salv-orlando has joined #openstack-qa | 06:51 | |
| *** salv-orlando has quit IRC | 06:56 | |
| *** jogo has joined #openstack-qa | 07:00 | |
| *** mardim has joined #openstack-qa | 07:03 | |
| *** Alex_Staf has quit IRC | 07:06 | |
| *** lkuchlan has joined #openstack-qa | 07:08 | |
| *** rcernin has quit IRC | 07:20 | |
| chandankumar | gmann_: andreaf masayukig I will be not available during meeting | 07:22 |
| *** itzikb has joined #openstack-qa | 07:25 | |
| *** snapiri1 has joined #openstack-qa | 07:28 | |
| gmann_ | chandankumar: ok | 07:34 |
| *** snapiri1 is now known as snapiri- | 07:35 | |
| *** pcaruana has joined #openstack-qa | 07:37 | |
| *** john51 has quit IRC | 07:39 | |
| *** slaweq_ has joined #openstack-qa | 07:47 | |
| *** armaan has quit IRC | 07:48 | |
| *** armaan has joined #openstack-qa | 07:48 | |
| andreaf | gmann_ I might be able to join the meeting for a bit but I will be on and off | 07:49 |
| gmann_ | andreaf: ok | 07:49 |
| *** salv-orlando has joined #openstack-qa | 07:52 | |
| *** slaweq_ has quit IRC | 07:52 | |
| openstackgerrit | Ghanshyam Mann proposed openstack/tempest master: Add releasenotes to mark the start of Rocky support https://review.openstack.org/546903 | 07:53 |
| *** salv-orlando has quit IRC | 07:56 | |
| *** ragiman has joined #openstack-qa | 07:57 | |
| openstackgerrit | Masayuki Igawa proposed openstack/tempest master: Add unit test for tempest run --config-file https://review.openstack.org/546905 | 07:58 |
| *** slaweq_ has joined #openstack-qa | 08:00 | |
| * gmann_ QA meeting time | 08:00 | |
| *** slaweq_ has quit IRC | 08:04 | |
| masayukig | chandankumar: mtreinish rm_work gmann_ I just added a unit test as a first step. I think we should have more unit tests, though. https://review.openstack.org/546905 | 08:05 |
| rm_work | yeah, probably need some | 08:05 |
| rm_work | mine is already +A, we'll see if it even makes it through the gates | 08:06 |
| *** fnaval has quit IRC | 08:11 | |
| *** fnaval has joined #openstack-qa | 08:12 | |
| *** fnaval has quit IRC | 08:17 | |
| *** tesseract has joined #openstack-qa | 08:18 | |
| *** janzian has quit IRC | 08:21 | |
| masayukig | rm_work: yeah, I know I rechecked it some times, though... | 08:24 |
| *** Alex_Staf has joined #openstack-qa | 08:25 | |
| rm_work | しょうがないね | 08:26 |
| rm_work | maybe soon :) | 08:26 |
| *** slaweq_ has joined #openstack-qa | 08:28 | |
| *** rossella_s has joined #openstack-qa | 08:31 | |
| *** kopecmartin has joined #openstack-qa | 08:34 | |
| *** gfidente has joined #openstack-qa | 08:36 | |
| masayukig | rm_work: そうだね :) | 08:36 |
| *** sshwarts has joined #openstack-qa | 08:38 | |
| *** gcheresh_ has joined #openstack-qa | 08:41 | |
| masayukig | gmann_: when is your flight for Dublin? Saturday? | 08:44 |
| gmann_ | masayukig: sunday, i will reach around 10 PM on sunday | 08:45 |
| *** slaweq_ has quit IRC | 08:45 | |
| gmann_ | but i will stay till 4th, returning on 4th from there | 08:46 |
| masayukig | gmann_: ok. mine is also Sunday, but 2:55am! | 08:46 |
| openstackgerrit | Andrea Frittoli proposed openstack-dev/devstack master: Orchestrate run-devstack for multinode https://review.openstack.org/528074 | 08:46 |
| openstackgerrit | Andrea Frittoli proposed openstack-dev/devstack master: Add multinode extra settings in devstack conf https://review.openstack.org/545696 | 08:46 |
| gmann_ | masayukig: ok and return | 08:46 |
| *** sapcc-bot1 has joined #openstack-qa | 08:47 | |
| masayukig | gmann_: returning on 5th | 08:47 |
| *** sapcc-bot has quit IRC | 08:47 | |
| openstackgerrit | Ghanshyam Mann proposed openstack/tempest master: Add release notes page for 18.0.0 https://review.openstack.org/546921 | 08:48 |
| gmann_ | masayukig: cool. | 08:48 |
| *** jpena|off is now known as jpena | 08:50 | |
| *** salv-orlando has joined #openstack-qa | 08:52 | |
| *** salv-orlando has quit IRC | 08:57 | |
| *** salv-orlando has joined #openstack-qa | 08:57 | |
| *** vivsoni has quit IRC | 08:59 | |
| *** vivsoni has joined #openstack-qa | 08:59 | |
| *** alexchadin has quit IRC | 09:03 | |
| openstackgerrit | Merged openstack/tempest master: Remove leftover call to _create_stestrepository https://review.openstack.org/546822 | 09:10 |
| *** dtantsur|afk is now known as dtantsur | 09:17 | |
| *** agurenko has joined #openstack-qa | 09:22 | |
| *** sridharg has quit IRC | 09:32 | |
| *** kiennt26 has quit IRC | 09:36 | |
| *** e0ne has joined #openstack-qa | 09:38 | |
| *** gkadam_ has joined #openstack-qa | 09:43 | |
| *** gkadam has quit IRC | 09:44 | |
| *** gkadam_ has quit IRC | 09:44 | |
| *** gkadam_ has joined #openstack-qa | 09:44 | |
| *** alinanesterova has joined #openstack-qa | 09:48 | |
| alinanesterova | andreaf: hello, can somebody help me with configuration of heat tempest plugin? | 09:49 |
| *** cloud-liang has quit IRC | 09:49 | |
| *** yamamoto has quit IRC | 10:06 | |
| andreaf | alinanesterova: sure what's the issue exactly? | 10:13 |
| *** pzchen has quit IRC | 10:14 | |
| alinanesterova | andreaf: how can I enable idempotent ids in heat tempest plugin when I run tests using rally? | 10:14 |
| alinanesterova | i create rally verifier with heat tests, run it and they run without their ids | 10:16 |
| alinanesterova | maybe I need to add some params to tempest.conf? | 10:16 |
| alinanesterova | because all tests have their own ids: https://github.com/openstack/heat-tempest-plugin/blob/master/heat_tempest_plugin/tests/scenario/test_volumes.py#L102 | 10:17 |
| andreaf | alinanesterova: uhm I know the heat team was looking for a solution to add idempotent ids to tests, since most of their tests are gabbi based | 10:18 |
| andreaf | alinanesterova: ricolin did you ever solve that ^^^ | 10:18 |
| chandankumar | alinanesterova: here you can find the required tempest.conf for heat https://github.com/openstack/heat/blob/master/heat_integrationtests/prepare_test_env.sh#L30 | 10:19 |
| chandankumar | it might be useful | 10:19 |
| andreaf | chandankumar I don't see anything there that is related to idemptotent ids though | 10:19 |
| andreaf | alinanesterova chandankumar idempotent ids cannot be enabled or disabled | 10:20 |
| chandankumar | andreaf: sorry i missed the part about the idempotent ids | 10:20 |
| alinanesterova | yes, tests run but doesn't have their ids. but all others tempest plugins do | 10:20 |
| *** rossella_s has quit IRC | 10:20 | |
| andreaf | alinanesterova: I don't know how rally runs the tests but it you discover tests via tempest you should see the idempotent id in the name | 10:21 |
| andreaf | do you have an example / a log or something? | 10:21 |
| alinanesterova | as far as I see log from ci on heat-tempest-plugin, there is the same problem | 10:22 |
| alinanesterova | http://logs.openstack.org/22/521822/1/check/heat-functional-orig-mysql-lbaasv2/b671b47/job-output.txt.gz#_2018-02-20_22_10_58_976683 | 10:22 |
| *** tosky has joined #openstack-qa | 10:22 | |
| alinanesterova | andreaf: I have almost the same log as I sent ^ | 10:22 |
| *** rossella_s has joined #openstack-qa | 10:23 | |
| andreaf | well that's the normal output you don't see the test id in the logs | 10:25 |
| andreaf | what the decorator does is add an attribute to the test | 10:26 |
| andreaf | alinanesterova just a sec | 10:27 |
| alinanesterova | yes, it adds attribute, but it doesnt seem to work | 10:27 |
| *** pcrews has quit IRC | 10:30 | |
| andreaf | alinanesterova I'm not sure what you mean but "it doesn't work" :) where do you expect to see the idemptotent id, or better, what are you trying to achieve with it? | 10:30 |
| andreaf | alinanesterova: so perhaps I can provide a better answer | 10:30 |
| alinanesterova | so I run heat tempest tests in docker container, and after that I want to push results to testrail, but testrail can't see them without their ids( | 10:33 |
| *** alexchadin has joined #openstack-qa | 10:34 | |
| alinanesterova | andreaf: i create rally verify and add this plugin like this: https://github.com/zemuvier/rally-tempest-heat/blob/master/run_tempest.sh#L63, and then just do rally verify start | 10:35 |
| *** pcrews has joined #openstack-qa | 10:36 | |
| alinanesterova | and if i run 'rally verify list-verifier-tests', i see heat tests without ids, but other tests (pure tempest, horizon, barbican etc) with them | 10:37 |
| andreaf | ok I see | 10:38 |
| andreaf | alinanesterova well for all tests on the gabbi side you won't get an id since it's not there | 10:39 |
| andreaf | alinanesterova for scenario tests I'm not sure yet - it shouldn't be different really it's the same decorator id | 10:40 |
| alinanesterova | andreaf: maybe there is a workaround for that? | 10:40 |
| andreaf | alinanesterova unless they have something in the heat plugin test discovery that breaks things | 10:40 |
| alinanesterova | or what should i change to make them not gabbi side? | 10:40 |
| andreaf | alinanesterova just to be clear, when you do rally verify list-verifier-tests you don't see the uuid for any of the tests? | 10:43 |
| alinanesterova | andreaf: exactly | 10:43 |
| andreaf | I don't know what rally is using but it's strange that you don't see the uuids if you see them for other plugins | 10:44 |
| andreaf | I'm just doing a test locally | 10:47 |
| alinanesterova | andreaf: so do you see them? | 10:48 |
| *** gcheresh_ has quit IRC | 10:50 | |
| andreaf | no I don't get them either just using tempest so it's not anything rally specific | 10:50 |
| alinanesterova | andreaf: do you have any ideas how to fix it? | 10:51 |
| *** lkuchlan has quit IRC | 10:53 | |
| andreaf | alinanesterova I'm looking - I think it's something in the heat-tempest-plugin that breaks things somewhere | 10:54 |
| *** gkadam__ has joined #openstack-qa | 10:54 | |
| andreaf | alinanesterova but I have no idea where | 10:55 |
| alinanesterova | okey let me know if you find something, i'm searching too | 10:55 |
| *** gkadam_ has quit IRC | 10:57 | |
| *** itzikb_ has joined #openstack-qa | 10:57 | |
| *** itzikb has quit IRC | 10:59 | |
| *** EmilienM has quit IRC | 10:59 | |
| *** mattoliverau has quit IRC | 10:59 | |
| *** mattoliverau has joined #openstack-qa | 11:00 | |
| *** EmilienM has joined #openstack-qa | 11:00 | |
| *** EmilienM has joined #openstack-qa | 11:00 | |
| *** salv-orl_ has joined #openstack-qa | 11:00 | |
| andreaf | alinanesterova even if I do $ python -mtesttools.run discover -l -s heat_tempest_plugin/tests/scenario -t heat_tempest_plugin/ I still get no uuids there | 11:01 |
| andreaf | so it's not anything specific to tempest discover | 11:02 |
| alinanesterova | yes... seems like this is error in heat tempest config | 11:02 |
| *** salv-orlando has quit IRC | 11:03 | |
| *** yamamoto has joined #openstack-qa | 11:06 | |
| *** pcaruana has quit IRC | 11:07 | |
| *** yamamoto has quit IRC | 11:13 | |
| *** tbarron_ has joined #openstack-qa | 11:23 | |
| *** tbarron has quit IRC | 11:24 | |
| andreaf | alinanesterova so I think I know what the problem is | 11:24 |
| alinanesterova | andreaf: what is it? | 11:24 |
| andreaf | alinanesterova heat tempest plugin does not rely on Tempest base class | 11:24 |
| alinanesterova | really? | 11:25 |
| andreaf | alinanesterova and it misses out a testtools mixin which is required for attributes to be added to the test id | 11:25 |
| andreaf | alinanesterova http://testtools.readthedocs.io/en/latest/for-test-authors.html?highlight=WithAttributes#test-attributes | 11:25 |
| andreaf | alinanesterova http://git.openstack.org/cgit/openstack/tempest/tree/tempest/test.py#n79 | 11:26 |
| *** mattoliverau_ has joined #openstack-qa | 11:27 | |
| andreaf | alinanesterova you can see it working here http://paste.openstack.org/show/681708/ | 11:28 |
| alinanesterova | maybe you will create a patch with this fix? andreaf | 11:29 |
| andreaf | alinanesterova https://review.openstack.org/546953 | 11:31 |
| alinanesterova | andreaf: thank you so much! you saved my life | 11:32 |
| *** Faster-Fanboi_ has joined #openstack-qa | 11:32 | |
| andreaf | heh np | 11:32 |
| andreaf | I pinged a couple of folks in the #heat room hopefully we can get reviews on it | 11:33 |
| andreaf | alinanesterova ^^^ | 11:33 |
| *** gcheresh_ has joined #openstack-qa | 11:33 | |
| alinanesterova | super! | 11:33 |
| *** mattoliverau has quit IRC | 11:34 | |
| *** grafuls has quit IRC | 11:34 | |
| *** Faster-Fanboi has quit IRC | 11:34 | |
| *** grafuls has joined #openstack-qa | 11:35 | |
| *** luzC has quit IRC | 11:36 | |
| openstackgerrit | Andrea Frittoli proposed openstack-dev/devstack master: Orchestrate run-devstack for multinode https://review.openstack.org/528074 | 11:37 |
| openstackgerrit | Andrea Frittoli proposed openstack-dev/devstack master: Add multinode extra settings in devstack conf https://review.openstack.org/545696 | 11:37 |
| *** luzC has joined #openstack-qa | 11:39 | |
| *** sridharg has joined #openstack-qa | 11:39 | |
| *** armaan has quit IRC | 11:39 | |
| *** armaan has joined #openstack-qa | 11:40 | |
| *** shardy has quit IRC | 11:42 | |
| *** armaan has quit IRC | 11:46 | |
| *** snapiri- has quit IRC | 11:47 | |
| *** snapiri1 has joined #openstack-qa | 11:48 | |
| dmellado | andreaf: ping | 11:49 |
| dmellado | just read your email (from 3 days ago xD) and if you'd like to use our repo as example | 11:49 |
| andreaf | dmellado hi | 11:49 |
| dmellado | we've migrated kuryr-kubernetes jobs to zuulv3 | 11:49 |
| andreaf | dmellado: cool I'll have a look thanks | 11:50 |
| dmellado | FYI https://github.com/openstack/kuryr-kubernetes/blob/master/.zuul.yaml | 11:50 |
| dmellado | yw! I'll take a look at your multinode branch and I do hope that that's something that we could speak and work next week | 11:50 |
| andreaf | it looks good thanks | 11:50 |
| andreaf | dmellado yeah sure I'm trying to get the multinode stuff working before PTG | 11:51 |
| dmellado | andreaf: awesome, thanks! | 11:51 |
| andreaf | how hard it was to use devstack-tempest as a basis? | 11:51 |
| andreaf | I'm writing docs so any part that was less clear I can include in the docs with more examples | 11:52 |
| dmellado | andreaf: tbh it was quite straightforward, once I found it was there | 11:52 |
| andreaf | dmellado: heh good that's what I hoped for :) | 11:52 |
| dmellado | xD | 11:53 |
| dmellado | so besides the multinode and a split (as our .zuul.yaml file grew bigger than I thought) | 11:54 |
| dmellado | we're done | 11:54 |
| tosky | as soon as there are few working example, it's easier, yep | 11:55 |
| dmellado | tosky++ | 11:55 |
| dmellado | xD | 11:55 |
| *** gcheresh_ has quit IRC | 11:55 | |
| tosky | (the risk is a bit too much of cargo-culting and unneeded copy-and-paste, but we are not at that point yet) | 11:55 |
| *** armaan has joined #openstack-qa | 11:57 | |
| *** jpena is now known as jpena|lunch | 11:57 | |
| *** snapiri1 has quit IRC | 11:58 | |
| openstackgerrit | Andrea Frittoli proposed openstack-dev/devstack master: Orchestrate run-devstack for multinode https://review.openstack.org/528074 | 12:08 |
| openstackgerrit | Andrea Frittoli proposed openstack-dev/devstack master: Add multinode extra settings in devstack conf https://review.openstack.org/545696 | 12:08 |
| *** yamamoto has joined #openstack-qa | 12:09 | |
| *** pcaruana has joined #openstack-qa | 12:09 | |
| *** raildo has joined #openstack-qa | 12:10 | |
| *** yamamoto has quit IRC | 12:14 | |
| *** gcheresh has quit IRC | 12:16 | |
| *** lkuchlan has joined #openstack-qa | 12:16 | |
| *** dave-mccowan has joined #openstack-qa | 12:26 | |
| *** yamamoto has joined #openstack-qa | 12:27 | |
| *** lkuchlan has quit IRC | 12:30 | |
| *** lkuchlan has joined #openstack-qa | 12:32 | |
| *** alinanesterova has quit IRC | 12:37 | |
| *** alinanesterova has joined #openstack-qa | 12:40 | |
| *** gcheresh_ has joined #openstack-qa | 12:45 | |
| openstackgerrit | Andrea Frittoli proposed openstack-dev/devstack master: Orchestrate run-devstack for multinode https://review.openstack.org/528074 | 12:51 |
| openstackgerrit | Andrea Frittoli proposed openstack-dev/devstack master: Add multinode extra settings in devstack conf https://review.openstack.org/545696 | 12:51 |
| *** zul has quit IRC | 12:51 | |
| *** tbarron_ is now known as tbarron | 12:52 | |
| *** rosmaita has joined #openstack-qa | 12:52 | |
| *** zul has joined #openstack-qa | 12:55 | |
| *** alinanesterova has quit IRC | 12:58 | |
| *** gcheresh has joined #openstack-qa | 12:59 | |
| *** lkuchlan has quit IRC | 13:00 | |
| *** alinanesterova has joined #openstack-qa | 13:01 | |
| *** CrayZee has joined #openstack-qa | 13:03 | |
| *** alinanesterova has quit IRC | 13:06 | |
| *** dustins has joined #openstack-qa | 13:10 | |
| *** salv-orl_ has quit IRC | 13:10 | |
| *** salv-orlando has joined #openstack-qa | 13:11 | |
| *** betherly has quit IRC | 13:15 | |
| *** salv-orlando has quit IRC | 13:15 | |
| *** salv-orlando has joined #openstack-qa | 13:15 | |
| *** betherly has joined #openstack-qa | 13:15 | |
| *** lkuchlan has joined #openstack-qa | 13:22 | |
| *** lkuchlan has quit IRC | 13:27 | |
| *** jpena|lunch is now known as jpena | 13:27 | |
| *** vivsoni has quit IRC | 13:28 | |
| *** vivsoni has joined #openstack-qa | 13:28 | |
| *** yamamoto has quit IRC | 13:34 | |
| *** yangyapeng has joined #openstack-qa | 13:34 | |
| *** sshnaidm|afk is now known as sshnaidm | 13:37 | |
| *** yangyapeng has quit IRC | 13:39 | |
| lennyb | andreaf, kindly review #link https://review.openstack.org/#/c/499575/ | 13:40 |
| *** CrayZee has quit IRC | 13:41 | |
| *** mriedem has joined #openstack-qa | 13:42 | |
| *** yamamoto has joined #openstack-qa | 13:44 | |
| *** yamamoto has quit IRC | 13:44 | |
| *** shardy has joined #openstack-qa | 13:48 | |
| *** pgadiya has quit IRC | 13:49 | |
| *** mwhahaha has quit IRC | 13:54 | |
| *** mwhahaha has joined #openstack-qa | 13:56 | |
| *** Kevin_Zheng has quit IRC | 13:58 | |
| *** zhongjun has quit IRC | 14:01 | |
| *** zhongjun has joined #openstack-qa | 14:01 | |
| *** Kevin_Zheng has joined #openstack-qa | 14:02 | |
| *** alinanesterova has joined #openstack-qa | 14:07 | |
| *** alexchadin has quit IRC | 14:08 | |
| *** lbragstad has joined #openstack-qa | 14:10 | |
| *** alinanesterova has quit IRC | 14:11 | |
| *** fnaval has joined #openstack-qa | 14:21 | |
| *** lkuchlan has joined #openstack-qa | 14:25 | |
| *** kopecmartin has quit IRC | 14:26 | |
| *** kopecmartin has joined #openstack-qa | 14:31 | |
| *** esberglu has joined #openstack-qa | 14:31 | |
| *** alexchadin has joined #openstack-qa | 14:35 | |
| *** dtantsur is now known as dtantsur|brb | 14:38 | |
| *** agurenko has quit IRC | 14:38 | |
| *** lkuchlan has quit IRC | 14:43 | |
| openstackgerrit | Matthew Treinish proposed openstack/tempest master: Remove duplicate unit test module https://review.openstack.org/547010 | 14:43 |
| mtreinish | andreaf: ^^^ I'm not sure why that's not failing | 14:43 |
| mtreinish | since you moved it the client and it's tests to the lib that module had a broken import, I'm a bit concerned that nothing caught that | 14:44 |
| *** yamamoto has joined #openstack-qa | 14:45 | |
| mtreinish | masayukig: when you get a sec can you take a look at: https://github.com/mtreinish/stestr/pull/142 | 14:46 |
| mtreinish | I'm planning to push the 2.0.0 release after that lands | 14:46 |
| *** kopecmartin has quit IRC | 14:49 | |
| *** yamamoto has quit IRC | 14:51 | |
| *** lkuchlan has joined #openstack-qa | 14:53 | |
| *** gkadam__ has quit IRC | 14:53 | |
| *** e0ne has quit IRC | 14:57 | |
| *** awaugama has joined #openstack-qa | 14:57 | |
| *** cmurphy has quit IRC | 14:57 | |
| *** janzian has joined #openstack-qa | 14:58 | |
| *** e0ne has joined #openstack-qa | 14:59 | |
| *** kopecmartin has joined #openstack-qa | 15:03 | |
| openstackgerrit | Andrea Frittoli proposed openstack-dev/devstack master: Orchestrate run-devstack for multinode https://review.openstack.org/528074 | 15:05 |
| openstackgerrit | Andrea Frittoli proposed openstack-dev/devstack master: Add multinode extra settings in devstack conf https://review.openstack.org/545696 | 15:05 |
| masayukig[m] | mtreinish: sure, I'll review it tomorrow :) | 15:09 |
| *** dkranz has joined #openstack-qa | 15:18 | |
| *** lkuchlan has quit IRC | 15:19 | |
| *** kopecmartin has quit IRC | 15:21 | |
| *** dtantsur|brb is now known as dtantsur | 15:26 | |
| *** alexchadin has quit IRC | 15:26 | |
| *** alexchadin has joined #openstack-qa | 15:27 | |
| mtreinish | masayukig[m]: cool, thanks | 15:30 |
| *** alexchadin has quit IRC | 15:31 | |
| *** mardim has quit IRC | 15:34 | |
| *** e0ne has quit IRC | 15:34 | |
| *** e0ne has joined #openstack-qa | 15:35 | |
| openstackgerrit | Andrea Frittoli proposed openstack-dev/devstack master: Orchestrate run-devstack for multinode https://review.openstack.org/528074 | 15:36 |
| openstackgerrit | Andrea Frittoli proposed openstack-dev/devstack master: Add multinode extra settings in devstack conf https://review.openstack.org/545696 | 15:36 |
| openstackgerrit | Andrea Frittoli proposed openstack/tempest master: Write tempest-multinode-full as zuulv3 native https://review.openstack.org/545724 | 15:37 |
| *** alexchadin has joined #openstack-qa | 15:37 | |
| *** sshwarts has quit IRC | 15:37 | |
| *** krtaylor has quit IRC | 15:38 | |
| *** alexchadin has quit IRC | 15:42 | |
| *** gcheresh_ has quit IRC | 15:43 | |
| openstackgerrit | Andrea Frittoli proposed openstack-infra/devstack-gate master: Add stable/pike Tempest bitrot job https://review.openstack.org/547035 | 15:46 |
| *** hongbin has joined #openstack-qa | 15:46 | |
| *** yamamoto has joined #openstack-qa | 15:47 | |
| *** rossella_s has quit IRC | 15:51 | |
| *** yamamoto has quit IRC | 15:51 | |
| *** mardim has joined #openstack-qa | 15:53 | |
| *** itzikb_ has quit IRC | 15:58 | |
| andreaf | mtreinish uhm weird | 16:04 |
| *** gcheresh has quit IRC | 16:04 | |
| *** rossella_s has joined #openstack-qa | 16:05 | |
| *** gcheresh has joined #openstack-qa | 16:05 | |
| mtreinish | andreaf: yeah, it's really weird. My only thought is it's not being picked up by discovery at all | 16:08 |
| mtreinish | but I'm not sure why that's happening | 16:08 |
| mtreinish | I tried the base unittest discover module too and it doesn't fail on it either | 16:09 |
| mtreinish | I only found it by testing out running the unittests with py.test (just to see) | 16:09 |
| andreaf | probably because of the broken import - but it shouldn't silently skip it | 16:09 |
| mtreinish | iirc py.test doesn't use the same discovery mechanism as upstream which would explain why it caught it | 16:09 |
| mtreinish | andreaf: right, the import error should be a fatal exception on discovery | 16:10 |
| mtreinish | because the module doesn't import without exception | 16:10 |
| *** ramishra has quit IRC | 16:11 | |
| *** sshnaidm is now known as sshnaidm|off | 16:12 | |
| *** amoralej has joined #openstack-qa | 16:16 | |
| amoralej | hi, i'm seeing a strange behavior in tempest from master, it seems it's not honouring the --whitelist-file option? | 16:17 |
| amoralej | could that be related to the switch to use stestr? | 16:17 |
| rnoriega | andreaf, ping | 16:17 |
| *** sshnaidm|off has quit IRC | 16:17 | |
| andreaf | rnoriega hi - what's up | 16:18 |
| amoralej | andreaf ^ any idea ? | 16:18 |
| andreaf | amoralej do you have a link? | 16:18 |
| rnoriega | andreaf, hi!!! just one quick question. In networking-l2gw we have a zuulv3 native job that inherits from devstack jobs, and I was wonder, if there is any plan to move to the new devstack service names | 16:19 |
| mtreinish | amoralej: also what version of stestr do you have installed? There was a bug with the whitelist-file being silently ignored in 1.0.0 that was fixed in 1.1.0 | 16:19 |
| rnoriega | andreaf, like neutron-api instead of q-svc | 16:19 |
| *** rossella_s has quit IRC | 16:20 | |
| amoralej | andreaf, not yet, the problem i have is that my jobs are timing out and i don't get logs but i've login in a server running the job and i see it's running all jobs, not the ones in the whitelist | 16:20 |
| amoralej | mtreinish, i have 1.1.0 | 16:20 |
| andreaf | rnoriega yeah I had the question in my mind - for now we use test-matrix which uses the old names but I started the process of migrating away from test-matrix for new branches (rocky and I plan to do queens as well) | 16:21 |
| andreaf | rnoriega https://review.openstack.org/#/c/546765/ | 16:21 |
| andreaf | rnoriega that still uses the old names but it's actually a good opportunity to start using the new ones | 16:22 |
| andreaf | rnoriega is it just a matter of using the new names or is there anything else involved? | 16:22 |
| *** rossella_s has joined #openstack-qa | 16:22 | |
| rnoriega | andreaf, I just got to review this patch: https://review.openstack.org/#/c/546994/1 | 16:24 |
| rnoriega | andreaf, which changes the devstack plugin to the new name. I don't want to change the definition of the job to disable all services, and add the new names... so I was hoping to get them by inheritance | 16:25 |
| rnoriega | andreaf, for free! xD xD | 16:25 |
| tosky | rnoriega: re that review, why don't check both names? if is_service_enabled neutron-api || is_service_enabled q-svn; then | 16:26 |
| tosky | so you should be fine | 16:26 |
| rnoriega | tosky, that's thinking out of the box! | 16:27 |
| rnoriega | tosky, good idea! :-) | 16:27 |
| *** grafuls has quit IRC | 16:27 | |
| andreaf | rnoriega yeah sure if you point me to magic document that maps new names to old names I can try to run https://review.openstack.org/#/c/546765/ with the old names | 16:27 |
| rnoriega | andreaf, no clue to be honest! I just found out today about the new naming convention! :-) | 16:28 |
| *** tosky has quit IRC | 16:31 | |
| *** armaan has quit IRC | 16:33 | |
| *** armaan has joined #openstack-qa | 16:33 | |
| *** d0ugal has quit IRC | 16:35 | |
| *** grafuls has joined #openstack-qa | 16:39 | |
| openstackgerrit | Matthew Treinish proposed openstack/tempest master: Add test for tempest run with a whitelist file https://review.openstack.org/547064 | 16:39 |
| mtreinish | amoralej: ^^^ it looks like it's working fine for me | 16:39 |
| amoralej | mtreinish, i'm trying to reproduce it by running it manually, let me abort current run | 16:40 |
| mtreinish | but there might be an edge condition in the logic I'm missing somewhere, Like off the top of my head, maybe relative vs absolute paths | 16:40 |
| mtreinish | the test case I wrote uses absolute paths | 16:41 |
| *** d0ugal has joined #openstack-qa | 16:41 | |
| amoralej | mtreinish, this is what we run http://paste.openstack.org/show/682210/ | 16:41 |
| amoralej | mtreinish, i've noticed we use --whitelist_file instead of --whitelist-file | 16:43 |
| mtreinish | amoralej: hmm, that could be it. Although I'd expect cliff to throw an error if it didn't understand --whitelist_file | 16:44 |
| amoralej | mtreinish, as per https://github.com/openstack/tempest/blob/master/tempest/cmd/run.py#L234 both should work? | 16:45 |
| amoralej | anyway, i'll test it | 16:45 |
| *** e0ne has quit IRC | 16:46 | |
| *** yamamoto has joined #openstack-qa | 16:48 | |
| *** cmurphy has joined #openstack-qa | 16:48 | |
| openstackgerrit | Andrea Frittoli proposed openstack-dev/devstack master: Orchestrate run-devstack for multinode https://review.openstack.org/528074 | 16:50 |
| openstackgerrit | Andrea Frittoli proposed openstack-dev/devstack master: Add multinode extra settings in devstack conf https://review.openstack.org/545696 | 16:50 |
| *** ragiman has quit IRC | 16:52 | |
| *** yamamoto has quit IRC | 16:52 | |
| mtreinish | amoralej: oh, it might be a subtle change in the interaction between your cli regex and the whitelist file | 16:53 |
| mtreinish | depending on the contents of the whitelist file that selection will get pretty hairy | 16:53 |
| amoralej | mtreinish, i just checked that, if i remove the regex option, it works as expected | 16:54 |
| amoralej | mtreinish, to test i created a whitelist file with a single line | 16:55 |
| amoralej | "tempest.api.compute.admin.test_agents.AgentsAdminTestJSON.test_create_agent" | 16:55 |
| amoralej | it looks like when adding regex option, whitelist_file is not used? | 16:56 |
| mtreinish | that would be a bug in stestr, the 2 options should be compatible: http://stestr.readthedocs.io/en/latest/MANUAL.html#test-selection | 16:56 |
| amoralej | i'm checking with other one, i.e. "smoke" and i get the same behavior | 16:57 |
| *** rossella_s has quit IRC | 16:57 | |
| amoralej | all tests are executed | 16:57 |
| *** rossella_s has joined #openstack-qa | 16:59 | |
| mtreinish | amoralej: I bet it's a behavior change between whatever temepst was doing before and now using stestr. The cli regex's are ORed meaning tests that match any regex (whitelist file, or cli) will run: https://github.com/mtreinish/stestr/blob/master/stestr/selection.py#L97-L98 | 16:59 |
| mtreinish | amoralej: you can use stestr list to test things out (it turns out the tempest run -l option was broken in the migration too :/) | 17:01 |
| amoralej | mtreinish, i'm testing with stestr list and it's weird | 17:01 |
| amoralej | i do | 17:01 |
| amoralej | stestr list --whitelist-file=/tmp/openstack/tempest/test-whitelist.txt --concurrency=2 --regex='^(?!tempest.scenario.gnocchi.test.live_assert_vcpus_metric_is_really_expurged.test_request.*$)(?!tempest.scenario.gnocchi.test.live_assert_no_delete_metrics_have_the_gabbilive_policy.test_request.*$).*'|wc -l | 17:01 |
| amoralej | and i get 184 lines | 17:01 |
| amoralej | but when i do tempest run with the same options i was running more that 1000 tests before i killed it | 17:02 |
| *** sridharg has quit IRC | 17:04 | |
| amoralej | mtreinish, i just double checked stestr list work as expected when using whitelist_file + regex | 17:05 |
| amoralej | but tempest run doesn't | 17:05 |
| amoralej | would revert https://review.openstack.org/#/c/504345/ be an option? :( | 17:06 |
| mtreinish | then there's likely a bug in how tempest run is calling stestr | 17:06 |
| *** armaan has quit IRC | 17:12 | |
| *** armaan has joined #openstack-qa | 17:13 | |
| mtreinish | amoralej: it might be a good idea given all the bugs in it | 17:16 |
| mtreinish | I'm trying to fix them as quickly as I can, but more keep popping up | 17:17 |
| openstackgerrit | Matthew Treinish proposed openstack/tempest master: Fix the -l/--list-tests argument for tempest run https://review.openstack.org/547073 | 17:17 |
| mtreinish | andreaf: ^^^ | 17:17 |
| mtreinish | normally I'm inclined to just fail forward and fix things, but if more things keep popping up that's probably not a good idea | 17:18 |
| *** sridharg has joined #openstack-qa | 17:21 | |
| mtreinish | amoralej: fwiw, I'm having a hard time reproducing the whitelist file getting ignored with a cli regex | 17:21 |
| mtreinish | amoralej: this sounds so similar to: https://github.com/mtreinish/stestr/issues/92 | 17:22 |
| *** slaweq has joined #openstack-qa | 17:29 | |
| openstackgerrit | Matthew Treinish proposed openstack/tempest master: Add test for tempest run with a whitelist file https://review.openstack.org/547064 | 17:30 |
| openstackgerrit | Matthew Treinish proposed openstack/tempest master: Fix the -l/--list-tests argument for tempest run https://review.openstack.org/547073 | 17:30 |
| mtreinish | amoralej: I added a unit test for whitelist with regex ^^^ | 17:30 |
| *** grafuls has quit IRC | 17:35 | |
| openstackgerrit | Merged openstack/patrole master: Remove all v2.0 identity API tests https://review.openstack.org/545959 | 17:37 |
| amoralej | mtreinish, http://paste.openstack.org/show/682296/ | 17:38 |
| amoralej | that's my test | 17:39 |
| *** Alex_Staf has quit IRC | 17:43 | |
| *** slaweq has quit IRC | 17:48 | |
| *** yamamoto has joined #openstack-qa | 17:48 | |
| *** armaan has quit IRC | 17:51 | |
| *** jpena is now known as jpena|off | 17:52 | |
| *** armaan has joined #openstack-qa | 17:52 | |
| *** yamamoto has quit IRC | 17:54 | |
| mtreinish | amoralej: it's the regex you're using it returns true on re.search() for every test | 18:04 |
| amoralej | mtreinish, then why stestr list doesn't returns all tests? | 18:05 |
| amoralej | we've been using exactly the same comman since long time | 18:05 |
| amoralej | as a way to exclude tests from the whitelist | 18:05 |
| mtreinish | you can test it pretty easily: http://paste.openstack.org/show/682337/ | 18:06 |
| mtreinish | which is basically what stestr does internally: https://github.com/mtreinish/stestr/blob/master/stestr/selection.py#L31-L34 | 18:07 |
| *** sridharg has quit IRC | 18:07 | |
| mtreinish | in stestr there is the --black-regex and --blacklist-file to do excludes | 18:08 |
| openstackgerrit | Clark Boylan proposed openstack-dev/devstack master: Test pip 10 works with devstack before release https://review.openstack.org/513825 | 18:11 |
| mtreinish | amoralej: the reason it works in stestr list for you is because you did '--regex=' which isn't an argument in stestr list (or stestr run) it's strictly a tempest run thing | 18:11 |
| amoralej | mtreinish, i'm testing the exact same command with a commit before moving to stestr to check if that changed the behavior | 18:12 |
| mtreinish | so it's trying to match on the full thing and fails | 18:13 |
| mtreinish | there is a bug (which will be fixed in the next release) https://github.com/mtreinish/stestr/issues/99 which treats unknown arguments as regex | 18:13 |
| *** slaweq has joined #openstack-qa | 18:15 | |
| *** gfidente has quit IRC | 18:16 | |
| mtreinish | amoralej: the way tempest run did selection before was kinda broken. It would literally take the whitelist files and the cli regex and go just do regex1|regex2|regex3|regex4 and then just passed that combined string to testr run in a subprocess, which had the potential to make things very unpredictable | 18:16 |
| mtreinish | my guess is that transform masked over the regex matching everything | 18:17 |
| amoralej | mtreinish, what we do in puppet-openstck-integration is to have a whitelist file for the tests we want to run | 18:18 |
| amoralej | and then use --reges to exclude known bad tests | 18:18 |
| amoralej | that used to work well | 18:19 |
| amoralej | iiuc, you mean that moving to stestr changed that behavior to a better one? | 18:19 |
| mtreinish | amoralej: yes, better and explict. How, as a user are you supposed to know your cli regex worked when if you test your cli regex on a test_id it returns a match (when it's supposed to exclude that test) | 18:21 |
| amoralej | sorry, i don't understand the question | 18:22 |
| mtreinish | it's a rhetorical question, to describe the state of things priort to the migration | 18:22 |
| amoralej | but i know that when i have a test breaking my job, i added to the regex and it was excluded | 18:22 |
| amoralej | so, what's the best way to implement same thing now? | 18:24 |
| amoralej | imo, this is a clear regression | 18:24 |
| amoralej | unless the change is documented properly, what i may have missed | 18:24 |
| amoralej | and follow deprecation rules | 18:25 |
| *** slaweq has quit IRC | 18:25 | |
| mtreinish | it worked by happenstance, because the internals were buggy. It wasn't the documented cli contract or how the the test runners actually work. Tempest was adding incorrect characters to the regex which made it not OR inputs | 18:25 |
| mtreinish | this would have bit you either from this patch or when the ostestr 1.1.0 release is pushed with: https://github.com/openstack/os-testr/commit/96db91056aded65abd8e8bb531ebcaf77b32b12a | 18:26 |
| amoralej | so, what's the best way to do this? | 18:26 |
| amoralej | using --whitelist-file --blacklist-file ? | 18:27 |
| amoralej | mmm | 18:27 |
| amoralej | those files support regexes? | 18:27 |
| mtreinish | amoralej: yeah, right now you should use either a blacklist file with the test ids you want to exclude. | 18:27 |
| mtreinish | yes, each line is a regex in the files | 18:27 |
| *** tesseract has quit IRC | 18:28 | |
| amoralej | let me test that, but again, this is a regression | 18:28 |
| *** gfidente has joined #openstack-qa | 18:29 | |
| amoralej | mtreinish, "argument --blacklist-file/--blacklist_file: not allowed with argument --whitelist-file/--whitelist_file" | 18:31 |
| mtreinish | that check isn't needed anymore, it's to protect against an old regex construction bug | 18:32 |
| mtreinish | I'll push a patch to remove it | 18:32 |
| mtreinish | amoralej: if you can figure out how to construct the selection regex you want without matching everything you can use that too | 18:32 |
| *** openstackgerrit has quit IRC | 18:33 | |
| amoralej | mtreinish, http://paste.openstack.org/show/682374/ | 18:35 |
| amoralej | any sugestion is appreciated | 18:36 |
| *** yamamoto has joined #openstack-qa | 18:50 | |
| *** openstackgerrit has joined #openstack-qa | 18:51 | |
| openstackgerrit | Matthew Treinish proposed openstack/tempest master: Fix the -l/--list-tests argument for tempest run https://review.openstack.org/547073 | 18:51 |
| openstackgerrit | Matthew Treinish proposed openstack/tempest master: Add test for tempest run with a whitelist file https://review.openstack.org/547064 | 18:51 |
| openstackgerrit | Matthew Treinish proposed openstack/tempest master: Cleanup selection list args in tempest run https://review.openstack.org/547105 | 18:51 |
| openstackgerrit | Matthew Treinish proposed openstack/tempest master: Add a black_regex flag to tempest run https://review.openstack.org/547106 | 18:51 |
| *** dtantsur is now known as dtantsur|afk | 18:52 | |
| mtreinish | masayukig, andreaf, afazekas|air, gmann_, oomichi: ^^^ | 18:52 |
| amoralej | mtreinish, so use case will be implemented via https://review.openstack.org/#/c/547106/ , right? | 18:55 |
| amoralej | please get it into 18.0.0 | 18:55 |
| mtreinish | amoralej: yes, that or using a blacklist regex after 547105 | 18:56 |
| amoralej | btw, i've reported it in https://bugs.launchpad.net/tempest/+bug/1751115 | 18:56 |
| openstack | Launchpad bug 1751115 in tempest "tempest run behavior with --whitelist-file and --regex changed after moving to stestr" [Undecided,New] | 18:56 |
| mtreinish | amoralej: or you can change the gnocchi line in your whitelist file to be: '^((?!tempest.scenario.gnocchi.test.live_assert_no_delete_metrics_have_the_gabbilive_policy.test_request.*$|tempest.scenario.gnocchi.test.live_assert_vcpus_metric_is_really_expurged.test_request.*$).)telemetry_tempest_plugin.gnocchi' | 18:56 |
| *** yamamoto has quit IRC | 18:56 | |
| mtreinish | which will match gnocci tests but exclude the ones you don't want | 18:56 |
| amoralej | let me test that | 18:57 |
| *** yamamoto has joined #openstack-qa | 18:59 | |
| *** gcheresh has quit IRC | 19:03 | |
| *** yamamoto has quit IRC | 19:04 | |
| *** bkopilov has quit IRC | 19:05 | |
| *** gfidente has quit IRC | 19:09 | |
| *** amoralej is now known as amoralej|off | 19:12 | |
| *** yamamoto has joined #openstack-qa | 19:14 | |
| *** yamamoto has quit IRC | 19:19 | |
| *** rossella_s has quit IRC | 19:20 | |
| *** rossella_s has joined #openstack-qa | 19:23 | |
| *** rossella_s has quit IRC | 19:28 | |
| *** yamamoto has joined #openstack-qa | 19:29 | |
| tonyb | gmann_: We can EOL tempest if you're ready. and we can chat about how we shoudl handle this in the future | 19:30 |
| *** rossella_s has joined #openstack-qa | 19:32 | |
| *** yamamoto has quit IRC | 19:34 | |
| *** yamamoto has joined #openstack-qa | 19:44 | |
| *** yamamoto has quit IRC | 19:52 | |
| openstackgerrit | Andrea Frittoli proposed openstack-dev/devstack master: DNM Debug devstack_data on all nodes https://review.openstack.org/547122 | 19:52 |
| *** rossella_s has quit IRC | 19:52 | |
| *** rossella_s has joined #openstack-qa | 19:53 | |
| openstackgerrit | Andrea Frittoli proposed openstack-dev/devstack master: Orchestrate run-devstack for multinode https://review.openstack.org/528074 | 19:57 |
| openstackgerrit | Andrea Frittoli proposed openstack-dev/devstack master: Add multinode extra settings in devstack conf https://review.openstack.org/545696 | 19:57 |
| *** mriedem has left #openstack-qa | 19:57 | |
| *** mriedem has joined #openstack-qa | 19:57 | |
| *** slaweq_ has joined #openstack-qa | 20:03 | |
| *** raildo has quit IRC | 20:04 | |
| *** slaweq_ has quit IRC | 20:07 | |
| *** rossella_s has quit IRC | 20:08 | |
| *** rossella_s has joined #openstack-qa | 20:10 | |
| mtreinish | tonyb: eol what in tempest? | 20:12 |
| tonyb | mtreinish: Ummm gmann_ and andreaf wheer talkign about wantiing to remoev newton support | 20:12 |
| tonyb | I guess you don't actually EOL to do that do you | 20:12 |
| tonyb | you just tage tempest $x and say that's the last version that supports newtin | 20:12 |
| tonyb | and then remove the code rigth? | 20:12 |
| mtreinish | tonyb: yeah, it's just push a tag N+1.0.0 for the newton support drop, and then remove the jobs | 20:13 |
| tonyb | mtreinish: okay, hopefully gmann_ and andreaf will get that message if not we can realy it at the PTG | 20:14 |
| mtreinish | at this point it might just be worth waiting until the queens release though, and just doing a combined eol and new release tag | 20:14 |
| mtreinish | since they're more or less overlapping now | 20:14 |
| openstackgerrit | Matthew Treinish proposed openstack/tempest master: Add a black_regex flag to tempest run https://review.openstack.org/547106 | 20:21 |
| openstackgerrit | Matthew Treinish proposed openstack/tempest master: Add test for tempest run with a whitelist file https://review.openstack.org/547064 | 20:21 |
| *** slaweq has joined #openstack-qa | 20:22 | |
| *** rossella_s has quit IRC | 20:36 | |
| *** rossella_s has joined #openstack-qa | 20:38 | |
| mtreinish | melwitt: I'm planning to push a new stestr release in the next week, (just waiting on 1 last patch) if you get a sec can you give the current stestr master a try and let me know if it works for you? | 20:43 |
| mtreinish | we made some big ui internal changes (switched from argparse to cliff) and I want to make sure we didn't miss something | 20:43 |
| *** awaugama has quit IRC | 20:45 | |
| openstackgerrit | Merged openstack-dev/devstack master: Correct configuration setting using NUMBER_FAKE_NOVA_COMPUTE https://review.openstack.org/541832 | 20:47 |
| *** yamamoto has joined #openstack-qa | 20:48 | |
| *** rossella_s has quit IRC | 20:48 | |
| *** rossella_s has joined #openstack-qa | 20:50 | |
| openstackgerrit | Matthew Treinish proposed openstack/tempest master: Fix the -l/--list-tests argument for tempest run https://review.openstack.org/547073 | 20:53 |
| openstackgerrit | Matthew Treinish proposed openstack/tempest master: Add missing env vars from unit test job https://review.openstack.org/547138 | 20:55 |
| openstackgerrit | Matthew Treinish proposed openstack/tempest master: Add a black_regex flag to tempest run https://review.openstack.org/547106 | 20:55 |
| openstackgerrit | Matthew Treinish proposed openstack/tempest master: Add test for tempest run with a whitelist file https://review.openstack.org/547064 | 20:55 |
| *** yamamoto has quit IRC | 20:55 | |
| *** vivsoni_ has joined #openstack-qa | 20:57 | |
| *** vivsoni has quit IRC | 20:57 | |
| openstackgerrit | Matthew Treinish proposed openstack/tempest master: Cleanup selection list args in tempest run https://review.openstack.org/547105 | 21:01 |
| openstackgerrit | Matthew Treinish proposed openstack/tempest master: Fix the -l/--list-tests argument for tempest run https://review.openstack.org/547073 | 21:01 |
| openstackgerrit | Matthew Treinish proposed openstack/tempest master: Add a black_regex flag to tempest run https://review.openstack.org/547106 | 21:01 |
| openstackgerrit | Matthew Treinish proposed openstack/tempest master: Add test for tempest run with a whitelist file https://review.openstack.org/547064 | 21:01 |
| openstackgerrit | Matthew Treinish proposed openstack/tempest master: Add unit test for tempest run --config-file https://review.openstack.org/546905 | 21:01 |
| *** rossella_s has quit IRC | 21:24 | |
| openstackgerrit | Ian Wienand proposed openstack-dev/devstack master: Role apache-logs-conf: fix redhat matching https://review.openstack.org/541006 | 21:26 |
| openstackgerrit | Ian Wienand proposed openstack-dev/devstack master: py3 changes for outfilter.py https://review.openstack.org/474833 | 21:26 |
| openstackgerrit | Ian Wienand proposed openstack-dev/devstack master: Add VERBOSE_NO_TIMESTAMP flag https://review.openstack.org/541067 | 21:26 |
| openstackgerrit | Ian Wienand proposed openstack-dev/devstack master: Run swift-container-sync under run_process https://review.openstack.org/542535 | 21:26 |
| openstackgerrit | Ian Wienand proposed openstack-dev/devstack master: Move platform jobs to zuulv3 native https://review.openstack.org/540704 | 21:26 |
| *** rossella_s has joined #openstack-qa | 21:28 | |
| *** pcaruana has quit IRC | 21:37 | |
| *** dave-mccowan has quit IRC | 21:49 | |
| *** dave-mcc_ has joined #openstack-qa | 21:51 | |
| andreaf | tonyb mtreinish gmann_ it's fine for me to wait until after PTG | 21:52 |
| andreaf | it would be actually a good chance at the PTG to make sure everyone's happy with that | 21:52 |
| andreaf | since newton is the last release with n-net support | 21:52 |
| *** yamamoto has joined #openstack-qa | 21:53 | |
| *** alinanesterova has joined #openstack-qa | 21:56 | |
| *** yamamoto has quit IRC | 21:57 | |
| *** alinanesterova has quit IRC | 22:01 | |
| *** yamamoto has joined #openstack-qa | 22:01 | |
| openstackgerrit | Andrea Frittoli proposed openstack-dev/devstack master: Orchestrate run-devstack for multinode https://review.openstack.org/528074 | 22:04 |
| openstackgerrit | Andrea Frittoli proposed openstack-dev/devstack master: Add multinode extra settings in devstack conf https://review.openstack.org/545696 | 22:04 |
| mtreinish | andreaf: if you get a sec, we should try to land this stack asap: https://review.openstack.org/#/q/status:open+project:openstack/tempest+branch:master+topic:fix-tempest-run | 22:05 |
| mtreinish | a bunch of things broke with the stestr migration | 22:05 |
| mtreinish | andreaf: also https://review.openstack.org/#/c/547138/ is a quick fix | 22:06 |
| andreaf | mtreinish oh I though I fixed that some time ago... obviously I didn't :P | 22:07 |
| *** armaan has quit IRC | 22:13 | |
| *** slaweq has quit IRC | 22:22 | |
| *** slaweq has joined #openstack-qa | 22:22 | |
| *** slaweq has quit IRC | 22:27 | |
| tonyb | andreaf: Cool. That sounds like a good plan. | 22:29 |
| *** esberglu has quit IRC | 22:32 | |
| *** dustins has quit IRC | 22:35 | |
| *** tonyb has quit IRC | 22:35 | |
| *** tonyb has joined #openstack-qa | 22:36 | |
| *** rcernin has joined #openstack-qa | 22:38 | |
| *** sshnaidm has joined #openstack-qa | 22:40 | |
| *** sshnaidm is now known as sshnaidm|off | 22:40 | |
| *** tosky has joined #openstack-qa | 22:41 | |
| *** dave-mcc_ has quit IRC | 22:44 | |
| *** janzian has quit IRC | 22:45 | |
| openstackgerrit | Andrea Frittoli proposed openstack-dev/devstack master: Orchestrate run-devstack for multinode https://review.openstack.org/528074 | 22:58 |
| openstackgerrit | Andrea Frittoli proposed openstack-dev/devstack master: Add multinode extra settings in devstack conf https://review.openstack.org/545696 | 22:58 |
| *** yamamoto has quit IRC | 23:02 | |
| *** rossella_s has quit IRC | 23:07 | |
| *** rossella_s has joined #openstack-qa | 23:09 | |
| *** rossella_s has quit IRC | 23:21 | |
| *** rossella_s has joined #openstack-qa | 23:22 | |
| *** rossella_s has quit IRC | 23:29 | |
| *** rossella_s has joined #openstack-qa | 23:30 | |
| *** hongbin has quit IRC | 23:34 | |
| *** tosky has quit IRC | 23:39 | |
| gmann_ | tonyb andreaf mtreinish yea, let's wait for PTG as we are doing queens release tag now. | 23:40 |
| *** rosmaita has quit IRC | 23:40 | |
| openstackgerrit | Andrea Frittoli proposed openstack-dev/devstack master: Move test_matrix_role into job group_vars https://review.openstack.org/545633 | 23:40 |
| openstackgerrit | Andrea Frittoli proposed openstack-dev/devstack master: Orchestrate run-devstack for multinode https://review.openstack.org/528074 | 23:40 |
| openstackgerrit | Andrea Frittoli proposed openstack-dev/devstack master: Add multinode extra settings in devstack conf https://review.openstack.org/545696 | 23:40 |
| gmann_ | andreaf: mtreinish btw 18.0.0 release notes patch or you want to get tempest run fix in before it (m ok either way)- https://review.openstack.org/#/c/546903/ | 23:42 |
| *** slaweq has joined #openstack-qa | 23:43 | |
| andreaf | gmann_ uhm I always feel bad making a release on a broken state since it's something people is more likely to use... but I guess it we have 18.1.0 people will get that instead | 23:44 |
| *** fnaval has quit IRC | 23:47 | |
| *** slaweq has quit IRC | 23:48 | |
| mtreinish | gmann_: yeah we should fix the tempest run stuff before we push a release | 23:49 |
| gmann_ | andreaf: mtreinish yea, just going through the discussion and patch series. ll include in 18.0.0 | 23:51 |
| mtreinish | gmann_: also there are some issues with that releasenote patch | 23:55 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!