*** itlinux_ has joined #openstack-rally | 00:04 | |
*** rcernin has quit IRC | 00:07 | |
*** itlinux has quit IRC | 00:07 | |
*** rcernin has joined #openstack-rally | 01:05 | |
*** itlinux_ has quit IRC | 01:26 | |
*** itlinux has joined #openstack-rally | 01:30 | |
*** itlinux has quit IRC | 01:56 | |
*** itlinux has joined #openstack-rally | 02:03 | |
*** altlogbot_2 has quit IRC | 02:12 | |
*** altlogbot_3 has joined #openstack-rally | 02:13 | |
*** dave-mccowan has quit IRC | 03:14 | |
*** itlinux has quit IRC | 03:40 | |
*** itlinux has joined #openstack-rally | 03:44 | |
*** itlinux has quit IRC | 04:03 | |
*** itlinux has joined #openstack-rally | 04:06 | |
*** itlinux has quit IRC | 04:42 | |
*** itlinux has joined #openstack-rally | 04:50 | |
*** itlinux has quit IRC | 05:04 | |
*** itlinux has joined #openstack-rally | 05:05 | |
*** pcaruana has joined #openstack-rally | 05:08 | |
*** pcaruana has quit IRC | 05:16 | |
*** pcaruana has joined #openstack-rally | 05:17 | |
*** itlinux has quit IRC | 05:44 | |
*** icey has quit IRC | 07:34 | |
*** rcernin has quit IRC | 07:36 | |
*** icey_ has joined #openstack-rally | 07:43 | |
*** andreykurilin has joined #openstack-rally | 07:51 | |
*** e0ne has joined #openstack-rally | 07:51 | |
*** icey_ has quit IRC | 08:06 | |
*** tosky has joined #openstack-rally | 08:10 | |
*** icey has joined #openstack-rally | 08:17 | |
*** tesseract has joined #openstack-rally | 08:48 | |
*** juhak has quit IRC | 09:53 | |
*** juhak has joined #openstack-rally | 09:53 | |
*** tesseract has quit IRC | 09:56 | |
*** jovial[m] has joined #openstack-rally | 09:59 | |
*** tesseract has joined #openstack-rally | 09:59 | |
*** tesseract has quit IRC | 10:00 | |
jovial[m] | when you using `rally verify start` is it possible to pass through command line arguments to tempest? | 10:00 |
---|---|---|
*** tesseract has joined #openstack-rally | 10:01 | |
andreykurilin | jovial[m]: hi! which arguments you would like to pass? | 10:01 |
andreykurilin | zul: hi! I'm planning to propose a new release of rally-openstack today or earlier next week | 10:02 |
jovial[m] | I was hoping to use the `-b` flag to specify a blacklist using a regex. I don't think `--skip-list` support this, right? | 10:02 |
andreykurilin | unfortunately you are right. `--skip-list` option doesn't support it and we doesn't have anything for that feature :( the only workaround which I can propose is to do something like `rally verify list-tests | grep some_regexp > skip_list.txt` | 10:04 |
jovial[m] | OK, thanks. That seems like a reasonable workaround. I will also have to specify a reason I assume? | 10:06 |
andreykurilin | right, I forgot about this. I guess `sed` can help to extend each line with a reason | 10:08 |
andreykurilin | Hope that someday someone will find time to extend our --skip-list feature | 10:08 |
jovial[m] | How would you extend it? You could make the --skip-list take a file containing a list of skip regex to reason, but I guess that would be backwards incompatible as the full stops would match any character. | 10:15 |
andreykurilin | jovial[m]: It should not break anything. | 10:21 |
andreykurilin | https://github.com/openstack/rally/blob/master/rally/plugins/common/verification/testr.py#L71 | 10:22 |
andreykurilin | here is a code for skip-list feature | 10:22 |
andreykurilin | it already lists all tests | 10:22 |
andreykurilin | so the only thing which should be changed is how tests from load_list are filtered | 10:22 |
jovial[m] | OK, shall I submit a patch to do this? | 10:23 |
andreykurilin | yes, please. | 10:26 |
jovial[m] | OK, I'm on it. | 10:26 |
andreykurilin | great | 10:26 |
*** luksky has quit IRC | 10:48 | |
*** tesseract has quit IRC | 11:10 | |
*** luksky has joined #openstack-rally | 11:17 | |
*** dave-mccowan has joined #openstack-rally | 11:45 | |
*** juhak has quit IRC | 11:50 | |
*** dave-mccowan has quit IRC | 11:50 | |
*** juhak has joined #openstack-rally | 11:51 | |
*** e0ne has quit IRC | 12:52 | |
*** e0ne has joined #openstack-rally | 13:01 | |
*** juhak has quit IRC | 13:10 | |
*** juhak has joined #openstack-rally | 13:10 | |
*** luksky has quit IRC | 13:31 | |
*** Anticime1 is now known as Anticimex | 14:26 | |
jovial[m] | andreykurilin: I had a quick look and it's definitely going to break existing skip-lists because of the square brackets, e.g: the test regex would need to look something like: `tempest\.api\.compute\.admin\.test_flavors\.FlavorsAdminTestJSON\.test_create_flavor_using_string_ram\[id-3b541a2e-2ac2-4b42-8b8d-ba6e22fcd4da\]: reason`. What do you think? | 15:01 |
*** itlinux has joined #openstack-rally | 15:03 | |
*** e0ne has quit IRC | 15:08 | |
*** e0ne has joined #openstack-rally | 15:11 | |
*** e0ne has quit IRC | 15:14 | |
*** e0ne has joined #openstack-rally | 15:15 | |
*** itlinux has quit IRC | 15:15 | |
*** itlinux has joined #openstack-rally | 15:17 | |
*** itlinux has quit IRC | 15:19 | |
*** luksky has joined #openstack-rally | 15:21 | |
*** itlinux has joined #openstack-rally | 15:21 | |
*** itlinux has quit IRC | 15:49 | |
openstackgerrit | Will Szumski proposed openstack/rally master: Allow regular expressions in skip-list https://review.opendev.org/661342 | 15:49 |
*** zul has quit IRC | 15:49 | |
*** itlinux has joined #openstack-rally | 15:50 | |
*** itlinux has quit IRC | 15:55 | |
*** e0ne has quit IRC | 16:04 | |
*** itlinux has joined #openstack-rally | 16:31 | |
*** itlinux has quit IRC | 17:01 | |
*** itlinux_ has joined #openstack-rally | 17:01 | |
*** itlinux_ has quit IRC | 17:01 | |
*** itlinux has joined #openstack-rally | 17:15 | |
*** itlinux has quit IRC | 17:16 | |
*** itlinux has joined #openstack-rally | 17:19 | |
*** itlinux_ has joined #openstack-rally | 17:21 | |
*** itlinux has quit IRC | 17:25 | |
*** itlinux_ has quit IRC | 17:47 | |
*** pcaruana has quit IRC | 17:53 | |
*** e0ne has joined #openstack-rally | 17:54 | |
*** e0ne has quit IRC | 18:26 | |
*** e0ne has joined #openstack-rally | 18:31 | |
*** pcaruana has joined #openstack-rally | 18:48 | |
*** pcaruana has quit IRC | 18:48 | |
*** luksky has quit IRC | 19:01 | |
*** tosky has quit IRC | 19:16 | |
*** juhak has quit IRC | 20:23 | |
*** juhak has joined #openstack-rally | 20:24 | |
*** e0ne has quit IRC | 21:40 | |
*** rallydev-bot has quit IRC | 21:42 | |
*** luksky has joined #openstack-rally | 23:04 | |
*** rcernin has joined #openstack-rally | 23:05 | |
*** rcernin has quit IRC | 23:11 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!