| *** galstrom is now known as galstrom_zzz | 00:22 | |
| *** hj-hpe has quit IRC | 00:37 | |
| openstackgerrit | Imran Hayder Malik proposed openstack/defcore: Flag test_volume_list_paginations tests https://review.openstack.org/382120 | 00:37 |
|---|---|---|
| *** woodster_ has quit IRC | 01:50 | |
| masayukig | dmellado : Thanks :) I also sent an email to the defcore ML about this. | 02:01 |
| *** tongli has quit IRC | 03:38 | |
| *** markvoelker has quit IRC | 03:48 | |
| *** markvoelker has joined #openstack-defcore | 04:49 | |
| *** markvoelker has quit IRC | 04:54 | |
| *** markvoelker has joined #openstack-defcore | 05:50 | |
| *** markvoelker has quit IRC | 05:55 | |
| *** pcaruana has joined #openstack-defcore | 06:46 | |
| *** markvoelker has joined #openstack-defcore | 06:51 | |
| *** Rockyg has joined #openstack-defcore | 06:52 | |
| *** markvoelker has quit IRC | 06:56 | |
| *** hogepodge has quit IRC | 07:21 | |
| *** markvoelker has joined #openstack-defcore | 07:51 | |
| *** markvoelker has quit IRC | 07:56 | |
| *** pilgrimstack has joined #openstack-defcore | 08:00 | |
| *** hogepodge has joined #openstack-defcore | 08:11 | |
| *** kbaikov has joined #openstack-defcore | 08:17 | |
| *** markvoelker has joined #openstack-defcore | 08:52 | |
| *** markvoelker has quit IRC | 08:57 | |
| *** markvoelker has joined #openstack-defcore | 09:53 | |
| *** gema has quit IRC | 09:56 | |
| *** markvoelker has quit IRC | 09:58 | |
| *** gema has joined #openstack-defcore | 10:33 | |
| *** markvoelker has joined #openstack-defcore | 10:54 | |
| *** markvoelker has quit IRC | 10:59 | |
| *** rcarrillocruz has joined #openstack-defcore | 11:31 | |
| *** markvoelker has joined #openstack-defcore | 11:54 | |
| *** markvoelker has quit IRC | 11:59 | |
| *** markvoelker has joined #openstack-defcore | 12:44 | |
| *** MarkBaker has quit IRC | 12:56 | |
| *** edmondsw has joined #openstack-defcore | 12:59 | |
| *** MarkBaker has joined #openstack-defcore | 13:01 | |
| *** tongli has joined #openstack-defcore | 13:28 | |
| *** MarkBaker has quit IRC | 13:55 | |
| *** MarkBaker has joined #openstack-defcore | 13:55 | |
| *** galstrom_zzz is now known as galstrom | 14:07 | |
| *** hj-hpe has joined #openstack-defcore | 14:28 | |
| *** hj-hpe has quit IRC | 14:38 | |
| *** edmondsw has quit IRC | 14:38 | |
| *** hogepodge has quit IRC | 14:38 | |
| *** mugsie has quit IRC | 14:38 | |
| *** wendar has quit IRC | 14:38 | |
| *** mugsie has joined #openstack-defcore | 14:39 | |
| *** hj-hpe has joined #openstack-defcore | 14:39 | |
| *** edmondsw has joined #openstack-defcore | 14:39 | |
| *** wendar has joined #openstack-defcore | 14:39 | |
| *** hogepodge has joined #openstack-defcore | 14:39 | |
| *** woodburn has quit IRC | 14:59 | |
| eglute_s | thanks notmyname! | 15:01 |
| *** pcaruana has quit IRC | 15:13 | |
| *** galstrom is now known as galstrom_zzz | 15:31 | |
| *** shamail_ has joined #openstack-defcore | 16:22 | |
| *** woodster_ has joined #openstack-defcore | 16:26 | |
| *** shamail_ has quit IRC | 16:28 | |
| *** shamail_ has joined #openstack-defcore | 16:29 | |
| *** shamail_ has quit IRC | 16:33 | |
| *** shamail_ has joined #openstack-defcore | 16:33 | |
| *** MarkBaker has quit IRC | 16:39 | |
| shamail_ | . | 16:43 |
| *** MarkBaker has joined #openstack-defcore | 16:51 | |
| *** shamail_ has quit IRC | 16:52 | |
| *** galstrom_zzz is now known as galstrom | 16:58 | |
| *** catherine_d|1 has joined #openstack-defcore | 17:00 | |
| markvoelker | catherine_d|1: sure, what's up? | 17:01 |
| Rockyg | o/ | 17:01 |
| catherine_d|1 | When people run Tempest tests, sometime tests fail for a legitimate reason ... some users will update Tempest test to pass the the tests | 17:02 |
| catherine_d|1 | I think it is better for users to submit a patch to flag the tests while waiting for a patch in Tempest .. | 17:03 |
| markvoelker | Agreed. The whole idea here is that everyone runs the same tests and therefore verifies the same behavior. | 17:03 |
| catherine_d|1 | how do we first inform users about that .. and of course there is no way for us to enforce | 17:04 |
| markvoelker | catherine_d|1: Seems like the simple thing to do is denote that in the instructions on the openstack.org/interop page, and then maybe stick a clause in the legal agreement saying something to the effect of "we hereby declare on penalty of voiding this agreement that we didn't alter the tests" | 17:05 |
| catherine_d|1 | if we all remember, earlier we had a.case where a tempest skipped test was shown as passing in one the vendor test ... that is the same situation because the user alter the test. | 17:06 |
| catherine_d|1 | yea... | 17:06 |
| markvoelker | The website actually links to a text file in our repo. It would be pretty trivial to put something in there about not modifying the tests and how to submit flags. I'll add that to my to-do list | 17:07 |
| markvoelker | Probably something I can bang out over lunch | 17:08 |
| * markvoelker realizes it is, in fact, past lunchtime here on the east coast | 17:08 | |
| catherine_d|1 | markvoelker: hogepodge: it may also be a good topic to bring up at the summit session | 17:08 |
| catherine_d|1 | ok let's note and discuss later ,, | 17:09 |
| markvoelker | And for anyone listening in: FYI there is a flag request posted now for those tests: https://review.openstack.org/#/c/382120/ | 17:10 |
| Rockyg | So a question -- should they file a flag request or a flag rquest and bug rport? We can ask the QA team to inform us of any bugs filed against dfcore tests | 17:12 |
| markvoelker | Rockyg: The flag request typically includes a bug ID. See D401 in https://github.com/openstack/defcore/blob/master/HACKING.rst#defcore-test-flagging-guidelines | 17:13 |
| Rockyg | Ah. thanks. been forever since i read those | 17:15 |
| catherine_d|1 | mostly the test data upload to RefSrack should be run with any Tempest version as-is no alteration (alteration should be for debug only) | 17:16 |
| * catherine_d|1 markvoelker: should go for lunch and Rockyg: catherine_d|1: will go for coffee break .. | 17:16 | |
| Rockyg | ++ | 17:17 |
| *** catherine_d|1 has quit IRC | 17:18 | |
| *** galstrom is now known as galstrom_zzz | 19:02 | |
| *** galstrom_zzz is now known as galstrom | 19:03 | |
| *** galstrom is now known as galstrom_zzz | 20:05 | |
| openstackgerrit | Mark T. Voelker proposed openstack/defcore: Add Guidance on Modifying Tests, Filing Flags https://review.openstack.org/382651 | 20:28 |
| markvoelker | catherined|1: ^^ | 20:30 |
| catherineD | markvoelker: Hi | 20:30 |
| *** galstrom_zzz is now known as galstrom | 20:31 | |
| openstackgerrit | Mark T. Voelker proposed openstack/defcore: Add Guidance on Modifying Tests, Filing Flags https://review.openstack.org/382651 | 20:32 |
| markvoelker | catherineD: took a stab at adding guidance about modifying tests per our discussion earlier | 20:33 |
| catherineD | thx | 20:33 |
| openstackgerrit | Ken'ichi Ohmichi proposed openstack/defcore: Change https://review.openstack.org/382653 | 20:47 |
| openstackgerrit | Ken'ichi Ohmichi proposed openstack/defcore: Change a compute-volume-get test https://review.openstack.org/382653 | 20:47 |
| *** edmondsw has quit IRC | 21:53 | |
| *** hj-hpe has quit IRC | 22:33 | |
| *** galstrom is now known as galstrom_zzz | 23:03 | |
| openstackgerrit | Merged openstack/defcore: Change compute-servers-delete test https://review.openstack.org/371180 | 23:04 |
| *** markvoelker has quit IRC | 23:22 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!