Friday, 2015-12-04

*** rbak has joined #openstack-qa00:03
*** nicholasgoracke has joined #openstack-qa00:06
*** rbrndt has quit IRC00:07
*** agireud has quit IRC00:07
*** weshay_xchat has quit IRC00:08
devanandaianw: the bug is that, no matter what cleaning steps are defined, none of them will get run by any driver00:08
devanandaianw: there is only one defined upstream, and it is skipped in most drivers right now, because it takes too long00:08
devanandaianw: in fixing the bug, we uncovered a test that actually would run that step, so we need to skip it there too00:09
devanandaianw: we will _also_ need to do something else so that we can ensure cleaning is tested. skipping the only step means we aren't testing it right now00:09
devanandaianw: also, thanks for the review00:09
*** nicholasgoracke has quit IRC00:10
ianwdevananda: right, pretty much what i thought.  is it the lack of nested-kvm that makes it so slow? or just that it's doing military grade shreds that's slow at the best of times?00:10
devanandaianw: both :)00:11
*** zhangjn has joined #openstack-qa00:13
*** agireud has joined #openstack-qa00:13
*** sileht has quit IRC00:15
*** woodster_ has quit IRC00:16
*** agireud has quit IRC00:18
gmannmtreinish: done, just 1 fix in hacking.rst00:18
*** jasonsb has joined #openstack-qa00:18
*** akshai has quit IRC00:19
mtreinishgmann: thanks, I'll respin right now00:20
openstackgerritMatthew Treinish proposed openstack/tempest: Use the idempotent id and tooling from tempest-lib  https://review.openstack.org/25327200:21
*** agireud has joined #openstack-qa00:21
mtreinishgmann: ^^^00:21
*** sileht has joined #openstack-qa00:27
*** Swami has quit IRC00:27
*** zhangjn has quit IRC00:28
*** devananda has quit IRC00:28
*** amotoki has joined #openstack-qa00:28
openstackgerritIan Wienand proposed openstack-dev/devstack: Only use lsb_release for distro tags  https://review.openstack.org/11710400:29
*** yamamoto has quit IRC00:36
*** agireud has quit IRC00:42
gmannmtreinish: regarding https://review.openstack.org/#/c/247278/00:42
gmannmtreinish: will not project-config will take stable branch devstack for stable branch jobs on master and on devstack stable branch  do not set microversion on tempest00:44
gmannmtreinish: or missing something ?00:44
*** amotoki has quit IRC00:44
mtreinishgmann: that works until the mitaka release00:44
mtreinishgmann: and we want to enable the microversion tests on stable too00:44
gmannmtreinish: but we want to enable on stable branch from mitaka onward00:45
gmannmtreinish:  i mean for kilo, liberty we do not want to run microversion tests00:46
gmannmtreinish: and from mitaka we will run all applicable microversions tests, even that is stable branch in N00:48
mtreinishgmann: why not? tempest is branchless so we should start running it on liberty and kilo00:48
mtreinishgmann: nova 2.2 was available in liberty right, why wouldn't you test it there too?00:49
gmannmtreinish: actually on kilo it would not work as devstack makes  tests to run on /v2.0 (not on /v2.1 which is added in liberty)00:50
mtreinishok, then we can ignore kilo, because that's just annoying00:50
gmannmtreinish: yea for liberty it will work but as discussed earlier sdague mentioned we can skip running on stable branches00:50
gmannmtreinish: ok, for liberty we can run00:51
mtreinishgmann: ok, but even if we ignore liberty you're only making life diffult in a few months00:51
mtreinishs/diffult/difficult00:51
gmannmtreinish: you mean when mitaka becomes stable?00:52
mtreinishbecause when we release mitaka and start working on N things won't behave as expected00:52
mtreinishyes00:52
gmannmtreinish: it should work right? for mitaka stable branch tests will allow to run all applicable versions tests00:52
mtreinishgmann: it works until you add a test for microversion 2.30 which is added in N and doesn't exist in mitaka00:53
mtreinishthen mitaka tries to run the test and the microversion doesnt exist00:53
mtreinishwhich is why you should encode the default max microversion in devstack, because only devstack knows which version of the code is deployed (and therefore which microversions are available)00:54
*** devananda has joined #openstack-qa00:54
openstackgerritMatthew Treinish proposed openstack/openstack-health: Make date window for job pages longer for periodic jobs  https://review.openstack.org/25321400:54
gmannmtreinish: ah yea, we need to cap version on mitaka on release like you mentioned as for extensions list00:54
mtreinishyep00:54
gmannmtreinish: actually making default on devstack would not work for v2 jobs (i replied on patch)00:55
mtreinishgmann: right, which is why it's a default that you can override00:55
mtreinishyou update the job definitions for the v2 jobs to not set a microversion (or set 2.0)00:55
mtreinishyou went about things backwards00:55
gmannmtreinish: i see00:56
* gmann thinking00:56
mtreinishor you add logic to devstack when it does a 2.0 only deploy to not set the microversion options in tempest, because devstack presumably knows about that too00:57
gmannmtreinish: yea that is nice, so we can avoid any project-config changes right00:58
gmannmtreinish: but we need to update devstack each time on release right00:58
mtreinishgmann: you would have too anyway00:58
*** hichihara has joined #openstack-qa00:59
mtreinishit's the same thing with the extension lists today00:59
* mtreinish checks if he remembered to do that on liberty00:59
gmannmtreinish: yea, and how we coordinate that on release, its something we need to mention somewhere or on failure we update ?01:00
mtreinishgmann: I'd put it on: https://wiki.openstack.org/wiki/QA/releases#Things_to_remember_when_creating_a_stable_branch01:00
mtreinishgmann: although the failure case is a good fallback01:00
mtreinishit'd be better to be proactive about it, but when a failure is hit it'll remind us quickly :)01:01
*** zhangjn has joined #openstack-qa01:01
gmannmtreinish: yea, thats nice.01:01
gmannmtreinish:  i will update patches and wiki too. with that we can have 2.2 mivrocersion tests running and check its all fine on all jobs01:02
gmannmtreinish: thanks :)01:02
mtreinishgmann: sure, np01:02
*** eil397 has quit IRC01:02
* mtreinish is excited to have microversion support finally :)01:02
gmannme too :)01:03
*** agireud has joined #openstack-qa01:12
*** agireud has quit IRC01:14
*** eil397 has joined #openstack-qa01:14
*** pvaneck has quit IRC01:17
*** yamamoto has joined #openstack-qa01:21
openstackgerritJohn Warren proposed openstack/tempest: Split out Neutron metering label rules client  https://review.openstack.org/25313301:23
gmannmtreinish: sdague another idea to avoid devstack change on each release is to discover max supported version from Nova and set on tempest ?01:24
*** jecarey has joined #openstack-qa01:25
*** mriedem has joined #openstack-qa01:29
*** jecarey has quit IRC01:29
*** agireud has joined #openstack-qa01:30
*** mtanino has quit IRC01:32
*** agireud has quit IRC01:34
openstackgerritRamy Asselin proposed openstack-infra/elastic-recheck: Make Elastic Recheck Watch more reusable  https://review.openstack.org/25151501:42
openstackgerritMasayuki Igawa proposed openstack-infra/subunit2sql: Add docstrings of test_ids  https://review.openstack.org/25222301:42
mtreinishgmann: discovery potentially masks errors, so we shouldn't do it automatically01:45
mtreinishthat's the whole reason we added config options for this to tempest01:46
gmannmtreinish: yea on tempest side i agree but on devstack we can do? :)01:48
*** agireud has joined #openstack-qa01:48
mtreinishit defeats the purpose to do it in devstack...01:48
mtreinishgmann: for microversions it's very easy to push a patch there is only one max version available for a single service01:48
mtreinishextensions list is much harder01:48
gmannmtreinish: yea, only thinking about sdague concern not to make devstack keep changes but yea discovery might be end up with wrong configuration etc01:51
*** TC01 has joined #openstack-qa01:51
gmannmtreinish: lets do without discovery and if we feel it is overhead of changing on each release then we can think those later01:52
gmannthanks01:52
*** agireud has quit IRC01:53
openstackgerritRamy Asselin proposed openstack-infra/elastic-recheck: Make Elastic Recheck Watch more reusable  https://review.openstack.org/25151501:57
*** eil397 has quit IRC01:58
*** salv-orlando has joined #openstack-qa02:02
*** agireud has joined #openstack-qa02:03
*** salv-orlando has quit IRC02:07
*** agireud has quit IRC02:07
*** amotoki has joined #openstack-qa02:13
*** sabeen has joined #openstack-qa02:16
*** markvoelker has quit IRC02:40
*** mateusz_ has joined #openstack-qa02:43
*** mateusz_ has quit IRC02:44
*** mateusz_ has joined #openstack-qa02:44
*** mateusz_ has quit IRC02:45
*** mateusz_ has joined #openstack-qa02:45
*** mateusz_ has quit IRC02:46
*** mateusz_ has joined #openstack-qa02:46
*** mateusz_ has quit IRC02:47
*** mateusz_ has joined #openstack-qa02:47
*** mateusz__ has joined #openstack-qa02:47
*** mateusz_ has quit IRC02:48
*** Poornima has joined #openstack-qa02:48
*** mateusz__ has quit IRC02:48
openstackgerritGhanshyam Mann proposed openstack-dev/devstack: Add compute microversions configuration on tempest  https://review.openstack.org/24724602:53
openstackgerritGhanshyam Mann proposed openstack/tempest: Add tests for Nova microversion v2.2  https://review.openstack.org/24499602:54
*** akshai has joined #openstack-qa02:59
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add tests to check migrations and models match  https://review.openstack.org/25330102:59
openstackgerritMasayuki Igawa proposed openstack-infra/subunit2sql: Make graph.py just a module  https://review.openstack.org/25330203:00
*** akshai has quit IRC03:03
*** akshai has joined #openstack-qa03:04
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Enable db api tests on all backends  https://review.openstack.org/25330403:13
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Remove group regex from testr.conf  https://review.openstack.org/25330503:13
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add tests to check migrations and models match  https://review.openstack.org/25330103:20
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Remove group regex from testr.conf  https://review.openstack.org/25330503:20
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Enable db api tests on all backends  https://review.openstack.org/25330403:20
*** hitalia has quit IRC03:23
*** yamahata has quit IRC03:23
openstackgerritxing-yang proposed openstack/tempest: Add tempest tests for CG  https://review.openstack.org/25221303:25
*** tochi has quit IRC03:28
*** hichihara has quit IRC03:36
*** moravec1 has joined #openstack-qa03:39
*** flwang1 has quit IRC03:46
*** jecarey has joined #openstack-qa03:50
*** e0ne_ has joined #openstack-qa03:52
*** zhangjn has quit IRC03:56
*** e0ne_ has quit IRC04:00
*** zhangjn has joined #openstack-qa04:05
*** tochi has joined #openstack-qa04:06
*** stevemar has quit IRC04:09
*** e0ne has joined #openstack-qa04:12
*** stevemar_znc has joined #openstack-qa04:12
*** akshai has quit IRC04:16
*** akshai has joined #openstack-qa04:16
*** e0ne has quit IRC04:16
*** zhangjn has quit IRC04:17
oomichimtreinish: ok, +A04:17
*** zhangjn has joined #openstack-qa04:17
openstackgerritGhanshyam Mann proposed openstack-dev/devstack: Add compute microversions configuration on tempest  https://review.openstack.org/24724604:17
*** zhangjn has quit IRC04:18
oomichimtreinish: can you take a look at https://review.openstack.org/#/c/252739/ instead ?04:19
openstackgerritMerged openstack-infra/subunit2sql: Add docstrings of test_ids  https://review.openstack.org/25222304:19
oomichimtreinish: necessary for bumping tempest-lib version on Tempest04:19
*** jecarey has quit IRC04:22
openstackgerritMerged openstack-infra/subunit2sql: Make graph.py just a module  https://review.openstack.org/25330204:24
*** dpaterson has quit IRC04:26
*** akshai has quit IRC04:26
*** mriedem has quit IRC04:27
*** agireud has joined #openstack-qa04:51
*** salv-orlando has joined #openstack-qa04:51
*** salv-orlando has quit IRC04:56
openstackgerritJacky_lei_zhang proposed openstack/tempest: Make volume_types_client use **kwargs  https://review.openstack.org/25022805:00
*** rfolco has quit IRC05:02
*** rbak has quit IRC05:04
*** mwagner_lap has joined #openstack-qa05:05
*** markvoelker has joined #openstack-qa05:05
*** amotoki_ has joined #openstack-qa05:09
*** markvoelker has quit IRC05:09
*** markvoelker has joined #openstack-qa05:10
*** amotoki_ has quit IRC05:12
*** amotoki has quit IRC05:13
oomichimtreinish: thanks, I was surprized your review on your timezone05:15
oomichimtreinish: good night :)05:15
*** amotoki has joined #openstack-qa05:17
*** amotoki has quit IRC05:17
*** bkopilov has quit IRC05:17
openstackgerritMerged openstack-dev/devstack: Update lib/ironic to always skip cleaning  https://review.openstack.org/25308905:22
*** agireud has quit IRC05:23
*** sabeen3 has joined #openstack-qa05:25
*** agireud has joined #openstack-qa05:26
*** sabeen has quit IRC05:28
*** bkopilov has joined #openstack-qa05:31
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Make create_image use **kwargs  https://review.openstack.org/25131005:35
*** agireud has quit IRC05:35
*** ekhugen has quit IRC05:42
*** ekhugen has joined #openstack-qa05:42
*** timello_ has quit IRC05:43
*** timello has joined #openstack-qa05:45
*** markvoelker_ has joined #openstack-qa05:47
*** armax has quit IRC05:48
*** markvoelker has quit IRC05:50
*** sabeen3 has quit IRC05:51
*** markvoelker_ has quit IRC05:51
*** salv-orlando has joined #openstack-qa05:52
*** sabeen1 has joined #openstack-qa05:52
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Make create_floating_ip use **kwargs  https://review.openstack.org/25277805:53
*** hoangcx has joined #openstack-qa05:53
*** hoangcx has left #openstack-qa05:53
*** salv-orl_ has joined #openstack-qa05:56
*** salv-orlando has quit IRC05:56
*** salv-orl_ has quit IRC05:56
*** salv-orlando has joined #openstack-qa05:57
openstackgerritTakashi NATSUME proposed openstack/tempest: Use container/disk format settings in glance v1 test  https://review.openstack.org/21877506:01
*** salv-orlando has quit IRC06:10
*** pc_m has quit IRC06:10
*** pc_m has joined #openstack-qa06:11
*** rcernin has joined #openstack-qa06:12
*** sabeen1 has quit IRC06:18
*** jdandrea has quit IRC06:19
*** jdandrea has joined #openstack-qa06:22
*** amotoki has joined #openstack-qa06:30
*** jlk has quit IRC06:41
*** jlk has joined #openstack-qa06:41
*** oomichi has quit IRC06:46
*** agireud has joined #openstack-qa06:50
*** agireud has quit IRC06:54
*** rcernin has quit IRC06:59
*** agireud has joined #openstack-qa07:04
*** rcernin has joined #openstack-qa07:07
*** tochi has quit IRC07:08
*** tochi has joined #openstack-qa07:09
*** agireud has quit IRC07:09
*** neeti has joined #openstack-qa07:12
*** tochi has quit IRC07:31
*** safchain has joined #openstack-qa07:41
*** salv-orlando has joined #openstack-qa07:44
*** grafuls has joined #openstack-qa07:45
*** yamahata has joined #openstack-qa07:54
*** rossella_s has joined #openstack-qa08:04
*** yamahata has quit IRC08:13
*** Poornima has quit IRC08:16
*** maht has quit IRC08:22
*** Poornima has joined #openstack-qa08:26
openstackgerritGhanshyam Mann proposed openstack/tempest: Handle StrOpt config option of microversion  https://review.openstack.org/25338008:30
*** Poornima has left #openstack-qa08:30
*** maht has joined #openstack-qa08:31
openstackgerritPiyush Pathak proposed openstack/tempest: Make add_router_to_l3_agent use **kwargs  https://review.openstack.org/25283908:31
*** ifarkas has joined #openstack-qa08:32
*** neeti has quit IRC08:34
*** neeti has joined #openstack-qa08:34
*** dmellado has joined #openstack-qa08:35
*** Poornima has joined #openstack-qa08:35
*** _nadya_ has joined #openstack-qa08:37
*** jlanoux has joined #openstack-qa08:40
*** vgridnev has quit IRC08:40
*** salv-orlando has quit IRC08:42
*** tochi has joined #openstack-qa08:44
openstackgerritMerged openstack/tempest: Rename private methods of glance_http  https://review.openstack.org/25133008:44
openstackgerritPiyush Pathak proposed openstack/tempest: Make update_extra_routes use **kwargs & doc string  https://review.openstack.org/25286208:44
openstackgerritMaho Koshiya proposed openstack/tempest: Add OS-INHERIT of keystone v3 in api tempest  https://review.openstack.org/25079508:47
*** salv-orlando has joined #openstack-qa08:48
openstackgerritMerged openstack/tempest: Remove unused json_request()  https://review.openstack.org/25133208:53
*** oomichi has joined #openstack-qa08:55
openstackgerritGhanshyam Mann proposed openstack-dev/devstack: Add compute microversions configuration on tempest  https://review.openstack.org/24724608:55
openstackgerritGhanshyam Mann proposed openstack/tempest: Add compute client base class for microversion support  https://review.openstack.org/24234609:00
openstackgerritGhanshyam Mann proposed openstack/tempest: Add logic to select the request microversion  https://review.openstack.org/24443909:00
openstackgerritGhanshyam Mann proposed openstack/tempest: Add support of schema versioning for microversion  https://review.openstack.org/24497409:00
openstackgerritGhanshyam Mann proposed openstack/tempest: Add tests for Nova microversion v2.2  https://review.openstack.org/24499609:01
*** tochi has quit IRC09:03
*** dims_ has quit IRC09:05
*** shardy has joined #openstack-qa09:05
*** gfidente has joined #openstack-qa09:08
*** gfidente has quit IRC09:08
*** gfidente has joined #openstack-qa09:08
*** dims has joined #openstack-qa09:11
*** shardy has quit IRC09:17
*** dims has quit IRC09:23
*** jordanP has joined #openstack-qa09:24
*** shardy has joined #openstack-qa09:25
*** hop|2 has joined #openstack-qa09:27
-openstackstatus- NOTICE: Tox tests are broken at the moment. From openstack-infra we are working to fix them. Please don't approve changes until we notify that tox tests work again.09:31
openstackgerritMasayuki Igawa proposed openstack/os-testr: Fix coverage section in tox.ini  https://review.openstack.org/25340709:32
*** dims has joined #openstack-qa09:34
*** vgridnev has joined #openstack-qa09:34
*** shardy has quit IRC09:34
*** dtantsur|afk is now known as dtantsur09:35
openstackgerritPiyush Pathak proposed openstack/tempest: Make update_extra_routes use **kwargs & doc string  https://review.openstack.org/25286209:35
openstackgerritMasayuki Igawa proposed openstack/os-testr: [WIP] Add unit test for colorizer  https://review.openstack.org/25340909:36
*** shardy has joined #openstack-qa09:37
*** shardy has quit IRC09:43
*** shardy has joined #openstack-qa09:46
openstackgerritDaniel Mellado proposed openstack/tempest: Split out keystone tenant client  https://review.openstack.org/24817009:49
*** ansiwen has quit IRC09:52
*** salv-orlando has quit IRC09:52
*** slunkad has joined #openstack-qa09:53
openstackgerritMasayuki Igawa proposed openstack/os-testr: [WIP] Add unit test for colorizer  https://review.openstack.org/25340909:55
*** kevinbenton has quit IRC10:01
*** yfried has quit IRC10:03
*** kevinbenton has joined #openstack-qa10:04
*** apevec has joined #openstack-qa10:06
*** apevec has quit IRC10:06
*** apevec has joined #openstack-qa10:06
*** salv-orlando has joined #openstack-qa10:10
openstackgerritGhanshyam Mann proposed openstack/tempest: Make v1 list_images use **kwargs & doc string update  https://review.openstack.org/25229110:15
openstackgerritPiyush Pathak proposed openstack/tempest: Make v3 update_user_password use **kwargs  https://review.openstack.org/25341910:15
*** slunkad has quit IRC10:24
*** slunkad has joined #openstack-qa10:25
*** ansiwen has joined #openstack-qa10:27
*** neeti has quit IRC10:29
*** agireud has joined #openstack-qa10:29
*** kbaikov has quit IRC10:30
*** openstackgerrit has quit IRC10:32
*** neeti has joined #openstack-qa10:32
*** openstackgerrit has joined #openstack-qa10:32
*** agireud has quit IRC10:34
*** kbaikov has joined #openstack-qa10:37
*** Poornima has quit IRC10:38
*** dzamboni has joined #openstack-qa10:39
*** gszasz has joined #openstack-qa10:42
openstackgerritMerged openstack/tempest: Remove unused agents's schema  https://review.openstack.org/25279910:51
*** neeti has quit IRC10:51
*** tosky has joined #openstack-qa10:52
*** vgridnev has quit IRC10:52
*** vgridnev has joined #openstack-qa10:54
openstackgerritMerged openstack/tempest: Use the idempotent id and tooling from tempest-lib  https://review.openstack.org/25327210:54
lewooomichi, jordanP [232432] Thanks for your reviews. I've pushsed a new patch set according to your remarks. If you could have a look when you have time...;)11:02
*** salv-orlando has quit IRC11:07
openstackgerritJoseph Lanoux proposed openstack/tempest: Update configuration options ssh-auth-strategy  https://review.openstack.org/25344411:12
*** yamamoto has quit IRC11:14
openstackgerritJoseph Lanoux proposed openstack/tempest: Update configuration options ssh-auth-strategy  https://review.openstack.org/25344411:14
*** aysyd has joined #openstack-qa11:17
*** salv-orlando has joined #openstack-qa11:18
*** piyush_ has joined #openstack-qa11:20
openstackgerritJoseph Lanoux proposed openstack/tempest: Update configuration options ssh-auth-strategy  https://review.openstack.org/25344411:32
*** salv-orlando has quit IRC11:36
openstackgerritJoseph Lanoux proposed openstack/tempest: Update configuration options ssh-auth-strategy  https://review.openstack.org/25344411:40
*** erlon has joined #openstack-qa11:44
openstackgerritJoseph Lanoux proposed openstack/tempest: Update configuration options ssh-auth-strategy  https://review.openstack.org/25344411:45
openstackgerritMerged openstack/tempest: Rename image_client to images_client  https://review.openstack.org/25131711:53
ylobankovgmann: ping11:55
*** yamamoto has joined #openstack-qa12:04
ylobankovgmann, oomichi, jordanP, andreaf: hi. could you please take a look https://review.openstack.org/#/c/252432/ and https://review.openstack.org/#/c/252467/12:07
*** yamamoto has quit IRC12:08
dmelladoI'll take a look too ylobankov ;)12:09
ylobankovdmellado: Thanks :)12:09
*** dtantsur is now known as dtantsur|brb12:09
openstackgerritGhanshyam Mann proposed openstack/tempest: Add tests for Nova microversion v2.2  https://review.openstack.org/24499612:16
*** gmann_ has joined #openstack-qa12:19
gmann_mtreinish: sdague andreaf oomichi  - please review microversion testing set - https://review.openstack.org/#/q/status:open++branch:master+topic:bp/api-microversions-testing-support,n,z12:19
gmann_now it will pass on gate12:19
*** gmann_ has quit IRC12:25
*** _nadya_ has quit IRC12:46
*** dtantsur|brb is now known as dtantsur12:46
*** cdent has joined #openstack-qa12:50
sdaguegmann: is there a devstack-gate or project config change up there somewhere?12:51
*** salv-orlando has joined #openstack-qa12:54
*** weshay_xchat has joined #openstack-qa12:55
*** salv-orlando has quit IRC12:58
openstackgerritMerged openstack/tempest: Switch run_tests.sh to use subunit-trace  https://review.openstack.org/25312113:05
*** cdent has quit IRC13:09
*** cdent has joined #openstack-qa13:09
*** piyush_ has quit IRC13:12
*** yamamoto has joined #openstack-qa13:22
*** slunkad has quit IRC13:26
*** yamamoto has quit IRC13:26
*** rfolco has joined #openstack-qa13:28
openstackgerritAnkit Agrawal proposed openstack/tempest: Add test for glance's tasks API  https://review.openstack.org/21666513:31
*** regXboi has joined #openstack-qa13:35
*** david-lyle has quit IRC13:43
*** sayali has joined #openstack-qa13:47
*** markvoelker has joined #openstack-qa13:47
*** cdent has quit IRC13:57
*** mriedem has joined #openstack-qa13:59
*** mhorban_ has joined #openstack-qa14:00
*** alaski is now known as lascii14:04
mriedemsdague: mtreinish: looks like the ebs test is regressed in the last 24 hours14:06
mriedemhttp://logs.openstack.org/59/252659/1/check/gate-tempest-dsvm-full-ceph/31dc302/console.html#_2015-12-03_20_09_28_87414:07
mriedemhttp://logstash.openstack.org/#dashboard/file/logstash.json?query=message:%5C%22Details:%20%7Bu'message':%20u'Invalid%20volume:%20Volume%20still%20has%201%20dependent%20snapshots.',%20u'code':%20400%7D%5C%22%20AND%20tags:%5C%22console%5C%2214:07
mriedemonly in the ceph jobs14:07
mriedemjbernard: ^14:07
mriedemfailing on all branches14:09
*** cdent has joined #openstack-qa14:10
mriedemtracking here https://bugs.launchpad.net/cinder/+bug/152029614:11
openstackLaunchpad bug 1520296 in Cinder "tempest test failed test_create_ebs_image_and_check_boot" [High,Confirmed]14:11
*** dustins has joined #openstack-qa14:12
*** dkranz has joined #openstack-qa14:12
*** salv-orlando has joined #openstack-qa14:16
*** markvoelker has quit IRC14:21
*** TuanNguyen has joined #openstack-qa14:26
mriedemsdague: this looks like the problem https://review.openstack.org/#/c/251421/14:27
*** cdent has quit IRC14:27
*** cdent has joined #openstack-qa14:28
jbernardmriedem: i didn't realize the gate was using the new plugin14:39
openstackgerritMartin Hickey proposed openstack-dev/devstack: Neutron VPNaaS: Use generated configuration files if available  https://review.openstack.org/25353014:43
*** akshai has joined #openstack-qa14:44
samueldmqhi, I have a change that fits in http://docs.openstack.org/developer/tempest/HACKING.html#bug-fix-on-core-project-needing-tempest-changes14:44
samueldmqbut it also affects stable branches14:44
samueldmqshould I propose the same patch against those branches ?14:45
samueldmqsee https://review.openstack.org/#/c/253270/14:45
openstackgerritJoseph Lanoux proposed openstack/tempest: Update configuration options ssh-auth-strategy  https://review.openstack.org/25344414:48
*** artom has joined #openstack-qa14:52
*** dansmith is now known as superdan14:53
*** rbak has joined #openstack-qa14:54
*** alex_xu is now known as alexus14:56
sdaguejbernard: you looking into that one?14:56
jbernardsdague: im looking, i thought the plugin was a -nv job for observation initially14:56
jbernardsdague: im trying to correct my project-config understanding14:57
jbernardsdague: it would explain why it suddenly change behaviour14:57
*** salv-orlando has quit IRC14:57
*** zz_dimtruck is now known as dimtruck14:57
sdaguejbernard: hmm... yeh, that shouldn't impact this14:59
sdaguemriedem: this isn't failing all the jobs15:00
sdagueI also don't think the plugin is being used in the main job runs15:01
*** tnguyen has quit IRC15:05
*** mfisher_ora has joined #openstack-qa15:06
*** patrickeast has quit IRC15:07
*** patrickeast has joined #openstack-qa15:08
*** shardy has quit IRC15:08
openstackgerritAlexander Gubanov proposed openstack/tempest: WIP: Add tests for API microversion with instance tags  https://review.openstack.org/23317615:10
*** salv-orlando has joined #openstack-qa15:12
*** ir2ivps6 has quit IRC15:12
sdaguedtroyer: https://review.openstack.org/#/c/252372/15:16
sdaguetrying to help the bleeding a bit15:17
*** jecarey has joined #openstack-qa15:23
*** yamahata has joined #openstack-qa15:24
*** jecarey has quit IRC15:24
*** jecarey has joined #openstack-qa15:25
*** rbrndt has joined #openstack-qa15:26
*** sayali has quit IRC15:26
openstackgerritMerged openstack-infra/elastic-recheck: the timeout query isn't helping anything, it's just masking failures  https://review.openstack.org/25298515:27
*** nadya has joined #openstack-qa15:29
*** mriedem has quit IRC15:30
*** nadya is now known as Guest2673615:30
*** Guest26736 is now known as _nadya_15:31
*** mtanino has joined #openstack-qa15:31
*** tnguyen has joined #openstack-qa15:35
*** openstackrecheck has joined #openstack-qa15:37
*** vgridnev has quit IRC15:39
*** vgridnev has joined #openstack-qa15:40
*** lucasagomes is now known as lucas-hungry15:41
*** salv-orlando has quit IRC15:44
*** dustins has quit IRC15:45
*** markvoelker has joined #openstack-qa15:45
*** shardy has joined #openstack-qa15:46
*** cdent has quit IRC15:57
*** pglass has joined #openstack-qa15:58
*** cdent has joined #openstack-qa15:58
kashyapsdague: Got a moment to see if this ER query makes sense? - https://review.openstack.org/#/c/253134/15:59
sdaguekashyap: yeh, though have we figured out why that is?16:00
sdaguebecause I was looking through cinder logs and didn't see anything obvious16:01
kashyapsdague: Have to investigate, ETOOMANYBUGS :-(16:01
kashyapsdague: What's worse - I can't see it on multiple runs16:01
sdagueoh, it's only in multinode....16:01
*** sabeen1 has joined #openstack-qa16:02
sdagueit's also only on ovh16:02
*** grafuls has quit IRC16:05
*** hop|2 has quit IRC16:10
kashyapsdague: "ovh"?  (Sorry for truncated attention, had to attend something at the door)16:15
kashyapYes, it's only multi-node16:15
kashyapAh, you're being badgered on -nova too, take your time.16:15
*** armax has joined #openstack-qa16:18
*** vgridnev has quit IRC16:18
*** lucas-hungry is now known as lucasagomes16:19
sdagueovh is one of our providers16:20
sdaguekashyap: anyway, yes, this is a good query, +A16:20
kashyapI see16:20
kashyapThanks for reviewing.16:21
sdaguekashyap: I suspect this is going to be a bug we're going to need to look at quite a bit soon, so as much detail as you can add to it would be great16:22
kashyapsdague: Certainly.  I've downloaded the logs locally to investigate, and try to artificially reproduce16:22
sdagueyeh, I expect it's a timing issue16:22
sdagueit should be all in the nova side though, that mount is made by nova-compute16:23
sdagueI kind of wonder if the mount is hanging16:23
openstackgerritMerged openstack-infra/elastic-recheck: Add a query for libvirt error when 'TestBootVolumePattern' fails  https://review.openstack.org/25313416:23
kashyapafazekas: ^ You also mentioned here you've seen it a couple of times.16:23
kashyapsdague: Have you seen before at all such kind of mounts hanging in this context?16:24
sdagueI've seen them in other places16:24
afazekaskashyap, 'Normally' this issue can happen when you do not have the required kernel module16:24
*** kbaikov has quit IRC16:25
kashyapafazekas:  iscsi_target_mod?16:25
afazekassomething like that16:25
kashyapAnd, 'target_core_mod16:25
kashyap'16:25
afazekasit aslo can happen if you have some firewall rule..16:26
kashyapafazekas: The Arch wiki says, they're in the Kernel and automatically loaded already16:26
*** dimtruck is now known as zz_dimtruck16:26
kashyapProbably not true for Ubuntu Kernels16:26
*** jecarey has quit IRC16:26
afazekasf23 also does not have everything for iscsi16:26
afazekasyou need to install kernel-modules as well16:27
*** jecarey has joined #openstack-qa16:27
*** jecarey has quit IRC16:27
afazekasLot of other issue can cause this kind of issue..16:27
*** ifarkas has quit IRC16:28
kashyapafazekas: Yeah, seems like one of those cases which involves multiple moving components16:31
*** cdent has quit IRC16:33
*** openstackrecheck has quit IRC16:37
*** zz_dimtruck is now known as dimtruck16:40
*** _nadya_ has quit IRC16:42
*** dramalho has joined #openstack-qa16:43
*** cdent has joined #openstack-qa16:43
*** dpaterson has joined #openstack-qa16:43
*** rfolco has quit IRC16:48
*** david-lyle has joined #openstack-qa16:49
*** rcernin has quit IRC16:52
-openstackstatus- NOTICE: The earlier JJB bug which disrupted tox-based job configurations has been reverted and applied; jobs seem to be running successfully for the past two hours.16:54
*** dtantsur is now known as dtantsur|afk16:54
*** rfolco has joined #openstack-qa16:55
*** jlanoux has quit IRC16:59
jbernardsdague: do you know the site that shows all the failures for a paticular job in the last n minutes?17:00
jbernardsdague: i might be thinking of logstash17:01
sdaguejbernard: yeh, logstash17:01
jbernardsdague: awesome, thanks17:01
*** salv-orlando has joined #openstack-qa17:01
*** dpaterson has quit IRC17:03
*** vgridnev has joined #openstack-qa17:08
sdaguemtreinish / dtroyer - https://review.openstack.org/#/c/252944/ it's time for that one I think17:08
sdaguewe promissed m-117:08
*** david-lyle has quit IRC17:13
*** dramalho has quit IRC17:27
*** yamamoto has joined #openstack-qa17:29
*** dramalho has joined #openstack-qa17:30
*** nic has joined #openstack-qa17:32
*** yamamoto has quit IRC17:34
*** asselin__ has quit IRC17:37
*** jordanP has quit IRC17:40
*** asselin_ has joined #openstack-qa17:41
openstackgerritMerged openstack/tempest: Add script to use tempest-lib files in tempest  https://review.openstack.org/24956017:42
*** yamahata has quit IRC17:45
*** stevemar_znc is now known as stevemar17:47
*** Swami has joined #openstack-qa17:50
*** dpaterson has joined #openstack-qa17:53
openstackgerritAnkit Agrawal proposed openstack/tempest: Add test for glance's tasks API  https://review.openstack.org/21666517:55
*** lezbar has quit IRC18:01
*** lezbar has joined #openstack-qa18:01
*** dustins has joined #openstack-qa18:05
*** maht has quit IRC18:06
*** lezbar has quit IRC18:06
*** diegows has joined #openstack-qa18:07
*** dzamboni has quit IRC18:07
*** mylu has joined #openstack-qa18:09
*** yamahata has joined #openstack-qa18:10
*** safchain has quit IRC18:12
*** erlon has quit IRC18:16
openstackgerritxing-yang proposed openstack/tempest: Add tempest tests for CG  https://review.openstack.org/25221318:31
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Enable db api tests on all backends  https://review.openstack.org/25330418:36
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add tests to check migrations and models match  https://review.openstack.org/25330118:36
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Remove group regex from testr.conf  https://review.openstack.org/25330518:36
*** sabeen1 has quit IRC18:36
*** tosky has quit IRC18:37
mtreinishHenryG: I've got a question, how do you read these failure messages: http://logs.openstack.org/01/253301/2/check/gate-subunit2sql-python27/65835c1/console.html#_2015-12-04_03_25_13_80818:38
mtreinishI'm working on adding model sync tests to subunit2sql and clearly the models aren't synced right, but I'm not sure what the output is indicating18:38
*** eil397 has joined #openstack-qa18:39
mtreinishauggy: I've got a regex question. I'm trying to do a re.match() (I don't have a choice on that) that matches mysql, postgresql, or sqlite anywhere in a string case insensitive18:43
mtreinishif it was re.search() it would be as simple as "(?i)(mysql|postgresql|sqlite)" but the tool uses re.match18:43
mtreinishany ideas?18:43
auggythat's weird that that doesn't work18:43
auggymaybe try ((mysql)|(postgresql)|(sqlite)) ?18:44
auggymtreinish: i'm not as well versed in match vs search but maybe try to group them more explicitly?? not sure18:45
mtreinishauggy: : that doesn't do it: http://paste.openstack.org/show/480917/18:46
mtreinishauggy: iirc match matches from the start of a string, while search matches for anywhere in the string18:46
*** rossella_s has quit IRC18:47
auggyohhhh18:47
auggyso you're looking for those terms embedded in function names and also as arguments within parens?18:47
mtreinishyeah18:47
mtreinishauggy: I'm trying to give testr a scheduler hint to put tests using the same db backend on the same worker18:49
mtreinishit will do regex.match(test_id).group(0) and use that as a group id18:49
auggymtreinish: this is kind of nasty but i got it to match - regex = re.compile("(?i)(mysql|postgresql|sqlite)")18:51
auggywhoops18:51
auggy"(.*?)(mysql|postgresql|sqlite)(.*)18:51
auggypaste vs middle button paste ;D18:51
mtreinishauggy: cool that matches!18:51
auggyyeah but the . is kind of nasty18:52
mtreinishauggy: oh, but group(0) returns the full string18:52
auggyoh no18:52
mtreinishso that won't work because testr will group them individually18:52
auggygroup(2) i think would be the right one18:52
*** flwang1 has joined #openstack-qa18:52
auggyor group(1)18:52
auggygroup(2) returns it18:52
mtreinishauggy: yeah, but I'm not writing the code that does the match :(18:52
mtreinishheh, it kinda sucks18:52
auggyah18:52
auggyoh well for that we can use exclusions18:53
auggylook ahead et al18:53
auggylemme see if i can get that to work18:53
mtreinishauggy: https://github.com/mtreinish/testrepository/blob/master/testrepository/testcommand.py#L572-L581 is what I have to work with :(18:53
mtreinishalthough I was the one who originally contributed that to testr, so it's still my fault I guess :)18:54
auggymtreinish: it seems to be ignoring lookahead syntax18:55
auggyi'll see if match uses that18:56
auggyunless i'm doing it wrong cuz i'm new to python ;)18:56
auggyhahaha man i'm having a rough day, i mixed up lookahead and lookbehind syntax18:56
mtreinishhaha18:57
mtreinishyou've just spent too much time doing python lately18:57
auggyhrm nope the lookahead still isn't working18:58
mtreinishheh, yeah I've been banging my head against this for about an hour18:59
mtreinishbut, I also suck at regex :)18:59
auggyomg i know why18:59
auggyi named the new expression regex218:59
auggyand i've been testing against regex119:00
auggyman i'm special19:00
auggymtreinish: "(?=<.*?\()(mysql|postgresql|sqlite)(?=.*)" <-- almost19:02
auggythe lookbehind isn't working yet19:02
auggyi think it's too general19:02
mtreinishwow, I never would have come up with that :)19:03
mtreinishauggy: hmm, that doesn't seem to match19:04
auggyyeh the first part is what i'm trying to fix19:04
auggyi think it's too general19:04
auggythis part: (?=<.*?\()19:04
*** woodster_ has joined #openstack-qa19:05
*** david-ly_ has joined #openstack-qa19:06
*** cdent has quit IRC19:10
auggybecause it's supposed to be ?<= lol19:12
*** mylu has quit IRC19:13
auggymtreinish: and apparantly python lookbehind assertions must be of a fixed width length19:15
auggythis is what i ended up with: (?<=\w+?\()(mysql|postgresql|sqlite)(?=.*)19:16
auggyand the \w isn't right because you have _ and . in your strings19:16
*** mylu_ has joined #openstack-qa19:17
mtreinishauggy: hmm, when I run re.compile() on that it complains19:17
auggyyeah lookbehind assertions have to be fixed width19:18
mtreinishauggy: yep: http://paste.openstack.org/show/480922/19:18
auggyso what i understand from that if your match can be of a variable length it won't work19:18
auggywhich is so weird19:18
auggyit gives you nothing to work with with match() basically19:18
auggyunless you can guarantee the lookbehind result is the same length19:18
auggybut the lookahead can vary :/19:19
auggythat makes no sense19:19
* mtreinish is confused :)19:19
*** pglass has quit IRC19:19
auggymaybe someone who knows more about python knows more about that restriction and how to get around it19:19
auggythe only thing i can think of is if you can manipulate the string somehow19:20
auggylike break it up and then reassemble it19:20
auggyif you're stuck using match19:20
auggysplit on the () maybe19:20
mtreinishunfotunately I don't have that option, because the test runner is running match over the list of test_ids it will run19:21
mtreinishI can push the patch to testr to switch it to a search()19:21
clarkbmtreinish: auggy the scrollback is large but what are you trying to achieve?19:21
mtreinishI don't think that'll be controversial19:21
mtreinishclarkb: I'm trying to set a testr group regex on the db backend for the subunit2sql tests19:21
mtreinishclarkb: testr does an re.match().group(0) to get the group id19:22
mtreinishclarkb: http://paste.openstack.org/show/480917/ was my early failed attempts19:22
auggyi was trying to use lookbehind and lookahead19:22
auggybut we ran into an issue where python requires lookbehind to be a fixed width or something?19:23
auggythat's so weird19:23
*** mylu_ has quit IRC19:23
clarkbwhat do the strings that you are matching look like?19:23
clarkb(I would be amazed if you need lookbehind19:23
mtreinishclarkb: there are 2:19:23
mtreinishsubunit2sql.tests.db.test_api.TestDatabaseAPI.test_get_test_runs_dicts_with_no_start_time(mysql)19:23
*** mylu has joined #openstack-qa19:23
*** gfidente has quit IRC19:23
mtreinishsubunit2sql.tests.migrations.test_migrations.TestWalkMigrations.test_postgresql_opportunistically19:23
mtreinishwell 2 forms, it's either testscenarios or explicit in the test name19:24
clarkb.*\((\w)\)19:24
auggybut he needs to capture group(0) is the thing19:24
clarkbright isn't that going to capture the \w as group 0?19:25
*** mylu has quit IRC19:25
*** dkranz has quit IRC19:25
mtreinishclarkb: also doesn't that only match the testscenarios case?19:25
*** mylu has joined #openstack-qa19:26
clarkbmtreinish: ah yes need a ? to make the missing (mysql) match19:26
*** dramalho has quit IRC19:26
clarkbso looks like this .*(:?\((\w)\))?19:26
*** dkranz has joined #openstack-qa19:27
clarkbI think :? is don't make this a capture group19:27
mtreinishclarkb: hmm it returns the full string: http://paste.openstack.org/show/480926/19:28
melwittmtreinish: do you happen to know if floating_ip is really required for the _check_network_internal_connectivity in test_network_basic_ops? https://github.com/openstack/tempest/blob/4662ac0/tempest/scenario/test_network_basic_ops.py#L30419:28
melwittmtreinish: I'm trying to cover a gap in cells testing where floating ips are not supported, so we would just want to check if internal network connectivity is working, at a minimum19:29
auggymtreinish: clarkb: ?: seems to be being ignored in match19:30
mtreinishmelwitt: tbh, I'm not sure. Those neutron scenarios are uneccesarily complex imo19:30
auggyi tried replacing my ?>= with it and it didn't work19:30
melwittyeah, ?: is for the non capturinggroup19:30
clarkbah I got them flipped around19:30
mtreinishmelwitt: you might be able to modify the test to not need floating ips, but at the same time floating ips might be part of what's being verified there19:31
*** dustins_ has joined #openstack-qa19:31
melwittmtreinish: heh. yeah, I wasn't sure. I'll consult someone in neutron, I didn't realize that's where it originated19:31
auggyclarkb: mtreinish: so this is the expression i had with lookaheads and lookbehinds: (?<=\.+?\()(mysql|postgresql|sqlite)(?=.+)19:32
*** dustins has quit IRC19:33
mtreinishmelwitt: there an abuse of what I consider "scenario" tests which I've always viewed as being an end user workflow19:33
mtreinishI've never known an end user who wants to do any of the things in those neutron tests :)19:33
melwittmtreinish: I suppose you could stretch it by saying "user wants to ssh into the instance" and all the testing in between is needed to prove that19:34
auggyoh i mispasted something, it's (?<=.+?\()(mysql|postgresql|sqlite)(?=.+)19:35
auggythis is what i get for group(0) using ?: instead of ?<= 'subunit2sql.tests.db.test_api.TestDatabaseAPI.test_get_test_runs_dicts_with_no_start_time(mysql'19:36
*** flwang1 has quit IRC19:36
mtreinishmelwitt: well, except we have other tests that do the ssh thing and don't require all of that weirdness. But, meh they exist, so it's a thing now19:36
clarkbmtreinish: auggy what should group(0) be in the second example above?19:36
clarkbis it supposed to be empty string/none?19:36
melwittmtreinish: oh? maybe I should find those. I searched the repo for "login" to find connectivity tests and test_network_basic_ops is all I found19:37
auggymysql19:37
clarkbauggy: where do you get mysql from in that case?19:37
*** cdent has joined #openstack-qa19:37
*** mylu has quit IRC19:37
clarkbthe first example has (mysql) so thats mysql19:37
clarkbsecond example is postgres19:37
mtreinishclarkb: it should be either mysql, postgresql, or sqlite19:37
*** mylu has joined #openstack-qa19:38
clarkbmtreinish: auggy and thats true for both examples?19:38
mtreinishclarkb: I'm trying to tell testr to group tests with same backend on the same worker19:38
auggyi just verified that my expression should match but just breaking it out into groups and removing the special cases19:38
auggysubunit2sql.tests.db.test_api.TestDatabaseAPI.test_get_test_runs_dicts_with_no_start_time( matches group(1)19:38
clarkbI see19:38
auggyso the expressions are accurate in my expression, but match() seems to be ignoring ?:19:38
auggyclarkb: that's why i used lookaheds/behinds19:39
auggybut i haven't done much regex with python sooo19:39
*** david-ly_ is now known as david-lyle19:39
clarkbwould .*(mysql|postgres|sqlite)?.* work?19:39
auggyclarkb: wouldn't that return the whole string for group(0)?19:39
mtreinishclarkb: it didn't when I tried it19:39
mtreinishauggy: yeah, iirc when I tried it thats what I got19:39
clarkboh so in that case19:40
auggyfrom what i can tell with match group(0) is the whole match19:40
clarkbI would suggest testr group a feature for a named group19:40
mtreinishclarkb, auggy: https://github.com/testing-cabal/testrepository/pull/1919:40
mtreinishI have a feeling it won't be that simple19:41
auggymtreinish: that's probably a wiser move but yeah19:41
auggyyeah there might be some things that dependend on match19:41
auggywhy are regexes in python so broken?19:41
auggythat's just so weird19:41
clarkbmtreinish: I think having a flag for --test-group-group foo then naming your capture group foo is the most flexible19:41
clarkbauggy: how ar ethey broken?19:41
clarkblookbehind is CFG iirc19:41
clarkbor maybe just pushdown19:42
clarkbits counting19:42
auggyit was more of a rhetorical question out of frustration, not trying to start a language debate19:42
mtreinishclarkb: well the scheduler hints are a config thing, but yeah doing it as a seperate opt might be better19:42
auggyit just works differently in python than other places i'm used ot using it19:42
mtreinishwe'll see what lifeless says :)19:42
auggymtreinish: i gotta hop back onto the stuff i was working on! feel free to bug me with other regex questions if it's at all helpful for you :)19:43
mtreinishmelwitt: most of the scenario tests that boot a server ssh into them19:43
mtreinishauggy: it is, I suck at regex :)19:43
mtreinishI don't think I've ever constructed one by myself that did it 100% correct19:44
mtreinishI always miss something19:44
*** mylu has quit IRC19:44
auggywhatever "correct" means19:44
auggyyeah they are tricky19:44
mtreinishhah, true19:44
auggyi've just done a lot of perl19:44
auggy;D19:44
*** markvoelker has quit IRC19:44
clarkbmtreinish: the nice thing about having an optional name is it can be at any arbitrary location19:45
clarkbyou don't have to do magic to overload what group(0) is19:45
melwittI did this to capture the mysql or postgres or sqlite. I don't know if it fits all the cases you need m = re.search(r'[^(]*(mysql|postgres|sqlite)', s)19:46
mtreinishmelwitt: well except testr uses re.match :)19:46
mtreinishthat's the source of all the trouble19:46
mtreinishmelwitt: https://github.com/mtreinish/testrepository/blob/master/testrepository/testcommand.py#L572-L58119:46
melwittsorry, I don't have the rest of the context19:46
mtreinishno worries, I've banged my head against this for long enough, it's not really important19:47
openstackgerritMerged openstack-dev/devstack: create apt_get_update to try to work around broken mirrors  https://review.openstack.org/25237219:47
mtreinishthere are only like 50 tests, so it's the diff between like 1.5 mins and 2.5 mins of run time :)19:47
melwittmtreinish: okay. I'll look at the other scenario tests, hopefully it's already covered in the cells job. with all the exclusions, I was concerned it wasn't covered19:47
mtreinishmelwitt: for example: https://github.com/openstack/tempest/blob/master/tempest/scenario/test_volume_boot_pattern.py ssh's into the guests to verify the same volume is used19:48
mtreinish(it writes a timestamp on the fs)19:49
mtreinishhttps://github.com/openstack/tempest/blob/master/tempest/scenario/test_minimum_basic.py logs in to check that the cinder volume is attached19:49
*** rbrndt has quit IRC19:49
melwittmtreinish: thanks. I have a vague memory of running the equivalent of our tempest job locally on a patch I was working on, wherein I broke network connectivity not passing network_info_cache or something. and all the tests passed. so now I'm rummaging around to see which tests do the ssh19:50
mtreinishmelwitt: there are also api tests that do ssh, but we turn that off in the gate (except for one nv job on tempest)19:51
mtreinishmriedem: http://git.openstack.org/cgit/openstack/tempest/tag/?h=8 sorry I forgot about that before19:52
*** mylu has joined #openstack-qa19:52
*** mylu has quit IRC19:54
*** regXboi has quit IRC19:55
*** mylu has joined #openstack-qa19:56
melwittmtreinish: it appears not possible to do what you want with re.match https://docs.python.org/2/library/re.html#search-vs-match19:56
mtreinishmelwitt: :( that's what I was afraid of19:56
mtreinishmelwitt: I guess https://github.com/testing-cabal/testrepository/pull/19 or something like it is the answer19:57
*** sabeen has joined #openstack-qa19:59
melwittmtreinish: yeah, I think so. it looks like the group_regex is intended to work only on "test ids"20:00
mtreinishmelwitt: yeah that callback function gets run on each test_id that testr is going to run20:02
*** dimtruck is now known as zz_dimtruck20:02
melwittmtreinish: and test id is in the beginning of the string and the rest of the test name after it I guess?20:02
mtreinishmelwitt: the whole string is the test_id20:03
mtreinishthe full path, test_name, attrs, testscenarios, etc20:03
melwittohh. okay20:03
mtreinishit makes doing the filtering and scheduling easier, but it makes result tracking more difficult20:06
*** sabeen has quit IRC20:09
*** dkranz has quit IRC20:10
*** lucasagomes is now known as lucas-afk20:10
*** dkranz has joined #openstack-qa20:12
mtreinishtimothyb89, anteaya, david-lyle, regXboi, jhesketh: I think it's time we announce dashboard on the ML. (now that all the db migrations are done) This is my draft: https://etherpad.openstack.org/p/1Ibg78gTIn20:17
mtreinishI'd appreciate any feedback on it before I push it out20:17
*** dtroyer has quit IRC20:19
timothyb89mtreinish: looks good to me, are there any last-minute things we want to take care of code-wise first?20:20
mtreinishtimothyb89: the only thing I was thinking of was: https://review.openstack.org/#/c/253214/20:20
timothyb89ah, I'll take a look20:21
mtreinishbut it is iterative, there will always be something else to do :)20:21
timothyb89for sure20:21
*** sabeen has joined #openstack-qa20:23
*** dtroyer has joined #openstack-qa20:28
*** jbernard has quit IRC20:32
david-lylemtreinish: LGTM20:34
mtreinishdavid-lyle: ok 2 +2s away it goes :)20:35
*** rbrndt has joined #openstack-qa20:40
mtreinishtimothyb89: I'm looking at the openstack health todo list, the breadcumbs thing. Is that the thing you implemented?20:43
timothyb89mtreinish: I guess so, though I don't know if that's necessarily what I implemented :)20:44
mtreinishTBH, I'm not sure what it means, but you called the commit a breadcrumb menu or something like that :)20:44
timothyb89I'd say its an equivalent feature, hopefully it satisfies whoever wrote that20:45
lifelessmtreinish: I'll look on monday but having a bug and or examples of what you're struggling would be great20:47
*** pglass has joined #openstack-qa20:48
mtreinishlifeless: ok, I'll add an example to the PR20:48
*** jasonsb has quit IRC20:49
*** diegows has quit IRC20:51
*** tnguyen has quit IRC20:51
mtreinishtimothyb89: so on: https://review.openstack.org/#/c/231287/ I'm kinda stuck20:52
mtreinishthe console log is showing an error about the date format, but I couldn't figure out where the call is coming from20:52
pc_mHi! In a newish repo, I'm trying to get the docs job to run. Anyone know why this is failing https://review.openstack.org/#/c/253660/ ?20:52
mtreinishtimothyb89: well ignoring the test add screw up :)20:53
*** mylu has quit IRC20:53
timothyb89mtreinish: hmm, odd... I need to run an errand, but I'll take a look in ~20 minutes20:54
mtreinishtimothyb89: ok, cool thanks20:55
*** maht has joined #openstack-qa20:59
*** ajmiller_ has joined #openstack-qa21:00
*** pvaneck has joined #openstack-qa21:03
*** diegows has joined #openstack-qa21:03
*** ajmiller has quit IRC21:03
*** weshay_xchat is now known as weshay21:05
*** diegows has quit IRC21:05
*** akshai has quit IRC21:12
*** cp16net has quit IRC21:14
*** cp16net has joined #openstack-qa21:16
*** pglass has quit IRC21:18
*** zz_dimtruck is now known as dimtruck21:24
*** jasonsb has joined #openstack-qa21:26
*** dustins_ has quit IRC21:27
*** boris-42_ has joined #openstack-qa21:28
*** gszasz has quit IRC21:31
*** rfolco has quit IRC21:31
*** TravT has joined #openstack-qa21:33
*** sabeen has quit IRC21:34
*** afazekas has quit IRC21:39
*** afazekas has joined #openstack-qa21:40
openstackgerritJohn Warren proposed openstack/tempest: Split out Neutron metering label rules client  https://review.openstack.org/25313321:40
*** TuanNguyen has quit IRC21:42
timothyb89mtreinish: I think the source of the bug is line #66 here https://review.openstack.org/#/c/231287/15/app/js/controllers/test.js21:54
timothyb89mtreinish: 'var startDate = ...' redefines the var in that scope, which overwrites the value passed into the controller21:56
timothyb89mtreinish: renaming the 2nd startDate should fix that issue, at least21:56
*** mwagner_lap has quit IRC21:59
timothyb89mtreinish: then on line #69 it should be testName rather than test_name ... after those fixes the page seems to be loading correctly22:02
mtreinishtimothyb89: ok cool22:04
* mtreinish gives it a try22:04
timothyb89mtreinish: that said, I do find it a bit suspicious that "Success and Failures" always shows 1 pass and 0 fails22:07
*** mylu has joined #openstack-qa22:08
mtreinishtimothyb89: yeah looking at how it was refactored when I wasn't working on it there isn't any aggregation going on22:08
mtreinishso success and fails will alway be 1 or zero22:08
mtreinishand it'll be a point for each time the test is run22:08
mtreinishtimothyb89: http://i.imgur.com/9ifFLom.png22:10
timothyb89hmm, makes sense I suppose22:10
mtreinishwell it makes sense why it's doing it. But it's a bad graph22:10
mtreinishshould probably be a stacked bar graph or something for each day or something22:11
*** mfisher_ora has quit IRC22:11
timothyb89that would make more sense22:11
mtreinishand for the run_time graph I really would like to see if we can use the same formatting as subunit2sql-graph run_tim22:11
mtreinishe22:11
mtreinishwhere it shows the average and std dev22:12
mtreinishbut those are the next steps before I think it's ready to land (well that and a table of something)22:12
mtreinishat least now it's working :)22:12
timothyb89is stdev and average recorded with subunit2sql?22:13
mtreinishtimothyb89: no, I leveraged pandas to do the calculations in subunit2sql-graph22:17
mtreinishtimothyb89: https://github.com/openstack-infra/subunit2sql/blob/master/subunit2sql/analysis/run_time.py#L56-L5722:18
timothyb89mtreinish: oh, okay, makes sense22:18
*** mylu has quit IRC22:18
*** mylu has joined #openstack-qa22:19
mtreinishtimothyb89: I'm sure d3 has something similar, but I wonder if it makes sense to do that on the rest api side22:19
timothyb89mtreinish: d3 can do stdev/mean/etc, if there's not an excessive amount of data to deal with that should be plenty fast22:21
mtreinishok, I'l look into playing with that then22:21
mtreinishlets see how long it takes me to figure out the js syntax to do it :)22:21
timothyb89should be something like d3.mean(timeEntries, function(d) { return d.y; })22:23
timothyb89though there doesn't seem to be a function for rolling means22:25
*** david-ly_ has joined #openstack-qa22:29
openstackgerritMatthew Treinish proposed openstack/openstack-health: Add test detail page  https://review.openstack.org/23128722:29
*** lascii is now known as alaski22:29
*** mylu has quit IRC22:30
timothyb89mtreinish: that said, doing some extra processing on the server might not be a bad idea, for lots tests we're looking at > 500kb of data to download, sometimes up to ~1MB22:30
*** mylu has joined #openstack-qa22:30
*** david-ly_ is now known as david-lyle_22:31
*** david-lyle has quit IRC22:32
*** mylu has quit IRC22:35
*** dimtruck is now known as zz_dimtruck22:36
EmilienMmtreinish: I would love having puppet projects on http://status.openstack.org/openstack-health/#/22:37
EmilienMdoes it makes sense to you?22:37
*** dpaterson has quit IRC22:38
mtreinishEmilienM: sure, the filters that collect subunit streams are: http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/files/logstash/jenkins-log-client.yaml#n1422:38
mtreinishI take it the puppet jobs don't match any of those?22:38
EmilienMmtreinish: ok, will add some modules and see how it behaves22:38
EmilienMmtreinish: it does not22:39
EmilienMmtreinish: we don't use subunit22:39
mtreinishEmilienM: well the jobs that run tempest do22:40
mtreinishthe beaker tests probably dont (although it wouldn't be too hard to do in ruby I don't think)22:40
EmilienMmtreinish: we have 2 jobs that run tempest22:40
EmilienMpuppet-openstack-integration22:40
mtreinishEmilienM: I'd recommend pushing a patch that changes L17 (or all the job selection regex) to be ".*(tempest|grenade).*"22:42
mtreinishhopefully that won't be too generic and pick up things we don't want22:42
mtreinishEmilienM: and as long as the puppet jobs that run tempest put the subunit stream in the same place with the same filename it'll just pick it up automatically22:43
EmilienMlet's see http://logs.openstack.org/20/253620/1/check/gate-puppet-openstack-integration-scenario001-dsvm-centos7/ddbea3d/22:43
EmilienMI think we're missing something22:44
mtreinishhmm, yeah you need to save the subunit stream to the logs dir22:44
EmilienMmaybe I'm not copying it22:44
mtreinishEmilienM: post test run from the tempest dir do 'testr last --subunit > log_dir/testrepository.subunit'22:44
EmilienMmtreinish: this is how I run tempest: https://github.com/openstack/puppet-openstack-integration/blob/master/run_tests.sh#L9622:45
mtreinishlike http://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/functions.sh#n62922:45
mtreinishEmilienM: yeah in the cleanup phase when you collect all the artifacts you want to do 'pushd /tmp/openstack/tempest; testr last --subunit > $LOGDIR/testrepository.subunit; popd' or something like that22:46
EmilienMok I see22:47
EmilienMmtreinish: I might also need to patch https://github.com/openstack-infra/project-config/blob/master/jenkins/scripts/copy_puppet_logs.sh22:47
mtreinishEmilienM: I would just do it right from that script22:48
mtreinishEmilienM: basically just copy this function: http://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/functions.sh#n61122:48
mtreinishalthough you can skip the subunit2html thing (unless you want to do that) and you probably will have to call testr from inside the tox venv, so .tox/all/bin/testr instead of testr22:49
*** eil397 has quit IRC22:50
mtreinishEmilienM: oh, I jsut realized you don't say tempest in the job name too22:51
mtreinishEmilienM: can we rename that to include tempest, so 'gate-puppet-openstack-integration-scenario001-tempest-dsvm-centos7'?22:52
EmilienMmtreinish: something like https://review.openstack.org/253728?22:52
EmilienMmtreinish: yes of course we can22:52
mtreinishEmilienM: yeah that'll save the subunit stream22:53
mtreinishand then do you need to modify copy_puppet_logs.sh to pick it up?22:53
EmilienMyes22:53
EmilienMand I rename jobs22:53
EmilienMand life is beautiful22:53
mtreinishEmilienM: well I need to fix the selection regex in the gearman client so that it'll pick up the puppet jobs post rename, but that's simple :)22:54
*** salv-orl_ has joined #openstack-qa22:54
EmilienMcool22:54
EmilienMthanks for your help mtreinish !22:54
*** jasonsb has quit IRC22:55
*** salv-orlando has quit IRC22:57
mtreinishEmilienM: https://review.openstack.org/#/c/253729/22:58
EmilienMhttps://review.openstack.org/253728 and https://review.openstack.org/25373022:59
*** mylu has joined #openstack-qa22:59
mtreinishEmilienM: reviewed23:01
EmilienMmtreinish: ok23:03
*** shardy has quit IRC23:07
*** dims has quit IRC23:10
*** cdent has quit IRC23:14
*** pglass has joined #openstack-qa23:18
*** aix has quit IRC23:19
*** pglass has quit IRC23:22
*** pglass has joined #openstack-qa23:22
*** pglass has quit IRC23:27
*** weshay has quit IRC23:33
*** openstack has joined #openstack-qa23:38
*** aysyd has quit IRC23:38
*** ajmiller_ has quit IRC23:40
*** dims has joined #openstack-qa23:47
*** nicholasgoracke has joined #openstack-qa23:52
*** TravT has left #openstack-qa23:53
*** rbrndt has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!