| *** krtaylor has joined #openstack-qa | 00:18 | |
| *** lexinator has quit IRC | 00:24 | |
| *** mberwanger has joined #openstack-qa | 00:24 | |
| *** lexinator has joined #openstack-qa | 00:37 | |
| *** mberwanger has quit IRC | 00:43 | |
| *** mberwanger has joined #openstack-qa | 00:45 | |
| *** mberwanger has quit IRC | 00:59 | |
| *** sthaha has joined #openstack-qa | 01:00 | |
| *** woodspa has joined #openstack-qa | 01:02 | |
| *** mberwanger has joined #openstack-qa | 01:03 | |
| *** lexinator has quit IRC | 01:39 | |
| *** lexinator has joined #openstack-qa | 01:40 | |
| *** marun has quit IRC | 01:45 | |
| *** lexinator has quit IRC | 01:46 | |
| *** afazekas has quit IRC | 01:53 | |
| *** krtaylor has quit IRC | 01:54 | |
| openstackgerrit | Zhi Kun Liu proposed a change to openstack/tempest: add image tests v2 https://review.openstack.org/39212 | 01:54 |
|---|---|---|
| *** marun has joined #openstack-qa | 01:59 | |
| *** mberwanger has quit IRC | 02:04 | |
| *** mberwanger has joined #openstack-qa | 02:04 | |
| *** afazekas has joined #openstack-qa | 02:05 | |
| *** lexinator has joined #openstack-qa | 02:06 | |
| *** mberwanger has quit IRC | 02:09 | |
| *** meteorfox has joined #openstack-qa | 02:17 | |
| *** adalbas has quit IRC | 02:28 | |
| *** woodspa has quit IRC | 02:43 | |
| *** lexinator has quit IRC | 02:53 | |
| *** lexinator has joined #openstack-qa | 02:59 | |
| openstackgerrit | anju Tiwari proposed a change to openstack/tempest: Negative test added for rescuing a paused vm https://review.openstack.org/39230 | 03:04 |
| Anju | afazekas: gm | 03:10 |
| Anju | did u lokk at the bug report? | 03:10 |
| Anju | *look | 03:10 |
| *** SergeyLukjanov has joined #openstack-qa | 03:20 | |
| *** mberwanger has joined #openstack-qa | 03:28 | |
| openstackgerrit | A change was merged to openstack-dev/devstack: Update the ML2 configuration in devstack https://review.openstack.org/37963 | 03:48 |
| openstackgerrit | A change was merged to openstack/tempest: Add eventlet to requirements.txt https://review.openstack.org/39368 | 03:50 |
| openstackgerrit | A change was merged to openstack/tempest: Fix fail logic for server of another tenant test https://review.openstack.org/39357 | 03:50 |
| *** krtaylor has joined #openstack-qa | 03:53 | |
| *** prekarat has joined #openstack-qa | 03:54 | |
| openstackgerrit | A change was merged to openstack-dev/devstack: renamed deprecated glanceclient parameter https://review.openstack.org/39323 | 03:55 |
| openstackgerrit | A change was merged to openstack-dev/devstack: Set horizon configuration for security groups https://review.openstack.org/39181 | 03:57 |
| *** prekarat has quit IRC | 03:58 | |
| *** prekarat has joined #openstack-qa | 03:58 | |
| openstackgerrit | A change was merged to openstack-dev/devstack: Add option to serve PXE for baremetal from nova-network https://review.openstack.org/38794 | 03:59 |
| Anju | afazekas: ping | 04:04 |
| *** mberwanger has quit IRC | 04:26 | |
| *** marun has quit IRC | 04:27 | |
| *** SergeyLukjanov has quit IRC | 04:45 | |
| *** prekarat has quit IRC | 04:57 | |
| *** prekarat1 has joined #openstack-qa | 04:58 | |
| *** rhsu has joined #openstack-qa | 05:03 | |
| Anju | hii anypdy have any idea of this error | 05:04 |
| Anju | <attribute 'message' of 'exceptions.BaseException' objects> (HTTP Unable to establish connection to http://10.0.9.43:35357/v2.0/OS-KSADM/roles/074c11b716bc4e7cbf8995fbbb32db98) | 05:04 |
| *** fungi has quit IRC | 05:08 | |
| *** jaypipes has quit IRC | 05:19 | |
| openstackgerrit | Sumanth Nagadavalli proposed a change to openstack/tempest: Sorting services list before asserting. https://review.openstack.org/39416 | 05:26 |
| *** rhsu has quit IRC | 05:29 | |
| ianw | Anju: 35357 is keystone port; keystone isn't running (or isn't responding) | 05:35 |
| Anju | ianw :thanks :i have resolved | 05:36 |
| Anju | :) | 05:36 |
| openstackgerrit | Ian Wienand proposed a change to openstack/tempest: Generic skip interface https://review.openstack.org/39417 | 05:36 |
| Anju | ianw : yet there is only three commans to install devstack | 05:37 |
| Anju | it looks simple only | 05:37 |
| Anju | but is not in realaity | 05:37 |
| Anju | :) | 05:38 |
| *** sthaha has quit IRC | 05:45 | |
| *** fungi has joined #openstack-qa | 05:48 | |
| *** psedlak has joined #openstack-qa | 05:55 | |
| *** prekarat1 has quit IRC | 06:00 | |
| *** prekarat has joined #openstack-qa | 06:00 | |
| *** psedlak_ has joined #openstack-qa | 06:06 | |
| Anju | psedlak: https://bugs.launchpad.net/openstack-api-site/+bug/1206608 | 06:10 |
| *** psedlak has quit IRC | 06:10 | |
| *** jhenner has joined #openstack-qa | 06:15 | |
| openstackgerrit | Ian Wienand proposed a change to openstack/tempest: Generic skip interface https://review.openstack.org/39417 | 06:36 |
| openstackgerrit | Sumanth Nagadavalli proposed a change to openstack/tempest: Sorting services list before asserting in test_get_service_list test https://review.openstack.org/39416 | 06:50 |
| Anju | ianw:ping | 06:58 |
| ianw | Anju: hi | 07:00 |
| *** psedlak__ has joined #openstack-qa | 07:03 | |
| *** jaypipes has joined #openstack-qa | 07:04 | |
| *** ChanServ sets mode: +o jaypipes | 07:04 | |
| *** sthaha has joined #openstack-qa | 07:07 | |
| Anju | ianw : https://github.com/openstack/tempest/blob/master/tempest/services/volume/json/volumes_client.py | 07:07 |
| *** psedlak_ has quit IRC | 07:07 | |
| Anju | ianw : any idea hoe to covert a https://github.com/openstack/tempest/blob/master/tempest/services/volume/json/volumes_client.py#L88 in xml | 07:08 |
| *** jgallard has joined #openstack-qa | 07:14 | |
| openstackgerrit | afazekas proposed a change to openstack/tempest: Generate temepst API doc from source https://review.openstack.org/39291 | 07:19 |
| *** afazekas is now known as afazekas__ | 07:22 | |
| *** psedlak__ is now known as psedlak | 07:24 | |
| *** afazekas has joined #openstack-qa | 08:04 | |
| afazekas | Anju: I hoped guilivo return from vacation earlier, AFAIK he touched the volume code last time.. | 08:08 |
| Anju | ok afazekas : thanks | 08:09 |
| afazekas | Anju: were you able to send an xml request with curl or crafttool ? | 08:09 |
| Anju | nooo | 08:09 |
| Anju | i wrote a code for xml also to know only that the xml code wiyhout parsing is working or not | 08:10 |
| afazekas | So you have a code which does it with xml , right ? | 08:11 |
| Anju | and afazekas:the problem is not only for volume but also for /tempest/services/image/v1 | 08:11 |
| Anju | tempest/services/image/v2 alos | 08:11 |
| Anju | slo | 08:11 |
| Anju | these tests are only responding for json only | 08:12 |
| Anju | yeah afazeaks: i wrote | 08:12 |
| Anju | but giving me an error | 08:12 |
| Anju | may i show you in pasitebin ? | 08:13 |
| afazekas | of course | 08:14 |
| *** lexinator has quit IRC | 08:15 | |
| Anju | afazekas:http://pastebin.com/KgSfrDEn | 08:16 |
| Anju | i dont know how much i am correct | 08:16 |
| Anju | i just try first in a simple way | 08:16 |
| Anju | and for network also xml response is missing https://github.com/openstack/tempest/tree/master/tempest/services/network | 08:17 |
| afazekas | Anju: thx, I will look it | 08:21 |
| * afazekas on a phone call | 08:21 | |
| *** afazekas has quit IRC | 08:26 | |
| *** prekarat has quit IRC | 08:33 | |
| *** afazekas has joined #openstack-qa | 08:37 | |
| afazekas | Anju: Usually I am immediate able to try an unified diff change by the 'patch -p1 <patch.file' command | 08:39 |
| afazekas | Anju: you can also send it to review if it close to work. | 08:42 |
| Anju | actually i am making a other file so whatever i add in afile cant not affect another one | 08:43 |
| Anju | so i am showing you like thisa | 08:43 |
| afazekas | Ok , I see | 08:43 |
| Anju | afazekas :what can i do for this | 08:44 |
| Anju | ? | 08:44 |
| Anju | you know i had have started looking in this a month ago | 08:45 |
| Anju | but not getting a fine solution | 08:45 |
| Anju | afazekas :did u see for netwok also https://github.com/openstack/tempest/tree/master/tempest/services/network | 08:46 |
| *** SergeyLukjanov has joined #openstack-qa | 08:48 | |
| afazekas | 'self.xml_to_json(etree.fromstring(body)' missing ')' | 08:50 |
| afazekas | without self | 08:51 |
| Anju | wait | 08:52 |
| Anju | afazekas:do you think without any parsing it will run? | 08:55 |
| Anju | afazekas:failed | 09:01 |
| Anju | afazekas:http://pastebin.com/b5eTvx6u | 09:04 |
| afazekas | Anju: IMHO it will do the operation if the request is correct | 09:04 |
| Anju | afazekas:that what i want to know some tsts are running in a simple way | 09:05 |
| Anju | without any aprsing | 09:05 |
| Anju | parsing | 09:05 |
| Anju | some are giving errors | 09:05 |
| Anju | and i dont know to send the correct request | 09:05 |
| Anju | I checked this by only calling aupload test from test_volume_actions.py | 09:06 |
| Anju | and i have mangedthe interface xml also | 09:07 |
| afazekas | NotFound: Object not found | 09:27 |
| afazekas | You can check it in the cinder's source code how it is handled | 09:27 |
| Anju | afazekas: is the document not updated | 09:27 |
| Anju | ? | 09:27 |
| Anju | http://api.openstack.org/api-ref.html#netconn-api | 09:27 |
| Anju | the response of network api still have response in quantum | 09:28 |
| Anju | or it is correct? | 09:29 |
| openstackgerrit | Wangpan proposed a change to openstack/tempest: Sorted list firstly when assert equal two lists https://review.openstack.org/39440 | 09:33 |
| *** prekarat has joined #openstack-qa | 09:46 | |
| afazekas | Anju: looks like you call the post twice | 09:53 |
| Anju | afazekas: I am trying ..as same problem is occuring for the network also | 10:00 |
| Anju | :( | 10:00 |
| Anju | afazekas: https://review.openstack.org/#/c/39230/ is this correct now :) | 10:07 |
| *** prekarat has quit IRC | 10:09 | |
| *** prekarat has joined #openstack-qa | 10:09 | |
| *** giulivo has joined #openstack-qa | 10:09 | |
| afazekas | http://www.fpaste.org/29176/65932137/ | 10:18 |
| afazekas | http://www.fpaste.org/29177/13752659/ | 10:19 |
| afazekas | giulivo: nice to see you | 10:19 |
| giulivo | afazekas :) thanks :) | 10:19 |
| afazekas | ANju has several question about how to the xml volume action action thing.. | 10:20 |
| afazekas | I guess you saw that part long time ago .. | 10:20 |
| *** lexinator has joined #openstack-qa | 10:20 | |
| giulivo | yep , Anju feel free to ping | 10:20 |
| Anju | thanks : afazekas :) | 10:21 |
| Anju | giulivo | 10:21 |
| Anju | :ping | 10:21 |
| Anju | hii | 10:21 |
| Anju | giulivo: asking you first time | 10:21 |
| *** lexinator has quit IRC | 10:25 | |
| *** mkollaro has joined #openstack-qa | 10:29 | |
| afazekas | giulivo: can you check it again : https://review.openstack.org/#/c/35165/ | 10:37 |
| *** jgallard has quit IRC | 10:48 | |
| openstackgerrit | Sean Dague proposed a change to openstack-dev/devstack: install oslo from upstream in devstack https://review.openstack.org/39450 | 10:51 |
| openstackgerrit | Sean Dague proposed a change to openstack-dev/devstack: Update projects to global requirements before setup https://review.openstack.org/35705 | 10:51 |
| Anju | sean : please have a look ..is this ok for you ?https://review.openstack.org/#/c/39230/ | 11:08 |
| openstackgerrit | afazekas proposed a change to openstack/tempest: setUpClass/tearDownClass full chain https://review.openstack.org/39346 | 11:11 |
| openstackgerrit | Sean Dague proposed a change to openstack-dev/devstack: Update projects to global requirements before setup https://review.openstack.org/35705 | 11:14 |
| openstackgerrit | Sean Dague proposed a change to openstack-dev/devstack: install oslo from upstream in devstack https://review.openstack.org/39450 | 11:14 |
| openstackgerrit | afazekas proposed a change to openstack/tempest: Switching to oslo importutils in the stress tests https://review.openstack.org/39279 | 11:19 |
| *** lexinator has joined #openstack-qa | 11:20 | |
| afazekas | <giulivo> | 11:21 |
| afazekas | giulivo: ping | 11:21 |
| *** lexinator has quit IRC | 11:25 | |
| *** SergeyLukjanov has quit IRC | 11:29 | |
| afazekas | mordred: ping | 11:31 |
| openstackgerrit | Sean Dague proposed a change to openstack-dev/devstack: Update projects to global requirements before setup https://review.openstack.org/35705 | 11:32 |
| openstackgerrit | Sean Dague proposed a change to openstack-dev/devstack: install oslo from upstream in devstack https://review.openstack.org/39450 | 11:32 |
| *** jgallard has joined #openstack-qa | 11:39 | |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/devstack-gate: add oslo.* to the projects list https://review.openstack.org/39465 | 11:43 |
| *** SergeyLukjanov has joined #openstack-qa | 11:57 | |
| *** dkranz has joined #openstack-qa | 11:58 | |
| *** afazekas has quit IRC | 12:01 | |
| *** jhenner1 has joined #openstack-qa | 12:02 | |
| *** mkollaro1 has joined #openstack-qa | 12:04 | |
| *** mkollaro has quit IRC | 12:04 | |
| *** jhenner has quit IRC | 12:04 | |
| *** psedlak_ has joined #openstack-qa | 12:05 | |
| *** psedlak has quit IRC | 12:05 | |
| *** lexinator has joined #openstack-qa | 12:21 | |
| *** lexinator has quit IRC | 12:26 | |
| kashyap | afazekas__, psedlak_ Heya, can you remind me, what's the iptables rule I need to get this successful: $ curl http://169.254.169.254/openstack | 12:40 |
| *** HenryG has joined #openstack-qa | 12:43 | |
| *** woodspa has joined #openstack-qa | 12:46 | |
| *** jasondotstar has joined #openstack-qa | 12:49 | |
| *** psedlak__ has joined #openstack-qa | 13:03 | |
| *** jhenner1 has quit IRC | 13:04 | |
| *** jhenner has joined #openstack-qa | 13:04 | |
| *** jgallard has quit IRC | 13:05 | |
| *** jgallard has joined #openstack-qa | 13:06 | |
| *** jgallard has quit IRC | 13:06 | |
| *** jgallard has joined #openstack-qa | 13:06 | |
| *** psedlak_ has quit IRC | 13:07 | |
| *** mkollaro1 has quit IRC | 13:08 | |
| *** krtaylor has quit IRC | 13:09 | |
| *** psedlak__ is now known as psedla | 13:13 | |
| *** psedla is now known as psedlak | 13:13 | |
| mordred | morning afazekas__ | 13:14 |
| *** mkollaro has joined #openstack-qa | 13:20 | |
| *** anteaya has joined #openstack-qa | 13:22 | |
| *** lexinator has joined #openstack-qa | 13:22 | |
| *** prekarat has quit IRC | 13:26 | |
| *** lexinator has quit IRC | 13:26 | |
| *** meteorfox has quit IRC | 13:33 | |
| *** psedlak_ has joined #openstack-qa | 13:41 | |
| *** psedlak has quit IRC | 13:41 | |
| *** prekarat has joined #openstack-qa | 13:47 | |
| *** krtaylor has joined #openstack-qa | 13:53 | |
| *** SergeyLukjanov has quit IRC | 13:58 | |
| openstackgerrit | Matthew Treinish proposed a change to openstack/tempest: Add tenant isolation for scenario tests https://review.openstack.org/39099 | 13:59 |
| *** psedlak__ has joined #openstack-qa | 14:01 | |
| *** SergeyLukjanov has joined #openstack-qa | 14:03 | |
| *** psedlak_ has quit IRC | 14:05 | |
| *** nsaje has joined #openstack-qa | 14:05 | |
| *** meteorfox has joined #openstack-qa | 14:07 | |
| *** jaypipes has quit IRC | 14:07 | |
| *** lexinator has joined #openstack-qa | 14:22 | |
| *** afazekas has joined #openstack-qa | 14:22 | |
| *** burt has joined #openstack-qa | 14:26 | |
| *** lexinator has quit IRC | 14:27 | |
| *** nsaje has quit IRC | 14:30 | |
| *** jaypipes has joined #openstack-qa | 14:34 | |
| *** ChanServ sets mode: +o jaypipes | 14:34 | |
| openstackgerrit | A change was merged to openstack-dev/devstack: install oslo from upstream in devstack https://review.openstack.org/39450 | 14:34 |
| *** dkranz has quit IRC | 14:43 | |
| *** anneisgentle is now known as annegentle | 14:47 | |
| openstackgerrit | A change was merged to openstack-dev/devstack: manage-vdi: Wait until devices have been created before mounting https://review.openstack.org/36461 | 14:48 |
| openstackgerrit | A change was merged to openstack-dev/devstack: Do not set os_aut_url for ceilometer https://review.openstack.org/38955 | 14:48 |
| *** dkranz has joined #openstack-qa | 14:56 | |
| kashyap | psedlak__, Heya have you ever noticed this HeartbeatTimeout? http://paste.openstack.org/show/42758/ | 14:57 |
| *** lexinator has joined #openstack-qa | 14:58 | |
| psedlak__ | kashyap: no, i never saw it sorry :/ | 14:59 |
| kashyap | Np :-) . | 15:00 |
| *** krtaylor has quit IRC | 15:00 | |
| *** HenryG has quit IRC | 15:03 | |
| *** sthaha has quit IRC | 15:09 | |
| *** meteorfox has quit IRC | 15:10 | |
| *** mlavalle has joined #openstack-qa | 15:15 | |
| *** mkollaro has quit IRC | 15:15 | |
| anteaya | what is the current status of tempest and testr? | 15:15 |
| anteaya | the reason I ask is that I will soon be using the tempest api suite quite a bit | 15:15 |
| anteaya | and it the api tests are using testr then I we can parallelize our test runs | 15:16 |
| anteaya | is there a meeting log or etherpad I can consult? | 15:16 |
| mtreinish | anteaya: it works well, but there are few race conditions and resource contentions | 15:16 |
| mtreinish | one sec I'll pull up the etherpad | 15:16 |
| anteaya | mtreinish: great thank you | 15:17 |
| mtreinish | anteaya: https://etherpad.openstack.org/debugging-testr-tempest | 15:17 |
| * anteaya reads | 15:17 | |
| mtreinish | it just a list of issues found in jenkins by running testr on the check queue nonvoting | 15:17 |
| mtreinish | although for a couple of days some changes brought things down on the run and I haven't seen most of those after bringing it back up | 15:18 |
| *** prekarat has quit IRC | 15:19 | |
| openstackgerrit | afazekas proposed a change to openstack/tempest: Disable logging to the stderr https://review.openstack.org/39505 | 15:22 |
| anteaya | mtreinish: thank you this is a start | 15:22 |
| *** meteorfox has joined #openstack-qa | 15:22 | |
| anteaya | know this is on my radar so if you see something random, feel free to ping me about it | 15:23 |
| afazekas | mtreinish,dkranz,sdague: https://review.openstack.org/39505 | 15:23 |
| anteaya | I am just getting my bearing with this, so it will take me some time | 15:23 |
| anteaya | and thanks | 15:23 |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/devstack-gate: add oslo.* to the projects list https://review.openstack.org/39465 | 15:24 |
| mtreinish | anteaya: ok, sure np. If you run into any troubles with testr on tempest let me know. Hopefully I can get through the rest of the races soon so this will be gating. | 15:24 |
| anteaya | mtreinish: grand thank you | 15:24 |
| anteaya | and I will talk to you if I see anything of note | 15:24 |
| mtreinish | afazekas: yeah I just saw it looks good. I'll give my +2 once jenkins gets back. | 15:25 |
| dkranz | afazekas: Ditto. | 15:25 |
| sdague | yeh, let me know when jenkins gets back as well, seems fine, but I'd like to see the output | 15:25 |
| dkranz | sdague: I just added the qa agenda for tomorrow and cleaned up. | 15:26 |
| mtreinish | sdague: well it's really verbose now. I don't know if you've looked at any of the runs since the oslo log switch got merged | 15:26 |
| sdague | dkranz: thanks | 15:26 |
| sdague | mtreinish: I have | 15:26 |
| sdague | that's why I want to see it go away in the output :) | 15:26 |
| *** SergeyLukjanov has quit IRC | 15:29 | |
| kashyap | Random question -- Any ideas why would 'quantum net-list' throw a "No route to host"? Stack trace -- http://paste.openstack.org/show/42760/ | 15:30 |
| kashyap | I checked a few things like: | 15:31 |
| mtreinish | sdague: I didn't notice when I pushed it through because I only tested it with testr which remained clean: https://jenkins.openstack.org/job/gate-tempest-devstack-vm-testr-full/3145/console :) | 15:31 |
| kashyap | 1. qpid running just file 2. have the correct qpid IP in /etc/quantum/quantum.conf ... | 15:31 |
| *** lexinator has quit IRC | 15:31 | |
| kashyap | dkranz, (or anyone) Would you happen to have any hints here? | 15:31 |
| afazekas | giulivo: https://review.openstack.org/#/c/35165/ Do you still think it should be simplified ? | 15:33 |
| dkranz | kashyap: No clue. Still haven't used quantum. | 15:33 |
| kashyap | dkranz, No worries :-) I've been torturing myself with an 2 node setup manually. Almost there, but I hit these niggling issues | 15:34 |
| kashyap | I need a walk! | 15:35 |
| dkranz | kashyap: :) | 15:35 |
| giulivo | afazekas, not simplified | 15:36 |
| giulivo | I only suggested few changes | 15:36 |
| giulivo | unfortunately I can'd edit my own comments or I'd have worded better but, let's go trough those | 15:39 |
| giulivo | I'd move lines from 64 to 67 right after the while statement so you start by inspecting the actual state rather than the returning body and don't need lines from 40 to 42 | 15:42 |
| giulivo | also, afazekas, why the lines 48 and 49 ? | 15:43 |
| *** Anju_ has joined #openstack-qa | 15:49 | |
| afazekas | "Considering fast status changes for BUILD status related tests. | 15:49 |
| afazekas | BUILD status wait can be useful when the server does | 15:49 |
| afazekas | not really need to be active for the test and we do not want to | 15:49 |
| afazekas | fail because the server reached the ACTIVE state before responding | 15:49 |
| afazekas | to the status query, due to rate limitation or for other reasons." | 15:49 |
| giulivo | I see, that is the response to one of the 4 comments | 15:54 |
| afazekas | The other are did in more difficult way to use a wait template which is more extendable | 15:55 |
| *** lexinator has joined #openstack-qa | 15:56 | |
| afazekas | boto's wait function relatively complex, but even those are not fully flagged, so a common wait skeleton sooner or later would be nice. Some kind of wait classes , or closures.. good code reuse solution should be used | 15:57 |
| afazekas | I grepped 41 wait function like thing last time in tempest .. | 15:58 |
| *** SergeyLukjanov has joined #openstack-qa | 16:03 | |
| openstackgerrit | A change was merged to openstack/tempest: Use state transition checker wait function in the ec2 image tests https://review.openstack.org/38805 | 16:05 |
| afazekas | https://github.com/openstack/nova/blob/master/nova/api/openstack/common.py#L62 a lot of task_state is mapped to the ACTIVE status | 16:05 |
| afazekas | the cli lies, and show more states then actually used | 16:06 |
| afazekas | most of this task_state does not allows additional actions | 16:06 |
| *** marun has joined #openstack-qa | 16:06 | |
| afazekas | s/then/than/ | 16:06 |
| *** adalbas has joined #openstack-qa | 16:10 | |
| anteaya | mtreinish: I just tried to run this command in /opt/stack/tempest in devstack: testr run --parallel tempest.api.identity.admin.test_services.py and got a No repository found in /opt/stack/tempest. Create one by running "testr init". | 16:11 |
| anteaya | I have never had to run testr init in any other repository, should I have to in /opt/stack/tempest? | 16:11 |
| anteaya | I also did a git pull in /opt/stack/tempest and re-ran ./unstack.sh and ./stack.sh and source openrc | 16:12 |
| anteaya | am I missing anything? | 16:12 |
| *** jgallard has quit IRC | 16:13 | |
| clarkb | anteaya: if you run tox for other projects we have configured tox to make sure it does a testr init if necessary | 16:15 |
| clarkb | anteaya: since you are not using tox here you may need to do a testr init manually. just run `testr init` it creates a .testrepository dir and some files in it | 16:16 |
| anteaya | okay so I have to run tox first | 16:16 |
| anteaya | I have avoided doing that in tempest since it take soooooo long to finish locally | 16:16 |
| clarkb | well you don't have to. but one of the reasons tox and run_tests exist is to make it so you don't have to think about this stuff | 16:16 |
| anteaya | but I will start it and then control-C out of it | 16:16 |
| clarkb | anteaya: in that case just run `testr init` manually | 16:16 |
| anteaya | okay I will do that, thanks clarkb | 16:16 |
| anteaya | just wanted to ensure I wasn't missing something else I should have done already | 16:17 |
| *** krtaylor has joined #openstack-qa | 16:17 | |
| anteaya | something that took 2 hours and 20 minutes (same vm instance) took less than a minute with testr run --parallel | 16:18 |
| anteaya | wow | 16:18 |
| clarkb | probably a bug somewhere :) | 16:19 |
| anteaya | in nosetests? | 16:19 |
| anteaya | or in my testr run --parallel run? | 16:19 |
| clarkb | testr run | 16:19 |
| clarkb | I wouldn't expect that kind of speedup | 16:20 |
| clarkb | anteaya: if you look in .testrepository/1 you should the subunit log of what happened | 16:20 |
| clarkb | Note the '1' corresponds to the test run id spat out by testr at the end of its run | 16:20 |
| anteaya | I will look, thank you | 16:21 |
| *** hemnafk is now known as hemna | 16:21 | |
| anteaya | clarkb: I ran it twice, so .testrepository/0 and .testrepository/1, both log files have no contents | 16:27 |
| anteaya | I wonder what took 5 seconds to run then? | 16:27 |
| anteaya | so yeah, bug | 16:28 |
| *** psedlak__ has quit IRC | 16:30 | |
| anteaya | removing the --parallel flag nets the same result | 16:31 |
| afazekas | anteaya: their is keystone code related the ec2 which will be partially removed, ant the ec2 credentials will be configured by devstack | 16:32 |
| anteaya | I don't even know where to begin looking | 16:32 |
| anteaya | afazekas: do you feel the ec2 credentials might be playing a role in how testr is running tests? | 16:32 |
| afazekas | now it happens on module time, long time ago it was delayed | 16:34 |
| anteaya | or are you saying that the ec2 credential configuration is what is taking 5 seconds? | 16:34 |
| *** aoeuaoeu has joined #openstack-qa | 16:35 | |
| *** aoeuaoeu has quit IRC | 16:35 | |
| afazekas | I did not measured it, it is communication with keystone it can be part of that time | 16:35 |
| anteaya | afazekas: okay thanks, yes that would make sense | 16:36 |
| anteaya | because none of the 5 seconds involves running any of the tests | 16:36 |
| anteaya | guess I have to find lifeless | 16:37 |
| anteaya | who would be asleep now methinks | 16:37 |
| afazekas | anteaya: I'll try to add devstack config soon | 16:37 |
| anteaya | okay thanks | 16:37 |
| openstackgerrit | A change was merged to openstack/tempest: Switching to oslo importutils in the stress tests https://review.openstack.org/39279 | 16:38 |
| anteaya | when you have a patch for that, I'd love to see | 16:38 |
| openstackgerrit | A change was merged to openstack/tempest: Sorting services list before asserting in test_get_service_list test https://review.openstack.org/39416 | 16:38 |
| anteaya | I think I will get some food now | 16:38 |
| anteaya | oh and planting some seeds -- qa bootcamp | 16:40 |
| anteaya | qa bootcamp | 16:41 |
| anteaya | qa bootcamp | 16:41 |
| openstackgerrit | A change was merged to openstack/tempest: Add stress test to attach volumes to vm's https://review.openstack.org/36652 | 16:42 |
| *** prekarat has joined #openstack-qa | 16:46 | |
| openstackgerrit | Marc Koderer proposed a change to openstack/tempest: Add argument to stop stress test on first error https://review.openstack.org/39524 | 16:47 |
| *** prekarat has quit IRC | 16:47 | |
| *** prekarat has joined #openstack-qa | 16:47 | |
| *** adam___ has joined #openstack-qa | 16:49 | |
| mtreinish | anteaya: sorry I was at lunch. Drop the py from the test filter in your command above | 16:52 |
| mtreinish | you weren't actually running any tests | 16:52 |
| anteaya | no worries, I am cooking some myself | 16:52 |
| mtreinish | that's why it ran so quickly | 16:52 |
| anteaya | ah ha, I will do that thanks | 16:52 |
| *** openstack has joined #openstack-qa | 17:19 | |
| adam___ | Hi, currently stress tests are not printing output on console, is it expected? or somthing wrong with it [ | 17:20 |
| Anju_ | adam__:what output u are expexting? | 17:28 |
| Anju_ | adam____:ping | 17:29 |
| Anju_ | sdague:ping | 17:30 |
| kashyap | Anju_, Friendly suggestion - if you have questions, just write them here. A 'naked' ping without context is usually frowned up on. | 17:37 |
| Anju_ | thanks: kashyap | 17:37 |
| openstackgerrit | A change was merged to openstack-infra/devstack-gate: add oslo.* to the projects list https://review.openstack.org/39465 | 17:38 |
| openstackgerrit | Prem Karat proposed a change to openstack/tempest: Add nova-v3-api tests for Create_Servers https://review.openstack.org/37671 | 17:41 |
| mtreinish | afazekas__: have you seen this before?: https://jenkins.openstack.org/job/gate-tempest-devstack-vm-testr-full/3158/console | 17:42 |
| *** afazekas__ is now known as afazekas | 17:42 | |
| *** adam___ has quit IRC | 17:44 | |
| afazekas | mtreinish: How frequently does it happens ? | 17:44 |
| mtreinish | afazekas: I think I've only seen it once maybe twice | 17:46 |
| mtreinish | but probably just that one time | 17:46 |
| *** adam___ has joined #openstack-qa | 17:47 | |
| adam___ | Hi, currently stress tests are not printing output on console, is it expected? or somthing wrong with it?? | 17:48 |
| afazekas | mtreinish: what is the test case timeout value ? | 17:48 |
| *** mlavalle has quit IRC | 17:48 | |
| afazekas | adam___: you can read the log file | 17:49 |
| mtreinish | afazekas: I set it to 250sec in .testr.conf | 17:49 |
| afazekas | tail -f log.file | 17:49 |
| mtreinish | that's the default, but its configurable with the OS_TEST_TIMEOUT environ | 17:49 |
| mtreinish | (the gate uses the default, or it should) | 17:50 |
| *** adam___ has quit IRC | 17:51 | |
| *** prekarat has quit IRC | 17:55 | |
| afazekas | mtreinish: the volume was in error state | 17:55 |
| mtreinish | afazekas: ok, so just a transient failure. Nothing to fix on our end? | 17:56 |
| mtreinish | or in one of the projects? | 17:56 |
| afazekas | http://fpaste.org/29299/29342013/ from http://logs.openstack.org/95/39495/1/check/gate-tempest-devstack-vm-testr-full/3158/logs/screen-n-api.txt.gz | 17:57 |
| afazekas | yes | 17:57 |
| afazekas | mtreinish: the boto wait logic does not have the exception on 'error' state feature | 17:58 |
| afazekas | they are timeouting | 17:59 |
| mtreinish | afazekas: ok, is that something we want to add to the boto tests? So that we don't sit there waiting 250secs? | 17:59 |
| *** adam____ has joined #openstack-qa | 17:59 | |
| adam____ | afazekas: where log.file created??? | 18:00 |
| adam____ | I did not configure any thing for logging | 18:00 |
| afazekas | in the current work directory , I'll check it soon | 18:02 |
| adam____ | ok pls leave you answer with my name, thnx for help | 18:03 |
| *** adam____ has quit IRC | 18:03 | |
| openstackgerrit | Matthew Treinish proposed a change to openstack/tempest: Add more locks for hosts and availability zones https://review.openstack.org/39539 | 18:06 |
| *** mlavalle has joined #openstack-qa | 18:06 | |
| openstackgerrit | Matthew Treinish proposed a change to openstack/tempest: Add more locks for hosts and availability zones https://review.openstack.org/39539 | 18:07 |
| afazekas | adam____: stress.debug.log | 18:12 |
| afazekas | mkoderer: what do you think about moving the stress test to use the oslo logger ? | 18:14 |
| mtreinish | afazekas, mkoderer: I think that we should everything else is using it. | 18:15 |
| mtreinish | in tempest that is | 18:15 |
| afazekas | The neutron smoke gate has too high fail ratio looks like volume and security group also involved | 18:19 |
| openstackgerrit | Matthew Treinish proposed a change to openstack/tempest: Add tenant isolation for scenario tests https://review.openstack.org/39099 | 18:19 |
| afazekas | Probably I will spend more time on stress testing the near future | 18:19 |
| mtreinish | afazekas: last time I looked at the neutron gate jobs it wasn't even getting past devstack exercises | 18:19 |
| afazekas | yes | 18:20 |
| afazekas | in my system I do not have exercises , and in this case the system behaves differently .. | 18:21 |
| afazekas | It is another issue I had to figure out .. | 18:21 |
| mtreinish | afazekas: you don't run devstack? | 18:21 |
| afazekas | I run | 18:21 |
| afazekas | I have very simple script to start devstack + tempest | 18:22 |
| afazekas | I will try to migrate to some gate script to start it | 18:22 |
| afazekas | On the first run the EC2 tests are failing on F19 | 18:23 |
| mtreinish | afazekas: oh, ok the gate just runs ./exercise.sh before it starts running tempest | 18:23 |
| afazekas | I try to add it, If it fixes the full run would be very interesting :) | 18:23 |
| *** lexinator has quit IRC | 18:30 | |
| afazekas | BTW: what limits the maximum versions in the global requirements.txt ? I Install a lot of thing from pip because F19 has newer packages | 18:32 |
| mtreinish | afazekas: https://github.com/openstack/requirements/blob/master/requirements.txt | 18:34 |
| afazekas | can I increase the max version, just by committing there ? | 18:34 |
| mtreinish | afazekas: there first, but then you'll probably have to do it in the package too | 18:35 |
| mtreinish | so update global first to allow an upgrade in tempest | 18:36 |
| *** lexinator has joined #openstack-qa | 18:37 | |
| openstackgerrit | Sean Dague proposed a change to openstack-dev/devstack: Update projects to global requirements before setup https://review.openstack.org/35705 | 18:37 |
| openstackgerrit | Sean Dague proposed a change to openstack-dev/devstack: add lib/infra https://review.openstack.org/39528 | 18:37 |
| openstackgerrit | A change was merged to openstack-dev/devstack: Fix a typo error in the openvz image link https://review.openstack.org/39529 | 18:39 |
| afazekas | mtreinish: Now it would have effect to every project ( alembic 0.4.2 , sqlalchemy 0.8.1) | 18:42 |
| *** mlavalle has quit IRC | 18:42 | |
| mkoderer | afazekas mtreinish sorry wasn't there - so should I add the oslo logger to the stress bp? | 18:46 |
| mkoderer | I think makes sense | 18:46 |
| mtreinish | mkoderer: hopefully it should be as simple as just changing the imports to 'from tempest.openstack.common import log as logging' | 18:48 |
| mtreinish | afazekas: ask sdague for the details of how things are pulled in the gate and for all the projects | 18:48 |
| mkoderer | ahh ok, never had a closer look to it | 18:48 |
| afazekas | mkoderer: yes, the stress already using the tempest.conf, I think it ok if logger initialized based on the temepst.conf | 18:48 |
| mtreinish | I think things are in flux right now | 18:48 |
| mtreinish | afazekas: there might be a way to play games with logging.setup() to get a seperate log file for stress | 18:49 |
| afazekas | mtreinish: it has some hard coded logger setting, it will be little more | 18:49 |
| sdague | afazekas: you need to get all the projects to work with it, basically | 18:49 |
| sdague | and I think heat is the blocker on sqla right now | 18:49 |
| sdague | they use a feature that was removed in 0.8 | 18:49 |
| mkoderer | cool - I will have a look tomorrow | 18:49 |
| mkoderer | afazekas: or do you want to do it? | 18:49 |
| afazekas | sdague: all of them ? | 18:50 |
| sdague | afazekas: yes | 18:50 |
| sdague | all the gating projects | 18:50 |
| sdague | remember, python doesn't let us have multiple versions installed | 18:50 |
| sdague | so everything that's in the gate has to be able to work with a single version | 18:50 |
| afazekas | sdague: do you have any detailed info about which feature was removed ? | 18:51 |
| afazekas | I mean from the sqlalchemy 0.8 | 18:52 |
| sdague | afazekas: search back on openstack-dev list | 18:52 |
| sdague | it's come up a couple of times | 18:52 |
| sdague | in the last couple months | 18:52 |
| afazekas | As I remember many project want to move to alembic , because of some sqlalachemy-migrate issue | 18:53 |
| afazekas | sdague: thx | 18:54 |
| mkoderer | when will the voting for the opensummit talks start? | 18:55 |
| mkoderer | tomorrow? | 18:56 |
| mkoderer | dkranz: did I understand you correctly that you want to create a sanity check for the stress tests? | 19:08 |
| dkranz | mkoderer: Yes. | 19:08 |
| mkoderer | I am just updating the blueprint work items... | 19:08 |
| dkranz | mkoderer: The idea was to run one case of each stress action in the gate to make sure they work and don't bit rot | 19:08 |
| mkoderer | dkranz: I will put your name on it | 19:09 |
| dkranz | mkoderer: So we don't submit broken code. | 19:09 |
| mkoderer | dkranz: yes shouldn't be hard with the new "-n" option | 19:09 |
| mkoderer | dkranz: thanks! | 19:09 |
| *** Anju_ has quit IRC | 19:11 | |
| *** mlavalle has joined #openstack-qa | 19:17 | |
| *** SergeyLukjanov has quit IRC | 19:24 | |
| burt | sdague: one new idea came up in nova for running _sync_power_states on demand in tempest: use the eventlet backdoor | 19:26 |
| afazekas | dkranz: we should have jobs for the skipped random failure test cases as well, to be sure they are fixed :) | 19:27 |
| *** SergeyLukjanov has joined #openstack-qa | 19:27 | |
| *** jhenner has quit IRC | 19:29 | |
| afazekas | burt: the back door usage is little bit gray for me, as the whitebox direct sql update, but if there is no other way | 19:29 |
| afazekas | .. | 19:29 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/devstack-gate: Build a devstack-gate image with diskimage-builder https://review.openstack.org/38871 | 19:29 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/devstack-gate: Proof of concept of kexec/takeovernode https://review.openstack.org/38887 | 19:29 |
| afazekas | So if there is no other way, it is ok for me | 19:32 |
| *** afazekas is now known as afazekas_zz | 19:33 | |
| sdague | burt: that's an interesting idea, I like it :) | 19:39 |
| clarkb | going to throw this out in here as well https://bugs.launchpad.net/tempest/+bug/1207066 | 19:41 |
| mtreinish | clarkb: afazekas_zz has a fix that fixes that. | 19:42 |
| mtreinish | actually nm it doesn't look like it fixed it | 19:43 |
| *** lexinator has quit IRC | 19:43 | |
| clarkb | this one https://review.openstack.org/#/c/39505/1 ? ya the console log is still giant with a lot of noise | 19:44 |
| *** lexinator has joined #openstack-qa | 19:44 | |
| mtreinish | clarkb: I'll push something out that'll dump it to a file by default | 19:45 |
| openstackgerrit | Sean Dague proposed a change to openstack-dev/devstack: Update projects to global requirements before setup https://review.openstack.org/35705 | 19:49 |
| openstackgerrit | Sean Dague proposed a change to openstack-dev/devstack: add lib/infra https://review.openstack.org/39528 | 19:49 |
| kashyap | Heya, when you get a moment, I made a typo in keystone end-point URL. Is there a way I gracefully edit it w/o mucking around w/ mysql? | 20:02 |
| openstackgerrit | Matthew Treinish proposed a change to openstack-dev/devstack: Fix tempest logging configuration https://review.openstack.org/39571 | 20:10 |
| * clarkb reviews | 20:11 | |
| mtreinish | clarkb: that was a fast response, I didn't even get a chance to point it out to you | 20:11 |
| clarkb | mtreinish: I was watching window 15 like a hawk :) | 20:11 |
| *** SergeyLukjanov has quit IRC | 20:12 | |
| clarkb | mtreinish: one problem with that is it will only fix things for devstack | 20:12 |
| clarkb | mtreinish: mriedem pointed in out in #openstack-infra and noted (s)he is not using devstack | 20:12 |
| clarkb | however, I am happy about the change because it will make the gate related stuff happier | 20:13 |
| mtreinish | clarkb: yeah, but it should fix it for the gate. I didn't want to steal afazekas_zz patch. I'm going to give him review comments to add the log_file to his patch | 20:13 |
| clarkb | mtreinish: gotcha | 20:13 |
| *** adalbas has quit IRC | 20:13 | |
| mtreinish | mriedem is a he 'm' for Matt | 20:13 |
| mtreinish | clarkb: afazekas_zz patch will work if you just run nosetests without any options, but one of the options we use in the tox job keeps printing out the logging unless we give it a file | 20:14 |
| clarkb | I see | 20:15 |
| mtreinish | just don't ask me which one | 20:16 |
| mtreinish | or why we need it | 20:16 |
| dkranz | lifeless: I seem to have gotten into some strange state with testr in the tempest directory where list-tests gives unittest.loader.ModuleImportError.. stuff | 20:22 |
| dkranz | lifeless: http://paste.openstack.org/show/42783/ | 20:22 |
| dkranz | lifeless: Any ideas? | 20:22 |
| clarkb | dkranz: I think python is unable to import the code due to a syntax error or similar | 20:23 |
| clarkb | dkranz: try running flake8 over your code | 20:23 |
| clarkb | or manually import one of those modules and look for tracebacks | 20:23 |
| dkranz | clarkb: Hmm. Yes there are errors but why does testr list them as tests it found? | 20:25 |
| clarkb | dkranz: I think that is a discover behavior | 20:26 |
| clarkb | dkranz: discover looks for modules and classes and functions that meet certain criteria. If one meeting the criteria fails to import it is letting you know | 20:27 |
| clarkb | dkranz: as is those names will not be importable and will fail to run so you should end up with failed tests | 20:27 |
| dkranz | clarkb: OK, but it is weird. | 20:28 |
| *** krtaylor has quit IRC | 20:29 | |
| openstackgerrit | Sean Dague proposed a change to openstack-dev/grenade: add oslo and infra from git to the upgrade https://review.openstack.org/39574 | 20:32 |
| *** meteorfox has quit IRC | 20:34 | |
| lifeless | dkranz: anteaya: lets talk in -infra | 20:34 |
| mtreinish | clarkb: it's clean: https://jenkins.openstack.org/job/gate-tempest-devstack-vm-full/37953/console | 20:37 |
| anteaya | lifeless: okay | 20:40 |
| *** lexinator has left #openstack-qa | 20:41 | |
| *** giulivo has quit IRC | 20:43 | |
| openstackgerrit | A change was merged to openstack-dev/devstack: add lib/infra https://review.openstack.org/39528 | 20:47 |
| openstackgerrit | Matt Riedemann proposed a change to openstack/tempest: Sync up the default value for the network_for_ssh option https://review.openstack.org/39577 | 20:51 |
| openstackgerrit | A change was merged to openstack/tempest: Add tox job for serial testr https://review.openstack.org/39371 | 20:52 |
| openstackgerrit | A change was merged to openstack/tempest: Negative test added for rescuing a paused vm https://review.openstack.org/39230 | 20:55 |
| openstackgerrit | Matt Riedemann proposed a change to openstack/tempest: Make test_neutron_dhcp_agent_list_hosting_net use net name from conf https://review.openstack.org/39581 | 21:02 |
| *** dkranz has quit IRC | 21:03 | |
| openstackgerrit | Matthew Treinish proposed a change to openstack-dev/devstack: Fix tempest logging configuration https://review.openstack.org/39571 | 21:08 |
| *** jasondotstar has quit IRC | 21:08 | |
| openstackgerrit | Sean Dague proposed a change to openstack-dev/grenade: add oslo and infra from git to the upgrade https://review.openstack.org/39574 | 21:09 |
| *** jasondotstar has joined #openstack-qa | 21:10 | |
| openstackgerrit | Matthew Treinish proposed a change to openstack-infra/devstack-gate: Copy tempest.log to logs dir after tempest run https://review.openstack.org/39583 | 21:12 |
| *** krtaylor has joined #openstack-qa | 21:14 | |
| sdague | oh, we lost dkranz for the day | 21:16 |
| *** meteorfox has joined #openstack-qa | 21:22 | |
| *** jasondotstar has quit IRC | 21:28 | |
| openstackgerrit | Matthew Treinish proposed a change to openstack-infra/devstack-gate: Copy tempest.log to logs dir after tempest run https://review.openstack.org/39583 | 21:30 |
| *** jog0 has joined #openstack-qa | 21:30 | |
| jog0 | mtreinish: ping | 21:30 |
| jog0 | looking now | 21:30 |
| mtreinish | jog0: pong | 21:30 |
| mtreinish | ok thanks | 21:31 |
| jog0 | I am in a car so may loose my connection randomly | 21:31 |
| mtreinish | jog0: no problem I'm gonna be heading home for the day shortly myself | 21:31 |
| jog0 | mtreinish: do you have the nova api logs? | 21:34 |
| jog0 | just found em | 21:34 |
| mtreinish | jog0: ok cool | 21:34 |
| mtreinish | sorry about that looks like I picked python from the pastebin dropdown so it didn't make a link | 21:35 |
| *** woodspa has quit IRC | 21:42 | |
| jog0 | good news is its not a tempest race condition | 21:42 |
| jog0 | mtreinish: I only see two calls that do anything with that AZ: create AZ and create server | 21:43 |
| mtreinish | jog0: ok, so you think it's a nova issue then? This only started happening after the az in available_zones check was added to server create with an az (which makes sense) | 21:44 |
| mtreinish | jog0: I think that there should be 4 though, 2 for json and 2 for xml | 21:45 |
| jog0 | mtreinish: actaully I didn't check the command to add the host to the az | 21:46 |
| *** mlavalle has quit IRC | 21:46 | |
| jog0 | mtreinish: hmm | 21:48 |
| mtreinish | jog0: something catch your eye? | 21:52 |
| *** mlavalle has joined #openstack-qa | 21:54 | |
| jog0 | mtreinish: besides how bad the longs are no | 21:55 |
| jog0 | logs* | 21:55 |
| jog0 | they are full of junk | 21:55 |
| jog0 | the API requests don't seem to be logged propperly (the bodies of that is) | 21:56 |
| jog0 | and its hard to read with all the notifiers | 21:56 |
| jog0 | I just found the xml test | 21:57 |
| jog0 | and that one passed as you said | 21:57 |
| mtreinish | jog0: yeah its not easy to follow with all the parallel requests happening when running with testr | 22:00 |
| jog0 | mtreinish: are you sur teh lock logic is working? | 22:02 |
| clarkb | mtreinish: for parallel logging you probably want to capture the logs in each test runner and attach the logs to the subunit stream | 22:03 |
| clarkb | this is what nova does and it allows you to see logs for each test | 22:03 |
| jog0 | clarkb: good idea | 22:04 |
| mtreinish | jog0: I think it is, it creates the lock files locally for me when it's running and at one point I broke devstack configuring tempest and the lockutils decerator errored out saying it didn't have a directory to put the lock files | 22:04 |
| *** burt has quit IRC | 22:05 | |
| mtreinish | clarkb: it's a bit trickier here though because I was referring to the logs from nova, glance, etc. for tempest runs which don't have any ideas about the test runners | 22:05 |
| clarkb | oh yeah | 22:06 |
| mtreinish | before it was nice and simple you could pull out a time stamp from the tempest log and find that in the service logs | 22:06 |
| jog0 | 2013-07-31 20:09:17.608 DEBUG nova.api.openstack.wsgi [req-b2f65d2d-a672-4971-ba29-2e7c4a9e1e24 admin admin] Action: 'create', body: {"aggregate": {"name": "test_aggregate_4984", "availability_zone": "nova"}} _process_stack /opt/stack/new/nova/nova/api/openstack/wsgi.py:927 | 22:06 |
| mtreinish | now it's kind of messy because there are 4 requests going on at the same time | 22:06 |
| jog0 | there is a az aggregate | 22:06 |
| clarkb | mtreinish: ya, so logstash in theory can help with this by making it easy to trace uuids through the logs | 22:08 |
| jog0 | 2013-07-31 20:09:18.298 DEBUG nova.api.openstack.wsgi [req-00f2d9e1-b66e-43d0-81fc-1a6616f6db25 admin admin] Action: 'create', body: {"aggregate": {"name": "test_aggregate_14159", "availability_zone": "nova"}} _process_stack /opt/stack/new/nova/nova/api/openstack/wsgi.py:927 | 22:08 |
| clarkb | unfortunately right now logstash got behind and then jeblair is doing semi breaking changes to where logs go so it probably won't be useful again until at least tomorrow | 22:08 |
| mtreinish | jog0: is that it, because the az should have a random name from the test: | 22:08 |
| mtreinish | az_name = rand_name(self.az_name_prefix) | 22:08 |
| jog0 | mtreinish: no that is not it I think | 22:08 |
| mtreinish | the prefix is 'test_az_' | 22:09 |
| jog0 | but some other test doesn't have that prefix | 22:09 |
| jog0 | so it looks like the xml test ran first | 22:14 |
| jog0 | and successfully | 22:14 |
| mtreinish | jog0: yeah, that's what the results indicated. | 22:17 |
| mtreinish | jog0: I don't see any aggregate test that creates an aggregate with the availability_zone name as nova. I wonder where that came from | 22:21 |
| jog0 | mtreinish: it did metadata changes after | 22:22 |
| mtreinish | clarkb: ok no rush, it'll be useful when it's back up but I've been manually fighting through things so far so what's a few more days | 22:22 |
| mtreinish | jog0: the client or nova? | 22:23 |
| clarkb | mtreinish: it should be happy shortly, growing pains | 22:23 |
| jog0 | mtreinish: tempest | 22:23 |
| jog0 | mtreinish: so add a line to print out the availability zones | 22:23 |
| jog0 | and lets see what that says when thisfails | 22:23 |
| jog0 | that should help isolate the issue | 22:23 |
| mtreinish | jog0: ok one sec. | 22:24 |
| jog0 | and where each service is | 22:25 |
| *** jasondotstar has joined #openstack-qa | 22:27 | |
| mtreinish | jog0: is this enough? http://paste.openstack.org/show/42801/ | 22:28 |
| mtreinish | that method just does a get on os-availability-zone/detail | 22:29 |
| mtreinish | or did you mean do the print on the nova side? | 22:29 |
| jog0 | mtreinish: yeah taht should be | 22:29 |
| jog0 | tempest side is better although either works | 22:29 |
| jog0 | what is the first return value that you are hiding? | 22:29 |
| mtreinish | jog0: ok I'll push it out as a wip. (I haven't been able to reproduce locally since I added the locking) | 22:30 |
| mtreinish | jog0: that's the resp from the http request | 22:30 |
| jog0 | mtreinish: ahh | 22:30 |
| mtreinish | has the status code and stuff like that from the http lib | 22:30 |
| jog0 | kk | 22:30 |
| jog0 | hopefully we can reproduce | 22:31 |
| openstackgerrit | Matthew Treinish proposed a change to openstack/tempest: Do not merge test for az fail https://review.openstack.org/39596 | 22:31 |
| mtreinish | yeah I hope so too. | 22:32 |
| mtreinish | I did this before I added the locking, when it was failing locally, and if I remember correctly it was printing both azs from xml and tempest | 22:33 |
| mtreinish | or actually just 2 azs but I was only expecting one because we clean them up on every test | 22:34 |
| mtreinish | jog0: anyway I'm gonna head home now I'll ping you tomorrow, hopefully we'll have more data... | 22:35 |
| jog0 | mtreinish: night | 22:41 |
| openstackgerrit | Steve Baker proposed a change to openstack-dev/devstack: Support heat in standalone mode. https://review.openstack.org/39602 | 22:48 |
| *** mlavalle has quit IRC | 22:53 | |
| *** rhsu has joined #openstack-qa | 22:59 | |
| *** bugsduggan has left #openstack-qa | 23:02 | |
| *** rhsu has quit IRC | 23:05 | |
| *** rhsu has joined #openstack-qa | 23:05 | |
| *** rhsu has quit IRC | 23:06 | |
| *** rhsu has joined #openstack-qa | 23:06 | |
| openstackgerrit | A change was merged to openstack-dev/devstack: Fix tempest logging configuration https://review.openstack.org/39571 | 23:29 |
| clarkb | \o/ | 23:29 |
| *** adalbas has joined #openstack-qa | 23:31 | |
| *** adalbas has quit IRC | 23:42 | |
| *** hemna is now known as hemnafk | 23:46 | |
| openstackgerrit | Ivan-Zhu proposed a change to openstack/tempest: port test_images and test_server_actions into v3 https://review.openstack.org/39609 | 23:56 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!