| *** aimon has joined #openstack-qa | 00:13 | |
| *** Sukhdev has joined #openstack-qa | 00:16 | |
| *** fbo has quit IRC | 00:18 | |
| *** TravT has quit IRC | 00:22 | |
| openstackgerrit | Ken'ichi Ohmichi proposed a change to openstack/tempest: Add "create a server" test with server group https://review.openstack.org/86792 | 00:26 |
|---|---|---|
| *** fbo has joined #openstack-qa | 00:28 | |
| *** Sukhdev has quit IRC | 00:30 | |
| *** GMann has joined #openstack-qa | 00:40 | |
| *** zhikunliu has joined #openstack-qa | 00:41 | |
| *** GMann_ has joined #openstack-qa | 00:42 | |
| *** GMann has quit IRC | 00:44 | |
| *** Lin has quit IRC | 01:12 | |
| *** tiantian has joined #openstack-qa | 01:13 | |
| *** mlavalle has quit IRC | 01:15 | |
| *** mriedem has joined #openstack-qa | 01:15 | |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Delete fingerprint for 1224001 https://review.openstack.org/94276 | 01:23 |
| *** sthaha has quit IRC | 01:25 | |
| *** sthaha has joined #openstack-qa | 01:26 | |
| openstackrecheck | openstack/horizon change: https://review.openstack.org/93761 failed gate-tempest-dsvm-postgres-full in the gate queue with an unrecognized error | 01:27 |
| *** nati_ueno has quit IRC | 01:27 | |
| *** safchain has quit IRC | 01:27 | |
| *** GMann_ has quit IRC | 01:29 | |
| *** zhikunliu has quit IRC | 01:35 | |
| *** tiantian has quit IRC | 01:36 | |
| *** tiantian has joined #openstack-qa | 01:36 | |
| *** openstackrecheck has quit IRC | 01:37 | |
| *** openstackrecheck has joined #openstack-qa | 01:37 | |
| *** nosnos has joined #openstack-qa | 01:47 | |
| *** malini is now known as malini_afk | 01:53 | |
| *** marun has quit IRC | 02:09 | |
| *** bill_az has quit IRC | 02:27 | |
| *** mriedem has quit IRC | 02:51 | |
| *** ivanzhu has joined #openstack-qa | 02:52 | |
| *** nosnos has quit IRC | 03:07 | |
| *** GMann has joined #openstack-qa | 03:16 | |
| openstackrecheck | openstack/glance change: https://review.openstack.org/94071 failed gate-tempest-dsvm-postgres-full in the gate queue with an unrecognized error | 03:26 |
| openstackgerrit | Steve Baker proposed a change to openstack/tempest: Make test_server_cfn_init a scenario test https://review.openstack.org/88137 | 03:29 |
| openstackgerrit | Steve Baker proposed a change to openstack/tempest: WIP scenario test for heat software-config https://review.openstack.org/92731 | 03:29 |
| openstackgerrit | Steve Baker proposed a change to openstack/tempest: Remove unorthodox credentials for orchestration scenarios https://review.openstack.org/94300 | 03:29 |
| *** nati_ueno has joined #openstack-qa | 03:29 | |
| *** bill_az has joined #openstack-qa | 03:36 | |
| *** coolsvap|afk is now known as coolsvap | 03:37 | |
| *** bill_az has quit IRC | 03:42 | |
| *** nosnos has joined #openstack-qa | 03:47 | |
| *** morganfainberg is now known as morganfainberg_Z | 03:49 | |
| *** GMann has quit IRC | 03:50 | |
| *** nati_ueno has quit IRC | 03:55 | |
| *** Sukhdev has joined #openstack-qa | 03:59 | |
| *** nosnos has quit IRC | 04:01 | |
| *** nati_ueno has joined #openstack-qa | 04:05 | |
| *** GMann has joined #openstack-qa | 04:15 | |
| *** ivanzhu has quit IRC | 04:21 | |
| *** ivanzhu has joined #openstack-qa | 04:22 | |
| *** Abhijeet has joined #openstack-qa | 04:22 | |
| *** yfried has quit IRC | 04:28 | |
| *** nosnos has joined #openstack-qa | 04:30 | |
| *** GMann has quit IRC | 04:30 | |
| *** ivanzhu has quit IRC | 04:34 | |
| *** mkoderer has joined #openstack-qa | 04:34 | |
| *** psharma has joined #openstack-qa | 04:35 | |
| *** Madan has joined #openstack-qa | 04:47 | |
| *** nati_ueno has quit IRC | 04:49 | |
| *** nati_ueno has joined #openstack-qa | 04:50 | |
| *** Madan has quit IRC | 05:03 | |
| *** GMann has joined #openstack-qa | 05:06 | |
| *** yfried has joined #openstack-qa | 05:09 | |
| *** ivanzhu has joined #openstack-qa | 05:15 | |
| *** tiantian has quit IRC | 05:21 | |
| *** jamielennox is now known as jamielennox|away | 05:32 | |
| *** ivanzhu has quit IRC | 05:36 | |
| *** nati_uen_ has joined #openstack-qa | 05:46 | |
| *** GMann has quit IRC | 05:47 | |
| *** nati_ueno has quit IRC | 05:49 | |
| openstackgerrit | Abhijeet Jain proposed a change to openstack/tempest: tests for Keystone endpoint V2 API https://review.openstack.org/93390 | 05:51 |
| *** nati_uen_ has quit IRC | 05:52 | |
| *** GMann has joined #openstack-qa | 05:53 | |
| *** nati_ueno has joined #openstack-qa | 05:53 | |
| *** Sukhdev has quit IRC | 05:59 | |
| openstackgerrit | Joe Gordon proposed a change to openstack-infra/elastic-recheck: Add fingerprint for bug 1321093 https://review.openstack.org/94308 | 06:01 |
| yfried | guys, I want to improve the debug in network failures. to do that, I need to ssh to localhost, how can I get user and pass/key during runtime? | 06:09 |
| openstackgerrit | Longgeek proposed a change to openstack-dev/devstack: ceilometer.conf configuration option missing os_auth_url https://review.openstack.org/94235 | 06:11 |
| *** tiantian has joined #openstack-qa | 06:12 | |
| Abhijeet | Jordan Pittier : Are you there ? | 06:16 |
| *** akamyshnikova has joined #openstack-qa | 06:25 | |
| *** harlowja is now known as harlowja_away | 06:28 | |
| *** giulivo has quit IRC | 06:29 | |
| *** giulivo has joined #openstack-qa | 06:32 | |
| *** Ch00k has joined #openstack-qa | 06:34 | |
| openstackgerrit | Yair Fried proposed a change to openstack/tempest: Force connection auth as part of RemoteClient in scenario https://review.openstack.org/92573 | 06:35 |
| *** GMann has quit IRC | 06:35 | |
| *** giulivo has quit IRC | 06:35 | |
| *** giulivo has joined #openstack-qa | 06:36 | |
| openstackgerrit | Abhijeet Jain proposed a change to openstack/tempest: tests the Keystone discover V2 API https://review.openstack.org/93422 | 06:37 |
| *** nati_ueno has quit IRC | 06:45 | |
| *** dkranz has quit IRC | 06:46 | |
| *** Madan has joined #openstack-qa | 06:57 | |
| *** nati_ueno has joined #openstack-qa | 06:58 | |
| *** dkranz has joined #openstack-qa | 07:02 | |
| *** Albert_13 has joined #openstack-qa | 07:05 | |
| openstackgerrit | Joe Gordon proposed a change to openstack-infra/devstack-gate: Save sql logs https://review.openstack.org/94314 | 07:09 |
| *** afazekas has quit IRC | 07:13 | |
| *** andreaf has quit IRC | 07:17 | |
| *** tnovacik has joined #openstack-qa | 07:18 | |
| *** Ch00k_ has joined #openstack-qa | 07:18 | |
| *** Ch00k has quit IRC | 07:20 | |
| *** Madan has quit IRC | 07:29 | |
| *** tnovacik has quit IRC | 07:31 | |
| *** luqas has joined #openstack-qa | 07:43 | |
| *** Madan has joined #openstack-qa | 07:44 | |
| *** luqas has quit IRC | 07:45 | |
| *** luqas has joined #openstack-qa | 07:46 | |
| openstackgerrit | Longgeek proposed a change to openstack-dev/devstack: ceilometer.conf configuration option missing os_auth_url https://review.openstack.org/94235 | 07:50 |
| *** ilyashakhat has quit IRC | 07:51 | |
| *** esmute has quit IRC | 07:52 | |
| *** ilyashakhat has joined #openstack-qa | 07:52 | |
| *** ivanzhu has joined #openstack-qa | 07:54 | |
| *** jlibosva has joined #openstack-qa | 07:54 | |
| *** ivanzhu has quit IRC | 07:55 | |
| *** nati_ueno has quit IRC | 07:56 | |
| *** jpich has joined #openstack-qa | 07:57 | |
| *** evgenyf has joined #openstack-qa | 07:58 | |
| *** esmute has joined #openstack-qa | 07:58 | |
| *** nati_uen_ has joined #openstack-qa | 07:58 | |
| *** safchain has joined #openstack-qa | 08:05 | |
| *** dkorn has joined #openstack-qa | 08:06 | |
| *** cdent has joined #openstack-qa | 08:17 | |
| *** mkollaro has joined #openstack-qa | 08:19 | |
| *** sthaha has quit IRC | 08:22 | |
| *** andreaf has joined #openstack-qa | 08:25 | |
| *** rwsu has quit IRC | 08:26 | |
| *** dkorn has quit IRC | 08:27 | |
| *** coolsvap is now known as coolsvap|afk | 08:32 | |
| openstackgerrit | afazekas proposed a change to openstack-dev/grenade: Enable V3 cert API calls https://review.openstack.org/94226 | 08:37 |
| *** ylobankov_ has quit IRC | 08:52 | |
| openstackrecheck | openstack/heat change: https://review.openstack.org/91485 failed gate-tempest-dsvm-postgres-full in the gate queue with an unrecognized error | 08:57 |
| openstackgerrit | Longgeek proposed a change to openstack-dev/devstack: ceilometer.conf configuration option missing os_auth_url https://review.openstack.org/94327 | 09:01 |
| openstackgerrit | nayna-patel proposed a change to openstack/tempest: Adds new v3 projects tests https://review.openstack.org/93877 | 09:03 |
| *** nati_uen_ has quit IRC | 09:10 | |
| *** mkollaro has quit IRC | 09:11 | |
| *** mkollaro has joined #openstack-qa | 09:14 | |
| openstackrecheck | Console logs not available after 13:23s for gate-heat-pep8 94217,4,40d94ec | 09:17 |
| *** evgenyf has quit IRC | 09:23 | |
| *** gszasz has joined #openstack-qa | 09:28 | |
| *** GMann has joined #openstack-qa | 09:32 | |
| *** GMann has quit IRC | 09:36 | |
| openstackrecheck | openstack-dev/devstack change: https://review.openstack.org/93814 failed gate-tempest-dsvm-postgres-full in the gate queue with an unrecognized error | 09:39 |
| *** evgenyf has joined #openstack-qa | 09:40 | |
| *** luqas has quit IRC | 09:46 | |
| *** coolsvap|afk is now known as coolsvap | 09:55 | |
| *** tosky has joined #openstack-qa | 10:00 | |
| *** Ch00k_ has quit IRC | 10:10 | |
| *** Ch00k has joined #openstack-qa | 10:13 | |
| *** Ch00k has quit IRC | 10:15 | |
| openstackgerrit | afazekas proposed a change to openstack/tempest: test_aggregates_basic_ops picks a non compute node https://review.openstack.org/94203 | 10:20 |
| openstackgerrit | Elena Ezhova proposed a change to openstack/tempest: Add scenario test for load balancer's health monitor https://review.openstack.org/59729 | 10:25 |
| openstackgerrit | Elena Ezhova proposed a change to openstack/tempest: Add scenario test for load balancer's session persistence https://review.openstack.org/62662 | 10:30 |
| *** ylobankov has joined #openstack-qa | 10:34 | |
| *** afazekas has joined #openstack-qa | 10:39 | |
| *** NithyaG has joined #openstack-qa | 10:41 | |
| *** nithya_g has quit IRC | 10:44 | |
| *** tkammer has joined #openstack-qa | 10:49 | |
| NithyaG | Hi Attila, I wanted to check if https://blueprints.launchpad.net/tempest/+spec/ssh-auth-strategy is near to completion? Please let me know if you would want me to do any portion. | 10:52 |
| andreaf | afazekas: ping | 10:55 |
| *** Albert_13 has quit IRC | 10:56 | |
| *** NithyaG has quit IRC | 10:59 | |
| *** luqas has joined #openstack-qa | 11:10 | |
| *** Albert_13 has joined #openstack-qa | 11:11 | |
| *** dmorita has quit IRC | 11:22 | |
| *** yfried_ has joined #openstack-qa | 11:24 | |
| *** Ch00k has joined #openstack-qa | 11:25 | |
| *** yfried has quit IRC | 11:25 | |
| *** NithyaG has joined #openstack-qa | 11:27 | |
| *** weshay has joined #openstack-qa | 11:30 | |
| *** luqas has quit IRC | 11:32 | |
| *** yfried__ has joined #openstack-qa | 11:33 | |
| *** yfried_ has quit IRC | 11:33 | |
| openstackrecheck | openstack/python-novaclient change: https://review.openstack.org/77962 failed gate-python-novaclient-python33, gate-tempest-dsvm-postgres-full in the gate queue with an unrecognized error | 11:33 |
| *** sthaha has joined #openstack-qa | 11:37 | |
| *** nithyag_ has joined #openstack-qa | 11:38 | |
| *** NithyaG has quit IRC | 11:39 | |
| *** NithyaG has joined #openstack-qa | 11:39 | |
| *** nithyag_ has left #openstack-qa | 11:40 | |
| *** NithyaG has left #openstack-qa | 11:40 | |
| *** matsuhashi has quit IRC | 11:41 | |
| *** NithyaG has joined #openstack-qa | 11:41 | |
| *** Abhijeet has quit IRC | 11:41 | |
| akamyshnikova | afazekas, Hi! Could you take a look at https://review.openstack.org/71251. I removed test_create_show_floating_ip_another_tenant_admin. | 11:42 |
| *** tiantian has quit IRC | 11:45 | |
| dkranz | sdague: ping | 11:53 |
| *** HenryG has quit IRC | 11:53 | |
| *** tosky has quit IRC | 11:54 | |
| dkranz | sdague: the email exchange about v3 is interesting but there are 14 patches now that involve merging v2/v3 code. | 11:54 |
| dkranz | sdague: The intent of my message was that we agree to abandon those and stop doing new ones. Is there disagreement about that? | 11:55 |
| sdague | nope | 11:55 |
| sdague | at least not that I can tell | 11:55 |
| openstackgerrit | Yaroslav Lobankov proposed a change to openstack/tempest: Sahara: add API tests for job binaries https://review.openstack.org/94344 | 11:55 |
| sdague | sorry, I thought we were now down the path of looking into the micro version support design | 11:55 |
| dkranz | sdague: we are | 11:55 |
| sdague | which, honestly, I think we should handle in the nova spec around this | 11:56 |
| dkranz | sdague: Sure, but we have to first stop the v2/v3 merge blueprint | 11:56 |
| sdague | sure | 11:56 |
| dkranz | sdague: I did not intend to go further with that discussion | 11:56 |
| dkranz | sdague: I'll send another message and -2 the affected changes\ | 11:56 |
| dkranz | sdague: class inheritance with micro versions, if we do it at all, will look quite different since our classes involve multiple apis only some of which will be micro versioned at a time | 11:57 |
| *** Madan has quit IRC | 11:58 | |
| *** gszasz has quit IRC | 12:00 | |
| *** gszasz has joined #openstack-qa | 12:01 | |
| *** Ch00k has quit IRC | 12:02 | |
| *** jhenner1 has joined #openstack-qa | 12:02 | |
| *** jhenner has quit IRC | 12:04 | |
| *** mkollaro1 has joined #openstack-qa | 12:04 | |
| *** mkollaro has quit IRC | 12:04 | |
| *** afazekas has quit IRC | 12:05 | |
| *** psharma has quit IRC | 12:05 | |
| *** yfried__ has quit IRC | 12:07 | |
| *** yfried__ has joined #openstack-qa | 12:07 | |
| *** giulivo has quit IRC | 12:09 | |
| *** Ch00k has joined #openstack-qa | 12:11 | |
| openstackgerrit | Yaroslav Lobankov proposed a change to openstack/tempest: Sahara: add API tests for data sources https://review.openstack.org/93301 | 12:13 |
| *** dhellmann_ is now known as dhellmann | 12:16 | |
| *** salv-orlando_ has joined #openstack-qa | 12:18 | |
| *** salv-orlando has quit IRC | 12:20 | |
| *** salv-orlando_ is now known as salv-orlando | 12:20 | |
| *** afazekas has joined #openstack-qa | 12:20 | |
| *** aysyd has joined #openstack-qa | 12:21 | |
| *** coolsvap is now known as coolsvap|afk | 12:22 | |
| *** tnovacik has joined #openstack-qa | 12:22 | |
| *** mriedem has joined #openstack-qa | 12:23 | |
| *** giulivo has joined #openstack-qa | 12:29 | |
| *** gszasz has quit IRC | 12:29 | |
| openstackgerrit | Sridhar Gaddam proposed a change to openstack/tempest: Improve IPV6 parity in Security Group testcases https://review.openstack.org/94130 | 12:30 |
| mriedem | sdague: so before i abandon this, https://review.openstack.org/#/c/94221/ - wondering if there is anything to be gained from it, i.e. are the compute build_timeouts in there still accurate? | 12:31 |
| mriedem | devstack has 196 and tempest has 300, and we have a lot of random timeout failures in compute and image tests | 12:32 |
| *** yfried__ is now known as yfried | 12:32 | |
| mriedem | maybe that can be helped if i can use ceilometer with this idea https://review.openstack.org/#/c/94245/ | 12:33 |
| sdague | mriedem: I think you are assuming that given a longer timeout, most of those operations would complete | 12:34 |
| sdague | which I don't think is the case | 12:34 |
| mriedem | i think image snapshot would, yes | 12:34 |
| sdague | mriedem: you see the snapshot complete later? | 12:34 |
| sdague | if you can point me at an instance like that, it would be great | 12:35 |
| mriedem | i'll dig, the test run might have been dead by then | 12:35 |
| sdague | oh, this is in scenarios? | 12:35 |
| mriedem | no, api.compute.images | 12:35 |
| sdague | that should happen way early | 12:36 |
| sdague | there should still be a log entry once it's done, I would think | 12:36 |
| openstackgerrit | Jakub Libosvar proposed a change to openstack-dev/grenade: TESTING ONLY: Get some debug info about mounted FS https://review.openstack.org/94351 | 12:36 |
| mriedem | well unless the server is deleted when the test class is done | 12:37 |
| mriedem | not sure if that's happening, but that's pretty common i think | 12:37 |
| mriedem | test deletes the server once it's done | 12:37 |
| sdague | do we have timing numbers on the snapshots that complete? | 12:40 |
| sdague | it seems like snapshotting a cirros shouldn't be that long | 12:40 |
| mriedem | i'll see if i can get a query | 12:40 |
| sdague | I think an interesting thing that might come of this is to try to account for the time that any of our timeout bound operations take | 12:40 |
| sdague | In personal experience, as timeout is rarely happening on an operation that would actually complete | 12:41 |
| *** tnovacik has quit IRC | 12:41 | |
| sdague | the timeouts were mostly decreased in the gate to decrease runtime, because a timeout was always a critical fail, then we just sit idle for a long time | 12:41 |
| mriedem | yeah, i've had that internally too | 12:42 |
| mriedem | since we set high timeouts since sometimes they'd help and sometimes they wouldn't | 12:42 |
| mriedem | there are the cases where some new test uses a thing that isn't implemented but it doesn't fail right away, so we timeout | 12:42 |
| mriedem | hmm, in this one image snapshot timeout i see the vm is smaller, 2 workers is all | 12:46 |
| mriedem | i thought we were normally running with 8 CPU VMs | 12:47 |
| *** cdent has quit IRC | 12:49 | |
| *** cdent has joined #openstack-qa | 12:49 | |
| *** yfried has quit IRC | 12:53 | |
| *** nati_ueno has joined #openstack-qa | 12:55 | |
| mriedem | you know what we need? tasks in glance. :) i.e. snapshot operation times out, i can query the task for the snapshot operation to get it's current status/progress details to help debug and know if it was hung. | 12:57 |
| *** jgrimm has joined #openstack-qa | 13:00 | |
| *** nosnos has quit IRC | 13:02 | |
| *** luqas has joined #openstack-qa | 13:03 | |
| *** nati_ueno has quit IRC | 13:04 | |
| *** gszasz has joined #openstack-qa | 13:05 | |
| *** Ju has quit IRC | 13:09 | |
| *** Obulpathi has joined #openstack-qa | 13:10 | |
| *** yamahata has joined #openstack-qa | 13:11 | |
| *** mwagner_lap has quit IRC | 13:11 | |
| *** jhenner1 has quit IRC | 13:11 | |
| *** afazekas has quit IRC | 13:12 | |
| *** Obulpathi has quit IRC | 13:13 | |
| *** Obulpathi has joined #openstack-qa | 13:13 | |
| mriedem | this warning seems bad, and it's showing up a lot http://goo.gl/IZi6pO | 13:14 |
| *** Ch00k has joined #openstack-qa | 13:19 | |
| openstackgerrit | Jakub Libosvar proposed a change to openstack-dev/grenade: TESTING ONLY: Get some debug info about mounted FS https://review.openstack.org/94351 | 13:21 |
| mtreinish | boris-42: pong | 13:21 |
| *** nati_ueno has joined #openstack-qa | 13:22 | |
| *** jhenner has joined #openstack-qa | 13:23 | |
| *** afazekas has joined #openstack-qa | 13:25 | |
| *** tosky has joined #openstack-qa | 13:26 | |
| *** dhellmann is now known as dhellmann_ | 13:27 | |
| *** mkollaro has joined #openstack-qa | 13:31 | |
| *** nati_ueno has quit IRC | 13:33 | |
| *** jgrimm has quit IRC | 13:35 | |
| *** mkollaro1 has quit IRC | 13:35 | |
| sdague | mriedem: right, that's a thing we discovered when I put in my subunit trace | 13:36 |
| *** jgrimm has joined #openstack-qa | 13:36 | |
| sdague | testr is just wrong on subunit worker accounting | 13:36 |
| sdague | all the tests are being run | 13:37 |
| sdague | but they are being told they are in the wrong worker | 13:37 |
| sdague | which does inhibit some other issues | 13:37 |
| mriedem | sdague: is there a testr issue reported for that? | 13:38 |
| sdague | mriedem: https://bugs.launchpad.net/testrepository/+bug/1316858 | 13:39 |
| openstackgerrit | Yaroslav Lobankov proposed a change to openstack/tempest: Sahara: add API tests for data sources https://review.openstack.org/93301 | 13:40 |
| mriedem | sdague: thanks | 13:41 |
| sdague | I sifted it manually, so I did find that we're not losing tests. They are just being assigned to the wrong worker at a subunit level. lifeless admitted it was a bug. | 13:42 |
| mriedem | admitting there is a problem is the first step to recovery... | 13:43 |
| mriedem | i think | 13:43 |
| mriedem | something like that :) | 13:43 |
| *** andreaf has quit IRC | 13:45 | |
| *** andreaf has joined #openstack-qa | 13:53 | |
| *** nati_ueno has joined #openstack-qa | 13:56 | |
| *** bill_az has joined #openstack-qa | 14:04 | |
| *** jamielennox|away has quit IRC | 14:11 | |
| *** ianw has quit IRC | 14:12 | |
| boris-42 | mtreinish still around? | 14:13 |
| *** ianw has joined #openstack-qa | 14:13 | |
| *** ianw has quit IRC | 14:14 | |
| *** ianw has joined #openstack-qa | 14:14 | |
| mtreinish | boris-42: yeah | 14:14 |
| boris-42 | mtreinish I have one question | 14:14 |
| *** ianw has quit IRC | 14:14 | |
| *** tnovacik has joined #openstack-qa | 14:14 | |
| boris-42 | mtreinish there was design session about tempest aaS | 14:15 |
| *** ianw has joined #openstack-qa | 14:15 | |
| openstackgerrit | Jakub Libosvar proposed a change to openstack-dev/grenade: TESTING ONLY: Get some debug info about mounted FS https://review.openstack.org/94351 | 14:15 |
| boris-42 | mtreinish but actually we have already the similar stuff in rally.. | 14:15 |
| *** ianw has quit IRC | 14:15 | |
| *** ianw has joined #openstack-qa | 14:15 | |
| mtreinish | boris-42: yeah and jenkins, and a bunch of other tools are similar too, we're probably not going to do it | 14:16 |
| mtreinish | it was more about talking through pain points in the current tempest user experience | 14:16 |
| boris-42 | mtreinish I think the biggest one is actually tempest.conf generation=) | 14:16 |
| boris-42 | mtreinish and organizing storing results + work with multiply clouds | 14:17 |
| boris-42 | mtreinish we are going to add horizon plugin for rally | 14:17 |
| boris-42 | mtreinish so admin users will be able to run tempest, or set periodic tasks (health checks) that will run some amount of tempest tests | 14:18 |
| *** jamielennox|away has joined #openstack-qa | 14:18 | |
| boris-42 | mtreinish as we are storing information about all runs we will be able to analyze it and do some logic on top of it | 14:18 |
| boris-42 | mtreinish e.g. notifications if it is too slow or some errors occurres | 14:18 |
| mtreinish | yeah that is basically what we discussed doing during the session :) | 14:19 |
| boris-42 | mtreinish so we are quite close to this stuff in rally | 14:19 |
| *** tkammer has quit IRC | 14:20 | |
| *** ianw has quit IRC | 14:20 | |
| boris-42 | mtreinish btw one more thing that I heard is that there are some issues with cleanup in tempest | 14:20 |
| mtreinish | but, as I said there is too much overlap with existing tooling, so we're probably not going to do it | 14:21 |
| *** ianw has joined #openstack-qa | 14:21 | |
| boris-42 | mtreinish ok | 14:21 |
| mtreinish | boris-42: yeah it's one of the things we need to work on fixing. There are a few resource leaks in tempest | 14:21 |
| mtreinish | we need to work on a tool to catch them and start plugging the leaks | 14:21 |
| boris-42 | mtreinish what do you think about a bit another approach | 14:22 |
| boris-42 | mtreinish e.g. use specific names templates | 14:22 |
| boris-42 | mtreinish tempest_uuid e.g. | 14:22 |
| boris-42 | mtreinish then we can have script that will deleted everything with such names, and we will be able to run it in every moment? | 14:22 |
| boris-42 | (just a idea) | 14:22 |
| boris-42 | mtreinish cause I heard that not all operators where happy about running tempest against production cloud.. so we should change this.. | 14:23 |
| boris-42 | (this opinion) | 14:23 |
| mtreinish | the issue with that approach is it's just a band-aid. The leaks are real bugs in tempest so we need a way to identify them. I think using common names will help identify the leaks though | 14:24 |
| mtreinish | I'm planning to write up a spec on doing this sometime this week or next | 14:24 |
| boris-42 | mtreinish nice | 14:24 |
| boris-42 | mtreinish and I am going to concentrate on tempest.conf stuff | 14:24 |
| boris-42 | mtreinish that will be huge task=) | 14:25 |
| *** dims has joined #openstack-qa | 14:28 | |
| *** TravT has joined #openstack-qa | 14:32 | |
| *** nati_ueno has quit IRC | 14:32 | |
| dkranz | boris-42: This may be relevant for comment https://review.openstack.org/91725 | 14:33 |
| *** yfried has joined #openstack-qa | 14:35 | |
| mriedem | yikes 59% bug classification rate | 14:40 |
| *** andreaf has quit IRC | 14:40 | |
| *** tkammer has joined #openstack-qa | 14:47 | |
| *** mwagner_lap has joined #openstack-qa | 14:48 | |
| *** andreaf has joined #openstack-qa | 14:49 | |
| *** dkorn has joined #openstack-qa | 14:51 | |
| *** nati_ueno has joined #openstack-qa | 14:51 | |
| *** TravT has quit IRC | 14:51 | |
| *** tosky has quit IRC | 14:56 | |
| *** torandu has quit IRC | 14:58 | |
| *** mrodden has joined #openstack-qa | 14:58 | |
| *** kgriffs|afk is now known as kgriffs | 14:59 | |
| *** evgenyf has quit IRC | 14:59 | |
| openstackgerrit | Longgeek proposed a change to openstack-dev/devstack: ceilometer.conf configuration option missing os_auth_url https://review.openstack.org/94327 | 15:02 |
| *** malini_afk is now known as malini | 15:03 | |
| afazekas | dkranz: https://review.openstack.org/#/c/94203/ | 15:07 |
| *** torandu has joined #openstack-qa | 15:07 | |
| afazekas | akamyshnikova: thx | 15:08 |
| afazekas | andreaf: pong | 15:09 |
| *** marun has joined #openstack-qa | 15:11 | |
| *** zul has quit IRC | 15:11 | |
| *** nati_ueno has quit IRC | 15:11 | |
| *** mlavalle has joined #openstack-qa | 15:13 | |
| *** atiwari has joined #openstack-qa | 15:16 | |
| NithyaG | afazekas: Hi, I wanted to talk with you about the ssh auth strategy blueprint. Is it near completion? if not, I wanted to check if you need a hand? I could pick a portion and do it under your guidance | 15:21 |
| NithyaG | https://blueprints.launchpad.net/tempest/+spec/ssh-auth-strategy | 15:21 |
| afazekas | NithyaG: I would appreciate all kind of help, basically I would like to do the same thing what is in the first big patch just little bit nicer | 15:25 |
| afazekas | The new cirros image change is merged , so probbaly the host name query can work now | 15:26 |
| *** mestery has quit IRC | 15:26 | |
| *** mestery has joined #openstack-qa | 15:26 | |
| NithyaG | Do you mean this patch? https://review.openstack.org/80635 | 15:26 |
| *** andreaf has quit IRC | 15:27 | |
| *** atiwari has quit IRC | 15:28 | |
| afazekas | https://review.openstack.org/#/c/81486/ | 15:28 |
| *** andreaf has joined #openstack-qa | 15:30 | |
| openstackgerrit | Peter Stachowski proposed a change to openstack/tempest: Enhanced Trove (database) flavor API tests https://review.openstack.org/89396 | 15:30 |
| andreaf | afazekas, NithyaG: the ssh-auth-strategy blueprints needs a qa-specs - do you want me to do it or can either of you care for that? | 15:32 |
| openstackgerrit | A change was merged to openstack/tempest: Fix test_create_show_delete_security_group_rule https://review.openstack.org/93509 | 15:33 |
| *** atiwari has joined #openstack-qa | 15:33 | |
| mriedem | jogo: i'm not sure about this one either https://review.openstack.org/#/c/94308/ | 15:33 |
| mriedem | comments inline | 15:33 |
| afazekas | andreaf: Offer accepted :) | 15:34 |
| *** wramthun has quit IRC | 15:34 | |
| *** wramthun has joined #openstack-qa | 15:34 | |
| andreaf | afazekas: ok will do | 15:34 |
| openstackrecheck | Console logs not available after 14:07s for check-grenade-dsvm-neutron 77210,11,1ce8a39 | 15:34 |
| afazekas | andreaf: one think I would like to add something to the original concept. the ssh code needs to able to use the debug stuff everywhere on ssh connection failure, and make the debug stuff ``intelligent``. Intelligent --> not just prints out big bench of logs, it tries to analyze the situation | 15:37 |
| *** gszasz has quit IRC | 15:37 | |
| andreaf | afazekas: that sounds like a separate blueprint | 15:38 |
| afazekas | andreaf: may be | 15:39 |
| afazekas | Sorry, I had to leave now | 15:39 |
| NithyaG | afazekas: Could you let me know what kind of cleanup you are intending for https://review.openstack.org/#/c/81486/? | 15:39 |
| mtreinish | afazekas: are you talking about the neutron debug log explosion | 15:39 |
| mtreinish | ? | 15:39 |
| *** kashyap has left #openstack-qa | 15:39 | |
| afazekas | We can discuss this tomorrow | 15:39 |
| NithyaG | afazekas: sure | 15:40 |
| afazekas | sorry ... | 15:40 |
| *** afazekas has quit IRC | 15:40 | |
| andreaf | afazekas, mtreinish, NithyaG: I will prepare the basic spec based on the original bp, so you can comment on it | 15:40 |
| mtreinish | andreaf: ok cool, thanks | 15:41 |
| *** mrodden has quit IRC | 15:43 | |
| *** mkollaro has quit IRC | 15:44 | |
| *** sthaha has quit IRC | 15:48 | |
| *** atiwari has quit IRC | 15:48 | |
| *** atiwari has joined #openstack-qa | 15:54 | |
| openstackgerrit | Terry Wilson proposed a change to openstack-dev/devstack: Fix notify_nova options https://review.openstack.org/94411 | 15:57 |
| openstackgerrit | Steven Hardy proposed a change to openstack/tempest: orchestration scenario manager add _wait_for_stack_status https://review.openstack.org/92565 | 15:57 |
| openstackgerrit | Steven Hardy proposed a change to openstack/tempest: orchestration add volume backup/restore scenario test https://review.openstack.org/90143 | 15:57 |
| openstackgerrit | Steven Hardy proposed a change to openstack/tempest: Make test_server_cfn_init a scenario test https://review.openstack.org/88137 | 15:57 |
| *** nati_ueno has joined #openstack-qa | 15:58 | |
| *** aimon has quit IRC | 15:58 | |
| *** yjiang5 has quit IRC | 15:58 | |
| openstackgerrit | A change was merged to openstack/tempest: Add hacking import exception for service clients https://review.openstack.org/94034 | 15:59 |
| *** danfinch has joined #openstack-qa | 16:01 | |
| *** cdent_ has joined #openstack-qa | 16:01 | |
| *** cdent has quit IRC | 16:03 | |
| *** cdent_ is now known as cdent | 16:03 | |
| openstackgerrit | A change was merged to openstack/tempest: Enable H302 rule everywhere https://review.openstack.org/94125 | 16:04 |
| *** tosky has joined #openstack-qa | 16:04 | |
| Albert_13 | Hi, is it possible to test that a VM gets the assigned ip through tempest if that VM is in a network without external connectivity? | 16:06 |
| *** thomasbiege has joined #openstack-qa | 16:08 | |
| openstackgerrit | Steven Hardy proposed a change to openstack/tempest: orchestration scenario manager add _wait_for_stack_status https://review.openstack.org/92565 | 16:09 |
| *** nati_ueno has quit IRC | 16:09 | |
| openstackrecheck | Console logs not available after 13:30s for check-tempest-dsvm-postgres-full 92769,1,7c5e25b | 16:10 |
| *** Albert_13 has quit IRC | 16:13 | |
| openstackgerrit | Yaroslav Lobankov proposed a change to openstack/tempest: Sahara: preparations for job binary tests https://review.openstack.org/94191 | 16:13 |
| *** jgrimm has quit IRC | 16:14 | |
| openstackgerrit | Yaroslav Lobankov proposed a change to openstack/tempest: Sahara: preparations for internal job binary tests https://review.openstack.org/94192 | 16:15 |
| openstackgerrit | Yaroslav Lobankov proposed a change to openstack/tempest: Sahara: add API tests for job binaries https://review.openstack.org/94344 | 16:15 |
| *** yamahata has quit IRC | 16:18 | |
| *** Ch00k has quit IRC | 16:20 | |
| *** tnovacik has quit IRC | 16:24 | |
| openstackgerrit | Matthew Treinish proposed a change to openstack/tempest: Start using oslotest for tempest unit tests https://review.openstack.org/77747 | 16:24 |
| *** rwsu has joined #openstack-qa | 16:30 | |
| *** morganfainberg_Z is now known as morganfainberg | 16:30 | |
| *** TravT has joined #openstack-qa | 16:30 | |
| *** Obulpathi has quit IRC | 16:31 | |
| openstackgerrit | A change was merged to openstack/tempest: Fix alt tenant id's issue in BaseV2MemberImageTest https://review.openstack.org/93857 | 16:31 |
| *** openstackgerrit has quit IRC | 16:35 | |
| *** mdenny has joined #openstack-qa | 16:35 | |
| *** Obulpathi has joined #openstack-qa | 16:36 | |
| *** openstackgerrit has joined #openstack-qa | 16:36 | |
| *** jpich has quit IRC | 16:37 | |
| *** jpich has joined #openstack-qa | 16:37 | |
| *** tkammer has quit IRC | 16:42 | |
| *** mmaglana has joined #openstack-qa | 16:46 | |
| openstackrecheck | Console logs not available after 13:28s for check-tempest-dsvm-full 94340,1,6c89422 | 16:47 |
| openstackgerrit | Yaroslav Lobankov proposed a change to openstack/tempest: Sahara: add API tests for job binaries https://review.openstack.org/94344 | 16:48 |
| *** safchain has quit IRC | 16:52 | |
| *** Ch00k has joined #openstack-qa | 16:54 | |
| *** Ch00k has quit IRC | 16:54 | |
| *** markmcclain has joined #openstack-qa | 16:59 | |
| openstackrecheck | Console logs not available after 13:46s for check-tempest-dsvm-postgres-full 94296,3,583e265 | 17:02 |
| *** cdent has quit IRC | 17:04 | |
| openstackgerrit | nayna-patel proposed a change to openstack/tempest: Add quota delete test to cinder https://review.openstack.org/90097 | 17:06 |
| *** mmaglana has quit IRC | 17:06 | |
| *** atiwari has quit IRC | 17:07 | |
| *** mmaglana has joined #openstack-qa | 17:07 | |
| openstackgerrit | Yaroslav Lobankov proposed a change to openstack/tempest: Sahara: add API tests for internal job binaries https://review.openstack.org/94427 | 17:08 |
| *** luqas has quit IRC | 17:15 | |
| *** harlowja_away is now known as harlowja | 17:16 | |
| openstackgerrit | Yaroslav Lobankov proposed a change to openstack/tempest: Sahara: minor changes for API tests https://review.openstack.org/90120 | 17:19 |
| *** atiwari has joined #openstack-qa | 17:21 | |
| *** jgrimm has joined #openstack-qa | 17:23 | |
| *** nati_ueno has joined #openstack-qa | 17:24 | |
| *** jpich has quit IRC | 17:27 | |
| *** mriedem has quit IRC | 17:27 | |
| *** nati_ueno has quit IRC | 17:31 | |
| *** mmaglana has quit IRC | 17:32 | |
| openstackrecheck | Console logs not available after 14:17s for gate-tempest-pep8 71251,21,b65c824 | 17:36 |
| *** mriedem has joined #openstack-qa | 17:38 | |
| openstackgerrit | Aaron Rosen proposed a change to openstack/tempest: Glance now requires admin role to upload image by default https://review.openstack.org/94435 | 17:42 |
| *** krtaylor has quit IRC | 17:42 | |
| ylobankov | Hello dkranz, mtreinish, sdague. Could you please take a look at https://review.openstack.org/#/c/90101/ and https://review.openstack.org/#/c/93301/ when you have free time. Thanks. | 17:50 |
| *** andreaf has quit IRC | 17:51 | |
| *** markmcclain has quit IRC | 17:51 | |
| *** markmcclain has joined #openstack-qa | 17:52 | |
| mtreinish | ylobankov: are there any api docs for sahara yet? | 17:54 |
| openstackgerrit | A change was merged to openstack/tempest: orchestration: Add test for resource_registry environment https://review.openstack.org/92609 | 17:54 |
| tosky | mtreinish: http://docs.openstack.org/developer/sahara/restapi/index.html | 17:56 |
| ylobankov | tosky: Thanks :) | 17:56 |
| tosky | :) | 17:57 |
| *** tosky has quit IRC | 17:57 | |
| openstackrecheck | Console logs not available after 13:31s for check-tempest-dsvm-postgres-full 82201,3,8e08897 | 17:58 |
| *** jamielennox|away is now known as jamielennox | 18:03 | |
| openstackgerrit | David Shrewsbury proposed a change to openstack/tempest: Place baremetal common methods in base class https://review.openstack.org/94436 | 18:04 |
| *** jlibosva has quit IRC | 18:05 | |
| *** ajayaa has joined #openstack-qa | 18:09 | |
| *** thomasbiege has quit IRC | 18:09 | |
| ajayaa | Hi. I am using devstack to test ec2 api compatibility with tempest. I see that ami image is not created by the command "euca-bundle-image" with error "arch should be of type string". any idea? | 18:09 |
| *** thomasbiege has joined #openstack-qa | 18:09 | |
| openstackgerrit | David Shrewsbury proposed a change to openstack/tempest: Add ironic instance rebuild advanced test https://review.openstack.org/94439 | 18:11 |
| openstackrecheck | Console logs not available after 13:27s for check-grenade-dsvm 94347,3,b42008b | 18:15 |
| *** coolsvap|afk has quit IRC | 18:16 | |
| *** dims has quit IRC | 18:17 | |
| *** coolsvap|afk has joined #openstack-qa | 18:19 | |
| openstackgerrit | A change was merged to openstack/tempest: orchestration: add test for untyped provider resources https://review.openstack.org/92612 | 18:22 |
| ylobankov | mtreinish: thanks for review! | 18:24 |
| *** mrodden has joined #openstack-qa | 18:25 | |
| ylobankov | mtreinish: I will resolve all comments tomorrow. | 18:25 |
| *** mmaglana has joined #openstack-qa | 18:25 | |
| *** jchai has joined #openstack-qa | 18:29 | |
| openstackrecheck | Console logs not available after 14:25s for check-grenade-dsvm-neutron 84945,11,55a9c54 | 18:32 |
| *** nati_ueno has joined #openstack-qa | 18:32 | |
| *** mmaglana has quit IRC | 18:33 | |
| openstackgerrit | Sam Hague proposed a change to openstack-dev/devstack: Add options to configure provider network mappings for OpenDaylight https://review.openstack.org/92123 | 18:35 |
| jchai | Hello, anyone around? | 18:37 |
| jchai | I am running into a problem with https://review.openstack.org/#/c/87762/ and was wondering if anyone could help me | 18:37 |
| *** krtaylor has joined #openstack-qa | 18:40 | |
| *** dims has joined #openstack-qa | 18:43 | |
| *** mlavalle has quit IRC | 18:43 | |
| mtreinish | jchai: I'd try giving it a rebase to start we just merged the change enabling H302 in tempest | 18:44 |
| openstackrecheck | Console logs not available after 13:24s for check-tempest-dsvm-postgres-full 93975,3,12afea2 | 18:45 |
| jchai | mtreinish: Thanks, I'll give that a try. What is H302? | 18:45 |
| mtreinish | it's a hacking rule from http://git.openstack.org/cgit/openstack-dev/hacking/ which enforces only importing modules | 18:46 |
| *** dkranz has quit IRC | 18:46 | |
| *** giulivo has quit IRC | 18:55 | |
| *** dkranz has joined #openstack-qa | 18:59 | |
| *** ianw has quit IRC | 19:00 | |
| openstackrecheck | Console logs not available after 14:32s for check-tempest-dsvm-full 93211,1,cd5aa05 | 19:00 |
| *** ianw has joined #openstack-qa | 19:00 | |
| *** giulivo has joined #openstack-qa | 19:00 | |
| openstackgerrit | Jorge Chai proposed a change to openstack/tempest: Add Marconi Smoke Tests https://review.openstack.org/87762 | 19:02 |
| *** dims has quit IRC | 19:03 | |
| *** kgriffs is now known as kgriffs|afk | 19:04 | |
| *** rockyg has joined #openstack-qa | 19:07 | |
| *** Sukhdev has joined #openstack-qa | 19:08 | |
| openstackgerrit | Yair Fried proposed a change to openstack/tempest: Network debug for all nodes via ssh https://review.openstack.org/94449 | 19:13 |
| yfried | sdague: could you please take look? ^ I'd like to get your opinion on this (WIP) | 19:18 |
| openstackrecheck | Console logs not available after 13:23s for gate-grenade-dsvm 92663,1,b0b5c8e | 19:23 |
| *** andreaf has joined #openstack-qa | 19:25 | |
| mtreinish | yfried: you really need a spec/bp for something like that first. Also I don't think that's the right approach, using a list of compute hosts to run debug commands through ssh is really weird and not something I feel we should be doing in tempest. | 19:26 |
| mtreinish | tempest should not require access to the hosts to do anything, which is part of my issue with the current neutron debug code (in addition to the hard coded single host assumption) | 19:27 |
| mtreinish | yfried: also something else to consider is that as an end user using neutron how are you supposed to debug anything if it requires access to the host... | 19:28 |
| tristanC | Hello folks, I'm affraid keystone have trouble to pass grenade for stable/icehouse (CertificatesV3TestJSON fail), e.g., http://logs.openstack.org/97/94397/1/check/check-grenade-dsvm/28b47b5/console.html#_2014-05-20_16_11_02_837 | 19:31 |
| openstackgerrit | David Shrewsbury proposed a change to openstack-infra/devstack-gate: Change Ironic bm flavor to use ephemeral partition https://review.openstack.org/94456 | 19:31 |
| *** andreaf has quit IRC | 19:33 | |
| *** andreaf has joined #openstack-qa | 19:33 | |
| *** kgriffs|afk is now known as kgriffs | 19:35 | |
| *** annegent^ has quit IRC | 19:37 | |
| *** andreaf_ has joined #openstack-qa | 19:38 | |
| openstackgerrit | A change was merged to openstack-dev/devstack: Use daemon flag only when USE_SCREEN=False https://review.openstack.org/93814 | 19:38 |
| *** andreaf has quit IRC | 19:39 | |
| *** annegentle_ has joined #openstack-qa | 19:40 | |
| *** ajayaa has quit IRC | 19:53 | |
| *** stevebaker has quit IRC | 19:54 | |
| *** stevebaker has joined #openstack-qa | 19:54 | |
| *** jeblair has quit IRC | 19:55 | |
| *** jeblair has joined #openstack-qa | 19:55 | |
| *** jeblair has quit IRC | 19:55 | |
| openstackgerrit | Aaron Rosen proposed a change to openstack-dev/devstack: DO NO MERGE (testing glance/tempest patch together) https://review.openstack.org/94462 | 19:56 |
| EmilienM | dtroyer: sdague: Hey, I wanted to know if a patch in grenade to support ceilometer would be welcome | 19:58 |
| EmilienM | (same question for heat) | 19:58 |
| *** catohornet has quit IRC | 19:59 | |
| dtroyer | EmilienM: of course! that sounds ambitious to me (not knowing much about ceilometer) so if we can break things down it might be easier. | 19:59 |
| EmilienM | dtroyer: cool, just want to be sure before working on it | 20:00 |
| dtroyer | like getting the service itself running and upgraded, then start plugging it in to other things.? | 20:00 |
| sdague | EmilienM: yes, definitely welcome | 20:00 |
| EmilienM | ok cool | 20:00 |
| EmilienM | dtroyer: currently working on upgrade, ceilometer is so far the easiest one project. | 20:01 |
| openstackrecheck | Console logs not available after 13:26s for check-tempest-dsvm-neutron-full 89357,8,3ba9a14 | 20:02 |
| *** giulivo has quit IRC | 20:06 | |
| *** kgriffs is now known as kgriffs|afk | 20:06 | |
| *** catohornet has joined #openstack-qa | 20:07 | |
| *** mmaglana has joined #openstack-qa | 20:07 | |
| *** dims has joined #openstack-qa | 20:07 | |
| openstackrecheck | openstack/cinder change: https://review.openstack.org/89482 failed because of: gate-grenade-dsvm: https://bugs.launchpad.net/bugs/1262566 | 20:08 |
| *** ThiagoCMC has joined #openstack-qa | 20:11 | |
| yfried | mtreinish: I'll post something tomorrow. I don't understand - the point this is to get the network changes created by neutron in order to debug failures. | 20:12 |
| yfried | this is for debug only and to collect data that is outside of the tempest "reach", but is relevant to testers. | 20:14 |
| yfried | this is all done assuming you have the knowledge and access to the various nodes. if you don't, then you simply won't get this data (same as if the user running tempest doesn't have sudo permissions) | 20:15 |
| yfried | mtreinish: so why the strong objection? | 20:15 |
| *** catohornet1 has joined #openstack-qa | 20:18 | |
| *** catohornet has quit IRC | 20:18 | |
| *** mmaglana has quit IRC | 20:18 | |
| *** jaypipes has quit IRC | 20:19 | |
| *** jaypipes has joined #openstack-qa | 20:20 | |
| *** ChanServ sets mode: +o jaypipes | 20:20 | |
| mtreinish | yfried: my point is that we shouldn't have to be logging into the nodes to be able to debug things. I get that it's optional but I don't think it's the right direction, instead it should be viewed as a neutron bug that you can't get the necessary information from the logs or api. | 20:20 |
| openstackrecheck | Console logs not available after 13:26s for check-tempest-dsvm-neutron 94436,1,c2848fa | 20:21 |
| mtreinish | part of the value of having tempest only deal with the public apis is that it is essentially the same as a user. Which means any pain points we have using tempest with a failure is the same as any user | 20:22 |
| mtreinish | also I don't believe the commands stuff is something we should have in the tree, but we needed it to debug the gate when we first started ramping up tempest testing with neutron | 20:23 |
| yfried | mtreinish: but if cloud admin sees these failures, he would log to the various nodes and try and get iptables/ovs details | 20:23 |
| yfried | mtreinish: I feel like you are saying - we should keep ourselves blind because a normal user might not be able to get this data | 20:24 |
| mtreinish | no, I'm saying it's a bug in neutron, you should be able to debug a failure from the service logs (or other logs). A cloud admin shouldn't have to run iptables or ovs commands to figure out what messed up. Also you can have it is an out of band tool, I just don't think it should be part of our normal failure processign | 20:28 |
| yfried | mtreinish: I understand that it's a REALLY ugly way, but until (if) neutron will provide some form of active debugging (which might be duplicating iptables/ovs api) we need this thing. it's helpful in case of network failures and the fact that the gate is more or less stable today, doesn't mean we won't need it tomorrow. also - this is a step towards multi node testing that could help other groups embrace tempest. | 20:28 |
| yfried | mtreinish: what's "out band tool"? | 20:29 |
| *** catohornet1 has quit IRC | 20:29 | |
| *** krtaylor has quit IRC | 20:29 | |
| mtreinish | yfried: something like a utility script to collect the information | 20:31 |
| *** stevebaker has quit IRC | 20:32 | |
| yfried | mtreinish: this needs to be called during runtime as part the the exception handling | 20:32 |
| yfried | as the data is changed immediately afterwards. | 20:32 |
| openstackgerrit | Emilien Macchi proposed a change to openstack-dev/grenade: Support Ceilometer services https://review.openstack.org/94468 | 20:34 |
| mtreinish | yfried: then that's exactly my point that neutron is un-debuggable and we should stop adding hacks to work around it. This debug stuff was only supposed to be a stop gap to make the gate work, I don't think we should expand it | 20:36 |
| yfried | mtreinish: I don't disagree, but until such ability is added to neutron, we can't ignore this | 20:37 |
| *** catohornet has joined #openstack-qa | 20:39 | |
| *** mkollaro has joined #openstack-qa | 20:40 | |
| mtreinish | why not? I don't see any value in expanding this, especially for non-gating purposes. Having everyone go through the pain of not being able to debug a race in the gate is a *big* motivator for improving the debug story with neutron. | 20:41 |
| *** ThiagoCMC has quit IRC | 20:41 | |
| mtreinish | I'd rather see steps on making things debuggable rather than expanding the debug stuff in tempest | 20:41 |
| *** tmcpeak has joined #openstack-qa | 20:43 | |
| tmcpeak | Hey all, had a few questions about Tempest. Is this a good place to find info? | 20:43 |
| mtreinish | yfried: even if that is just a debug api for neutron that just parrots the output of commands over a rest interface that would probably be enough to start | 20:44 |
| mtreinish | tmcpeak: probably :) | 20:44 |
| tmcpeak | Cool! I'm curious about various test runner options. What runs best, and what are pros and cons? | 20:45 |
| tmcpeak | I guess I'm mostly confused about how everything fits together. Have gone through all the documentation I could find and I'm still pretty lost | 20:45 |
| mtreinish | tmcpeak: testr: https://pypi.python.org/pypi/testrepository, it's what we use for gating tests and is what we write the tests using. The downside is that there are some ui warts with it, that need improvement | 20:46 |
| mtreinish | if you look at the tox.ini or run_tempest.sh you'll see that testr is being called for both of them | 20:46 |
| tmcpeak | ok cool, so testrunner is the defacto standard, but my understanding is that testrunner is more of a results tracking tool | 20:47 |
| tmcpeak | which kind of relies on other runners | 20:47 |
| tmcpeak | I've seen subunit, noserunner, and tox thrown around. I'm not sure how those fit in | 20:48 |
| mtreinish | tmcpeak: yeah testr calls subunit.run to do actually run the tests | 20:48 |
| mtreinish | the stack is pretty deep when it comes to the tools | 20:48 |
| mtreinish | for example it's normally tox -> testr -> subunit -> ... | 20:49 |
| tmcpeak | oh ok, then how would nose fit in? | 20:49 |
| mtreinish | nose is probably the only test runner that does't work with tempest | 20:50 |
| tmcpeak | ahh ok, I saw some example video on YouTube where the guy was running nose | 20:50 |
| mtreinish | because we use the testscenarios library in a few places (a growing number) | 20:50 |
| mtreinish | tmcpeak: nose was the de facto test runner until about a year ago, but it had some major issues | 20:50 |
| tmcpeak | ok, testscenarios is incompatible with nose? | 20:50 |
| mtreinish | which is why we moved away from it | 20:51 |
| tmcpeak | ahh ok! | 20:51 |
| tmcpeak | are there docs on this that I'm missing? I hate to bug you guys when I could find the answer myself :) | 20:51 |
| tmcpeak | I read through all the tempest docs I could find | 20:51 |
| mtreinish | tmcpeak: the only docs we have on tempest are here: http://docs.openstack.org/developer/tempest/ | 20:52 |
| mtreinish | it's definitely a todo to improve that this cycle | 20:52 |
| tmcpeak | ok cool, I've definitely read through that | 20:52 |
| tmcpeak | when I ran the run_tempest.sh command I get a broken pipe because it can't find the module subunit | 20:53 |
| *** ThiagoCMC has joined #openstack-qa | 20:53 | |
| tmcpeak | which lead me to look around and found the YouTube video where the guy was running with nose | 20:54 |
| tmcpeak | the automatic venv creation thing is really cool, but I guess my subunit didn't get set up/installed correctly | 20:55 |
| *** mmaglana has joined #openstack-qa | 20:55 | |
| mtreinish | hmm all the necessary modules should be installed by run_tempest when it setups the venv | 20:55 |
| mtreinish | tmcpeak: tox does the same thing too if you run tox -efull | 20:55 |
| mtreinish | that mirrors the tests that are run for gating | 20:56 |
| mtreinish | tmcpeak: do you have a pastebin of the failure? was it subunit-2to1 or the colorizer? | 20:57 |
| tmcpeak | so what are the differences between running with tox and running with testr? My understanding is that testr basically provides results tracking for the tests run by tox. Is that right? | 20:57 |
| tmcpeak | colorizer | 20:57 |
| tmcpeak | I'll put up pastebin | 20:57 |
| mtreinish | then that's really weird because if you have subunit-2to1 you should have subunit :) | 20:58 |
| openstackgerrit | Boris Pavlovic proposed a change to openstack/qa-specs: Automate tempest config generation https://review.openstack.org/94473 | 20:58 |
| boris-42 | mtreinish ^ I started work on this | 20:59 |
| mtreinish | tmcpeak: tox setups the env and runs testr, see: http://git.openstack.org/cgit/openstack/tempest/tree/tox.ini#n34 | 20:59 |
| tmcpeak | pastebin.com/NjUfZvr0 | 20:59 |
| boris-42 | mtreinish going to make some generator of tables from input format to start working on table with conf options | 20:59 |
| boris-42 | mtreinish I think it's good to have in spec table with all conf options? | 20:59 |
| mtreinish | boris-42: awesome thanks I'll take a look at it tomorrow probably | 20:59 |
| boris-42 | mtreinish ok | 21:00 |
| tmcpeak | oh ok cool, I looked through the tox.ini file and my understanding was that it was the way you choose which directories of tests to run | 21:00 |
| openstackrecheck | Console logs not available after 14:20s for check-tempest-dsvm-neutron 94462,1,c1c3f31 | 21:06 |
| mtreinish | boris-42: you mean an inline table outlining the options to auto configure? Wouldn't that be quite large :) | 21:06 |
| *** markmcclain has quit IRC | 21:07 | |
| tmcpeak | did you see the pastebin? | 21:08 |
| tmcpeak | maybe I'm doing something dumb | 21:08 |
| mtreinish | tmcpeak: yeah I guess it's a bit confusing we use the the path of the tests to filter with a regex. The test ids contain the path so it works well for that. | 21:08 |
| mtreinish | tmcpeak: sorry not yet let me take a look at it now | 21:08 |
| tmcpeak | ok cool, thank you! | 21:08 |
| *** Sukhdev has quit IRC | 21:08 | |
| *** stevebaker has joined #openstack-qa | 21:11 | |
| mtreinish | tmcpeak: it looks like subunit isn't installed in the venv, I'd try recreating it with tools/install_venv.py(that's what run_tempest.sh calls) and make sure there aren't any errors when it installs the deps from test-requirements.txt | 21:11 |
| tmcpeak | ok cool, let me give that a shot, thank you! | 21:12 |
| *** dkorn has quit IRC | 21:12 | |
| mtreinish | oh I guess you could use 'run_tempest.sh -u' too which does basically the same thing | 21:13 |
| tmcpeak | ok cool, running the install_venv script now | 21:13 |
| *** aysyd has quit IRC | 21:13 | |
| boris-42 | mtreinish yep it will be | 21:13 |
| tmcpeak | btw what is the best way to select certain tempest tests to run? | 21:13 |
| tmcpeak | I was looking at modifying the test_discover.py | 21:13 |
| tmcpeak | but that seems a little janky | 21:13 |
| mtreinish | tmcpeak: testr takes a regex filter and will only run the tests that match it | 21:14 |
| boris-42 | mtreinish 200 lines but it will allow to structure work | 21:14 |
| boris-42 | mtreinish or I can link it somehow from spec? | 21:15 |
| tmcpeak | ok, ERROR: /bin/sh: 1: xslt-config not found | 21:15 |
| mtreinish | boris-42: you stole my words, I was going to suggest using something outside like a google doc spreadsheet so we can change it without a commit | 21:15 |
| boris-42 | mtreinish ok I will make google spreadsheet | 21:15 |
| tmcpeak | and error: command 'gcc' failed with exit status 1 | 21:15 |
| tmcpeak | so guess I'm missing a dependency that it can't automatically resolve? | 21:16 |
| mtreinish | tmcpeak: yeah it's failing to build python-lxml, which I think requires libxml dev and libxslt dev too | 21:16 |
| tmcpeak | hmm, ok, let me grab those and try again :) thank you | 21:17 |
| mrodden | holy patches batman, i have bash8 things to review! | 21:17 |
| mtreinish | boris-42: yeah that'll work better I think, because the config list isn't really constant, although I think we'll have to start working on locking it down with branchless tempest | 21:17 |
| mtreinish | mrodden: awesome | 21:17 |
| mrodden | yeah looked at my watched queue today and there are like 9 patches from not me | 21:18 |
| mrodden | which was surprising | 21:18 |
| *** mwagner_lap has quit IRC | 21:19 | |
| mtreinish | mrodden: you're the ptl of the hottest new project on the block :) | 21:19 |
| mrodden | lucky me :) | 21:20 |
| mrodden | usually i'm the one contributing to other people's projects | 21:21 |
| tmcpeak | ahh nice! this is much better :) | 21:22 |
| tmcpeak | works like a charm now, thank you :) | 21:22 |
| tmcpeak | was missing libxslt-dev | 21:22 |
| *** marun has quit IRC | 21:23 | |
| boris-42 | mtreinish yep or at least we should align adding new tempest config arguments with tool that generates it | 21:24 |
| boris-42 | mtreinish I mean if somebody would like to add new tempest conf option he should make as well change in generating tool | 21:25 |
| boris-42 | mtreinish I'll try to add ASAP base | 21:25 |
| boris-42 | mtreinish so nobody will be blocked | 21:25 |
| *** Obulpathi has quit IRC | 21:27 | |
| *** krtaylor has joined #openstack-qa | 21:31 | |
| *** marun has joined #openstack-qa | 21:33 | |
| *** andreaf_ has quit IRC | 21:36 | |
| *** TravT has quit IRC | 21:37 | |
| *** Sukhdev has joined #openstack-qa | 21:38 | |
| *** mmaglana has quit IRC | 21:42 | |
| *** nati_ueno has quit IRC | 21:46 | |
| *** mmaglana has joined #openstack-qa | 21:49 | |
| *** tmcpeak has quit IRC | 21:50 | |
| *** catohornet has left #openstack-qa | 21:52 | |
| *** mmaglana has quit IRC | 21:53 | |
| openstackrecheck | Console logs not available after 13:30s for check-tempest-dsvm-full 94452,2,aa01d54 | 21:54 |
| *** ThiagoCMC has quit IRC | 21:54 | |
| *** nati_ueno has joined #openstack-qa | 21:56 | |
| mrodden | mtreinish: do you want bugs for the cookiecutter template or just patch updates? | 21:57 |
| mtreinish | mrodden: either or, although does it have a lp? | 21:58 |
| mrodden | oh | 21:58 |
| mrodden | yeah it probably doesn't have a lp | 21:58 |
| mrodden | its a few small updates to the doc portions | 21:59 |
| mrodden | oslo.sphinx -> oslosphinx | 21:59 |
| mrodden | and the paths to readme.rst and stuff were off | 21:59 |
| mtreinish | is this after the patch I pushed through this morning? | 21:59 |
| *** harlowja is now known as harlowja_away | 21:59 | |
| openstackgerrit | Gaudenz Steinlin proposed a change to openstack-infra/elastic-recheck: Add e-r query for bug 1320670 https://review.openstack.org/94486 | 21:59 |
| mrodden | uh i haven't seen it | 22:00 |
| mrodden | looking | 22:00 |
| mtreinish | but, if it's that simple just push patch (assuming I didn't already fix it :) ) | 22:01 |
| mrodden | i dont see a patch from you in the list | 22:01 |
| mrodden | https://review.openstack.org/#/q/project:openstack-dev/cookiecutter,n,z ? | 22:01 |
| mtreinish | I merged it this morning | 22:02 |
| mtreinish | oh the full project cookiecutter | 22:02 |
| mrodden | oh ok | 22:02 |
| mtreinish | I just pushed the specs-cookiecutter | 22:02 |
| mrodden | ok no | 22:03 |
| mrodden | this is diff i think | 22:03 |
| mtreinish | yeah there is the project cookiecutter | 22:03 |
| mtreinish | the oslo lib cookiecutter | 22:03 |
| mrodden | yep | 22:03 |
| mtreinish | and the specs cookiecutter | 22:03 |
| mrodden | project cookiecutter was what i was thnking of | 22:03 |
| mtreinish | mostly because cookiecutter doesn't support branching | 22:03 |
| mrodden | basically | 22:04 |
| mrodden | https://review.openstack.org/#/c/93994/ | 22:04 |
| mrodden | and https://review.openstack.org/#/c/93988/ | 22:04 |
| mrodden | i will put those on my todo to make sure they get there | 22:04 |
| mtreinish | mrodden: sure, just push them out I'll give it a +2 | 22:06 |
| mrodden | k | 22:06 |
| *** ThiagoCMC has joined #openstack-qa | 22:06 | |
| mrodden | need to grab more coffee first :) | 22:06 |
| anteaya | dtroyer: heads up, I added our devstack chat to next week's infra meeting: https://wiki.openstack.org/wiki/Meetings/InfraTeamMeeting#Agenda_for_next_meeting | 22:08 |
| *** harlowja_away is now known as harlowja | 22:08 | |
| *** rockyg has quit IRC | 22:10 | |
| *** Obulpathi has joined #openstack-qa | 22:13 | |
| *** weshay has quit IRC | 22:15 | |
| openstackrecheck | Console logs not available after 13:24s for check-tempest-dsvm-postgres-full 94483,1,6fbf51d | 22:20 |
| *** mkollaro has quit IRC | 22:24 | |
| *** mwagner_lap has joined #openstack-qa | 22:26 | |
| openstackgerrit | Boris Pavlovic proposed a change to openstack/qa-specs: Automate tempest config generation https://review.openstack.org/94473 | 22:26 |
| boris-42 | mtreinish ^ I put in doc all config options with scope and default values | 22:27 |
| boris-42 | mtreinish so next step is to chose the type of value (discoverable/specify-only/createable/..) | 22:28 |
| *** Obulpathi has quit IRC | 22:30 | |
| *** dims has quit IRC | 22:35 | |
| *** ThiagoCMC has quit IRC | 22:36 | |
| *** catohornet has joined #openstack-qa | 22:38 | |
| *** yamahata has joined #openstack-qa | 22:40 | |
| *** catohornet has quit IRC | 22:41 | |
| *** catohornet1 has joined #openstack-qa | 22:41 | |
| *** mriedem has quit IRC | 22:49 | |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/devstack-gate: localize variables https://review.openstack.org/85309 | 22:50 |
| *** atiwari has quit IRC | 22:51 | |
| *** jchai has quit IRC | 22:51 | |
| *** jaypipes has quit IRC | 22:54 | |
| *** nati_ueno has quit IRC | 22:54 | |
| openstackrecheck | openstack/python-novaclient change: https://review.openstack.org/77963 failed because of: gate-grenade-dsvm: https://bugs.launchpad.net/bugs/1315095 | 22:58 |
| *** bill_az has quit IRC | 23:01 | |
| *** jgrimm has quit IRC | 23:06 | |
| mrodden | sdague or dtroyer, if you wanted to take a quick look at this py26 compatibility fix for bash8 it would be nice to get merged soon https://review.openstack.org/#/c/93530/1 | 23:09 |
| *** nati_ueno has joined #openstack-qa | 23:14 | |
| *** tmcpeak has joined #openstack-qa | 23:30 | |
| tmcpeak | hey mrodden, got time for another simple Q? | 23:31 |
| mrodden | tmcpeak: are you sure you mean me? | 23:32 |
| tmcpeak | oh wait | 23:32 |
| tmcpeak | actually probably not | 23:32 |
| mrodden | :) | 23:32 |
| tmcpeak | other guy here was helping me earlier | 23:32 |
| mrodden | yeah mtreinish | 23:32 |
| tmcpeak | forgot his name though :\ | 23:32 |
| tmcpeak | yes! | 23:32 |
| tmcpeak | ok, let's try this again :) | 23:33 |
| tmcpeak | mtreinish: got time for another simple Q? :) | 23:33 |
| mrodden | you could just ask your question | 23:33 |
| mrodden | someone else might be able to answer | 23:33 |
| mrodden | also, he's probably away for the rest of the day | 23:33 |
| tmcpeak | ahh ok | 23:34 |
| tmcpeak | I'm trying to run three categories of tests: api, scenario, and services | 23:34 |
| tmcpeak | what's the best way to specify those tests to run | 23:34 |
| tmcpeak | I know I can specify a regex | 23:35 |
| tmcpeak | is that the best way? | 23:35 |
| mrodden | thats a good question | 23:36 |
| mrodden | i dont really know | 23:36 |
| mrodden | i usually run single modules | 23:36 |
| mrodden | like | 23:36 |
| mrodden | testr -- tempest.api.compute | 23:36 |
| sdague | mrodden: +A | 23:36 |
| mrodden | sdague: cool thanks | 23:36 |
| tmcpeak | ahhh | 23:37 |
| mrodden | also i'm not sure how to handle new error checks | 23:37 |
| mrodden | like this one https://review.openstack.org/#/c/94146/ | 23:37 |
| mrodden | i am pretty sure it doesn't belong under whitespace errors though | 23:37 |
| mrodden | :) | 23:37 |
| *** Sukhdev has quit IRC | 23:38 | |
| tmcpeak | I'm using the run_tempest.sh script, do you know if there is a similar way to run a single module with that? | 23:40 |
| *** yamahata has quit IRC | 23:43 | |
| *** malini is now known as malini_afk | 23:43 | |
| mrodden | tmcpeak: i think it passes args through | 23:44 |
| mrodden | so | 23:44 |
| mrodden | run_tempest.sh tempest.api.compute | 23:44 |
| mrodden | shoudl work? | 23:45 |
| mrodden | or try | 23:45 |
| mrodden | run_tempest.sh -- tempest.api.compute | 23:45 |
| tmcpeak | hmmm ok, yeah tried both of those but it gives me some sick output | 23:45 |
| tmcpeak | followed by Ran 0 tests in 2.886s | 23:46 |
| mrodden | heh yeah testr | 23:46 |
| mrodden | oh | 23:46 |
| mrodden | so it kind of work | 23:46 |
| mrodden | ed | 23:46 |
| tmcpeak | haha I guess | 23:46 |
| tmcpeak | that's testr output? | 23:46 |
| mrodden | yes | 23:46 |
| mrodden | run_tempest.sh just calls testr | 23:46 |
| tmcpeak | yikes, unfriendly looking thing, huh? | 23:46 |
| mrodden | yep... | 23:46 |
| mrodden | their working on that anyway | 23:47 |
| tmcpeak | ok, yeah I didn't know if that was testr or subunit or what | 23:47 |
| openstackrecheck | openstack/horizon change: https://review.openstack.org/93796 failed because of: gate-horizon-selenium: https://bugs.launchpad.net/bugs/1317630 | 23:47 |
| mrodden | if you open up the run_tempest.sh it will have the commands | 23:47 |
| mrodden | by default it does testr | 23:47 |
| mrodden | which uses subunit | 23:47 |
| tmcpeak | yeah, saw that command, just didn't know which was outputting that scary stuff ;) | 23:48 |
| mrodden | yeah it barfs out raw bytes that it captures via stdout, stderr | 23:48 |
| mrodden | which isnt really useful in most cases | 23:49 |
| tmcpeak | ahh, I guess that's why the doc I was reading suggested grepping the output for test, success, and that kind of stuff | 23:49 |
| *** nati_ueno has quit IRC | 23:50 | |
| mrodden | yeah | 23:50 |
| tmcpeak | ok cool, I'll try poking around a bit more | 23:50 |
| tmcpeak | thank you for the help | 23:51 |
| mrodden | np | 23:51 |
| mrodden | more people will be around tomorrow | 23:51 |
| *** nati_ueno has joined #openstack-qa | 23:51 | |
| mrodden | that i'm sure will be able to tell you the answer off the top of their head | 23:51 |
| tmcpeak | ok cool, if I can't make much progress I'll stop back by | 23:51 |
| tmcpeak | this channel is a nice resource :) | 23:51 |
| *** tmcpeak has quit IRC | 23:54 | |
| *** suneelb has joined #openstack-qa | 23:55 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!