| *** DennyZhang has quit IRC | 00:04 | |
| *** jpipes has quit IRC | 00:08 | |
| *** matsuhashi has joined #openstack-qa | 00:25 | |
| openstackgerrit | A change was merged to openstack/tempest: Revert "unskipping bug related to test_stamp_pattern.py" https://review.openstack.org/49181 | 00:44 |
|---|---|---|
| *** nosnos has joined #openstack-qa | 00:49 | |
| giulivo | sdague, mtreinish, cyeoh does tempest get into feature freeze after the first RC is announced? | 00:49 |
| openstackgerrit | A change was merged to openstack/tempest: Explicity specify network for heat slow tests https://review.openstack.org/48170 | 00:55 |
| *** adalbas has quit IRC | 00:58 | |
| *** giulivo has quit IRC | 00:58 | |
| *** weshay has quit IRC | 00:59 | |
| *** DennyZhang has joined #openstack-qa | 01:12 | |
| *** rockyg has joined #openstack-qa | 01:15 | |
| *** yfujioka has joined #openstack-qa | 01:21 | |
| *** jasondot_ has joined #openstack-qa | 01:37 | |
| *** dims has quit IRC | 01:40 | |
| *** DennyZhang has quit IRC | 02:10 | |
| *** kong has joined #openstack-qa | 02:19 | |
| openstackgerrit | Lingxian Kong proposed a change to openstack/tempest: add some negative tests for attach_interfaces https://review.openstack.org/49231 | 02:27 |
| *** prekarat has joined #openstack-qa | 03:05 | |
| *** prekarat has quit IRC | 03:05 | |
| *** prekarat has joined #openstack-qa | 03:05 | |
| *** jasondot_ has quit IRC | 03:14 | |
| openstackgerrit | Lingxian Kong proposed a change to openstack/tempest: add some negative tests for attach_interfaces https://review.openstack.org/49231 | 03:28 |
| *** mriedem has quit IRC | 03:28 | |
| openstackgerrit | Joe Mills proposed a change to openstack-dev/devstack: Add MIDONET settings to dhcp.ini https://review.openstack.org/49297 | 03:33 |
| openstackgerrit | A change was merged to openstack/tempest: Update style guide link in HACKING.rst https://review.openstack.org/49179 | 03:55 |
| *** tkammer has joined #openstack-qa | 04:04 | |
| *** harlowja has quit IRC | 04:08 | |
| *** kong has quit IRC | 04:17 | |
| *** yfujioka has quit IRC | 04:28 | |
| *** tkammer has quit IRC | 04:28 | |
| *** tkammer has joined #openstack-qa | 04:29 | |
| *** yfujioka has joined #openstack-qa | 04:30 | |
| *** SergeyLukjanov has joined #openstack-qa | 04:58 | |
| *** jaypipes has joined #openstack-qa | 05:46 | |
| *** ChanServ sets mode: +o jaypipes | 05:46 | |
| *** prekarat has quit IRC | 05:49 | |
| *** jlibosva has joined #openstack-qa | 05:53 | |
| *** SergeyLukjanov has quit IRC | 05:55 | |
| *** dkorn has joined #openstack-qa | 06:27 | |
| *** afazekas_no_irq has joined #openstack-qa | 06:55 | |
| openstackgerrit | Mehdi Abaakouk proposed a change to openstack/tempest: [DEBUG] ceilometer-api https://review.openstack.org/49314 | 07:05 |
| *** SergeyLukjanov has joined #openstack-qa | 07:19 | |
| *** anteaya has quit IRC | 07:21 | |
| *** dkorn has quit IRC | 07:30 | |
| openstackgerrit | Mehdi Abaakouk proposed a change to openstack/tempest: [DEBUG] ceilometer-api https://review.openstack.org/49314 | 07:36 |
| *** dkorn has joined #openstack-qa | 07:44 | |
| *** yassine has joined #openstack-qa | 07:48 | |
| *** thomasbiege has joined #openstack-qa | 08:07 | |
| *** thomasbiege has quit IRC | 08:09 | |
| *** giulivo has joined #openstack-qa | 08:11 | |
| *** raies_ has joined #openstack-qa | 08:12 | |
| raies_ | afazekas: please look at https://review.openstack.org/#/c/47339/ I have incorporated with you review comments | 08:14 |
| *** matsuhashi has quit IRC | 08:28 | |
| *** matsuhashi has joined #openstack-qa | 08:28 | |
| raies_ | mkoderer: hi | 08:35 |
| *** jasondot_ has joined #openstack-qa | 08:35 | |
| openstackgerrit | Mehdi Abaakouk proposed a change to openstack/tempest: [DEBUG] ceilometer-api https://review.openstack.org/49314 | 08:41 |
| openstackgerrit | Mehdi Abaakouk proposed a change to openstack/tempest: [DEBUG] ceilometer-api https://review.openstack.org/49314 | 08:44 |
| openstackgerrit | Mehdi Abaakouk proposed a change to openstack/tempest: [DEBUG] ceilometer-api do not review this https://review.openstack.org/49314 | 08:49 |
| *** dkorn has quit IRC | 08:52 | |
| *** prekarat has joined #openstack-qa | 08:58 | |
| *** tkammer has quit IRC | 09:01 | |
| *** tkammer has joined #openstack-qa | 09:27 | |
| openstackgerrit | Mehdi Abaakouk proposed a change to openstack/tempest: [DEBUG] ceilometer-api do not review this https://review.openstack.org/49314 | 09:36 |
| *** raies_ has quit IRC | 09:48 | |
| *** Anju has quit IRC | 09:53 | |
| *** tkammer has quit IRC | 10:04 | |
| *** jasondot_ has quit IRC | 10:06 | |
| openstackgerrit | Mehdi Abaakouk proposed a change to openstack/tempest: [DEBUG] ceilometer-api do not review this https://review.openstack.org/49314 | 10:13 |
| *** matsuhashi has quit IRC | 10:16 | |
| openstackgerrit | Mehdi Abaakouk proposed a change to openstack/tempest: [DEBUG] ceilometer-api do not review this https://review.openstack.org/49314 | 10:16 |
| *** tkammer has joined #openstack-qa | 10:17 | |
| *** yfujioka has quit IRC | 10:19 | |
| *** SergeyLukjanov has quit IRC | 10:27 | |
| *** dims has joined #openstack-qa | 10:31 | |
| *** SergeyLukjanov has joined #openstack-qa | 10:33 | |
| openstackgerrit | A change was merged to openstack/tempest: add server reset_state tests https://review.openstack.org/48794 | 10:39 |
| *** jeblair has quit IRC | 10:47 | |
| *** jeblair has joined #openstack-qa | 10:48 | |
| *** weshay has joined #openstack-qa | 10:53 | |
| *** fbo is now known as fbo_away | 10:59 | |
| *** raies has quit IRC | 11:06 | |
| *** SergeyLukjanov has quit IRC | 11:08 | |
| *** dims has quit IRC | 11:09 | |
| *** SergeyLukjanov has joined #openstack-qa | 11:10 | |
| *** adalbas has joined #openstack-qa | 11:15 | |
| *** nosnos has quit IRC | 11:16 | |
| *** dkorn has joined #openstack-qa | 11:18 | |
| *** afazekas_no_irq has quit IRC | 11:20 | |
| sdague | giulivo: we typically cut a stable branch once all the projects have stable branches | 11:31 |
| openstackgerrit | Mehdi Abaakouk proposed a change to openstack/tempest: [DEBUG] ceilometer-api do not review this https://review.openstack.org/49314 | 11:32 |
| sdague | but our timeline isn't fixed | 11:32 |
| *** dims has joined #openstack-qa | 11:36 | |
| giulivo | sdague, thanks! | 11:38 |
| *** dims has quit IRC | 11:41 | |
| giulivo | sdague, and do the projects get a stable branch at the time of the final release or of the rc? | 11:41 |
| *** dims has joined #openstack-qa | 11:42 | |
| giulivo | like what is the for new tempest things to get in before the tempest's stable branch? | 11:43 |
| giulivo | *what is the timeframe | 11:43 |
| giulivo | milestone -> rc or milestone -> finale release ? | 11:44 |
| dims | sdague, good news and bad news. good news - review 49210 does fix the simultaneous bogus fd issue (quick check using @message:"Second simultaneous" AND @fields.build_change:"49210"). bad news - can't get past the other neutron, other flakiness and the additional gate/check jobs we threw in yesterday. | 11:52 |
| *** Anju has joined #openstack-qa | 11:53 | |
| *** fbo_away is now known as fbo | 12:01 | |
| openstackgerrit | Mehdi Abaakouk proposed a change to openstack/tempest: [DEBUG] ceilometer-api do not review this https://review.openstack.org/49314 | 12:03 |
| *** ken1ohmichi has quit IRC | 12:04 | |
| *** mkollaro has joined #openstack-qa | 12:10 | |
| *** mriedem has joined #openstack-qa | 12:12 | |
| *** sthaha has quit IRC | 12:17 | |
| openstackgerrit | Mehdi Abaakouk proposed a change to openstack/tempest: [DEBUG] ceilometer-api do not review this https://review.openstack.org/49314 | 12:21 |
| openstackgerrit | Mehdi Abaakouk proposed a change to openstack/tempest: [DEBUG] ceilometer-api do not review this https://review.openstack.org/49314 | 12:42 |
| *** dkranz has joined #openstack-qa | 12:42 | |
| *** thomasbiege1 has joined #openstack-qa | 12:56 | |
| *** thomasbiege1 has quit IRC | 12:56 | |
| openstackgerrit | Mehdi Abaakouk proposed a change to openstack/tempest: [DEBUG] ceilometer-api do not review this https://review.openstack.org/49314 | 13:22 |
| sdague | dims: so we can always do a ninja merge if we need to | 13:24 |
| *** weshay has quit IRC | 13:24 | |
| *** thomasbiege1 has joined #openstack-qa | 13:30 | |
| dims | sdague, +1 to ninja merge :) | 13:32 |
| *** yassine has quit IRC | 13:34 | |
| *** yassine has joined #openstack-qa | 13:35 | |
| *** rfolco has joined #openstack-qa | 13:35 | |
| openstackgerrit | Mehdi Abaakouk proposed a change to openstack/tempest: [DEBUG] ceilometer-api do not review this https://review.openstack.org/49314 | 13:49 |
| *** weshay has joined #openstack-qa | 13:58 | |
| *** DennyZhang has joined #openstack-qa | 13:59 | |
| *** yassine has quit IRC | 14:00 | |
| *** yassine has joined #openstack-qa | 14:01 | |
| *** thomasbiege1 has quit IRC | 14:03 | |
| *** thomasbiege1 has joined #openstack-qa | 14:05 | |
| *** thomasbiege1 has quit IRC | 14:09 | |
| *** dkorn has quit IRC | 14:22 | |
| *** dkorn has joined #openstack-qa | 14:24 | |
| openstackgerrit | Matthew Treinish proposed a change to openstack-infra/elastic-recheck: Make test_required_files.py real unit tests https://review.openstack.org/49265 | 14:30 |
| openstackgerrit | Mehdi Abaakouk proposed a change to openstack-dev/devstack: [debug] ceilometer don't review this https://review.openstack.org/49376 | 14:32 |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Make test_queries save stdout in tox testr https://review.openstack.org/49080 | 14:40 |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Add mox fixture to base TestCase https://review.openstack.org/49264 | 14:40 |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Cleanup README https://review.openstack.org/49281 | 14:40 |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Add query for bug 1232748 https://review.openstack.org/49280 | 14:40 |
| *** anteaya has joined #openstack-qa | 14:44 | |
| *** prekarat1 has joined #openstack-qa | 14:44 | |
| *** prekarat has quit IRC | 14:45 | |
| *** jlibosva has quit IRC | 14:53 | |
| openstackgerrit | Mehdi Abaakouk proposed a change to openstack-dev/devstack: [debug] ceilometer don't review this https://review.openstack.org/49376 | 14:53 |
| openstackgerrit | Mehdi Abaakouk proposed a change to openstack-dev/devstack: [debug] ceilometer don't review this https://review.openstack.org/49376 | 14:54 |
| *** thomasbiege1 has joined #openstack-qa | 14:56 | |
| *** tkammer has quit IRC | 15:00 | |
| *** adalbas has quit IRC | 15:07 | |
| *** thomasbiege1 has quit IRC | 15:11 | |
| *** dkorn has quit IRC | 15:16 | |
| openstackgerrit | Mehdi Abaakouk proposed a change to openstack-dev/devstack: [debug] ceilometer don't review this https://review.openstack.org/49376 | 15:16 |
| *** thomasbiege1 has joined #openstack-qa | 15:17 | |
| *** jhenner has quit IRC | 15:27 | |
| sdague | dims: what's the review again? | 15:35 |
| dims | https://review.openstack.org/#/c/49210/ | 15:35 |
| openstackgerrit | Matthew Treinish proposed a change to openstack-infra/elastic-recheck: Update elasticRecheck imports in bot.py https://review.openstack.org/48878 | 15:37 |
| jog0 | dims: https://bugs.launchpad.net/neutron/+bug/1233923 | 15:40 |
| jog0 | have some further information on that one | 15:40 |
| dims | jog0, thanks, will take a peek | 15:41 |
| jog0 | dims: we know enough to think its a neutron related issue thats really it | 15:43 |
| openstackgerrit | Matthew Treinish proposed a change to openstack-infra/elastic-recheck: Reorganize tests into unit and functional tests https://review.openstack.org/49391 | 15:46 |
| *** openstackrecheck has quit IRC | 15:47 | |
| *** openstackrecheck has joined #openstack-qa | 15:47 | |
| openstackgerrit | Joe Gordon proposed a change to openstack-infra/elastic-recheck: Stop using While True to wait for ElasticSearch https://review.openstack.org/48766 | 15:49 |
| *** marun has quit IRC | 15:50 | |
| sdague | jog0: so I found one more REQUIRED_FILES location in er that I need to address, and I'm trying to understand the get_failed_tempest logic | 15:50 |
| sdague | so that I can refactor this to handle it | 15:50 |
| jog0 | sdague: hehe its a little wonkey | 15:50 |
| jog0 | get_failed_tempest logic is: if pep8 and unit tests pass and tempest failed run | 15:51 |
| sdague | so if we find a python unit test or pep 8 fail we bail fast | 15:51 |
| sdague | but also if we find a tempest fail, but the files aren't on the log server we bail | 15:51 |
| jog0 | sdague: because we assume the patch is bad in those cases | 15:51 |
| jog0 | sdague: right | 15:51 |
| sdague | and that's it, right? | 15:51 |
| jog0 | if something goes wrong and the files don't get copied over they won't be in elasticSearch either | 15:51 |
| jog0 | sdague: let me confirm | 15:52 |
| *** yassine has quit IRC | 15:52 | |
| jog0 | sdague: yeah there is also the only look for jenkins authored comments that contain 'build failed ...' | 15:52 |
| jog0 | but yeah | 15:52 |
| jog0 | that is correct | 15:52 |
| mtreinish | jog0: on 48766 you still rename the function, so the test call still needs to updated otherwise it won't work. | 15:52 |
| jog0 | mtreinish: doh | 15:53 |
| jog0 | oh woops I did want to rename the function | 15:53 |
| mtreinish | jog0: I actually like the new name more | 15:53 |
| *** thomasbiege1 has quit IRC | 15:57 | |
| sdague | jog0: ok, I'll retool this after lunch | 16:03 |
| *** hemnafk is now known as hemna_ | 16:04 | |
| jog0 | sdague: cool make sure ot update the docs and whatnot too | 16:06 |
| openstackgerrit | Mehdi Abaakouk proposed a change to openstack-dev/devstack: force run_process to really spawn a bash process https://review.openstack.org/49394 | 16:07 |
| openstackrecheck | openstack/nova change: https://review.openstack.org/49386 failed tempest with an unrecognized error | 16:08 |
| *** prekarat1 has quit IRC | 16:10 | |
| *** prekarat has joined #openstack-qa | 16:12 | |
| openstackgerrit | Julien Danjou proposed a change to openstack/tempest: Re-enable EC2 skipped test https://review.openstack.org/49396 | 16:15 |
| openstackgerrit | Julien Danjou proposed a change to openstack/tempest: Re-enable EC2 skipped test https://review.openstack.org/49396 | 16:19 |
| *** SergeyLukjanov has quit IRC | 16:20 | |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/elastic-recheck: Add hits_by_query method https://review.openstack.org/49398 | 16:20 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/elastic-recheck: add check_success tool https://review.openstack.org/49246 | 16:20 |
| openstackrecheck | openstack/cinder change: https://review.openstack.org/45892 failed tempest with an unrecognized error | 16:21 |
| *** prekarat has quit IRC | 16:25 | |
| openstackrecheck | openstack/cinder change: https://review.openstack.org/47365 failed tempest with an unrecognized error | 16:26 |
| openstackgerrit | Joe Gordon proposed a change to openstack-infra/elastic-recheck: Stop using While True to wait for ElasticSearch https://review.openstack.org/48766 | 16:31 |
| openstackgerrit | Mehdi Abaakouk proposed a change to openstack-dev/devstack: force run_process to really spawn a bash process https://review.openstack.org/49394 | 16:36 |
| openstackgerrit | Joe Gordon proposed a change to openstack-infra/elastic-recheck: Stop using While True to wait for ElasticSearch https://review.openstack.org/48766 | 16:37 |
| *** prekarat has joined #openstack-qa | 16:37 | |
| openstackgerrit | Mehdi Abaakouk proposed a change to openstack-dev/devstack: force run_process to really spawn a bash process https://review.openstack.org/49394 | 16:37 |
| *** marun has joined #openstack-qa | 16:39 | |
| *** adalbas has joined #openstack-qa | 16:44 | |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Update elasticRecheck imports in bot.py https://review.openstack.org/48878 | 16:48 |
| *** afazekas_no_irq has joined #openstack-qa | 16:48 | |
| *** SergeyLukjanov has joined #openstack-qa | 16:49 | |
| openstackgerrit | Mate Lakat proposed a change to openstack-dev/devstack: xenapi: increase default memory to 3G https://review.openstack.org/49401 | 16:49 |
| *** fbo is now known as fbo_away | 17:01 | |
| openstackrecheck | openstack/ceilometer change: https://review.openstack.org/48667 failed tempest with an unrecognized error | 17:03 |
| jog0 | I think bug 1233923 is one of biggest errors without a logstash query | 17:05 |
| jog0 | https://bugs.launchpad.net/nova/+bug/1233923 | 17:06 |
| openstackrecheck | openstack/tempest change: https://review.openstack.org/49396 failed tempest with an unrecognized error | 17:08 |
| openstackgerrit | Matthew Treinish proposed a change to openstack-infra/elastic-recheck: Reorganize tests into unit and functional tests https://review.openstack.org/49391 | 17:09 |
| openstackrecheck | openstack/cinder change: https://review.openstack.org/47365 failed tempest with an unrecognized error | 17:09 |
| *** harlowja has joined #openstack-qa | 17:10 | |
| jog0 | russellb: ^ | 17:10 |
| mkoderer_ | mtreinish: ping | 17:10 |
| mtreinish | mkoderer_: pong | 17:12 |
| *** dkranz has quit IRC | 17:12 | |
| mkoderer_ | mtreinish: it's a bit strange what happened with the stress tests in the nightly jobs for me | 17:12 |
| mkoderer_ | mtreinish: after my fix we had two successful runs but now it's failing again | 17:13 |
| mkoderer_ | http://logs.openstack.org/periodic/periodic-tempest-devstack-vm-stress/devstack-precise-hpcloud-az3-416310/31/logs/tempest.txt.gz | 17:13 |
| mkoderer_ | http://logs.openstack.org/periodic/periodic-tempest-devstack-vm-stress/devstack-precise-hpcloud-az3-418188/32/logs/tempest.txt.gz | 17:13 |
| mtreinish | hmm, that's a short log | 17:14 |
| mtreinish | and that last line is weird, I've never seen that before | 17:14 |
| mkoderer_ | mtreinish: so far I see it's in the setUp call before the test function was called | 17:14 |
| mkoderer_ | mtreinish: I think I will need to put some additional logging | 17:15 |
| mtreinish | mkoderer_: yeah it's hard to tell exactly what's going on from those logs | 17:16 |
| mtreinish | if it's any consolation the coverage runs are failing in a weird way too, and I haven't had time to dig into it yet | 17:16 |
| mkoderer_ | mtreinish: yes, if I have time tomorrow I will have a look to them too | 17:17 |
| mkoderer_ | tomorrow is a public holiday in germany.. so I should have time for upstream :) | 17:17 |
| mtreinish | mkoderer_: ok, you shouldn't have to work during a holiday though. I know that I wouldn't :) | 17:20 |
| *** kong has joined #openstack-qa | 17:21 | |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Add hits_by_query method https://review.openstack.org/49398 | 17:22 |
| *** dkranz has joined #openstack-qa | 17:29 | |
| openstackgerrit | Lingxian Kong proposed a change to openstack/tempest: add some tests for aggregate https://review.openstack.org/49157 | 17:32 |
| mtreinish | sdague: can you push this through? https://review.openstack.org/#/c/48764/ it's got a complicated dependency with the other unit tests I'm working on | 17:33 |
| *** DennyZhang has quit IRC | 17:34 | |
| *** fbo_away is now known as fbo | 17:37 | |
| openstackrecheck | openstack/glance change: https://review.openstack.org/49316 failed tempest because of: https://bugs.launchpad.net/bugs/1211915 and https://bugs.launchpad.net/bugs/1230407 and | 17:41 |
| sdague | mtreinish: sure | 17:42 |
| openstackgerrit | Lingxian Kong proposed a change to openstack/tempest: add some negative tests for attach_interfaces https://review.openstack.org/49231 | 17:42 |
| jog0 | double neutron fail ^^^ | 17:43 |
| *** DennyZhang has joined #openstack-qa | 17:44 | |
| mtreinish | jog0: oooh | 17:45 |
| mtreinish | oops trailing 'and' in the gerrit comment :) | 17:45 |
| mtreinish | and in the irc message too I guess | 17:46 |
| jog0 | mtreinish: yeah just noticed that too | 17:46 |
| jog0 | but more important than that small bug its working! | 17:47 |
| mtreinish | jog0: \o/ | 17:50 |
| openstackrecheck | openstack/cinder change: https://review.openstack.org/48836 failed tempest with an unrecognized error | 17:52 |
| openstackgerrit | Joe Gordon proposed a change to openstack-infra/elastic-recheck: Cleanup tests https://review.openstack.org/48764 | 17:52 |
| sdague | jog0: so why does python setup.py develop not work without root privs? | 17:53 |
| sdague | on elastic-recheck | 17:53 |
| jog0 | sdague: hrmm it worked for me | 17:53 |
| jog0 | I did it in a venv | 17:53 |
| jog0 | though | 17:53 |
| sdague | http://paste.openstack.org/show/47848/ | 17:54 |
| sdague | I thought pbr was supposed to fix this issue for us | 17:54 |
| sdague | mordred: you about? | 17:54 |
| jog0 | a work around is the venv for sure | 17:55 |
| mtreinish | sdague: doesn't it make a symlink to /usr/local ? | 17:55 |
| mtreinish | that would require root | 17:55 |
| openstackrecheck | openstack/python-neutronclient change: https://review.openstack.org/49403 failed tempest because of: https://bugs.launchpad.net/bugs/1229475 | 17:57 |
| sdague | right, but setup.py develop is supposed to be only in tree, right? | 17:57 |
| *** dkorn has joined #openstack-qa | 17:58 | |
| *** dkorn has joined #openstack-qa | 17:59 | |
| openstackgerrit | Lingxian Kong proposed a change to openstack/tempest: add some negative tests for attach_interfaces https://review.openstack.org/49231 | 17:59 |
| *** raies has joined #openstack-qa | 18:01 | |
| raies | giulivo: hi | 18:01 |
| openstackgerrit | Lingxian Kong proposed a change to openstack/tempest: add some tests for aggregate https://review.openstack.org/49157 | 18:06 |
| openstackgerrit | Matt Riedemann proposed a change to openstack-dev/devstack: Change DATABASE_HOST default to 127.0.0.1 https://review.openstack.org/49409 | 18:09 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/elastic-recheck: Add graph script https://review.openstack.org/49410 | 18:09 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/elastic-recheck: Add graph script https://review.openstack.org/49410 | 18:10 |
| *** mlavalle has joined #openstack-qa | 18:29 | |
| *** rockyg has quit IRC | 18:31 | |
| *** rockyg has joined #openstack-qa | 18:31 | |
| mtreinish | mlavalle: did you see this yesterday?: https://git.openstack.org/cgit/openstack-dev/devstack/commit/?id=1c1aef0eb7796f0fe8b2502eb4aaa62369b7842a | 18:31 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/elastic-recheck: Add graph script https://review.openstack.org/49410 | 18:32 |
| mlavalle | mtreinish: no, I didn't see it. let me take a look | 18:32 |
| mlavalle | mtreinish: ok, I saw that. What are the problems being generated? Can you point me to logs where I can see what the problem is? | 18:36 |
| *** dkranz has quit IRC | 18:36 | |
| *** openstackrecheck has quit IRC | 18:42 | |
| *** openstackrecheck has joined #openstack-qa | 18:42 | |
| openstackrecheck | openstack/tempest change: https://review.openstack.org/49157 failed tempest with an unrecognized error | 18:44 |
| openstackrecheck | openstack/neutron change: https://review.openstack.org/49247 failed tempest with an unrecognized error | 18:44 |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Stop using While True to wait for ElasticSearch https://review.openstack.org/48766 | 18:47 |
| openstackrecheck | openstack/tempest change: https://review.openstack.org/49231 failed tempest with an unrecognized error | 18:49 |
| mtreinish | mlavalle: I think that there is already a fix in progress for the underlying bug. It was just an interesting side effect | 18:49 |
| mtreinish | of turning on tenant isolation | 18:50 |
| mlavalle | mtreinish: cool, can you point me to that fix…. just for my own education…. ;-) | 18:50 |
| openstackgerrit | Lingxian Kong proposed a change to openstack/tempest: add some tests for aggregate https://review.openstack.org/49157 | 18:50 |
| *** dkorn has quit IRC | 18:51 | |
| *** dkranz has joined #openstack-qa | 18:51 | |
| mtreinish | mlavalle: actually nm it's just a debug info patch: https://review.openstack.org/#/c/49233/ | 18:52 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/elastic-recheck: Add graph script https://review.openstack.org/49410 | 18:54 |
| mlavalle | mtreinish: I didn't understand the last comment…. Do I need to worry about this or it is being taken care of? | 18:54 |
| *** raies has quit IRC | 18:54 | |
| openstackgerrit | Lingxian Kong proposed a change to openstack/tempest: add some tests for aggregate https://review.openstack.org/49157 | 18:56 |
| openstackrecheck | openstack/heat change: https://review.openstack.org/48964 failed tempest with an unrecognized error | 18:56 |
| openstackrecheck | openstack-dev/devstack change: https://review.openstack.org/49409 failed tempest with an unrecognized error | 19:00 |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/elastic-recheck: add check_success tool https://review.openstack.org/49246 | 19:04 |
| sdague | jog0: can you take a spin on that, it's sorted now by fails | 19:10 |
| sdague | the only one I'm going to need to handle some refactoring on | 19:11 |
| *** mlavalle has left #openstack-qa | 19:11 | |
| *** mlavalle_ has joined #openstack-qa | 19:15 | |
| dims | sdague, python-neutronclient - does that have the most number of neutron oriented jenkins jobs? | 19:20 |
| sdague | dims: it's got the same number as neutron | 19:21 |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/elastic-recheck: add check_success tool https://review.openstack.org/49246 | 19:22 |
| dims | sdague, thx | 19:23 |
| mordred | sdague: sup? | 19:26 |
| dkranz | sdague: Annoying question: Are we -1 on reviews for negative tests lacking a 'negative' tag? | 19:26 |
| sdague | dkranz: yes, that should be a -1 | 19:31 |
| sdague | mordred: so python setup.py develop.... I thought that wasn't supposed to require root | 19:31 |
| sdague | or am I confused | 19:31 |
| dkranz | sdague: thanks. So be it. | 19:32 |
| mordred | sdague: it shoudl not require root | 19:40 |
| sdague | mordred: so it does | 19:40 |
| mordred | sdague: have you found an instance where itneeds it? | 19:40 |
| sdague | yes, elastic-recheck | 19:41 |
| mordred | sdague: it's probably the local egg-info dir | 19:41 |
| mordred | sdague: something probably did something in the dir as root and then did not chown the egg-info dir | 19:41 |
| sdague | no, it wanted to do /usr/local mods | 19:41 |
| mordred | oh! that's ... | 19:41 |
| mordred | oh. duh. sorry | 19:41 |
| * mordred is stupid right now | 19:41 | |
| openstackrecheck | openstack/python-novaclient change: https://review.openstack.org/48822 failed tempest because of: https://bugs.launchpad.net/bugs/1211915 and https://bugs.launchpad.net/bugs/1217734 and https://bugs.launchpad.net/bugs/1230407 and | 19:41 |
| mordred | yes. setup.py develop absolutely needs root | 19:41 |
| mordred | if you aren't installing into a virtualenv | 19:41 |
| mordred | it's installing globally just like install | 19:42 |
| mordred | it just does it with links rather than file copies | 19:42 |
| *** dkranz has quit IRC | 19:44 | |
| sdague | ok | 19:44 |
| *** kong has quit IRC | 19:47 | |
| openstackrecheck | openstack/tempest change: https://review.openstack.org/49231 failed tempest because of: https://bugs.launchpad.net/bugs/1226337 | 19:49 |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/elastic-recheck: add check_success tool https://review.openstack.org/49246 | 19:50 |
| mriedem | mtreinish: ping | 19:52 |
| mriedem | or sdague? | 19:52 |
| mriedem | i'm fishing for feelings on this: https://bugs.launchpad.net/tempest/+bug/1234370 | 19:53 |
| mriedem | given tempest + neutron, i think it's valid | 19:53 |
| mriedem | if there is agreement i can work a patch | 19:54 |
| *** adalbas has quit IRC | 19:58 | |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/elastic-recheck: add check_success tool https://review.openstack.org/49246 | 20:00 |
| mtreinish | mriedem: you're running in serial though right? | 20:00 |
| mriedem | mtreinish: yup, b/c we're using neutron | 20:00 |
| mtreinish | did cleanup just fail (or was slow) | 20:01 |
| mriedem | mtreinish: i think the issue is the tearDown is asynchronous | 20:01 |
| mriedem | slow | 20:01 |
| mriedem | i ran the test again manually and it was all good | 20:01 |
| mtreinish | mriedem: then probably adding a wait for deleted is the solution here | 20:01 |
| mriedem | mtreinish: so i'm thinking in the setup for that class, if not MULTI_USER, delete the instances or timeout, else fail as it does today | 20:01 |
| mriedem | mtreinish: agreed | 20:01 |
| mtreinish | mriedem: for the record you can run with neutron and tenant isolation if you can stand a very high nondeterministic failure rate :) | 20:03 |
| mtreinish | (the code is there) | 20:03 |
| mriedem | mtreinish: yeah, in my environment, this isn't non-voting, so i can't stand it :) | 20:03 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/elastic-recheck: Add graph script https://review.openstack.org/49410 | 20:12 |
| jog0 | sdague: looking. also have you seen http://status.openstack.org/elastic-recheck/ | 20:12 |
| sdague | jog0: yes, it was liberally borrowed from check_success :) | 20:15 |
| openstackgerrit | Matt Riedemann proposed a change to openstack/tempest: Clean up existing instances when not using tenant isolation https://review.openstack.org/49431 | 20:16 |
| mriedem | mtreinish: ^ | 20:16 |
| jog0 | its amazing what a little ElasticSearch can do | 20:17 |
| sdague | yep | 20:21 |
| mtreinish | mriedem: actually looking at your patch I think the better solution is to find out where the stray servers are coming from | 20:23 |
| mtreinish | then try to plug that leak | 20:23 |
| mtreinish | I didn't realize it was in setupClass that you were hitting the issue | 20:24 |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: add check_success tool https://review.openstack.org/49246 | 20:24 |
| mriedem | mtreinish: yeah, just because of the restriction that test makes | 20:24 |
| mtreinish | mriedem: do we have another py26 bug with raising a skip exception? because you shouldn't be seeing a traceback there | 20:25 |
| mtreinish | it should just skip | 20:26 |
| mriedem | mtreinish: i should point out i'm using nose | 20:26 |
| mtreinish | (which I don't think is good behavior) | 20:26 |
| mtreinish | mriedem: well you have to with py26 | 20:26 |
| mriedem | and i think there is some history there on not fixing things for nose and py26 | 20:26 |
| mtreinish | mriedem: I'm against it | 20:26 |
| mriedem | with regards to skipException | 20:26 |
| mtreinish | I was just asking I thought we got that working again at one point | 20:27 |
| mriedem | if i remember correctly you have to set an environment variable or something for that to get ignored | 20:27 |
| mriedem | you still lose the test coverage though | 20:27 |
| mtreinish | mriedem: which is why I'd like to find the leaks and remove the skip | 20:27 |
| mtreinish | if you look at the git history it was part of a bunch of fixes to fix a flaky gate last year | 20:28 |
| mriedem | mtreinish: so how do you propose going about finding the leaks? since the server deletes are asynchronous in the tear down, if you're on a slower system or there is a spike or something, you could still always hit this right? | 20:30 |
| mriedem | mtreinish: what i can do locally is modify that setup to dump the servers since the names should have the tests they were created in | 20:31 |
| mriedem | and then see if there is maybe something going on in those tests? | 20:31 |
| mriedem | i'd have to think they are leftover from the test class right before test_list_servers_negative | 20:32 |
| mriedem | which would be list_server_filters | 20:32 |
| mriedem | *test_list_server_filters | 20:32 |
| jog0 | mtreinish: can you abandon https://review.openstack.org/#/c/48477/ | 20:32 |
| *** DennyZhang has quit IRC | 20:34 | |
| mtreinish | mriedem: yeah finding the leaks is a fun problem | 20:36 |
| mtreinish | afazekas_no_irq was working on it at one point | 20:36 |
| mtreinish | temporary adding the prints would probably work for the short term | 20:36 |
| mtreinish | jog0: yeah probably | 20:37 |
| *** dkranz has joined #openstack-qa | 20:41 | |
| *** mlavalle_ has quit IRC | 20:44 | |
| *** SergeyLukjanov has quit IRC | 20:48 | |
| openstackgerrit | Joe Gordon proposed a change to openstack-infra/elastic-recheck: Cleanup tests https://review.openstack.org/48764 | 20:57 |
| mriedem | mtreinish: of course once i add the prints to debug i can't recreate :) | 21:03 |
| mtreinish | mriedem: well it is a race condition | 21:06 |
| mtreinish | and prints take so much time to execute | 21:06 |
| mriedem | it did fail on two different systems today for me though, just not when i want it to | 21:06 |
| openstackgerrit | Joe Gordon proposed a change to openstack-infra/elastic-recheck: Add more debug logs to classify https://review.openstack.org/49442 | 21:08 |
| *** thomasbiege1 has joined #openstack-qa | 21:24 | |
| *** thomasbiege1 has quit IRC | 21:26 | |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Add more debug logs to classify https://review.openstack.org/49442 | 21:26 |
| *** weshay has quit IRC | 21:28 | |
| mtreinish | dkranz: ping | 21:28 |
| *** openstackrecheck has quit IRC | 21:30 | |
| *** openstackrecheck has joined #openstack-qa | 21:30 | |
| *** rockyg has quit IRC | 21:34 | |
| *** mlavalle has joined #openstack-qa | 21:42 | |
| mlavalle | mtreinish: are you still around? | 21:42 |
| mtreinish | mlavalle: yep, what's up? | 21:44 |
| mlavalle | mtreinish: so what's next for isolated networks? how can i help? | 21:45 |
| mtreinish | mlavalle: so neutron isn't ready for tenant isolation isolation. It generates too many requests which hits races inside of neutron. | 21:46 |
| mtreinish | but neutron is now gated on tenant isolation | 21:46 |
| mtreinish | so neutron code can't get through unless the bug is fixed | 21:46 |
| mlavalle | mtreinish: what bug is that? | 21:47 |
| mtreinish | mlavalle: the one I was refering too earlier: https://bugs.launchpad.net/swift/+bug/1224001 | 21:48 |
| mtreinish | although there might be other ones too (I'm not sure) | 21:48 |
| *** rfolco has quit IRC | 21:49 | |
| mlavalle | mtreinish: i'll track it down. in the mean time, what do you think is the best use of my time? Go back to work on cleaning gate-tempest-devstack-vm-neutron-full? | 21:50 |
| mtreinish | mlavalle: well that bug has a lot of attention right now, because it's blocking both rc1 and code in neutron from merging. So maybe concentrating on getting the full tempest working with neutron is better. | 21:53 |
| mtreinish | although I suspect you'll hit similar issues | 21:53 |
| mtreinish | at this point that's going to be an icehouse-1 target | 21:53 |
| mlavalle | mtreinish: cool. I just want to contribute. i'll see what i can do with full tempest with neutron and keep an eye on that bug…. | 21:55 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/elastic-recheck: Add graph script https://review.openstack.org/49410 | 21:55 |
| openstackrecheck | openstack/cinder change: https://review.openstack.org/48528 failed tempest with an unrecognized error | 21:55 |
| *** afazekas_no_irq has quit IRC | 21:57 | |
| openstackrecheck | openstack/keystone change: https://review.openstack.org/49273 failed tempest with an unrecognized error | 21:59 |
| openstackgerrit | Matt Riedemann proposed a change to openstack/tempest: Handle test_list_servers_by_changes_since without tenant isolation https://review.openstack.org/49447 | 22:03 |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Add graph script https://review.openstack.org/49410 | 22:03 |
| mriedem | woohoo two tempest patches in one day | 22:03 |
| openstackrecheck | openstack/heat change: https://review.openstack.org/49435 failed tempest because of: https://bugs.launchpad.net/bugs/1226337 | 22:07 |
| *** mriedem has quit IRC | 22:15 | |
| openstackgerrit | A change was merged to openstack/tempest: Test cases for V3 Project Actions https://review.openstack.org/41345 | 22:33 |
| *** ko_ has joined #openstack-qa | 22:42 | |
| *** ko_ has left #openstack-qa | 22:42 | |
| *** anteaya has quit IRC | 22:47 | |
| *** fbo is now known as fbo_away | 22:58 | |
| *** anteaya has joined #openstack-qa | 23:00 | |
| *** mlavalle has quit IRC | 23:17 | |
| *** mkollaro has quit IRC | 23:26 | |
| *** rfolco has joined #openstack-qa | 23:30 | |
| *** giulivo has quit IRC | 23:31 | |
| openstackgerrit | A change was merged to openstack/tempest: Add test for admin deleting servers of others https://review.openstack.org/48881 | 23:56 |
| *** rfolco has quit IRC | 23:58 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!