| *** oomichi has quit IRC | 00:00 | |
| lifeless | clarkb: tox is churning away now | 00:00 |
|---|---|---|
| clarkb | lifeless: http://pastie.org/9540391 you should see stuff like that | 00:00 |
| clarkb | the diff appears to be in the dict within the list | 00:00 |
| lifeless | clarkb: thats comparing two lists | 00:00 |
| *** yamahata has quit IRC | 00:01 | |
| lifeless | anyhow, I'll have a poke | 00:01 |
| clarkb | thanks | 00:02 |
| lifeless | we could use a structured matcher to unwrap stuff if it truely is dicts beeing affected by randomhash seeds | 00:02 |
| lifeless | whats up with the tests directory there | 00:03 |
| lifeless | isn't it meant to be in the module ? | 00:03 |
| lifeless | clarkb: this isn't a python problem | 00:04 |
| lifeless | clarkb: that test is comparing a string | 00:04 |
| lifeless | expect_body = '[{"path": "/barney", "value": "miller", ' \ | 00:04 |
| lifeless | '"op": "replace"}]' | 00:04 |
| clarkb | arg wtf bbq | 00:04 |
| clarkb | ok thanks | 00:04 |
| clarkb | I completely missed that | 00:04 |
| lifeless | clarkb: you are welcome :) | 00:04 |
| clarkb | lifeless: one more thing. know a good way to debug segfaulting testr test runners (subunit.run in this case) | 00:06 |
| lifeless | segfaulting! | 00:06 |
| clarkb | lifeless: I am running with testtools now to try and narrow it down but I think the tests are at fault | 00:06 |
| lifeless | gdb | 00:06 |
| clarkb | I was hoping you wouldn't say that | 00:06 |
| clarkb | gdb with python is :( | 00:06 |
| lifeless | it should be :) these days | 00:06 |
| lifeless | good macro support etc | 00:06 |
| clarkb | but don't you need to install all the -dbg packages on debian based distros | 00:07 |
| lifeless | there are two related things | 00:11 |
| lifeless | there's the debug build python interpreter | 00:11 |
| gmann_ | andreaf_: regarding single base class for all tests, i prefer to have separate base class for each kind of tests for example separate base for neutron tests, volume tests, server tests etc. | 00:11 |
| lifeless | and separately there are the detached symbol files for libraries etc | 00:11 |
| lifeless | you need the latter | 00:11 |
| gmann_ | andreaf_: it provides to have clean and separate code for each functionality. Tests which need more than one functionality they can have multiple base class. | 00:12 |
| lifeless | gmann_: you don't need multiple base classes, just use fixtures to combine functionality | 00:13 |
| gmann_ | lifeless: yes that is another better way | 00:14 |
| clarkb | lifeless: http://pastie.org/9540417 looks like it derped trying to exit | 00:23 |
| clarkb | lifeless: so I probably do need the python3.4-dbg package instead? | 00:23 |
| *** Longgeek has quit IRC | 00:26 | |
| lifeless | clarkb: https://docs.python.org/devguide/gdb.html | 00:26 |
| lifeless | clarkb: do you have py-bt as an available command? | 00:27 |
| clarkb | not in my currently running python. I just installed the dbg package and am building a new virtualenv and deps with it | 00:28 |
| clarkb | hrm still no py-bt | 00:28 |
| lifeless | clarkb: so you don't need to rebuild your virtualenv | 00:28 |
| lifeless | clarkb: the python interpreter with --pydebug is incompatible with regular extensions | 00:29 |
| lifeless | clarkb: use regular python3.4 - installing the package is fine | 00:29 |
| *** dmorita has joined #openstack-qa | 00:29 | |
| lifeless | clarkb: it has the debug symbols, but don't use the debug interpreter | 00:29 |
| clarkb | lifeless: ok, just load the symbols onto regular python? | 00:30 |
| lifeless | gdb should do it automatically | 00:30 |
| clarkb | kk will give that a go | 00:30 |
| clarkb | my paste was prior to installing the -dbg package | 00:30 |
| clarkb | hrm no debugging symbols found. probably because I am running out of a virtualenv | 00:31 |
| clarkb | and need to load them manually | 00:31 |
| *** zz_dimtruck is now known as dimtruck | 00:31 | |
| lifeless | binary path may be wrong yes | 00:32 |
| lifeless | since virtualenv is evil like that | 00:32 |
| clarkb | ya | 00:33 |
| clarkb | lifeless: if I load the symbols from /usr/bin/python3.4-dbg it dies on a SIGPIPE broken pipe | 00:39 |
| clarkb | I assume that is the wrong way to get my symbols? | 00:39 |
| lifeless | uhm | 00:40 |
| lifeless | not necessarily | 00:40 |
| lifeless | are there child processes? | 00:40 |
| clarkb | I did run gdb with --args .tox/py34/bin/python -m testtools.run discover -t ./ . | 00:41 |
| clarkb | and __libc_send is complaining. Perhaps I need to load then run? | 00:41 |
| lifeless | no | 00:42 |
| lifeless | that works for me | 00:42 |
| lifeless | gdb run --args .tox/py34/bin/python -m testtools.run discover -t ./ . | 00:42 |
| lifeless | r | 00:42 |
| clarkb | lifeless: did you load `symbol-file /usr/bin/python3.4-dbg` first? | 00:43 |
| lifeless | btw the macros are in /usr/lib/debug/usr/bin/python3.4m-gdb.py | 00:43 |
| clarkb | your steps above is how I got the bt that I pasted | 00:43 |
| lifeless | clarkb: thats the debug interpreter, stop touching it | 00:43 |
| clarkb | lifeless: where do I get my symbols then? | 00:43 |
| lifeless | clarkb: its fundamentally different | 00:43 |
| lifeless | /usr/lib/debug/usr/lib/python3.4 | 00:43 |
| clarkb | lifeless: yes ok but I haven o symbols | 00:43 |
| lifeless | and | 00:43 |
| lifeless | /usr/lib/debug/usr/lib/x86_64-linux-gnu/libpython3.4m.so.1.0 | 00:44 |
| lifeless | clarkb: gdb run --symbols /usr/lib/debug/usr/lib/x86_64-linux-gnu/libpython3.4m.so.1.0 --args .tox/py34/bin/python -m testtools.run discover -t ./ . | 00:44 |
| lifeless | r | 00:44 |
| lifeless | runs the test suite ok for me | 00:45 |
| clarkb | it does for me if I don't load any symbols. Loading those above is same thing | 00:45 |
| clarkb | I started a fresh gdb too | 00:45 |
| lifeless | with --symbols - I'm giving it the symbols file | 00:46 |
| lifeless | for the same python, not the debug build | 00:46 |
| clarkb | ya the paths you have above | 00:46 |
| * clarkb tries that instead of loading interactively | 00:46 | |
| *** yjiang5 has quit IRC | 00:46 | |
| *** wendar has quit IRC | 00:47 | |
| clarkb | nope same thing | 00:47 |
| lifeless | SIGPIPE may just be reflective of you encountering a sigpipe | 00:47 |
| *** wendar has joined #openstack-qa | 00:47 | |
| lifeless | which is why I asked about child processes | 00:47 |
| *** dimtruck has quit IRC | 00:47 | |
| lifeless | see http://www.chiark.greenend.org.uk/ucgi/~cjwatson/blosxom/2009-07-02-python-sigpipe.html | 00:48 |
| clarkb | I am running the same command as you | 00:48 |
| clarkb | or are you doing it in a different repo | 00:48 |
| lifeless | right, but I'm likely running a different test suite | 00:48 |
| lifeless | as you haven't told me what one is breaking | 00:48 |
| clarkb | oh I thought I did that sorry. oslo.messaging | 00:48 |
| lifeless | try setting sigpipe to ignored anyhow | 00:49 |
| *** dimtruck has joined #openstack-qa | 00:49 | |
| clarkb | arg I was in a bad repo too. rootwrap was sigpiping of course | 00:50 |
| clarkb | because its rootwrap | 00:50 |
| *** yamahata has joined #openstack-qa | 00:54 | |
| clarkb | and this time it exited normally | 00:58 |
| *** torandu has quit IRC | 01:01 | |
| *** markmcclain has quit IRC | 01:04 | |
| lifeless | you may need to run it a number of times | 01:04 |
| lifeless | its a gc race | 01:04 |
| lifeless | with a __del__ probably | 01:04 |
| *** suneelb has quit IRC | 01:05 | |
| lifeless | make sure you're using the regular interpreter | 01:05 |
| clarkb | yup I am using regular interpreter now. and I figured it was so I started it again | 01:06 |
| clarkb | I don't think it is finding the -gdb.py file though so no py-bt yet | 01:06 |
| clarkb | probably need to load that directly too for the same raisins | 01:06 |
| clarkb | but one thing at a time | 01:06 |
| *** dims_ has joined #openstack-qa | 01:14 | |
| openstackgerrit | Emilien Macchi proposed a change to openstack-dev/grenade: grenade.sh: destroy javelin resources by the end https://review.openstack.org/120295 | 01:15 |
| *** gmann_ has quit IRC | 01:18 | |
| openstackgerrit | A change was merged to openstack-dev/devstack: Initialize metadata definitions catalog https://review.openstack.org/110955 | 01:18 |
| clarkb | ok I can get it to sigsegv regularly without loading symbols | 01:23 |
| *** gmann has quit IRC | 01:23 | |
| clarkb | now to try a lot more with symbols | 01:23 |
| *** gmann has joined #openstack-qa | 01:25 | |
| *** amotoki has joined #openstack-qa | 01:33 | |
| *** oomichi has joined #openstack-qa | 01:35 | |
| *** amotoki has quit IRC | 01:37 | |
| *** mattoliverau has quit IRC | 01:49 | |
| *** mattoliverau has joined #openstack-qa | 01:50 | |
| *** aimon has quit IRC | 01:51 | |
| *** nosnos has joined #openstack-qa | 01:54 | |
| *** jyuso has joined #openstack-qa | 02:16 | |
| *** aimon has joined #openstack-qa | 02:19 | |
| *** harlowja is now known as harlowja_away | 02:25 | |
| *** pcrews has quit IRC | 02:36 | |
| *** arnaud__ has joined #openstack-qa | 02:40 | |
| *** Poornima has joined #openstack-qa | 02:47 | |
| *** adalbas has quit IRC | 02:48 | |
| *** jpich has quit IRC | 02:52 | |
| *** jpich has joined #openstack-qa | 02:59 | |
| *** dims_ has quit IRC | 03:01 | |
| *** dims_ has joined #openstack-qa | 03:01 | |
| *** yjiang5 has joined #openstack-qa | 03:05 | |
| *** dimtruck is now known as zz_dimtruck | 03:05 | |
| *** saurabh_ has joined #openstack-qa | 03:11 | |
| *** saurabh_ has quit IRC | 03:11 | |
| *** saurabh_ has joined #openstack-qa | 03:11 | |
| *** saurabh_ has joined #openstack-qa | 03:11 | |
| *** dims_ has quit IRC | 03:14 | |
| *** dims_ has joined #openstack-qa | 03:15 | |
| *** rfolco has quit IRC | 03:16 | |
| *** dims_ has quit IRC | 03:19 | |
| *** weshay has quit IRC | 03:25 | |
| *** amotoki has joined #openstack-qa | 03:34 | |
| *** SridharG has joined #openstack-qa | 03:36 | |
| *** amotoki has quit IRC | 03:38 | |
| Santosh | afazekas: I have resolved the issue by upgrading dnsmasq version to 2.63 | 03:46 |
| *** SridharG has left #openstack-qa | 03:50 | |
| *** saurabh_ has quit IRC | 04:10 | |
| *** melwitt has joined #openstack-qa | 04:35 | |
| *** arnaud__ has quit IRC | 04:35 | |
| *** yamahata has quit IRC | 04:37 | |
| *** arnaud__ has joined #openstack-qa | 04:42 | |
| *** melwitt has quit IRC | 04:43 | |
| *** Poornima has quit IRC | 04:45 | |
| *** cmyster has quit IRC | 04:46 | |
| *** ajo_ has joined #openstack-qa | 04:48 | |
| openstackgerrit | Masayuki Igawa proposed a change to openstack/tempest: Migrate test_encrypted_cinder_volumes to tempest client https://review.openstack.org/111905 | 04:50 |
| *** saurabh_ has joined #openstack-qa | 04:54 | |
| *** saurabh_ has quit IRC | 04:54 | |
| *** saurabh_ has joined #openstack-qa | 04:54 | |
| *** saurabh_ has joined #openstack-qa | 04:54 | |
| *** carl_baldwin has joined #openstack-qa | 04:55 | |
| openstackgerrit | Masayuki Igawa proposed a change to openstack/tempest: Migrate test_encrypted_cinder_volumes to tempest client https://review.openstack.org/111905 | 04:59 |
| *** saurabh_ has quit IRC | 05:08 | |
| *** rdekel has joined #openstack-qa | 05:11 | |
| *** amotoki has joined #openstack-qa | 05:11 | |
| *** arnaud__ has quit IRC | 05:14 | |
| *** arnaud__ has joined #openstack-qa | 05:15 | |
| *** Poornima has joined #openstack-qa | 05:16 | |
| *** carl_baldwin has quit IRC | 05:21 | |
| *** afazekas_ has joined #openstack-qa | 05:27 | |
| *** chandankumar has joined #openstack-qa | 05:27 | |
| *** cmyster has joined #openstack-qa | 05:27 | |
| *** cmyster has quit IRC | 05:27 | |
| *** cmyster has joined #openstack-qa | 05:27 | |
| *** arnaud__ has quit IRC | 05:32 | |
| *** amotoki_ has joined #openstack-qa | 05:34 | |
| *** ajo_ has quit IRC | 05:38 | |
| *** yfried__ has joined #openstack-qa | 05:38 | |
| *** amotoki_ has quit IRC | 05:40 | |
| *** k4n0 has joined #openstack-qa | 05:45 | |
| *** Santosh has quit IRC | 05:51 | |
| *** SridharG has joined #openstack-qa | 05:54 | |
| *** saurabh_ has joined #openstack-qa | 06:00 | |
| *** saurabh_ has quit IRC | 06:00 | |
| *** saurabh_ has joined #openstack-qa | 06:00 | |
| *** saurabh_ has joined #openstack-qa | 06:00 | |
| *** Madan has joined #openstack-qa | 06:01 | |
| *** arnaud__ has joined #openstack-qa | 06:03 | |
| *** rdekel has quit IRC | 06:10 | |
| *** yjiang5 has quit IRC | 06:14 | |
| *** bkopilov has quit IRC | 06:14 | |
| *** bkopilov has joined #openstack-qa | 06:15 | |
| *** bkopilov has quit IRC | 06:15 | |
| *** bkopilov_wfh has joined #openstack-qa | 06:15 | |
| *** bkopilov_wfh has quit IRC | 06:16 | |
| *** sc68cal has quit IRC | 06:22 | |
| *** neeti has joined #openstack-qa | 06:23 | |
| openstackgerrit | Masayuki Igawa proposed a change to openstack/tempest-lib: Remove a duplicate ignore rule of pep8 https://review.openstack.org/120321 | 06:23 |
| *** rdekel has joined #openstack-qa | 06:24 | |
| *** sc68cal has joined #openstack-qa | 06:25 | |
| *** flaper87|afk is now known as flaper87 | 06:34 | |
| *** rdekel has quit IRC | 06:36 | |
| *** bkopilov has joined #openstack-qa | 06:38 | |
| *** gszasz has joined #openstack-qa | 06:38 | |
| *** pkoniszewski has joined #openstack-qa | 06:40 | |
| *** nmagnezi has joined #openstack-qa | 06:43 | |
| yfried__ | andreaf_: ping | 06:48 |
| *** gfidente has joined #openstack-qa | 07:06 | |
| *** k4n0 has quit IRC | 07:07 | |
| *** jpich has quit IRC | 07:07 | |
| *** safchain has joined #openstack-qa | 07:12 | |
| *** dmellado has joined #openstack-qa | 07:19 | |
| yfried__ | masayukig: posted a question for you https://review.openstack.org/#/c/117714/7 | 07:20 |
| *** luqas has joined #openstack-qa | 07:20 | |
| masayukig | yfried__: looking | 07:21 |
| *** k4n0 has joined #openstack-qa | 07:21 | |
| *** jordanP has joined #openstack-qa | 07:21 | |
| yfried__ | bkopilov: ping | 07:22 |
| bkopilov | yfried__, reply | 07:22 |
| yfried__ | bkopilov: https://review.openstack.org/#/c/119611/ this should have a rebase button (left side next to Abandon and Cherry Pick) press it to retrigger CI and loose the bad review from Citrix | 07:24 |
| bkopilov | yfried__, ok thanks a lot | 07:24 |
| openstackgerrit | Benny Kopilov proposed a change to openstack/tempest: Glance Negative - chanage image owner https://review.openstack.org/119611 | 07:26 |
| *** luqas has quit IRC | 07:26 | |
| *** luqas has joined #openstack-qa | 07:27 | |
| mkoderer | afazekas: do you know why we add resource cleanups, manually terminate the resources and then remove from cleanup in boto test? | 07:28 |
| mkoderer | like https://github.com/openstack/tempest/blob/master/tempest/thirdparty/boto/test_ec2_instance_run.py#L193 | 07:28 |
| *** arnaud__ has quit IRC | 07:28 | |
| mkoderer | afazekas_: ^ | 07:28 |
| openstackgerrit | OpenStack Proposal Bot proposed a change to openstack/tempest: Updated from global requirements https://review.openstack.org/110110 | 07:32 |
| *** yfried has joined #openstack-qa | 07:35 | |
| *** yfried has quit IRC | 07:35 | |
| *** yfried__ has quit IRC | 07:35 | |
| *** amotoki_ has joined #openstack-qa | 07:35 | |
| *** yfried has joined #openstack-qa | 07:35 | |
| afazekas_ | mkoderer: this termination should be used only if the test code itself already deleted the resource | 07:37 |
| *** jlanoux has joined #openstack-qa | 07:38 | |
| *** amotoki_ has quit IRC | 07:40 | |
| afazekas_ | mkoderer: the resource registered for deletion for handling the error case, the cleanup methods expected to be strict and cry if there is nothing to delete | 07:40 |
| masayukig | yfried__: maybe, you're right. | 07:41 |
| afazekas_ | mkoderer: BTW: an explicit wait for termination should be added before that line | 07:42 |
| *** jlibosva has joined #openstack-qa | 07:43 | |
| masayukig | yfried__: This should be 'exceptions.NotFound'. I'll fix it. Thanks. | 07:43 |
| *** ajo_ has joined #openstack-qa | 07:44 | |
| *** Albert has joined #openstack-qa | 07:48 | |
| *** evgenyf has joined #openstack-qa | 07:48 | |
| mkoderer | afazekas_: ok the "wait" is missing everywhere and there also: https://review.openstack.org/#/c/115944/7 | 07:53 |
| *** yfried has quit IRC | 07:54 | |
| *** qba73 has joined #openstack-qa | 07:54 | |
| openstackgerrit | Masayuki Igawa proposed a change to openstack/tempest: Migrate test_server_cfn_init to tempest clients https://review.openstack.org/117714 | 07:55 |
| afazekas_ | https://review.openstack.org/#/c/119292/ I wonder is it related to a missing wait | 07:55 |
| openstackgerrit | Masayuki Igawa proposed a change to openstack/tempest: Migrate test_server_cfn_init to tempest clients https://review.openstack.org/117714 | 07:56 |
| *** yfried has joined #openstack-qa | 07:57 | |
| *** e0ne has joined #openstack-qa | 08:00 | |
| *** e0ne has quit IRC | 08:04 | |
| *** evgenyf has quit IRC | 08:18 | |
| openstackgerrit | Ravikumar Venkatesan proposed a change to openstack/tempest: test_tokens_nocatalog to identity v3 test_tokens https://review.openstack.org/93172 | 08:19 |
| *** cnesa10 has joined #openstack-qa | 08:21 | |
| *** evgenyf has joined #openstack-qa | 08:38 | |
| *** yfried has quit IRC | 08:47 | |
| *** e0ne has joined #openstack-qa | 08:49 | |
| *** luqas has quit IRC | 08:53 | |
| *** zz_johnthetubagu is now known as johnthetubaguy | 08:55 | |
| *** neeti has quit IRC | 08:56 | |
| *** neeti has joined #openstack-qa | 08:56 | |
| *** jyuso has quit IRC | 08:58 | |
| *** qba73 has quit IRC | 09:06 | |
| *** qba73 has joined #openstack-qa | 09:06 | |
| openstackgerrit | Swapnil Kulkarni proposed a change to openstack-dev/devstack: Update multiple backend names in tempest configuration https://review.openstack.org/120351 | 09:06 |
| openstackgerrit | A change was merged to openstack-dev/devstack: Fix regression in Cinder volume type creation https://review.openstack.org/117522 | 09:17 |
| openstackgerrit | Chris Dent proposed a change to openstack-dev/devstack: Replace screen_it() with run_process() throughout https://review.openstack.org/120077 | 09:20 |
| *** akuznetsova has quit IRC | 09:21 | |
| *** luqas has joined #openstack-qa | 09:21 | |
| *** evgenyf has quit IRC | 09:22 | |
| *** akuznetsova has joined #openstack-qa | 09:23 | |
| *** akuznetsova has quit IRC | 09:25 | |
| *** e0ne has quit IRC | 09:27 | |
| *** e0ne has joined #openstack-qa | 09:28 | |
| *** marun has joined #openstack-qa | 09:31 | |
| *** akuznetsova has joined #openstack-qa | 09:33 | |
| *** cdent has joined #openstack-qa | 09:34 | |
| *** amotoki_ has joined #openstack-qa | 09:36 | |
| *** amotoki_ has quit IRC | 09:41 | |
| *** qba73 has quit IRC | 09:41 | |
| *** nosnos has quit IRC | 09:41 | |
| *** nosnos has joined #openstack-qa | 09:42 | |
| *** qba73 has joined #openstack-qa | 09:46 | |
| *** aix has quit IRC | 09:47 | |
| *** nosnos has quit IRC | 09:47 | |
| *** sergeysh has joined #openstack-qa | 09:47 | |
| *** Qarekhani has joined #openstack-qa | 09:50 | |
| Qarekhani | hi | 09:51 |
| Qarekhani | can anyone help me ... | 09:52 |
| *** evgenyf has joined #openstack-qa | 09:53 | |
| *** Longgeek has joined #openstack-qa | 09:59 | |
| *** marun has quit IRC | 10:05 | |
| *** marun has joined #openstack-qa | 10:06 | |
| Qarekhani | "libvirtError: operation failed: filter 'nova-no-nd-reflection' already exists with uuid 89637f16-774a-4b8c-857b-08819c6fcf41" nova-compute . any idea ??? | 10:10 |
| *** yfried has joined #openstack-qa | 10:13 | |
| yfried | masayukig: still here? | 10:15 |
| *** marun has quit IRC | 10:16 | |
| *** cnesa10 has quit IRC | 10:18 | |
| masayukig | yfried: yeah, but I'll leave soon, though.. | 10:20 |
| yfried | masayukig: the stack_delete method is no longer needed. it's now doing the same thing as delete_wrapper. | 10:21 |
| *** aix has joined #openstack-qa | 10:21 | |
| openstackgerrit | Yair Fried proposed a change to openstack/tempest: Migrate advanced server network to tempest clients https://review.openstack.org/113124 | 10:22 |
| *** mkollaro has joined #openstack-qa | 10:24 | |
| *** cnesa9 has joined #openstack-qa | 10:24 | |
| masayukig | yfried: hmm, ok. I'll check it. Thanks:) | 10:26 |
| *** evgenyf has quit IRC | 10:29 | |
| *** evgenyf has joined #openstack-qa | 10:30 | |
| *** mdenny has quit IRC | 10:36 | |
| openstackgerrit | Yair Fried proposed a change to openstack/tempest: Adds status check for FloatingIP in scenarios https://review.openstack.org/102700 | 10:40 |
| coolsvap | yfried, seems the https://review.openstack.org/#/c/117621/ has failed merge, should we add a recheck? | 10:46 |
| *** cnesa9 has quit IRC | 10:46 | |
| *** asselin has quit IRC | 10:46 | |
| *** cnesa9 has joined #openstack-qa | 10:51 | |
| *** cnesa9 has quit IRC | 10:52 | |
| *** cnesa9 has joined #openstack-qa | 10:53 | |
| *** dims_ has joined #openstack-qa | 10:57 | |
| *** dmorita has quit IRC | 11:00 | |
| oomichi | coolsvap: "recheck" maybe work for it. | 11:01 |
| *** Poornima has quit IRC | 11:02 | |
| coolsvap | oomichi, thanks done | 11:02 |
| oomichi | coolsvap: nice :-) | 11:03 |
| *** gmann has quit IRC | 11:06 | |
| *** gmann has joined #openstack-qa | 11:12 | |
| *** Longgeek_ has joined #openstack-qa | 11:14 | |
| *** Longgeek has quit IRC | 11:18 | |
| *** zz_dimtruck is now known as dimtruck | 11:19 | |
| *** neeti has quit IRC | 11:20 | |
| *** dims_ has quit IRC | 11:21 | |
| *** dims_ has joined #openstack-qa | 11:21 | |
| *** dims__ has joined #openstack-qa | 11:22 | |
| coolsvap | oomichi, would you like to review a small devstack fix? | 11:23 |
| oomichi | coolsvap: I can do it, can you show the URL? | 11:24 |
| coolsvap | oomichi, thanks i just wanted to confirm first https://review.openstack.org/#/c/120351/ | 11:25 |
| *** dims_ has quit IRC | 11:25 | |
| *** Poornima has joined #openstack-qa | 11:26 | |
| openstackgerrit | Chris Dent proposed a change to openstack-dev/devstack: Replace screen_it() with run_process() throughout https://review.openstack.org/120077 | 11:29 |
| *** dimtruck is now known as zz_dimtruck | 11:37 | |
| *** amotoki_ has joined #openstack-qa | 11:37 | |
| *** mwagner_lap has quit IRC | 11:38 | |
| oomichi | coolsvap: done, but I'm not devstack-core. so I cannot +2 for it. | 11:39 |
| coolsvap | oomichi, thanks! | 11:39 |
| *** adalbas has joined #openstack-qa | 11:39 | |
| *** zz_dimtruck is now known as dimtruck | 11:40 | |
| *** amotoki_ has quit IRC | 11:41 | |
| openstackgerrit | Chris Dent proposed a change to openstack/tempest: Make SwiftScenarioTest methods public https://review.openstack.org/120385 | 11:43 |
| openstackgerrit | afazekas proposed a change to openstack/tempest: Have the EC2 instance test to wait for termination https://review.openstack.org/120386 | 11:44 |
| afazekas_ | ianw: ^ | 11:45 |
| *** ajo_ has quit IRC | 11:46 | |
| afazekas_ | mkoderer: ^ | 11:47 |
| openstackgerrit | Ken'ichi Ohmichi proposed a change to openstack-dev/devstack: Fix the warning message of CINDER_MULTI_LVM_BACKEND https://review.openstack.org/120389 | 11:49 |
| *** luqas has quit IRC | 11:49 | |
| yfried | cmyster: tempest has image uuid in conf. I think it also has image name somewhere, but the best thing to do (if possible) is to retrieve the name on runtime using image uuid | 11:54 |
| cmyster | yfried: so I still need to know something about an image before hand ? | 11:54 |
| yfried | coolsvap: make sure it's not a rebase issue. it that case - recheck won't help | 11:55 |
| yfried | cmyster: just take the uuid from tempest.conf what else do you need to know? | 11:56 |
| cmyster | actually, nothing... if its always there and IIRC it always is. | 11:56 |
| cmyster | thanks | 11:56 |
| *** cmyster is now known as cmyster_away | 11:56 | |
| openstackgerrit | A change was merged to openstack-dev/devstack: Run processes without screen https://review.openstack.org/117339 | 12:00 |
| *** rfolco has joined #openstack-qa | 12:03 | |
| *** mmedvede has joined #openstack-qa | 12:12 | |
| openstackgerrit | Phil Day proposed a change to openstack/tempest: Allow new quota types https://review.openstack.org/120395 | 12:13 |
| *** dkranz has joined #openstack-qa | 12:21 | |
| *** weshay has joined #openstack-qa | 12:27 | |
| *** aysyd has joined #openstack-qa | 12:27 | |
| *** dimtruck is now known as zz_dimtruck | 12:29 | |
| *** dims__ has quit IRC | 12:34 | |
| *** dims_ has joined #openstack-qa | 12:35 | |
| *** mwagner_lap has joined #openstack-qa | 12:37 | |
| *** dims_ has quit IRC | 12:38 | |
| *** dims_ has joined #openstack-qa | 12:38 | |
| openstackgerrit | Phil Day proposed a change to openstack/tempest: Allow new quota types https://review.openstack.org/120395 | 12:39 |
| yfried | dkranz: ping | 12:39 |
| dkranz | Hi | 12:39 |
| *** Qarekhani has quit IRC | 12:40 | |
| openstackgerrit | Rohan Kanade proposed a change to openstack/tempest: Add subnet tests for extra attributes https://review.openstack.org/106326 | 12:40 |
| *** zz_dimtruck is now known as dimtruck | 12:40 | |
| openstackgerrit | A change was merged to openstack-dev/grenade: Add Ironic sideways migration testing https://review.openstack.org/111859 | 12:41 |
| *** mwagner_lap has quit IRC | 12:41 | |
| *** mwagner_lap has joined #openstack-qa | 12:41 | |
| *** oomichi has quit IRC | 12:54 | |
| *** yfried has quit IRC | 12:57 | |
| *** Madan has quit IRC | 12:58 | |
| *** afazekas_ has quit IRC | 13:01 | |
| *** aix has quit IRC | 13:02 | |
| cdent | dtroyer, sdague I'm struggling to determine if the failures on https://review.openstack.org/#/c/120077/ have anything to do with its changes | 13:03 |
| *** aix has joined #openstack-qa | 13:04 | |
| sdague | cdent: http://logs.openstack.org/77/120077/5/check/gate-tempest-dsvm-large-ops/9d17c15/logs/screen-n-cpu.txt.gz | 13:07 |
| *** luqas has joined #openstack-qa | 13:08 | |
| cdent | oh buggery | 13:08 |
| cdent | thanks | 13:08 |
| cdent | I know what's causing that | 13:08 |
| *** mpavlase has joined #openstack-qa | 13:08 | |
| sdague | yeh, I think you lost some quotes | 13:08 |
| cdent | there's been several changes around that area because the sg call wants quotes, but so does setsid | 13:10 |
| * cdent pokes | 13:11 | |
| cdent | run_process doesn't like shell redirections | 13:11 |
| openstackgerrit | Emily Hugenbruch proposed a change to openstack/tempest: Remove extra tenant_isolation parameter from config file https://review.openstack.org/120245 | 13:12 |
| *** dustins has joined #openstack-qa | 13:13 | |
| *** mriedem has joined #openstack-qa | 13:16 | |
| *** afazekas_ has joined #openstack-qa | 13:16 | |
| *** amotoki has quit IRC | 13:21 | |
| *** dkranz has quit IRC | 13:24 | |
| *** sabeen1 has quit IRC | 13:26 | |
| openstackgerrit | A change was merged to openstack-dev/devstack: Set flavor id for Ironic's baremetal flavor https://review.openstack.org/107814 | 13:31 |
| *** dkranz has joined #openstack-qa | 13:37 | |
| *** torandu has joined #openstack-qa | 13:38 | |
| *** amotoki has joined #openstack-qa | 13:38 | |
| *** markmcclain has joined #openstack-qa | 13:40 | |
| *** markmcclain has quit IRC | 13:40 | |
| *** markmcclain has joined #openstack-qa | 13:41 | |
| *** amotoki has quit IRC | 13:43 | |
| mtreinish | jogo: yeah, that means during that period almost all of the cpu usage was waiting for io... | 13:46 |
| EmilienM | sdague: fyi: https://bugs.launchpad.net/tempest/+bug/1367762 (I'm on it) | 13:49 |
| *** dimtruck is now known as zz_dimtruck | 13:49 | |
| sdague | EmilienM: cool, thanks! | 13:49 |
| *** yamahata has joined #openstack-qa | 13:53 | |
| *** Longgeek_ has quit IRC | 13:56 | |
| openstackgerrit | Emilien Macchi proposed a change to openstack/tempest: javelin: fix object destruction https://review.openstack.org/120425 | 13:57 |
| EmilienM | sdague: ^ | 13:57 |
| EmilienM | sdague: an error of mine when I pushed "destroy" code | 13:58 |
| *** adalbas has quit IRC | 14:01 | |
| sdague | thanks | 14:02 |
| *** dustins_ has joined #openstack-qa | 14:03 | |
| *** dustins has quit IRC | 14:03 | |
| cdent | dtroyer: you around? I have a question about output redirection in _run_process of functions-common | 14:04 |
| dtroyer | cdent: yup | 14:05 |
| cdent | there's a line exec 1>/path/to/current-timestamp/log | 14:05 |
| cdent | in lib/nova if using the fake driver and setting up multiple fake nodes | 14:05 |
| cdent | it will try to write to the same log file | 14:06 |
| cdent | and do some clobbering | 14:06 |
| cdent | do you think it is safe to do 1>> for that line? | 14:06 |
| cdent | or is some other option required | 14:06 |
| dtroyer | hmmm…that may have been happening for some time, maybe | 14:07 |
| cdent | >> won't work with & | 14:07 |
| cdent | feh | 14:07 |
| cdent | so something else | 14:07 |
| cdent | I'm happy to leave the bug in place as is | 14:08 |
| cdent | (for another time) | 14:08 |
| *** torandu has quit IRC | 14:08 | |
| cdent | but thought I'd give it a shot | 14:08 |
| dtroyer | that's a side problem that I think we can actually work around by fixing your root issue | 14:08 |
| *** rbak has joined #openstack-qa | 14:08 | |
| *** afazekas_ has quit IRC | 14:08 | |
| cdent | dtroyer: ? | 14:09 |
| *** torandu has joined #openstack-qa | 14:09 | |
| cdent | is it okay do use a different service name? n-cpu-1 n-cpu-2 etc? | 14:09 |
| dtroyer | the process redirection in the run_process() call in start_nova_compute() looks like it is a problem too | 14:09 |
| cdent | i've already fixed that | 14:10 |
| dtroyer | it would be if run_process() knew how to match them | 14:10 |
| dtroyer | ok, cool | 14:10 |
| cdent | it's in the testing of the fix that I discovered this new problem | 14:10 |
| *** jecarey has joined #openstack-qa | 14:10 | |
| *** Longgeek has joined #openstack-qa | 14:11 | |
| dtroyer | so we either remove the unique service name assumption (the current problem) or skip the is_service_enabled() check | 14:11 |
| *** rbak_ has joined #openstack-qa | 14:12 | |
| *** atiwari has joined #openstack-qa | 14:12 | |
| dtroyer | I don't like appending to the log as it'll interleave them and be a pain to use | 14:12 |
| cdent | yes | 14:12 |
| *** rbak has quit IRC | 14:13 | |
| cdent | there's this: [[ ${service} == n-cell-* && ${ENABLED_SERVICES} =~ "n-cell" ]] && enabled=0 | 14:13 |
| dtroyer | wait, if CURRENT_LOG_TIME was actually updated they would be unique, then it reduces to just identifying which is which. but hanving the timestamp on all the logs be the same is handy in a dir full of them | 14:13 |
| cdent | add a n-cpu-* and it ought to be okay | 14:13 |
| dtroyer | I'm looking for a general solution first, but we may fall back to something like that | 14:14 |
| *** pcrews has joined #openstack-qa | 14:15 | |
| cdent | the granularity on CURRENT_LOG_TIME is only seconds, which is probably not enough | 14:15 |
| cdent | (even if it updated) | 14:15 |
| dtroyer | ok, so try this | 14:15 |
| dtroyer | in lib/nova is_nova_enabled() add a check for n-cpu-* before the return 1 line. n-cell is a special case and eventually needs to be resolved | 14:16 |
| dtroyer | wait... | 14:17 |
| cdent | I think it has to be done in the is_service_enabled, no? | 14:17 |
| dtroyer | I'm trying to remove all of the special-cases in is_service_enabled() | 14:18 |
| cdent | we're not checking for nova, we're checking for n-cpu | 14:18 |
| cdent | I know :) | 14:18 |
| dtroyer | and move the nova ones into lib/nova for example | 14:18 |
| dtroyer | so... | 14:18 |
| openstackgerrit | Rob Crittenden proposed a change to openstack-dev/devstack: Configure endpoints to use SSL natively or via proxy https://review.openstack.org/98854 | 14:19 |
| dtroyer | yeah, dammit, it's been to long since I thought about this, you may be right, we can't do wildcards by checking function names... | 14:19 |
| cdent | gyres within gyres | 14:20 |
| cdent | should I put the hack in and leave a note? | 14:20 |
| cdent | brb | 14:20 |
| dtroyer | yeah, do that. this is the same problem as n-cell and is different than the project name tests there. | 14:24 |
| * cdent is back | 14:25 | |
| cdent | my step-daughter has just left for uni, had to send her off properly | 14:25 |
| cdent | Okay, dtroyer, I'll make it so | 14:25 |
| dtroyer | I suspect long-term we'll need to invent what amounts to array syntax for the service names… n-cpu:1 (something shell-safe). I'll add that to the service rename list | 14:28 |
| dtroyer | thanks cdent | 14:28 |
| *** pkoniszewski has quit IRC | 14:28 | |
| *** zz_jgrimm is now known as jgrimm | 14:28 | |
| cdent | I have the sense that if I stray to long in devstack I'll never come out | 14:28 |
| dtroyer | I've been here since its third week ;) nearly 3 years now | 14:29 |
| *** rwsu has joined #openstack-qa | 14:30 | |
| *** mpaolino has joined #openstack-qa | 14:30 | |
| *** atiwari has quit IRC | 14:30 | |
| *** gszasz has quit IRC | 14:31 | |
| *** Longgeek has quit IRC | 14:34 | |
| openstackgerrit | Chris Dent proposed a change to openstack-dev/devstack: Replace screen_it() with run_process() throughout https://review.openstack.org/120077 | 14:38 |
| *** dhellmann is now known as dhellmann_ | 14:39 | |
| *** dhellmann_ is now known as dhellmann | 14:40 | |
| *** carl_baldwin has joined #openstack-qa | 14:41 | |
| *** carl_baldwin has left #openstack-qa | 14:42 | |
| *** Longgeek has joined #openstack-qa | 14:42 | |
| *** mpaolino has quit IRC | 14:43 | |
| *** jgrimm is now known as zz_jgrimm | 14:47 | |
| *** rwsu has quit IRC | 14:48 | |
| *** Longgeek has quit IRC | 14:49 | |
| *** hemna_ is now known as hemna | 14:49 | |
| openstackgerrit | Swapnil Kulkarni proposed a change to openstack-dev/devstack: Update multiple backend names in tempest configuration https://review.openstack.org/120351 | 14:53 |
| *** marun has joined #openstack-qa | 14:54 | |
| *** zz_dimtruck is now known as dimtruck | 14:55 | |
| *** dkranz has quit IRC | 15:07 | |
| *** morganfainberg is now known as morgan | 15:12 | |
| *** morgan is now known as Morgan | 15:13 | |
| openstackgerrit | Ken Giusti proposed a change to openstack-dev/devstack: Add an option to enable version 1.0 of the AMQP messaging protocol https://review.openstack.org/109118 | 15:14 |
| *** Sukhdev has joined #openstack-qa | 15:14 | |
| *** SridharG has left #openstack-qa | 15:14 | |
| *** Morgan is now known as morgan | 15:15 | |
| *** aix has quit IRC | 15:17 | |
| *** dkranz has joined #openstack-qa | 15:21 | |
| *** mmedvede has quit IRC | 15:22 | |
| *** Sukhdev has quit IRC | 15:23 | |
| *** Sukhdev has joined #openstack-qa | 15:24 | |
| *** [1]evgenyf has joined #openstack-qa | 15:27 | |
| *** marun has quit IRC | 15:27 | |
| sdague | dkranz: so I'm seeing a number of launchpad bugs which seem to be RDO bugs copy and pasted up | 15:27 |
| sdague | https://bugs.launchpad.net/nova/+bug/1280389 being an example | 15:27 |
| dkranz | sdague: just a sec | 15:27 |
| dkranz | sdague: ok | 15:28 |
| sdague | and I'm mostly trying to figure out the flow here, because it would be one thing if the redhat folks were working these bugs upstream, but they mostly seem to be QA folks triaging RDO things, and then lots of duplicate / split conversations in 2 trackers, which doesn't help anyone. | 15:29 |
| sdague | I don't have a solution, but it's a common pattern I've seen in trying to triage nova bugs | 15:29 |
| *** evgenyf has quit IRC | 15:29 | |
| *** [1]evgenyf is now known as evgenyf | 15:29 | |
| dkranz | sdague: I will find out what the intent is | 15:29 |
| sdague | and was curious what your thoughts are | 15:29 |
| *** cbader has joined #openstack-qa | 15:30 | |
| *** aix has joined #openstack-qa | 15:30 | |
| dkranz | I'm in a meeting now but will get back on this in a few hours | 15:30 |
| sdague | sure, no prob | 15:30 |
| sdague | thanks for looking at it | 15:30 |
| *** chandankumar has quit IRC | 15:33 | |
| *** mauricioliima has joined #openstack-qa | 15:33 | |
| dkranz | jhenner: ^^^ | 15:33 |
| jhenner | dkranz: which line I should start reading from? | 15:34 |
| *** k4n0 has quit IRC | 15:34 | |
| dkranz | jhenner: 11:27 | 15:34 |
| *** Sukhdev has quit IRC | 15:34 | |
| mauricioliima | Hello, Somebody know why this error "NameError: name 'stresstest' is not defined" happen? | 15:35 |
| *** Poornima has quit IRC | 15:35 | |
| jhenner | dkranz: I am not sure how can i help there | 15:36 |
| mauricioliima | I'm trying run stress test on object_storage | 15:36 |
| mauricioliima | I'm using tempest server | 15:36 |
| jhenner | dkranz: sdague: I am not sure about all the reasons, but we should just open a BZ dup of LP bug if we need the fix in RHOS | 15:37 |
| *** Sukhdev has joined #openstack-qa | 15:37 | |
| dkranz | jhenner: that makes sense to me but was not sure why that was not happening here | 15:37 |
| sdague | jhenner: so what I'm concerned about is that we end up with staleness all over the place | 15:38 |
| sdague | because there are 9 month old lp artifacts that aren't getting updated | 15:38 |
| sdague | and BZ which have more technical discussion on the issue | 15:38 |
| sdague | so I think that if the artifacts are getting duped, than someone needs to be responsible for syncing back all the comments | 15:39 |
| openstackgerrit | Chris St. Pierre proposed a change to openstack/tempest: Change invalid flavor name https://review.openstack.org/120451 | 15:40 |
| jhenner | sdague, dkranz: I was probably lazy to add link to https://bugzilla.redhat.com/show_bug.cgi?id=1076100 to the LP bug | 15:40 |
| sdague | jhenner: well, I'm less conerned about adding the link | 15:40 |
| *** amotoki has joined #openstack-qa | 15:41 | |
| sdague | I'm more concerned that there is better info in the BZ than in the lp bug | 15:41 |
| sdague | so it's not fixable upstream | 15:41 |
| sdague | because lots of useful context is not in our tracker | 15:41 |
| *** mlavalle has joined #openstack-qa | 15:41 | |
| jhenner | sdague: well, Stephen asked me on BZ, so I replied on BZ | 15:42 |
| jhenner | sdague: so it was not my fault (: | 15:42 |
| *** mlavalle has quit IRC | 15:42 | |
| dkranz | jhenner: It's not about fault | 15:42 |
| *** mlavalle has joined #openstack-qa | 15:42 | |
| openstackgerrit | Matt Riedemann proposed a change to openstack-infra/elastic-recheck: Add query for gate-oslo.db-python33 setup failure https://review.openstack.org/120452 | 15:42 |
| sdague | right, I'm not trying to blame anyone here | 15:42 |
| dkranz | jhenner: We should just make sure that we use LP to make comments on upstream bugs that are expected to have upstream fixes | 15:43 |
| sdague | I'm trying to figure out what the right model is for this, because if the answer is redhat is going to basically just use BZ, we should just delete the LP bugs | 15:43 |
| jhenner | sdague: dkranz: makes sense | 15:43 |
| dkranz | sdague: no, that is not the model | 15:43 |
| sdague | dkranz: ok | 15:43 |
| dkranz | sdague: the model is what you expect, but with an execution glitch :) | 15:43 |
| sdague | dkranz: ok, cool | 15:43 |
| sdague | well glad I noticed the glitch :) | 15:44 |
| dkranz | sdague: thanks for pointing this out | 15:44 |
| sdague | thanks for diving in | 15:44 |
| jhenner | sdague: the model is that for every bug which can have a LP counterpart, the LP should be there | 15:44 |
| sdague | jhenner: ok, cool. Can you mark those BZ bugs to make people have the conversation in the LP bug? | 15:44 |
| openstackgerrit | Chris St. Pierre proposed a change to openstack/tempest: Change invalid flavor name https://review.openstack.org/120451 | 15:44 |
| jhenner | sdague: no problem. | 15:44 |
| sdague | jhenner: thanks! | 15:44 |
| jhenner | dkranz: sdague: we should inform other people about that we should discuss on LP only. I think most of them will agree. | 15:45 |
| sdague | jhenner: awesome, great. I'll leave that to you guys to message at redhat. I think it will make a more collaborative model. | 15:46 |
| *** evgenyf has quit IRC | 15:48 | |
| mauricioliima | Hello, I'm trying run tempest stress test on object_storage, but this error always happen "NameError: name 'stresstest' is not defined" | 15:49 |
| *** ZZelle has quit IRC | 15:52 | |
| *** ZZelle has joined #openstack-qa | 15:53 | |
| *** qba73 has quit IRC | 15:55 | |
| *** dkranz has quit IRC | 15:56 | |
| *** zz_jgrimm is now known as jgrimm | 15:56 | |
| *** asselin has joined #openstack-qa | 16:01 | |
| *** dustins_ is now known as dustins | 16:01 | |
| *** arnaud has joined #openstack-qa | 16:02 | |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Add query for gate-oslo.db-python33 setup failure https://review.openstack.org/120452 | 16:02 |
| mlavalle | mtreinish: tomorrow meeting is at 1700 UTC, right? | 16:03 |
| mtreinish | mlavalle: yep | 16:03 |
| *** arnaud has quit IRC | 16:03 | |
| mlavalle | mtreinish: ok, I fixed the agenda title in the wiki :-) | 16:03 |
| mtreinish | oops, sloppy copy & paste :) | 16:04 |
| *** jlanoux has quit IRC | 16:06 | |
| *** jordanP has quit IRC | 16:08 | |
| *** dkranz has joined #openstack-qa | 16:08 | |
| *** mwagner_lap has quit IRC | 16:09 | |
| *** marun has joined #openstack-qa | 16:10 | |
| *** mestery has quit IRC | 16:10 | |
| *** mestery has joined #openstack-qa | 16:11 | |
| openstackgerrit | Albert vico proposed a change to openstack/tempest: Improvements into ssh and remote_client classes https://review.openstack.org/119762 | 16:11 |
| *** rwsu has joined #openstack-qa | 16:12 | |
| *** markmcclain has quit IRC | 16:12 | |
| *** dkranz has quit IRC | 16:13 | |
| *** yjiang5 has joined #openstack-qa | 16:17 | |
| *** chandankumar has joined #openstack-qa | 16:21 | |
| *** dkranz has joined #openstack-qa | 16:25 | |
| *** jlibosva has quit IRC | 16:26 | |
| *** jlibosva has joined #openstack-qa | 16:26 | |
| *** cdent_ has joined #openstack-qa | 16:27 | |
| *** jlibosva has quit IRC | 16:28 | |
| *** cdent has quit IRC | 16:29 | |
| *** cdent_ is now known as cdent | 16:29 | |
| *** melwitt has joined #openstack-qa | 16:30 | |
| *** Albert has quit IRC | 16:31 | |
| *** dkranz has quit IRC | 16:34 | |
| *** chandankumar has quit IRC | 16:38 | |
| *** adalbas has joined #openstack-qa | 16:43 | |
| *** dkranz has joined #openstack-qa | 16:47 | |
| *** mkollaro has quit IRC | 16:49 | |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Remove fingerprint for bug 1291605 https://review.openstack.org/120220 | 16:50 |
| *** markmcclain has joined #openstack-qa | 16:51 | |
| openstackgerrit | Chris Dent proposed a change to openstack-dev/devstack: Replace screen_it() with run_process() throughout https://review.openstack.org/120077 | 16:57 |
| *** aix has quit IRC | 16:58 | |
| *** harlowja_away is now known as harlowja | 16:58 | |
| *** suneelb has joined #openstack-qa | 17:00 | |
| *** mmedvede has joined #openstack-qa | 17:01 | |
| *** arnaud has joined #openstack-qa | 17:07 | |
| *** arnaud__ has joined #openstack-qa | 17:07 | |
| *** cnesa9 has quit IRC | 17:22 | |
| openstackgerrit | A change was merged to openstack-dev/devstack: Source lib/dstat in unstack.sh https://review.openstack.org/119715 | 17:23 |
| *** chandankumar has joined #openstack-qa | 17:29 | |
| *** e0ne has quit IRC | 17:33 | |
| *** mwagner_lap has joined #openstack-qa | 17:33 | |
| *** Sukhdev has quit IRC | 17:37 | |
| *** Sukhdev has joined #openstack-qa | 17:38 | |
| *** rhsu has joined #openstack-qa | 17:38 | |
| *** safchain has quit IRC | 17:40 | |
| *** masayukig has quit IRC | 17:45 | |
| *** amotoki has quit IRC | 17:48 | |
| *** masayukig has joined #openstack-qa | 17:51 | |
| *** aimon has quit IRC | 18:02 | |
| *** chandankumar has quit IRC | 18:09 | |
| mriedem | mtreinish: have you seen this before? https://bugs.launchpad.net/cinder/+bug/1367857 | 18:09 |
| *** atiwari has joined #openstack-qa | 18:11 | |
| mtreinish | mriedem: yeah I've seen that come and go in the past | 18:13 |
| mtreinish | but I haven't seen it in a while | 18:13 |
| mtreinish | its part of the reason we migrated the scenarios to addCleanup | 18:13 |
| mriedem | mtreinish: ok i'm going to push a change to make the rest_client waiters timeout a tad more useful | 18:13 |
| *** yamahata has quit IRC | 18:13 | |
| mtreinish | because there used to a cleanup bug where it wouldn't detach a volume before delete | 18:13 |
| mriedem | yeah i remember that | 18:14 |
| mtreinish | mriedem: sure patches to make that clearer are always welcome | 18:14 |
| mtreinish | mriedem: hmm, I'm not sure why the 404 didn't cause the wait loop to exit there though | 18:16 |
| mriedem | mtreinish: me neither, so maybe i'm looking at the wrong thing | 18:16 |
| mriedem | that's why i wanted to put the thing_id in the timeout exception | 18:17 |
| mriedem | otherwise i'm assuming it was the snapshot client not handling the 404, but the code looks correct | 18:17 |
| *** johnthetubaguy is now known as zz_johnthetubagu | 18:21 | |
| *** morgan is now known as morganfainberg | 18:23 | |
| *** aimon has joined #openstack-qa | 18:23 | |
| *** morganfainberg is now known as morgan | 18:24 | |
| *** arnaud has quit IRC | 18:25 | |
| *** arnaud__ has quit IRC | 18:25 | |
| *** e0ne has joined #openstack-qa | 18:26 | |
| mtreinish | mriedem: I think it's there: http://logs.openstack.org/54/119254/2/gate/gate-tempest-dsvm-full/3384549/logs/tempest.txt.gz?#_2014-09-10_15_48_46_681 | 18:26 |
| mtreinish | the GET loop stops and it goes onto server cleanup after that | 18:26 |
| mtreinish | I'm think either we have a leaky add cleanup somewhere and we try the wait loop again | 18:28 |
| *** e0ne has quit IRC | 18:28 | |
| mtreinish | which would explain the 404 at the bottom of the logs for that test | 18:28 |
| *** safchain has joined #openstack-qa | 18:28 | |
| mtreinish | mriedem: oh, nm it's an addCleanup_with_wait call, because the 404 is from tearDownClass not _run_cleanup | 18:29 |
| *** safchain has quit IRC | 18:30 | |
| mtreinish | which means that something is doing an addCleanup with a wait loop on that volume | 18:30 |
| mtreinish | let me look at the test | 18:30 |
| mtreinish | mriedem: yep, that's exactly what is happening: http://git.openstack.org/cgit/openstack/tempest/tree/tempest/scenario/manager.py#n267 | 18:33 |
| *** mlavalle has quit IRC | 18:33 | |
| *** mlavalle has joined #openstack-qa | 18:34 | |
| mtreinish | the volume delete just took longer than a single wait timeout | 18:34 |
| mtreinish | so the wait_for_resource deletion addCleanup() call failed | 18:34 |
| mriedem | mtreinish: ah so double wait for cleanup | 18:34 |
| mtreinish | but the addCleanUp_with_wait() issues an async delete call, and then adds a wait at the very end | 18:34 |
| mtreinish | by that point the volume has been deleted | 18:35 |
| mtreinish | mriedem: yep | 18:35 |
| *** chandankumar has joined #openstack-qa | 18:35 | |
| mriedem | mtreinish: ok, seems like a simple fix | 18:35 |
| openstackgerrit | Matt Riedemann proposed a change to openstack/tempest: Better timeout exception in wait_for_resource_deletion https://review.openstack.org/120519 | 18:38 |
| mriedem | mtreinish: there is the diag patch ^ | 18:38 |
| mriedem | mtreinish: were you going to push a patch for the bug fix? | 18:39 |
| *** chandankumar has quit IRC | 18:39 | |
| mtreinish | mriedem: nah, I'll let you have that honor :) | 18:39 |
| *** e0ne has joined #openstack-qa | 18:40 | |
| openstackgerrit | Joe Gordon proposed a change to openstack-dev/grenade: Add comment explaining where javelin logs are found https://review.openstack.org/119587 | 18:40 |
| mriedem | mtreinish: is this what you were thinking? https://gist.github.com/mriedem/935c36c7c54cae433f68 | 18:42 |
| cdent | dtroyer: this is still happening: http://logs.openstack.org/77/120077/7/check/check-devstack-dsvm-cells/f5054ad/logs/screen-n-cpu.txt.gz | 18:42 |
| *** e0ne has quit IRC | 18:43 | |
| mtreinish | mriedem: I don't think that'll work because if wait_on_delete is false then addCleanup isn't called | 18:43 |
| mriedem | mtreinish: so just ignore wait_on_delete? | 18:43 |
| mriedem | i mean, remove it | 18:43 |
| mtreinish | the addCleanup_with wait is just a pseudo optimization to issue an async delete command up front and delay the wait loops until the end | 18:44 |
| mtreinish | to avoid the delays on teardown by doing a bunch of sync deletes | 18:44 |
| mriedem | oh | 18:45 |
| mriedem | ok, well from what i see, nothing ever calls the scenario manager's create_volume with wait_on_delete=False | 18:45 |
| mriedem | so seems that could be removed and we just always have addCleanup_with_wait - since that's already in there | 18:46 |
| mtreinish | well actually I think just doing 2 addcleanups first the wait_on_delete one, followed up with a direct delete call | 18:46 |
| mtreinish | wait_on_delete=True makes it a sync delete, so we probably should just do that everytime | 18:47 |
| mtreinish | and ignore the call to addCleanup_with_wait completely | 18:47 |
| *** Qarekhani has joined #openstack-qa | 18:47 | |
| mriedem | ok | 18:48 |
| *** Sukhdev has quit IRC | 18:49 | |
| cdent | jogo: yeah, something definitely not right on the run_process stuff with cells, but I'm not sure what | 18:49 |
| jogo | cdent: yeah it looks like its run_process related | 18:50 |
| jogo | cdent: why did you add line 1710 here https://review.openstack.org/#/c/120077/7/functions-common | 18:51 |
| cdent | jogo, which line? | 18:52 |
| cdent | (1710 doesn't show) | 18:52 |
| jogo | 1721* | 18:52 |
| jogo | cdent: and why the switch of start_nova_rest and start_nova_compute in start_nova https://review.openstack.org/#/c/120077/7/lib/nova | 18:53 |
| cdent | 1721 is because of line 684 here: https://review.openstack.org/#/c/120077/7/lib/nova (after discussion with dean: log files are clobbered if more than one fake compute nodes) | 18:54 |
| jogo | cdent: ahh | 18:54 |
| jogo | that make ssense | 18:54 |
| jogo | cdent: that sounds like a seperate patch to me | 18:55 |
| jogo | cdent: hopefully making that patch smaller will make it eaier to find the issue | 18:55 |
| mriedem | mtreinish: sorry, i'm still not completely understanding this - when the 2nd waiter runs doesn't it get the 404 back and shouldn't it just exit? | 18:55 |
| cdent | the change of ordering was an effort to address n-cpu complaning that n-coord was not there and I tried it because when I went back to look at early changes on those lines, the ordering had been different before those functions were extracted | 18:56 |
| openstackgerrit | Armando Migliaccio proposed a change to openstack/tempest: Fix MismatchError for LB scenario test https://review.openstack.org/120533 | 18:56 |
| mriedem | mtreinish: oh or is it the case that the wait and delete are running at the same time, | 18:56 |
| mriedem | mtreinish: so this makes the wait synchronized with the delete | 18:57 |
| cdent | the reason the n-cpu-x change is in this patchset is because with run_process being used the config file handling must be changed and when that config handling is changed the log clobbering is more exposed and problematic | 18:57 |
| cdent | so dtroyer and I decided now was the right time | 18:57 |
| *** vigneshvar has joined #openstack-qa | 18:57 | |
| jogo | cdent: ahh I see | 18:57 |
| jogo | cdent: anywa lunch time for me, happy debugging | 18:58 |
| vigneshvar | Hi guys please review my patch https://review.openstack.org/#/c/117985/ and give your comments | 18:58 |
| cdent | thanks jogo | 18:58 |
| mtreinish | mriedem: so if wait_on_delete==True then 2 addcleanup calls are made, the first is the wait_for_resource_deletion() the second is the a volume delete | 18:58 |
| openstackgerrit | Doug Hellmann proposed a change to openstack/qa-specs: Add RSS feed https://review.openstack.org/120534 | 18:59 |
| openstackgerrit | Doug Hellmann proposed a change to openstack/qa-specs: Remove templates from toctrees https://review.openstack.org/120535 | 18:59 |
| mtreinish | the addCleanup( volume delete) gets made by addcleanup_with_wait | 18:59 |
| openstackgerrit | Doug Hellmann proposed a change to openstack/qa-specs: Use the current date for the copyright statement https://review.openstack.org/120536 | 18:59 |
| mriedem | yup | 18:59 |
| mriedem | with you so far :) | 18:59 |
| mtreinish | addcleanup_with_wait also appends a wait_for_resource_deletion call into a list in tearDownClass | 18:59 |
| mtreinish | mriedem: http://git.openstack.org/cgit/openstack/tempest/tree/tempest/scenario/manager.py#n1028 | 19:00 |
| mtreinish | so when wait_on_delete is true we end up waiting for deletion twice, once right after the delete call is made (addCleanup is a LIFO) | 19:00 |
| mtreinish | and the second during tearDownClass which happens after the addCleanup stack is done | 19:00 |
| mriedem | ok | 19:01 |
| *** e0ne has joined #openstack-qa | 19:01 | |
| *** chandankumar has joined #openstack-qa | 19:01 | |
| mriedem | and the timeout happens where? | 19:01 |
| mtreinish | the problem here is that the wait done inside the if wait_on_delet with addCleanup timed out, so it failed with a timeout exception | 19:02 |
| *** dustins has quit IRC | 19:02 | |
| mtreinish | but by the time tearDownClass got around to doing the second wait the volume was deleted | 19:02 |
| mriedem | which should make that waiter a no-op right? because it should catch the 404 and stop waiting. | 19:02 |
| *** dustins has joined #openstack-qa | 19:03 | |
| mtreinish | yep, which is what happened, but we had an unhandled timeout exception from the first wait_on_resource_deletion which is that stacktrace you have in the bug | 19:03 |
| *** e0ne has quit IRC | 19:04 | |
| mriedem | ok.... | 19:04 |
| mriedem | so i'm really just removing an unnecessary 2nd wait call on a resource that is already deleted, | 19:05 |
| mriedem | but the timeout is still an issue regardless, | 19:05 |
| mriedem | so this is just...cleanup/ | 19:05 |
| mriedem | ? | 19:05 |
| mriedem | at this point you should be kicking yourself for saying i should make the change :P | 19:06 |
| vigneshvar | Guys , devstack related changes must be discussed in which channel ? Any info | 19:06 |
| mtreinish | mriedem: yeah, the volume failed to disappear during a timeout interval | 19:06 |
| mriedem | vigneshvar: this one | 19:06 |
| *** nmagnezi has quit IRC | 19:06 | |
| mtreinish | mriedem: nah, by explaining it to you once, you'll be able to fix all the bugs next time :) | 19:07 |
| *** marun has quit IRC | 19:07 | |
| vigneshvar | mriedem: ok thanks , am in right place. please review my change, when free https://review.openstack.org/#/c/117985/ . Thanks | 19:07 |
| openstackgerrit | Ken Giusti proposed a change to openstack-dev/devstack: Add an option to enable version 1.0 of the AMQP messaging protocol https://review.openstack.org/109118 | 19:09 |
| *** markmcclain has quit IRC | 19:09 | |
| vigneshvar | Also I am facing this issue of "Mysql has gone away" in a server launched using devstack | 19:10 |
| vigneshvar | This happens in almost all screens randomly | 19:10 |
| vigneshvar | and it works sometimes and fails few times | 19:10 |
| *** masayukig has quit IRC | 19:10 | |
| vigneshvar | Any idea why this happens | 19:10 |
| openstackgerrit | Matt Riedemann proposed a change to openstack/tempest: Remove redundant waiter in create_volume cleanup https://review.openstack.org/120542 | 19:12 |
| mriedem | mtreinish: hopefully that makes sense ^ | 19:12 |
| openstackgerrit | Chris Dent proposed a change to openstack-dev/devstack: Replace screen_it() with run_process() throughout https://review.openstack.org/120077 | 19:15 |
| *** masayukig has joined #openstack-qa | 19:16 | |
| *** mgagne has quit IRC | 19:18 | |
| *** dtroyer has quit IRC | 19:19 | |
| *** mgagne has joined #openstack-qa | 19:19 | |
| *** mgagne is now known as Guest75250 | 19:19 | |
| mtreinish | mriedem: I had a couple of suggestions, but that's the basic idea | 19:20 |
| *** dtroyer has joined #openstack-qa | 19:21 | |
| *** nmagnezi has joined #openstack-qa | 19:21 | |
| *** markmcclain has joined #openstack-qa | 19:30 | |
| openstackgerrit | Matt Riedemann proposed a change to openstack/tempest: Remove redundant waiter in create_volume cleanup https://review.openstack.org/120542 | 19:30 |
| openstackgerrit | patrick-crews proposed a change to openstack-infra/elastic-recheck: Adding query namespace to elastic-recheck https://review.openstack.org/101958 | 19:32 |
| *** mriedem has quit IRC | 19:34 | |
| *** dimtruck is now known as zz_dimtruck | 19:40 | |
| *** nmagnezi has quit IRC | 19:42 | |
| openstackgerrit | A change was merged to openstack/qa-specs: Remove docutils pin https://review.openstack.org/117164 | 19:44 |
| vigneshvar | mysql has gone away , any idea this occurs randomly | 19:47 |
| *** sballe has joined #openstack-qa | 19:52 | |
| *** gordc has joined #openstack-qa | 19:54 | |
| *** nmagnezi has joined #openstack-qa | 19:57 | |
| *** weshay has quit IRC | 20:00 | |
| *** Sukhdev has joined #openstack-qa | 20:01 | |
| *** markmcclain has quit IRC | 20:03 | |
| openstackgerrit | Doug Hellmann proposed a change to openstack/qa-specs: Use the current date for the copyright statement https://review.openstack.org/120536 | 20:05 |
| openstackgerrit | Doug Hellmann proposed a change to openstack/qa-specs: Add RSS feed https://review.openstack.org/120534 | 20:05 |
| openstackgerrit | Doug Hellmann proposed a change to openstack/qa-specs: Remove templates from toctrees https://review.openstack.org/120535 | 20:05 |
| *** ZZelle_ has joined #openstack-qa | 20:09 | |
| ZZelle_ | mtreinish, hi | 20:10 |
| *** markmcclain has joined #openstack-qa | 20:18 | |
| mtreinish | ZZelle_: hi | 20:21 |
| ZZelle_ | mtreinish, about https://review.openstack.org/103498 on provider extension tests | 20:22 |
| ZZelle_ | mtreinish, i updated the code ... now must of the code is runned in the gate with default configuration | 20:22 |
| mtreinish | ZZelle_: ok, I'll take a look and drop my -2 | 20:24 |
| ZZelle_ | mtreinish, but i could not use testscenario as tests because of its daughter change | 20:24 |
| ZZelle_ | s/as/in/ | 20:24 |
| mtreinish | yeah, I saw your comment on that. I'll take a look at that part too | 20:25 |
| *** marun has joined #openstack-qa | 20:28 | |
| jogo | any idea why neutron-full failures are spiking? http://jogo.github.io/gate/ | 20:31 |
| *** yfried has joined #openstack-qa | 20:35 | |
| *** hockeynut_ has quit IRC | 20:40 | |
| *** dustins has quit IRC | 20:40 | |
| *** chandankumar has quit IRC | 20:41 | |
| *** freyes has quit IRC | 20:41 | |
| *** freyes has joined #openstack-qa | 20:41 | |
| *** krtaylor has quit IRC | 20:42 | |
| *** hockeynut has joined #openstack-qa | 20:42 | |
| *** weshay has joined #openstack-qa | 20:43 | |
| jogo | mtreinish: where is the req-id for this failure http://logs.openstack.org/58/117258/2/gate/gate-tempest-dsvm-neutron-full/48c8627/console.html | 20:50 |
| mtreinish | jogo: it's in the tempest log file, the console output the log fixture which doesn't understand the req-id field | 20:52 |
| mtreinish | jogo: we need to make a oslo.log fixture to capture it with the right formatting | 20:53 |
| mtreinish | jogo: http://logs.openstack.org/58/117258/2/gate/gate-tempest-dsvm-neutron-full/48c8627/logs/tempest.txt.gz?#_2014-09-10_20_18_56_050 | 20:54 |
| mtreinish | that should line should be the req-id you're looking for | 20:55 |
| *** nmagnezi has quit IRC | 20:56 | |
| *** marun has quit IRC | 20:57 | |
| jogo | mtreinish: ahh | 20:57 |
| jogo | mtreinish: found the req-id anway | 20:57 |
| *** rbak_ has quit IRC | 21:01 | |
| *** rfolco has quit IRC | 21:04 | |
| *** rbak has joined #openstack-qa | 21:07 | |
| *** aysyd has quit IRC | 21:08 | |
| *** marun has joined #openstack-qa | 21:08 | |
| *** sabeen has joined #openstack-qa | 21:10 | |
| *** dkranz has quit IRC | 21:17 | |
| *** krtaylor has joined #openstack-qa | 21:19 | |
| *** mestery has quit IRC | 21:25 | |
| *** mestery has joined #openstack-qa | 21:26 | |
| *** Sukhdev has quit IRC | 21:44 | |
| *** Sukhdev has joined #openstack-qa | 21:44 | |
| *** sballe_ has joined #openstack-qa | 21:45 | |
| *** sballe has quit IRC | 21:49 | |
| *** masayukig has quit IRC | 21:55 | |
| jogo | http://logs.openstack.org/35/111635/3/gate/gate-tempest-dsvm-neutron-full/998850f/logs/horizon_error.txt.gz | 21:57 |
| jogo | horizon bug | 21:57 |
| *** masayukig has joined #openstack-qa | 22:01 | |
| *** jecarey has quit IRC | 22:01 | |
| *** ZZelle_ has quit IRC | 22:04 | |
| *** krtaylor has quit IRC | 22:04 | |
| *** jgrimm is now known as zz_jgrimm | 22:09 | |
| *** dims__ has joined #openstack-qa | 22:13 | |
| *** dims_ has quit IRC | 22:17 | |
| *** dims__ has quit IRC | 22:18 | |
| openstackgerrit | Joe Gordon proposed a change to openstack-infra/elastic-recheck: Add query for bug 1345955 https://review.openstack.org/120595 | 22:19 |
| *** dims_ has joined #openstack-qa | 22:19 | |
| *** gordc has quit IRC | 22:20 | |
| *** arnaud has joined #openstack-qa | 22:22 | |
| *** arnaud__ has joined #openstack-qa | 22:22 | |
| *** flaper87 is now known as flaper87|afk | 22:22 | |
| *** morgan is now known as morganfainberg | 22:27 | |
| *** jpich has joined #openstack-qa | 22:29 | |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Add query for bug 1345955 https://review.openstack.org/120595 | 22:32 |
| *** dims_ has quit IRC | 22:34 | |
| *** dims_ has joined #openstack-qa | 22:35 | |
| *** arnaud__ has quit IRC | 22:36 | |
| *** zz_dimtruck is now known as dimtruck | 22:36 | |
| *** marun is now known as marun_afk | 22:37 | |
| *** rhsu has quit IRC | 22:38 | |
| *** dims_ has quit IRC | 22:39 | |
| *** marun_afk has quit IRC | 22:53 | |
| *** sergeysh has quit IRC | 22:55 | |
| *** rockyg has joined #openstack-qa | 22:56 | |
| *** mpavlase has quit IRC | 22:56 | |
| *** rbak has quit IRC | 23:01 | |
| *** vigneshvar has quit IRC | 23:09 | |
| *** melwitt has quit IRC | 23:09 | |
| *** melwitt has joined #openstack-qa | 23:16 | |
| *** melwitt has quit IRC | 23:16 | |
| *** melwitt has joined #openstack-qa | 23:17 | |
| *** melwitt has quit IRC | 23:17 | |
| *** melwitt has joined #openstack-qa | 23:17 | |
| *** melwitt has quit IRC | 23:18 | |
| *** melwitt has joined #openstack-qa | 23:19 | |
| *** yfried has quit IRC | 23:22 | |
| *** cbader has quit IRC | 23:22 | |
| *** melwitt has quit IRC | 23:26 | |
| openstackgerrit | Swapnil Kulkarni proposed a change to openstack-dev/devstack: Update multiple backend names in tempest configuration https://review.openstack.org/120351 | 23:41 |
| *** Sukhdev has quit IRC | 23:44 | |
| *** rockyg has quit IRC | 23:48 | |
| *** harlowja has quit IRC | 23:48 | |
| *** harlowja_ has joined #openstack-qa | 23:48 | |
| *** atiwari has quit IRC | 23:49 | |
| *** hemna is now known as hemna_ | 23:53 | |
| *** rhsu has joined #openstack-qa | 23:54 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!