*** mahito has joined #openstack-qa | 00:01 | |
openstackgerrit | Joe Gordon proposed openstack/tempest: Skip test_shelve_instance in multihost case https://review.openstack.org/174652 | 00:02 |
---|---|---|
jogo | mtreinish: something like that ^ | 00:02 |
mtreinish | jogo: yeah that should work | 00:03 |
*** mahito_ has joined #openstack-qa | 00:04 | |
*** dims__ has joined #openstack-qa | 00:04 | |
mtreinish | jogo: after looking at that test, your the other option would be to tell devstack to say shelve doesn't work in multinode | 00:04 |
mtreinish | but I think we should save that if we figure out it really doesn't work multinode | 00:05 |
*** mahito has quit IRC | 00:05 | |
*** dims_ has joined #openstack-qa | 00:05 | |
jogo | yeah this should be a bug | 00:06 |
jogo | not a issue we just have to live with | 00:07 |
jogo | mtreinish: thanks | 00:07 |
* jogo wanders off | 00:08 | |
*** dims__ has quit IRC | 00:09 | |
*** bknudson has joined #openstack-qa | 00:12 | |
*** davideagnello has quit IRC | 00:12 | |
*** tosky has quit IRC | 00:13 | |
*** sputnik13 has quit IRC | 00:13 | |
*** luqas has joined #openstack-qa | 00:15 | |
*** davideagnello has joined #openstack-qa | 00:16 | |
*** luqas has quit IRC | 00:20 | |
*** dmellado has quit IRC | 00:21 | |
openstackgerrit | Merged openstack-dev/devstack: doc changes to devstack overview.rst https://review.openstack.org/174496 | 00:22 |
*** yamamoto has quit IRC | 00:25 | |
*** dmorita has joined #openstack-qa | 00:27 | |
*** yamamoto has joined #openstack-qa | 00:27 | |
*** yamamoto has quit IRC | 00:28 | |
*** dmellado has joined #openstack-qa | 00:29 | |
*** marun has quit IRC | 00:31 | |
*** davideagnello has quit IRC | 00:32 | |
*** zz_dimtruck is now known as dimtruck | 00:34 | |
*** mlavalle has quit IRC | 00:37 | |
openstackgerrit | Ian Wienand proposed openstack-dev/devstack: Actually run function tests https://review.openstack.org/174663 | 00:41 |
ianw | dougwig: ^ so we don't even run those tests in the gate! doh | 00:42 |
openstackgerrit | Ian Wienand proposed openstack-dev/devstack: Stop deleting token prefixes when processing ENABLED_SERVICES negations https://review.openstack.org/171402 | 00:43 |
dougwig | ianw: ooh, good find. | 00:43 |
ianw | dougwig: i just did a depend-on for your change, that should actually test it :) | 00:44 |
clarkb | jogo mtreinish shelve does work across nodes | 00:44 |
clarkb | I worked hard to make that work | 00:44 |
clarkb | if it doesnt work that is a bug likely in nova | 00:44 |
clarkb | back to driving now but ^ is a regression if thats the case. now is time to fix it not ignore it | 00:46 |
mtreinish | clarkb: ok well I'll drop my +2 on jogo's skip commit then | 00:46 |
mtreinish | he made it sound like a fix wasn't coming any time soon and a skip was necessary | 00:47 |
*** patrickeast has quit IRC | 00:50 | |
openstackgerrit | Matthew Treinish proposed openstack/tempest: Cleanup fixed_name logic in test_list_server_filters https://review.openstack.org/174671 | 00:50 |
mtreinish | sdague: ^^^ | 00:50 |
openstackgerrit | Doug Wiegley proposed openstack-dev/devstack: Stop deleting token prefixes when processing ENABLED_SERVICES negations https://review.openstack.org/171402 | 00:51 |
*** achanda has quit IRC | 00:51 | |
*** achanda has joined #openstack-qa | 00:59 | |
*** mwagner_lap has joined #openstack-qa | 01:00 | |
*** weshay has joined #openstack-qa | 01:05 | |
openstackgerrit | Matthew Treinish proposed openstack/tempest: Add a paragraph on the use of tempest_roles option https://review.openstack.org/174675 | 01:05 |
*** yamamoto has joined #openstack-qa | 01:10 | |
*** krtaylor has joined #openstack-qa | 01:13 | |
clarkb | mtreinish why wouldnt we fix it during bug fix time? | 01:15 |
clarkb | also note I have been afk all day so may have missed something | 01:15 |
clarkb | previously the issue was shelve wouldnt cleanup networking on old host then bring it up on new host so packet paths were messed up | 01:17 |
clarkb | and it was a real bug | 01:18 |
*** jecarey has joined #openstack-qa | 01:25 | |
*** Sukhdev has quit IRC | 01:34 | |
*** rfolco has quit IRC | 01:46 | |
*** harlowja is now known as harlowja_away | 01:47 | |
*** dims_ has quit IRC | 01:54 | |
openstackgerrit | Ian Wienand proposed openstack-dev/devstack: Create config file in merge_config_file https://review.openstack.org/174678 | 01:57 |
ianw | dougwig: ^ another thing i noticed | 01:57 |
ianw | dougwig: also, https://jenkins07.openstack.org/job/gate-devstack-unit-tests/393/console <- your change does seem to fail, but we don't pick it up | 01:58 |
openstackrecheck | Console logs not available after 13:22s for gate-sahara-pep8 173654,11,339252f | 02:08 |
*** pal has joined #openstack-qa | 02:13 | |
*** achanda has quit IRC | 02:20 | |
*** dkranz has joined #openstack-qa | 02:21 | |
*** achanda has joined #openstack-qa | 02:22 | |
*** dmellado has quit IRC | 02:22 | |
*** pal_ has joined #openstack-qa | 02:33 | |
*** pal has quit IRC | 02:34 | |
*** dimtruck is now known as zz_dimtruck | 02:34 | |
*** marrusl has quit IRC | 02:34 | |
openstackgerrit | Ken'ichi Ohmichi proposed openstack/tempest: Check domain's enabled attribute strictly https://review.openstack.org/174680 | 02:35 |
*** dkranz has quit IRC | 02:37 | |
*** weshay has quit IRC | 02:37 | |
*** dmellado has joined #openstack-qa | 02:42 | |
*** liusheng has joined #openstack-qa | 02:46 | |
*** jecarey has quit IRC | 02:47 | |
*** achanda has quit IRC | 02:49 | |
*** woodster_ has quit IRC | 02:50 | |
*** sputnik13 has joined #openstack-qa | 02:53 | |
*** yamahata has quit IRC | 02:56 | |
*** Longgeek has joined #openstack-qa | 02:59 | |
*** Longgeek has quit IRC | 03:04 | |
*** Longgeek has joined #openstack-qa | 03:06 | |
*** liusheng has quit IRC | 03:07 | |
*** liusheng has joined #openstack-qa | 03:07 | |
*** achanda has joined #openstack-qa | 03:20 | |
*** pal_ has quit IRC | 03:22 | |
openstackgerrit | Ian Wienand proposed openstack-dev/devstack: Create config file in merge_config_file https://review.openstack.org/174678 | 03:24 |
openstackgerrit | Ian Wienand proposed openstack-dev/devstack: Add "passed" and "failed" functions https://review.openstack.org/174682 | 03:24 |
openstackgerrit | Ian Wienand proposed openstack-dev/devstack: Use unittest help in test_ip.sh https://review.openstack.org/174683 | 03:24 |
openstackgerrit | Ian Wienand proposed openstack-dev/devstack: Fix return of test_ini_config & test_meta_config https://review.openstack.org/174684 | 03:24 |
openstackgerrit | Ian Wienand proposed openstack-dev/devstack: Move function.sh to test_functions.sh https://review.openstack.org/174685 | 03:24 |
openstackgerrit | Ian Wienand proposed openstack-dev/devstack: Fix die_if_not_set tests https://review.openstack.org/174686 | 03:24 |
openstackgerrit | Ian Wienand proposed openstack-dev/devstack: Convert test_functions.sh to use unittest helpers https://review.openstack.org/174687 | 03:24 |
openstackgerrit | Ian Wienand proposed openstack-dev/devstack: Remove old comment in run_tests.sh https://review.openstack.org/174688 | 03:24 |
ianw | dougwig: ^ you see what you created :) | 03:24 |
*** ebagdasa has quit IRC | 03:29 | |
*** pal has joined #openstack-qa | 03:31 | |
*** davideagnello has joined #openstack-qa | 03:33 | |
*** davideagnello has quit IRC | 03:38 | |
*** Sukhdev has joined #openstack-qa | 03:44 | |
dougwig | ianw: good, this is more valuable than the original change. 😃 | 03:44 |
*** achanda has quit IRC | 03:52 | |
*** luqas has joined #openstack-qa | 03:52 | |
*** sputnik13 has quit IRC | 03:53 | |
*** luqas has quit IRC | 03:57 | |
dougwig | ianw: anything I can help with in the morning? | 04:00 |
ianw | dougwig: i don't think so; that stack mean that ./run_tests.sh runs the tests and catches failures. but i do believe your proposed original change fails, despite not being picked up ATM | 04:01 |
dougwig | ianw: I saw that, and marked my patch -a to make sure it's not considered. | 04:02 |
ianw | dougwig: also maybe double-check https://review.openstack.org/#/c/174678/ -- i get so lost in that ridiculously long awk script ... | 04:02 |
dougwig | ianw: awk, perhaps the only thing that can make perl look good. | 04:04 |
*** yfried|afk is now known as yfried__ | 04:06 | |
*** achanda has joined #openstack-qa | 04:07 | |
*** achanda has quit IRC | 04:11 | |
*** achanda has joined #openstack-qa | 04:16 | |
*** yfried__ is now known as yfried|afk | 04:17 | |
*** achanda has quit IRC | 04:18 | |
*** yfried|afk is now known as yfried__ | 04:19 | |
*** achanda has joined #openstack-qa | 04:21 | |
openstackgerrit | Merged openstack/tempest: Test creation of server attached to created port https://review.openstack.org/162886 | 04:22 |
*** achanda has quit IRC | 04:29 | |
*** kashyap` is now known as kashyap | 04:36 | |
*** achanda has joined #openstack-qa | 04:42 | |
*** mmedvede has quit IRC | 04:46 | |
*** ajmiller_ has joined #openstack-qa | 04:51 | |
*** neeti has joined #openstack-qa | 04:52 | |
*** ajmiller has quit IRC | 04:54 | |
*** mmedvede has joined #openstack-qa | 04:57 | |
*** oomichi has joined #openstack-qa | 05:08 | |
*** sputnik13 has joined #openstack-qa | 05:09 | |
openstackgerrit | Abhishek G M proposed openstack/tempest: Test Creation of server in a shared_network https://review.openstack.org/168910 | 05:11 |
*** sputnik13 has quit IRC | 05:11 | |
openstackgerrit | Abhishek G M proposed openstack/tempest: Test Create of VM with multiple Nics https://review.openstack.org/168040 | 05:20 |
*** openstackgerrit has quit IRC | 05:21 | |
*** openstackgerrit has joined #openstack-qa | 05:21 | |
*** sks has joined #openstack-qa | 05:27 | |
*** Madan has joined #openstack-qa | 05:27 | |
*** yfried__ is now known as yfried|afk | 05:34 | |
*** rushiagr_away is now known as rushiagr | 05:38 | |
*** nikil2 has joined #openstack-qa | 05:42 | |
*** hitalia has joined #openstack-qa | 05:43 | |
*** Sukhdev has quit IRC | 05:43 | |
*** Sukhdev has joined #openstack-qa | 05:50 | |
*** oomichi has quit IRC | 05:59 | |
*** pal has quit IRC | 06:10 | |
*** ibiris_away is now known as ibiris | 06:17 | |
*** armax has quit IRC | 06:22 | |
*** bnemec has quit IRC | 06:32 | |
*** k4n0 has joined #openstack-qa | 06:34 | |
*** Longgeek_ has joined #openstack-qa | 06:37 | |
*** yamahata has joined #openstack-qa | 06:38 | |
*** Longgeek has quit IRC | 06:39 | |
*** jyuso1 has quit IRC | 06:40 | |
*** mhorban has quit IRC | 06:45 | |
*** Sukhdev has quit IRC | 06:45 | |
*** achanda has quit IRC | 06:53 | |
*** achanda has joined #openstack-qa | 06:56 | |
*** yfried|afk is now known as yfried__ | 06:56 | |
*** gilliard is now known as gillllliard | 07:03 | |
*** gillllliard is now known as gillllllliard | 07:03 | |
openstackgerrit | Ramakrishnan G proposed openstack-dev/devstack: Add support for provider network in tempest https://review.openstack.org/156887 | 07:06 |
openstackgerrit | Ramakrishnan G proposed openstack-dev/devstack: Add support for provider network in tempest https://review.openstack.org/174729 | 07:07 |
*** e0ne has joined #openstack-qa | 07:08 | |
openstackgerrit | Mh Raies proposed openstack/tempest-lib: Adding support for trove CLI. https://review.openstack.org/174730 | 07:08 |
*** yfried__ is now known as yfried|afk | 07:12 | |
openstackgerrit | Ramakrishnan G proposed openstack-dev/devstack: Fix issue with ml2 plugin on using provider network https://review.openstack.org/174731 | 07:13 |
*** markus_z has joined #openstack-qa | 07:14 | |
*** ibiris is now known as ibiris_away | 07:14 | |
*** ibiris_away is now known as ibiris | 07:15 | |
*** amotoki has quit IRC | 07:18 | |
*** svasheka has quit IRC | 07:21 | |
*** nikil2 has quit IRC | 07:21 | |
openstackgerrit | Ramakrishnan G proposed openstack-dev/devstack: Add support for ilo drivers in lib/ironic https://review.openstack.org/174733 | 07:21 |
*** luqas has joined #openstack-qa | 07:22 | |
*** e0ne has quit IRC | 07:23 | |
*** tochi has quit IRC | 07:23 | |
*** e0ne has joined #openstack-qa | 07:28 | |
*** tochi has joined #openstack-qa | 07:28 | |
*** ibiris is now known as ibiris_away | 07:28 | |
*** achanda has quit IRC | 07:29 | |
*** andreykurilin__ has joined #openstack-qa | 07:32 | |
*** achanda_ has joined #openstack-qa | 07:32 | |
*** dims__ has joined #openstack-qa | 07:33 | |
*** yamahata has quit IRC | 07:34 | |
*** jlibosva has joined #openstack-qa | 07:35 | |
*** nikil22 has joined #openstack-qa | 07:36 | |
*** vponomaryov has quit IRC | 07:37 | |
*** dims__ has quit IRC | 07:38 | |
*** jlanoux has joined #openstack-qa | 07:40 | |
*** achanda_ has quit IRC | 07:40 | |
openstackrecheck | Console logs not available after 13:25s for gate-cinder-docs 174482,2,56b9804 | 07:40 |
*** gfidente has joined #openstack-qa | 07:43 | |
*** yfried|afk is now known as yfried__ | 07:44 | |
*** mahito has joined #openstack-qa | 07:46 | |
*** alex_xu has quit IRC | 07:46 | |
*** heyongli has quit IRC | 07:47 | |
*** heyongli has joined #openstack-qa | 07:48 | |
*** alex_xu has joined #openstack-qa | 07:48 | |
*** mahito_ has quit IRC | 07:49 | |
*** andreykurilin___ has joined #openstack-qa | 07:53 | |
*** andreykurilin__ has quit IRC | 07:53 | |
*** e0ne has quit IRC | 07:57 | |
*** ibiris_away is now known as ibiris | 08:01 | |
*** e0ne has joined #openstack-qa | 08:01 | |
*** SridharG has joined #openstack-qa | 08:04 | |
*** rushiagr is now known as rushiagr_away | 08:04 | |
*** achanda has joined #openstack-qa | 08:06 | |
*** sks has quit IRC | 08:08 | |
*** e0ne has quit IRC | 08:09 | |
openstackgerrit | Mh Raies proposed openstack/tempest-lib: Adding support for trove CLI. https://review.openstack.org/174730 | 08:10 |
*** newbie has joined #openstack-qa | 08:12 | |
*** newbie is now known as Guest43836 | 08:13 | |
*** e0ne has joined #openstack-qa | 08:14 | |
*** e0ne has quit IRC | 08:18 | |
*** turul has joined #openstack-qa | 08:18 | |
*** achanda has quit IRC | 08:20 | |
*** hichihara has quit IRC | 08:21 | |
*** ylobankov_ has quit IRC | 08:21 | |
*** achanda_ has joined #openstack-qa | 08:22 | |
*** zz_johnthetubagu is now known as johnthetubaguy | 08:22 | |
*** yfried__ is now known as yfried|afk | 08:22 | |
*** e0ne has joined #openstack-qa | 08:22 | |
Guest43836 | Could anyone take a look, please: https://review.openstack.org/173875 | 08:26 |
*** ylobankov has joined #openstack-qa | 08:26 | |
*** safchain has joined #openstack-qa | 08:29 | |
*** turul is now known as afazekas | 08:30 | |
*** achanda_ has quit IRC | 08:35 | |
*** mahito has quit IRC | 08:37 | |
*** yfried|afk is now known as yfried__ | 08:37 | |
*** jordanP has joined #openstack-qa | 08:42 | |
*** e0ne has quit IRC | 08:42 | |
*** andreykurilin___ has quit IRC | 08:43 | |
*** e0ne has joined #openstack-qa | 08:46 | |
*** pcaruana has joined #openstack-qa | 08:50 | |
*** mpaolino has joined #openstack-qa | 08:50 | |
*** e0ne has quit IRC | 08:51 | |
*** e0ne has joined #openstack-qa | 08:53 | |
*** tkammer has joined #openstack-qa | 08:58 | |
*** e0ne has quit IRC | 09:00 | |
*** pal has joined #openstack-qa | 09:00 | |
*** e0ne has joined #openstack-qa | 09:04 | |
*** yamamoto has quit IRC | 09:06 | |
*** e0ne has quit IRC | 09:09 | |
*** ibiris is now known as ibiris_away | 09:09 | |
*** rushiagr_away is now known as rushiagr | 09:10 | |
*** yfried__ is now known as yfried|afk | 09:12 | |
*** yfried|afk is now known as yfried__ | 09:15 | |
*** ihrachyshka has joined #openstack-qa | 09:16 | |
*** gszasz has joined #openstack-qa | 09:18 | |
*** ibiris_away is now known as ibiris | 09:19 | |
*** anshul has joined #openstack-qa | 09:22 | |
openstackgerrit | Ramakrishnan G proposed openstack-dev/devstack: Add support for ilo drivers in lib/ironic https://review.openstack.org/174733 | 09:31 |
*** ibiris is now known as ibiris_away | 09:33 | |
*** yfried__ is now known as yfried|afk | 09:34 | |
*** ibiris_away is now known as ibiris | 09:35 | |
openstackrecheck | Console logs not available after 13:23s for gate-nova-pep8 174656,6,0b82677 | 09:43 |
*** aix has joined #openstack-qa | 09:45 | |
*** jamielennox is now known as jamielennox|away | 09:49 | |
*** e0ne has joined #openstack-qa | 09:50 | |
*** tosky has joined #openstack-qa | 09:54 | |
*** cdent has joined #openstack-qa | 10:01 | |
*** enikanorov_ has quit IRC | 10:09 | |
*** sputnik13 has joined #openstack-qa | 10:12 | |
*** cdent has quit IRC | 10:12 | |
*** cdent has joined #openstack-qa | 10:13 | |
*** enikanorov_ has joined #openstack-qa | 10:15 | |
*** sputnik13 has quit IRC | 10:15 | |
*** neeti has quit IRC | 10:17 | |
*** yfried|afk is now known as yfried__ | 10:22 | |
*** pc_m has joined #openstack-qa | 10:28 | |
*** Madan has quit IRC | 10:30 | |
*** safchain has quit IRC | 10:31 | |
*** safchain has joined #openstack-qa | 10:34 | |
*** e0ne is now known as e0ne_ | 10:38 | |
*** yfried__ is now known as yfried|afk | 10:38 | |
*** dratushnyy has quit IRC | 10:38 | |
*** ajmiller__ has joined #openstack-qa | 10:39 | |
openstackgerrit | fumihiko kakuma proposed openstack-dev/devstack: Fix remove_disabled_extensions to remove an extension at the last position https://review.openstack.org/172789 | 10:40 |
*** e0ne_ is now known as e0ne | 10:42 | |
*** ajmiller_ has quit IRC | 10:43 | |
*** pal has quit IRC | 10:45 | |
*** k4n0 has quit IRC | 10:47 | |
*** jlibosva has quit IRC | 10:53 | |
*** jlibosva has joined #openstack-qa | 10:54 | |
*** jlibosva has quit IRC | 10:54 | |
*** jlibosva has joined #openstack-qa | 10:55 | |
*** jlibosva has quit IRC | 10:56 | |
*** jlibosva has joined #openstack-qa | 10:56 | |
*** yfried|afk is now known as yfried__ | 10:57 | |
*** jlibosva has quit IRC | 10:57 | |
*** jlibosva has joined #openstack-qa | 10:57 | |
*** dims__ has joined #openstack-qa | 11:02 | |
*** sks has joined #openstack-qa | 11:05 | |
openstackgerrit | Ramakrishnan G proposed openstack-dev/devstack: Add support for ilo drivers in lib/ironic https://review.openstack.org/174733 | 11:05 |
*** aix has quit IRC | 11:05 | |
*** vponomaryov has joined #openstack-qa | 11:06 | |
*** yfried__ is now known as yfried|afk | 11:07 | |
*** yfried|afk is now known as yfried__ | 11:09 | |
openstackgerrit | Ramakrishnan G proposed openstack-dev/devstack: Configure active_timeout and ssh_user in lib/tempest https://review.openstack.org/174819 | 11:17 |
openstackgerrit | Ramakrishnan G proposed openstack/tempest: Make OS_TEST_TIMEOUT configurable in tox.ini https://review.openstack.org/174822 | 11:23 |
raies_ | afazekas: hi | 11:26 |
*** mwagner_lap has quit IRC | 11:26 | |
raies_ | afazekas: I am facing an error, Jenkins gets fail because "Cells" is not enabled. Is by default n-cells service is disabled in devstack-gate ? how to enable it ? I can see default setting to disable here https://github.com/openstack-infra/devstack-gate/blob/master/devstack-vm-gate-wrap.sh#L204 | 11:28 |
openstackgerrit | Ramakrishnan G proposed openstack/tempest: Honour ssh_connect_method in test_baremetal_server_ops https://review.openstack.org/174828 | 11:34 |
openstackgerrit | Sean Dague proposed openstack-dev/devstack: refactor ping_check https://review.openstack.org/174370 | 11:39 |
*** dmorita has quit IRC | 11:44 | |
openstackrecheck | Console logs not available after 13:25s for gate-nova-pep8 118604,17,ef8ffd3 | 11:45 |
afazekas | raies_, We had a non voting cell job only on nova and it is failing: http://logs.openstack.org/94/173794/2/check/check-tempest-dsvm-cells/ec1ae52/ | 11:47 |
*** tochi has quit IRC | 11:48 | |
afazekas | s/had/have/ | 11:49 |
*** anshul has quit IRC | 11:49 | |
*** anshul has joined #openstack-qa | 11:50 | |
raies_ | afazekas: I faced http://logs.openstack.org/48/171148/2/check/check-novaclient-dsvm-functional/273fef7/testr_results.html.gz | 11:50 |
afazekas | raies_: IMHO if we would like to have cell job on tempest the layout in the project-config repo needs to be changed | 11:50 |
*** anshul has quit IRC | 11:50 | |
*** anshul has joined #openstack-qa | 11:51 | |
raies_ | afazekas: ok | 11:51 |
openstackgerrit | Ramakrishnan G proposed openstack-dev/devstack: Network not reachable after creating provider net https://review.openstack.org/174832 | 11:51 |
*** cbits has joined #openstack-qa | 11:52 | |
*** cbits has left #openstack-qa | 11:55 | |
*** cdent has quit IRC | 11:55 | |
*** e0ne is now known as e0ne_ | 11:58 | |
openstackrecheck | Console logs not available after 13:22s for gate-cinder-pep8 163706,7,9195fea | 11:59 |
*** cdent has joined #openstack-qa | 12:01 | |
*** aix has joined #openstack-qa | 12:03 | |
*** rfolco has joined #openstack-qa | 12:06 | |
*** aysyd has joined #openstack-qa | 12:06 | |
*** e0ne_ has quit IRC | 12:08 | |
*** e0ne has joined #openstack-qa | 12:10 | |
*** weshay has joined #openstack-qa | 12:13 | |
*** bknudson has quit IRC | 12:15 | |
*** mwagner_lap has joined #openstack-qa | 12:19 | |
*** woodster_ has joined #openstack-qa | 12:19 | |
*** abehl has joined #openstack-qa | 12:20 | |
*** anshul has quit IRC | 12:21 | |
openstackgerrit | Sean Dague proposed openstack-dev/devstack: add back n-cert https://review.openstack.org/174847 | 12:23 |
*** sks has quit IRC | 12:25 | |
*** yfried__ is now known as yfried|afk | 12:29 | |
*** yfried|afk is now known as yfried__ | 12:29 | |
*** cdent has quit IRC | 12:34 | |
*** cdent has joined #openstack-qa | 12:35 | |
*** bknudson has joined #openstack-qa | 12:36 | |
*** jaypipes has joined #openstack-qa | 12:38 | |
*** ChanServ sets mode: +o jaypipes | 12:38 | |
*** cdent has quit IRC | 12:41 | |
*** cdent has joined #openstack-qa | 12:41 | |
*** nikil22 has quit IRC | 12:44 | |
*** dpaterson has joined #openstack-qa | 12:49 | |
*** anshul has joined #openstack-qa | 12:50 | |
*** dkranz has joined #openstack-qa | 12:51 | |
*** abehl has quit IRC | 12:52 | |
*** cbader has joined #openstack-qa | 12:53 | |
*** SridharG has left #openstack-qa | 12:56 | |
*** zz_dimtruck is now known as dimtruck | 12:59 | |
*** cbader has quit IRC | 13:00 | |
*** marrusl has joined #openstack-qa | 13:01 | |
*** dmellado has quit IRC | 13:02 | |
openstackgerrit | Sean Dague proposed openstack-dev/devstack: add back n-cert https://review.openstack.org/174847 | 13:02 |
*** neeti has joined #openstack-qa | 13:03 | |
*** neeti has quit IRC | 13:03 | |
*** gszasz has quit IRC | 13:06 | |
*** artom has joined #openstack-qa | 13:14 | |
*** marcusvrn has quit IRC | 13:19 | |
*** cdent has quit IRC | 13:23 | |
openstackgerrit | Anthony PERARD proposed openstack/tempest: Introduce compute.libvirt_type config option. https://review.openstack.org/174866 | 13:23 |
openstackgerrit | Anthony PERARD proposed openstack/tempest: Skip test_volume_boot_pattern for Nova with libvirt-xen https://review.openstack.org/174867 | 13:23 |
*** dustins has joined #openstack-qa | 13:23 | |
*** rushiagr is now known as rushiagr_away | 13:23 | |
*** mriedem has joined #openstack-qa | 13:26 | |
*** markus_z has quit IRC | 13:29 | |
openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add a cli subcommand for deleting old rows https://review.openstack.org/172200 | 13:29 |
*** jecarey has joined #openstack-qa | 13:32 | |
*** dansmith is now known as superdan | 13:35 | |
*** yfried__ is now known as yfried|afk | 13:41 | |
*** yfried|afk is now known as yfried__ | 13:43 | |
*** anshul has quit IRC | 13:45 | |
*** anshul has joined #openstack-qa | 13:46 | |
*** anshul has quit IRC | 13:46 | |
*** anshul has joined #openstack-qa | 13:47 | |
*** mhorban has joined #openstack-qa | 13:49 | |
openstackgerrit | Dan Smith proposed openstack-dev/grenade: DNM: For testing nova https://review.openstack.org/174581 | 13:50 |
openstackgerrit | Dan Smith proposed openstack-dev/grenade: Make nova migrate flavor data, per Kilo->Lemming requirements https://review.openstack.org/174567 | 13:50 |
*** mpaolino has quit IRC | 13:53 | |
openstackgerrit | Thomas Bechtold proposed openstack/tempest-lib: Fix ValueError in subunit_trace https://review.openstack.org/174882 | 13:57 |
*** dimtruck is now known as zz_dimtruck | 13:58 | |
*** jaypipes is now known as leakypipes | 13:59 | |
*** rbak has joined #openstack-qa | 14:00 | |
*** bnemec has joined #openstack-qa | 14:03 | |
*** mriedem has quit IRC | 14:03 | |
*** yfried__ is now known as yfried|afk | 14:03 | |
*** mriedem has joined #openstack-qa | 14:06 | |
*** BadCub_Hiding is now known as BadCub | 14:06 | |
openstackgerrit | Sergey Slipushenko proposed openstack/tempest: Tool for generation user accounts from spec https://review.openstack.org/172605 | 14:07 |
*** zz_dimtruck is now known as dimtruck | 14:07 | |
*** rushiagr_away is now known as rushiagr | 14:08 | |
*** cdent has joined #openstack-qa | 14:09 | |
*** yfried|afk is now known as yfried__ | 14:09 | |
sslypush1nko | mtreinish: I separated account_generator code from javelin, as you asked me to do. Can you review this patch ^^ | 14:10 |
openstackrecheck | openstack-dev/devstack change: https://review.openstack.org/173493 failed because of: gate-tempest-dsvm-full: https://bugs.launchpad.net/bugs/1429151 | 14:10 |
openstack | Launchpad bug 1429151 in Cinder "SimpleReadOnlyCinderClientTest.test_cinder_encryption_type_list fails randomly" [High,Confirmed] | 14:10 |
mtreinish | sslypush1nko: yes I will take a look | 14:10 |
openstackgerrit | Anthony PERARD proposed openstack-dev/devstack: Include libvirt_type in tempest config. https://review.openstack.org/174888 | 14:10 |
sslypush1nko | thx | 14:10 |
*** anshul has quit IRC | 14:11 | |
sslypush1nko | Also I left feature for cleanup, becuse it is in a spec | 14:11 |
*** e0ne is now known as e0ne_ | 14:11 | |
*** e0ne_ is now known as e0ne | 14:13 | |
*** sslypush1nko is now known as sslypushenko | 14:20 | |
*** yfried__ is now known as yfried|afk | 14:21 | |
*** rdekel has joined #openstack-qa | 14:21 | |
*** neeti has joined #openstack-qa | 14:21 | |
*** rdekel1 has joined #openstack-qa | 14:23 | |
*** sabeen has joined #openstack-qa | 14:24 | |
*** rdekel has quit IRC | 14:25 | |
dtroyer | ianw: wow, dragging DevStack tests into the 2000's, thanks | 14:25 |
dtroyer | is that series ready? I'm heading off to see how bad things still are on OS/X | 14:26 |
*** mwagner_lap has quit IRC | 14:29 | |
*** sabeen2 has joined #openstack-qa | 14:32 | |
*** dims__ has quit IRC | 14:33 | |
*** zz_jgrimm is now known as jgrimm | 14:34 | |
*** neeti_ has joined #openstack-qa | 14:35 | |
*** sabeen has quit IRC | 14:36 | |
*** neeti has quit IRC | 14:37 | |
*** rdekel1 has quit IRC | 14:40 | |
*** marun has joined #openstack-qa | 14:41 | |
*** neeti_ has quit IRC | 14:41 | |
*** neeti has joined #openstack-qa | 14:41 | |
*** mtanino has joined #openstack-qa | 14:41 | |
*** neeti has quit IRC | 14:45 | |
openstackrecheck | openstack-dev/devstack change: https://review.openstack.org/174147 failed gate-tempest-dsvm-postgres-full in the gate queue with an unrecognized error | 14:46 |
*** DieLove has joined #openstack-qa | 14:49 | |
sdague | dtroyer: the test updates? | 14:50 |
dtroyer | sdague: yeah, it's still working as well as expected | 14:51 |
sdague | yep | 14:52 |
sdague | yeh, those look all reasonable to me | 14:52 |
*** DieLove has quit IRC | 14:52 | |
openstackgerrit | Andrew Boik proposed openstack-dev/devstack: Set DevStack to dual stack by default in Kilo+ https://review.openstack.org/160856 | 14:52 |
sdague | dtroyer: so, we should probably figure out what else we want in before the stable/kilo branch is cut | 14:53 |
dtroyer | I wasn't sure if he was done iterating on those, looks like maybe so | 14:53 |
sdague | https://review.openstack.org/#/c/174370/ is the last thing I'd really like, because I want to use that from grenade and drop the custom function | 14:53 |
sdague | the stackrc default change to add back n-crt is in the gate now, that will make people's lives happier | 14:54 |
sdague | although, I have to say, it's not clear to me why n-crt is a dedicated service | 14:54 |
sdague | you have any history there? | 14:55 |
dtroyer | sdague: it is just to support ec2 stuff, I think the reason that people want it back is because the accrc script creates ec2 creds | 14:55 |
dtroyer | I'd rather make all of that opt-in, but haven't had the time to dig into that | 14:56 |
sdague | so there are a bunch of devstack things that poke it during stack.sh | 14:56 |
dtroyer | I don't think that is a big deal before stable/kilo though | 14:56 |
*** yfried|afk is now known as yfried__ | 14:59 | |
sdague | ok | 15:00 |
*** yamahata has joined #openstack-qa | 15:01 | |
sdague | yeh, maybe it's just the calls down into create_userrc | 15:01 |
dtroyer | what about sean's dual-stack default? | 15:02 |
dtroyer | https://review.openstack.org/#/c/160856/ | 15:02 |
*** dims__ has joined #openstack-qa | 15:04 | |
*** yfried__ is now known as yfried|afk | 15:09 | |
*** armax has joined #openstack-qa | 15:22 | |
jogo | clarkb: do you have a link showing shelve working across nodes? | 15:22 |
*** dims__ has quit IRC | 15:22 | |
jogo | I spot checked a few cases and didn't see any that worked when moving between nodes | 15:23 |
clarkb | jogo: when I first got the job working | 15:23 |
clarkb | I can go find logs from that time period | 15:23 |
jogo | clarkb: shelve doesn't always move between nodes though | 15:23 |
clarkb | I know | 15:23 |
clarkb | but the fail rate was near 100% when it didn't work | 15:24 |
jogo | if this is a regression that is a really useful piece of information | 15:24 |
clarkb | I then tracked down the bug which thankfully already had a fix in the works and begged nova core to get that in | 15:24 |
jogo | or maybe if this is a multihost related | 15:24 |
clarkb | once that got in the job worked fine | 15:24 |
*** yfried|afk is now known as yfried__ | 15:26 | |
jogo | its possible we didn't notice this since this doesn't happen frequently enough | 15:26 |
jogo | clarkb: well I have more news: | 15:28 |
clarkb | http://logs.openstack.org/39/174139/6/experimental/check-tempest-dsvm-multinode-full/288b165/logs/screen-n-cpu.txt.gz I think that one shelved successfully | 15:28 |
jogo | clarkb: we have other bugs as well http://logs.openstack.org/13/173213/4/check/check-tempest-dsvm-multinode-full/9ac7736/logs/testr_results.html.gz | 15:28 |
clarkb | looks like that log shows the node going down then the other shows it coming back? | 15:28 |
jogo | that is from a job should have passed | 15:28 |
clarkb | jogo: well did you see my comment about the dhcp failures? | 15:29 |
clarkb | I think thats a nova bug too | 15:29 |
clarkb | but need to track it down with a bit more data | 15:29 |
jogo | clarkb: btw https://review.openstack.org/#/c/169449/ | 15:29 |
jogo | is still waiting for a +W | 15:29 |
clarkb | I am wondering if that should go in after my ansible change | 15:30 |
clarkb | also I do not know why it wasn't approved | 15:31 |
jogo | clarkb: you are right the log you sent shows TestShelveInstance-2141082895 working between nodes | 15:31 |
clarkb | jogo: and that run was from yesterday | 15:32 |
jogo | http://logs.openstack.org/13/173213/4/check/check-tempest-dsvm-multinode-full/9ac7736/logs/10.208.198.2-subnode/screen-n-cpu.txt.gz?level=TRACE#_2015-04-17_10_57_46_357 | 15:34 |
jogo | ugg | 15:34 |
jogo | more ebtables issues | 15:34 |
jogo | cburgess: ^ | 15:34 |
cburgess | Grrrr | 15:34 |
cburgess | jogo: Did you merge that other patch we worked on? | 15:35 |
*** macjack has joined #openstack-qa | 15:35 | |
cburgess | jogo: Oh this is cute... thats actually libvirt now telling us it had a race. | 15:35 |
jogo | cburgess: I wouldn't call that cute but yeah | 15:36 |
cburgess | I'm starting to think that we need to have libvirt do all ebtables work and we need to *not* touch ebtables at the nova level. | 15:36 |
jogo | cburgess: yeah ... | 15:36 |
cburgess | Otherwise we will need to have both nova and libvirt use/support the lock file which will require sufficiently new enough versions of libvirt and ebtables. | 15:37 |
jogo | kashyap: ^ | 15:37 |
*** nfedotov has joined #openstack-qa | 15:37 | |
jogo | and it gets ugly quickly | 15:37 |
jogo | lets move this to the nova room cburgess | 15:37 |
cburgess | Or just use a sufficiently old enough version of ebtables where it just ignore the problem. :) | 15:37 |
clarkb | jogo: so can we abandon that test skip? | 15:37 |
clarkb | and focus on fixing these bugs instead? | 15:37 |
kashyap | jogo: 1 moment, on a phone call. Be back in a bit. | 15:38 |
jogo | clarkb: I'll mark it as a WIP for now | 15:38 |
jogo | I think we should time box the fix for this test | 15:38 |
jogo | otherwise revisit it later | 15:38 |
clarkb | what no | 15:39 |
*** Swami has joined #openstack-qa | 15:39 | |
clarkb | this isn't a relatively major bug in nova just prior to release? | 15:39 |
clarkb | nova will just drop nodes on the floor because raisins | 15:39 |
jogo | clarkb: it is fairly big, but not clear if this is a regression or not | 15:41 |
jogo | and its a fairly minor API call | 15:41 |
clarkb | jogo: looking at your ebtables stuff I think that is what breaks shelve | 15:41 |
clarkb | jogo: at least for the job log you linked above | 15:41 |
cburgess | So this is a byproduct of newer kernels and ebtables. If you run nova on old enough kernel/ebtables this isn't an issue. | 15:41 |
clarkb | jogo: so its not a minor nova feature | 15:41 |
clarkb | jogo: its booting nodes in general | 15:41 |
cburgess | For instance.. gate would never have seen this on stock precise. | 15:42 |
clarkb | (also appears that it may be what breaks dhcp) | 15:42 |
clarkb | cburgess: we shouldn't expect deployers to deploy nova on precise :) | 15:42 |
clarkb | it only has 2 years of support left >_> | 15:43 |
cburgess | clarkb: Completely agree, just stating that for regression vs not, old versions of nova would have the same problem on trusty etc. | 15:43 |
clarkb | gotcha | 15:43 |
jogo | clarkb: clarkb so we are talking about two separate bugs | 15:43 |
clarkb | jogo: I think they are related | 15:43 |
jogo | 1) libvirt+ebtables | 15:43 |
sdague | does libvirt always call ebtables via a shell out? | 15:43 |
clarkb | jogo: unless you have specific instances of shelve that fail without ebtables exploding | 15:43 |
jogo | 2) shelve unshelve | 15:43 |
sdague | like... could our fix be an ebtables wrapper that does a big lock | 15:43 |
clarkb | jogo: I have not seen evidence of the shelve unshelve breakage | 15:43 |
jogo | clarkb: yes most cases don't explode with ebtables like this | 15:44 |
clarkb | jogo: other than your link above which is ebtables | 15:44 |
*** Longgeek_ has quit IRC | 15:44 | |
cburgess | sdague: ebtables already supports a lock, its a matter of knowing you have a new enough version of ebtables and having a new enough version of libvirt that supports it. | 15:44 |
*** Guest43836 has quit IRC | 15:44 | |
sdague | cburgess: right, but we don't know that | 15:45 |
sdague | so we can work around it on our side | 15:45 |
sdague | until such time as we can know that | 15:45 |
jogo | clarkb: http://logs.openstack.org/88/174288/1/check/check-tempest-dsvm-multinode-full/3e3be58/console.html | 15:47 |
sdague | anyway, lunch time, later folks | 15:47 |
jogo | clarkb: shelve unshelve break | 15:47 |
openstackgerrit | Merged openstack-dev/devstack: Revert "List all CIRROS ARCH images in image_list.sh" https://review.openstack.org/170934 | 15:47 |
clarkb | jogo: http://logs.openstack.org/88/174288/1/check/check-tempest-dsvm-multinode-full/3e3be58/console.html#_2015-04-16_11_26_00_029 no thats dhcp break | 15:47 |
jogo | clarkb: with no stacktrace | 15:47 |
cburgess | sdague: Yeah the trick is I'm not sure about getting libvirt to use that wrapper. It would probably have supportability issues with different distros (aka I can't image redhat being cool with that). | 15:47 |
jogo | clarkb: yes, dhcp breaks for shelve/unshelve | 15:47 |
clarkb | jogo: its dhcp breaking, so next step is to go look in syslog logs for the requests | 15:47 |
sdague | cburgess: yeh, it could be optional | 15:48 |
jogo | clarkb: agreed. Having two different conversations at the same time here :/ | 15:48 |
clarkb | jogo: ltes back up | 15:48 |
*** yfried__ has quit IRC | 15:48 | |
clarkb | jogo: dhcp breaks in gneral not just for shelve unshelve | 15:48 |
*** enikanorov__ has joined #openstack-qa | 15:48 | |
jogo | cburgess: what about newer libvirt? | 15:48 |
clarkb | jogo: if shelve unshelve breaks and dhcp is involved then that isn't likely due to shelves fault | 15:48 |
clarkb | jogo: instead it is an issue iwth dhcp | 15:49 |
openstackgerrit | Merged openstack-dev/devstack: Remove unused IPv6 setup from DevStack neutron script https://review.openstack.org/161877 | 15:49 |
openstackgerrit | Merged openstack-dev/devstack: Added libxml2-dev package as a pre-requisite when installing tempest. This is required so that devstack can be installed on vanilla Ubuntu systems. https://review.openstack.org/171138 | 15:49 |
clarkb | jogo: I think there is likely a race between nova setting up dhcp rules for the VM and the VM booting | 15:49 |
openstackgerrit | Merged openstack-dev/devstack: Assurance status of rabbitmq is running https://review.openstack.org/168705 | 15:49 |
openstackgerrit | Merged openstack-dev/devstack: Added ceilometer-agent-ipmi support https://review.openstack.org/167090 | 15:49 |
openstackgerrit | Merged openstack-dev/devstack: Switching Sahara to https in case of USE_SSL=True https://review.openstack.org/153741 | 15:49 |
jogo | clarkb: its possible | 15:49 |
openstackgerrit | Merged openstack-dev/devstack: Added support of sahara with tls-proxy service https://review.openstack.org/154303 | 15:49 |
clarkb | jogo: one way to confirm that would be to find dnsmasq logs in syslog for reuqests from that node that are rejected because dnsmasq does not know about that node | 15:49 |
cburgess | jogo: So there is a version of libvirt that supports the lock, not sure of the exact version, it was added sometime after Paris when vish and I brought this up to Berrange. | 15:49 |
cburgess | jogo: Gets back into the whole knowing you have new enough versions and what to do if you don | 15:50 |
cburgess | er.. don't | 15:50 |
jogo | http://logs.openstack.org/88/174288/1/check/check-tempest-dsvm-multinode-full/3e3be58/logs/10.176.200.184-subnode/syslog.txt.gz | 15:50 |
*** tsekiyama has joined #openstack-qa | 15:51 | |
*** enikanorov_ has quit IRC | 15:51 | |
kashyap | cburgess: jogo I think more than half of these issues will be gone if we're using a moderately less ancient version of libvirt. | 15:52 |
jogo | clarkb: Apr 16 11:16:53 devstack-trusty-2-node-rax-iad-2194251-1687 dnsmasq-dhcp[22310]: DHCPDISCOVER(br100) fa:16:3e:fb:3e:3e no address available | 15:52 |
cburgess | jogo, clarkb I don't think we can move all of this into libvirt. Some of it we probably could, but some of it related to floating IPs which could exist locally on the hypervisor (multi_host) or on a seperate node. | 15:52 |
clarkb | jogo: http://logs.openstack.org/88/174288/1/check/check-tempest-dsvm-multinode-full/3e3be58/logs/10.176.200.184-subnode/syslog.txt.gz#_Apr_16_11_16_00 too | 15:53 |
cburgess | kashyap: Yes we could just require a certain version of libvirt and ebtables and say if you don't have them, no locking, your mileage may vary. | 15:53 |
kashyap | cburgess: The thing is day in and day out, I test from newest versions of libvirt and QEMU, and keep wishing we'd move to somewhat newer. | 15:53 |
cburgess | We could provide an "alternate" wrapper script like sdague suggested in those cases with documentation on how to deploy it if you simply can't upgrade. | 15:53 |
kashyap | This is not some legacy version of OpenStack, since this is _upstream_ OpenStack development, | 15:54 |
cburgess | kashyap: No argument hear, we use much newer versions of that stuff in prod. I actually "fixed" this issues about a year ago for us. | 15:54 |
kashyap | I'd expect us to be fairly ahead | 15:54 |
*** sslypushenko has quit IRC | 15:54 | |
kashyap | But that horse of version capabilities has been beaten beyond death on the lists without any solid conclusions. /me stops the rant here :-) | 15:55 |
cburgess | jogo, clarkb The more I look at this, the more I think this is *only* an issue when nova-network and libvirt are on the same host. So multi_host and/or devstack. | 15:55 |
jogo | cburgess kashyap: I want us to use a newer version of libvirt as well | 15:55 |
clarkb | jogo: so I think that is the bug and syslog confirms it | 15:55 |
*** sslypushenko has joined #openstack-qa | 15:55 | |
jogo | clarkb: maybe | 15:55 |
kashyap | jogo: I know you support that view from a recent #openstack-nova conversation | 15:55 |
jogo | clarkb: I am a bit distracted | 15:55 |
kashyap | That allows to focus on _real_ bugs | 15:55 |
jogo | cburgess clarkb: so I have to head out to coachella now ... | 15:55 |
jogo | will be back monday | 15:55 |
clarkb | jogo: have fun, but my -1 still stands on that test :) this appears to be a nova bug which I can write up for better tracking now that we seem to have real info | 15:56 |
* kashyap needs to head out too, if there's a discussion on the list, I'll follow | 15:56 | |
cburgess | jogo: Have fun, I'll think on this some more. I might right a patch on Sunday that tries to use the latest ebtables/libvirt to solve this. Its a bit complicated though. | 15:56 |
cburgess | clarkb This is really a continution of 1316621 | 15:57 |
jogo | clarkb: thanks, yeah I am fine with a -1 on my skip for now | 15:57 |
jogo | especially since we have more information | 15:57 |
jogo | clarkb: can you spearhead the discussion about moving to a new libvirt with cburgess? | 15:57 |
clarkb | cburgess: sorry I may me confusing you with the other conversation jogo and I are having | 15:57 |
cburgess | clarkb: Oh sorry. | 15:58 |
cburgess | My bad. | 15:58 |
clarkb | jogo: cburgess we are not going to be able to just upgrade libvirt everywhere | 15:58 |
jogo | clarkb: as hunting down bugs in an anciant libvirt isn't really a win | 15:58 |
clarkb | jogo: but there is no way today or tomorrow to just "use latest libvirt" | 15:58 |
cburgess | So again.. its not really a libvirt bug. It has to do with how the kernel changed to handle certain calls for net filter related things. | 15:58 |
jogo | clarkb: what about less old libvirt but not 'ewest' | 15:58 |
clarkb | I think even russellb found that it was a bit of trouble | 15:58 |
clarkb | jogo: even that isn't really possible | 15:58 |
clarkb | we don't have libvirt packages for f2X, centos7, precise, trusty | 15:59 |
jogo | anyway I have to head out, I am interested to know what are options actually are | 15:59 |
* jogo gets ready for coachella | 15:59 | |
clarkb | and until someone volunteers to do that work it is problematic | 15:59 |
cburgess | Well... so... 2 possible solution here then.. | 15:59 |
cburgess | Or actually.. we do both. | 15:59 |
cburgess | 1) We fix it properly in the code assuming new versions | 15:59 |
cburgess | 2) We also provide a work-around script like sdague mentioned that we can enable as a work around and we configure the gate to use that. | 16:00 |
cburgess | but fundamentally its a race between nova and libvirt. We can't fix that unless we get libvirt to do *something*, even if that is call our wrapper script. | 16:00 |
*** armax has quit IRC | 16:01 | |
clarkb | cburgess: how new of libvirt are we talking? and is it newer than what is in f21, centos7 and ubuntu trusty? | 16:02 |
*** safchain has quit IRC | 16:02 | |
cburgess | clarkb: Fairly now.. http://libvirt.org/git/?p=libvirt.git;a=commit;h=dc33e6e4a5a5d429198b2c63ff6b63729353e2cf, looks like 1.2.11 according to a comment from mriedem in the bug. | 16:04 |
cburgess | er fairly new | 16:04 |
clarkb | ya so that isn't going to be sanely possible until we have people building packages for all the things | 16:05 |
clarkb | mordred: ^ | 16:05 |
clarkb | russellb did have a job at one point that built libvirt from source on f20 iirc and even that had trouble keeping up. | 16:05 |
cburgess | OK well, like I said, we can basically provide 2 fixes in the code. One that does the right thing with the right version and one that allows you to use a wrapper script. The wrapper script will require some documentation though since you will have to make system level changes to get libvirt to call it too. | 16:06 |
* mordred reads scrollback | 16:07 | |
cburgess | mordred: This is just the same old we need newer libvirt because.. reasons. | 16:07 |
mordred | yah | 16:07 |
*** dkranz has quit IRC | 16:07 | |
cburgess | In this case the reason is a race we can't really work around any other way.. but still its reasons. | 16:07 |
mordred | and we need the general ability to be able to express such a need | 16:08 |
mordred | yup | 16:08 |
clarkb | however | 16:08 |
*** yamahata has quit IRC | 16:08 | |
clarkb | it is also pretty important to recognize that if your users can't use centos7 and ubuntu trusty libvirt they aren't likely to be happy users | 16:08 |
cburgess | Not to down play that this a fairly ugly race and bug. | 16:08 |
mordred | clarkb: I'm not sure I agree | 16:08 |
clarkb | this is a different situation than "we would like to be able to test nova's functionality with newer libvirt features" | 16:09 |
mordred | clarkb: I think if it's important to a user to use trusty libvirt, it'll also be important to that user to use trusty nova | 16:09 |
clarkb | this is "well we wrote a bug around libvirt that we know about BUT everyone just upgrade libvirt" | 16:09 |
clarkb | mordred: yes but trusty nova is broken too | 16:09 |
mordred | if the user is willing to use a nova that was not shipped with trusty | 16:09 |
clarkb | mordred: and so is cnetos7 nov | 16:09 |
cburgess | Everyone is broken. | 16:09 |
mordred | the user needs to be willing to use a newer libvirt too | 16:09 |
mordred | because the two are pretty tied together | 16:09 |
mordred | and being willing to do one and not the other is bananas | 16:09 |
clarkb | mordred: no one is saying do one and not the other | 16:10 |
mordred | 16:08:35 clarkb | it is also pretty important to recognize that if your users can't use centos7 and ubuntu trusty libvirt they aren't likely to be happy users | 16:10 |
cburgess | As ugly and disgusting as it sounds to me I think sdague wrapper script might be the only solution for those who can't upgrade. | 16:10 |
clarkb | mordred: I am saying there is a pretty big flaw in all novas | 16:10 |
clarkb | mordred: regardless of libvirt version | 16:10 |
mordred | ok | 16:10 |
clarkb | mordred: yes with centos7 and trusty nova | 16:10 |
*** pcaruana has quit IRC | 16:10 | |
cburgess | clarkb: Assuming a new enough kernel too. The flaw doesn't exist before a certain kernel rev (can't recall off the top of my head, maybe 3.13). | 16:10 |
clarkb | ok so maybe just all trusty users then | 16:11 |
cburgess | Point being.. its a bad bug. I agree. | 16:11 |
cburgess | So I think we have to provide the proper fix, and a work around fix. The gate will have to use the work around for now as well *most* distro customers. | 16:11 |
*** sabeen2 has quit IRC | 16:11 | |
*** e0ne has quit IRC | 16:12 | |
clarkb | mordred: but the distinction is important because if the only place our software works is on our test bed then we haven't done a good job | 16:12 |
clarkb | cburgess: and ya it should be straightforward to have devstack install the workaround if it detect it is necessary | 16:13 |
clarkb | cburgess: and that will get it into the gate while we sort out ability to test latest/newer/different libvirt | 16:13 |
*** jlanoux has quit IRC | 16:14 | |
mordred | clarkb: totally agree | 16:16 |
mordred | clarkb: which is why I think we can't just do a one-off solution | 16:16 |
mordred | clarkb: but need to have a fully fleshed out and considered mechanism | 16:16 |
*** macjack has quit IRC | 16:17 | |
*** marcusvrn has joined #openstack-qa | 16:17 | |
*** luqas has quit IRC | 16:18 | |
*** salv-orl_ has quit IRC | 16:19 | |
*** mriedem1 has joined #openstack-qa | 16:19 | |
cburgess | clarkb: OK I'll talk to jogo on monday and if I have time today/this weekend I'll work on some type of fix. I need to even think about what the wrapper needs to do. Basically use oslo.concurrency to do the locking and exec of ebtables. | 16:20 |
*** subscope has joined #openstack-qa | 16:20 | |
*** mriedem has quit IRC | 16:21 | |
*** marcusvrn1 has joined #openstack-qa | 16:22 | |
*** marcusvrn2 has joined #openstack-qa | 16:22 | |
*** marcusvrn has quit IRC | 16:23 | |
*** marcusvrn3 has joined #openstack-qa | 16:23 | |
cburgess | Looks like we can write the wrapper to mimic ebtables with --concurrent such that new enough libvirts will detect it and do the right thing. We can then have nova detect if it supports --concurrent as well and if it doesn't log that a user will need to deploy the wrapper work around and provide a link to the docs about it. | 16:24 |
*** salv-orlando has joined #openstack-qa | 16:24 | |
*** dims__ has joined #openstack-qa | 16:24 | |
clarkb | cburgess: jogo filed https://bugs.launchpad.net/nova/+bug/1445569 for the dhcp thing | 16:25 |
openstack | Launchpad bug 1445569 in OpenStack Compute (nova) "No dhcp lease after shelve unshelve" [Undecided,New] | 16:25 |
clarkb | I haven't been able to say if it is specific to shelve unshelve yet, but hopefully provided enough info there for someone with nova familiarity to figure it out quickly | 16:25 |
*** tkammer has quit IRC | 16:26 | |
cburgess | clarkb: OK I haven't looked at that one. I | 16:26 |
*** marcusvrn1 has quit IRC | 16:26 | |
cburgess | I can try and poke at it if I have time today, short day for me, have to meet a repair man to get my oven fixed. | 16:26 |
*** marcusvrn2 has quit IRC | 16:26 | |
*** patrickeast has joined #openstack-qa | 16:27 | |
cburgess | clarkb: Taking a quick look the proper calls seem to be in the code to update dnsmasq with the network info. Didn't do a deep trace. | 16:29 |
*** tkammer has joined #openstack-qa | 16:30 | |
*** yamahata has joined #openstack-qa | 16:31 | |
cburgess | clarkb: Does that shelve/unshelve fail everytime? | 16:33 |
clarkb | cburgess: no | 16:33 |
*** Nic has joined #openstack-qa | 16:33 | |
cburgess | Is shelve offload called as part of the test? | 16:34 |
*** nfedotov has quit IRC | 16:37 | |
*** dkranz has joined #openstack-qa | 16:38 | |
clarkb | cburgess: https://git.openstack.org/cgit/openstack/tempest/tree/tempest/scenario/test_shelve_instance.py#n57 appears to yes | 16:40 |
cburgess | clarkb: k... this is weird.. trying to understand this code flow. | 16:41 |
*** armax has joined #openstack-qa | 16:46 | |
*** dims__ is now known as dimsum__ | 16:50 | |
*** ajmiller__ is now known as ajmiller | 16:53 | |
*** jlibosva has quit IRC | 16:55 | |
*** Nic has quit IRC | 16:56 | |
*** armax has quit IRC | 16:58 | |
*** ihrachyshka has quit IRC | 17:00 | |
*** armax has joined #openstack-qa | 17:03 | |
*** dimtruck is now known as zz_dimtruck | 17:05 | |
*** salv-orlando has quit IRC | 17:06 | |
*** suneelb has joined #openstack-qa | 17:09 | |
*** catohornet has quit IRC | 17:09 | |
*** harlowja_away is now known as harlowja | 17:17 | |
*** luqas has joined #openstack-qa | 17:19 | |
*** Nic has joined #openstack-qa | 17:20 | |
*** luqas has quit IRC | 17:24 | |
*** salv-orlando has joined #openstack-qa | 17:29 | |
*** catohornet has joined #openstack-qa | 17:35 | |
openstackgerrit | Merged openstack-dev/devstack: Remove keystone public/admin_endpoint options https://review.openstack.org/168770 | 17:36 |
*** e0ne has joined #openstack-qa | 17:37 | |
*** mriedem1 is now known as mriedem | 17:38 | |
openstackgerrit | Merged openstack-dev/devstack: Fixing n-crt removal from stackrc https://review.openstack.org/173493 | 17:42 |
*** jordanP has quit IRC | 17:43 | |
*** gfidente is now known as gfidente|afk | 17:45 | |
*** e0ne is now known as e0ne_ | 17:45 | |
*** achanda has joined #openstack-qa | 17:48 | |
*** e0ne_ is now known as e0ne | 17:52 | |
*** e0ne is now known as e0ne_ | 17:57 | |
*** vponomaryov has quit IRC | 18:01 | |
*** armax has quit IRC | 18:05 | |
*** aix has quit IRC | 18:06 | |
openstackrecheck | openstack/cinder change: https://review.openstack.org/174783 failed gate-tempest-dsvm-full in the gate queue with an unrecognized error | 18:11 |
mtreinish | wow, ddt makes some ugly test_ids | 18:17 |
*** Sukhdev has joined #openstack-qa | 18:19 | |
*** armax has joined #openstack-qa | 18:20 | |
*** mlavalle has joined #openstack-qa | 18:24 | |
*** leakypipes has quit IRC | 18:25 | |
*** rushiagr is now known as rushiagr_away | 18:26 | |
*** dustins_ has joined #openstack-qa | 18:26 | |
*** annashen has joined #openstack-qa | 18:27 | |
*** johnthetubaguy is now known as zz_johnthetubagu | 18:28 | |
*** andreykurilin__ has joined #openstack-qa | 18:29 | |
*** dustins has quit IRC | 18:29 | |
*** e0ne_ is now known as e0ne | 18:30 | |
*** cdent has quit IRC | 18:36 | |
*** tosky has quit IRC | 18:42 | |
*** achanda has quit IRC | 18:46 | |
*** annashen has quit IRC | 18:47 | |
mtreinish | dkranz: if you get a sec, I've got a bunch of doc patches up: https://review.openstack.org/#/q/status:open+project:openstack/tempest+branch:master+topic:tempest-config-guide,n,z | 18:51 |
mtreinish | some have -1s but I'd like to just update in a batch | 18:52 |
mtreinish | so if you've got more comments :) | 18:52 |
mtreinish | hogepodge: ^^^ you too :) | 18:54 |
*** achanda has joined #openstack-qa | 18:56 | |
*** salv-orlando has quit IRC | 18:57 | |
*** e0ne has quit IRC | 18:58 | |
*** marcusvrn3 has quit IRC | 19:00 | |
*** marun has quit IRC | 19:03 | |
dkranz | mtreinish: on it in a few | 19:13 |
mtreinish | dkranz: cool thanks, no rush | 19:13 |
sdague | mtreinish: there are 2 grenade patches you could approve before the weekend - https://review.openstack.org/#/c/174302/3 :) | 19:18 |
sdague | ok, running away, arwen is waking up | 19:18 |
mtreinish | sdague: done | 19:19 |
*** bnemec is now known as beekneemech | 19:22 | |
pc_m | mtreinish: hi | 19:22 |
mtreinish | pc_m: hi | 19:23 |
pc_m | mtreinish: I'm hitting an issue with the VPN functional job that I'm hoping you may have some thoughts on. | 19:24 |
*** suneelb has quit IRC | 19:24 | |
pc_m | mtreinish: Are the gate-hook.sh scripts supposed to run in strict bash mode? | 19:24 |
mtreinish | pc_m: you mean the strict posix mode? | 19:25 |
mtreinish | or something else | 19:25 |
pc_m | mtreinish: The equivalent of bash with set -u. | 19:25 |
pc_m | mtreinish: It seems like the VPN gate-hook.sh script is running in strict mode, and the neutron one is not. I cannot figure out where this could be getting set as the two repos have very similar files for everything. | 19:27 |
*** dustins_ has quit IRC | 19:27 | |
*** ajo has quit IRC | 19:28 | |
*** ajo has joined #openstack-qa | 19:28 | |
*** ajo has quit IRC | 19:28 | |
mtreinish | pc_m: well looking at the job definition it's set to call bash -xe | 19:30 |
mtreinish | pc_m: http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/neutron-vpnaas.yaml#n28 | 19:30 |
openstackgerrit | Merged openstack-dev/devstack: Add "passed" and "failed" functions https://review.openstack.org/174682 | 19:30 |
mtreinish | which is what gets passed to: http://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/functions.sh#n46 | 19:30 |
pc_m | mtreinish: Yeah, same as neutron.yaml. | 19:30 |
*** yamahata has quit IRC | 19:31 | |
mtreinish | so unless something inside the scripts (or something it's calling is calling set -u) I'm not sure | 19:31 |
openstackgerrit | Merged openstack-dev/devstack: Use unittest help in test_ip.sh https://review.openstack.org/174683 | 19:31 |
openstackgerrit | Merged openstack-dev/devstack: Fix return of test_ini_config & test_meta_config https://review.openstack.org/174684 | 19:31 |
openstackgerrit | Merged openstack-dev/devstack: Move function.sh to test_functions.sh https://review.openstack.org/174685 | 19:31 |
openstackgerrit | Merged openstack-dev/devstack: Fix die_if_not_set tests https://review.openstack.org/174686 | 19:32 |
openstackgerrit | Merged openstack-dev/devstack: Convert test_functions.sh to use unittest helpers https://review.openstack.org/174687 | 19:32 |
openstackgerrit | Merged openstack-dev/devstack: Remove old comment in run_tests.sh https://review.openstack.org/174688 | 19:32 |
openstackgerrit | Merged openstack-dev/devstack: Create config file in merge_config_file https://review.openstack.org/174678 | 19:32 |
pc_m | mtreinish: The VPN repo cloned and modified the neutron.yaml, and ditto for the gate-hook.sh. So they seem to be the same, but when I run vpn functional job, it is in -u mode. | 19:32 |
pc_m | mtreinish: So I don't know how it is getting turned on, in the vpn case. | 19:34 |
pc_m | mtreinish: Is it possible that some other set option would automatically set -u? | 19:34 |
mtreinish | pc_m: I assume it is one of these sources: http://git.openstack.org/cgit/openstack/neutron-vpnaas/tree/neutron_vpnaas/tests/contrib/gate_hook.sh#n25 | 19:35 |
mtreinish | but I didn't trace through it all, but I could see set -u being called by sourcing a bunch of things from devstack | 19:35 |
pc_m | mtreinish: In the current VPN tree, it's not running with -u (as everything works fine). The gate-hook stacks DevStack via the devstack-vm-gate.sh script | 19:36 |
pc_m | mtreinish: In my patchset, I'm trying to do what Neutron has done, and only configure devstack, but not actually stack. | 19:37 |
pc_m | mtreinish: Like neutron, it ends up calling some devstack scripts, that assume you are NOT running in -u mode. For neutron, it works, for VPN, it fails with an unbound variable error. | 19:38 |
mtreinish | pc_m: so it's your patch that's failing do you have a link? | 19:39 |
pc_m | mtreinish: I guess I could unset -u, but wanted to understand why neutron works. | 19:39 |
pc_m | mtreinish: yes... https://review.openstack.org/#/c/168115/15 | 19:39 |
pc_m | Here's the failing log... http://logs.openstack.org/15/168115/17/check/check-neutron-vpnaas-dsvm-functional/261ea6d/console.html | 19:40 |
*** subscope has quit IRC | 19:40 | |
pc_m | mtreinish: It calls a method _get_package_list, indirectly, and that method expects a $1 arg, and then checks to see if it is empty. Being in -u mode, the job fails. | 19:41 |
mtreinish | pc_m: http://logs.openstack.org/15/168115/17/check/check-neutron-vpnaas-dsvm-functional/261ea6d/console.html#_2015-04-17_11_33_47_394 | 19:41 |
pc_m | mtreinish: If you look at any Neutron commit, the same invocation of the script passes. | 19:41 |
mtreinish | this source: source /opt/stack/new/neutron/tools/deploy_rootwrap.sh /opt/stack/new/neutron /opt/stack/new/neutron-vpnaas/.tox/dsvm-functional/etc /opt/stack/new/neutron-vpnaas/.tox/dsvm-functional/bin | 19:41 |
mtreinish | is calling set -eu | 19:41 |
pc_m | mtreinish: Ah! I was looking for -u in the log. | 19:42 |
pc_m | mtreinish: Thanks. I was going crazy. | 19:42 |
mtreinish | sure, np | 19:42 |
*** ibiris is now known as ibiris_away | 19:45 | |
mtreinish | dpaterson: hey, if you get a chance could you post up your cli work? I think I'll have some time next week to play with it | 19:48 |
mtreinish | even if doesn't come close to working it'd be good to have the reviews up | 19:48 |
*** annashen has joined #openstack-qa | 19:48 | |
*** madhu_ak has joined #openstack-qa | 19:49 | |
*** salv-orlando has joined #openstack-qa | 19:49 | |
dpaterson | mtreinish: yes I will this weekend, sorry for delay, up to eyeballs in other stuff. | 19:50 |
*** achanda has quit IRC | 19:50 | |
mtreinish | dpaterson: sure, no worries. I just wanted to make sure it didn't fall through the cracks :) | 19:50 |
dpaterson | mtreinish: Sure, and thanks | 19:51 |
*** annashen has quit IRC | 19:53 | |
*** patrickeast has quit IRC | 19:53 | |
*** tkammer has quit IRC | 19:55 | |
madhu_ak | Hello | 19:56 |
madhu_ak | , I have created tempest tests in neutron-lbaas tree and it perfectly working as designed for admin and non-admin users..the resources are indeed setup and cleaned up against devstack instances. For admin tests, when i run the tests for many times and upon completion, I could see bunch of tenant_id's when I randomly check 'keystone tenant-list'. | 19:56 |
madhu_ak | I am not sure where is the best place to write a piece of code for deleting the tenant_ids.. | 19:57 |
madhu_ak | upon researching, I found this: https://github.com/stackforge/ospurge, I am not familiar with it though. Do we use ospurge for other projects? | 19:57 |
*** annashen has joined #openstack-qa | 20:00 | |
madhu_ak | can anybody help? | 20:02 |
*** gfidente|afk has quit IRC | 20:09 | |
*** artom has quit IRC | 20:11 | |
mtreinish | madhu_ak: if the resources aren't being cleaned up then you did something wrong in your setupclass/teardownclass pieces | 20:11 |
mtreinish | because it should always be tearing down whatever it creates | 20:12 |
mtreinish | you don't want to have users need to rely on ospurge or tempest's cleanup: http://git.openstack.org/cgit/openstack/tempest/tree/tempest/cmd/cleanup.py to cleanup after your tests | 20:12 |
*** jogo has quit IRC | 20:14 | |
madhu_ak | so, having resource_cleanup method will clear the tenant_ids as well? | 20:14 |
*** dkranz has quit IRC | 20:14 | |
mtreinish | madhu_ak: you should look at the tempest code around using tenant isolation in test.py for setupclass and teardownclass and look at what existing tempest tests are doing | 20:15 |
mtreinish | you'll see how to invoke things to ensure they get cleaned up | 20:15 |
madhu_ak | oh, thanks for that info..will look into it.. I think calling tearDownClass method will cleanup the resources | 20:17 |
*** Sukhdev has quit IRC | 20:19 | |
madhu_ak | btw, do we have sample code for tearDownClass or resource clean_up for admin test cases, maybe are we using like this in neutron/compute/or other projects? | 20:20 |
*** openstackgerrit has quit IRC | 20:22 | |
*** openstackgerrit has joined #openstack-qa | 20:22 | |
openstackgerrit | Merged openstack-dev/grenade: Comment function files https://review.openstack.org/174302 | 20:23 |
openstackgerrit | Merged openstack-dev/grenade: ensure that grenade db is fresh on each run https://review.openstack.org/174303 | 20:23 |
openstackgerrit | Merged openstack-dev/grenade: update README.rst to reflect current reality https://review.openstack.org/173817 | 20:23 |
*** marun has joined #openstack-qa | 20:25 | |
*** achanda has joined #openstack-qa | 20:27 | |
*** Sukhdev has joined #openstack-qa | 20:28 | |
*** annashen has quit IRC | 20:28 | |
*** andreykurilin___ has joined #openstack-qa | 20:28 | |
*** andreykurilin__ has quit IRC | 20:29 | |
*** annashen has joined #openstack-qa | 20:32 | |
*** mlavalle has quit IRC | 20:34 | |
*** annashen_ has joined #openstack-qa | 20:44 | |
*** annashen has quit IRC | 20:44 | |
*** luqas has joined #openstack-qa | 20:57 | |
madhu_ak | mtreinish: thanks for that, I just used resource_cleanup method, its deleting the tenant_ids :-) | 21:01 |
*** armax has quit IRC | 21:01 | |
*** luqas has quit IRC | 21:01 | |
openstackgerrit | Swaminathan Vasudevan proposed openstack-infra/devstack-gate: DVR Multinode test patch to separate ctlr and compute https://review.openstack.org/175056 | 21:05 |
-openstackstatus- NOTICE: Gerrit will be unavailable between 22:00 and 23:59 UTC for project renames and a database update. | 21:05 | |
*** dpaterson has quit IRC | 21:06 | |
*** mriedem has quit IRC | 21:07 | |
*** BadCub is now known as Party_Bear | 21:17 | |
*** pc_m has quit IRC | 21:18 | |
*** shardy has quit IRC | 21:20 | |
*** openstackgerrit has quit IRC | 21:23 | |
*** openstackgerrit has joined #openstack-qa | 21:23 | |
openstackrecheck | openstack/nova change: https://review.openstack.org/174524 failed gate-tempest-dsvm-postgres-full in the gate queue with an unrecognized error | 21:26 |
*** dkranz has joined #openstack-qa | 21:26 | |
*** erlon has quit IRC | 21:31 | |
*** annashen_ has quit IRC | 21:36 | |
*** annashen has joined #openstack-qa | 21:37 | |
*** ArxCruz has joined #openstack-qa | 21:41 | |
*** bknudson has quit IRC | 21:44 | |
*** armax has joined #openstack-qa | 21:47 | |
dkranz | mtreinish: I'm reviewing your doc patches (thank you!) and am wondering how much grammatical nitpickiness is appropriate. Do you want a -1 and correction for every little thing? | 21:48 |
*** jamielennox|away is now known as jamielennox | 21:48 | |
dkranz | mtreinish: I'm ok either way | 21:49 |
mtreinish | dkranz: I'm gonna have to rebase the whole stack probably so -1 away so the stat trackers will pick it up :) | 21:52 |
*** mlavalle has joined #openstack-qa | 21:58 | |
*** tkammer has joined #openstack-qa | 22:02 | |
*** jecarey has quit IRC | 22:04 | |
*** Swami has quit IRC | 22:04 | |
-openstackstatus- NOTICE: Gerrit is unavailable until 23:59 UTC for project renames and a database update. | 22:05 | |
-openstackstatus- NOTICE: Gerrit is unavailable until 23:59 UTC for project renames and a database update. | 22:08 | |
*** ChanServ changes topic to "Gerrit is unavailable until 23:59 UTC for project renames and a database update." | 22:08 | |
dkranz | mtreinish: ok. I ran out of time and gerrit is down, but I will just pull the last one and fix the issues. Gerrit is not a very good UI for marking up text while editing :) | 22:13 |
*** andreykurilin___ has quit IRC | 22:13 | |
*** annashen has quit IRC | 22:15 | |
*** annashen has joined #openstack-qa | 22:16 | |
*** jgrimm is now known as zz_jgrimm | 22:20 | |
*** Sukhdev has quit IRC | 22:28 | |
*** dboik_ has quit IRC | 22:41 | |
*** davideagnello has joined #openstack-qa | 22:41 | |
*** dboik has joined #openstack-qa | 22:41 | |
*** annashen has quit IRC | 22:41 | |
*** ArxCruz has quit IRC | 22:42 | |
*** Sukhdev has joined #openstack-qa | 22:51 | |
*** achanda has quit IRC | 22:54 | |
*** annashen has joined #openstack-qa | 22:54 | |
*** aysyd has quit IRC | 22:56 | |
*** achanda has joined #openstack-qa | 22:56 | |
*** dboik has quit IRC | 23:02 | |
*** ChanServ changes topic to "All Things QA..." | 23:05 | |
-openstackstatus- NOTICE: Gerrit is available again. | 23:05 | |
*** jhenner has quit IRC | 23:09 | |
*** patrickeast has joined #openstack-qa | 23:10 | |
*** achanda has quit IRC | 23:11 | |
*** annashen has quit IRC | 23:15 | |
*** davideagnello has quit IRC | 23:15 | |
*** achanda has joined #openstack-qa | 23:15 | |
*** mlavalle has quit IRC | 23:20 | |
*** Swami has joined #openstack-qa | 23:28 | |
*** dboik has joined #openstack-qa | 23:29 | |
*** jamielennox is now known as jamielennox|away | 23:30 | |
*** flaper87 has quit IRC | 23:38 | |
*** ajmiller has quit IRC | 23:45 | |
*** patrickeast has quit IRC | 23:50 | |
*** dboik has quit IRC | 23:57 | |
*** weshay has quit IRC | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!