Friday, 2014-06-06

*** yamahata has quit IRC00:00
*** levi_b has quit IRC00:02
*** matsuhashi has joined #openstack-qa00:03
*** stevebaker has quit IRC00:04
*** stevebaker has joined #openstack-qa00:05
*** catohornet has quit IRC00:05
*** masayuki_ has joined #openstack-qa00:10
*** masayuki_ has quit IRC00:10
*** masayukig has quit IRC00:10
*** masayukig has joined #openstack-qa00:17
*** catohornet has joined #openstack-qa00:27
*** dmorita has joined #openstack-qa00:27
*** zhikunliu has joined #openstack-qa00:27
*** GMann has joined #openstack-qa00:30
openstackgerritA change was merged to openstack-infra/elastic-recheck: Add query for ceilometer test_ordination_assign timeout bug 1326855  https://review.openstack.org/9816000:36
*** openstackrecheck has quit IRC00:37
*** openstackrecheck has joined #openstack-qa00:37
openstackgerritGhanshyam Mann proposed a change to openstack/tempest: Check create/get/delete V2 server_group attributes  https://review.openstack.org/9506400:53
*** TravT has quit IRC00:54
*** malini_afk is now known as malini00:58
*** dims__ has quit IRC01:01
*** aimon_ has joined #openstack-qa01:03
*** malini is now known as malini_afk01:06
openstackgerritGhanshyam Mann proposed a change to openstack/tempest: Verify V2 list server_group API attributes  https://review.openstack.org/9506501:08
*** yamahata has joined #openstack-qa01:08
*** salv-orlando has quit IRC01:10
*** mkollaro has quit IRC01:14
openstackrecheckopenstack/sahara change: https://review.openstack.org/97376 failed because of: gate-tempest-dsvm-postgres-full: https://bugs.launchpad.net/bugs/92185801:14
*** yamahata has quit IRC01:15
*** yamahata has joined #openstack-qa01:15
*** nati_uen_ has quit IRC01:21
*** nati_ueno has joined #openstack-qa01:21
*** levi_b has joined #openstack-qa01:24
*** levi_b has quit IRC01:29
*** maixmus has joined #openstack-qa01:30
openstackgerritIan Wienand proposed a change to openstack-infra/devstack-gate: Use root to write syslog from journalctl  https://review.openstack.org/9828301:33
*** maixmus has quit IRC01:34
openstackgerritIan Wienand proposed a change to openstack-infra/devstack-gate: Use root to write syslog from journalctl  https://review.openstack.org/9828301:38
*** nosnos has joined #openstack-qa01:46
openstackgerritIan Wienand proposed a change to openstack-infra/devstack-gate: Fix ntp restart for Fedora  https://review.openstack.org/9828802:10
openstackgerritIan Wienand proposed a change to openstack-infra/devstack-gate: Fix ntp restart for Fedora  https://review.openstack.org/9828802:11
openstackrecheckopenstack/horizon change: https://review.openstack.org/81502 failed gate-tempest-dsvm-full in the gate queue with an unrecognized error02:11
*** morganfainberg is now known as morganfainberg_Z02:14
openstackgerritAnita Kuno proposed a change to openstack-infra/elastic-recheck: Add query for nova test_volume_boot_pattern bug 1327020  https://review.openstack.org/9829002:16
*** chen has quit IRC02:19
*** mmaglana has joined #openstack-qa02:21
*** morganfainberg_Z is now known as morganfainberg02:28
openstackgerritAndrey Pavlov proposed a change to openstack/tempest: Add 'Member' role to all created users  https://review.openstack.org/9646002:29
openstackgerritAndrey Pavlov proposed a change to openstack/tempest: fix usage of allow_tenant_isolation  https://review.openstack.org/9713902:29
*** morganfainberg is now known as morganfainberg_Z02:42
*** morganfainberg_Z is now known as morganfainberg02:43
*** harlowja is now known as harlowja_away02:46
*** mmaglana has quit IRC03:01
*** mmaglana has joined #openstack-qa03:01
*** mmaglana has quit IRC03:05
*** mmaglana has joined #openstack-qa03:06
*** GMann has quit IRC03:06
*** levi_b has joined #openstack-qa03:12
*** matsuhashi has quit IRC03:13
*** nosnos has quit IRC03:13
*** nosnos has joined #openstack-qa03:13
openstackrecheckopenstack/oslo.db change: https://review.openstack.org/93414 failed gate-tempest-dsvm-full in the gate queue with an unrecognized error03:14
*** matsuhashi has joined #openstack-qa03:14
*** matsuhashi has quit IRC03:14
*** levi_b has quit IRC03:16
*** nosnos has quit IRC03:17
*** nosnos has joined #openstack-qa03:31
*** matsuhashi has joined #openstack-qa03:38
*** nosnos has quit IRC03:39
*** nosnos has joined #openstack-qa03:40
*** matsuhashi has quit IRC03:48
*** matsuhashi has joined #openstack-qa03:56
*** matsuhashi has quit IRC03:56
*** nosnos has quit IRC04:00
*** Poornima has joined #openstack-qa04:01
*** matsuhashi has joined #openstack-qa04:04
*** mmaglana has quit IRC04:06
*** mmaglana has joined #openstack-qa04:07
*** mmaglana has quit IRC04:12
openstackgerritMh Raies proposed a change to openstack/tempest: Optimization and response status code update  https://review.openstack.org/8823304:13
*** Madan has joined #openstack-qa04:20
*** nosnos has joined #openstack-qa04:21
openstackgerritMh Raies proposed a change to openstack/tempest: Optimization and response status code update  https://review.openstack.org/8823304:23
openstackgerritGhanshyam Mann proposed a change to openstack/tempest: Adds test for Sec group default rule Nova V2 API  https://review.openstack.org/8792404:24
openstackgerritafazekas proposed a change to openstack-infra/elastic-recheck: Add query for 1244457  https://review.openstack.org/9829704:28
*** k4n0 has joined #openstack-qa04:32
*** Longgeek has joined #openstack-qa04:35
*** amotoki has joined #openstack-qa04:43
*** coolsvap|afk is now known as coolsvap04:56
*** ildikov has quit IRC04:56
*** ianw has quit IRC04:59
*** ianw has joined #openstack-qa04:59
*** ianw has quit IRC04:59
*** ianw has joined #openstack-qa05:00
*** flwang has quit IRC05:03
*** hockeynut has quit IRC05:03
*** levi_b has joined #openstack-qa05:03
*** cyeoh has quit IRC05:04
*** wendar has quit IRC05:04
*** jvrbanac has quit IRC05:04
*** wendar has joined #openstack-qa05:05
*** flwang has joined #openstack-qa05:05
*** jvrbanac has joined #openstack-qa05:05
*** hockeynut has joined #openstack-qa05:05
*** yamahata has quit IRC05:15
*** adalbas has quit IRC05:15
*** eezhova has quit IRC05:15
*** nsaje has quit IRC05:15
*** nati_ueno has quit IRC05:15
*** dosaboy has quit IRC05:15
*** mdenny has quit IRC05:15
*** mwagner_lap has quit IRC05:15
*** Pico has quit IRC05:15
*** gabriel-bezerra has quit IRC05:15
*** masayukig has quit IRC05:15
*** sthaha has quit IRC05:15
*** marun has quit IRC05:15
*** ilyashakhat has quit IRC05:15
*** bauzas has quit IRC05:15
*** rossella_s has quit IRC05:15
*** DinaBelova has quit IRC05:15
*** eglynn-office has quit IRC05:15
*** danfinch has quit IRC05:15
*** mrodden has quit IRC05:15
*** asselin has quit IRC05:15
*** jamielennox has quit IRC05:15
*** locke105 has quit IRC05:15
*** jeblair has quit IRC05:15
*** dansmith has quit IRC05:15
*** NithyaG_afk has quit IRC05:15
*** lifeless has quit IRC05:15
*** mtreinish has quit IRC05:15
*** dtroyer has quit IRC05:15
*** Shrews has quit IRC05:15
*** mikal has quit IRC05:15
*** shardy has quit IRC05:15
*** pleia2 has quit IRC05:15
*** psedlak has quit IRC05:15
*** malini_afk has quit IRC05:15
*** SergeyLukjanov has quit IRC05:15
*** sbadia has quit IRC05:15
*** raies has quit IRC05:15
*** boris-42 has quit IRC05:15
*** morganfainberg has quit IRC05:15
*** gema has quit IRC05:15
*** jogo has quit IRC05:15
*** Madan has quit IRC05:15
*** aimon_ has quit IRC05:15
*** fbo_away has quit IRC05:15
*** tteggel has quit IRC05:15
*** enikanorov has quit IRC05:15
*** bnemec has quit IRC05:15
*** peterstac has quit IRC05:15
*** sdague has quit IRC05:15
*** amotoki has quit IRC05:15
*** openstackrecheck has quit IRC05:15
*** mkoderer has quit IRC05:15
*** _afazekas_slp has quit IRC05:15
*** vponomaryov has quit IRC05:15
*** enikanorov_ has quit IRC05:15
*** esmute has quit IRC05:15
*** kmartin has quit IRC05:15
*** cschwede_ has quit IRC05:15
*** ianw has quit IRC05:15
*** zhikunliu has quit IRC05:15
*** dmorita has quit IRC05:15
*** yfried has quit IRC05:15
*** StevenK has quit IRC05:15
*** ruhe has quit IRC05:15
*** sileht has quit IRC05:15
*** zul has quit IRC05:15
*** beisner has quit IRC05:15
*** comstud has quit IRC05:15
*** rahmu has quit IRC05:15
*** adam_g has quit IRC05:15
*** levi_b has quit IRC05:15
*** matsuhashi has quit IRC05:15
*** dpaterson has quit IRC05:15
*** openstackgerrit has quit IRC05:15
*** asvechnikov has quit IRC05:15
*** zaro has quit IRC05:15
*** yamahata_ has quit IRC05:15
*** Abhijeet has joined #openstack-qa05:27
*** psharma has joined #openstack-qa05:27
*** cyeoh has joined #openstack-qa05:27
*** ianw has joined #openstack-qa05:27
*** amotoki has joined #openstack-qa05:27
*** Madan has joined #openstack-qa05:27
*** matsuhashi has joined #openstack-qa05:27
*** nati_ueno has joined #openstack-qa05:27
*** yamahata has joined #openstack-qa05:27
*** aimon_ has joined #openstack-qa05:27
*** openstackrecheck has joined #openstack-qa05:27
*** zhikunliu has joined #openstack-qa05:27
*** dmorita has joined #openstack-qa05:27
*** masayukig has joined #openstack-qa05:27
*** mrodden has joined #openstack-qa05:27
*** sthaha has joined #openstack-qa05:27
*** dpaterson has joined #openstack-qa05:27
*** adalbas has joined #openstack-qa05:27
*** marun has joined #openstack-qa05:27
*** dosaboy has joined #openstack-qa05:27
*** asselin has joined #openstack-qa05:27
*** openstackgerrit has joined #openstack-qa05:27
*** yfried has joined #openstack-qa05:27
*** malini_afk has joined #openstack-qa05:27
*** mkoderer has joined #openstack-qa05:27
*** eezhova has joined #openstack-qa05:27
*** nsaje has joined #openstack-qa05:27
*** mdenny has joined #openstack-qa05:27
*** raies has joined #openstack-qa05:27
*** mwagner_lap has joined #openstack-qa05:27
*** Pico has joined #openstack-qa05:27
*** ilyashakhat has joined #openstack-qa05:27
*** StevenK has joined #openstack-qa05:27
*** bauzas has joined #openstack-qa05:27
*** rossella_s has joined #openstack-qa05:27
*** ruhe has joined #openstack-qa05:27
*** DinaBelova has joined #openstack-qa05:27
*** eglynn-office has joined #openstack-qa05:27
*** danfinch has joined #openstack-qa05:27
*** _afazekas_slp has joined #openstack-qa05:27
*** asvechnikov has joined #openstack-qa05:27
*** gabriel-bezerra has joined #openstack-qa05:27
*** tteggel has joined #openstack-qa05:27
*** zaro has joined #openstack-qa05:27
*** sileht has joined #openstack-qa05:27
*** zul has joined #openstack-qa05:27
*** fbo_away has joined #openstack-qa05:27
*** vponomaryov has joined #openstack-qa05:27
*** shardy has joined #openstack-qa05:27
*** locke105 has joined #openstack-qa05:27
*** enikanorov_ has joined #openstack-qa05:27
*** yamahata_ has joined #openstack-qa05:27
*** jeblair has joined #openstack-qa05:27
*** esmute has joined #openstack-qa05:27
*** dansmith has joined #openstack-qa05:27
*** kmartin has joined #openstack-qa05:27
*** boris-42 has joined #openstack-qa05:27
*** enikanorov has joined #openstack-qa05:27
*** pleia2 has joined #openstack-qa05:27
*** beisner has joined #openstack-qa05:27
*** bnemec has joined #openstack-qa05:27
*** NithyaG_afk has joined #openstack-qa05:27
*** gema has joined #openstack-qa05:27
*** jamielennox has joined #openstack-qa05:27
*** lifeless has joined #openstack-qa05:27
*** mtreinish has joined #openstack-qa05:27
*** comstud has joined #openstack-qa05:27
*** dtroyer has joined #openstack-qa05:27
*** jogo has joined #openstack-qa05:27
*** Shrews has joined #openstack-qa05:27
*** cschwede_ has joined #openstack-qa05:27
*** morganfainberg has joined #openstack-qa05:27
*** peterstac has joined #openstack-qa05:27
*** psedlak has joined #openstack-qa05:27
*** mikal has joined #openstack-qa05:27
*** sbadia has joined #openstack-qa05:27
*** SergeyLukjanov has joined #openstack-qa05:27
*** adam_g has joined #openstack-qa05:27
*** sdague has joined #openstack-qa05:27
*** rahmu has joined #openstack-qa05:27
*** yamahata has quit IRC05:28
*** adalbas has quit IRC05:28
*** eezhova has quit IRC05:28
*** nsaje has quit IRC05:28
*** nati_ueno has quit IRC05:28
*** dosaboy has quit IRC05:28
*** mdenny has quit IRC05:28
*** mwagner_lap has quit IRC05:28
*** Pico has quit IRC05:28
*** gabriel-bezerra has quit IRC05:28
*** masayukig has quit IRC05:28
*** sthaha has quit IRC05:28
*** marun has quit IRC05:28
*** ilyashakhat has quit IRC05:28
*** bauzas has quit IRC05:28
*** rossella_s has quit IRC05:28
*** DinaBelova has quit IRC05:28
*** eglynn-office has quit IRC05:28
*** danfinch has quit IRC05:28
*** mrodden has quit IRC05:28
*** asselin has quit IRC05:28
*** jamielennox has quit IRC05:28
*** locke105 has quit IRC05:28
*** jeblair has quit IRC05:28
*** dansmith has quit IRC05:28
*** NithyaG_afk has quit IRC05:28
*** lifeless has quit IRC05:28
*** mtreinish has quit IRC05:28
*** dtroyer has quit IRC05:28
*** Shrews has quit IRC05:28
*** mikal has quit IRC05:28
*** shardy has quit IRC05:28
*** pleia2 has quit IRC05:28
*** psedlak has quit IRC05:28
*** malini_afk has quit IRC05:28
*** SergeyLukjanov has quit IRC05:28
*** sbadia has quit IRC05:28
*** Abhijeet has quit IRC05:28
*** raies has quit IRC05:28
*** boris-42 has quit IRC05:28
*** morganfainberg has quit IRC05:28
*** gema has quit IRC05:28
*** jogo has quit IRC05:28
*** Madan has quit IRC05:28
*** aimon_ has quit IRC05:28
*** fbo_away has quit IRC05:28
*** tteggel has quit IRC05:28
*** enikanorov has quit IRC05:28
*** bnemec has quit IRC05:28
*** peterstac has quit IRC05:28
*** sdague has quit IRC05:28
*** psharma has quit IRC05:28
*** cyeoh has quit IRC05:28
*** amotoki has quit IRC05:28
*** openstackrecheck has quit IRC05:28
*** mkoderer has quit IRC05:28
*** _afazekas_slp has quit IRC05:28
*** vponomaryov has quit IRC05:28
*** enikanorov_ has quit IRC05:28
*** esmute has quit IRC05:28
*** kmartin has quit IRC05:28
*** cschwede_ has quit IRC05:28
*** ianw has quit IRC05:28
*** zhikunliu has quit IRC05:28
*** dmorita has quit IRC05:28
*** yfried has quit IRC05:28
*** StevenK has quit IRC05:28
*** ruhe has quit IRC05:28
*** sileht has quit IRC05:28
*** zul has quit IRC05:28
*** beisner has quit IRC05:28
*** comstud has quit IRC05:28
*** rahmu has quit IRC05:28
*** adam_g has quit IRC05:28
*** matsuhashi has quit IRC05:28
*** dpaterson has quit IRC05:28
*** openstackgerrit has quit IRC05:28
*** asvechnikov has quit IRC05:28
*** zaro has quit IRC05:28
*** yamahata_ has quit IRC05:28
*** Abhijeet has joined #openstack-qa05:33
*** psharma has joined #openstack-qa05:33
*** cyeoh has joined #openstack-qa05:33
*** ianw has joined #openstack-qa05:33
*** amotoki has joined #openstack-qa05:33
*** Madan has joined #openstack-qa05:33
*** matsuhashi has joined #openstack-qa05:33
*** nati_ueno has joined #openstack-qa05:33
*** yamahata has joined #openstack-qa05:33
*** aimon_ has joined #openstack-qa05:33
*** openstackrecheck has joined #openstack-qa05:33
*** zhikunliu has joined #openstack-qa05:33
*** dmorita has joined #openstack-qa05:33
*** masayukig has joined #openstack-qa05:33
*** mrodden has joined #openstack-qa05:33
*** sthaha has joined #openstack-qa05:33
*** dpaterson has joined #openstack-qa05:33
*** adalbas has joined #openstack-qa05:33
*** marun has joined #openstack-qa05:33
*** dosaboy has joined #openstack-qa05:33
*** asselin has joined #openstack-qa05:33
*** openstackgerrit has joined #openstack-qa05:33
*** yfried has joined #openstack-qa05:33
*** malini_afk has joined #openstack-qa05:33
*** mkoderer has joined #openstack-qa05:33
*** eezhova has joined #openstack-qa05:33
*** nsaje has joined #openstack-qa05:33
*** mdenny has joined #openstack-qa05:33
*** raies has joined #openstack-qa05:33
*** mwagner_lap has joined #openstack-qa05:33
*** Pico has joined #openstack-qa05:33
*** ilyashakhat has joined #openstack-qa05:33
*** StevenK has joined #openstack-qa05:33
*** bauzas has joined #openstack-qa05:33
*** rossella_s has joined #openstack-qa05:33
*** ruhe has joined #openstack-qa05:33
*** DinaBelova has joined #openstack-qa05:33
*** eglynn-office has joined #openstack-qa05:33
*** danfinch has joined #openstack-qa05:33
*** _afazekas_slp has joined #openstack-qa05:33
*** asvechnikov has joined #openstack-qa05:33
*** gabriel-bezerra has joined #openstack-qa05:33
*** tteggel has joined #openstack-qa05:33
*** zaro has joined #openstack-qa05:33
*** sileht has joined #openstack-qa05:33
*** zul has joined #openstack-qa05:33
*** fbo_away has joined #openstack-qa05:33
*** vponomaryov has joined #openstack-qa05:33
*** shardy has joined #openstack-qa05:33
*** locke105 has joined #openstack-qa05:33
*** enikanorov_ has joined #openstack-qa05:33
*** yamahata_ has joined #openstack-qa05:33
*** jeblair has joined #openstack-qa05:33
*** esmute has joined #openstack-qa05:33
*** dansmith has joined #openstack-qa05:33
*** kmartin has joined #openstack-qa05:33
*** boris-42 has joined #openstack-qa05:33
*** enikanorov has joined #openstack-qa05:33
*** pleia2 has joined #openstack-qa05:33
*** beisner has joined #openstack-qa05:33
*** bnemec has joined #openstack-qa05:33
*** NithyaG_afk has joined #openstack-qa05:33
*** gema has joined #openstack-qa05:33
*** jamielennox has joined #openstack-qa05:33
*** lifeless has joined #openstack-qa05:33
*** mtreinish has joined #openstack-qa05:33
*** comstud has joined #openstack-qa05:33
*** dtroyer has joined #openstack-qa05:33
*** jogo has joined #openstack-qa05:33
*** Shrews has joined #openstack-qa05:33
*** cschwede_ has joined #openstack-qa05:33
*** morganfainberg has joined #openstack-qa05:33
*** peterstac has joined #openstack-qa05:33
*** psedlak has joined #openstack-qa05:33
*** mikal has joined #openstack-qa05:33
*** sbadia has joined #openstack-qa05:33
*** SergeyLukjanov has joined #openstack-qa05:33
*** adam_g has joined #openstack-qa05:33
*** sdague has joined #openstack-qa05:33
*** rahmu has joined #openstack-qa05:33
*** sthaha has quit IRC05:36
*** sthaha has joined #openstack-qa05:37
*** SridharG has joined #openstack-qa05:57
*** levi_b has joined #openstack-qa05:57
*** sthaha has quit IRC05:57
*** levi_b has quit IRC06:01
*** sc68cal_ has joined #openstack-qa06:09
*** sc68cal has quit IRC06:09
*** ildikov has joined #openstack-qa06:12
*** sc68cal_ has quit IRC06:26
*** sc68cal has joined #openstack-qa06:29
*** Longgeek has quit IRC06:31
openstackrecheckopenstack/keystone change: https://review.openstack.org/70630 failed because of: gate-tempest-dsvm-full: https://bugs.launchpad.net/bugs/132061706:38
*** andreaf has joined #openstack-qa06:42
*** _afazekas_slp has quit IRC06:44
*** jpich has joined #openstack-qa06:45
*** yfried has quit IRC06:47
*** Longgeek has joined #openstack-qa07:02
*** Longgeek has quit IRC07:06
*** Longgeek has joined #openstack-qa07:06
*** mestery has quit IRC07:10
*** mestery has joined #openstack-qa07:12
*** nati_ueno has quit IRC07:17
*** luqas has joined #openstack-qa07:19
*** yfried has joined #openstack-qa07:26
openstackgerritAnthony Woods proposed a change to openstack-dev/devstack: Adds neutron linuxbridge-agent support to ironic deployment. When the Neutron Agent is set to 'linuxbridge', instead of the default 'openvswitch', the baremetal nodes created in libvirt will use bridge networking instead of an openvswitch virtualport.  https://review.openstack.org/9831707:35
*** luqas has quit IRC07:37
*** luqas has joined #openstack-qa07:39
openstackgerritGhanshyam Mann proposed a change to openstack/tempest: Adds test for Floating Ips bulk Nova V2 API  https://review.openstack.org/8682407:40
openstackrecheckopenstack/tempest change: https://review.openstack.org/97245 failed gate-tempest-dsvm-full in the gate queue with an unrecognized error07:41
*** GMann has joined #openstack-qa07:42
*** levi_b has joined #openstack-qa07:43
*** jlibosva has joined #openstack-qa07:46
*** levi_b has quit IRC07:47
openstackgerritAmit Prakash Pandey proposed a change to openstack/tempest: Bug # 1326451  https://review.openstack.org/9809207:49
*** dkorn has joined #openstack-qa07:50
*** jordanP has joined #openstack-qa08:00
*** gszasz_ has joined #openstack-qa08:06
*** marun has quit IRC08:09
openstackgerritFeodor Tersin proposed a change to openstack-dev/devstack: Parse openstackclient output to get EC2 and S3 urls.  https://review.openstack.org/9550008:11
*** gszasz has joined #openstack-qa08:15
*** gszasz has quit IRC08:16
*** yrabl has joined #openstack-qa08:19
*** gszasz has joined #openstack-qa08:19
*** gszasz has joined #openstack-qa08:21
*** gszasz has quit IRC08:24
*** default has joined #openstack-qa08:27
*** default has quit IRC08:27
*** gszasz has joined #openstack-qa08:29
openstackgerritAnthony Woods proposed a change to openstack-dev/devstack: Adds neutron linuxbridge-agent support to ironic deployment.  https://review.openstack.org/9831708:35
*** vrovachev has joined #openstack-qa08:36
*** salv-orlando has joined #openstack-qa08:40
openstackgerritA change was merged to openstack/tempest: Add API test for resizing a stopped server  https://review.openstack.org/8731208:45
*** luqas has quit IRC08:46
*** luqas has joined #openstack-qa08:48
openstackrecheckopenstack/nova change: https://review.openstack.org/96585 failed because of: gate-tempest-dsvm-neutron: https://bugs.launchpad.net/bugs/1323658, gate-tempest-dsvm-full: unrecognized error08:48
*** GMann has quit IRC08:49
*** eglynn-office is now known as eglynn09:11
openstackgerritDaisuke Morita proposed a change to openstack/tempest: Add parametric tests of Swift object API, part 1  https://review.openstack.org/8170309:11
*** giulivo has joined #openstack-qa09:12
*** safchain has joined #openstack-qa09:13
openstackgerritDaisuke Morita proposed a change to openstack/tempest: Add parametric tests of Swift object API, part 1  https://review.openstack.org/8170309:13
*** cdent has joined #openstack-qa09:18
*** eglynn is now known as eglynn-afk09:19
*** leseb has joined #openstack-qa09:26
*** levi_b has joined #openstack-qa09:31
*** levi_b has quit IRC09:36
*** mkollaro has joined #openstack-qa09:40
openstackgerritA change was merged to openstack/tempest: Add missing compute service tags to volume API tests  https://review.openstack.org/9763009:51
*** aimon___ has joined #openstack-qa10:00
*** aimon_ has quit IRC10:01
*** zhikunliu has quit IRC10:03
*** dpaterson has quit IRC10:20
*** Abhijeet has quit IRC10:21
openstackgerritAnthony Woods proposed a change to openstack-dev/devstack: Adds neutron linuxbridge-agent support to ironic deployment.  https://review.openstack.org/9831710:22
openstackrecheckopenstack/nova change: https://review.openstack.org/94713 failed because of: gate-grenade-dsvm: https://bugs.launchpad.net/bugs/1224518, gate-tempest-dsvm-neutron: https://bugs.launchpad.net/bugs/132365810:33
*** leseb has quit IRC10:34
*** leseb has joined #openstack-qa10:35
*** coolsvap is now known as coolsvap|afk10:39
*** leseb has quit IRC10:39
openstackgerritMh Raies proposed a change to openstack/tempest: Compute "cells" basic API test  https://review.openstack.org/9033710:42
*** jhenner has joined #openstack-qa10:45
*** nosnos has quit IRC10:45
openstackgerritAndrea Frittoli  proposed a change to openstack-infra/devstack-gate: Support for alternate trunk name (not master)  https://review.openstack.org/9836510:46
*** safchain has quit IRC10:53
*** amitpp has joined #openstack-qa10:54
amitppwhich file in tempest affects auth_token10:55
openstackgerritAndrea Frittoli  proposed a change to openstack-infra/devstack-gate: Support for alternate trunk name (not master)  https://review.openstack.org/9836510:56
*** dmorita has quit IRC10:58
*** jhenner has quit IRC11:01
*** jhenner has joined #openstack-qa11:01
*** SridharG has quit IRC11:07
*** SridharG has joined #openstack-qa11:13
*** dims__ has joined #openstack-qa11:15
*** matsuhashi has quit IRC11:16
*** dims_ has joined #openstack-qa11:19
*** levi_b has joined #openstack-qa11:19
*** matsuhashi has joined #openstack-qa11:21
*** dims__ has quit IRC11:21
*** luqas has quit IRC11:22
*** levi_b has quit IRC11:24
openstackrecheckopenstack/nova change: https://review.openstack.org/94012 failed because of: gate-tempest-dsvm-full: https://bugs.launchpad.net/bugs/122641211:31
openstackgerritSean Dague proposed a change to openstack-infra/elastic-recheck: add bug for havana get-pip failure  https://review.openstack.org/9837811:33
*** lbragstad has joined #openstack-qa11:34
*** matsuhashi has quit IRC11:36
*** ajo|mac has joined #openstack-qa11:36
*** matsuhashi has joined #openstack-qa11:36
*** adalbas has quit IRC11:38
*** matsuhashi has quit IRC11:40
*** mwagner_lap has quit IRC11:42
openstackgerritA change was merged to openstack-infra/elastic-recheck: add bug for havana get-pip failure  https://review.openstack.org/9837811:43
openstackgerritSean Dague proposed a change to openstack-infra/elastic-recheck: this is the expired version of  https://review.openstack.org/9838111:49
*** leseb has joined #openstack-qa11:49
*** adalbas has joined #openstack-qa11:50
*** openstackrecheck has quit IRC11:53
*** openstackrecheck has joined #openstack-qa11:53
openstackgerritA change was merged to openstack-infra/elastic-recheck: this is the expired version of  https://review.openstack.org/9838111:59
*** Manishanker_ has joined #openstack-qa12:07
Manishanker_Hello everyone, Is it possible to call executables from Tempest like sfuzz ?12:07
*** openstackrecheck has quit IRC12:08
*** openstackrecheck has joined #openstack-qa12:08
*** safchain has joined #openstack-qa12:09
*** salv-orlando has quit IRC12:10
*** yfried has quit IRC12:11
*** Poornima has quit IRC12:16
*** levi_b has joined #openstack-qa12:23
mkodererManishanker_: is it a python module or an external binary?12:28
*** Madan has quit IRC12:30
*** dpaterson has joined #openstack-qa12:32
*** yamahata has quit IRC12:33
openstackgerritnayna-patel proposed a change to openstack/tempest: Adds new v3 projects tests to Keystone  https://review.openstack.org/9387712:34
openstackrecheckopenstack/keystone change: https://review.openstack.org/97039 failed because of: gate-grenade-dsvm: https://bugs.launchpad.net/bugs/132718412:36
*** dims_ has quit IRC12:37
*** ekhugen has joined #openstack-qa12:37
*** Shrews has quit IRC12:37
*** Shrews has joined #openstack-qa12:39
*** thomasbiege has joined #openstack-qa12:39
*** psharma has quit IRC12:40
openstackgerritAndrea Frittoli  proposed a change to openstack-infra/devstack-gate: Support for alternate trunk name (not master)  https://review.openstack.org/9836512:44
*** aysyd has joined #openstack-qa12:44
*** zul has quit IRC12:45
andreafsdague: ping12:46
openstackgerritMonty Taylor proposed a change to openstack-dev/devstack: Update again and retry a failed package install  https://review.openstack.org/9839812:47
*** luqas has joined #openstack-qa12:48
sdaguepong12:49
*** zul has joined #openstack-qa12:49
openstackgerritMonty Taylor proposed a change to openstack-dev/devstack: Update again and retry a failed package install  https://review.openstack.org/9839812:52
openstackgerritAndrea Frittoli  proposed a change to openstack/qa-specs: add bp:test-accounts  https://review.openstack.org/9840012:55
*** jchai has joined #openstack-qa12:58
DinaBelovasdague, o/ I'm really sorry if I'm annoying, but may you take a look on the https://review.openstack.org/#/c/97253/ and https://review.openstack.org/#/c/97252 ?12:58
*** malini_afk is now known as malini12:59
sdagueDinaBelova: I probably won't get to specs today honestly, until it seems like we can get the gate queue flowing more reasonably12:59
DinaBelovasdague, oh, yes... Completely understand :)13:01
*** k4n0 has quit IRC13:02
DinaBelovasdague - as said, I'm running around these changes only because I will be happy to see them merged to j1 :)13:02
DinaBelovasorry :)13:02
*** malini has left #openstack-qa13:02
sdagueyeh, I think that the best way to help with that is to help on the gate :) because the folks that will tend to be reviewing these things also tend to be fixing the gate13:03
sdagueso one impacts the other13:03
jordanPmtreinish, hi. Still working on my shelve/unshelve scenario. So I got my nova patch merged in Havana. But I am facing 2 more small problems that require a backport to havana (again !). The relevant trace in havana is here http://logs.openstack.org/65/96165/1/check/check-grenade-dsvm-partial-ncpu-icehouse/2ac603c/logs/new/screen-n-api.txt.gz#_2014-06-04_12_57_04_476  and the patch a need to get merged is https://review.openstack.org/#/c/72521/13:03
jordanPyou can quickly see that the backported patch is really relevant with respect to my stacktrace13:04
*** dims has joined #openstack-qa13:08
*** amotoki has quit IRC13:08
*** gabriel-bezerra has left #openstack-qa13:09
*** eglynn-afk is now known as eglynn-office13:18
*** dustins has joined #openstack-qa13:19
*** amitpp has quit IRC13:20
andreafsdague: I submitted a patch to the test matrix stuff to support a trunk branch other than "master" - if you have a moment to review https://review.openstack.org/#/c/98365/ as that was mostly your work I think?13:22
sdagueandreaf: realistically, it won't get looked at today13:23
andreafsdague: I also started a bp for the static users https://review.openstack.org/#/c/98400/ but it's only the problem statement so far13:23
andreafsdague: sure np I just wanted to let you know13:23
openstackgerritMatthew Treinish proposed a change to openstack-infra/devstack-gate: Capture old tempest artifacts too  https://review.openstack.org/9840613:24
openstackgerritAndrey Pavlov proposed a change to openstack/tempest: Add 'Member' role to all created users  https://review.openstack.org/9646013:24
openstackgerritAndrey Pavlov proposed a change to openstack/tempest: fix usage of allow_tenant_isolation  https://review.openstack.org/9713913:24
mtreinishjordanP: I'll take a look at it later13:24
jordanPok13:26
*** salv-orlando has joined #openstack-qa13:27
*** salv-orlando_ has joined #openstack-qa13:31
*** salv-orlando has quit IRC13:33
*** salv-orlando_ has quit IRC13:37
*** Obulpathi has joined #openstack-qa13:37
sdagueandreaf: the native python clients, when they log, where is that coming from - https://jenkins05.openstack.org/job/gate-grenade-dsvm/3729/consoleFull13:38
*** masayukig has quit IRC13:38
openstackgerritA change was merged to openstack-infra/devstack-gate: Put cached files in old/ dirs too  https://review.openstack.org/9826513:39
mtreinishsdague: http://goo.gl/4bm5aG something started making ssh timeout recently13:39
sdaguemtreinish: yep13:41
sdagueany chance it was just a move13:41
*** salv-orlando has joined #openstack-qa13:41
mtreinishmriedem: ^^^ you mentioned something about n-net ssh issues too13:42
mtreinishsdague: a move?13:42
sdaguelike it was always there, but something else moved around13:42
sdagueso the message changed13:42
sdagueit definitely looks like n-net13:42
openstackgerritA change was merged to openstack/tempest: Revert "Fail fast during advanced networking test"  https://review.openstack.org/9724513:42
mriedemsdague: mtreinish: https://bugs.launchpad.net/bugs/+bugs?field.searchtext=test_volume_boot_pattern&search=Search+Bug+Reports&field.scope=all&field.scope.target=13:42
sdaguemtreinish: there a bug for that?13:42
mriedemtest_volume_boot_pattern is failing with ssh timeouts in n-net13:43
mriedemi'm duplicating the 4 bugs to a single one now13:43
mriedemand working on the query13:43
sdaguemriedem: cool13:43
mtreinishmriedem: this was from test_snapshot_patter though13:43
mriedemmtreinish: the other ssh timeout i know about is the neutron one13:43
mtreinishyeah this is definitely a n-net thing, but I just don't think its contained to just test_volume_boot_pattern13:44
*** andreaf has quit IRC13:44
mriedemneutron guys are thinking this resolves the neutron ssh problem https://review.openstack.org/#/c/97245/13:44
*** andreaf has joined #openstack-qa13:44
andreafsdague: my irc client died - what was your question?13:46
sdagueandreaf: the native python clients, when they log, where is that coming from - https://jenkins05.openstack.org/job/gate-grenade-dsvm/3729/consoleFull13:47
sdaguethough I think I found it, at least for novaclient13:47
mtreinishmriedem: well at least the spike in neutron ssh failures. I don't think it really fixes anything13:47
openstackgerritVadim Rovachev proposed a change to openstack/tempest: Added cinder and neutron notifications tests for ceilometer  https://review.openstack.org/6716413:47
mriedemmtreinish: yeah sounds like they still have more to investigate13:47
mriedembut sounds like it should help settle things down13:48
*** vrovachev has quit IRC13:48
sdaguemriedem: nova only merged a couple of changes since then13:48
*** salv-orlando_ has joined #openstack-qa13:48
mriedem?13:48
sdaguesorry, with the thing mtreinish is pointing out13:48
sdaguerealistically the only nova change that could be impacting it is - https://github.com/openstack/nova/commit/f807356df966b971a6be5f0440f1131b6aaff7d613:49
sdagueas nova has only merged a couple patches in the last 24hrs13:49
*** salv-orlando_ has quit IRC13:49
*** salv-orlando has quit IRC13:50
andreafsdague: I only see an ssh timeout issue in there13:50
mriedemsdague: i could swear there was a follow on patch to that one of hans' to fix something13:50
sdagueandreaf: yeh, what I actually want to do is stop dumping the keystone token13:50
mriedemnm, that one is the last to merge13:51
sdagueyeh13:51
sdaguemtreinish: so if you limit build_queue to check, you can see when it lands13:52
sdaguehttp://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOlwiVFJBQ0UgdGVtcGVzdC5jb21tb24uc3NoIHRpbWVvdXQ6IHRpbWVkIG91dFwiIEFORCBidWlsZF9xdWV1ZTpjaGVjayIsImZpZWxkcyI6W10sIm9mZnNldCI6MCwidGltZWZyYW1lIjoiNjA0ODAwIiwiZ3JhcGhtb2RlIjoiY291bnQiLCJ0aW1lIjp7InVzZXJfaW50ZXJ2YWwiOjB9LCJzdGFtcCI6MTQwMjA2MjY1OTA1NX0=13:52
*** salv-orlando has joined #openstack-qa13:52
mtreinishsdague: that's a nice spike13:52
mtreinishso just push a revert for that commit then?13:52
andreafsdague:     def http_log_req(self, method, url, kwargs) from novaclient ?13:53
andreafsdague: you can only turn http debug on or off, you'll need a patch to client to hide tokens13:53
sdagueandreaf: yep, I see that, will hack on it a bit. Those tokens are kind of unweildly13:54
sdaguemtreinish: so given that pattern I'd expect to see that fail on the patch itself13:54
*** salv-orlando has quit IRC13:54
sdaguewhich I don't13:54
sdaguewe need to find a patch with check queue fails on it13:54
*** yfried has joined #openstack-qa13:56
*** Manishanker_ has quit IRC13:56
mriedemsdague: could this be causing any ssh issues since it's dealing with security groups? https://review.openstack.org/9289314:01
sdaguemriedem: could be14:02
mriedemit's a little weird, there is a jenkins failure on that patch after it merged14:02
openstackrecheckConsole logs not available after 13:25s for check-tempest-dsvm-neutron 82778,18,4cdcf8914:02
sdaguethe merge times don't really line up though14:02
sdaguemriedem: that's because we promoted it14:02
openstackrecheckopenstack/oslo.db change: https://review.openstack.org/93396 failed because of: gate-grenade-dsvm: https://bugs.launchpad.net/bugs/1327184, gate-tempest-dsvm-full: https://bugs.launchpad.net/bugs/132718414:02
mriedemcould it be anything in tempest? https://github.com/openstack/tempest/commits/master14:03
mtreinishmriedem: nothing stood out to me that's merged recently14:03
sdaguethat's a possibility. The don't reuse servers means we spawn a bunch more14:04
mriedemhttps://review.openstack.org/#/c/97245/14:04
mriedemthat shows up in your logstash query14:04
mriedemmessage:"TRACE tempest.common.ssh timeout: timed out" AND build_queue:check14:04
sdaguemriedem: yeh, that basically just moves the fail around14:05
mriedemok, just saw it hit in check queue, 4 'recheck no bugs' on it14:05
sdaguethough that only just merged14:05
sdagueyeh, honestly, I'm not sure there is a clear revert here. I think we just need to figure out what info, if provided, would let us see the bug cause14:05
openstackgerritMark McLoughlin proposed a change to openstack-infra/elastic-recheck: Add query for volume detach failure  https://review.openstack.org/9842114:06
mriedemso maybe with don't re-use servers we have more servers spawning like you said, and we're hitting connection timeouts14:08
*** salv-orlando has joined #openstack-qa14:08
mriedemwere ssh_timeouts ever tweaked after starting to re-use servers?14:08
mriedemlike to make the timeout smaller?14:08
sdaguemriedem: nope14:08
*** markmcclain has joined #openstack-qa14:09
sdaguewe are doing a tear down each time14:09
*** salv-orlando has quit IRC14:09
sdaguebut we probably did increase our computes by 20% over a run14:09
*** rbak has joined #openstack-qa14:11
openstackgerritA change was merged to openstack-infra/elastic-recheck: Add query for volume detach failure  https://review.openstack.org/9842114:12
*** jgrimm has joined #openstack-qa14:13
mriedemi see ssh_timeout in tempest is 300 and in devstack it sets it to 196 to match build_timeout14:13
mriedembeen that way for a long time i guess14:14
mtreinishmriedem: when can try increasing the timeout by 104 sec, to counter the increased load from more servers14:14
mriedem104 is oddly specific, how did you get that?14:15
mtreinish300 - 19614:15
mriedemso just 300 like the default :)14:15
mriedemwant me to push a test patch to devstack?14:16
mriedemand recheck it all day?14:16
mtreinishyeah just drop the devstack iniset that overrides the default14:17
*** bnemec is now known as beekneemech14:17
*** salv-orlando has joined #openstack-qa14:17
mriedemwill do, sec14:17
*** salv-orlando has quit IRC14:20
openstackgerritMatt Riedemann proposed a change to openstack-dev/devstack: Use tempest default for ssh_timeout value  https://review.openstack.org/9842414:21
*** salv-orlando has joined #openstack-qa14:22
*** openstackrecheck has quit IRC14:22
*** openstackrecheck has joined #openstack-qa14:22
*** salv-orlando has quit IRC14:23
*** salv-orlando has joined #openstack-qa14:25
mtreinishmriedem: take a look at ^^^ in the zuul status. What did you do?14:27
*** fbo_away is now known as fbo14:29
mtreinishmriedem: oh, just looks like apt-mirror failure: http://logs.openstack.org/24/98424/1/check/check-tempest-dsvm-full/53d7232/logs/devstacklog.txt.gz14:29
*** salv-orlando has quit IRC14:30
*** yamahata has joined #openstack-qa14:32
sdaguemtreinish: it shouldn't be more load though14:34
sdaguewe do them in series14:34
sdagueand... 3 minutes14:34
sdagueis a long freaking time to wait for a cirros image to get a network14:35
*** thomasbiege has quit IRC14:35
sdaguemaking it 5 minutes doesn't seem like it will help14:35
mtreinishsdague: it's just trying something...14:35
sdaguesure, but it's not actually giving us any more debug info. Which means just rule of smallish numbers will show a variance in it.14:36
mtreinishI think we need to start dumping the console logs for all the ssh scenario tests too14:36
sdaguemtreinish: ++14:36
sdagueand I think the sec group rules14:36
sdaguebecause maybe that's an issue14:37
sdaguehonestly, this should all get consolidated into a debug_fail_compute14:37
sdagueso we can call it from any such failure14:37
*** salv-orlando has joined #openstack-qa14:37
sdaguemriedem: mock question14:38
sdagueI'm trying to fix some logging in python-novaclient, but there are no tests14:38
sdagueso I want to build some14:38
sdaguehttp://paste.openstack.org/show/83125/14:38
sdagueI'm clearly failing in mocking the default logger14:38
sdaguebecause it should have been called there14:39
sdagueany thoughts?14:39
mtreinishsdague: just use oslotest: http://git.openstack.org/cgit/openstack/oslotest/tree/oslotest/base.py#n5914:41
sdagueit's python novaclient, so it can't14:42
openstackgerritAnita Kuno proposed a change to openstack-infra/elastic-recheck: Add query for nova test_volume_boot_pattern bug 1298472  https://review.openstack.org/9829014:42
mriedemsdague: p.o.o isn't happy14:43
mriedemgot a gist?14:43
*** tmcpeak has joined #openstack-qa14:46
openstackrecheckopenstack/sahara change: https://review.openstack.org/96592 failed because of: gate-tempest-dsvm-full: https://bugs.launchpad.net/bugs/132718414:46
sdagueactually, I'm going down the fixtures front14:47
sdaguemtreinish: any idea how to get the log buffer out of the fixture?14:47
mtreinishsdague: I'd probably need an example, but it should just be an attr14:48
*** yamahata has quit IRC14:48
*** yamahata has joined #openstack-qa14:48
*** mmaglana has joined #openstack-qa14:50
sdaguemtreinish: ok, got it14:50
sdagueit's .output14:50
sdagueyou have to read the source to find that out14:50
sdagueif fixtures wasn't on bzr I'd fix that :)14:50
openstackgerritAnita Kuno proposed a change to openstack-infra/elastic-recheck: Add query for nova test_volume_boot_pattern bug 1298472  https://review.openstack.org/9829014:52
*** mlavalle has joined #openstack-qa14:56
*** nati_ueno has joined #openstack-qa14:57
*** markmcclain has quit IRC15:00
openstackgerritSalvatore Orlando proposed a change to openstack-dev/devstack: I have this branch just to run tests on upstream gate.  https://review.openstack.org/9844115:01
mriedemsdague: mtreinish: jgriffith: i think i found some leaky leaky volume thingies15:01
mriedemor potential contributors15:02
mriedemhttp://git.openstack.org/cgit/openstack/tempest/tree/tempest/scenario/test_volume_boot_pattern.py#n17615:02
*** leseb has quit IRC15:02
mriedemtest_volume_boot_pattern is extended for cinder v2 tests15:02
mriedemso that runs for cinder v1 and cinder v215:02
*** leseb has joined #openstack-qa15:03
mriedemthere is cleanup at the end of the test case for making sure the volume is detached before deleting it15:03
mriedemhowever, when we have the ssh timeout fail, we never run those cleanups15:03
mriedemso should be using addCleanup right?15:03
mtreinishmriedem: oh, that again. The problem is that scenario does all the teardown in tearDownClass15:04
mtreinishso the ordering gets messed up15:04
mriedemmtreinish: so try/except?15:04
mriedemtry/finally15:04
mtreinishmriedem: I have this patch from forever ago to fix that problem: https://review.openstack.org/6210115:04
mtreinishbut I've never gotten around to fixing it15:04
anteayawhere is elastic-recheck supposed to get jaraco.util from?15:05
anteayapypi?15:05
mriedemmtreinish: that is forever ago15:06
mriedemmtreinish: would you be opposed to a small surgical try/finally in test_volume_boot_pattern right now?15:06
mtreinishmriedem: I thought jgriffith already pushed a fix that added detach to LIFO in tearDownClass that worked around the leak15:06
*** leseb has quit IRC15:07
mtreinishprobably not, although I dislike finally15:07
*** adalbas has quit IRC15:07
mtreinishI think there was a patch trying that before but the issue is more than just ssh exceptions15:07
mriedemif it's already been handled i won't mess with it, but would be nice if jgriffith can confirm15:07
mtreinishit's really any exception causing the problem15:07
mriedemi'm not proposing catching ssh exceptions15:08
mriedemjust try/finally and doing the server stop and volume detach before raising whatever failed15:08
mriedemsince addCleanup doesn't work right now it sounds like15:08
openstackgerritChristian Berendt proposed a change to openstack-infra/elastic-recheck: Prettified all HTML files  https://review.openstack.org/9844515:08
sdagueI guess what we really want is a force delete15:08
sdagueon volumes15:08
mriedemcinder has a force delete15:08
sdagueok, so why won't that work here?15:08
mriedemi'm not sure where this tear down code is, looking15:09
sdaguemaybe we can actually read scenario failures if we land this - https://review.openstack.org/#/c/98443/1/novaclient/tests/test_client.py :)15:10
sdagueoh, I mean the whole review15:10
*** atiwari has joined #openstack-qa15:11
*** mmaglana has quit IRC15:11
*** mmaglana has joined #openstack-qa15:12
openstackgerritMatthew Treinish proposed a change to openstack/tempest: Validate ssh client auth before we use it  https://review.openstack.org/9844615:12
maurosrI didn't read the whole conversation, but this might help on volume clean up https://review.openstack.org/#/c/82709/15:12
maurosrsdague: ^15:12
mtreinishsdague: ^^^ I think that should get us console logs on ssh failure15:12
mtreinishit turns out most, if not all, places that ssh caught exceptions when the clients were being inited15:13
maurosrthe one point that can help in the timeout which was hardcoded15:13
maurosrnot the refactoring itself15:13
maurosrbut I thought it was useful to clean a little bit15:13
sdaguemtreinish: why?15:14
mtreinishthe exceptions weren't being raised until we tried to run a command15:15
mtreinishwhich didn't have the handling15:15
mtreinishso the logging wasn't run15:15
sdaguebut the handling is here?15:15
sdaguesorry, it's not clear from that patch where the handling happens15:15
mtreinishsdague: for example http://git.openstack.org/cgit/openstack/tempest/tree/tempest/scenario/test_snapshot_pattern.py#n4615:16
mtreinishor http://git.openstack.org/cgit/openstack/tempest/tree/tempest/scenario/test_volume_boot_pattern.py#n9815:16
*** mmaglana has quit IRC15:16
*** salv-orlando has quit IRC15:16
*** salv-orlando_ has joined #openstack-qa15:16
sdaguemtreinish: ok, sure, but can we instead bake this whole thing in?15:17
sdagueso that every class isn't writing their own calls to log output15:17
mtreinishsdague: that's the next step15:17
mtreinishunifying the ssh class init15:17
sdagueok, I feel like we should just jump to that next step15:17
mtreinishsdague: we'd still need this though, that would just unify the exception handling and calls to get_remote_client15:19
*** kgriffs|afk is now known as kgriffs15:19
mtreinishthere is also already a common class for sshing to the guest, but it's overloaded everywhere from what I can tell15:19
*** salv-orlando_ has quit IRC15:19
mtreinishwe still want to fail before we try running an commands15:19
sdagueyeh, so I think we need to basically reunify all that logic in a single place15:19
*** dpaterson has quit IRC15:19
*** adalbas has joined #openstack-qa15:21
*** openstackgerrit has quit IRC15:22
*** gszasz has quit IRC15:23
*** leseb has joined #openstack-qa15:24
mriedemsdague: mtreinish: query for the test_volume_boot_pattern bug https://review.openstack.org/#/c/98450/15:25
*** cbader has joined #openstack-qa15:25
*** nati_ueno has quit IRC15:26
sdaguehttps://etherpad.openstack.org/p/unified-ssh-verification15:26
sdaguesomething along those lines15:26
sdagueand then if anything goes wrong, that class has all the handling15:26
sdaguethe problem right now is this stuff isn't encapsulated into a sane interface, it's just dragged in via inheritance15:27
*** jpich has quit IRC15:28
*** ildikov has quit IRC15:28
*** openstackgerrit has joined #openstack-qa15:29
openstackgerritMatthew Treinish proposed a change to openstack/tempest: Start to unify ssh client init  https://review.openstack.org/9845115:33
openstackgerritSean Dague proposed a change to openstack-infra/elastic-recheck: fix 1327184  https://review.openstack.org/9845215:33
mtreinishsdague: ^^^ that's what I saw as the unified ssh client15:34
mtreinishoh you pasted an idea15:34
sdaguemtreinish: yeh, I want the unified client to actually be a class15:34
sdaguethat lives independently15:34
sdagueand no one pulls it in via inheritance15:34
*** nati_ueno has joined #openstack-qa15:34
sdaguebecause otherwise I think we're going to be chasing this one15:35
mtreinishsdague: ok, well that'll take a bit more time15:37
mtreinishI'll work on it this afternoon15:38
mtreinishbut I still think we should push through that first patch to get console logs in the short term15:38
anteayamriedem: yeah, yours collects far better results15:38
*** amitpp has joined #openstack-qa15:38
sdaguemtreinish: sure15:38
anteayamriedem: and shows this issue is fairly new and spiking15:38
*** nati_ueno has quit IRC15:39
*** nati_ueno has joined #openstack-qa15:44
*** jchai is now known as jchai_afk15:45
*** jordanP has quit IRC15:45
*** cdent_ has joined #openstack-qa15:46
*** cdent has quit IRC15:46
*** cdent_ is now known as cdent15:46
*** jchai_afk is now known as jchai15:47
*** yfried has quit IRC15:49
*** nati_ueno has quit IRC15:51
anteayamriedem: so this query: https://review.openstack.org/#/c/98149/15:51
*** yrabl_ has joined #openstack-qa15:51
anteayawhich will take care of the rest of the ceilometer ut unclassified failures15:51
anteayaboth queries are mentioned in the bug report15:51
anteayashouldn't the query include both test case filters from the bug report?15:52
*** leseb has quit IRC15:52
*** openstackgerrit has quit IRC15:53
*** yrabl has quit IRC15:55
mriedemanteaya: yeah, iff it will show up in the gate15:56
mriedemhttp://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOlwiRkFJTFxcOiB0ZXN0cy5hbGFybS50ZXN0X3JwYy5UZXN0UlBDQWxhcm1Ob3RpZmllci50ZXN0X25vdGlmeV9hbGFybVwiIEFORCB0YWdzOlwiY29uc29sZVwiIEFORCBwcm9qZWN0Olwib3BlbnN0YWNrL2NlaWxvbWV0ZXJcIiIsImZpZWxkcyI6W10sIm9mZnNldCI6MCwidGltZWZyYW1lIjoiNjA0ODAwIiwiZ3JhcGhtb2RlIjoiY291bnQiLCJ0aW1lIjp7InVzZXJfaW50ZXJ2YWwiOjB9LCJzdGFtcCI6MTQwMjA3MDE2NzMxNX0=15:56
mriedemi see it in the check queue only with 2 changes15:56
mriedemanteaya: seeing if i can get an older hit in the gate15:57
*** markmcclain has joined #openstack-qa15:58
*** fbo is now known as fbo_away15:58
anteayamriedem: kk, I can remove the second query to get the patch in, since we do need at least the first query in there15:59
mriedemanteaya: hold up15:59
anteayaI just wanted to discuss it first15:59
anteayaholding15:59
*** jchai is now known as jchai_afk15:59
*** atiwari has quit IRC16:01
*** aimon___ has quit IRC16:01
*** leseb has joined #openstack-qa16:01
*** nati_ueno has joined #openstack-qa16:02
*** levi_b has quit IRC16:03
*** levi_b has joined #openstack-qa16:03
openstackrecheckConsole logs not available after 15:32s for check-tempest-dsvm-full 98105,4,553ed5516:05
*** mmaglana has joined #openstack-qa16:06
openstackrecheckopenstack/cinder change: https://review.openstack.org/95936 failed because of: gate-grenade-dsvm: https://bugs.launchpad.net/bugs/1327184 https://bugs.launchpad.net/bugs/128590816:06
*** openstackrecheck has quit IRC16:07
*** openstackrecheck has joined #openstack-qa16:07
*** levi_b has quit IRC16:08
*** jlibosva has quit IRC16:08
*** jlibosva has joined #openstack-qa16:08
*** jlibosva has quit IRC16:09
*** safchain has quit IRC16:12
jogowhoa http://jogo.github.io/gate/ what happened?16:14
mriedemanteaya: shows up on 5/29 but still check queue, but different patch16:18
mriedemso probably safe to keep the OR16:18
anteayakk16:18
mriedemjogo: ssh timeouts spiking since yesterday16:18
anteayaso no change needed from me?16:18
jogomriedem: yeah, did the revert patch land in tempest?16:18
mriedemjogo: yeah but that's a different thing16:19
mriedemthis is newish16:19
jogomriedem: gah16:19
mriedemjogo: https://review.openstack.org/#/c/98450/16:19
jogohmm this one is a nov anetwork issue16:20
jogonova network*16:21
jogoor at least not neutron16:21
*** rwsu has joined #openstack-qa16:21
jogoI think16:21
mriedemanteaya: so they are different unit tests with different failures16:21
mriedemi think they should probably be different bugs/patches16:21
anteayakk16:21
anteayamriedem: what should I change in that patch?16:22
anteayaor should the bug report be split first?16:22
mriedemanteaya: i'd leave whatever one hits in the gate, so the notification one16:22
openstackrecheckConsole logs not available after 13:27s for check-tempest-dsvm-neutron 98443,1,3847ceb16:22
mriedemtest_notification_service16:22
anteayakk16:23
*** openstackrecheck has quit IRC16:23
*** openstackrecheck has joined #openstack-qa16:23
* anteaya edits patchset16:23
*** leseb has quit IRC16:24
*** marun has joined #openstack-qa16:24
*** jchai_afk is now known as jchai16:25
*** mikal has quit IRC16:26
anteayamriedem: https://review.openstack.org/#/c/98149/416:26
anteayaopenstackstatus is on hiatus16:26
*** luqas has quit IRC16:26
anteayasorry openstackgerrit is on hiatus16:27
*** mikal has joined #openstack-qa16:27
*** nati_ueno has quit IRC16:28
*** mkollaro has quit IRC16:30
*** mwagner_lap has joined #openstack-qa16:35
*** openstackgerrit has joined #openstack-qa16:36
openstackrecheckConsole logs not available after 13:24s for gate-tempest-dsvm-full 95846,2,15e1dda16:37
*** ildikov has joined #openstack-qa16:38
anteayamriedem: do you want to split out the bug report so I can create a new patch for the query I just removed from that one?16:41
anteayamriedem: I'm not sure how to split out bug reports, I have never done it16:41
*** aimon__ has joined #openstack-qa16:41
anteayamriedem: also will you be at the qa/infra meetup in germany so you can teach me more?16:41
*** levi_b has joined #openstack-qa16:44
openstackgerritJeremy Stanley proposed a change to openstack-dev/devstack: Update again and retry a failed package install  https://review.openstack.org/9839816:47
fungimordred: ^ you had a bash syntax error. retesting with a minor fix16:47
mordredfungi: that's so awesome.16:48
mordredfungi: the logic looked sane to you though?16:49
fungimordred: yeah, just wanted to see it in action, but that bug masked any evidence16:49
mordred++16:50
fungimordred: also, while i expect it to belt-and-braces some kinds of failures there, the ones we were seeing with broken mirrors from out-of-order/partial/in-progress updates are probably going to still cause it to fail16:52
fungibecause it's doubtful the remote problem will right itself before the retry16:53
mordredfungi: yah16:57
mordredfungi: although I hope that what we're doing there is reducing the amount of times we touch the mirrors at all16:58
*** atiwari has joined #openstack-qa16:58
mordredbecause we really shouldn't need to touch them most of the tie16:58
mordredtime16:58
fungiwe can introduce a small wait between retries, but that's also fiddly16:58
mordredfungi: and then if it buys us some headroom, we can work on implemeting an AFS-publish based repo mirror :)16:58
fungimordred: i think you're onto something. yet more proof that any problem can be solved with a liberal application of afs. just smear it all over and watch your troubles disappear16:59
mordredfungi: mmm. afs spread on toast17:00
fungii might try it instead of marmite tomorrow morning17:00
anteayayou eat marmite?17:00
anteayawhat do you think of it?17:00
*** comstud is now known as bearhands17:00
anteayaI got some shitake mushrooms from the store for the first time and am really enjoying them17:01
anteayamuch richer taste than other mushrooms17:01
*** nati_ueno has joined #openstack-qa17:02
openstackrecheckConsole logs not available after 14:07s for check-tempest-dsvm-full 96323,6,da0a4ea17:04
*** dansmith is now known as superdan17:04
fungiyeah, i eat marmite just about every day. great on sourdough toast or crackers17:06
fungishiitake mushrooms too. i make a lot of dashi with them17:07
fungiconsidering getting into growing them17:08
*** vponomaryov has left #openstack-qa17:11
*** jogo is now known as flashgordon17:12
*** harlowja_away is now known as harlowja17:13
*** markmcclain has quit IRC17:17
*** kgriffs is now known as kgriffs|afk17:24
openstackgerritJeremy Stanley proposed a change to openstack-dev/devstack: Update again and retry a failed package install  https://review.openstack.org/9839817:27
fungimordred: one more correction ^17:27
*** dkorn has quit IRC17:31
*** mwagner_lap has quit IRC17:31
fungiand that turns up yet another problem17:31
openstackgerritJeremy Stanley proposed a change to openstack-dev/devstack: Update again and retry a failed package install  https://review.openstack.org/9839817:34
fungifound a typo ^17:34
*** leseb has joined #openstack-qa17:35
openstackgerritElizabeth K. Joseph proposed a change to openstack-infra/elastic-recheck: Add link to elastic-recheck docs to index  https://review.openstack.org/9847717:39
*** leseb has quit IRC17:39
*** rbak has quit IRC17:40
*** Shrews has quit IRC17:41
*** Shrews has joined #openstack-qa17:41
openstackrecheckConsole logs not available after 13:34s for check-tempest-dsvm-full 81166,14,0a758b617:42
clarkbfungi: /me reviews this retry in devstack change17:45
mriedemanteaya: i'll open a separate ceilometer bug based on what gordc says in -dev17:46
*** levi_b has quit IRC17:46
mriedemanteaya: and i won't be at the infra/qa meetup in germany, nova meetup only17:46
anteayamriedem: following along in -dev, thanks17:46
mriedemif approved that is17:46
*** levi_b has joined #openstack-qa17:46
fungiclarkb: i've got a current run for the latest patchset open in a tab here to see if there's anything else wrong... https://jenkins05.openstack.org/job/check-tempest-dsvm-full/9450/console17:46
anteayamriedem: :( would be great to have you at the qa/infra meetup17:46
mriedemnot sure i'll make paris17:47
anteayano no don't say that17:47
mriedemworking wife with a 3 year old at home...hard to get out of country for a week at a time...17:47
clarkbfungi: should it have a sleep between attempts?17:47
clarkbeven a few seconds may make a big difference17:47
openstackrecheckopenstack/trove change: https://review.openstack.org/96780 failed gate-grenade-dsvm in the gate queue with an unrecognized error17:48
fungiclarkb: possibly. i suggested that earlier, though the mechanics of it are still being confirmed anyway17:48
anteayamriedem: ah family, yes that I can understand17:48
anteayamriedem: and hard to travel with a small one17:48
clarkbfungi: is REPOS_UPDATED redundant?17:51
*** levi_b has quit IRC17:51
clarkbfungi: the change uses || to retry17:51
clarkbso REPOS_UPDATED doesn't seem to be used17:51
fungithat's a good point. i missed that it was being set unnecessarily17:52
fungithough i think the obvious bugs are ironed out now at least... the job got to running tempest17:52
*** tkammer has joined #openstack-qa17:53
openstackgerritMatthew Treinish proposed a change to openstack/tempest: Validate ssh client auth before we use it  https://review.openstack.org/9844617:54
clarkbcool17:55
clarkbI will leave comments and let you decide if you want to clean up more but +2 from me17:55
clarkbor +117:55
clarkbbecause devstack17:55
mtreinishsdague: ^^^ new rev turns out unexercised code paths were broken17:55
mtreinishwho would have guessed17:55
clarkbfungi: actually wait17:56
clarkbfungi: does that update the first time around?17:56
fungiclarkb: i don't believe so, no17:56
clarkboh nevermind REPOS_UPDATED != true17:56
clarkbthat is what the variable is for17:57
clarkbI get it now :)17:57
fungiyeah, it is used17:57
fungiand that's part of the point of the change is to only update the package list if the package download fails17:57
openstackgerritA change was merged to openstack-infra/elastic-recheck: Add link to elastic-recheck docs to index  https://review.openstack.org/9847717:57
fungiwhich may shield us from some additional mirror-update-in-progress type failures17:57
anteayamriedem: I have to do food and a walk, will come back the celiometer patches17:59
mriedemok17:59
clarkbfungi: yeah it should in a perfect situation update repos once18:01
openstackgerritMatt Riedemann proposed a change to openstack-dev/devstack: Use tempest default for ssh_timeout value  https://review.openstack.org/9842418:01
clarkbfungi: and only try again if a package install failed18:01
*** amitpp has quit IRC18:01
clarkbmtreinish: so that doesn't fix the ssh trouble to vms but makes it easier to debug?18:03
mtreinishclarkb: it'll dump the vm console log when ssh fails correctly18:03
clarkbnice18:03
mtreinishwell, I think it might miss one test case that doesn't have things setup properly, but this is a short term thing18:04
mtreinishI'm going to work on unifying all the ssh stuff today18:04
openstackgerritArmando Migliaccio proposed a change to openstack/tempest: Push triage patch to trigger SSH EOFError  https://review.openstack.org/9848318:07
*** openstackrecheck has quit IRC18:08
*** openstackrecheck has joined #openstack-qa18:08
openstackgerritMatt Riedemann proposed a change to openstack-infra/elastic-recheck: Add query for 1244457  https://review.openstack.org/9829718:08
openstackgerritA change was merged to openstack-infra/elastic-recheck: Add query for 1244457  https://review.openstack.org/9829718:12
*** tkammer has quit IRC18:15
*** rbak has joined #openstack-qa18:21
*** openstackrecheck has quit IRC18:22
*** openstackrecheck has joined #openstack-qa18:22
*** cdent has quit IRC18:23
*** openstackrecheck has quit IRC18:26
openstackgerritMatt Riedemann proposed a change to openstack/tempest: Fallback to force-delete of volumes if regular delete times out  https://review.openstack.org/9848918:33
mriedemjgriffith: ^18:33
*** malini has joined #openstack-qa18:38
*** levi_b has joined #openstack-qa18:39
openstackgerritMatt Riedemann proposed a change to openstack-dev/devstack: Set osapi_volume_workers equal to number of CPUs  https://review.openstack.org/9849218:47
*** dkorn has joined #openstack-qa18:49
openstackgerritMatt Riedemann proposed a change to openstack-dev/devstack: Don't set nova api/conductor workers since nova handles this  https://review.openstack.org/9849318:52
*** Longgeek has quit IRC18:54
*** markmcclain has joined #openstack-qa18:56
*** markmcclain1 has joined #openstack-qa19:00
*** markmcclain has quit IRC19:02
*** nati_ueno has quit IRC19:04
openstackgerritMatt Riedemann proposed a change to openstack/tempest: Ensure instance/volume cleanup in test_volume_boot_pattern  https://review.openstack.org/9849719:05
openstackgerritMatt Riedemann proposed a change to openstack/tempest: Ensure instance/volume cleanup in test_volume_boot_pattern  https://review.openstack.org/9849719:07
*** andreaf has quit IRC19:07
mtreinishmriedem, sdague: I think I found the problem with the ssh stuff19:17
mtreinishit looks like a keypair mismatch19:17
mtreinishhttp://logs.openstack.org/46/98446/2/check/check-tempest-dsvm-full/5e97e50/console.html#_2014-06-06_18_56_04_075 doesn't match http://logs.openstack.org/46/98446/2/check/check-tempest-dsvm-full/5e97e50/console.html#_2014-06-06_18_56_04_20319:17
sdaguemtreinish: those are host keys19:18
mtreinishdoh, my mistake19:18
openstackgerritMalini Kamalambal proposed a change to openstack/tempest: Add Tests for Message & Claim APIs  https://review.openstack.org/9494419:19
mriedemalso, abandoned https://review.openstack.org/#/c/98424/ to set ssh_timeout to 30019:19
mriedemhit the bug was trying to help fix19:19
mtreinishoh, wait look at the network info19:20
mtreinish172.24.4.4 is what is was trying to connect to19:20
*** kgriffs|afk is now known as kgriffs19:20
mtreinishbut it's not listed there in the console output19:21
*** jhenner has quit IRC19:21
mtreinishmriedem: ok, yeah it was a long shot anyway19:23
mriedemmtreinish: as you can see above, i'm throwing up several of those today :)19:23
*** Longgeek has joined #openstack-qa19:24
openstackgerritDavid Shrewsbury proposed a change to openstack/tempest: Place baremetal common methods in base class  https://review.openstack.org/9443619:25
openstackgerritDavid Shrewsbury proposed a change to openstack/tempest: Add ironic instance rebuild advanced test  https://review.openstack.org/9443919:25
*** nati_ueno has joined #openstack-qa19:26
*** Longgeek has quit IRC19:29
*** santib has joined #openstack-qa19:31
santibhi maurosr: have a sec to talk about https://review.openstack.org/#/c/85850/19:32
santib?19:32
*** levi_b has quit IRC19:33
maurosrsantib: just a second so I can remember what it is19:33
*** levi_b has joined #openstack-qa19:34
santibmaurosr: sure. It was a couple a month ago hehe19:34
*** SridharG has quit IRC19:34
sdaguemtreinish: it's a floating ip though19:35
sdagueso it won't be on the node19:35
maurosrsantib: ok, so the dependent patch is merged, cool, you just need an update without the skip19:35
sdagueit will be built by a SNAT rule on the host19:35
santiboh, that's right. I forgot about the split19:35
mtreinishsdague: are we using floats in the gate? because it's configurable I thought19:35
santibthanks maurosr. I'll submit a new patch with that change19:36
maurosryw19:36
sdaguemtreinish: that's a good question19:36
mtreinishsdague: either way I was just looking at the floating ip code in scenario and the attach is async (returns a 202) but we don't wait for anything19:37
mtreinishso I'm wondering if the problem is the floating ip is never getting added19:37
*** openstackrecheck has joined #openstack-qa19:38
openstackgerritMatt Riedemann proposed a change to openstack-infra/elastic-recheck: Add query for nova test_enforce_http_true unit test bug 1288178  https://review.openstack.org/9850219:38
mriedemsdague: ^19:38
*** nati_ueno has quit IRC19:38
*** levi_b has quit IRC19:38
sdaguemtreinish: that's possible. Though how long after the attach do we time out?19:39
sdagueI think it's probably fair to put a wait on the floating ip create19:39
sdagueloop on server get19:39
mtreinishit's the ssh timeout + whatever time it takes to get to the ssh attempt19:39
sdagueright, that's still minutes19:39
sdagueI'm very suspicious of anything that we fail after 3 minutes being something we need to wait longer for19:40
*** dustins has quit IRC19:40
sdaguemtreinish: however... it might be useful to look for the floating ip on the server object on the fail path19:40
sdaguemorganfainberg: you had some cantrip to modify logging post oslo log startup right?19:42
morganfainbergsdague, i want to say i did something like that.19:42
morganfainbergsdague, but... details are hazy19:42
morganfainbergwhat are you aiming to accomplish?19:43
openstackgerritA change was merged to openstack-infra/elastic-recheck: Add query for nova test_enforce_http_true unit test bug 1288178  https://review.openstack.org/9850219:44
*** dkorn has quit IRC19:53
sdaguemorganfainberg: I'm trying to do more fine grained control of the tempest logs19:54
morganfainbergh19:54
morganfainbergah19:54
sdagueso we can dump things like the keystone.session DEBUG19:54
sdaguewhich is completely useless, and gets in the way19:54
morganfainbergright.19:55
morganfainbergi _know_ we did something like that at one point.19:55
sdagueglance debug is mostly the same level of useful19:55
sdagueyeh, I found it in keystone19:55
sdagueit hacks oslo config early19:55
morganfainbergsdague, ah19:55
sdagueI actually want to do it after the logger is instantiated19:55
morganfainbergsdague, i've done that before iirc. but not for openstack... give me a sec to see if i can dig up where i did that19:56
*** openstackrecheck has quit IRC19:58
sdaguemtreinish: https://review.openstack.org/#/c/98505/ - log debug of requests on by default to see if that's helpful in seeing things19:58
*** openstackrecheck has joined #openstack-qa19:59
morganfainbergsdague, i think the hacks i've done have been simply grabbing the logger object (in olso case) doing log.logger.setLevel19:59
sdaguemorganfainberg: so getLogger is creating a new logger per namespace?20:00
morganfainbergsdague, there is another way to do it, it's ... config based for the modules.20:00
morganfainbergsdague, yeah.20:00
sdagueok, I can work with that20:00
sdaguesorry, some of the details escape me at times20:00
morganfainbergsdague, http://pasteraw.com/5h3c1wmg7qs0qjkcnhubvyb1tzt7kfy20:01
openstackgerritSean Dague proposed a change to openstack/tempest: trace the world  https://review.openstack.org/9850520:01
*** catohornet has quit IRC20:01
*** coolsvap|afk has quit IRC20:01
*** adarazs has quit IRC20:01
*** coolsvap|afk has joined #openstack-qa20:01
morganfainbergsdague, no need to be sorry, something about asking a question saves a lot of time in the lab?20:02
morganfainberg:)20:02
*** adarazs has joined #openstack-qa20:02
*** jhenner has joined #openstack-qa20:06
mtreinishsdague: wait most of the failures are in the scenario tests so your trace the world won't help20:07
mtreinishbecause they don't use the rest client20:08
openstackrecheckConsole logs not available after 13:25s for gate-ceilometer-python27 97268,6,a3ab67020:08
sdaguemtreinish: it will help on the other tests20:09
*** adalbas has quit IRC20:09
sdagueI'm staring at a lot of tests that do POST ......../action20:09
sdagueand, because nova's rest urls for action make me sad, we don't actually know what we did20:10
mtreinishsdague: which fail are you trying to debug?20:10
sdaguehttp://logs.openstack.org/66/98266/2/check/check-tempest-dsvm-full/102c2d9/console.html20:11
sdague2014-06-06 16:49:26.429 |     2014-06-06 16:46:01,291 Request (ServersNegativeTestJSON:test_suspend_server_invalid_state): 409 POST http://127.0.0.1:8774/v2/3699fdba5c364fa5a1de3afdeb969a72/servers/d68940b3-c500-4f27-9594-05b33877771a/action 0.085s20:11
sdague2014-06-06 16:49:26.429 |     2014-06-06 16:46:01,508 Request (ServersNegativeTestJSON:test_suspend_server_invalid_state): 202 POST http://127.0.0.1:8774/v2/3699fdba5c364fa5a1de3afdeb969a72/servers/d68940b3-c500-4f27-9594-05b33877771a/action 0.216s20:11
sdaguethat 409 is suspicious20:11
mtreinishsdague: what happened to the request ids in the logs? I thought your cleaned up logging still had that20:12
morganfainberga conflict on a suspend?20:13
morganfainbergthat is odd.20:13
sdaguemtreinish: that's a good question20:14
sdagueI think the log format got changed20:14
sdagueok, let me do this other thing first20:14
openstackrecheckConsole logs not available after 13:22s for check-grenade-dsvm 97337,1,62165a420:22
*** nati_ueno has joined #openstack-qa20:22
*** adalbas has joined #openstack-qa20:23
*** dosaboy_ has joined #openstack-qa20:25
openstackgerritSantiago Baldassin proposed a change to openstack/tempest: Test metadata not replaced on aggregate zone update  https://review.openstack.org/8585020:26
*** catohornet has joined #openstack-qa20:26
*** dosaboy has quit IRC20:26
*** adalbas has quit IRC20:28
openstackgerritMatthew Treinish proposed a change to openstack/tempest: Validate ssh client auth before we use it  https://review.openstack.org/9844620:29
openstackgerritMatthew Treinish proposed a change to openstack/tempest: Add extra debug info to ssh failure  https://review.openstack.org/9850720:29
sdaguemtreinish: I'm meeting mathias from the lug at schatzi's on the porch at 5:30, if you want to get beers. I feel like after this week I need one :)20:31
sdaguealso, things I hate, our config file verifier requires 2 blank lines at the end of the file.... o_O20:32
mtreinishsdague: that sounds like a good idea, I guess the porch is open now20:33
*** levi_b has joined #openstack-qa20:33
mtreinishsdague: really? that seems weird20:33
sdaguemtreinish: yep20:33
sdaguebecause the diff is white space sensitive20:34
*** santib has left #openstack-qa20:34
sdagueso when I manually edit the sample in emacs, it trims out the extra spaces20:35
sdagueand sadness20:35
openstackgerritSean Dague proposed a change to openstack/tempest: trace the world  https://review.openstack.org/9850520:35
openstackgerritSean Dague proposed a change to openstack/tempest: create tempest.log class  https://review.openstack.org/9850920:35
openstackrecheckConsole logs not available after 13:22s for check-tempest-dsvm-postgres-full 91817,3,61e453320:35
sdagueok, so the 2nd one is the one I want to figure out if you totally hate20:35
mtreinishsdague: file a bug with emacs then... :)20:35
sdaguemtreinish: no, I've configured it that way20:36
sdagueto get around most pep8 issues20:36
*** kgriffs is now known as kgriffs|afk20:36
mtreinishsdague: so the lazy load config we need in tempest breaks setting the logging level?20:40
mtreinishbecause it doesn't load the default level option before we get logs20:40
*** kgriffs|afk is now known as kgriffs20:41
sdaguemtreinish: no, the issue is that you can't override oslo logging levels in your own config defaults20:41
sdagueso you have to do this late override if you want control20:42
*** jchai has quit IRC20:42
*** kgriffs is now known as kgriffs|afk20:42
sdaguekeystone does it in a slightly different way20:43
mtreinishsdague: default_log_levels doesn't work?20:43
mtreinishI feel like I'm missing an important piece20:43
sdaguemtreinish: you can't set that, because if you set it to something different from oslo, it explodes20:43
sdaguebecause you can only define an option more than once if the defaults are the same as well20:43
mtreinishsdague: why not just use CONF.set_default() or whatever it is in the config loader?20:44
sdaguein the proxy? yeh, that would work20:45
sdagueI'll redo that20:45
mtreinishyeah, that's normally the path for doing something like that20:45
mtreinishit's how we end up faking things in the unit tests too20:46
sdagueoh, keystone does a slightly more evil thing really20:48
openstackrecheckConsole logs not available after 13:25s for check-grenade-dsvm 98493,1,bfb594520:48
*** levi_b has quit IRC20:51
*** levi_b has joined #openstack-qa20:52
*** dkorn has joined #openstack-qa20:52
*** cbader has quit IRC20:53
*** salv-orlando has joined #openstack-qa20:53
*** levi_b has quit IRC20:53
*** adalbas has joined #openstack-qa20:55
openstackgerritSean Dague proposed a change to openstack/tempest: trace the world  https://review.openstack.org/9850520:56
openstackgerritSean Dague proposed a change to openstack/tempest: provide ability to tweak oslo log defaults  https://review.openstack.org/9851520:56
openstackgerritSean Dague proposed a change to openstack/tempest: create tox target for generating a config  https://review.openstack.org/9851620:56
sdaguemtreinish: ok, how about 9851520:57
*** salv-orlando has quit IRC20:57
mtreinishsdague: it looks a lot more sane.20:58
*** jgrimm has quit IRC20:58
mtreinishsdague: btw, what do you think about turning v3 testing off in the gate?20:59
sdaguealso, 98516, so that we can have a consistent way that works20:59
mtreinishnot removing it from the tree, but just flipping the config flag in devstack20:59
sdaguemtreinish: I think we should try to get nova concensus on it20:59
mtreinishI'll send something to the ML about it tonight or tomorrow then21:00
sdaguecool21:00
*** tmcpeak has quit IRC21:01
openstackrecheckConsole logs not available after 13:26s for check-tempest-dsvm-full 95831,4,c54cc0e21:02
*** nati_ueno has quit IRC21:03
*** nati_ueno has joined #openstack-qa21:03
*** mriedem has quit IRC21:08
*** aysyd has quit IRC21:08
*** Obulpathi has quit IRC21:10
openstackrecheckConsole logs not available after 13:23s for check-grenade-dsvm 96780,8,f9807c221:15
*** mriedem has joined #openstack-qa21:17
mriedemmtreinish: how much time do we save per run if we disable nova v3 api testes?21:19
mtreinishmriedem: probably quite a bit, there are a lot of tests. I'll push a wip to test it21:19
mriedemi was going to do the same next week, i'm thinking about disabling those in our internal CI since we're not supporting it21:20
mtreinishsdague: looks like the attach is working fine: http://logs.openstack.org/07/98507/1/check/check-grenade-dsvm-icehouse/ab8c90a/console.html#_2014-06-06_21_06_36_82021:21
mtreinishand the iptables rules look reasonable to me21:21
sdagueit's ~8minutes IIRC21:21
*** mmaglana has quit IRC21:21
sdagueI did look at it once21:21
*** kgriffs|afk is now known as kgriffs21:22
sdaguemtreinish: yeh, so you know what would be better21:22
sdagueif we didn't just dump iptables21:23
sdaguebut instead did an analysis of it21:23
openstackgerritMatthew Treinish proposed a change to openstack-dev/devstack: Disable the v3 api tempest tests  https://review.openstack.org/9852521:23
mtreinishsdague: I didn't actually add anything for that failure. that was already in that test21:23
sdaguemtreinish: yeh, I know21:23
mtreinishit was just a coincidence21:24
mtreinishyeah, like print the secgroup listing from nova21:24
mtreinishI think that was there as part of the neutron debug mess21:24
sdaguemtreinish: right, but we could filter it for people in the checker21:25
sdaguefloating IP looks connected: ok21:25
sdaguesecurity groups allow ssh: ok21:25
sdagueanyway, it's bar time :)21:26
sdagueI'll see you over there in a few21:26
openstackrecheckConsole logs not available after 13:24s for gate-python-keystoneclient-python26 81166,14,28d3de021:29
*** nati_ueno has quit IRC21:37
*** mmaglana has joined #openstack-qa21:38
*** mmaglana has quit IRC21:40
*** malini is now known as malini_afk21:41
*** mriedem has quit IRC21:41
openstackrecheckConsole logs not available after 13:29s for check-grenade-dsvm 98499,1,0d5dafe21:42
openstackgerritAnita Kuno proposed a change to openstack-infra/elastic-recheck: Add query for ceilometer periodic notifier ut bug 1321826  https://review.openstack.org/9814921:45
*** aimon__ has quit IRC21:46
*** giulivo has quit IRC21:48
flashgordonwhoa this grenade job is going insnae21:50
flashgordonhttp://jogo.github.io/gate/21:50
openstackgerritAnita Kuno proposed a change to openstack-infra/elastic-recheck: Add query for ceilometer test_notification_service bug 1327344  https://review.openstack.org/9853521:50
*** jamielennox is now known as jamielennox|away21:52
openstackgerritDean Troyer proposed a change to openstack-dev/devstack: Fix Apache site config handling on Fedora  https://review.openstack.org/9853721:52
openstackrecheckConsole logs not available after 13:23s for gate-cinder-python26 97880,9,db492ba21:56
*** dtroyer has quit IRC21:57
*** flwang has quit IRC21:59
*** nati_ueno has joined #openstack-qa21:59
*** nati_ueno has quit IRC22:00
*** dkorn has quit IRC22:01
*** nati_ueno has joined #openstack-qa22:02
*** dtroyer has joined #openstack-qa22:03
*** atiwari has quit IRC22:07
openstackrecheckConsole logs not available after 13:24s for check-grenade-dsvm 92498,4,9d0233622:09
*** aimon_ has joined #openstack-qa22:10
openstackgerritAdam Gandelman proposed a change to openstack-dev/devstack: Setup color logging for Ironic  https://review.openstack.org/9854422:12
*** ajo|mac has quit IRC22:14
*** masayukig has joined #openstack-qa22:19
*** salv-orlando has joined #openstack-qa22:25
openstackrecheckConsole logs not available after 16:13s for check-grenade-dsvm 97233,1,4dcbd3b22:25
*** atiwari has joined #openstack-qa22:26
*** flwang has joined #openstack-qa22:29
*** tmcpeak has joined #openstack-qa22:36
openstackrecheckConsole logs not available after 13:25s for check-grenade-dsvm 95879,3,e71099422:39
*** adalbas has quit IRC22:43
*** ekhugen has quit IRC22:49
openstackrecheckConsole logs not available after 13:23s for check-tempest-dsvm-full 91081,15,ba1100a22:52
*** Sukhdev has joined #openstack-qa22:55
*** Sukhdev_ has joined #openstack-qa23:03
*** Sukhdev has quit IRC23:05
openstackrecheckConsole logs not available after 13:27s for check-grenade-dsvm 98497,2,f97552123:06
*** dims_ has joined #openstack-qa23:11
*** TravT has joined #openstack-qa23:11
*** nati_ueno has quit IRC23:11
*** dims has quit IRC23:14
*** beisner is now known as beisner-weekend23:16
openstackrecheckConsole logs not available after 13:58s for gate-grenade-dsvm 91179,3,e02331d23:20
*** nati_ueno has joined #openstack-qa23:24
*** catohornet1 has joined #openstack-qa23:25
*** Longgeek has joined #openstack-qa23:28
*** Sukhdev_ has quit IRC23:30
*** Longgeek has quit IRC23:32
openstackrecheckConsole logs not available after 13:29s for check-tempest-dsvm-full 98489,1,b466b9e23:37
openstackgerritJoe Gordon proposed a change to openstack/tempest: Skip test_snapshot_pattern  https://review.openstack.org/9855823:49
openstackrecheckConsole logs not available after 14:07s for check-grenade-dsvm 98302,3,20e4ac023:51
*** kgriffs is now known as kgriffs|afk23:55

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!