Friday, 2016-01-22

*** austin81 has left #openstack-qa00:00
*** rbak_ has quit IRC00:01
*** ylobankov has quit IRC00:01
openstackgerritMorgan Fainberg proposed openstack-dev/devstack: Always cache tokens in a shared memcache  https://review.openstack.org/27047400:05
*** jlwhite has quit IRC00:07
*** jpas has quit IRC00:09
*** tochi has quit IRC00:09
*** markvoelker has quit IRC00:11
openstackgerritMerged openstack-dev/devstack: notification_driver is deprecated to driver  https://review.openstack.org/26863600:11
openstackgerritMerged openstack-dev/devstack: Support for logging the nova-dhcpbridge command line  https://review.openstack.org/26981700:12
*** zhangjn has joined #openstack-qa00:17
*** markvoelker has joined #openstack-qa00:18
*** jasonsb has joined #openstack-qa00:25
openstackrecheckopenstack-dev/devstack change: https://review.openstack.org/234232 failed because of: gate-tempest-dsvm-large-ops: https://bugs.launchpad.net/bugs/1491949 https://bugs.launchpad.net/bugs/150061500:28
openstackLaunchpad bug 1491949 in OpenStack Compute (nova) "gate-tempest-dsvm-large-ops fails to deallocate instance network due to rpc timeout" [Medium,Confirmed]00:28
openstackLaunchpad bug 1500615 in OpenStack Compute (nova) "Large Ops scenario is taking too long" [High,Confirmed]00:28
*** yarkot has joined #openstack-qa00:29
openstackgerritfengzhr proposed openstack/tempest: There is no api for searching images with size  https://review.openstack.org/27058500:32
*** Swami has quit IRC00:35
*** zhangjn has quit IRC00:39
*** hoangcx has joined #openstack-qa00:39
*** jaypipes has quit IRC00:41
*** zhangjn has joined #openstack-qa00:41
*** zhangjn has quit IRC00:41
openstackrecheckConsole logs not available after 13:22s for gate-requirements-tox-validate 271072,2,8ea52a800:42
*** salv-orlando has quit IRC00:43
*** armax has quit IRC00:48
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: WIP: Add initial optional influxdb support for test_runs  https://review.openstack.org/27108800:49
*** ksantoshk has quit IRC00:54
*** jacky-zhang has joined #openstack-qa00:56
openstackgerritJamie Lennox proposed openstack-dev/devstack: Put service users in a seperate domain  https://review.openstack.org/27105100:56
*** eil397 has quit IRC00:58
*** jlvillal has quit IRC00:58
*** jlvillal has joined #openstack-qa01:02
*** salv-orlando has joined #openstack-qa01:04
*** pvaneck has quit IRC01:07
*** markvoelker has quit IRC01:09
*** salv-orlando has quit IRC01:09
*** mriedem has joined #openstack-qa01:11
*** yarkot_ has joined #openstack-qa01:18
*** gema has quit IRC01:24
*** ylobankov has joined #openstack-qa01:25
*** gema has joined #openstack-qa01:25
*** yarkot_ has quit IRC01:29
*** rfolco has joined #openstack-qa01:31
*** hitalia has quit IRC01:31
*** ylobankov has quit IRC01:38
*** rfolco has quit IRC01:44
*** ccneill has quit IRC01:45
*** sshnaidm has quit IRC01:48
openstackrecheckConsole logs not available after 13:23s for gate-cinder-pep8 258649,11,ba003e001:54
*** jlwhite has joined #openstack-qa01:54
*** davideagnello has quit IRC01:56
*** bochi-michael has joined #openstack-qa01:59
*** dims__ has joined #openstack-qa02:04
*** dims_ has quit IRC02:06
openstackrecheckConsole logs not available after 13:24s for gate-tempest-dsvm-neutron-full 266633,2,8d02d6702:07
*** mtanino has quit IRC02:07
*** ChuckC has quit IRC02:07
*** zackf has quit IRC02:10
*** zackf has joined #openstack-qa02:11
*** mriedem has quit IRC02:12
*** yamamoto_ has joined #openstack-qa02:18
*** rossella_s has quit IRC02:31
*** rossella_s has joined #openstack-qa02:31
*** yamamoto_ has quit IRC02:38
*** yamamoto_ has joined #openstack-qa02:39
openstackgerritJohn L. Villalovos proposed openstack-dev/devstack: Set PS4 in stack.sh to provide additional debug info  https://review.openstack.org/27112102:45
*** woodster_ has quit IRC02:46
openstackrecheckConsole logs not available after 13:25s for gate-tempest-dsvm-postgres-full 256920,28,da2b87c02:47
*** moravec has joined #openstack-qa02:49
*** hoangcx_ has joined #openstack-qa02:54
*** yamamoto_ has quit IRC02:55
*** hoangcx has quit IRC02:56
*** hoangcx_ is now known as hoangcx02:59
gmannmtreinish: can you look into those - https://review.openstack.org/#/c/270744/ https://review.openstack.org/#/c/270745/03:07
gmannmtreinish: for check requirement job for specs repo03:07
*** achanda has joined #openstack-qa03:08
*** Poornima has joined #openstack-qa03:11
*** yamahata has quit IRC03:11
openstackgerritJamie Lennox proposed openstack-dev/devstack: Allow putting service users in a seperate domain  https://review.openstack.org/27105103:14
openstackrecheckConsole logs not available after 13:26s for gate-keystone-linters 263064,7,849ed9d03:23
*** jlwhite has quit IRC03:23
*** jecarey has joined #openstack-qa03:24
*** jecarey has quit IRC03:29
*** jecarey has joined #openstack-qa03:34
openstackrecheckConsole logs not available after 13:22s for experimental-tempest-dsvm-multinode-full-dibtest 254063,3,ae778d503:36
openstackgerritMerged openstack-dev/devstack: Stop referencing no longer existing SERVICE_ENDPOINT variable  https://review.openstack.org/26896003:38
*** jecarey has quit IRC03:39
openstackrecheckopenstack/horizon change: https://review.openstack.org/268263 failed gate-horizon-npm-run-lint in the gate queue with an unrecognized error03:39
*** yamamoto_ has joined #openstack-qa03:47
openstackrecheckopenstack/swift change: https://review.openstack.org/205803 failed because of: gate-grenade-dsvm: https://bugs.launchpad.net/bugs/1526737 https://bugs.launchpad.net/bugs/1532809 https://bugs.launchpad.net/bugs/135557303:50
openstackLaunchpad bug 1526737 in OpenStack Compute (nova) "Race between nova-network and dnsmasq allocating ips" [High,In progress] - Assigned to Dan Smith (danms)03:50
openstackLaunchpad bug 1532809 in OpenStack Compute (nova) "Gate failures when DHCP lease cannot be acquired" [Undecided,New]03:50
openstackLaunchpad bug 1355573 in OpenStack Compute (nova) "tempest volume scenarios periodically fail /w SSHTimeout" [Undecided,New]03:50
*** nicholasgoracke has joined #openstack-qa03:50
openstackgerritMerged openstack-dev/devstack: use sudo to remove /etc/openstack directory  https://review.openstack.org/26924403:53
*** tochi has joined #openstack-qa03:56
*** ylobankov has joined #openstack-qa03:57
*** ylobankov has quit IRC04:05
*** ylobankov has joined #openstack-qa04:06
*** sabeen1 has joined #openstack-qa04:07
*** dims__ has quit IRC04:08
*** vgridnev has joined #openstack-qa04:08
*** ylobankov has quit IRC04:08
openstackrecheckConsole logs not available after 13:24s for gate-swift-dsvm-functional 271119,1,fdff7fc04:10
openstackrecheckopenstack/swift change: https://review.openstack.org/258720 failed because of: gate-tempest-dsvm-full: https://bugs.launchpad.net/bugs/1526737 https://bugs.launchpad.net/bugs/153280904:10
openstackLaunchpad bug 1526737 in OpenStack Compute (nova) "Race between nova-network and dnsmasq allocating ips" [High,In progress] - Assigned to Dan Smith (danms)04:10
openstackLaunchpad bug 1532809 in OpenStack Compute (nova) "Gate failures when DHCP lease cannot be acquired" [Undecided,In progress] - Assigned to Davanum Srinivas (DIMS) (dims-v)04:10
*** akshai has joined #openstack-qa04:13
*** akshai has quit IRC04:18
*** agireud has quit IRC04:20
*** coolsvap|away has joined #openstack-qa04:21
*** coolsvap|away is now known as coolsvap04:22
*** ylobankov has joined #openstack-qa04:22
*** agireud has joined #openstack-qa04:22
openstackrecheckConsole logs not available after 13:22s for gate-tempest-dsvm-full-ceph 258788,4,427db3a04:24
openstackrecheckopenstack/requirements change: https://review.openstack.org/266189 failed gate-requirements-docs, gate-requirements-pep8, gate-requirements-python27 in the gate queue with an unrecognized error04:24
openstackrecheckopenstack/requirements change: https://review.openstack.org/268229 failed gate-requirements-docs, gate-requirements-pep8, gate-requirements-python27 in the gate queue with an unrecognized error04:24
*** ylobankov has quit IRC04:25
openstackgerritDavid Paterson proposed openstack/tempest: Add unit tests for account generator  https://review.openstack.org/27057604:26
openstackgerritMerged openstack/qa-specs: Remove argparse from requirements  https://review.openstack.org/27039504:30
*** ylobankov has joined #openstack-qa04:31
openstackrecheckConsole logs not available after 13:28s for gate-nova-python27 248989,81,fd081a004:40
*** tochi has quit IRC04:43
*** ylobankov has quit IRC04:43
*** sabeen1 has quit IRC05:03
*** nicholasgoracke has quit IRC05:05
*** hoangcx has quit IRC05:11
*** akshai has joined #openstack-qa05:14
*** akshai has quit IRC05:19
openstackrecheckConsole logs not available after 13:22s for gate-tempest-dsvm-neutron-large-ops 262045,32,9eaca1205:23
*** vgridnev has quit IRC05:24
*** bochi-michael has quit IRC05:27
*** zhangjn has joined #openstack-qa05:27
*** ylobankov has joined #openstack-qa05:27
*** bochi-michael has joined #openstack-qa05:27
*** zhangjn has quit IRC05:28
*** armax has joined #openstack-qa05:37
openstackrecheckConsole logs not available after 13:28s for gate-keystone-python34 271135,1,a700feb05:38
*** SlickNik has quit IRC05:43
*** SridharG has joined #openstack-qa05:44
*** markvoelker has joined #openstack-qa05:44
*** vgridnev has joined #openstack-qa05:47
openstackrecheckConsole logs not available after 13:23s for gate-grenade-dsvm 266160,12,1640f3605:52
openstackrecheckopenstack/glance change: https://review.openstack.org/269989 failed because of: gate-grenade-dsvm: https://bugs.launchpad.net/bugs/1526737 https://bugs.launchpad.net/bugs/1532809 https://bugs.launchpad.net/bugs/135557305:53
openstackLaunchpad bug 1526737 in OpenStack Compute (nova) "Race between nova-network and dnsmasq allocating ips" [High,In progress] - Assigned to Dan Smith (danms)05:53
openstackLaunchpad bug 1532809 in OpenStack Compute (nova) "Gate failures when DHCP lease cannot be acquired" [Undecided,In progress] - Assigned to Davanum Srinivas (DIMS) (dims-v)05:53
openstackLaunchpad bug 1355573 in OpenStack Compute (nova) "tempest volume scenarios periodically fail /w SSHTimeout" [Undecided,New]05:53
*** SlickNik has joined #openstack-qa06:01
*** SlickNik has quit IRC06:01
*** markvoelker_ has joined #openstack-qa06:04
*** Poornima has quit IRC06:05
openstackrecheckConsole logs not available after 13:23s for experimental-tempest-dsvm-multinode-full-dibtest 117104,12,39bb1cc06:06
*** SlickNik has joined #openstack-qa06:06
*** markvoelker has quit IRC06:07
*** _nadya_ has joined #openstack-qa06:10
*** akshai has joined #openstack-qa06:15
openstackrecheckConsole logs not available after 13:22s for gate-keystone-python34 267777,2,c2023d206:19
*** akshai has quit IRC06:20
openstackgerritMarc Koderer proposed openstack/qa-specs: Remove DDT spec  https://review.openstack.org/27114906:21
*** coolsvap is now known as coolsvap|away06:26
*** Poornima has joined #openstack-qa06:27
*** SridharG has quit IRC06:30
*** vgridnev has quit IRC06:33
*** fedexo has joined #openstack-qa06:39
*** yamahata has joined #openstack-qa06:39
openstackrecheckConsole logs not available after 13:23s for experimental-tempest-dsvm-multinode-full-dibtest 259931,7,c5dd8d906:42
*** _nadya_ has quit IRC06:43
*** salv-orlando has joined #openstack-qa06:44
*** achanda has quit IRC06:47
*** vgridnev has joined #openstack-qa06:54
openstackrecheckConsole logs not available after 13:31s for gate-horizon-npm-run-lint 259236,19,320a9c006:55
*** anshul has joined #openstack-qa06:58
*** neeti has joined #openstack-qa06:59
*** SridharG has joined #openstack-qa07:04
*** k4n0 has joined #openstack-qa07:05
openstackgerritMasayuki Igawa proposed openstack/openstack-health: Add parameters for options in URL  https://review.openstack.org/27064307:09
openstackrecheckConsole logs not available after 13:24s for gate-horizon-npm-run-test 270553,4,e652df607:09
*** salv-orlando has quit IRC07:09
*** hichihara has joined #openstack-qa07:11
*** hoangcx has joined #openstack-qa07:11
*** fedexo has quit IRC07:13
*** chenli has joined #openstack-qa07:16
*** akshai has joined #openstack-qa07:16
*** armax has quit IRC07:18
*** akshai has quit IRC07:21
chenlihello, I'm trying to run tempest test by hand, I have followed  https://github.com/openstack/tempest07:21
chenliThis is my steps and my tempest.conf http://paste.openstack.org/show/484646/07:21
chenliThen I run command " testr run tempest.api.image.v2.test_images_member_negative.ImagesMemberNegativeTest.test_image_share_invalid_status --parallel  --concurrency=3"07:22
openstackrecheckConsole logs not available after 13:32s for gate-requirements-python27 268229,3,cc81c6807:22
chenliI get a pass : http://paste.openstack.org/show/484647/07:23
chenlibut only 2 users shows in the log...07:23
*** armax has joined #openstack-qa07:24
*** chenli has quit IRC07:24
*** chenli has joined #openstack-qa07:24
*** ylobankov has quit IRC07:25
*** rcernin has joined #openstack-qa07:31
openstackrecheckConsole logs not available after 13:24s for gate-requirements-pep8 263598,2,04bd99607:36
*** armax has quit IRC07:43
*** oomichi has joined #openstack-qa07:44
openstackrecheckConsole logs not available after 13:23s for gate-horizon-npm-run-test 259231,18,4b9811807:50
*** tochi has joined #openstack-qa07:50
oomichigmann: can you take a look at https://review.openstack.org/#/c/265051/ ?07:51
oomichigmann: just one comment07:51
gmannoomichi: ops, doing07:52
oomichigmann: thanks in advance :)07:52
*** grafuls has joined #openstack-qa07:52
hichiharaoomichi: Can you review https://review.openstack.org/#/c/254063/ ?07:53
oomichihichihara: ok, checking now...07:54
hichiharaoomichi: The patch already get two +2 but other reviewer suggests your review07:54
hichiharaoomichi: Thank you :)07:55
oomichihichihara: ah, andreaf is requiring mine. I missed that, thanks for pointing it out :)07:56
*** safchain has joined #openstack-qa07:58
oomichigmann: about https://review.openstack.org/#/c/25406307:59
hichiharaoomichi: You're welcome :)07:59
openstackgerritGhanshyam Mann proposed openstack/tempest: Separate base microversion client and compute client  https://review.openstack.org/26505108:00
oomichigmann: according to api-wg guideline, HEAD action is defined as EXISTS.08:01
oomichigmann: do you know that meaning ?08:01
gmannoomichi: checking08:02
openstackgerritMasayuki Igawa proposed openstack/openstack-health: Add parameters for options in URL  https://review.openstack.org/27064308:03
openstackrecheckConsole logs not available after 13:24s for gate-grenade-dsvm 267962,9,d907be608:03
gmannoomichi: yea, that actually suggested to use to knwo whether resource exist or not08:03
gmannoomichi: mean check resource internally and tell it is present or not08:04
oomichigmann: then, agreeing with "check_" right?08:04
oomichigmann: HEAD is defined on https://tools.ietf.org/html/rfc7231#section-4.3.208:05
gmannoomichi: yea, i checked keystone code and they just check roles are assigned or not08:05
gmannoomichi: basically as per my understanding, HEAD is to 1. small amount of resource data or 2. get only few metadata 3. only check existence of resource without returning anything08:07
gmannoomichi: 1 and 2 mainly used to speed up the getting resource than GET which fetch all resource data and may take time08:07
oomichigmann: yeah, right. HEAD seems almost same as GET without "response body"08:08
gmannoomichi: yea but there is also no hard rule that HEAD cannot return response body08:08
gmannoomichi: it may return but very few necessary info like links etc08:08
oomichigmann: according to the RFC, "the server MUST NOT send a message body in the response"08:09
oomichithat seems hard rule as RFC08:09
oomichieven if RFC ;)08:10
mkodererandreaf: hi, could you have a look at https://review.openstack.org/#/c/255161/708:10
gmannoomichi: yea you are right, info only in header only not response body08:10
*** hichihara has quit IRC08:11
mkoderersince your working on the client managers.. I am not sure if this change will affect you in any way08:11
gmannoomichi: but not much clear and thats why in api-wg also :)08:11
oomichigmann: nice point, I agree :)08:11
gmannoomichi: RFC should be kind of MUST guidelines instead of MAY BE kinda :)08:12
*** boris-42 has quit IRC08:13
*** _nadya_ has joined #openstack-qa08:14
oomichigmann: RFC is just "Request for Comments" on the meaning IIUC, not so hard. but I agree that api-wg is based on that08:16
gmannoomichi: humm08:17
*** akshai has joined #openstack-qa08:17
*** achanda has joined #openstack-qa08:17
gmannoomichi: stress tests failing on this experimental v3 job - https://review.openstack.org/#/c/254063/308:17
*** _nadya_ has quit IRC08:17
gmannoomichi: m running on my local env to see if anything that patch introduced08:18
*** vgridnev has quit IRC08:20
*** akshai has quit IRC08:22
dmelladohi gmann, I've been noticing quite some failures in experimental gates for a while :\08:22
dmelladowouldn't be able to check precisely when this has started08:22
*** achanda has quit IRC08:22
dmelladois there anything that we should be aware of about this?08:22
dmelladomaybe we should move stress gates from experimental to non-experimental in order to avoid having theses broken08:23
gmanndmellado: any link?08:23
dmelladofor instance this patch, hold on08:24
gmanndmellado: i mean other than that08:24
gmanndmellado: stress tests takes lot of time and might not be suitable for non-experiment08:24
dmelladogmann:, I'm checking for the link ;)08:24
gmanndmellado: just want to verify those08:24
dmelladogmann: then maybe a subset of stress?08:24
gmanndmellado: ok, thansks08:24
oomichigmann: nice catch08:25
dmelladogmann: https://review.openstack.org/#/c/259931/08:25
dmelladothis patch doesn't modify any stress related code08:25
dmelladoand the stress gates are failing08:25
dmelladoI was chatting about this with JordanP the other day08:26
dmelladoso maybe he could also have some patch to show you as an example08:26
dmelladoI'd have liked to take a look but I'm *terribly* busy with other stuff downstream, non-tempest related so wasn't available to have upstream fun :\08:27
gmanndmellado: ohh..08:29
dmelladogmann: yep :\08:33
*** markvoelker_ has quit IRC08:38
mkodererdmellado: gmann: is there a bug opened for the stress test?08:39
mkodererif yes you can assign it to me08:39
mkodererI will take care08:39
gmannmkoderer: i do not think so, today only i saw this failing08:40
gmannmkoderer: Thanks it will be really helpful08:40
mkoderergmann: k, I will open one08:40
gmannmkoderer: cool. Thanks again :)08:41
dmelladomkoderer: I'll open it and assign it to you08:41
*** apevec has joined #openstack-qa08:42
*** apevec has quit IRC08:42
*** apevec has joined #openstack-qa08:42
mkodererdmellado: already done08:43
mkodererhttps://bugs.launchpad.net/tempest/+bug/153695608:43
openstackLaunchpad bug 1536956 in tempest "Stress tests are failing (experimental-queue)" [Medium,Triaged] - Assigned to Marc Koderer (m-koderer)08:43
mkodererdmellado: but you can add more information if you have some08:43
dmelladomkoderer: thanks, will do! ;)08:44
*** oomichi is now known as oomichi_away08:45
*** oomichi_away has quit IRC08:49
openstackrecheckConsole logs not available after 13:23s for gate-cinder-pep8 258880,26,2bd05e508:52
*** k4n0 has quit IRC08:52
*** shardy has joined #openstack-qa08:53
*** ihrachys has joined #openstack-qa08:53
gmannmkoderer: got the issue for stress failure08:55
gmannmkoderer: that is because of configured cred is being used by stress tests by default08:55
gmannmkoderer: and devstack has removed those08:55
gmannmkoderer: just replied to bug08:55
gmannmkoderer: you are putting fix or should i push ?08:57
*** tochi has quit IRC08:59
*** tochi has joined #openstack-qa09:02
mkoderergmann: I will need until monday do work on it09:04
mkoderergmann: so feel free to assign it to you if you have the fix ;)09:04
gmannmkoderer: oh, i will push.09:04
*** jordanP has joined #openstack-qa09:04
mkoderergmann: +109:05
*** ihrachys has quit IRC09:05
openstackrecheckConsole logs not available after 13:27s for experimental-tempest-dsvm-multinode-full-dibtest 254063,3,9b6db9f09:06
*** ihrachys has joined #openstack-qa09:09
*** drptbl has joined #openstack-qa09:09
openstackgerritGhanshyam Mann proposed openstack/tempest: Fix stress tests job to use dynamic cred  https://review.openstack.org/27119509:12
*** akshai has joined #openstack-qa09:18
*** binbincong has quit IRC09:18
*** akshai has quit IRC09:23
*** e0ne has joined #openstack-qa09:24
*** vgridnev has joined #openstack-qa09:25
*** gfidente has joined #openstack-qa09:26
*** e0ne has quit IRC09:27
*** boris-42 has joined #openstack-qa09:33
*** markvoelker has joined #openstack-qa09:34
*** _nadya_ has joined #openstack-qa09:34
*** _nadya_ has quit IRC09:35
*** jacky-zhang has quit IRC09:38
*** markvoelker has quit IRC09:39
*** markvoelker has joined #openstack-qa09:39
*** jecarey has joined #openstack-qa09:40
*** markvoelker has quit IRC09:44
*** jecarey has quit IRC09:44
*** markvoelker has joined #openstack-qa09:45
*** markvoelker has quit IRC09:50
*** _nadya_ has joined #openstack-qa10:01
*** ihrachys has quit IRC10:01
*** dtantsur|afk is now known as dtantsur10:06
*** drptbl has quit IRC10:08
*** Poornima is now known as Poornima|L010:13
*** drptbl has joined #openstack-qa10:14
*** akshai has joined #openstack-qa10:18
*** achanda has joined #openstack-qa10:20
*** akshai has quit IRC10:23
*** cdent has joined #openstack-qa10:23
*** aix has joined #openstack-qa10:23
openstackgerritPiyush Pathak proposed openstack/tempest: Make 2 functions in network_client use **kwargs  https://review.openstack.org/25884810:25
*** jasonsb has quit IRC10:26
*** achanda has quit IRC10:28
*** apevec has quit IRC10:30
*** apevec has joined #openstack-qa10:30
*** apevec has quit IRC10:30
*** apevec has joined #openstack-qa10:30
*** rossella_s has quit IRC10:31
*** rossella_s has joined #openstack-qa10:31
*** tosky has joined #openstack-qa10:33
*** markvoelker has joined #openstack-qa10:35
*** tochi has quit IRC10:37
*** markvoelker has quit IRC10:39
*** e0ne has joined #openstack-qa10:40
openstackgerritPiyush Pathak proposed openstack/tempest: Make 2 functions in network_client use **kwargs  https://review.openstack.org/25884810:41
*** Poornima|L0 is now known as Poornima10:42
*** vgridnev has quit IRC10:44
*** vgridnev has joined #openstack-qa10:48
openstackgerritPiyush Pathak proposed openstack/tempest: Make 2 functions in network_client use **kwargs  https://review.openstack.org/25884810:58
*** sshnaidm has joined #openstack-qa10:59
*** dims has joined #openstack-qa11:00
openstackrecheckConsole logs not available after 13:24s for gate-cinder-python34 271197,1,ebf694611:01
openstackgerritMerged openstack/tempest: create_server: pass arguments as part of kwargs  https://review.openstack.org/25985911:03
*** aysyd has joined #openstack-qa11:12
*** markvoelker has joined #openstack-qa11:12
openstackrecheckConsole logs not available after 13:27s for gate-tempest-dsvm-neutron-src-glance_store 270734,4,f0a7deb11:15
*** markvoelker has quit IRC11:18
openstackgerritMerged openstack-dev/devstack: neutron: enable MTU advertisement  https://review.openstack.org/26753811:18
openstackgerritMerged openstack/tempest: API/compute: create all servers through the common wrappers  https://review.openstack.org/26534311:18
*** hoangcx has quit IRC11:19
*** aix has quit IRC11:23
*** achanda has joined #openstack-qa11:24
*** yamamoto_ has quit IRC11:25
*** rfolco has joined #openstack-qa11:25
openstackrecheckConsole logs not available after 13:29s for gate-grenade-dsvm 271181,2,53cf7e811:28
*** achanda has quit IRC11:28
*** chenli_ has joined #openstack-qa11:28
openstackrecheckopenstack/nova change: https://review.openstack.org/187395 failed because of: gate-grenade-dsvm: https://bugs.launchpad.net/bugs/1526737 https://bugs.launchpad.net/bugs/1532809 https://bugs.launchpad.net/bugs/135557311:28
openstackLaunchpad bug 1526737 in OpenStack Compute (nova) "Race between nova-network and dnsmasq allocating ips" [High,In progress] - Assigned to Dan Smith (danms)11:28
openstackLaunchpad bug 1532809 in OpenStack Compute (nova) "Gate failures when DHCP lease cannot be acquired" [Undecided,In progress] - Assigned to Davanum Srinivas (DIMS) (dims-v)11:28
openstackLaunchpad bug 1355573 in OpenStack Compute (nova) "tempest volume scenarios periodically fail /w SSHTimeout" [Undecided,New]11:28
*** chenli has quit IRC11:30
*** chenli_ is now known as chenli11:30
*** aix has joined #openstack-qa11:37
*** cdent has quit IRC11:43
*** openstackgerrit has quit IRC11:47
*** openstackgerrit has joined #openstack-qa11:47
*** kbaikov has quit IRC11:49
*** boris-42 has quit IRC11:53
openstackrecheckConsole logs not available after 13:28s for gate-requirements-tox-validate 263598,2,c677f8012:01
*** kbaikov has joined #openstack-qa12:01
*** markvoelker has joined #openstack-qa12:07
*** yamamoto has joined #openstack-qa12:09
*** erlon has joined #openstack-qa12:10
*** chenli has quit IRC12:10
*** markvoelker has quit IRC12:12
*** yamamoto has quit IRC12:13
*** yamamoto has joined #openstack-qa12:15
*** moravec has quit IRC12:18
openstackgerritMerged openstack-dev/devstack: Always cache tokens in a shared memcache  https://review.openstack.org/27051512:18
*** akshai has joined #openstack-qa12:20
*** akshai has quit IRC12:24
*** moravec has joined #openstack-qa12:25
openstackrecheckConsole logs not available after 13:24s for gate-requirements-python27 266189,6,9c476ef12:25
*** yamamoto has quit IRC12:32
*** yamamoto has joined #openstack-qa12:32
*** yamamoto has quit IRC12:33
*** openstackgerrit has quit IRC12:33
*** openstackgerrit has joined #openstack-qa12:33
*** yamamoto has joined #openstack-qa12:33
*** gszasz has joined #openstack-qa12:36
openstackgerritAlex Petrov proposed openstack/tempest: Identity V3: missing api coverage for 'Get Endpoint' method  https://review.openstack.org/27092812:38
*** jordanP has quit IRC12:40
*** ccarmack has joined #openstack-qa12:41
*** markvoelker has joined #openstack-qa12:42
*** jaypipes has joined #openstack-qa12:45
*** ChanServ sets mode: +o jaypipes12:45
*** jaypipes is now known as leakypipes12:45
*** yamamoto has quit IRC12:46
*** yamamoto has joined #openstack-qa12:46
openstackgerritSean Dague proposed openstack-dev/devstack: reduce default lease time to 5 minutes  https://review.openstack.org/27127712:50
*** yamamoto has quit IRC12:51
*** cdent has joined #openstack-qa12:53
*** markvoelker has quit IRC12:54
*** dims is now known as dimsum__13:00
*** vgridnev has quit IRC13:01
*** cdent is now known as anticdent13:04
*** dtantsur is now known as dtantsur|brb13:11
*** weshay_xchat has joined #openstack-qa13:12
*** weshay_xchat is now known as weshay13:13
*** drptbl has quit IRC13:13
*** yamamoto has joined #openstack-qa13:14
*** drptbl has joined #openstack-qa13:14
*** vgridnev has joined #openstack-qa13:16
*** e0ne has quit IRC13:16
*** e0ne has joined #openstack-qa13:17
*** vgridnev has quit IRC13:19
*** edmondsw has joined #openstack-qa13:20
*** grafuls has quit IRC13:20
*** grafuls has joined #openstack-qa13:21
*** vgridnev has joined #openstack-qa13:23
openstackrecheckConsole logs not available after 13:23s for gate-tempest-dsvm-neutron-full 271250,2,69a075f13:24
openstackrecheckopenstack-dev/devstack change: https://review.openstack.org/270856 failed because of: gate-tempest-dsvm-large-ops: https://bugs.launchpad.net/bugs/149194913:25
openstackLaunchpad bug 1491949 in OpenStack Compute (nova) "gate-tempest-dsvm-large-ops fails to deallocate instance network due to rpc timeout" [Medium,Confirmed]13:25
*** jffische has joined #openstack-qa13:25
*** jffische has left #openstack-qa13:27
*** jffische has joined #openstack-qa13:28
*** malini has joined #openstack-qa13:31
*** malini1 has joined #openstack-qa13:33
*** bochi-michael has quit IRC13:34
*** jordanP has joined #openstack-qa13:35
*** malini has quit IRC13:36
*** annemccormick has joined #openstack-qa13:38
*** markvoelker has joined #openstack-qa13:38
*** annemccormick_ has joined #openstack-qa13:39
*** dtantsur|brb is now known as dtantsur13:42
openstackrecheckConsole logs not available after 13:24s for gate-tempest-dsvm-full 270589,2,865f2c013:42
*** annemccormick has quit IRC13:42
*** annemccormick_ is now known as annemccormick13:42
*** markvoelker has quit IRC13:43
*** jswarren has joined #openstack-qa13:51
*** jpas has joined #openstack-qa13:51
*** markvoelker has joined #openstack-qa13:59
*** markvoelker_ has joined #openstack-qa14:01
*** anshul has quit IRC14:01
*** markvoelker has quit IRC14:04
*** drptbl has quit IRC14:07
*** drptbl has joined #openstack-qa14:09
*** annemccormick has quit IRC14:10
*** dkranz has joined #openstack-qa14:12
*** sabeen1 has joined #openstack-qa14:18
*** sabeen3 has joined #openstack-qa14:20
*** akshai has joined #openstack-qa14:21
*** mriedem has joined #openstack-qa14:22
sc68calsdague: +2'd your patch to devstack that shortens the dchp lease time in n-net14:22
*** sabeen1 has quit IRC14:22
sc68cal*dhcp14:22
sdaguesc68cal: cool14:23
sdaguethat's in the "can't hurt" realm I think14:23
mriedemodd, this job showed up on the uncategorized bugs page, but it was successful http://logs.openstack.org/01/267401/1/gate/gate-tempest-dsvm-neutron-full/1f49e99/console.html14:24
*** neeti has quit IRC14:26
sc68calsdague: yeah. I have to find kevinbenton's patch - I know in Neutron we adjusted the default lease time. I think shortened it.14:26
*** Poornima has quit IRC14:27
mriedemsc68cal: have you been noticing a rise in neutron job timeouts?14:27
*** nicholasgoracke has joined #openstack-qa14:27
*** nicholasgoracke has quit IRC14:27
sdaguemriedem: so, my guess, is that's the logstash overrun14:28
*** nicholasgoracke has joined #openstack-qa14:28
mriedemtell me more14:28
sc68calmriedem: I haven't. I think I've seen the run time for neutron decrease recently. I know we were up around 1:30 for a while but a couple patches i've seen around 1hr14:28
sc68caloh wait that's grenade14:29
sc68caloh wow gate-tempest-dsvm-neutron-full is 1:4514:29
sc68calttps://review.openstack.org/#/c/267850/14:29
sc68calelp.14:29
sc68calwelp.14:29
sdaguemriedem: http://logstash.openstack.org/#dashboard/file/logstash.json?query=build_status%3AFAILURE%20AND%20build_change%3A26740114:29
*** regXboi has joined #openstack-qa14:29
mriedemsc68cal: yeah http://logs.openstack.org/24/265024/5/gate/gate-tempest-dsvm-neutron-full/52b2b13/console.html#_2016-01-18_13_34_37_99114:29
sdaguelogstash is not stopping it's multiline parsing at the end of a file14:29
sdagueso it gets a new file and jams it in14:30
sdaguethe ansible output is a huge part of the issue here14:30
*** rossella_s has quit IRC14:31
sdague_id:AVJhr89q5FfNtYbkLjHC14:31
sdaguethat's a good instance of this14:31
openstackrecheckConsole logs not available after 13:23s for gate-nova-pep8 271272,1,3ec82dd14:31
*** akshai has quit IRC14:31
sc68calmriedem: since you're alive, can we discuss classifying https://review.openstack.org/#/c/254610/ ?14:31
sc68calor are you ignoring me on that one ;)14:31
*** rossella_s has joined #openstack-qa14:31
mriedemno, i don't understand the reply though14:32
mriedemsdague: fun14:33
sdagueI thought clarkb addressed it, but I guess not14:33
mriedemi was also asking about neutron job timeouts because a lot of the neutron job failures that are uncategorized are timeouts14:33
mriedemhttp://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22Killed%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20timeout%20-s%209%5C%22%20AND%20build_name%3A*neutron*%20AND%20tags%3A%5C%22console%5C%22&from=7d14:33
sdagueright, that timeout is the keystone middleware issue14:34
mriedemi was thinking those were just ovh or internap but they are on rax nodes too14:34
mriedemkeystone middleware issue?!14:34
mriedemtell me more!14:34
sdaguesc68cal: where is the tempest code that you think is wrong14:34
sdaguekeystone middleware 4.1 removed their caching layer14:34
sdagueso all keystone requests double in time14:34
mriedemsdague: this http://git.openstack.org/cgit/openstack/tempest/tree/tempest/scenario/manager.py#n82414:34
sdagueneutron talks to keystone a lot14:34
mriedemstevemar: bknudson: why did keystone middleware 4.1 remove it's caching layer?14:35
mriedemyou guys are oslo.cache cores for god's sake14:35
sc68calsdague: I'm not sure where in the tempest code, but reading the logs I found a place where it appears tempest is re-using the UUID after deletion - https://bugs.launchpad.net/neutron/+bug/1523638/comments/514:35
openstackLaunchpad bug 1523638 in neutron "tempest fails with No IPv4 addresses found" [High,Confirmed] - Assigned to Sean M. Collins (scollins)14:35
mriedemsc68cal: code is above ^14:36
* mriedem likes http://codesearch.openstack.org/14:36
sdagueso that requires all the ports are active14:37
sdagueor sorry, that the server is active14:37
sc68calmriedem: thx14:37
sc68calsdague: right14:37
sc68calthe logic must be funky though, because Nova got a termination request14:37
mriedemare you sure? looks like status='ACTIVE' is on a port list call to me14:38
mriedemnot server list14:38
mriedemfiltering by device_id, which is the server uuid14:38
sc68cal2015-12-08 16:08:10.995 - instance is deleted14:38
sc68cal2015-12-08 16:08:16.402 - someone queries about the instance that they terminated a couple seconds ago14:38
sc68calnova returns a 40414:39
sc68caland that bubbles up through tempest, where the list of ips is an empty set14:39
sc68calwhich then that error gets thrown14:40
bknudsonmriedem: the comment in the commit was that keystonemiddleware shouldn't do its own caching by default and the deployer should configure memcache14:40
mriedemblarg14:40
mriedembknudson: is anyone adding that config to devstack?14:40
sdaguemriedem: yes14:40
bknudsonalso, I don't think we ever switched keystonemiddleware to use oslo.cache14:40
bknudsonnotmorgan has a change to configure memcache in devstack14:40
mriedemok14:41
mriedemi hope that all went out with a deprecation cycle and/or release notes or something14:41
bknudsonmriedem: https://review.openstack.org/#/c/270515/14:41
sdaguemriedem: it did not14:41
mriedemgreat14:41
sdagueI argued in the requirements review that we need a big fat warning, including a keystone middleware warning of dropping something like this14:42
bknudsonhere's the review: https://review.openstack.org/#/c/212345/14:42
mriedemsdague: yeah i'd agree with that14:42
bknudsonin keystonemiddleware14:43
sdaguesc68cal: any idea where this is getting called in the dealocate path?14:43
mriedemsdague: commented on https://review.openstack.org/#/c/212345/14:44
sc68calsdague: nope.14:44
openstackrecheckConsole logs not available after 13:22s for gate-glance-pep8 269965,2,56a963b14:44
*** neeti has joined #openstack-qa14:44
sdaguebecause I only see it during allocate14:44
*** pcaruana has joined #openstack-qa14:49
sdaguesc68cal: yeh, so this is another wait and timing issue14:50
sdagueit's assuming that ports are on the server the second the server is active14:50
sc68calsdague: gotcha14:51
sdaguebut this code is so over optimized, unwinding that is .... going to be pretty hard14:51
sc68calyeah :(14:51
sc68calIt looks like something masks the 404 not found from nova14:52
mriedemsdague: ah i found https://review.openstack.org/#/c/270417/ - that's not a cap though14:52
sc68calthe ports client in the tempest client should catch that 404 and bail14:52
*** yamamoto has quit IRC14:52
sdaguesc68cal: actually, make sure you keep an eye on what's in the cleanups path14:53
sdague_run_cleanups is happening in teardown14:53
sdaguewe've failed before then14:53
sc68calack14:54
sdaguehttp://127.0.0.1:9696/v2.0/ports?device_id=8e527171-7125-4585-b896-6d1b86e74481&fixed_ip=None&status=ACTIVE14:54
sdagueis the thing that failed14:54
sc68calsdague: can you link me that log line?14:54
*** obutenko has quit IRC14:55
sdaguehttp://logs.openstack.org/66/254166/2/gate/gate-tempest-dsvm-neutron-linuxbridge/350516d/console.html.gz#_2015-12-08_16_31_39_74314:55
sdaguethis is why we have the function introspection on the logging14:55
sdagueTestSecurityGroupsBasicOps:_run_cleanups14:55
sdagueclass and function running that rest call14:55
* sc68cal digs more14:56
*** markvoelker has joined #openstack-qa14:57
*** jlwhite has joined #openstack-qa14:57
sdaguesc68cal: https://github.com/openstack/tempest/blob/acbc4864bda883384dffface9cfbd61f414cffce/tempest/scenario/test_security_groups_basic_ops.py#L27114:57
sdagueright there you need to add a poll to wait for ports to get active14:57
openstackrecheckConsole logs not available after 13:22s for gate-nova-python34 241189,14,253212b14:58
sdaguebefore assign floating ips runs14:58
sdaguethat will address this14:58
*** SridharG has quit IRC14:58
sc68calright. So that fixes the case where tempest doesn't wait for ports to come up14:59
sc68caldid I misread the logs where it's using the UUID after termination?14:59
sc68calor are we looking at two different ways tempest was buggy15:00
sc68cal*at least two15:00
*** rbak has joined #openstack-qa15:00
*** markvoelker_ has quit IRC15:01
sc68calbecause I see this - http://logs.openstack.org/66/254166/2/gate/gate-tempest-dsvm-neutron-linuxbridge/350516d/console.html.gz#_2015-12-08_16_31_39_80015:01
sc68calInstance 8e527171-7125-4585-b896-6d1b86e74481 could not be found15:01
mriedemhmm, req-962533cc-2852-4f37-85f1-353339a493e8 doesn't show up anywhere else15:03
mriedemoh,15:03
mriedemsc68cal: that's probably just a wait for server termination in the cleanups15:04
mriedemin that case the 404 is normal,15:04
mriedemthe waiter code is specifically waiting for a 40415:04
mriedemto break the wait loop15:04
mriedemhttps://github.com/openstack/tempest/blob/master/tempest/common/waiters.py#L10015:05
sc68calugh15:06
sc68calgetting pulled in multiple directions here15:07
sc68calnow I'm seeing this funkyness in devstack - install_get_pip is failing. http://paste.openstack.org/show/484708/15:08
mriedemthat was being talked about in infra the other day i think15:09
mriedempip 8?15:09
dtantsurhey folks! does https://bugs.launchpad.net/ironic/+bug/1537076 ring any bells to anyone? can it be something related to keystone v2->v3 story?15:10
openstackLaunchpad bug 1537076 in Ironic "Timed out waiting for Nova hypervisor-stats count >= 1 due to Nova Unable to establish connection to http://127.0.0.1:35357/v2.0/tokens" [High,Confirmed]15:10
sdaguesc68cal: that's at the end of the cleanup15:10
sc68calmriedem: yeah probably15:10
sdaguesc68cal: Request (TestSecurityGroupsBasicOps:_run_cleanups)15:11
sdaguegot up 4 lines15:11
sdaguenotice it's in _run_cleanups15:11
openstackrecheckConsole logs not available after 13:21s for gate-grenade-dsvm 246625,16,7cd943715:11
sdaguesc68cal: everything after - 2015-12-08 16:08:10,22415:11
sdagueis running the code added to addCleanup, because the test is over15:12
*** markvoelker has quit IRC15:12
sc68calsdague: ack15:13
*** sigmavirus24_awa is now known as sigmavirus2415:13
sdaguethe 404 for the server at the end isn't an error15:13
sdagueit's actually expected, because it issues deletes and waits on them15:13
*** drptbl has quit IRC15:14
sdague2015-12-08 16:08:10,224 is the DELETE for the server15:14
sdagueit's just checking that it's done at the end15:14
sc68calah15:14
sc68calthanks, that makes sense15:15
sdaguebecause if you don't wait for server deletes, then you can very easily go over real mem limits during tests15:15
sdaguewhich we used to do15:15
sdaguea lot15:15
mriedemi feel like i said all of this 10 min ago....15:15
mriedemdeja vu15:15
sdaguemriedem: yeh, you did, sorry, I didn't see your response15:16
sc68calsorry, it just may take a little more explaining and patience15:16
mriedemmtreinish can triple dip when he's awake :)15:16
sc68callol, no I think twice will suffice :)15:16
* sc68cal adds link to transcript to his trello board for this bug15:18
*** drptbl has joined #openstack-qa15:22
*** zz_dimtruck is now known as dimtruck15:22
openstackrecheckConsole logs not available after 13:21s for experimental-tempest-dsvm-multinode-full-dibtest 271195,1,270972515:24
*** malini1 has left #openstack-qa15:25
sdaguesc68cal: do you know if neutron is actually setting mtu to the guests now?15:27
sdagueor where that would get validated?15:27
*** anticdent has quit IRC15:28
sc68calsdague: so - we need to set it via devstack - with https://review.openstack.org/#/c/267604/15:28
sc68calsdague: and then neutron will take that MTU, calculate the overhead for the tunnel mechanism being used, then pass it into the instance via dhcp15:28
*** achanda has joined #openstack-qa15:29
*** mragupat has joined #openstack-qa15:30
sc68calvia https://review.openstack.org/#/c/263486/15:31
sc68calihar has a patch that links a couple things together when it comes to MTU stuff, handling backports to stable/liberty and master so that we can get grenade multinode up and running - https://review.openstack.org/#/c/265759/1415:32
*** ylobankov has joined #openstack-qa15:33
mtreinishmriedem: ?15:34
*** achanda has quit IRC15:34
*** slowrie has quit IRC15:35
*** slowrie has joined #openstack-qa15:35
openstackgerritMarkus Zoeller (markus_z) proposed openstack-dev/devstack: remove "redhat-rpm-config" (F21 dependency)  https://review.openstack.org/27138115:36
mriedemmtreinish: nothing15:36
sdaguesc68cal: where does that adjust the dhcp option?15:36
sc68calsdague: https://github.com/openstack/neutron/blob/master/neutron/agent/linux/dhcp.py#L37015:37
*** jecarey has joined #openstack-qa15:38
sdaguesc68cal: hmmm, but that uses an option that's not this one - https://review.openstack.org/#/c/267604/5/lib/neutron_plugins/ml215:38
openstackrecheckConsole logs not available after 13:24s for gate-horizon-dsvm-integration 271248,4,aedd04915:38
sdagueadvertise_mtu is not set anywhere in devstack15:39
openstackgerritAlexander Gubanov proposed openstack/tempest: Add new tempest test "RebuildInstanceWithVolume"  https://review.openstack.org/18236515:41
*** markvoelker has joined #openstack-qa15:44
*** woodster_ has joined #openstack-qa15:44
*** neeti has quit IRC15:44
sdagueclarkb: http://logs.openstack.org/72/271272/1/check/gate-tempest-dsvm-multinode-full/a41d736/console.html - that's with the mtu forced to 1400 in the guests15:45
sdaguestill having odd ssh fails15:45
sc68calsdague: right, let me refresh myself on what path_mtu is used for15:48
*** nicholasgoracke has quit IRC15:49
*** pglass has joined #openstack-qa15:50
sc68calsdague: so, for master branch we have advertise_mtu set to true by default15:50
*** nicholasgoracke has joined #openstack-qa15:50
*** nicholasgoracke has quit IRC15:50
sc68calso we just need to set path_mtu to something15:50
*** nicholasgoracke has joined #openstack-qa15:51
sc68calI have to refresh my memory on what we're doing for liberty - I think ihar had to do something different15:51
*** yamahata has quit IRC15:52
openstackrecheckConsole logs not available after 13:23s for gate-tempest-dsvm-neutron-full 271252,2,4de86b915:52
*** yamahata has joined #openstack-qa15:52
*** e0ne has quit IRC15:52
*** cdent has joined #openstack-qa15:52
sc68calI think it might be via this patch - https://review.openstack.org/#/c/267847/15:52
*** e0ne has joined #openstack-qa15:53
sc68cali'll have to ask him on monday15:53
*** safchain has quit IRC15:54
sc68calsorry, I feel kind of stupid today, only 3 hours of sleep. I am probably not making much sense15:54
*** patient-0-bl0gan is now known as blogan16:05
openstackrecheckConsole logs not available after 13:23s for gate-tempest-dsvm-ceilometer-mysql-neutron-full 270928,2,26a8eb916:05
*** vgridnev has quit IRC16:07
*** salv-orlando has joined #openstack-qa16:08
*** salv-orlando has quit IRC16:12
*** mragupat has quit IRC16:12
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck: Add query for keystonemiddleware 4.0.0 / gnocchi bug 1522014  https://review.openstack.org/27141416:13
openstackbug 1522014 in Gnocchi "keystonemiddleware 4.0.0 breaks gnocchi gate" [Critical,Fix committed] https://launchpad.net/bugs/152201416:13
mriedemmtreinish: ^16:13
mtreinishmriedem: +A16:14
*** mragupat has joined #openstack-qa16:15
*** rcernin has quit IRC16:15
openstackrecheckConsole logs not available after 13:24s for experimental-tempest-dsvm-multinode-full-dibtest 270999,1,b0b1bb316:18
*** ccarmack has quit IRC16:22
*** ccarmack has joined #openstack-qa16:28
openstackrecheckConsole logs not available after 13:24s for gate-grenade-dsvm 260587,9,676b00c16:32
*** sabeen3 has quit IRC16:32
*** ccneill has joined #openstack-qa16:32
*** armax has joined #openstack-qa16:33
*** hop has quit IRC16:37
sc68calmtreinish: hey, do you have any insight into what this error is? http://paste.openstack.org/show/484708/16:41
sdaguesc68cal: thats pip < 716:42
sc68calhow do I fix? this is a fresh VM16:42
sdaguerm /home/vagrant/devstack/files/get-pip.py16:43
sdagueit can16:43
sdague't be a fully fresh vm16:43
*** mtanino has joined #openstack-qa16:43
sdagueunless there is a whole new pip issue16:43
*** jlwhite has quit IRC16:43
*** jlwhite has joined #openstack-qa16:44
sc68calah - get-pip.py is something that is cached?16:44
sc68calthink i'm going to go home and go to bed.16:45
openstackrecheckConsole logs not available after 13:26s for gate-nova-python27 271272,1,3b4e8aa16:45
mtreinishyeah, we do that because we put it on the nodepool images so we don't have to download it every run16:45
openstackgerritMerged openstack-infra/elastic-recheck: Add query for keystonemiddleware 4.0.0 / gnocchi bug 1522014  https://review.openstack.org/27141416:46
openstackbug 1522014 in Gnocchi "keystonemiddleware 4.0.0 breaks gnocchi gate" [Critical,Fix committed] https://launchpad.net/bugs/152201416:46
mtreinishI probably should have used -r instead of -c when I patched devstack to cap pip < 816:46
*** dimtruck is now known as zz_dimtruck16:46
*** salv-orlando has joined #openstack-qa16:47
clarkbsdague how was it set?16:47
sdaguein dnsmasq16:48
sdagueso all dhcp clients will get it16:48
sdagueclarkb: https://review.openstack.org/#/c/271272/16:49
clarkband that version of cirros is one that accepts the dhcp option? I remember that was another thing16:49
sdague0.3.3 is supposed to16:50
*** sabeen has joined #openstack-qa16:50
sdaguewe're using 0.3.416:50
*** achanda has joined #openstack-qa16:50
clarkbsdague it used the wrong IP16:52
clarkb10.1.0.4 is not routable16:52
*** sabeen2 has joined #openstack-qa16:52
sdagueoh, we're still on that break16:53
sdaguesorry, my bad16:53
*** openstackrecheck has quit IRC16:54
*** openstackrecheck has joined #openstack-qa16:54
*** rcernin has joined #openstack-qa16:54
*** sabeen has quit IRC16:55
*** e0ne has quit IRC16:55
*** achanda has quit IRC16:57
*** ylobankov has quit IRC16:58
*** achanda has joined #openstack-qa16:59
*** zz_dimtruck is now known as dimtruck17:00
stevemarmriedem: did you go for lunch yet?17:03
mriedemtrying to17:03
stevemarmriedem: okay, go ahead, we have the changes all lined up for ksm: https://review.openstack.org/#/c/270974/ if you wanted to review17:04
*** jlwhite_ has joined #openstack-qa17:04
*** jlwhite has quit IRC17:04
*** yamahata has quit IRC17:06
openstackrecheckConsole logs not available after 13:50s for gate-glance-python34 269965,3,26750ba17:11
*** drptbl has quit IRC17:11
*** ylobankov has joined #openstack-qa17:15
openstackgerritJohn L. Villalovos proposed openstack-infra/devstack-gate: Set PS4 to provide additional debug info  https://review.openstack.org/27143417:21
openstackgerritMerged openstack-dev/devstack: Add flag for test_volume_services  https://review.openstack.org/26422317:24
*** nicholasgoracke has quit IRC17:24
dimsum__sdague : don't we need this on the stable/liberty side too? https://review.openstack.org/#/c/271277/17:25
sdaguedimsum__: sure, but master first17:25
dimsum__sdague : grenade is failing as the lease fails on the old/ side17:27
dimsum__hence asking17:27
openstackrecheckConsole logs not available after 13:34s for gate-horizon-dsvm-integration 270871,3,1b53d4c17:27
openstackgerritMerged openstack/tempest: Add tests for Nova microversion v2.2  https://review.openstack.org/24499617:28
sdaguedimsum__: right, it is also doing it there17:29
*** jecarey has quit IRC17:29
sdaguedimsum__: yeh, backport is fine, mtreinish / dtroyer / clarkb should weigh in17:29
*** nicholasgoracke has joined #openstack-qa17:31
*** dimtruck is now known as zz_dimtruck17:33
*** dtantsur is now known as dtantsur|afk17:33
openstackgerritMerged openstack/tempest: Make v1 list_images use **kwargs & doc string update  https://review.openstack.org/25229117:34
openstackgerritDavanum Srinivas (dims) proposed openstack-dev/devstack: reduce default lease time to 5 minutes  https://review.openstack.org/27144217:36
dimsum__dtroyer : clarkb : mtreinish : backport of the 5 mins lease https://review.openstack.org/#/c/271442/17:38
*** jasonsb has joined #openstack-qa17:40
openstackrecheckConsole logs not available after 14:05s for gate-requirements-pep8 268856,1,649162517:41
*** jordanP has quit IRC17:42
*** _nadya_ has quit IRC17:46
*** asselin has quit IRC17:46
*** zz_dimtruck is now known as dimtruck17:46
-openstackstatus- NOTICE: Restarting zuul due to a memory leak17:51
*** asselin has joined #openstack-qa17:53
*** beisner has quit IRC17:54
*** beisner has joined #openstack-qa17:55
*** gfidente is now known as gfidente|afk17:57
*** mragupat has quit IRC17:58
*** boris-42 has joined #openstack-qa18:07
*** achanda has quit IRC18:11
*** achanda has joined #openstack-qa18:11
*** jlwhite_ has quit IRC18:15
*** nicholasgoracke has quit IRC18:15
*** tosky has quit IRC18:16
*** gszasz has quit IRC18:17
*** lezbar__ has quit IRC18:20
*** nicholasgoracke has joined #openstack-qa18:23
jlvillalmtreinish: Do you know where to file devstack-gate bugs?18:24
notmorganmriedem: for what it's worth i disagree with the production impact for the memorycache revert in keystonemiddleware. in gate our use is very syntehtic.18:25
notmorganmriedem: but clearly i wasn't here to argue this earlier today.18:25
*** armax has quit IRC18:25
mtreinishjlvillal: depending on the bug it'll either be on storyboard (I'm assuming there is a d-g project there) or openstack-gate on lp18:26
jlvillalmtreinish: Minor bug18:27
mtreinishprobably storyboard then18:27
mtreinishopenstack-gate is only there for elastic recheck tracking infra things18:27
jlvillalmtreinish: How does 'Closes-bug' work with storyboard?  Sorry first time I've ever used storyboard.18:28
*** slowrie has quit IRC18:28
mtreinishit doesn't work with it18:29
mtreinishyou have to do it manually18:30
*** slowrie has joined #openstack-qa18:30
jlvillalmtreinish: Okay thanks.18:30
openstackgerritJohn L. Villalovos proposed openstack-infra/devstack-gate: Fix '-f: command not found' error  https://review.openstack.org/27146318:30
mtreinishyou probably should put a reference to the story number in the commit msg though18:30
jlvillalmtreinish: I decided to skip the bug for ^^^^ :)18:30
mtreinishthat's fine18:30
mtreinishI wouldn't want to deal with storyboard either :)18:31
*** rossella_s has quit IRC18:31
jlvillalLOL :)18:31
*** ccneill has quit IRC18:31
mtreinishyep, that's a bug18:31
*** rossella_s has joined #openstack-qa18:31
openstackgerritSean Dague proposed openstack/tempest: remove AuthorizationTestJSON tests  https://review.openstack.org/27146718:32
sdaguemtreinish: ^^^18:32
sdagueI stared at these tests for a bit today, and they are massive overkill for testing the exact same 7 lines of code in nova18:32
*** mquin has quit IRC18:33
*** mquin has joined #openstack-qa18:33
jlvillalmtreinish: The docs for devstack-gate say to talk about it on #openstack-dev or #openstack-infra. But I notice the patch submission notices show up here. Just wondering if one of the should get changed to #openstack-qa?18:35
*** Swami_ has joined #openstack-qa18:35
jlvillals/one of the/one of them/18:35
jlvillalAs in update the docs.18:36
*** jordanP has joined #openstack-qa18:36
mtreinishjlvillal: you probably could add -qa to the docs, I don't think it's a big deal either way18:36
mtreinishit's an infra project, but there is a lot of -qa overlap18:36
jlvillalOkay. Thanks.18:37
jlvillalI didn't see the notice show up in -infra when I submitted the patch.18:37
mtreinishsdague: we're gonna have to go through https://wiki.openstack.org/wiki/QA/Tempest-test-removal for that removal18:37
mtreinishthe first 2 criteria aren't an issue, but I suspect some of those might be in defcore18:38
*** gfidente|afk has quit IRC18:38
sdaguethey shouldn't be, they are all negative tests18:38
mtreinishsdague: https://github.com/openstack/defcore/blob/master/2015.07/2015.07.required.txt#L99-L10418:39
sdaguewhich are specifically not supposed to be in defcore18:39
sdague*sigh*18:40
openstackgerritJohn L. Villalovos proposed openstack-infra/devstack-gate: Update IRC channel to use #openstack-qa  https://review.openstack.org/27147418:41
* mtreinish disappears for a bit18:41
*** harlowja has quit IRC18:46
*** jordanP has quit IRC18:46
*** harlowja has joined #openstack-qa18:46
*** e0ne has joined #openstack-qa18:53
*** jecarey has joined #openstack-qa18:53
jffischeNot sure how this all works. I am pretty much new to everything here,18:56
jffischeso please bear with me. I want to take the CI's tempest test output and push it using subunit2sql into a mysql db so eventually18:56
jffischesubunit2sql[graph] can be used to display trends. I have a mysql db initialized with a schema using subunit2sql-db-manage.18:56
jffischeMy questions:18:56
jffische1) How do I push the tempest output using subunit2sql to my mysql db?18:56
jffische2) Do I need Elasticsearch and Kibana some where in there?18:56
jffische3) Can I do it with this python script:18:56
jffischefrom subunit2sql import shell18:56
jffischefrom subunit2sql import read_subunit18:56
jffischesubunit_file = open('subunit_file', 'r')18:56
jffische# Load default config18:56
jffischeshell.cli_opts()18:56
*** jecarey has quit IRC18:58
*** eil397 has joined #openstack-qa18:58
*** jecarey has joined #openstack-qa19:01
*** jecarey_ has joined #openstack-qa19:02
*** jecarey has quit IRC19:05
*** _nadya_ has joined #openstack-qa19:07
*** ccarmack has quit IRC19:08
*** ccneill has joined #openstack-qa19:11
*** rcernin has quit IRC19:12
*** mragupat has joined #openstack-qa19:19
*** jpas has quit IRC19:20
*** sabeen2 has quit IRC19:24
*** chmouel_ is now known as chmouel19:25
*** johnsom_ has joined #openstack-qa19:25
*** yamahata has joined #openstack-qa19:26
*** achanda has quit IRC19:26
johnsom_Hi folks, I have been struggling with a devstack plugin.sh issue and could use some help.19:26
*** jasonsb has quit IRC19:27
*** sabeen1 has joined #openstack-qa19:27
johnsom_I need a way to decide whether to build an image with diskimage-builder in plugin.sh based on settings in gate_hook.19:27
*** markvoelker has quit IRC19:27
*** nicholasgoracke has quit IRC19:27
johnsom_However, it seems that the environment variables for devstack setup are not making it down to the plugin.sh run.19:28
johnsom_Any ideas on how I can get a variable or other mechanism down from gate_hook to plugin.sh?19:28
*** sabeen3 has joined #openstack-qa19:29
*** slowrie has quit IRC19:30
*** slowrie has joined #openstack-qa19:31
*** sabeen1 has quit IRC19:32
*** grafuls has quit IRC19:35
*** ylobankov has quit IRC19:37
*** nicholasgoracke has joined #openstack-qa19:39
*** nicholasgoracke has quit IRC19:39
openstackgerritDevananda van der Veen proposed openstack-infra/elastic-recheck: Add query for Ironic bug 1537076  https://review.openstack.org/27149619:40
openstackbug 1537076 in Ironic "Timed out waiting for Nova hypervisor-stats count >= 1 due to Nova Unable to establish connection to http://127.0.0.1:35357/v2.0/tokens" [High,Confirmed] https://launchpad.net/bugs/153707619:40
*** krtaylor has quit IRC19:41
*** jlwhite_ has joined #openstack-qa19:41
*** cdent has quit IRC19:44
*** nicholasgoracke has joined #openstack-qa19:45
mriedemuh oh huge mega tempest-lib bug!19:47
*** jlwhite_ has quit IRC19:48
*** achanda has joined #openstack-qa19:53
mtreinishmriedem: ?19:53
mriedemyou'll see19:53
devanandamriedem: I was about to land tempestlib support in Ironic ... are you saying we should wait a bit?19:54
mriedemno19:56
*** dims has joined #openstack-qa19:57
*** dimsum__ has quit IRC19:57
mtreinishjffische: the easiest way to get tempest's results into subunit2sql would be something like: testr last --subunit | subunit2sql --database-connection...19:57
mtreinishafter each tempest run19:57
mtreinishthat command will replay the last test run with subunit output and pipe that into subunit2sql19:57
mtreinishand no you do not need elastic search or kibana, just a sql db (mysql, postgres, and sqlite should work)19:58
mriedemmtreinish: voila!  https://review.openstack.org/#/c/271505/19:59
*** aysyd has quit IRC20:00
*** slowrie has quit IRC20:01
*** slowrie has joined #openstack-qa20:02
*** raildo is now known as raildo-afk20:02
mtreinishmriedem: that technically would break the interface if someone is using the args by name20:03
mriedemoh god20:03
openstackgerritPaulo Ewerton Gomes Fragoso proposed openstack-dev/devstack: Move default Keystone API version to v3  https://review.openstack.org/27150820:03
mriedemmtreinish: better release a major version :)20:04
*** nicholasgoracke has quit IRC20:04
mtreinishhah20:04
mriedemonly after mitaka-eol of course20:05
mriedemmtreinish: the good news, http://codesearch.openstack.org/?q=.show_volume_attachment%5C(&i=nope&files=&repos=20:06
mtreinishthat's assuming openstack consumers. There could be other users out there20:07
mriedemyou think?20:07
mtreinishyou never know20:07
mriedemyeah i know20:07
mtreinishI already +2'd the patch20:07
mriedembut still20:07
mriedemballsy20:07
mriedemthat's why you're like a 5 time PTL20:07
mriedemhuge balls20:07
mtreinishif someone complains we can just add a attach_id kwarg20:07
*** e0ne has quit IRC20:08
mriedemsure20:08
mtreinishheh, well only 4 times :)20:08
mriedembtw, i'm out for the next 2 weeks20:08
mtreinishI'm gonna be in bristol too...20:09
mtreinishand then australia the following week :)20:09
mriedemheh, excellent20:10
openstackrecheckConsole logs not available after 13:36s for gate-grenade-dsvm-neutron 182365,25,c3d818120:11
*** pcaruana has quit IRC20:14
*** leakypipes has quit IRC20:14
*** achanda has quit IRC20:16
*** e0ne has joined #openstack-qa20:24
openstackrecheckConsole logs not available after 13:34s for gate-tempest-dsvm-full-ceph 271331,3,1386a8d20:24
*** johnsom_ has quit IRC20:26
*** jasonsb has joined #openstack-qa20:27
*** salv-orlando has quit IRC20:29
*** ylobankov has joined #openstack-qa20:32
*** ylobankov has quit IRC20:32
*** ylobankov has joined #openstack-qa20:40
*** slowrie has quit IRC20:41
*** slowrie has joined #openstack-qa20:41
*** sabeen3 has quit IRC20:42
openstackrecheckConsole logs not available after 13:40s for gate-glance-pep8 271429,1,f0e83c420:45
openstackgerritMatt Riedemann proposed openstack/tempest: Add a test for cinder multiattach  https://review.openstack.org/26660520:47
openstackgerritMatt Riedemann proposed openstack/tempest: Add a test for cinder multiattach  https://review.openstack.org/26660520:50
*** achanda has joined #openstack-qa20:53
mtreinishmriedem: ^^^ we do have microversion support in tempest now20:54
mtreinishhttps://review.openstack.org/#/c/244996/ was the first test to land using it20:54
mriedemmtreinish: the nova code doesn't have a microversion yet20:54
mtreinishah, ok20:55
*** mtanino has quit IRC20:55
*** e0ne has quit IRC20:58
*** KimJ has joined #openstack-qa21:02
*** jlwhite_ has joined #openstack-qa21:03
openstackrecheckConsole logs not available after 14:06s for gate-cinder-python34 271424,1,222e00121:04
*** jasonsb has quit IRC21:15
*** marcusvrn_ has quit IRC21:17
*** salv-orlando has joined #openstack-qa21:18
*** sabeen1 has joined #openstack-qa21:27
*** salv-orlando has quit IRC21:28
openstackrecheckConsole logs not available after 13:34s for gate-nova-tox-functional 184584,12,4079d9d21:29
openstackrecheckopenstack/keystone change: https://review.openstack.org/269990 failed because of: gate-grenade-dsvm: https://bugs.launchpad.net/bugs/1526737 https://bugs.launchpad.net/bugs/1532809 https://bugs.launchpad.net/bugs/135557321:32
openstackLaunchpad bug 1526737 in OpenStack Compute (nova) "Race between nova-network and dnsmasq allocating ips" [High,In progress] - Assigned to Dan Smith (danms)21:32
openstackLaunchpad bug 1532809 in OpenStack Compute (nova) "Gate failures when DHCP lease cannot be acquired" [Undecided,In progress] - Assigned to Davanum Srinivas (DIMS) (dims-v)21:32
openstackLaunchpad bug 1355573 in OpenStack Compute (nova) "tempest volume scenarios periodically fail /w SSHTimeout" [Undecided,New]21:32
*** sabeen3 has joined #openstack-qa21:36
*** sabeen1 has quit IRC21:38
*** jlwhite_ has quit IRC21:40
*** markvoelker has joined #openstack-qa21:40
*** markvoelker has quit IRC21:40
*** markvoelker has joined #openstack-qa21:41
*** mtanino has joined #openstack-qa21:43
openstackrecheckConsole logs not available after 14:13s for gate-nova-python27 248581,5,236493321:46
*** jffische has quit IRC21:47
*** pcaruana has joined #openstack-qa21:48
*** mriedem has quit IRC21:51
*** rcernin has joined #openstack-qa21:52
openstackrecheckopenstack/nova change: https://review.openstack.org/257638 failed because of: gate-grenade-dsvm: https://bugs.launchpad.net/bugs/1463631, gate-tempest-dsvm-neutron-full: https://bugs.launchpad.net/bugs/150900421:54
openstackLaunchpad bug 1463631 in grenade "60_nova/resources.sh:106:ping_check_public fails intermittently" [Undecided,Confirmed]21:54
openstackLaunchpad bug 1509004 in neutron ""test_dualnet_dhcp6_stateless_from_os" failures seen in the gate" [Medium,Confirmed]21:54
*** jlwhite has joined #openstack-qa21:54
openstackgerritMatthew Treinish proposed openstack/tempest: WIP: Start to use fixtures for credentials and client managers  https://review.openstack.org/27153821:59
*** mragupat has quit IRC21:59
*** erlon has quit IRC22:06
openstackrecheckConsole logs not available after 13:26s for gate-grenade-dsvm 253112,4,e16ec1022:07
*** jlwhite has quit IRC22:09
*** salv-orlando has joined #openstack-qa22:10
*** ylobankov has quit IRC22:12
*** jlwhite has joined #openstack-qa22:15
*** slowrie has quit IRC22:17
*** slowrie has joined #openstack-qa22:18
*** jlwhite has quit IRC22:20
openstackrecheckConsole logs not available after 13:45s for gate-keystone-python27 264533,9,fac41e322:21
openstackgerritAdrien Cunin proposed openstack/tempest-lib: Raise IdentityError if auth_url doesn't exist  https://review.openstack.org/27030122:21
openstackgerritAdrien Cunin proposed openstack/tempest-lib: Added __init__.py to tests/services/identity/  https://review.openstack.org/27154522:24
*** achanda has quit IRC22:24
*** jlwhite has joined #openstack-qa22:25
*** dkranz has quit IRC22:30
*** markvoelker has quit IRC22:32
*** ylobankov has joined #openstack-qa22:32
*** jlwhite_ has joined #openstack-qa22:37
*** jlwhite has quit IRC22:37
*** ccneill has quit IRC22:41
openstackrecheckConsole logs not available after 13:45s for gate-grenade-dsvm 256460,4,7e5892622:42
*** ylobankov has quit IRC22:44
*** ylobankov has joined #openstack-qa22:47
openstackgerritMerged openstack/tempest: Split out Neutron security group rules client  https://review.openstack.org/26656422:47
*** rcernin has quit IRC22:53
*** krtaylor has joined #openstack-qa22:54
openstackgerritMerged openstack/tempest: Apply "POST/DELETE" rules to agents_client  https://review.openstack.org/26398222:55
*** dims_ has joined #openstack-qa22:56
*** dims has quit IRC22:58
*** ccneill has joined #openstack-qa22:58
*** sigmavirus24 is now known as sigmavirus24_awa23:00
*** salv-orlando has quit IRC23:07
*** KimJ has quit IRC23:10
*** dims_ has quit IRC23:13
openstackrecheckConsole logs not available after 14:24s for gate-cinder-pep8 271462,1,b10d05323:14
*** salv-orlando has joined #openstack-qa23:14
*** jamielennox is now known as jamielennox|away23:15
*** jlwhite_ has quit IRC23:17
*** achanda has joined #openstack-qa23:21
*** rbak has quit IRC23:26
*** Swami_ has quit IRC23:26
*** Swami_ has joined #openstack-qa23:26
*** ylobankov has quit IRC23:27
*** pglass has quit IRC23:31
*** ylobankov has joined #openstack-qa23:33
openstackrecheckConsole logs not available after 14:22s for gate-grenade-dsvm 269880,3,b411f6e23:37
*** slowrie has quit IRC23:38
*** slowrie has joined #openstack-qa23:39
*** edmondsw has quit IRC23:41
*** apevec has quit IRC23:43
openstackgerritMerged openstack/tempest: Updated from global requirements  https://review.openstack.org/26854423:43
openstackgerritMerged openstack/tempest: Add omit files for coverage  https://review.openstack.org/26745123:44
openstackgerritMerged openstack/tempest: Raise tox min version to avoid maximum recursion issue  https://review.openstack.org/26738223:44
*** ylobankov has quit IRC23:51
*** edmondsw has joined #openstack-qa23:54
*** jswarren_ has joined #openstack-qa23:56
*** dims has joined #openstack-qa23:56
openstackrecheckConsole logs not available after 14:28s for gate-glance-python34 255584,9,b23010a23:57
*** jswarren has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!