Wednesday, 2016-03-02

*** yamahata has joined #openstack-qa00:00
openstackrecheckConsole logs not available after 13:27s for gate-devstack-unit-tests 286084,4,7e9e31200:02
*** tmatsu has joined #openstack-qa00:04
*** pglass has quit IRC00:10
*** yamahata has quit IRC00:11
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Make data_processing/baremetal use rest_client  https://review.openstack.org/28691400:11
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Make compute keypairs_client use rest_client  https://review.openstack.org/28691500:11
openstackrecheckConsole logs not available after 13:37s for gate-tempest-dsvm-neutron-full 286672,1,71b3e9100:16
*** mylu has quit IRC00:17
*** zz_dimtruck is now known as dimtruck00:18
openstackgerritGhanshyam Mann proposed openstack/tempest: Add support of microversion in all compute service clients  https://review.openstack.org/28441400:19
*** mylu has joined #openstack-qa00:19
*** mylu has quit IRC00:25
openstackrecheckConsole logs not available after 13:32s for gate-tempest-dsvm-ceilometer-mysql-neutron-full 285602,6,38b697000:29
*** mylu has joined #openstack-qa00:32
*** erlon has quit IRC00:36
*** mylu has quit IRC00:37
*** mylu has joined #openstack-qa00:41
*** ajmiller has quit IRC00:43
openstackrecheckConsole logs not available after 13:21s for gate-grenade-dsvm-neutron 286695,2,66886cb00:43
mriedemmtreinish: i failed miserably http://logs.openstack.org/55/286855/1/experimental/gate-tempest-dsvm-neutron-dvr-multinode-full/8c4b90c/console.html#_2016-03-02_00_17_36_78000:43
*** jlk has quit IRC00:46
*** jlk has joined #openstack-qa00:46
*** dimtruck is now known as zz_dimtruck00:46
*** jlk has quit IRC00:46
*** jlk has joined #openstack-qa00:46
*** mylu has quit IRC00:47
*** mylu has joined #openstack-qa00:47
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Use instance variable in ByteStreamToStreamResult init  https://review.openstack.org/28692500:47
*** Swami has quit IRC00:48
mtreinishmriedem: heh, it's close00:48
mtreinishat least the code is being run :)00:49
*** rossella_s has quit IRC00:54
*** rossella_s has joined #openstack-qa00:54
openstackrecheckConsole logs not available after 13:21s for gate-nova-python27 253082,2,3d813cd00:56
*** luzC has quit IRC00:58
openstackgerritGhanshyam Mann proposed openstack/tempest: Add tests for compute v2.10 microversion  https://review.openstack.org/27776301:00
*** zz_dimtruck is now known as dimtruck01:02
*** achanda has quit IRC01:03
*** yangyapeng has joined #openstack-qa01:05
openstackgerritGhanshyam Mann proposed openstack/tempest: Add tests for compute v2.10 microversion  https://review.openstack.org/27776301:06
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Remove unused flush from read_subunit()  https://review.openstack.org/28692801:09
openstackrecheckConsole logs not available after 13:21s for gate-cinder-python27 285469,5,8139ebc01:10
*** tochi has quit IRC01:15
*** mylu has quit IRC01:19
mriedemmtreinish: probably safe to abandon this one https://review.openstack.org/#/c/157729/01:23
mriedemno updates since may of 201501:23
openstackrecheckConsole logs not available after 13:21s for gate-glance-pep8 256381,4,7c5cf7401:23
*** cody-somerville_ has joined #openstack-qa01:23
mtreinishmriedem: yeah01:24
*** cody-somerville has quit IRC01:24
*** jasonsb has joined #openstack-qa01:25
mriedemmtreinish: and https://review.openstack.org/#/c/164396/01:25
mriedemand this :) https://review.openstack.org/#/c/207621/01:26
mriedemjust make me qa core so i can abandon all of these old patches01:26
openstackrecheckConsole logs not available after 13:20s for gate-tempest-dsvm-neutron-full 268712,3,be63a1501:36
*** beisner has quit IRC01:38
*** tochi has joined #openstack-qa01:39
*** beisner has joined #openstack-qa01:40
*** fawadkhaliq has quit IRC01:42
*** yangyapeng has quit IRC01:43
*** yamamoto has joined #openstack-qa01:45
*** apoorvad has quit IRC01:48
openstackrecheckConsole logs not available after 13:20s for gate-grenade-dsvm 276903,5,f8e66ae01:50
*** achanda has joined #openstack-qa01:51
*** mtanino has quit IRC01:51
*** jaypipes has quit IRC01:54
*** pvaneck has quit IRC02:00
openstackrecheckConsole logs not available after 13:21s for gate-horizon-pep8 283171,8,808d82302:03
*** woodster_ has quit IRC02:06
*** rfolco_ has joined #openstack-qa02:08
*** rfolco_ has quit IRC02:08
openstackrecheckConsole logs not available after 13:21s for gate-tempest-dsvm-full 274885,12,a90a22802:16
openstackrecheckConsole logs not available after 13:21s for gate-tempest-dsvm-full 267827,11,306579f02:30
*** vhosakot has joined #openstack-qa02:30
*** tochi has quit IRC02:32
*** yamamoto has quit IRC02:36
openstackrecheckConsole logs not available after 13:21s for gate-tempest-dsvm-postgres-full 262637,4,0130e1502:43
*** mriedem has quit IRC02:46
*** dimtruck is now known as zz_dimtruck02:48
*** ngoracke has joined #openstack-qa02:51
*** cody-somerville_ is now known as cody-somerville02:52
*** cody-somerville has joined #openstack-qa02:52
openstackrecheckConsole logs not available after 13:21s for gate-tempest-dsvm-neutron-full 273982,3,ade256d02:56
*** bkopilov has quit IRC02:57
*** tochi has joined #openstack-qa02:58
*** vhosakot has quit IRC03:01
*** vhosakot has joined #openstack-qa03:02
*** zz_dimtruck is now known as dimtruck03:08
*** EinstCrazy has joined #openstack-qa03:09
openstackrecheckConsole logs not available after 13:21s for gate-nova-python27 286744,1,db731d403:10
*** dims has quit IRC03:15
*** dimtruck is now known as zz_dimtruck03:18
*** weshay has quit IRC03:22
*** yamamoto has joined #openstack-qa03:22
openstackrecheckConsole logs not available after 13:21s for gate-tempest-dsvm-neutron-full 286745,1,aaa2b9c03:23
*** david-lyle has joined #openstack-qa03:24
*** larainema has quit IRC03:27
*** larainema has joined #openstack-qa03:29
*** zz_dimtruck is now known as dimtruck03:33
*** sigmavirus24 is now known as sigmavirus24_awa03:34
openstackgerrityalei wang proposed openstack-dev/devstack: Add pg_createcluster creating process for postgresql 9.3  https://review.openstack.org/28696003:34
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Make compute keypairs_client use rest_client  https://review.openstack.org/28691503:36
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Make data_processing/baremetal use rest_client  https://review.openstack.org/28691403:36
openstackrecheckConsole logs not available after 13:21s for gate-tempest-dsvm-postgres-full 281482,2,1b6126803:37
*** fnaval has quit IRC03:39
*** fawadkhaliq has joined #openstack-qa03:43
*** dimtruck is now known as zz_dimtruck03:47
openstackrecheckConsole logs not available after 13:21s for gate-horizon-npm-run-test 227036,41,93f572f03:50
*** fnaval has joined #openstack-qa03:53
*** luzC has joined #openstack-qa03:56
*** zz_dimtruck is now known as dimtruck04:01
openstackrecheckConsole logs not available after 13:20s for gate-tempest-dsvm-full 285972,1,959b14a04:03
*** shausy has joined #openstack-qa04:06
*** bkopilov has joined #openstack-qa04:13
openstackrecheckConsole logs not available after 13:20s for gate-tempest-dsvm-full 275266,14,db1d7c604:17
*** johnsom__ has joined #openstack-qa04:22
johnsom__Hi folks, question about the log archive from a gate run.  Which repo has the code that archives the logs from a gate run?04:23
*** johnsom has joined #openstack-qa04:25
johnsom__The octavia project boots service vms and I would like to explore the possibility of archiving the nova console logs from those service vms.04:26
*** ianw has joined #openstack-qa04:28
openstackrecheckConsole logs not available after 13:20s for gate-nova-python27 284839,3,643aeeb04:30
*** Poornima has joined #openstack-qa04:31
*** sridharg has joined #openstack-qa04:31
*** cody-somerville has quit IRC04:33
*** ngoracke has quit IRC04:34
*** cody-somerville has joined #openstack-qa04:35
openstackgerritTim Buckley proposed openstack/openstack-health: Add CSS rules to improve table column sizes  https://review.openstack.org/28697904:37
*** oomichi_ has joined #openstack-qa04:40
oomichi_masayukig: hi, can you take a look at https://review.openstack.org/#/c/286914/ again?04:41
openstackgerritTim Buckley proposed openstack/openstack-health: Add CSS rules to improve table column sizes  https://review.openstack.org/28697904:41
*** yamahata has joined #openstack-qa04:41
oomichi_that is a nice point, and gmann also pointed it before.04:41
*** luzC has quit IRC04:43
oomichi_masayukig: so quick, thanks04:43
openstackrecheckConsole logs not available after 13:21s for gate-tempest-dsvm-full 263927,9,4362be604:43
masayukigoomichi_: yeah, thanks for clarification :) I feel it would be good to add a description about it in the commit message or somewhere.04:44
oomichi_masayukig: ok, will do it soon04:45
*** sree has joined #openstack-qa04:49
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Make compute keypairs_client use rest_client  https://review.openstack.org/28691504:52
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Make data_processing/baremetal use rest_client  https://review.openstack.org/28691404:52
oomichi_masayukig: done on ^^^04:53
*** rossella_s has quit IRC04:53
*** rossella_s has joined #openstack-qa04:54
openstackrecheckConsole logs not available after 13:20s for gate-tempest-dsvm-neutron-full 284778,4,1abf5dc04:57
*** fawadkhaliq has quit IRC04:58
*** dimtruck is now known as zz_dimtruck05:02
openstackrecheckConsole logs not available after 13:21s for gate-keystone-pep8 285521,6,9fb716d05:10
gmannoomichi_: I updated microversion patches please check05:11
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Make object/orchestration clients use rest_client  https://review.openstack.org/28698505:13
oomichi_gmann: you have updated the commit msg?05:13
*** vhosakot has quit IRC05:14
oomichi_gmann: https://review.openstack.org/#/c/277763/ ?05:14
gmannoomichi_: commit msg? no05:15
oomichi_gmann: I got it now. but that still is red on jenkins05:16
gmannoomichi_: ah just recheck05:16
gmannoomichi_: you can check tomorrow :)05:16
gmannoomichi_: what i told is true about your late night work there :)05:16
gmannoomichi_: you still working :P05:16
*** amotoki has joined #openstack-qa05:16
oomichi_gmann: with wine ;-)05:17
gmannoomichi_: heh05:17
*** tmatsu has quit IRC05:17
oomichi_gmann: don't we need to cap original keypair test with v2.9 ?05:17
oomichi_gmann: that is another point.05:18
*** salv-orl_ has joined #openstack-qa05:19
gmannoomichi_: you mean test_keypairs_v22 ?05:19
*** tmatsu has joined #openstack-qa05:19
oomichi_gmann: when running mv tests with mv range v2.10+, the original test run against these mv also due to lack of cap. is it intentional?05:19
oomichi_gmann: yeah, right05:19
* gmann thinking05:20
oomichi_gmann: and test_keypairs.py also05:21
gmannoomichi_: I think we should run. cloud with 2.10+ means it has v2.2 and v2.1 version too05:21
gmannoomichi_: in that case we should run those tests too05:21
oomichi_gmann: I am feeling I did put the same point before05:21
gmannoomichi_: yea that was running the same tests for both microversion05:21
*** tmatsu has quit IRC05:22
*** salv-orlando has quit IRC05:22
gmannoomichi_: in this case v2.10 tests is derived from base.BaseKeypairTest05:22
oomichi_gmann: because each test module inherits from base test class, not previous mv test class, right?05:22
gmannoomichi_: which has no tests case, means no tests running twice05:22
gmannoomichi_: yea right05:23
oomichi_gmann: ok, here is a point.05:23
gmannoomichi_: if we inherit from previous mv tests then we should cap as we did for v2.205:23
oomichi_gmann: that depends on how to inherit/implement mv tests05:23
openstackrecheckConsole logs not available after 13:20s for gate-nova-pep8 265415,3,f64d83a05:23
openstackgerritTim Buckley proposed openstack/openstack-health: Condense tables to improve visual consistency  https://review.openstack.org/28698605:24
oomichi_gmann: ok, and sorry for one more point.05:24
gmannoomichi_: yea, based on mv tests implementation we need to decide the cap base class tests etc05:24
gmannoomichi_: sure, it getting more clear and better :)05:24
oomichi_gmann: is it necessary to set "latest" on a new test class?05:24
oomichi_gmann: original test module doesn't specify it, and the default value of the class is the same05:25
oomichi_gmann: when I saw that, the above question came to me.05:25
gmannoomichi_: ahh, nice point that is in very base class05:26
gmannoomichi_: so we can skip that05:26
oomichi_gmann: can you update?05:27
gmannoomichi_: sure, please -105:27
oomichi_gmann: +1 instead of +205:28
*** yfried_ has quit IRC05:28
gmannoomichi_: ok Thanks :)05:28
oomichi_gmann: that is not worth to put -1 ;-)05:28
*** tmatsu has joined #openstack-qa05:29
openstackgerritGhanshyam Mann proposed openstack/tempest: Add tests for compute v2.10 microversion  https://review.openstack.org/27776305:29
gmannoomichi_: done05:29
oomichi_gmann: +205:30
gmannoomichi_: Thanks.05:31
*** tmatsu has quit IRC05:31
gmannoomichi_: and can you check bases patches also but may be tomorrow not now, it too late for you :)05:32
*** sayalilunkad has quit IRC05:33
oomichi_gmann: +2 again05:33
gmannoomichi_: Thanks again :)05:34
*** achanda has quit IRC05:35
*** sree_ has joined #openstack-qa05:35
*** pcaruana has joined #openstack-qa05:36
*** sree_ is now known as Guest4944305:36
openstackrecheckConsole logs not available after 13:21s for gate-nova-pep8 286772,1,9a91ece05:37
*** sree has quit IRC05:39
*** achanda has joined #openstack-qa05:39
*** achanda has quit IRC05:39
*** tmatsu has joined #openstack-qa05:41
*** tmatsu_ has joined #openstack-qa05:44
*** sree has joined #openstack-qa05:45
*** Guest49443 has quit IRC05:45
*** sayalilunkad has joined #openstack-qa05:45
*** tmatsu has quit IRC05:47
*** pcaruana has quit IRC05:49
*** sree has quit IRC05:50
openstackrecheckConsole logs not available after 13:21s for gate-cinder-pep8 285293,7,42371c605:50
*** sree has joined #openstack-qa05:51
*** rcernin has joined #openstack-qa05:51
*** johnsom__ has quit IRC05:51
*** dave-mccowan has quit IRC05:51
*** zz_dimtruck is now known as dimtruck05:53
*** yangyapeng has joined #openstack-qa05:54
openstackgerritMerged openstack-dev/devstack: Disable tempest tox venv recreation in OFFLINE mode  https://review.openstack.org/28557105:55
openstackgerritMerged openstack-dev/devstack: Add note about the periodic proposal job to the header  https://review.openstack.org/28666605:56
*** achanda has joined #openstack-qa06:00
*** hoangcx has joined #openstack-qa06:01
openstackrecheckConsole logs not available after 13:21s for gate-horizon-npm-run-test 285084,6,791f9c006:03
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Split out Neutron routers client  https://review.openstack.org/26031906:06
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Make routers_client use **kwargs  https://review.openstack.org/28441206:06
*** sree has quit IRC06:11
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Make object/orchestration clients use rest_client  https://review.openstack.org/28698506:11
oomichi_gmann: your turn ;-) https://review.openstack.org/#/c/286914/ and https://review.openstack.org/#/c/286915/306:12
*** binbincong has quit IRC06:13
openstackrecheckConsole logs not available after 13:21s for experimental-tempest-dsvm-neutron-full-dibtest 274792,6,6dff40a06:17
*** dimtruck is now known as zz_dimtruck06:17
gmannoomichi_: i saw that, +A on both06:18
oomichi_gmann: thanks :)06:18
gmannoomichi_: ll review https://review.openstack.org/286985 too after jenkin06:19
*** binbincong has joined #openstack-qa06:24
*** gamado has joined #openstack-qa06:24
*** sree has joined #openstack-qa06:25
*** sree has joined #openstack-qa06:25
*** kbaikov has quit IRC06:29
openstackrecheckConsole logs not available after 13:20s for gate-cinder-python27 276981,13,b49a92a06:30
*** amotoki has quit IRC06:33
*** amotoki has joined #openstack-qa06:34
*** sridharg has quit IRC06:34
*** armax has quit IRC06:35
*** amotoki has quit IRC06:36
*** krtaylor has quit IRC06:37
*** jamielennox is now known as jamielennox|away06:38
*** yfried_ has joined #openstack-qa06:38
*** kbaikov has joined #openstack-qa06:42
openstackrecheckConsole logs not available after 13:21s for experimental-tempest-dsvm-multinode-full-dibtest 240611,3,0825b7106:44
*** hoangcx has quit IRC06:44
*** ngoracke has joined #openstack-qa06:46
openstackgerritOpenStack Proposal Bot proposed openstack-dev/devstack: Updated from generate-devstack-plugins-list  https://review.openstack.org/28640106:49
*** jamielennox|away is now known as jamielennox06:49
*** hichihara has joined #openstack-qa06:49
*** krtaylor has joined #openstack-qa06:49
*** ngoracke has quit IRC06:50
openstackrecheckConsole logs not available after 13:21s for gate-tempest-dsvm-postgres-full-kilo 283769,5,d289d6c06:57
*** shardy has joined #openstack-qa07:00
*** hoangcx has joined #openstack-qa07:02
*** e0ne has joined #openstack-qa07:06
openstackgerritMerged openstack/tempest: Properly handle failures during resource cleanup  https://review.openstack.org/28611207:07
*** jamielennox is now known as jamielennox|away07:08
*** pilgrimstack1 has joined #openstack-qa07:09
*** pilgrimstack has quit IRC07:10
openstackrecheckConsole logs not available after 13:21s for gate-nova-releasenotes 274885,13,680293b07:10
*** Serlex has joined #openstack-qa07:13
*** amotoki has joined #openstack-qa07:14
*** oomichi_ has quit IRC07:16
*** anshul has joined #openstack-qa07:18
*** sridharg has joined #openstack-qa07:23
openstackrecheckConsole logs not available after 13:21s for gate-glance-python34 269277,3,0032f6807:24
*** amotoki has quit IRC07:35
openstackrecheckConsole logs not available after 13:21s for gate-tempest-dsvm-postgres-full 284484,5,8e598c507:37
*** amotoki has joined #openstack-qa07:43
*** sridhargaddam has joined #openstack-qa07:44
*** sridharg has quit IRC07:44
*** hoangcx has quit IRC07:46
*** amotoki has quit IRC07:48
openstackrecheckConsole logs not available after 13:21s for gate-devstack-gate-unittests 286136,2,f15aeb407:50
*** markvoelker has quit IRC07:58
*** e0ne has quit IRC07:59
*** neeti has joined #openstack-qa07:59
*** sree_ has joined #openstack-qa08:00
*** sree_ is now known as Guest5416008:01
*** pcaruana has joined #openstack-qa08:02
*** achanda has quit IRC08:03
*** sree has quit IRC08:03
*** hichihara has quit IRC08:04
openstackrecheckConsole logs not available after 13:21s for gate-horizon-npm-run-test 227036,42,d4af50008:04
*** gfidente has joined #openstack-qa08:05
*** gfidente has quit IRC08:05
*** gfidente has joined #openstack-qa08:05
*** achanda has joined #openstack-qa08:07
*** zz_dimtruck is now known as dimtruck08:11
openstackgerritThomas Herve proposed openstack-infra/devstack-gate: Remove double timestamp from console logs  https://review.openstack.org/28613608:16
openstackrecheckConsole logs not available after 13:21s for gate-tempest-pep8 283770,7,2bc94dc08:17
*** achanda has quit IRC08:18
*** jamielennox|away is now known as jamielennox08:25
*** jlanoux has joined #openstack-qa08:26
openstackrecheckConsole logs not available after 13:20s for gate-cinder-pep8 286795,2,d29d3c408:30
*** lxsli0 has joined #openstack-qa08:32
*** tmatsu_ has quit IRC08:33
*** yfried_ has quit IRC08:34
*** Guest54160 has quit IRC08:37
*** sree has joined #openstack-qa08:38
*** lxsli0 has quit IRC08:38
*** ifarkas has joined #openstack-qa08:40
*** sree has quit IRC08:42
openstackrecheckConsole logs not available after 13:21s for gate-tempest-dsvm-neutron-full 267827,12,bff295008:44
openstackgerritYuriy Nesenenko proposed openstack/tempest: Fix test_get_service_by_host_name  https://review.openstack.org/26776508:45
*** ihrachys has joined #openstack-qa08:51
*** hoangcx has joined #openstack-qa08:53
*** rossella_s has quit IRC08:54
*** dimtruck is now known as zz_dimtruck08:54
*** yaume has joined #openstack-qa08:54
*** rossella_s has joined #openstack-qa08:54
*** speller has joined #openstack-qa08:57
openstackrecheckConsole logs not available after 13:21s for gate-tempest-dsvm-neutron-full 286828,1,1fd7c4708:57
*** apevec has joined #openstack-qa08:58
*** markvoelker has joined #openstack-qa08:58
*** apevec has left #openstack-qa09:03
reedip ajo: Ping09:04
*** yfried has joined #openstack-qa09:05
*** lucas-dinner is now known as lucasagomes09:06
*** hoangcx has quit IRC09:06
openstackrecheckConsole logs not available after 13:21s for gate-grenade-dsvm 286833,2,dc74aaf09:10
*** jasonsb has quit IRC09:16
openstackrecheckConsole logs not available after 13:21s for gate-tempest-python34 260319,27,258206b09:24
*** e0ne has joined #openstack-qa09:28
openstackgerritMerged openstack/eslint-config-openstack: Enable builtinGlobals for no-redeclare  https://review.openstack.org/26588709:33
openstackrecheckConsole logs not available after 13:21s for gate-tempest-dsvm-neutron-full 284412,4,b0ed38c09:37
*** e0ne has quit IRC09:37
*** Serlex has quit IRC09:39
*** Serlex has joined #openstack-qa09:40
*** jasonsb has joined #openstack-qa09:43
*** tochi has quit IRC09:44
*** reedip is now known as reedip_away09:46
openstackrecheckConsole logs not available after 13:21s for gate-horizon-dsvm-integration 268368,17,a88f69009:51
*** _nadya_ has joined #openstack-qa09:58
*** e0ne has joined #openstack-qa10:00
*** kiran-r has joined #openstack-qa10:02
openstackrecheckConsole logs not available after 13:21s for gate-tempest-dsvm-postgres-full 286271,1,579c10610:04
kiran-rCan somebody review this patch please? https://review.openstack.org/#/c/267452/10:15
openstackrecheckConsole logs not available after 13:20s for gate-keystone-python27 286852,1,9cb94b110:17
*** amotoki has joined #openstack-qa10:18
*** mvk has quit IRC10:20
*** dtantsur|afk is now known as dtantsur10:25
openstackrecheckConsole logs not available after 13:21s for experimental-tempest-dsvm-multinode-full-dibtest 286855,1,12ad62b10:31
*** gszasz has joined #openstack-qa10:31
*** jordanP has joined #openstack-qa10:32
*** mvk has joined #openstack-qa10:35
*** doradus has joined #openstack-qa10:42
*** doradus has quit IRC10:42
*** doradus has joined #openstack-qa10:42
*** _nadya__ has joined #openstack-qa10:43
*** _nadya_ has quit IRC10:43
openstackrecheckConsole logs not available after 13:21s for gate-glance-python27 280786,10,8da200510:44
*** tmatsu has joined #openstack-qa10:45
*** ihrachys has quit IRC10:47
*** tmatsu has quit IRC10:49
*** yamahata has quit IRC10:51
*** tosky has joined #openstack-qa10:51
*** dims_ has joined #openstack-qa10:51
*** hichihara has joined #openstack-qa10:54
*** binbincong has quit IRC10:57
openstackrecheckConsole logs not available after 13:21s for gate-tempest-dsvm-neutron-full 284627,6,85c1ba310:57
*** Abhishek has joined #openstack-qa10:58
*** cdent has joined #openstack-qa10:59
Abhishekcan anyone pls review :    https://review.openstack.org/#/c/267452/11:01
*** sdague has joined #openstack-qa11:02
openstackgerritMerged openstack/tempest: Add release notes for upcoming release  https://review.openstack.org/28669511:05
*** tosky has quit IRC11:05
*** _nadya__ has quit IRC11:10
*** binbincong has joined #openstack-qa11:10
openstackrecheckConsole logs not available after 13:21s for gate-horizon-npm-run-test 227036,43,824237111:11
*** tosky has joined #openstack-qa11:11
*** salv-orlando has joined #openstack-qa11:19
*** salv-orl_ has quit IRC11:22
openstackrecheckConsole logs not available after 13:21s for gate-cinder-python27 284395,2,4dafa6111:24
*** EinstCrazy has quit IRC11:24
*** yangyapeng has quit IRC11:30
*** Abhishek has quit IRC11:35
*** Abhishek has joined #openstack-qa11:35
*** Abhishek has quit IRC11:36
*** Abhishek has joined #openstack-qa11:36
openstackrecheckConsole logs not available after 13:20s for gate-tempest-dsvm-neutron-full 285901,2,464c8f311:37
*** Abhishek__ has joined #openstack-qa11:37
*** yfried has quit IRC11:39
*** yfried_ has joined #openstack-qa11:39
*** _nadya_ has joined #openstack-qa11:40
*** Abhishek has quit IRC11:41
*** yamamoto has quit IRC11:41
*** _nadya_ has quit IRC11:45
*** Abhishek__ has quit IRC11:47
openstackrecheckConsole logs not available after 13:23s for gate-tempest-dsvm-full-liberty 270564,3,9af801e11:51
*** ihrachys has joined #openstack-qa11:52
*** dave-mccowan has joined #openstack-qa11:53
*** _nadya_ has joined #openstack-qa11:55
snikitinandreaf: Hi, Andrea! Have you been satisfied by results of experimental jobs here? https://review.openstack.org/#/c/284621/12:03
openstackrecheckConsole logs not available after 13:21s for gate-horizon-npm-run-test 209680,10,18f9da912:04
*** aysyd has joined #openstack-qa12:05
andreafsnikitin: yes I was mostly interested in the v3 only job which passed12:05
*** cdent has quit IRC12:06
andreafsnikitin: +A12:08
snikitinandreaf: great! thank you12:08
*** rodrigods has quit IRC12:12
*** rodrigods has joined #openstack-qa12:12
openstackrecheckConsole logs not available after 13:21s for gate-tempest-dsvm-full 286889,1,b3e877012:18
*** Poornima has quit IRC12:20
*** kiran-r has quit IRC12:21
*** yamamoto has joined #openstack-qa12:24
*** yamamoto_ has joined #openstack-qa12:25
*** erlon has joined #openstack-qa12:25
*** Liuqing has joined #openstack-qa12:27
*** yamamoto has quit IRC12:29
*** kiran-r has joined #openstack-qa12:29
*** raildo-afk is now known as raildo12:31
openstackrecheckConsole logs not available after 13:21s for gate-tempest-dsvm-postgres-full 277670,4,450e80812:31
*** bkopilov has quit IRC12:31
*** hichihara has quit IRC12:39
*** yamamoto_ has quit IRC12:43
*** rfolco has joined #openstack-qa12:44
openstackrecheckConsole logs not available after 13:22s for gate-cinder-python27 286256,7,76722b012:44
*** edmondsw has joined #openstack-qa12:46
*** markvoelker has quit IRC12:48
*** markvoelker has joined #openstack-qa12:49
*** lucasagomes is now known as lucas-hungry12:51
*** rossella_s has quit IRC12:53
*** rossella_s has joined #openstack-qa12:54
*** fawadkhaliq has joined #openstack-qa12:54
*** yamamoto has joined #openstack-qa12:55
openstackrecheckConsole logs not available after 13:20s for gate-horizon-npm-run-lint 286918,2,99778de12:58
*** _nadya_ has quit IRC13:01
*** yaume_ has joined #openstack-qa13:03
*** yaume has quit IRC13:04
openstackrecheckConsole logs not available after 13:21s for gate-horizon-npm-run-test 227036,44,f42987c13:11
*** yaume_ has quit IRC13:12
*** yaume has joined #openstack-qa13:13
*** dkranz has joined #openstack-qa13:15
*** yangyapeng has joined #openstack-qa13:19
*** fawadkhaliq has quit IRC13:21
*** yangyapeng has quit IRC13:22
openstackrecheckConsole logs not available after 13:21s for gate-tempest-python34 286915,1,6d62d2a13:24
*** ngoracke has joined #openstack-qa13:25
*** yaume has quit IRC13:27
*** yaume has joined #openstack-qa13:27
*** yamamoto has quit IRC13:28
openstackgerritSean Dague proposed openstack/tempest: Add LOG.info to boot from volume tests  https://review.openstack.org/28663413:29
*** ngoracke has quit IRC13:30
*** pleia2 has quit IRC13:33
*** yaume has quit IRC13:33
*** yfried has joined #openstack-qa13:34
*** yaume has joined #openstack-qa13:34
*** yfried_ has quit IRC13:38
sdagueandreaf / mtreinish / jordanP - https://review.openstack.org/#/c/286634/ - some additional logging in the boot from volume tests to try to make understanding the failures easier13:38
openstackrecheckConsole logs not available after 13:21s for gate-tempest-dsvm-postgres-full 286908,1,87b45a713:38
jordanPsdague, this won"t help a lot but +2 anyway. Problem is, as you said in your email, on teardown13:39
*** yamamoto has joined #openstack-qa13:39
*** yamamoto has quit IRC13:39
jordanPit looks like a deadlock when the volume and the instance need to be deleted.13:40
*** yaume has quit IRC13:40
sdaguejordanP: it's not always on teardown13:41
*** yaume has joined #openstack-qa13:41
jordanPah ok then13:41
sdaguebut, yes, there is *also* a teardown issue13:41
jordanPI'll try to spend an hour on doing the cleanup explicitely in the test itself, it should help to understand what's going on in that case, hopefully13:42
*** yangyapeng has joined #openstack-qa13:48
*** yaume has quit IRC13:50
*** bkopilov has joined #openstack-qa13:51
*** yaume has joined #openstack-qa13:51
openstackrecheckConsole logs not available after 13:21s for gate-tempest-python34 286914,1,e6dadea13:51
*** _nadya_ has joined #openstack-qa13:51
*** yamamoto has joined #openstack-qa13:54
*** yaume has quit IRC13:55
*** yaume has joined #openstack-qa13:56
*** Abhishek has joined #openstack-qa13:56
*** Abhishek has quit IRC13:56
*** sree has joined #openstack-qa13:59
*** yaume has quit IRC14:00
*** yaume has joined #openstack-qa14:01
*** yamamoto has quit IRC14:02
*** josdotso has quit IRC14:02
*** sree has quit IRC14:02
*** sree has joined #openstack-qa14:02
*** lucas-hungry is now known as lucasagomes14:03
openstackrecheckConsole logs not available after 13:21s for gate-tempest-dsvm-neutron-full 284635,2,56c3c5b14:04
*** bapalm has quit IRC14:05
*** yaume has quit IRC14:05
*** yaume has joined #openstack-qa14:06
*** jbernard_ has joined #openstack-qa14:06
*** bapalm has joined #openstack-qa14:06
*** sree has quit IRC14:07
*** weshay has joined #openstack-qa14:07
*** yamamoto has joined #openstack-qa14:07
openstackgerritTrevor McCasland proposed openstack-dev/devstack: Add error checking for euch.sh volume creation  https://review.openstack.org/28546414:10
*** yaume has quit IRC14:12
*** yaume has joined #openstack-qa14:12
*** rodrigods has quit IRC14:14
*** rodrigods has joined #openstack-qa14:14
openstackrecheckConsole logs not available after 13:21s for gate-horizon-npm-run-test 285084,9,d6a659d14:18
*** jbernard has left #openstack-qa14:20
*** yamamoto has quit IRC14:23
*** yaume has quit IRC14:25
*** Poornima has joined #openstack-qa14:25
*** yaume has joined #openstack-qa14:25
*** jecarey has quit IRC14:30
*** Ravikiran_K has joined #openstack-qa14:31
*** mriedem has joined #openstack-qa14:31
openstackrecheckConsole logs not available after 13:21s for gate-tempest-dsvm-neutron-full-liberty 284414,6,edfaac214:31
*** neeti_ has joined #openstack-qa14:32
*** anshul has quit IRC14:32
*** neeti has quit IRC14:33
*** mylu has joined #openstack-qa14:35
*** shausy has quit IRC14:36
*** Swami has joined #openstack-qa14:38
yfriedgmann: ping14:40
openstackgerritMerged openstack-infra/elastic-recheck: Add query for volume-backed live migration abort bug 1524898  https://review.openstack.org/28672514:41
openstackbug 1524898 in OpenStack Compute (nova) "Volume based live migration aborted unexpectedly" [High,Confirmed] https://launchpad.net/bugs/152489814:42
*** anshul has joined #openstack-qa14:44
*** Liuqing has quit IRC14:44
*** yamamoto has joined #openstack-qa14:44
openstackrecheckConsole logs not available after 13:21s for gate-glance-docs 280786,11,478bbe114:45
*** yaume_ has joined #openstack-qa14:45
*** mylu has quit IRC14:46
*** Swami_ has joined #openstack-qa14:46
openstackgerritMerged openstack-infra/subunit2sql: Use instance variable in ByteStreamToStreamResult init  https://review.openstack.org/28692514:46
openstackgerritMerged openstack-infra/subunit2sql: Remove unused flush from read_subunit()  https://review.openstack.org/28692814:47
*** yaume has quit IRC14:49
openstackgerritMerged openstack-infra/subunit2sql: Add API methods for getting tests by prefix  https://review.openstack.org/28333414:49
openstackgerritYair Fried proposed openstack/tempest: Security Groups multi-node scenario  https://review.openstack.org/25974614:50
*** Swami has quit IRC14:50
*** yangyapeng has quit IRC14:51
*** yangyapeng has joined #openstack-qa14:52
*** openstackrecheck has quit IRC14:54
*** openstackrecheck has joined #openstack-qa14:54
*** rbak has joined #openstack-qa14:55
openstackgerritMerged openstack/tempest: Make data_processing/baremetal use rest_client  https://review.openstack.org/28691414:55
*** sshnaidm_ has joined #openstack-qa14:56
*** yangyape_ has joined #openstack-qa14:56
*** sshnaidm has quit IRC14:56
*** sshnaidm_ has quit IRC14:56
*** jecarey has joined #openstack-qa14:57
*** yangyapeng has quit IRC14:57
*** doradus has quit IRC14:58
*** tosky has quit IRC15:00
*** tosky has joined #openstack-qa15:01
*** sridhargaddam has quit IRC15:03
*** sshnaidm has joined #openstack-qa15:03
*** zz_dimtruck is now known as dimtruck15:08
*** sigmavirus24_awa is now known as sigmavirus2415:08
*** mtanino has joined #openstack-qa15:09
*** tosky has quit IRC15:10
*** tosky has joined #openstack-qa15:15
*** austin81 has joined #openstack-qa15:16
openstackrecheckConsole logs not available after 13:21s for gate-glance-docs 278157,4,5391edb15:17
*** yamamoto has quit IRC15:17
*** jaypipes has joined #openstack-qa15:17
*** ChanServ sets mode: +o jaypipes15:17
*** mylu has joined #openstack-qa15:18
*** yamamoto has joined #openstack-qa15:18
*** ajmiller has joined #openstack-qa15:18
*** yamamoto has quit IRC15:18
*** yangyape_ has quit IRC15:19
*** yangyapeng has joined #openstack-qa15:19
*** yamamoto has joined #openstack-qa15:21
*** sridharg has joined #openstack-qa15:23
*** yangyape_ has joined #openstack-qa15:26
*** woodster_ has joined #openstack-qa15:27
*** sridharg has quit IRC15:28
*** yangyape_ has quit IRC15:29
*** yangyapeng has quit IRC15:30
openstackrecheckConsole logs not available after 13:20s for gate-keystone-python27 285521,8,3efdef615:30
*** gamado has quit IRC15:30
*** jecarey has quit IRC15:31
*** jecarey has joined #openstack-qa15:31
*** anshul has quit IRC15:36
*** neeti_ has quit IRC15:36
*** yamahata has joined #openstack-qa15:39
*** ngoracke has joined #openstack-qa15:42
*** yamamoto has quit IRC15:42
*** yamamoto has joined #openstack-qa15:43
openstackrecheckConsole logs not available after 13:20s for gate-tempest-dsvm-full-liberty 286634,2,cf8238f15:43
*** yamamoto has quit IRC15:43
*** yamamoto has joined #openstack-qa15:44
*** ngoracke has quit IRC15:47
*** yfried has quit IRC15:49
*** jlwhite has joined #openstack-qa15:49
openstackrecheckConsole logs not available after 13:21s for gate-tempest-dsvm-full 287226,1,b95041615:57
openstackgerritMerged openstack/eslint-config-openstack: Documented project governance  https://review.openstack.org/26591815:59
*** doradus has joined #openstack-qa16:03
*** pglass has joined #openstack-qa16:03
*** vhosakot has joined #openstack-qa16:05
*** pcaruana has quit IRC16:05
*** fawadkhaliq has joined #openstack-qa16:06
*** Serlex has quit IRC16:06
*** jaypipes has quit IRC16:08
*** _nadya_ has quit IRC16:09
openstackrecheckConsole logs not available after 13:21s for gate-tempest-dsvm-neutron-full 286915,3,307027816:10
*** armax has joined #openstack-qa16:11
*** doradus has quit IRC16:14
*** fawadkhaliq has quit IRC16:14
*** bauzas_ has joined #openstack-qa16:14
*** bauzas has quit IRC16:15
*** johnthetubaguy has quit IRC16:15
*** bauzas_ is now known as bauzas16:15
*** johnthetubaguy has joined #openstack-qa16:15
*** jplopezgu_ has joined #openstack-qa16:17
*** jplopezgu_ is now known as jlopezgu16:18
openstackgerritAl Miller proposed openstack-dev/devstack: Remove ~/.config/openstack/clouds.yml in clean.sh  https://review.openstack.org/28689816:20
*** luzC has joined #openstack-qa16:20
*** jaypipes has joined #openstack-qa16:22
*** ChanServ sets mode: +o jaypipes16:22
*** Swami__ has joined #openstack-qa16:22
openstackrecheckConsole logs not available after 13:21s for gate-cinder-python34 286601,2,c03a43d16:23
*** aalam has joined #openstack-qa16:25
openstackgerritJames E. Blair proposed openstack-infra/subunit2sql: Don't extend the passed in targets  https://review.openstack.org/28729916:26
*** Swami_ has quit IRC16:26
sdaguemtreinish: is there any easy switch to flip to make the teardown non fatal?16:27
sdaguebecause that would at least mitigate the gate a bit16:27
*** mylu has quit IRC16:28
mtreinishsdague: no we don't have anything like that right now, we'd have to add one16:30
sdagueI thought i saw something about teardown fatal16:30
sdaguein a config somewhere16:30
*** mylu has joined #openstack-qa16:32
mtreinishI don16:32
mtreinish't know of anything like that16:32
*** mylu has quit IRC16:33
*** doradus has joined #openstack-qa16:33
openstackgerritThomas Maddox proposed openstack-dev/devstack: Don't waste time zero'ing out local block image lvm volumes with nova  https://review.openstack.org/21592916:34
*** david-lyle has quit IRC16:36
openstackrecheckConsole logs not available after 13:21s for gate-cinder-python34 286600,2,aa44fa616:37
mtreinishsdague: unrelated: https://pypi.python.org/pypi/Tempest/16:37
*** david-lyle has joined #openstack-qa16:38
*** doradus has quit IRC16:38
*** yamahata has quit IRC16:39
*** jecarey_ has joined #openstack-qa16:39
*** apoorvad has joined #openstack-qa16:40
*** yfried has joined #openstack-qa16:41
*** regXboi has joined #openstack-qa16:41
*** vhosakot has quit IRC16:41
*** krtaylor has quit IRC16:41
openstackgerritMatthew Treinish proposed openstack/qa-specs: Move reintegrate-tempest-lib spec to implemented  https://review.openstack.org/28730816:41
*** jecarey has quit IRC16:42
*** yamamoto has quit IRC16:42
*** mylu has joined #openstack-qa16:44
*** mylu has quit IRC16:45
sdaguemtreinish: ah, it's a stress test option - https://github.com/openstack/tempest/blob/52abbd93a2ea9d4517538e3ec0d18f87c166602d/tempest/config.py#L98616:45
*** sc68cal has joined #openstack-qa16:46
openstackgerritJames E. Blair proposed openstack-infra/subunit2sql: Don't extend the passed in targets  https://review.openstack.org/28729916:47
openstackgerritJames E. Blair proposed openstack-infra/subunit2sql: Don't extend the passed in targets  https://review.openstack.org/28729916:47
sdaguejordanP: did you get around to unwinding the delete into the main method there?16:53
jordanPnope, I didn't start. I was planning to spend an hour on it16:53
*** rossella_s has quit IRC16:53
jordanPbut had to do something else16:54
*** rossella_s has joined #openstack-qa16:54
*** ttx has quit IRC16:54
*** ttx has joined #openstack-qa16:56
sdagueok, I wonder if we can trigger _run_cleanups directly16:57
openstackrecheckConsole logs not available after 13:21s for gate-cinder-python34 286677,1,cd40e5716:57
mtreinishsdague: https://docs.python.org/2/library/unittest.html#unittest.TestCase.doCleanups16:58
*** _nadya_ has joined #openstack-qa17:00
*** Poornima has quit IRC17:00
*** yfried has quit IRC17:00
*** gema has quit IRC17:01
*** speller has quit IRC17:01
*** gema has joined #openstack-qa17:02
sdaguemtreinish: does testtools honor that?17:03
*** luzC has quit IRC17:03
sdagueI guess it's got inheritance17:03
sdagueso maybe17:03
*** luzC has joined #openstack-qa17:04
mtreinishsdague: as far as I know. Testtools should just be an extension on unittest so it shouldn't break anything in the base stdlib17:04
mtreinishif it does that's a bug17:04
sdaguewell, there is definitely an alternative path here17:04
sdaguehowever, I think this will bypass that17:04
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Split out Neutron routers client  https://review.openstack.org/26031917:06
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Make routers_client use **kwargs  https://review.openstack.org/28441217:06
openstackgerritSean Dague proposed openstack/tempest: Force cleanups into the main test method for boot from volume  https://review.openstack.org/28732317:07
sdaguealso, liberty failed across the board on the other one17:07
sdagueI kind of wonder how the timing and failure graphs will look if we account teardown17:07
*** luzC has quit IRC17:08
*** luzC has joined #openstack-qa17:08
openstackgerritMerged openstack/tempest: Use isinstance instead of type  https://review.openstack.org/28477317:08
*** vhosakot has joined #openstack-qa17:09
*** yamahata has joined #openstack-qa17:09
mtreinishsdague: you can use stackviz to visualize that: https://stackviz.timothyb89.org/s/74c0523f-2e13-44a0-abc0-4c8a8c99d7c7/#/0/timeline17:09
*** jlwhite_ has joined #openstack-qa17:10
*** jlwhite has quit IRC17:10
mtreinishthe setupclass for volume boot pattern looks like it's pretty quick17:10
sdaguebut what about the teardown17:11
openstackrecheckConsole logs not available after 13:20s for gate-tempest-dsvm-full 285521,9,450976317:11
*** e0ne has quit IRC17:11
sdaguebecause I think the issue is that teardown takes minutes17:11
sdagueso we're getting a timeout in teardown17:12
sdagueeven though the test looks like it completed in less than the timeout17:12
*** pleia2 has joined #openstack-qa17:12
*** Swami__ has quit IRC17:12
sdaguenothing actually failed in teardown in these logs from what I can see, it's just progressing slowly17:12
*** achanda has joined #openstack-qa17:12
mtreinishit doesn't get added to the subunit stream and since volume boot pattern is last on both of it's workers you can't cheat and look at the gaps17:13
sdagueright17:13
sdaguethe _run_cleanups never get added?17:13
sdagueit's not a real tearDown17:13
*** yangyapeng has joined #openstack-qa17:14
*** grafuls has quit IRC17:14
*** mylu has joined #openstack-qa17:14
mtreinishso the class level fixtures only get added on failures, I don't think addcleanup or the per method setups ever end up in the stream as seperate ids (since they're tied to an id already)17:16
*** dtantsur is now known as dtantsur|afk17:17
*** rfolco has quit IRC17:17
*** jlanoux has quit IRC17:18
*** mylu has quit IRC17:19
*** salv-orl_ has joined #openstack-qa17:19
*** yangyapeng has quit IRC17:19
sdaguemtreinish: ok, well forcing doCleanup in the main process should at least make this more clear.17:19
*** jlwhite_ has quit IRC17:21
*** fawadkhaliq has joined #openstack-qa17:21
jordanPthe cleanup part of this test is a bit complicated. You have to delete in that order : a server, a volume, a volume snapshort then a server and then a volume. And wait for resource deletion in the middle of each step17:21
*** salv-orlando has quit IRC17:22
*** jaypipes has quit IRC17:22
*** yfried has joined #openstack-qa17:23
*** mriedem has left #openstack-qa17:24
*** mriedem has joined #openstack-qa17:24
*** krtaylor has joined #openstack-qa17:24
*** achanda has quit IRC17:27
*** kiran-r has quit IRC17:28
openstackgerritJordan Pittier proposed openstack/tempest: Scenario/manager.py: always wait when delete a cinder vol  https://review.openstack.org/28733617:28
openstackgerritIhar Hrachyshka proposed openstack-dev/devstack: worlddump: request Guru Mediation reports for neutron agents  https://review.openstack.org/27903517:29
sdaguejordanP: right, that's why I think cheating is fine and just running doCleanups17:29
*** vhosakot has quit IRC17:29
*** jasonsb has quit IRC17:30
*** jlwhite has joined #openstack-qa17:30
openstackrecheckConsole logs not available after 13:21s for gate-horizon-pep8 287252,1,3aa15b017:30
*** cdent has joined #openstack-qa17:30
*** vhosakot has joined #openstack-qa17:30
jordanPsdague, at the end of the test ? L143 ?17:31
*** rbak has quit IRC17:31
jordanPI am not sure what this will buy us. More logging ?17:31
jordanPah I didn't see your patch, okay then17:32
*** jasonsb has joined #openstack-qa17:32
sdaguewell, I think one of the things is the test fail rate in all the analysis tools is off because of where this processes17:32
sdagueas is the actual duration of this test17:32
sdaguesubunit2sql, for instance, doesn't count a fail in _run_cleanups as a fail17:33
mtreinishsdague: if it fails during _run_cleanups I'm pretty sure that's fatal to the test17:33
sdaguefrom what i can tell17:33
mtreinishand subunit2sql will count it17:33
sdaguemtreinish: well, it reports it differently17:33
*** Swami has joined #openstack-qa17:33
mtreinishdoes it?17:33
*** rbak has joined #openstack-qa17:33
sdaguehttp://status.openstack.org//openstack-health/#/17:33
jordanPyes, unittest doc says if the test fail in a cleanup stage, it's marked as fail. I don't know about subunit thoug17:34
mtreinishsdague: tearDownClass is different from _run_cleanups17:34
mtreinish_run_cleanups failures will work like you want17:34
sdaguemtreinish: then what is going on there?17:34
mtreinishtearDownClass doesn't17:34
mtreinishthe thing that isn't accounted for with _run_cleanups is the timing17:35
mtreinishwhich is arguably a subunit bug, but others might disagree with me there...17:35
sdagueI also think our timings is way off. We see all the success runs of 2.5minutes, and think our timeouts are fine17:35
mtreinish(well more realistically the fix would be in testtools)17:35
*** boris-42 has joined #openstack-qa17:35
sdaguebut don't realize it's really more like 4.5minutes and we don't have the headroom17:35
*** jasonsb has quit IRC17:36
*** jaypipes has joined #openstack-qa17:36
*** ChanServ sets mode: +o jaypipes17:36
*** Ravikiran_K has left #openstack-qa17:36
*** doradus has joined #openstack-qa17:39
*** jordanP has quit IRC17:42
*** yamamoto has joined #openstack-qa17:43
openstackrecheckConsole logs not available after 13:21s for gate-nova-python27 287253,1,0c269d317:43
*** achanda has joined #openstack-qa17:45
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Make database/telemetry clients use rest_client  https://review.openstack.org/28734317:47
*** jaypipes has quit IRC17:47
*** tosky_ has joined #openstack-qa17:47
*** tosky has quit IRC17:48
*** aalam has quit IRC17:50
*** yamamoto has quit IRC17:50
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Make database/telemetry clients use rest_client  https://review.openstack.org/28734317:51
*** aalam has joined #openstack-qa17:52
*** rfolco has joined #openstack-qa17:52
*** _nadya_ has quit IRC17:53
openstackrecheckConsole logs not available after 13:20s for gate-horizon-npm-run-test 236042,51,d8b12e917:57
*** rbak_ has joined #openstack-qa17:57
sdaguehuh, there is a 4th instance somewhere?17:58
*** rbak has quit IRC17:59
*** pcrews__ has joined #openstack-qa17:59
*** tosky_ is now known as tosky17:59
*** pcrews_ has quit IRC17:59
sdaguewhat is tempest.common.compute-instance-1530232993 ?17:59
*** lucasagomes is now known as lucas-dinner18:01
*** e0ne has joined #openstack-qa18:04
*** austin81 has quit IRC18:04
*** safchain has joined #openstack-qa18:05
*** shardy has quit IRC18:06
*** cdent has left #openstack-qa18:06
*** rbak__ has joined #openstack-qa18:07
*** rbak_ has quit IRC18:09
*** luzC has quit IRC18:10
openstackrecheckConsole logs not available after 13:20s for gate-cinder-python27 271595,18,e864faa18:10
sdaguehuh, we're polling status on things which are already gone18:11
*** david-lyle has quit IRC18:12
*** sigmavirus24 is now known as sigmavirus24_awa18:12
*** david-lyle has joined #openstack-qa18:13
*** fnaval has quit IRC18:14
*** gfidente has quit IRC18:14
openstackgerritSean Dague proposed openstack/tempest: add cleanup debug  https://review.openstack.org/28736018:14
*** ihrachys has quit IRC18:14
*** luzC has joined #openstack-qa18:14
*** mriedem has quit IRC18:18
*** yaume_ has quit IRC18:18
openstackrecheckConsole logs not available after 13:21s for gate-tempest-dsvm-postgres-full 286276,3,6d0ca3318:23
*** doradus has quit IRC18:24
mtreinishsdague: ugh, how are we ending up with an instance without the test name as the random string seed?18:24
sdagueI think because it's the boot from snapshot 3rd instance18:25
*** safchain has quit IRC18:25
*** mylu has joined #openstack-qa18:25
mtreinishsdague: well this: https://github.com/openstack/tempest/blob/master/tempest/common/compute.py#L56-L57 is also wrong18:26
sdagueso, more odd.... concerning18:26
mtreinishwe shouldn't ever default to that name because it makes tracking leaks really difficult18:26
sdaguewe seem to be looking for deleted things multiple times18:26
sdaguelike, we tear down server 318:26
sdagueand then after we tear down server 218:27
sdaguewe do another poke at server 318:27
*** aalam has quit IRC18:27
sdagueeven though we definitely already got the server 3 404 and moved on18:27
mtreinishsdague: so the scenario tests have an async wait add_cleanup call (which was supposed to be a timing optimization)18:27
sdagueI've been locally annotating the log, and it's weird18:27
mtreinishwhere it issues a delete and then does the poll loop at the end during teardownclass18:28
sdaguemtreinish: well, it's doing it all at least twice18:28
sdagueand it's definitely not going through the resources like that18:28
*** austin81 has joined #openstack-qa18:28
sdagueI think we should probably delete any optimizations here for clarity, honestly18:28
*** mriedem has joined #openstack-qa18:29
*** e0ne has quit IRC18:29
mtreinishsdague: that dates back to like folsom or grizzly IIRC18:29
*** doradus has joined #openstack-qa18:29
sdagueyeh18:30
*** e0ne has joined #openstack-qa18:30
mtreinishI remember adding it, I was refactoring something jaypipes did that created a lifo out of band in teardownclass to actually use addcleanup18:31
*** e0ne has quit IRC18:31
sdaguewell, anyway, this teardown is kind of nuts, and it's pretty hard to figure out why we're looping around again18:31
*** ddieterly has joined #openstack-qa18:31
sdaguedelete of server 2 takes 45 seconds as well ... which seems long18:32
*** e0ne has joined #openstack-qa18:32
mtreinishthat does seem kinda long18:32
mtreinishespecially for a tiny cirros image18:32
ddieterlyif there is a devstack plugin and a gate job, how does the gate job know how to run the tempest tests if i add a tempest test plugin? what is the mechanism to get the tempest tests to run?18:33
sdaguemtreinish: right, I think the issue is we're requiring a graceful shutdown ... because nova does that by default now18:33
mtreinishsdague: oh, yeah that could do it18:34
*** mylu has quit IRC18:35
*** mylu has joined #openstack-qa18:35
*** fnaval has joined #openstack-qa18:37
openstackrecheckConsole logs not available after 13:20s for gate-cinder-pep8 283440,10,06f6b1f18:37
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Make identity clients use rest_client  https://review.openstack.org/28738018:41
ddieterlysdague: what is the mechanism to get tempest tests to run in a tempest test plugin?18:43
sdaguemtreinish: ok, that's pretty deeply embedded now. I thought we had fast kill but we really don't any more18:44
*** ajmiller_ has joined #openstack-qa18:45
ddieterlyis it simply declaring tempest.test_plugins in the setup.cfg file?18:45
*** ajmiller has quit IRC18:48
*** austin81 has left #openstack-qa18:50
openstackrecheckConsole logs not available after 13:21s for gate-cinder-python34 286256,8,0b283e718:50
mriedemmtreinish: so i'm not sure how i'm hitting htis http://logs.openstack.org/55/286855/1/experimental/gate-tempest-dsvm-neutron-dvr-multinode-full/8c4b90c/console.html#_2016-03-02_00_17_36_78018:51
mriedembecause as far as i can tell, test_volume_boot_pattern is hitting similar code when calling get_server_ip(server)18:51
mriedemi.e. https://review.openstack.org/#/c/286855/1/tempest/api/compute/admin/test_live_migration.py@9318:52
mriedemvs18:52
mriedemhttps://github.com/openstack/tempest/blob/master/tempest/scenario/test_volume_boot_pattern.py#L11318:52
mriedemoooo i see18:53
mriedemget_server_ip is different for api tests and scenario tests18:53
mriedemsneaky sneaky18:53
sdagueyeh18:53
*** pvaneck has joined #openstack-qa18:53
sdagueit's a bit less bonkers then it used to be18:54
sdaguebut they are still different18:54
*** tosky has quit IRC18:55
*** dwalleck has joined #openstack-qa18:56
*** dwalleck has quit IRC18:56
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Make network clients use rest_client  https://review.openstack.org/28738218:56
sdaguemriedem: also liberty went extra bonkers?18:58
sdaguehttps://review.openstack.org/#/c/286634/ is very suspicious that it failed on all of liberty18:58
mriedemlooking18:59
mriedemhmmm18:59
mriedeminternap for one thing18:59
mgagnemriedem: hi18:59
mriedemsdague: have you run what-broke?18:59
sdaguemriedem: nope18:59
sdagueit's the boot from volume job though19:00
mriedemyeah, i'll run what-broke19:00
mgagnemriedem: sup with internap? =)19:00
mriedemnothing yet19:00
sdaguemgagne: being slow... ?19:00
mgagnesdague: any metrics?19:00
sdaguehttp://logs.openstack.org/76/286276/3/gate/gate-tempest-dsvm-postgres-full/6d0ca33/console.html and http://logs.openstack.org/76/286276/3/gate/gate-tempest-dsvm-neutron-full/e9b56fd/console.html timing out on boot from volume19:01
sdagueboth on internap19:01
mgagnesdague: gate is running at full capacity, you might be your own noisy neighbours19:01
mriedemsdague: this failed differently http://logs.openstack.org/34/286634/2/check/gate-tempest-dsvm-neutron-full-liberty/0dd5886/console.html19:01
sdaguemgagne: right could be19:01
mriedemyikes http://logs.openstack.org/34/286634/2/check/gate-tempest-dsvm-neutron-full-liberty/0dd5886/logs/screen-c-vol.txt.gz?level=TRACE19:01
sdaguebut we're always going to be19:02
mriedemhttp://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22fixtures._fixtures.timeout.TimeoutException%5C%22%20AND%20tags%3A%5C%22console%5C%22&from=7d19:02
mriedemfrom that, build_node is primarily internap and ovh19:03
sdaguemriedem: yep19:03
mriedemit's really weird that it'd be failing full on liberty though and not master19:03
sdaguehonestly, I think it's just a speed issue19:03
mgagneI prefer node_provider =)19:03
sdagueit also fails on master19:03
openstackrecheckConsole logs not available after 13:21s for gate-horizon-python27 284848,6,968fe2319:03
sdaguejust not this time apparently19:04
sdagueI guess it was just bad dice on allocation19:04
sdaguemtreinish: do you know which timeout is killing us here?19:04
sdaguebecause last I looked the tempest timeout was 1200s19:04
sdagueand we're not there19:04
sdaguethis is like a 600s timeout19:04
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Remove service_client module  https://review.openstack.org/28738819:07
mgagnemriedem: RAX: 10(iad), OVH: 29(bsh1) + 16(gra1), INAP: 72(nyj01)19:08
sdaguehmmm.... somethign is setting it to 50019:08
sdague OS_TEST_TIMEOUT=${OS_TEST_TIMEOUT:-500}19:08
sdaguegdi19:10
mgagnemriedem: I'm trying to see where the timeout are occuring19:12
mgagneI saw some related to instance connectivity tests19:12
*** ylobankov has joined #openstack-qa19:12
*** ajmiller_ is now known as ajmiller19:15
openstackgerritSean Dague proposed openstack/tempest: bump tempest testr timeout to 1800s  https://review.openstack.org/28739519:15
sdaguethat will fix this19:15
sdaguemriedem: you have a bug for it?19:15
mriedemnope19:16
mgagneI see a lot of ERROR logs for one of the failed connectivity tests: http://logs.openstack.org/71/270971/5/check/gate-neutron-dsvm-fullstack/0df391e/logs/TestOvsConnectivitySameNetwork.test_connectivity_GRE-and-l2pop,Ofctl_/neutron-openvswitch-agent--2016-02-25--02-25-30-454060.log.txt.gz19:16
mgagnecould it be related?19:16
sdaguemgagne: so.... it looks like the primary issue is just that we've got a timeout that's too low19:16
mgagnelike an issue that could only be triggered on slow nodes19:17
sdagueand it's in a place that I wasn't expecting19:17
openstackrecheckConsole logs not available after 13:21s for gate-cinder-python34 286116,2,021570e19:17
sdaguebecause I actually looked for it the other day19:17
sdaguemtreinish: so.... let me know if you are ok with https://review.openstack.org/287395 or if I should do the test scaling thing19:19
openstackgerritMerged openstack-infra/subunit2sql: Don't extend the passed in targets  https://review.openstack.org/28729919:19
mgagnetimeout looks to be related to test_connectivity test failures and since I see errors in logs, I'm wondering what triggers them19:20
mgagneif all test_connectivity are timing out, this can easily pile up and make it looks like node is slow19:20
sdagueso, I think there are 2 things19:21
mgagneI think too19:21
sdague1 ... in general the internap nodes are in the slower bucket for us, so the boot from volume test can individually timeout19:21
mgagneslow passing tests and slow failing tests =)19:21
sdague2 ... we run out of total time19:22
*** sigmavirus24_awa is now known as sigmavirus2419:22
sdaguehttps://review.openstack.org/#/c/286276/19:22
sdagueit's what happened there, 120 minutes wasn't long enough to get through the run19:22
mgagnesdague: where is the time wasted?19:23
mgagnesdague: "this is a very slow node" what does it mean?19:23
openstackgerritMatt Riedemann proposed openstack/tempest: DNM: ssh into active instance before and after live migration  https://review.openstack.org/28685519:23
mgagnesdague: Running devstack: is it the bootstrapping part before tempest is run?19:23
sdaguemgagne: that is an error we throw in there for logstash19:23
sdaguebecause we can't do math on the logs easily19:24
mgagnesdague: I'm sure there is more to that =)19:24
sdaguehttp://logs.openstack.org/76/286276/3/gate/gate-tempest-dsvm-postgres-full/6d0ca33/logs/devstacklog.txt.gz is the detailed log19:25
mgagneI'm looking at it and trying to figure out what's slow19:25
mgagne~3m more to install packages (based on stats at the end)19:26
sdaguethis feels like io slowness19:26
sdaguebecause 257s for pip_install is really high given the wheel mirror19:26
sdaguethe disk io speed is just way off19:26
openstackrecheckConsole logs not available after 13:20s for gate-horizon-python27 257770,12,59822de19:30
*** mvk has quit IRC19:31
*** vhosakot has quit IRC19:31
*** fnaval has quit IRC19:32
mgagnesdague: could be very bad lock where multiple pip install are running at the same time on the same node19:33
mgagneluck*19:33
*** vhosakot has joined #openstack-qa19:35
*** doradus has quit IRC19:35
sdaguemgagne: ?19:36
*** mylu has quit IRC19:36
sdaguewell, we use the io path quite a lot for lots of things19:36
*** mylu has joined #openstack-qa19:36
sdaguethat's just a good global counter for how things are doing on the io level19:37
*** davideagnello is now known as davideagnello__19:40
openstackrecheckConsole logs not available after 13:21s for gate-glance-python27 273982,3,87cac5d19:43
*** davideagnello__ is now known as davide85_19:45
mgagnesdague: dstat isn't enabled until after packages are installed19:48
mgagnesdague: I tried to see where the resources went19:48
mgagnesdague: but the interesting part isn't available in the csv of dstat19:48
sdaguemgagne: no, honestly, the rest of the run is slow as well19:48
mgagnesdague: sure but I can't analyze 2 hours of test. If I can concentrate on one part, that would be easier19:49
sdaguemgagne: right, but the point is we emit that message from devstack when the aggregate timing is odd19:49
mgagneI know19:50
sdaguewe still had 1.5 hrs after devstack ran19:50
sdagueI don't think you are going to find any particular hot spot19:50
mgagneI think I could correlate those infos with stats I have on my side (provider)19:50
*** doradus has joined #openstack-qa19:50
mgagneI just enabled some stats tool so won't be able to compare until it gather a couple of data points19:51
ddieterlyanyone here able to answer some tempest plugin test questions?19:51
mgagnesdague: do you have a test result for gate-tempest-dsvm-cells but on an other provider? I can try to compare19:53
mgagneok found rax results, 47m vs ~2h19:56
openstackrecheckConsole logs not available after 13:20s for experimental-tempest-dsvm-multinode-full-dibtest 286573,2,706f49b19:57
*** gszasz has quit IRC19:58
mtreinishsdague: we can do a blanket timeout, unless you think there is value in holding faster tests to the smaller timeout19:58
mtreinishsdague: are we not having any issues with the build_timeout of 192s? (or whatever it is)20:03
mgagnesdague: ok, average load at internap is just way higher than others20:05
mgagnesdague: will see what I can do on my side about it20:05
openstackrecheckConsole logs not available after 13:21s for gate-nova-python27 286931,2,bda89b220:10
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Split out Neutron routers client  https://review.openstack.org/26031920:18
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Make routers_client use **kwargs  https://review.openstack.org/28441220:18
*** mylu has quit IRC20:22
*** apoorvad has quit IRC20:23
*** mylu has joined #openstack-qa20:23
openstackrecheckConsole logs not available after 13:20s for gate-cinder-python34 286775,4,a867f4920:24
*** mylu has quit IRC20:25
*** mylu has joined #openstack-qa20:27
*** rcernin has quit IRC20:36
openstackrecheckConsole logs not available after 13:21s for gate-requirements-integration-dsvm 287313,1,f5e456220:37
*** luzC has quit IRC20:38
sdaguemtreinish: no, this is the fixture timeout on delete20:40
sdaguemgagne: yeh, my guess is io constraints, we may just need to back off the over commit20:41
mtreinishsdague: right, I realize that. I was just curious if we're not also tripping the per async operation timeout20:41
sdaguemtreinish: I don't believe so20:43
sdagueor if we are, it's way less than this20:43
mtreinishok20:43
sdaguethe reality is, it's only this job that seems in trouble20:44
sdagueso we could put the test scaling bit in instead20:44
*** luzC has joined #openstack-qa20:44
sdagueI had that pulled together the other day, but then the 1200 timeout in tox.ini threw me off that path20:44
sdaguenot realizing that we're falling back to the 500 in .testr.conf20:44
*** david-lyle has quit IRC20:45
*** david-lyle has joined #openstack-qa20:47
*** jecarey_ has quit IRC20:49
*** yangyapeng has joined #openstack-qa20:50
openstackrecheckConsole logs not available after 13:21s for gate-nova-pep8 287248,2,889030e20:50
openstackgerritMerged openstack/tempest: Added processing /compute URL for getting list of versions  https://review.openstack.org/28462120:51
*** rossella_s has quit IRC20:53
*** rossella_s has joined #openstack-qa20:54
openstackgerritSean Dague proposed openstack/tempest: Implement TIMEOUT_SCALING_FACTOR for tempest  https://review.openstack.org/28743420:55
sdaguemtreinish: so that's honestly probably *more* correct ^^^20:55
mgagnesdague: we couldn't find any io constraints on our side20:55
mgagnesdague: we suspect CPU instead20:55
sdaguemgagne: really? interesting20:55
sdaguewhat's the procs on these?20:55
mgagnesdague: rax: 9 average load. inap: 25 average load20:55
sdagueoof20:56
mgagneyea20:56
sdaguehonestly, I'm surprised it held up20:56
sdaguenormally once we get above 12 we start killing the message bus20:56
mgagnesdague: I would find a way to auto generate graphs with http://lamada.eu/dstat-graph/ from build logs very useful20:56
mtreinishsdague: +220:56
sdaguemgagne: me too20:57
mgagnesdague: that's how I found about the load average20:57
*** yangyapeng has quit IRC20:57
sdaguemtreinish: isn't that a thing?20:57
mgagnethere is no way I can mentally parse the csv20:57
*** pvaneck has quit IRC20:57
sdagueor is it only a partial thing20:57
mtreinishsdague: well stackviz is the closest thing to that20:57
mgagnesdague: but there is no license attached to the project so I don't know if we can fork it and patch it + host it20:57
*** pvaneck has joined #openstack-qa20:58
mtreinishit's still not integrated into the workflow20:58
sdaguemgagne: yeh, if you ask and find out, we could do a thing there20:58
mtreinishyou can do it out of band20:58
sdaguemtreinish: is there still anyone working on stackviz?20:58
timothyb89sdague: yup!20:58
sdaguetimothyb89: ok, coolio, any thoughts on getting it into our workflow a little tighter20:58
sdagueit would be super nice to have that at the end of runs20:59
mtreinishsdague: https://review.openstack.org/#/c/287373/20:59
*** apoorvad has joined #openstack-qa20:59
mtreinishsdague: in the meantime you can use timothyb89's prototype: https://stackviz.timothyb89.org/20:59
sdaguemtreinish: ok, starred for tomorrow20:59
timothyb89sdague: mtreinish beat me to it :)20:59
*** mylu has quit IRC21:01
*** mylu has joined #openstack-qa21:01
*** raildo is now known as raildo-afk21:02
openstackrecheckConsole logs not available after 13:21s for gate-tempest-dsvm-neutron-full 284412,6,c0489b121:04
*** jecarey has joined #openstack-qa21:05
*** jecarey has quit IRC21:08
*** jecarey has joined #openstack-qa21:08
*** aysyd has quit IRC21:09
*** moravec has joined #openstack-qa21:09
*** ngoracke has joined #openstack-qa21:10
*** ngoracke has quit IRC21:14
openstackrecheckConsole logs not available after 13:21s for gate-horizon-pep8 283171,9,b57228d21:17
*** aunnam has joined #openstack-qa21:23
*** anshul has joined #openstack-qa21:24
*** anshul has quit IRC21:26
*** dkranz has quit IRC21:27
sdaguemtreinish: oo... is openstack health a thing again - http://status.openstack.org/openstack-health/#/ ?21:29
sdaguemtreinish: feature request on last 10 failed21:30
*** aunnam has left #openstack-qa21:30
*** dkranz has joined #openstack-qa21:30
openstackrecheckConsole logs not available after 13:21s for gate-grenade-dsvm-neutron 279035,4,e499b7021:30
sdaguesort by stop time21:31
sdagueor by some time, not by test name21:31
sdagueand if we could get the last 10 in the integrated gate queue, that would be awesome21:31
*** manjeets has joined #openstack-qa21:32
mtreinishsdague: yeah, jeblair found the bug and fixed it with: https://review.openstack.org/#/c/287299/21:33
sdaguenice21:33
mtreinishso things are moving again there21:33
mtreinishoh, did I forget to make the table sortable21:34
mtreinishoops21:34
sdagueit sorts by test name I think21:34
sdagueit's very noticable with the current data set21:34
mtreinishyeah, that's wrong we should default sort on one of the times, but I meant to make it selectable21:35
sdaguealso, the time could probably just be Feb 2, 17:2621:35
mtreinishlike the other tables21:35
yfriedafazekas: mtreinish: gmann: oomichi: masayukig: https://review.openstack.org/259746 could you please review?21:35
sdagueso that it was visually easier to parse21:35
sdaguealmost all of those values in the time field are not human useful :)21:36
sdagueespecially seconds an uS21:36
sdagueand year :)21:36
mtreinishsdague: well when we had >1 yr of data in the db year was important21:37
mtreinishbut we're filtering < 6months now so it's not needed anymore21:37
mtreinishsdague: if you file a bug on that, masayukig will prbably just do it when he's online21:37
mriedemblarg21:38
mriedemwhy do compute api tests have to redefine class variables for all of the clients that are already in the base class?21:39
timothyb89mtreinish, sdague: I can take care of it really quick21:39
mtreinishtimothyb89: go for it, I'm stuck in a pandas hole right now21:39
timothyb89mtreinish: that doesn't sound like much fun21:39
mtreinishI dunno, pandas are cool :)21:40
mtreinishmriedem: for no good reason, the only thing I can think of is 80 chars in pep821:40
mriedemmtreinish: no i mean http://logs.openstack.org/55/286855/2/experimental/gate-tempest-dsvm-neutron-dvr-multinode-full/3fd9226//console.html#_2016-03-02_21_24_18_87621:41
mriedemhttps://review.openstack.org/#/c/286855/2/tempest/api/compute/admin/test_live_migration.py21:41
mriedemi'm using some other clients that aren't stored as vars in setup_clients in the test class, but they are defined in setup_clients in the base class21:41
mriedemso i figured i could just re-use those21:41
mtreinishmriedem: that should work, is super() called in the test_live_migration.py setup_clients?21:43
mriedemyup21:43
mriedemand in BaseV2ComputeAdminTest21:44
openstackrecheckConsole logs not available after 13:21s for gate-tempest-dsvm-neutron-dvr 260319,29,8a6caef21:44
mriedemis it because this is admin?21:44
mriedemso it has to use cls.os_adm21:44
mriedemb/c the base class uses cls.os.*21:44
mtreinishmriedem: well both managers should be initialized21:44
mtreinishit might not be using the one you want to be, but it should be defined21:45
mriedemalright, weird21:45
manjeetshi I am trying to check if some extension is enabled in neutron or not using defined method  https://github.com/openstack/tempest/blob/master/tempest/test.py#L16321:45
mriedemwell, i guess i'll just put my head in the sand and follow the pattern already in the test21:46
manjeetsbut it is not working for one of extension recently added21:46
manjeetsif want to check a extension from list returned by neutron ext-list21:46
mtreinishmriedem: I normally prefer to do self.os_adm.client_name.call() instead of an alias21:46
*** r-mibu has quit IRC21:46
mtreinishit's easier to know where things come from that way21:46
*** erlon has quit IRC21:46
*** r-mibu has joined #openstack-qa21:47
openstackgerritMatthew Treinish proposed openstack/openstack-health: WIP: Add numeric run_time data for runs  https://review.openstack.org/28746321:48
*** krtaylor has quit IRC21:48
mtreinishtimothyb89: ^^^ my pandas hole21:48
openstackgerritMatt Riedemann proposed openstack/tempest: DNM: ssh into active instance before and after live migration  https://review.openstack.org/28685521:48
mtreinishalthough it breaks the js side, but I didn't want to lose my work21:48
*** sc68cal has quit IRC21:48
timothyb89mtreinish: ah, cool, that'll be nice21:48
timothyb89we can always use more scatter plots :)21:49
mriedemmtreinish: check out how much of the scenario manager i had to copy here https://review.openstack.org/#/c/286855/3/tempest/api/compute/admin/test_live_migration.py21:49
mtreinishmriedem: how do the other api tests that ssh do it?21:50
mriedemthe validation_resources or whatever it's called21:50
mriedembut i think those are only set if run_validation=True?21:50
mtreinishmanjeets: that function is only for configuration, it doesn't query the api at all21:50
mriedemthe scenarios tests create all of that stuff on the fly21:50
*** sc68cal has joined #openstack-qa21:50
mtreinishmanjeets: tempest doesn't rely on the api to make a skip decision like that. It's just asking for trouble to do that21:51
oomichiyfried: hat is gmann's turn and need to wait for his morning more 2 hours21:51
yfriedoomichi: turn?21:51
manjeetsyea i need to check configuration whether some extension is loaded or not21:52
oomichiyfried: his score is latest now, and I'd like to see his feedback21:52
manjeetsmtreinish:21:52
yfriedoomichi: ok21:52
*** josdotso has joined #openstack-qa21:54
*** armax has quit IRC21:55
openstackrecheckConsole logs not available after 13:21s for gate-horizon-python27 284973,3,9ac6bde21:57
sdaguemriedem: because they hate you21:58
mriedemgod, obviously21:58
oomichimtreinish: gate-tempest-dsvm-layer4 seems broken now, is someone working for that?21:58
oomichielse I will do21:58
*** armax has joined #openstack-qa21:59
sdagueoomichi: I don't think anyone else is looking at it, and it looks proper broken21:59
oomichisdague: proper broken?22:00
sdaguenot just an odd race22:00
oomichimeaning intentional broken?22:00
sdaguecreate_tenant has wrong number of args22:00
moravec@mtreinish @timothyb89 is there an option on OpenStack Health to see %tests failed instead of %runs failed?22:04
*** achanda has quit IRC22:06
moravecunless I'm missing something, all the data is showing the number and % of the runs that fail, but a failed run can mean anything from 1 to n failed tests22:08
mtreinishmoravec: yes, you can either dive down into a per run page, or go right to: http://status.openstack.org/openstack-health/#/tests?groupKey=project&resolutionKey=hour22:09
mtreinishmoravec: and there is also a per test page: http://status.openstack.org/openstack-health/#/test/tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern22:10
openstackrecheckConsole logs not available after 13:21s for gate-tempest-dsvm-neutron-full 281999,2,c89d5f922:10
moravec@mtreinish ok, but no summary data for the range selected?  Like, over the past week what is the %tests failed for a given build_queue (e.g., periodic_qa)?22:11
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Skip test_list_db_versions  https://review.openstack.org/28747622:12
mtreinishmoravec: not for a single build_queue we have that per job (well build_name is the actual key)22:12
mtreinishmoravec: like http://status.openstack.org/openstack-health/#/job/gate-tempest-dsvm-neutron-full?groupKey=project&resolutionKey=hour22:13
mtreinishoomichi: I wasn't aware it was broken, do you have a link?22:13
*** achanda has joined #openstack-qa22:13
moravec@mtreinish ok, thanks, that's what I thought.  Something like this, but showing the test% pass/fail  (vs. runs)  http://status.openstack.org/openstack-health/#/?groupKey=build_queue&resolutionKey=hour&duration=P1M22:14
oomichimtreinish: http://logs.openstack.org/43/287343/2/check/gate-tempest-dsvm-layer4/e07db68/logs/testr_results.html.gz22:14
*** e0ne has quit IRC22:14
oomichimtreinish: I start digging it now22:14
*** mylu has quit IRC22:15
*** mylu has joined #openstack-qa22:15
mtreinishoomichi: is that on your change which updates the clients to use the rest_client instead of service_client?22:16
mtreinishI'm wondering are we seeing that failure elsewhere22:16
oomichimtreinish: oops, nice point22:17
*** e0ne has joined #openstack-qa22:17
mtreinishmoravec: sure, it's doable. The problem with that is twofold though. there isn't neccesarily a consistent set of tests across all jobs on an arbitrary metadata key and its a lot of data22:18
mtreinishlike the per job page is are slowest because to pull in all the data necessary at the per test level is expensive22:18
*** weshay has quit IRC22:19
moravec@mtreinish ok, I see the link you sent has Test Failure Rate by build_nameā€¦.that's useful.  Thanks for the pointers.  I was thinking the %test fail is a better view of how things are than job failures, since a single test failure marks the whole job failed.22:20
*** achanda has quit IRC22:20
openstackgerritTim Buckley proposed openstack/openstack-health: Improve failed and recent runs tables  https://review.openstack.org/28747822:21
andreafmtreinish: do you want me to re-spin this or can we get it in as is, and I will start the implementation?22:22
mtreinishandreaf: what is this?22:23
andreafmtreinish: heh sorry it's the client manager refactor spec22:23
mtreinishandreaf: I think we should respin the spec first22:24
openstackrecheckConsole logs not available after 13:20s for gate-tempest-dsvm-neutron-full 287355,1,447697722:24
andreafI just noticed you have comments on the resources one - I'll check them now22:24
andreafok22:24
mtreinishto see if there is buy in from the broader community, not just us :)22:24
andreafjswarren: hi - have you heard anything from dwalleck about his patches for the test resources spec?22:25
andreafmtreinish: heh, good point22:26
jswarrenandreaf: He submitted this: https://review.openstack.org/#/c/286342/222:26
*** e0ne has quit IRC22:27
andreafjswarren: oh - ok - I missed that, thanks for the link I'll review it22:28
*** dkranz has quit IRC22:28
openstackgerritTim Buckley proposed openstack/openstack-health: Add REST API methods for test prefixes  https://review.openstack.org/28748222:31
*** edmondsw has quit IRC22:32
openstackrecheckConsole logs not available after 13:21s for gate-cinder-python34 286901,2,e5cb6cc22:37
*** bkopilov has quit IRC22:39
*** yangyapeng has joined #openstack-qa22:41
*** yangyapeng has quit IRC22:46
openstackgerritTim Buckley proposed openstack/openstack-health: Add REST API methods for test prefixes  https://review.openstack.org/28748222:47
*** mriedem has quit IRC22:48
*** mylu has quit IRC22:49
*** bkopilov has joined #openstack-qa22:50
openstackrecheckConsole logs not available after 13:20s for gate-cinder-python34 281625,6,66667af22:51
*** krtaylor has joined #openstack-qa22:52
*** yarkot_ has joined #openstack-qa22:53
*** sc68cal_ has joined #openstack-qa22:56
*** dims_ has quit IRC22:56
*** yarkot_ has quit IRC22:57
*** sc68cal has quit IRC22:58
*** mylu has joined #openstack-qa22:58
openstackrecheckConsole logs not available after 13:20s for gate-swift-docs 278245,23,7c31cab23:04
openstackgerritMerged openstack/openstack-health: Remove workaround graph width  https://review.openstack.org/28595523:12
*** yamamoto_ has joined #openstack-qa23:12
*** sigmavirus24 is now known as sigmavirus24_awa23:15
*** mylu has quit IRC23:15
*** regXboi has quit IRC23:17
openstackrecheckConsole logs not available after 13:21s for gate-glance-python27 287349,2,765079923:17
*** ajmiller has quit IRC23:17
*** ajmiller has joined #openstack-qa23:18
*** salv-orlando has joined #openstack-qa23:19
*** achanda has joined #openstack-qa23:20
*** salv-orl_ has quit IRC23:22
*** yamamoto_ has quit IRC23:24
*** dimtruck is now known as zz_dimtruck23:25
*** mylu has joined #openstack-qa23:27
*** mylu has quit IRC23:27
*** mylu has joined #openstack-qa23:27
*** achanda has quit IRC23:28
openstackrecheckConsole logs not available after 13:21s for gate-tempest-dsvm-postgres-full 287343,2,02ea13223:31
*** mylu has quit IRC23:33
*** tochi has joined #openstack-qa23:37
*** ddieterly has quit IRC23:39
*** pglass has quit IRC23:42
openstackrecheckConsole logs not available after 13:21s for gate-nova-python27 287253,2,de6118923:44
*** manjeets has left #openstack-qa23:47
*** salv-orlando has quit IRC23:50
*** salv-orlando has joined #openstack-qa23:51
gmannyfried: looks fine.23:52
*** ylobankov has quit IRC23:55
openstackrecheckConsole logs not available after 13:20s for experimental-tempest-dsvm-multinode-full-dibtest 287363,1,5d258d323:57
*** ajmiller has quit IRC23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!