Thursday, 2015-12-10

*** gfidente has quit IRC00:02
openstackrecheckConsole logs not available after 13:31s for gate-tempest-dsvm-neutron-full 246337,4,d41b52a00:04
*** markvoelker has quit IRC00:05
*** dimtruck is now known as zz_dimtruck00:06
*** zhangjn has joined #openstack-qa00:08
*** akshai has quit IRC00:11
openstackrecheckConsole logs not available after 13:23s for gate-grenade-dsvm-multinode 255562,1,14dd52500:17
*** zhangjn has quit IRC00:26
gmannmtreinish: but unit tests are with mocked fake_client which does got to actual service client methods00:30
*** rossella_s has quit IRC00:30
*** rossella_s has joined #openstack-qa00:30
gmannmtreinish: https://github.com/openstack/tempest/blob/master/tempest/tests/cmd/test_javelin.py#L2800:30
openstackrecheckConsole logs not available after 13:25s for gate-tempest-dsvm-full-ceph 254428,5,37abedc00:30
openstackgerritMerged openstack-dev/grenade: export DATABASES_TO_SAVE for save-state  https://review.openstack.org/23393500:40
*** nic has quit IRC00:42
openstackrecheckConsole logs not available after 13:31s for gate-tempest-dsvm-neutron-full 255417,3,f533eae00:44
*** hemna is now known as hemnafk00:50
*** pvaneck has quit IRC00:52
*** zhangjn has joined #openstack-qa00:53
openstackrecheckConsole logs not available after 13:30s for gate-glance_store-python27 255583,1,af8654a00:58
*** eil397 has quit IRC01:02
gmannmtreinish: another idea to cover that to update its unit tests to mock service cleitn methods instead of client class01:03
gmannmtreinish: at least we will be able to capture right usage of service client on javelin01:04
gmannmtreinish: another issue on same line is for cleanup scripts01:04
gmannmtreinish: i will check if we can cover those in UT01:05
*** zhangjn has quit IRC01:05
*** markvoelker has joined #openstack-qa01:05
*** zhangjn has joined #openstack-qa01:07
openstackgerritYuiko Takada proposed openstack/tempest: Remove Ironic tests  https://review.openstack.org/24618501:09
*** markvoelker has quit IRC01:11
openstackrecheckConsole logs not available after 13:22s for gate-nova-pep8 255586,1,a9c0c4001:12
*** ajmiller_ has quit IRC01:22
*** mtanino has quit IRC01:23
openstackrecheckConsole logs not available after 13:24s for gate-horizon-releasenotes 255590,1,f79c26801:25
*** Swami has quit IRC01:35
*** akshai has joined #openstack-qa01:36
openstackrecheckConsole logs not available after 13:22s for gate-nova-python27 255572,1,ae1a54f01:39
*** akshai has quit IRC01:41
*** armax has quit IRC01:43
*** yamamoto has joined #openstack-qa01:43
*** jamielennox|away is now known as jamielennox01:48
*** yamamoto has quit IRC01:49
openstackgerritGhanshyam Mann proposed openstack/tempest: Add tests for Nova microversion v2.2  https://review.openstack.org/24499601:51
openstackrecheckConsole logs not available after 13:23s for gate-glance-python34 255584,1,dc38f3c01:53
*** Liuqing has joined #openstack-qa01:53
*** yamamoto has joined #openstack-qa01:54
*** boris-42_ has quit IRC01:54
*** yamamoto has quit IRC01:54
*** johnthetubaguy has quit IRC01:54
*** boris-42_ has joined #openstack-qa01:56
*** johnthetubaguy has joined #openstack-qa01:57
*** tochi has quit IRC01:59
*** rcernin has quit IRC02:01
openstackrecheckConsole logs not available after 13:28s for gate-tempest-dsvm-full-test-accounts 254274,3,2a583e702:07
*** salv-orl_ has joined #openstack-qa02:07
*** salv-orlando has quit IRC02:10
*** davidlenwell has quit IRC02:10
*** hitalia has quit IRC02:12
*** davidlenwell has joined #openstack-qa02:13
openstackrecheckConsole logs not available after 13:25s for gate-tempest-dsvm-neutron-full-non-admin 252467,5,2753ac902:20
openstackrecheckopenstack/nova change: https://review.openstack.org/253901 failed because of: gate-tempest-dsvm-full-ceph: https://bugs.launchpad.net/bugs/146425902:21
openstackLaunchpad bug 1464259 in OpenStack Compute (nova) "Volumes tests fails often with rbd backend" [High,In progress] - Assigned to Matt Riedemann (mriedem)02:21
*** zhangjn has quit IRC02:21
*** hoangcx has joined #openstack-qa02:24
*** hoangcx has left #openstack-qa02:24
*** zhangjn has joined #openstack-qa02:25
*** tochi has joined #openstack-qa02:26
openstackrecheckConsole logs not available after 13:28s for gate-tempest-dsvm-neutron-full-kilo 246185,3,bff34fb02:44
*** Liuqing has quit IRC02:46
openstackrecheckConsole logs not available after 13:28s for gate-tempest-dsvm-neutron-full 255044,4,21055d203:02
*** boris-42_ has quit IRC03:03
*** ajo has quit IRC03:04
*** Liuqing has joined #openstack-qa03:05
*** markvoelker has joined #openstack-qa03:07
*** yamamoto has joined #openstack-qa03:10
*** markvoelker has quit IRC03:12
*** eliqiao has quit IRC03:27
*** hitalia has joined #openstack-qa03:29
*** tochi has quit IRC03:31
*** nicholasgoracke has joined #openstack-qa03:33
*** hitalia has quit IRC03:41
openstackgerritFelixLi proposed openstack/tempest: Remove wrong comment  https://review.openstack.org/25416003:42
*** flwang1 has quit IRC03:55
*** tochi has joined #openstack-qa03:56
*** dwalleck has joined #openstack-qa03:57
*** sree has joined #openstack-qa04:04
*** sree has quit IRC04:05
*** davidlenwell has quit IRC04:06
*** timothyb89 has quit IRC04:08
*** timothyb89 has joined #openstack-qa04:08
*** davidlenwell has joined #openstack-qa04:09
*** zhangjn has quit IRC04:09
*** yamahata has joined #openstack-qa04:10
*** sree has joined #openstack-qa04:11
*** jasonsb has joined #openstack-qa04:11
*** sree has quit IRC04:22
*** amotoki has quit IRC04:25
*** rossella_s has quit IRC04:30
*** rossella_s has joined #openstack-qa04:30
*** sree has joined #openstack-qa04:33
openstackrecheckopenstack/tempest change: https://review.openstack.org/251312 failed gate-tempest-dsvm-postgres-full in the gate queue with an unrecognized error04:34
*** hoangcx has joined #openstack-qa04:45
*** hoangcx has left #openstack-qa04:48
*** zhangjn has joined #openstack-qa04:51
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Make server action methods[m-z] use **kwargs  https://review.openstack.org/25513804:54
*** zhangjn has quit IRC05:04
*** Poornima has joined #openstack-qa05:05
openstackgerritPiyush Pathak proposed openstack/tempest: Make update_extra_routes use **kwargs & doc string  https://review.openstack.org/25286205:06
*** markvoelker has joined #openstack-qa05:07
*** armax has joined #openstack-qa05:11
*** markvoelker has quit IRC05:12
*** oomichi_away is now known as oomichi05:12
oomichigmann: I cannot make today irc meeting. I wrote current situation related to service client dev on https://wiki.openstack.org/wiki/Meetings/QATeamMeeting#Proposed_Agenda_for_December_10th_2015_.280900_UTC.2905:19
oomichigmann: I'm happy if you will share it on the meeting05:20
gmannoomichi: sure i will share.Thanks05:20
openstackgerritMerged openstack/tempest: Use Tempest-lib's compute volumes_client  https://review.openstack.org/24973405:25
binbincongHi all, I added some keystone v3 users negative test cases, they are all related to user authentication, please help to review if you have time. Thanks. https://review.openstack.org/#/c/254164/05:25
*** zhangjn has joined #openstack-qa05:29
openstackgerritPiyush Pathak proposed openstack/tempest: Make v3 create_trust  use **kwargs & doc string  https://review.openstack.org/25459605:29
*** amotoki has joined #openstack-qa05:30
openstackgerritMerged openstack/tempest: Make v2 create_user_ec2_credentials  use **kwargs  https://review.openstack.org/25417405:32
*** SridharG has joined #openstack-qa05:42
*** nicholasgoracke has quit IRC05:42
*** Liuqing has quit IRC05:43
*** Liuqing has joined #openstack-qa05:44
*** greghayn1 has joined #openstack-qa05:57
*** greghaynes has quit IRC05:58
*** greghayn1 is now known as greghaynes05:58
*** greghaynes has quit IRC05:59
*** maht has quit IRC06:00
*** greghaynes has joined #openstack-qa06:00
*** maht has joined #openstack-qa06:00
*** greghaynes has quit IRC06:05
*** greghaynes has joined #openstack-qa06:06
openstackgerritPiyush Pathak proposed openstack/tempest: Make v3 update_user_password use **kwargs  https://review.openstack.org/25341906:06
*** gamado has joined #openstack-qa06:07
openstackgerritJacky_lei_zhang proposed openstack/tempest: Make types_client use **kwargs  https://review.openstack.org/25022806:08
*** jacky_zhang has joined #openstack-qa06:09
jacky_zhanghi oomichi ylobankov please review:https://review.openstack.org/#/c/250171/ and https://review.openstack.org/#/c/254127/ if you have time,thanks06:12
*** zhangjn has quit IRC06:30
*** _nadya_ has joined #openstack-qa06:33
*** zhangjn has joined #openstack-qa06:34
*** vgridnev has joined #openstack-qa06:36
openstackgerritRyota MIBU proposed openstack/tempest: add client_manager_class param to BaseTestCase  https://review.openstack.org/25516106:37
*** hitalia has joined #openstack-qa06:38
oomichijacky_zhang: +W for both, thanks06:39
*** gamado has quit IRC06:45
openstackrecheckopenstack/tempest change: https://review.openstack.org/254010 failed because of: gate-tempest-dsvm-ceilometer-mysql-neutron-full: https://bugs.launchpad.net/bugs/134961706:46
openstackLaunchpad bug 1349617 in OpenStack Compute (nova) "SSHException: Error reading SSH protocol banner[Errno 104] Connection reset by peer" [Undecided,Incomplete]06:46
jacky_zhangoomichi, Thanks for your time06:48
*** neeti has joined #openstack-qa06:49
openstackgerritGhanshyam Mann proposed openstack/tempest: Makes microversions config option clear about 'None'  https://review.openstack.org/25338006:51
openstackgerritGhanshyam Mann proposed openstack/tempest: Add compute client base class for microversion support  https://review.openstack.org/24234606:51
openstackgerritGhanshyam Mann proposed openstack/tempest: Add logic to select the request microversion  https://review.openstack.org/24443906:51
openstackgerritGhanshyam Mann proposed openstack/tempest: Add support of schema versioning for microversion  https://review.openstack.org/24497406:52
openstackgerritGhanshyam Mann proposed openstack/tempest: Add tests for Nova microversion v2.2  https://review.openstack.org/24499606:52
*** sree has quit IRC06:53
*** sree has joined #openstack-qa06:54
*** zhangjn has quit IRC06:54
*** armax has quit IRC06:57
*** gamado has joined #openstack-qa06:58
*** sree has quit IRC06:58
*** jacky_zhang has quit IRC06:59
*** jacky_zhang has joined #openstack-qa07:00
*** itzikb has joined #openstack-qa07:06
*** zhangjn has joined #openstack-qa07:06
*** zhangjn has quit IRC07:07
*** markvoelker has joined #openstack-qa07:08
*** flwang1 has joined #openstack-qa07:09
*** rcernin has joined #openstack-qa07:11
*** markvoelker has quit IRC07:13
openstackgerritDavanum Srinivas (dims) proposed openstack/tempest: Remove the ec2 api tests from tempest  https://review.openstack.org/22273707:18
*** sree has joined #openstack-qa07:20
*** hitalia has quit IRC07:21
*** zhangjn has joined #openstack-qa07:22
*** sree has quit IRC07:24
*** hitalia has joined #openstack-qa07:26
*** dims_ has joined #openstack-qa07:27
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Remove duplicated wait_for_resource_deletion()  https://review.openstack.org/25570207:32
*** bochi-michael has joined #openstack-qa07:33
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Make server action methods[f-l] use **kwargs  https://review.openstack.org/25511907:36
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Make server action methods[m-z] use **kwargs  https://review.openstack.org/25513807:36
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Make server action methods[a-c] use **kwargs  https://review.openstack.org/25510407:36
*** anshul has joined #openstack-qa07:39
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Make server action methods[f-l] use **kwargs  https://review.openstack.org/25511907:39
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Change docstring of compute client  https://review.openstack.org/25404307:39
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Make live_migrate_server() use common method  https://review.openstack.org/25507807:39
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Make server action methods[m-z] use **kwargs  https://review.openstack.org/25513807:39
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Make server action methods[a-c] use **kwargs  https://review.openstack.org/25510407:39
*** maht has quit IRC07:40
*** dwalleck has quit IRC07:41
*** _nadya_ has quit IRC07:41
*** _nadya_ has joined #openstack-qa07:43
*** safchain has joined #openstack-qa07:44
*** salv-orl_ has quit IRC07:47
*** _nadya_ has quit IRC07:48
openstackgerritSergey Nikitin proposed openstack/tempest: WIP: Add tests for API microversion with instance tags  https://review.openstack.org/23317607:50
*** nicholasgoracke has joined #openstack-qa07:54
*** nicholasgoracke has quit IRC07:58
dmelladohi oomichi gmann, morning08:00
dmelladodo we have a meeting today? I couldn't see the agenda08:00
dmellado+ also I'd like to discuss about dropping javelin off tempest08:01
*** sree has joined #openstack-qa08:02
dmelladoas from my chat with sdague it isn't used at all anymore, even in the grenade gates08:02
*** sree_ has joined #openstack-qa08:02
*** sree_ is now known as Guest9790608:03
*** peterstac has quit IRC08:04
*** dansmith has quit IRC08:05
*** jgriffith has quit IRC08:05
*** sirushti has quit IRC08:05
*** sree has quit IRC08:06
openstackrecheckConsole logs not available after 13:24s for gate-tempest-dsvm-neutron-full-liberty 251312,4,91f9bd808:06
*** dansmith has joined #openstack-qa08:07
*** dansmith is now known as Guest1777908:07
*** zhangjn has quit IRC08:08
*** shausy has joined #openstack-qa08:09
*** hitalia has quit IRC08:10
*** jgriffith has joined #openstack-qa08:11
*** sirushti has joined #openstack-qa08:11
*** peterstac has joined #openstack-qa08:11
gmanndmellado: yea we have08:11
dmelladogmann: just saw your mail ;)08:11
*** zhangjn has joined #openstack-qa08:11
dmelladolet's discuss javelin in the meeting later too08:11
gmanndmellado: yea, javelin is not used in grenade now.08:11
gmanndmellado: yea i added that in agenda08:11
dmelladomaybe we should just drop it08:12
gmanndmellado: yea, lets discuss in meeting08:13
*** yamahata has quit IRC08:14
openstackgerritMerged openstack/qa-specs: List Plugins  https://review.openstack.org/24757508:23
*** aopincar has joined #openstack-qa08:28
*** dwalleck has joined #openstack-qa08:30
openstackrecheckConsole logs not available after 13:39s for gate-tempest-dsvm-neutron-full 255161,3,a3195c708:30
oomichidmellado: morning08:31
oomichidmellado: I cannot make today meeting, so gmann can lead it today08:31
*** grafuls has joined #openstack-qa08:31
dmelladooomichi: morning, sure ;)08:31
*** oomichi is now known as oomichi_away08:32
openstackgerritWei Liu proposed openstack/tempest: Add 3 negative test cases for dientity v3 role  https://review.openstack.org/25572508:32
*** oomichi_away has quit IRC08:32
*** e0ne has joined #openstack-qa08:32
*** vgridnev has quit IRC08:36
*** _nadya_ has joined #openstack-qa08:39
*** ifarkas has joined #openstack-qa08:39
*** ifarkas has quit IRC08:39
*** ifarkas has joined #openstack-qa08:40
ylobankovhi dmellado. I will take a look at your patch today.08:41
dmelladoylobankov: thanks! ;)08:41
dmelladoit should be ok now, but I'd like to talk about the javelin in the meeting08:41
dmelladofeel free to join ;)08:41
*** vgridnev has joined #openstack-qa08:42
*** shardy has joined #openstack-qa08:43
*** jlanoux has joined #openstack-qa08:46
*** salv-orlando has joined #openstack-qa08:48
*** sshnaidm has joined #openstack-qa08:48
*** vgridnev has quit IRC08:48
*** kbaikov has quit IRC08:50
*** e0ne has quit IRC08:52
*** jordanP has joined #openstack-qa08:52
openstackgerritGhanshyam Mann proposed openstack/tempest: Make volume backups_client to use **kwargs  https://review.openstack.org/25574108:52
*** salv-orlando has quit IRC08:52
*** apevec has joined #openstack-qa08:53
*** apevec has quit IRC08:53
*** apevec has joined #openstack-qa08:53
*** flwang1 has quit IRC08:53
openstackrecheckConsole logs not available after 13:27s for gate-tempest-dsvm-full-ceph 246337,4,e0a93e908:55
*** gszasz has joined #openstack-qa08:56
*** kbaikov has joined #openstack-qa08:58
*** piyush_ has joined #openstack-qa08:58
gmannQA meeting time...09:00
*** gszasz has quit IRC09:02
*** gszasz has joined #openstack-qa09:04
*** msno has joined #openstack-qa09:04
msnoHi Guyz.. one of my tempest test is failing with 500 error code.09:05
msnoi am using HP helion version 2 .. based on Kilo09:05
msnotempest.api.image.v2.test_images.BasicOperationsImagesTest09:05
*** aopincar has quit IRC09:06
*** drptbl has joined #openstack-qa09:07
msnocan someone give me a pointer if its a glance issue OR swift09:08
msnohttp://paste.openstack.org/show/481430/09:08
*** maht has joined #openstack-qa09:08
openstackrecheckConsole logs not available after 13:30s for gate-tempest-dsvm-full-ceph 253859,3,269678909:09
*** markvoelker has joined #openstack-qa09:09
*** jamielennox is now known as jamielennox|away09:09
*** hoangcx has joined #openstack-qa09:09
*** gfidente has joined #openstack-qa09:10
*** gfidente has quit IRC09:10
*** gfidente has joined #openstack-qa09:10
*** hoangcx has left #openstack-qa09:10
*** tochi has quit IRC09:12
*** shausy has quit IRC09:12
*** shausy has joined #openstack-qa09:13
jordanPmsno, glance tests in Tempest are not 100% "interoperable"09:13
*** markvoelker has quit IRC09:14
jordanPthey don't pass on all and every cloud distributio09:14
msnojordanP, only this particular test is failing09:15
*** gfidente has quit IRC09:16
*** gsagie has joined #openstack-qa09:17
gsagieHello, i want to use gate tests that uses openstack neutron client, what is the best way to retrieve the username/password and auth url to use?09:17
gsagieor should i just put them hard coded, (i saw in the logs secretadmin/secretpass are used)09:18
msnoalso .. almopst all my swift test is failing with the following message09:19
msnotempest.exceptions.Conflict: An object with that identifier already exists09:20
msnoDetails: An object with that identifier already exists09:20
msnoDetails: <html><h1>Conflict</h1><p>There was a conflict when trying to complete your request.</p></html>09:20
msnoany pointers please09:20
openstackrecheckConsole logs not available after 13:24s for gate-tempest-dsvm-postgres-full 244996,12,2fdf83a09:22
*** hogepodge has quit IRC09:26
*** gfidente has joined #openstack-qa09:28
*** gfidente has quit IRC09:28
*** gfidente has joined #openstack-qa09:28
*** hogepodge has joined #openstack-qa09:28
*** flwang1 has joined #openstack-qa09:30
*** openstackgerrit has quit IRC09:32
*** openstackgerrit has joined #openstack-qa09:32
*** flwang1 has quit IRC09:36
openstackrecheckConsole logs not available after 13:28s for gate-tempest-dsvm-ironic-agent_ssh 222737,9,d45585109:36
*** apevec has quit IRC09:37
*** neeti has quit IRC09:37
*** gszasz has quit IRC09:37
*** hichihara has quit IRC09:40
openstackgerritlyanchih proposed openstack/tempest-lib: volumes_links attribute not allowd in volume list  https://review.openstack.org/25576009:44
msnoguyz .. this looks like the issue ..https://bugs.launchpad.net/fuel/+bug/143635209:46
openstackLaunchpad bug 1436352 in Fuel for OpenStack 6.0.x "Glance OSTF test create and delete image v2 was failed" [Critical,Invalid] - Assigned to Mike Fedosin (mfedosin)09:46
*** anshul has quit IRC09:47
msnoglance seems to be trying to delete the image before the swift container is empty09:47
msnois there any timeoiut alue i can give in tempest.conf OR glance conf file ..09:47
msnoto oevrcome this09:47
*** jaypipes has joined #openstack-qa09:49
*** ChanServ sets mode: +o jaypipes09:49
*** gszasz has joined #openstack-qa09:49
openstackrecheckConsole logs not available after 13:24s for gate-grenade-dsvm-multinode 208794,13,d0df81609:50
*** vgridnev has joined #openstack-qa09:50
*** e0ne has joined #openstack-qa09:51
*** cdent has joined #openstack-qa09:53
*** gamado has quit IRC09:53
*** obutenko has joined #openstack-qa09:53
*** 64MAADBY3 has joined #openstack-qa09:53
*** 18WABEBTZ has joined #openstack-qa09:53
*** salv-orlando has joined #openstack-qa09:53
*** 64MAADBY3 has quit IRC09:55
*** gsagie has left #openstack-qa09:59
*** sree has joined #openstack-qa09:59
*** neeti has joined #openstack-qa10:01
*** anshul has joined #openstack-qa10:02
*** dwalleck has quit IRC10:03
*** Guest97906 has quit IRC10:03
gmannandreaf: hi10:03
*** aopincar has joined #openstack-qa10:03
andreafgmann: hi10:03
gmannandreaf: can we see the tempest conf file also for those job ?10:03
openstackrecheckConsole logs not available after 13:28s for gate-tempest-dsvm-postgres-full-kilo 255078,2,2dfb86110:04
andreafgmann: no, at the moment is only test result data10:04
gmannandreaf: as you mentioned  pre proc account but i did not find :)10:04
gmannandreaf: ok10:04
openstackrecheckopenstack/tempest change: https://review.openstack.org/250171 failed gate-grenade-dsvm-multinode in the gate queue with an unrecognized error10:04
andreafthe job is called test-accounts10:04
gmannandreaf: i did not get pre prov account means10:04
andreafgmann: http://status.openstack.org/openstack-health/#/job/periodic-tempest-dsvm-full-test-accounts-master10:04
gmannwhere i can see10:04
* gmann checking10:05
andreafgmann: I mean using the pre-provisioned credentials provider, formerly know as test accounts :)10:05
gmannandreaf: oh got it :)10:05
openstackgerritJordan Pittier proposed openstack-dev/devstack: Enable volume manage/unmanage test for Cinder LVM  https://review.openstack.org/25205610:06
andreafgmann: we run two periodic jobs periodic-tempest-dsvm-full-test-accounts-master and periodic-tempest-dsvm-neutron-full-test-accounts-master and we also have experimental jobs10:06
gmannandreaf:  yea10:06
andreafgmann: but we cannot really switch those to be voting jobs until we sort those object store failures out10:06
gmannandreaf: yea that true10:07
gmannandreaf: last question, at the end we will be able to see all logs failure_success and all configuration from dashboard right?10:07
andreafgmann: that was on the original plan / spec, yes - I would like to see that as it will make a nice troubleshooting tooll10:08
gmannandreaf: yea it will be great and easy for debugging too10:08
*** hop|2 has joined #openstack-qa10:09
*** 18WABEBTZ has quit IRC10:09
gmannandreaf:  it will help while reviewing also about some experimental failure etc.10:09
gmannandreaf: Thanks a lot for your time.10:09
andreafgmann: indeed, that's the idea10:09
andreafgmann: np10:10
jordanPgmann, about https://review.openstack.org/#/c/254864/4/tempest/services/volume/base/base_qos_client.py,cm . If I go for  {'keys': kwargs} then I won't use **kwargs but  **args. Because the 'keys' key expect a list not a dict10:11
jordanP(brb coffee=10:12
*** k4n0 has joined #openstack-qa10:15
obutenkohi! review please - https://review.openstack.org/#/c/252964/10:15
*** k4n0 has quit IRC10:15
openstackrecheckConsole logs not available after 13:34s for gate-tempest-dsvm-neutron-full-kilo 255702,1,1c0832110:18
*** Liuqing has quit IRC10:19
*** erlon has joined #openstack-qa10:21
*** sree has quit IRC10:21
*** sree has joined #openstack-qa10:22
*** markvoelker has joined #openstack-qa10:25
*** sree has quit IRC10:26
*** rbak_ has joined #openstack-qa10:26
*** rbak has quit IRC10:28
*** markvoelker has quit IRC10:29
*** dtantsur|afk is now known as dtantsur10:30
openstackrecheckConsole logs not available after 13:36s for gate-tempest-dsvm-neutron-full-kilo 242346,13,3d827f110:31
jordanPjlanoux, you are at 8 recheck in a row !10:32
jordanPnew record !10:32
dmelladolol10:37
dmellado8 rechecks?10:37
dmelladoand I was complaning for three!10:38
*** zhangjn has quit IRC10:38
*** _nadya_ has quit IRC10:39
*** maht has quit IRC10:39
*** vgridnev has quit IRC10:40
*** vgridnev_ has joined #openstack-qa10:40
*** _nadya_ has joined #openstack-qa10:41
*** Liuqing has joined #openstack-qa10:42
*** maht has joined #openstack-qa10:42
openstackrecheckConsole logs not available after 13:29s for gate-grenade-dsvm-multinode 251312,4,0bb632010:46
jlanouxjordanP: Yeah - I'm quite annoyed by that...10:51
openstackgerritMarian Horban proposed openstack/tempest-lib: Added processing /compute URL for getting list of versions  https://review.openstack.org/24581510:51
jlanouxif at least there was some kind of consistent in that...10:51
jlanoux*consustency10:52
jlanoux*consistency10:52
*** aix has joined #openstack-qa10:54
*** jaypipes has quit IRC10:55
*** dims_ has quit IRC11:04
*** _nadya_ has quit IRC11:04
openstackrecheckConsole logs not available after 13:29s for gate-grenade-dsvm-multinode 253444,8,a2b03d311:05
*** binbincong has left #openstack-qa11:06
*** tosky has joined #openstack-qa11:06
*** binbincong has joined #openstack-qa11:08
*** SridharG has quit IRC11:12
dmelladojlanoux: good luck ;)11:14
dmelladoit's quite irritating, tbh. I even found this https://github.com/smerritt/gerrit-auto-recheck/blob/master/auto-recheck.py11:14
dmelladoand was thinking about adapting it xD11:14
jlanoux:) thanks dmellado!11:14
dmelladonp jlanoux ;)11:14
jlanouxlol11:14
*** yamamoto has quit IRC11:15
dmelladojlanoux: if you want to laugh at me my gf asked me 'what's this 'recheck' that you're always typing?'11:15
jlanouxLOL!11:16
*** aysyd has joined #openstack-qa11:18
*** cdent has quit IRC11:18
openstackrecheckConsole logs not available after 13:38s for gate-nova-pep8 202655,22,b06c05911:20
openstackgerritWei Liu proposed openstack/tempest: Add 3 negative test cases for dientity v3 role  https://review.openstack.org/25572511:25
*** aopincar has quit IRC11:28
*** lucas-dinner is now known as lucasagomes11:28
*** zhangjn has joined #openstack-qa11:31
jordanPauto-recheck.py is a shame11:33
jordanPthis is not how we can make openstack better and the gate more stable11:34
openstackrecheckConsole logs not available after 13:28s for gate-cinder-python27 250220,7,334b3cd11:34
*** mwagner_lap has quit IRC11:34
openstackgerritAndrea Frittoli proposed openstack/tempest: Test change to debug lp1524717  https://review.openstack.org/25581511:36
*** vgridnev_ has quit IRC11:45
*** vgridnev has joined #openstack-qa11:45
*** zhangjn has quit IRC11:45
openstackrecheckConsole logs not available after 13:43s for gate-nova-pep8 202653,23,ecdb44c11:48
*** sree has joined #openstack-qa11:54
*** sree has quit IRC11:58
dmelladojordanP: :) +1 on that12:02
dmelladohappily we should make the gate completely stable12:02
openstackrecheckConsole logs not available after 13:35s for gate-tempest-dsvm-full-ceph-src-glance_store 251211,6,ed41b6d12:05
*** cdent has joined #openstack-qa12:07
openstackgerritMerged openstack/tempest: [V3] Rename get_policy to show_policy  https://review.openstack.org/25412712:07
openstackgerritMerged openstack/tempest: [V3] Rename get_policy to show_policy  https://review.openstack.org/25412712:07
*** _nadya_ has joined #openstack-qa12:10
*** _nadya_ has quit IRC12:11
*** sree has joined #openstack-qa12:12
*** aix has quit IRC12:14
openstackgerritMerged openstack/tempest: Fix T110 violation for database client  https://review.openstack.org/25401012:17
openstackgerritMerged openstack/tempest: Makes microversions config option clear about 'None'  https://review.openstack.org/25338012:21
*** salv-orlando has quit IRC12:22
*** eliqiao has joined #openstack-qa12:23
openstackgerritMerged openstack/tempest: Make live_migrate_server() use common method  https://review.openstack.org/25507812:23
openstackrecheckConsole logs not available after 13:35s for gate-tempest-dsvm-neutron-full 254043,6,771367612:24
openstackgerritPiyush Pathak proposed openstack/tempest: Make add_dhcp_agent_to_network  use **kwargs  https://review.openstack.org/25583912:25
*** weshay_xchat has joined #openstack-qa12:25
*** markvoelker has joined #openstack-qa12:26
*** zhangjn has joined #openstack-qa12:29
*** rossella_s has quit IRC12:30
*** markvoelker has quit IRC12:30
*** rossella_s has joined #openstack-qa12:30
piyush_Hi Gmann:12:33
piyush_This is regarding https://review.openstack.org/#/c/254864/4/tempest/services/volume/base/base_qos_client.py12:33
*** gamado_ has joined #openstack-qa12:36
openstackrecheckConsole logs not available after 13:44s for gate-tempest-dsvm-ironic-agent_ssh 250171,13,0f5e84d12:38
*** weshay_xchat is now known as weshay12:39
openstackgerritMerged openstack/tempest: Making names of Cinder client classes consistent  https://review.openstack.org/25246712:45
*** openstackgerrit has quit IRC12:47
*** openstackgerrit has joined #openstack-qa12:48
*** jacky_zhang has quit IRC12:50
openstackrecheckConsole logs not available after 14:14s for gate-tempest-dsvm-nova-wsgi-full 227278,19,01d3b9f12:52
*** 7F1AA6H41 has joined #openstack-qa12:52
*** aix has joined #openstack-qa12:55
*** notmyname has quit IRC12:57
*** dmellado has quit IRC12:57
*** crinkle has quit IRC12:57
*** notmyname has joined #openstack-qa12:57
*** dmellado has joined #openstack-qa12:57
*** crinkle has joined #openstack-qa12:58
*** yamamoto has joined #openstack-qa12:59
*** yamamoto_ has joined #openstack-qa13:01
*** gamado_ has quit IRC13:04
*** yamamoto has quit IRC13:05
openstackrecheckConsole logs not available after 13:48s for experimental-tempest-dsvm-multinode-full-dibtest 252506,3,a43336213:06
*** mwagner_lap has joined #openstack-qa13:06
*** markvoelker has joined #openstack-qa13:08
*** yamamoto_ has quit IRC13:14
*** yamamoto has joined #openstack-qa13:15
openstackrecheckConsole logs not available after 13:56s for gate-nova-pep8 202648,25,b5e637113:20
*** piyush_ has quit IRC13:26
*** mriedem_away is now known as mriedem13:26
*** jaypipes has joined #openstack-qa13:28
*** ChanServ sets mode: +o jaypipes13:28
*** jaypipes has quit IRC13:28
*** neeti has quit IRC13:31
openstackrecheckConsole logs not available after 14:28s for gate-tempest-dsvm-neutron-full-kilo 253444,8,424d5ef13:34
*** regXboi has joined #openstack-qa13:38
*** dims has joined #openstack-qa13:43
*** cdent has quit IRC13:45
*** apevec has joined #openstack-qa13:45
*** apevec has quit IRC13:45
*** apevec has joined #openstack-qa13:45
openstackgerritJim Rollenhagen proposed openstack-dev/devstack: Ironic: add flag for using plugin  https://review.openstack.org/25587813:47
*** bochi-michael has quit IRC13:47
jrollsdague: ^ so it begins13:48
openstackrecheckConsole logs not available after 14:00s for gate-nova-docs 255796,1,02d15b013:48
jrollsdague: that topic has ironic patches too, let me know if that flag to transition is insane :)13:48
*** dims has quit IRC13:48
sdaguejroll: seems good to me13:51
*** zhiyan has quit IRC13:51
jrollcool, thanks13:52
*** zhiyan has joined #openstack-qa13:53
openstackgerritDaniel Mellado proposed openstack/tempest: Split out keystone tenant client  https://review.openstack.org/24817013:57
openstackgerritDaniel Mellado proposed openstack/tempest: Split users_client from keystone client v2.  https://review.openstack.org/25538513:57
openstackgerritDaniel Mellado proposed openstack/tempest: Split out roles client from keystone identity client  https://review.openstack.org/25427413:57
*** openstackstatus has quit IRC13:57
*** dims_ has joined #openstack-qa13:57
openstackgerritJim Rollenhagen proposed openstack-dev/devstack: Fix override-defaults in plugin docs  https://review.openstack.org/25588413:58
jrolleasiest doc review ever ^13:58
*** ansiwen has quit IRC13:58
*** sc68cal has quit IRC13:58
*** ansiwen has joined #openstack-qa13:59
*** 7F1AA6H41 has quit IRC14:00
*** sc68cal has joined #openstack-qa14:01
*** sc68cal has quit IRC14:01
*** sc68cal has joined #openstack-qa14:01
openstackrecheckConsole logs not available after 13:57s for experimental-tempest-dsvm-multinode-full-dibtest 252283,10,e66ce4914:02
openstackgerritJim Rollenhagen proposed openstack-dev/devstack: Ironic: add flag for using plugin  https://review.openstack.org/25587814:03
*** dpaterson has joined #openstack-qa14:05
*** tnguyen1 has joined #openstack-qa14:08
openstackgerritMartin Hickey proposed openstack-dev/devstack: Neutron LBaaS: Use generated configuration files if available  https://review.openstack.org/25300614:10
*** sree has quit IRC14:12
*** cdent has joined #openstack-qa14:14
openstackrecheckConsole logs not available after 14:37s for gate-tempest-dsvm-ceilometer-mysql-neutron-full 252862,4,9e24de114:17
*** yamamoto has quit IRC14:17
*** yamamoto has joined #openstack-qa14:20
*** yamamoto has quit IRC14:22
*** yamamoto has joined #openstack-qa14:24
*** yamamoto has quit IRC14:26
openstackgerritJim Rollenhagen proposed openstack-dev/devstack: Remove ironic code from tree  https://review.openstack.org/25589814:27
*** rbak_ has quit IRC14:30
*** salv-orlando has joined #openstack-qa14:30
openstackrecheckConsole logs not available after 13:56s for gate-nova-pep8 201606,20,a38c31e14:31
*** msno has quit IRC14:31
*** ajo has joined #openstack-qa14:31
*** lucasagomes is now known as lucas-hungry14:35
*** Guest17779 is now known as dansmith14:36
*** dansmith is now known as Guest1812414:37
*** Guest18124 is now known as dansmith14:37
*** yamamoto has joined #openstack-qa14:38
*** dkranz has joined #openstack-qa14:39
*** zhangjn has quit IRC14:39
*** Poornima has quit IRC14:41
openstackgerritJim Rollenhagen proposed openstack-dev/devstack: Remove ironic code from tree  https://review.openstack.org/25589814:45
*** shausy has quit IRC14:46
jordanPgmann, you here ?14:46
*** nicholasgoracke has joined #openstack-qa14:46
regXboimtreinish: ping on two things :)14:47
openstackrecheckConsole logs not available after 14:01s for gate-nova-python34 224726,10,18ca95b14:48
*** mtanino has joined #openstack-qa14:48
*** salv-orl_ has joined #openstack-qa14:49
*** salv-orlando has quit IRC14:51
*** mmedvede has quit IRC14:53
*** gszasz has quit IRC14:53
*** dpaterson has quit IRC14:54
*** mmedvede has joined #openstack-qa14:54
*** j_king_ is now known as j_king14:56
*** boris-42_ has joined #openstack-qa14:59
*** itzikb has quit IRC15:00
*** amotoki has quit IRC15:02
openstackrecheckConsole logs not available after 14:08s for gate-tempest-dsvm-full-ceph 209581,28,52730ed15:02
openstackgerritJim Rollenhagen proposed openstack-dev/devstack: Remove ironic code from tree  https://review.openstack.org/25589815:11
*** rbak has joined #openstack-qa15:15
openstackrecheckConsole logs not available after 15:22s for gate-tempest-dsvm-full 224759,8,6584fd315:18
*** rbrndt has joined #openstack-qa15:21
mtreinishregXboi: what's up?15:22
*** zz_dimtruck is now known as dimtruck15:22
openstackgerritJim Rollenhagen proposed openstack-dev/devstack: Remove ironic code from tree  https://review.openstack.org/25589815:23
regXboimtreinish: (1) what's the possibility of getting an instance the dashboard to work on check pipeline data?15:23
jrollsdague: turns out the plugin is already enabled in project-config, just doesn't exist (afaict) so no need for that flag15:23
regXboimtreinish: (2) I'm trying to run down what appears to be a failure in volume_backed_live_migration - I thought it might be a bug in the tempest test, but now I'm no longer thinking so15:24
mtreinishregXboi: well if we wanted to do it as a separate instance it would require a second subunit2sql db and some modifications to the gearman worker to write data to it15:25
*** alyson_ has joined #openstack-qa15:25
mtreinishit wouldn't be that difficult, but I've been thinking about the best way to incorporate some of that data15:26
mtreinishbecause there are certain jobs on check that tracking with openstack-health would be good15:26
regXboimtreinish: I only ask after spending over an hour today determining what tests have been the ones to fail most frequently in the last seven days for two neutron jobs that run in the check pipeline15:27
regXboithe dashboard would have made that a few minute proposition15:27
mtreinishyep, I agree15:27
obutenkoHi! review please - https://review.openstack.org/#/c/252964/15:27
regXboinow of course, figuring out *why* the job failed is a whole other kettle of fish15:28
openstackgerritJordan Pittier proposed openstack/tempest: Make volume_qos_client use **kwargs  https://review.openstack.org/25486415:28
mtreinishregXboi: I mean I'm fine with the 2 dashboard approach 1 for gate/periodic and 1 for everything else15:28
mtreinishI'm just wondering if we can do it more cleverly :)15:28
regXboimtreinish: ack - now that the flea is in your ear, I'm good :)15:28
mtreinishas for the test did you have a specific link to a failure you were looking at?15:29
*** pglass has joined #openstack-qa15:31
openstackrecheckConsole logs not available after 13:59s for gate-horizon-pep8 252488,7,b75e90115:32
*** gszasz has joined #openstack-qa15:35
clarkbmtreinish libvert is having unexpected errors during live migration. regXboi and I were discussing in -infra15:38
mtreinishclarkb: ah ok15:38
clarkbhttp://logs.openstack.org/17/255217/5/check/gate-tempest-dsvm-neutron-dvr-multinode-full/15995d2/logs/ that job15:38
openstackgerritAlexander Schmidt proposed openstack-dev/devstack: Add distro support for KVM for IBM z Systems  https://review.openstack.org/25247415:39
regXboimtreinish, clarkb: sorry - I'm over in nova as we speak asking there15:39
* regXboi is bouncing between too many channels15:39
jordanPmtreinish, hi. i think you can now reconsider your -2 on https://review.openstack.org/#/c/221487 The test can now pass in the Gate (see depends-on changes)15:40
regXboilogstash shows these as sporadically causing multinode jobs to fail, and the only commonality I found was the ovh cloud15:40
mtreinishregXboi: oh, thats interesting15:40
*** jordanP has quit IRC15:41
openstackgerritJim Rollenhagen proposed openstack-dev/devstack: Remove ironic code from tree  https://review.openstack.org/25589815:41
openstackgerritJim Rollenhagen proposed openstack-dev/devstack: Ironic: add flag for using plugin  https://review.openstack.org/25587815:41
clarkbregXboi right but you need to decouple the known fail from unknown fail15:42
*** jordanP has joined #openstack-qa15:42
regXboiclarkb: ack15:42
clarkbbecause everything prior to yesterday or so wpuld fail on the hostname thing in ovh15:42
*** armax has joined #openstack-qa15:45
mtreinishjordanP: I'd prefer the depends-on to go in the other direction so everything was self testing15:47
mtreinishbut, meh15:47
openstackrecheckConsole logs not available after 13:55s for gate-os-brick-pep8 251266,2,ca99ef315:50
*** armax has quit IRC15:50
*** lucas-hungry is now known as lucasagomes15:51
mtreinishjordanP: I looked at the logs on the devstack change it's still running without manage enabled: http://logs.openstack.org/56/252056/3/check/gate-tempest-dsvm-full/1d17238/logs/tempest_conf.txt.gz15:54
*** armax has joined #openstack-qa15:55
jordanPmtreinish, that's because Eric made a mistake in https://review.openstack.org/#/c/223188/15:56
jordanPhe overwrites what he is trying to set in https://review.openstack.org/#/c/25205615:56
jordanPmy point was, maybe but a -1 and not a -2 to show your good will :)15:57
jordanP*put15:57
mtreinishjordanP: oh, heh. eharney and I were talking about this patch in -cinder last week :)15:57
jordanPahh ok, good !15:58
*** rbrndt has quit IRC16:01
mtreinishandreaf: ooh, look at you using all the new fancy tools in this bug report: https://bugs.launchpad.net/tempest/+bug/1524717 :)16:03
openstackLaunchpad bug 1524717 in tempest "ObjectACL tempest tests are flaky with preprov reds" [Critical,Confirmed] - Assigned to Andrea Frittoli (andrea-frittoli)16:03
*** _nadya_ has joined #openstack-qa16:03
mtreinishandreaf: I especially like using the db to verify the worker breadkdown. I don't think I've done that before16:04
*** dtantsur is now known as dtantsur|brb16:08
*** _nadya_ has quit IRC16:09
*** armax has quit IRC16:11
openstackrecheckConsole logs not available after 13:57s for gate-grenade-dsvm-multinode 250739,10,c197f9e16:12
hop|2jordanP: hi, if you have time, please review https://review.openstack.org/#/c/233176/16:14
*** devananda has quit IRC16:15
*** ccneill has joined #openstack-qa16:16
*** tnguyen1 has quit IRC16:17
*** yamamoto_ has joined #openstack-qa16:17
*** ajmiller has joined #openstack-qa16:18
*** yamamoto has quit IRC16:18
*** hop|2 has quit IRC16:18
regXboimtreinish, clarkb: https://bugs.launchpad.net/nova/+bug/152489816:19
openstackLaunchpad bug 1524898 in OpenStack Compute (nova) "Volume based live migration aborted unexpectedly" [High,Confirmed]16:19
*** e0ne has quit IRC16:20
*** devananda has joined #openstack-qa16:21
*** aix has quit IRC16:22
sc68calmriedem: I could have probably set the tag to q-agt - but anyway I abandoned https://review.openstack.org/#/c/254610/ due to your comments, looks like it might be fixed16:23
mtreinishsc68cal: well if it was a bug in the past it'll be good to add it just to get it off the uncategorized page16:24
sc68calmtreinish: ah16:24
mriedemmtreinish: the query is too generic16:24
mriedemlogstash is down for me now16:24
mtreinishmriedem: I didn't look at the query :)16:24
mtreinishI was jsut saying16:24
clarkbmriedem: its OOM preventing again16:25
mriedemis it just me or does it seem like newer es is worse?16:25
clarkbits not16:26
openstackrecheckConsole logs not available after 14:00s for gate-grenade-dsvm-multinode 255815,1,ed83e3216:26
clarkbthe alternative is actually OOM and take out the cluster for a couple days while it recovers16:26
clarkbwe ran into this a lot way back when16:26
mriedemoh, ok16:26
mtreinishwe just need moar ram :)16:26
mriedemi wasn't sure what had changed16:26
clarkbmtreinish: either that or less data16:26
clarkbmriedem: well now it sets a sane upper threshold it won't go beyond to avoid OOMing16:27
mtreinishclarkb: yeah, we should do a push on decreasing verbosity again16:27
mriedemhmm, do we know how the chatty kathy's are?16:27
mriedem*who16:27
mtreinishclarkb: is neutron still the worst offender?16:27
clarkbCaused by: org.elasticsearch.common.util.concurrent.UncheckedExecutionException: org.elasticsearch.common.breaker.CircuitBreakingException: [FIELDDATA] Data too large, data for [@timestamp] would be larger than limit of [22469214208/20.9gb]16:27
* mtreinish prepares to blame sc68cal and regXboi16:27
clarkbso its really just too many timestmaps16:27
clarkbthats 70% of available ram16:28
clarkbI can bump it again16:28
clarkbI can also delete our oldest index16:28
mriedemdo we have control over the timestamps?16:29
mriedemi guess i don't understand that part16:29
regXboioh?16:29
clarkbmriedem: aiui its saying I need to load all these timestamps into memory to service some query and I can't do that16:29
openstackgerritVitaly Gridnev proposed openstack/tempest: [sahara] adding versions to sahara tempest tests  https://review.openstack.org/25596816:29
mriedemlike a multiline query?16:30
*** rossella_s has quit IRC16:30
clarkbso we have control over how many timestamps are written to the index, but the size of a timestamp should be fixed (even if each one isn't a 64bit integer there is a fixed string size for the data)16:30
regXboimreidem, clarkb: if you can give me ammo with respect to what projects are taking up what space, I can go fight the fight16:30
clarkbmriedem: no like a all time query16:30
openstackgerritVitaly Gridnev proposed openstack/tempest: [sahara] adding new plugin versions to sahara tempest tests  https://review.openstack.org/25596816:30
*** rossella_s has joined #openstack-qa16:30
mriedemok, and cutting down verbosity in the logs doesn't help this?16:31
clarkbmriedem: cutting the number of timestamps would probably help16:31
mriedembecause i know a recent offender https://review.openstack.org/#/c/255404/16:31
clarkbalso I wonder if hte siwtch to much higher precision timestamps in oslo makes any difference16:31
mtreinishmriedem, clarkb: one thing I thought about recently is fix all the deprecation warnings on master: http://logstash.openstack.org/#dashboard/file/logstash.json?query=message:%5C%22deprecated%5C%22%20AND%20loglevel:%5C%22WARNING%5C%22%20AND%20build_branch:%5C%22master%5C%2216:31
mriedemmtreinish: yeah, i've wanted to do that too, but $time16:32
mriedemseems we could do some cleanup in devstack16:32
mtreinishI'll write a ml post about it, it's pretty low hanging fruit16:32
mtreinishso I'm sure somone will step up to help with16:32
clarkbbut basically I think we are right at the edge of our limits cluster size wise and old ES played a little less conservatively16:33
clarkbwhereas new ES is saying "hey you are right at the edge and it scares me"16:33
mriedemES is all grown up now16:33
mriedemES is now voting republican16:33
mriedemrequiring to know a logs religion before it will index it16:34
mriedemetc16:34
clarkbnapkin math says that 75% of memory would just allow those queries to run16:35
clarkb(until we index more and need more memory)16:36
clarkbwe are at 70% right now16:37
EmilienMmtreinish: fyi I don't use javelin anymore (since last year)16:37
EmilienMmhh, since march actually16:37
EmilienMjordanP: ^16:37
sdagueclarkb: what's the internal storage format for @timestamp in ES?16:37
jordanPok, good to know. Thabks !16:37
mtreinishEmilienM: sure, I figured that was the case16:38
openstackgerritVitaly Gridnev proposed openstack/tempest: [sahara] adding new plugin versions to sahara tempest tests  https://review.openstack.org/25596816:38
mtreinishwhich is why I'm fine with deprecating it16:38
clarkbsdague: I don't know16:38
clarkbsdague: I do know that it rejects things it can't parse as a timestamp16:38
clarkbso it is being semi smart about it16:38
EmilienMmtreinish++16:38
sdagueclarkb: right, but I guess the question is if we store the less precise one, does it help?16:39
openstackgerritVitaly Gridnev proposed openstack/tempest: [sahara] adding new plugin versions to sahara tempest tests  https://review.openstack.org/25596816:39
clarkbsdague: thats something to look into, not sure yet16:39
sdaguebecause not having enough space for @timestamp to me just sounds like we've overall got too many rows16:39
clarkbsdague: yes thats basically it16:39
sdagueok, but we're already down to 10 days16:39
clarkband why deleting old indexes alleviates it16:39
sdagueI guess we can cut to 716:39
*** spartacloud has joined #openstack-qa16:39
sdaguebut honestly, even 10 days means we miss a lot of events16:39
openstackrecheckConsole logs not available after 13:57s for gate-tempest-dsvm-full-ceph 249834,12,fc4242616:40
sdagueit would be really good to get back to 1416:40
*** hemnafk is now known as hemna16:40
clarkbif anyone knows where we can find a half a terabyte of ram and 10tb ish of disk we can probably get up to 14 days16:40
sdagueI wonder if we could get a bluebox env that would be less constrained here16:40
sdaguemordred: ^^^16:40
*** sshnaidm has quit IRC16:40
*** tnguyen1 has joined #openstack-qa16:41
clarkbright now we are at 60GB RAM/1TB disk * 6 nodes. 30GB of ram is directly reserved by ES on each host the other 30GB being left to OS caching16:41
clarkbthis 50/50 split comes recommended from ES16:41
clarkbhrm I wonder if I put a single large proxy query node in front of the cluster if that would help16:42
clarkbhave a singel 120GB RAM node with no disk just to deal with query aggregation?16:42
*** rcernin has quit IRC16:42
sdagueyeh, maybe16:43
*** jlanoux has quit IRC16:43
clarkbI am going to delete our oldest index for now (to get us back to working with queries)16:43
mordredsdague, clarkb: talking about getting an env that's bigger for ES?16:47
*** vgridnev has quit IRC16:47
*** vgridnev has joined #openstack-qa16:47
*** vgridnev has quit IRC16:47
clarkbmordred: ya16:47
mordredclarkb: put together some specs and I'll ask around16:48
clarkbmordred: rough numbers is 12TB disk and 512GB of RAM spread across ~6 nodes. But probably shoudl talk to people that have scaled ES a bit more to see what they think16:49
mordredclarkb: so 2TB per node - would it make it better/worse to have 12 machiens with 1TB?16:50
*** spartacloud has quit IRC16:50
clarkbmordred: the problem with 12 machines instead of 6 is that the current fail is we need 22.5GB of RAM just to load our timestamps into memory for queries16:50
clarkbmordred: so there is a scale up factor too16:51
mordredgotcha16:51
mordredso we pay that cost per machine16:51
clarkbya16:51
mordrednod16:51
*** hitalia has joined #openstack-qa16:52
mordredso - for reference purposes16:52
mordredthe bluebox cloud we have right now16:52
mordredhas hypervisors with 251.5GB RAM and 915GB Disk16:53
clarkbbut its possible that we only need a single "query" node that is hug eand can spread the disk out. Also possible that if we shard more aggressively ES can do smart things16:53
*** sabeen has joined #openstack-qa16:53
*** david-lyle has quit IRC16:53
mordredso with the machines we currently have in our posession, we can accomplish the ram-size easily16:54
mordredbut we'd need a cinder to get attached16:55
mordred(basically thinking about what we'd want to request to add to that cloud)16:55
*** sabeen3 has joined #openstack-qa16:55
openstackgerritMartin Hickey proposed openstack-dev/devstack: Neutron LBaaS: Use generated configuration files if available  https://review.openstack.org/25300616:56
clarkbmordred: probably step one is to track down someone that actually knows elasticsearch :) see what they have to say then translate that into cloud needs. But doing that should be doable16:58
*** sabeen has quit IRC16:58
clarkbpleia2: ^ anyone you have met at their conference you think might be open to that?16:58
mordreddoesn't leslie hawthorn work there?16:59
mordredoh - looks like she stopped working there in August16:59
*** gema_ is now known as gema16:59
mordredstill, she might be a good resource to find a resource - I'll poke her real quick16:59
*** gema is now known as Guest6804117:00
*** dtantsur|brb is now known as dtantsur17:01
*** rbrndt has joined #openstack-qa17:01
*** Guest68041 is now known as gema_17:01
* mordred has poked leslie17:02
*** salv-orl_ has quit IRC17:03
*** armax has joined #openstack-qa17:03
pleia2clarkb: not off the top of my head17:03
clarkbcool, let me knw if you need more info or if I need to hop in a new hcannel or something17:03
*** yamahata has joined #openstack-qa17:04
openstackgerritChuck Carmack proposed openstack/tempest: :Add a config option to disable security group usage  https://review.openstack.org/22519917:05
*** spartacloud has joined #openstack-qa17:05
*** dims_ has quit IRC17:06
mordredclarkb: tl;dr on why not expand at rax?17:08
clarkbmordred: quota17:08
mordredah17:09
clarkbwe are already under pressure there and these are very large nodes17:09
clarkb(I think one new machine is enough to get us right near quota limits again)17:09
mordredso we'll be making a request of a provider either way17:09
clarkbI would have to double chekc on what we bumped to17:09
clarkbwe might also be able to convince jroll to onmetal us17:09
jrollohai17:09
clarkbwhich would be neat for other reasons17:09
mordredcan we get the disk we need in onmetal?17:09
clarkbmordred: I think so on the disk flavor17:09
jrollon io flavor yes17:09
jrolland super fast disk17:09
clarkbthere is on flavor that is hella disk17:09
*** spartacloud has quit IRC17:10
mordredjroll: 512G RAM / 12TB disk17:10
jroll2x 1.6tb pci-e flash17:10
jrollnewp :/17:10
mordredis the target17:10
mordredjroll: across 6 machines17:10
clarkbwell we don't need that in one machine17:10
jrollwe don't have a "bundle of spinning rust" flavor17:10
clarkbmordred: dependon on how much ram the on metal nodes use we can probably be as small at 3 nodes?17:10
mordred2x 1.6tb x 6 machines sounds like it would hit it17:10
jeblairjroll: we don't need to raid it so we could use that as 3.2tb, right?17:10
clarkb3.2TB * 3 ~= 10TB its closish17:10
mordredjroll: how much ram is on those machines?17:11
jrolljeblair: correct, they're raw disks17:11
jrollmordred: 128gb17:11
*** ig0r_ has joined #openstack-qa17:11
mordredyeah. so 4 of those sound like they'd do the trick17:11
mordredjroll: you wanted us to use onmetal in the infra control plane, right? :)17:12
*** dims has joined #openstack-qa17:12
jrollone thing to note: some of the root disks in there are super fragile, I wouldn't go write heavy on them (they're 32gb)17:12
jrollsome have new fancy root disks though, that are less fragile17:12
clarkbwe would do almost no writes to the root disks17:12
mordredyh17:12
jrollmordred: I want everyone to use onmetal everywhere :D17:12
jrollclarkb: just keep in mind /var/log etc17:13
mtreinishjroll: if you give it to me for free I'll use it everywhere :)17:13
clarkbfor logs its on the order of 1GB a day maxish17:13
clarkbmaybe my idea of a lot of writes is different than yours :)17:13
jrollclarkb: 3000 p/e cycle rating17:13
jrollthey're fragile, trust me :/17:14
jrollit's a thing we're working on17:14
*** drptbl has quit IRC17:15
openstackgerritChuck Carmack proposed openstack/tempest: Add a config option to disable security group usage  https://review.openstack.org/22519917:16
*** dims has quit IRC17:16
*** dims has joined #openstack-qa17:17
jeblairjroll: did you buy a pallet of deskstars "new in box" off ebay? :)17:17
jrolljeblair: that may have been a better idea :P17:23
jeblairha17:24
jrollthey really aren't that terrible, you just have to know they could fail and do backups properly and whatnot17:24
*** dims has quit IRC17:24
openstackgerritSean M. Collins proposed openstack-dev/devstack: Fix tunneling support for linuxbridge-agent  https://review.openstack.org/25600017:25
openstackgerritSean M. Collins proposed openstack-dev/devstack: Fix tunneling support for linuxbridge-agent  https://review.openstack.org/25600017:26
clarkbjroll: so is using ~4 io flavor onmetal nodes a possibility for the elasticsearch cluster? should we keep that in our backpocket as we figure out the scaling issues/solutions?17:30
jrollclarkb: I don't see why not, unless billing tries to raise hell about it. default quota is 10 instances per onmetal flavor17:31
jrollso you're well within that17:31
clarkbcool thanks for the info17:34
openstackgerritDoug Wiegley proposed openstack-infra/devstack-gate: Add neutron-lib repo to list of projects  https://review.openstack.org/25600717:34
*** jordanP has quit IRC17:34
jrollnp17:35
clarkbdougwig: ^ is neutron-lib consumed fromsource or from releases?17:35
*** spartacloud has joined #openstack-qa17:35
clarkbdougwig: I am actually trying to reduce that list as much as possible because many things are ocnsumed from releaeses except on specific jobs. By only adding them to the PROJECTS list on the specific jobs we save quite a bit of time doing git updates and checkouts17:36
*** spartacloud has quit IRC17:37
*** openstackstatus has joined #openstack-qa17:37
*** ChanServ sets mode: +v openstackstatus17:37
*** spartacloud has joined #openstack-qa17:37
*** vgridnev has joined #openstack-qa17:37
dougwigclarkb: let me preface this with a giant *i think*, and whatever we're doing for other libs is fine by me: it will be via release for the projects, though at the same time, it'll be running it's consumers jobs against its own master. i'm fine with setting that per project, though it'll be a lot, and it's tiny.17:39
clarkbthe size is less of an issue as much as just doing git io for every project in every job adds up17:40
clarkbdougwig: by removing the clients by default I was seeing up to 5 minutes shaved off of every job17:41
clarkb(since cleints are installed from pypi mirrors not source on most jobs)17:41
*** weshay has quit IRC17:41
*** spartacloud has quit IRC17:43
dougwigclarkb: i'm fine not putting it in, and fanning it out into the jobs. i'll abandon.17:44
openstackrecheckConsole logs not available after 13:21s for gate-grenade-dsvm 255898,5,5950b6f17:44
clarkbdougwig: cool, we already have a pattern for "run devstack with this lib from source" as a template too. Let me get a link to that17:45
clarkbso you should be able to just add those jobs to neutron-lib so it gets tested against master when changes are made to it17:45
dougwigclarkb: awesome, thank you.17:46
*** weshay_xchat has joined #openstack-qa17:46
*** dims has joined #openstack-qa17:47
*** weshay_xchat is now known as weshay17:47
clarkbdougwig: https://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/devstack-gate.yaml#n116 is the job and in zuul's layout if you add the lib-forward-testing template to a project that test runs against that project17:48
*** nic has joined #openstack-qa17:49
clarkbI should see if  Ican get the change to remove grenade and the clients in17:51
*** Liuqing has quit IRC17:51
dmelladomtreinish: ping re javelin17:51
openstackgerritMerged openstack/tempest: Make argument params of list methods consistent  https://review.openstack.org/25017117:53
*** dims has quit IRC17:53
*** yamamoto_ has quit IRC17:54
*** artom has quit IRC17:55
*** artom has joined #openstack-qa17:55
*** jaypipes has joined #openstack-qa17:57
*** ChanServ sets mode: +o jaypipes17:57
*** dims has joined #openstack-qa17:57
*** drptbl has joined #openstack-qa17:57
openstackrecheckConsole logs not available after 13:22s for gate-horizon-pep8 252488,10,72fdb5d17:58
*** gema_ is now known as gema17:58
dougwigclarkb: rocking, thank you17:58
*** zackf has joined #openstack-qa18:00
*** ifarkas has quit IRC18:00
*** Swami has joined #openstack-qa18:01
*** jaypipes has quit IRC18:02
*** shardy has quit IRC18:05
*** hitalia has quit IRC18:06
*** drptbl has quit IRC18:08
*** dtantsur is now known as dtantsur|afk18:08
*** salv-orlando has joined #openstack-qa18:11
*** pglass has quit IRC18:11
*** dims has quit IRC18:12
*** spartacloud has joined #openstack-qa18:14
*** pglass has joined #openstack-qa18:15
*** zackf has quit IRC18:16
*** spartacloud is now known as zackf18:16
openstackrecheckConsole logs not available after 13:23s for gate-grenade-dsvm-multinode 254428,5,d69e14418:16
*** sabeen3 has quit IRC18:17
*** anshul has quit IRC18:19
*** pglass has quit IRC18:21
*** alan_ has joined #openstack-qa18:23
*** apevec has quit IRC18:26
*** jaypipes has joined #openstack-qa18:28
*** ChanServ sets mode: +o jaypipes18:28
openstackrecheckConsole logs not available after 13:23s for gate-tempest-dsvm-full-ceph 255572,2,fa6dbf318:29
*** alan_ is now known as apevec18:36
*** apevec has quit IRC18:36
*** dims has joined #openstack-qa18:36
*** apevec has joined #openstack-qa18:37
*** apevec has quit IRC18:37
*** apevec has joined #openstack-qa18:37
*** ccneill has quit IRC18:39
*** ccneill has joined #openstack-qa18:40
*** maht has quit IRC18:40
openstackgerritJohn Warren proposed openstack/tempest: Rename references to compute security groups client  https://review.openstack.org/25605018:41
openstackrecheckConsole logs not available after 13:24s for gate-grenade-dsvm-multinode 252474,4,85db50218:43
*** ccneill has quit IRC18:48
mtreinishdmellado: pong18:51
openstackgerritDaniel Mellado proposed openstack/tempest: Split out roles client from keystone identity client  https://review.openstack.org/25427418:56
*** harlowja has quit IRC18:56
openstackrecheckConsole logs not available after 13:24s for gate-tempest-dsvm-neutron-full-non-isolated 248170,22,9b2c9c618:56
*** harlowja has joined #openstack-qa18:56
dmelladomtreinish: ping I'm back too19:01
mtreinishok19:01
mtreinishdmellado: what about javelin did you want to talk about?19:02
*** hitalia has joined #openstack-qa19:02
dmelladowell, basically we were discussing that this morning and that's why I sent the mail to the ML19:02
dmelladoI reverted back the change in https://review.openstack.org/#/c/255163/ so if you could have a look it'd be great19:02
dmelladoalso I wanted to ask how to handle the 'deprecated' process19:03
dmelladowhat should be in that commit?19:03
*** tosky has quit IRC19:03
mtreinishdmellado: I already dropped the -2, I'll look at the patch series later19:03
dmelladomtreinish: thanks19:03
mtreinishdmellado: we just need to emit a warning whenever javelin is invoked that it's deprecated and marked for removal19:03
*** asselin__ has joined #openstack-qa19:04
dmelladomtreinish: I see, so it's just a modification from the javelin file, I'll create it19:04
mtreinishdmellado: we really have to let that sit there for like a cycle before we can remove it from the tree19:04
dmelladothis came around while splitting the keystone client,19:05
*** maht has joined #openstack-qa19:05
dmelladoshouldn't we also change the mock client in the javelin test?19:05
*** pglass has joined #openstack-qa19:05
mtreinishwe can, that's probably good to do to make sure we don't miss it in further client refactors19:05
*** asselin has quit IRC19:05
dmelladocool, then I'll have a look and put in in the patch series19:07
dmelladothanks for your clarifications!19:07
sc68calmtreinish: hey, is there a dashboard for branch health?19:09
sc68calmtreinish: rumor has it I broke stable/liberty19:10
openstackrecheckConsole logs not available after 13:24s for gate-nova-pep8 247692,12,463b27519:10
sc68calmtreinish: with the new linux bridge job voting19:10
mtreinishsc68cal: so there is a patch in progress that gives you that view on the home page: https://review.openstack.org/24045319:11
mtreinishsc68cal: you should be able to manually construct the url for the 2nd page for liberty jobs even if that isn't landed yet19:11
sc68cal"Patch in Merge Conflict" noooooooooooooooooooooooooo19:12
*** e0ne has joined #openstack-qa19:13
mtreinishsc68cal: http://status.openstack.org/openstack-health/#/g/build_branch/stable%252Fliberty19:13
mtreinishI think that's right19:13
*** mriedem is now known as mriedem_haircut19:14
sc68calmtreinish: thanks19:18
mtreinishsc68cal: remember though it doesn't show up on the dashboard if things fail before tempest runs19:19
mtreinishyet...19:19
sc68calmtreinish: gotcha19:20
*** Sam-I-Am has joined #openstack-qa19:20
sc68callooks like we have an APT error that is blocking stuff in stable/liberty19:20
sc68calSam-I-Am and I are poking at it19:20
Sam-I-Amhi19:20
sc68calhttp://logs.openstack.org/00/256000/2/check/gate-grenade-dsvm-neutron/9f59139/logs/grenade.sh.txt.gz#_2015-12-10_18_21_42_89019:21
*** gfidente has quit IRC19:21
*** tnguyen1 has left #openstack-qa19:21
*** tnguyen1 has joined #openstack-qa19:22
mtreinishsc68cal: well that's no good. Do you think it's a mirror sync issue? or do you think a new version is getting pulled in breaking stuffs19:23
openstackrecheckConsole logs not available after 13:22s for gate-nova-python34 254703,5,7f0e70019:23
sc68calmtreinish: it's a grenade job, so my guess is the latter19:23
sc68calSam-I-Am: also check out http://status.openstack.org/openstack-health/#/g/build_branch/stable%252Fliberty19:23
sc68calSam-I-Am: LB job has run 7 times and passed19:24
sc68calon stable/liberty, if I read it right19:24
Sam-I-Amlooking19:24
mtreinishsc68cal: hmm, so kilo devstack is failing on apt19:24
sc68calmtreinish: yep, good point19:25
*** pvaneck has joined #openstack-qa19:26
sc68calmtreinish: so is this what you and mriedem_haircut and others deal with in stable branches? stuff just breaking all the time?19:26
mtreinishsc68cal: http://logstash.openstack.org/#dashboard/file/logstash.json?query=message:%5C%22libffi-dev%20:%20Depends:%20libffi6%5C%2219:26
mtreinishsc68cal: yep, pretty much19:27
mtreinishsc68cal: fwiw, in this case I think it's more than just stable kilo devstack, that logstash query has 96 hits over 7 days19:27
mtreinishmostly on master19:27
Sam-I-Amhmm19:28
sc68calmtreinish: http://img.4plebs.org/boards/tg/image/1396/31/1396319591548.png19:29
mtreinishhaha19:29
Sam-I-Ami love transient problems19:29
sc68calmtreinish: alternatively - http://gunshowcomic.com/64819:30
Sam-I-Ammtreinish: http://logs.openstack.org/00/256000/2/check/gate-grenade-dsvm-neutron/9f59139/logs/old/devstacklog.txt.gz#_2015-12-10_18_21_34_40819:31
mtreinishSam-I-Am: yeah, that looks like the normal mirror sync transient error19:31
mtreinishSam-I-Am, sc68cal: http://status.openstack.org/elastic-recheck/gate.html#140090519:32
Sam-I-Ammtreinish: is there any information you dont have? :)19:32
Sam-I-Amalways impressed at the amount of things available19:33
mtreinishwhich sc68cal has commented on in the past :)19:33
*** cdent has quit IRC19:33
mtreinishhttps://bugs.launchpad.net/openstack-gate/+bug/140090519:33
openstackLaunchpad bug 1400905 in OpenStack-Gate "Hash Sum mismatch on apt mirrors" [Undecided,Confirmed]19:33
mtreinishgranted it was back in april19:33
*** yottatsa has joined #openstack-qa19:33
yottatsahi19:33
sc68calmtreinish: I think yottatsa is looking to add more testing to the neutron ipv6 tests in tempest19:34
sc68calmostly to verify routing between two tenant networks on the ipv6 side19:34
sc68caldo we need a blueprint or will a bug in launchpad suffice19:34
mtreinisha bug is probably fine19:35
yottatsaI'd like to add tempest scenario tests to verify that IPV6 routing is vorking between two networks19:35
mtreinishwe normally don't require a lot of paperwork for adding new tests19:35
yottatsaOk, I'll file a bug19:35
clarkbhas anyone worked on reducing the amount of work the ipv6 tests do that isn't completely necessary?19:35
clarkbmtreinish: ^ I remember you saying a lot of the long runtime in tempest was there19:35
mtreinishclarkb: yeah the ipv6 scenarios eat a lot of time19:36
mtreinishclarkb: http://status.openstack.org/openstack-health/#/job/gate-tempest-dsvm-neutron-full you can sort by runtime19:36
mtreinishclarkb: the only patch I've seen on it so far is from haleyb which just eliminated a bunch of tests19:36
*** jaypipes has quit IRC19:36
mtreinishI'm not sure that's the right approach though19:36
stevemarmriedem_haircut: we need a snazzy before and after pic19:37
openstackrecheckConsole logs not available after 13:22s for gate-cinder-pep8 255947,1,61d74a019:37
clarkbI think the tests were making multiple VMs each time even if tempest could ping directly19:37
mtreinishoh, looks like the numbers on the openstack health page for runtime aren't right. I doubt it takes 4k seconds on avg :)19:37
clarkbso if we could reduce to a single VM and check connectivity except for when testing specific things like network to network routing that would help19:37
mtreinishhttps://review.openstack.org/#/c/239868/19:38
mtreinishclarkb: yeah, that's definitely a good improvement to make19:38
clarkbthats a good question in that change19:38
mtreinishclarkb: it is. I'll defer to armax and others on the value there19:40
mtreinishif it's not necessary I'm fine with wiping out all of those permutations19:40
* armax looks19:40
mtreinishwell, that's just wrong: https://github.com/openstack/openstack-health/blob/master/app/js/controllers/job.js#L8319:45
mtreinishhow did that get through review :)19:45
openstackrecheckConsole logs not available after 13:23s for gate-tempest-dsvm-neutron-full-kilo 255968,4,fb9e04c19:50
*** aysyd has quit IRC19:53
openstackgerritgordon chung proposed openstack-dev/devstack: only set admin_* options for eventlet  https://review.openstack.org/25607819:59
Sam-I-Ammtreinish: worth just rechecking this? https://review.openstack.org/#/c/256000/20:00
*** rcernin has joined #openstack-qa20:01
sc68calI know I had promised to help make the ipv6 tests run faster, but I am so over subscribed it's not funny. So that's why there's been little progress20:02
sc68calI had hoped getting the linux bridge CI voting would help clear my plate20:02
clarkbno worries was just curious if progress had been made (since there was discussion of adding even more tests that will require multiple VMs and likely be slow )20:02
Sam-I-Amclarkb: where is downloadmoretime.com ?20:03
sc68calyottatsa may be able to help, we want to get rid of the ssh-over-ipv4 then do ipv6 between two vm tests20:03
openstackrecheckConsole logs not available after 13:24s for gate-glance-python27 255584,2,8cd5c5c20:04
Sam-I-Amsc68cal: ew, that sounds gross20:04
*** jasonsb has quit IRC20:04
clarkbsc68cal: I think a lot of cases can check tempest to VM then you have a much smaller number of tests that do VM to VM comms to test things like the routing20:04
sc68calwell, tempest assumes floating IP is the only way to access an instance20:04
sc68calclarkb: exactly20:04
clarkbright so there is owrk that would have to be done20:04
clarkbbut shoul dbe doable20:04
*** armax has quit IRC20:09
*** rbak_ has joined #openstack-qa20:11
*** mriedem_haircut has quit IRC20:13
*** gszasz has quit IRC20:14
*** rbak has quit IRC20:15
openstackrecheckConsole logs not available after 13:22s for gate-grenade-dsvm 255518,2,c2c22e720:17
*** mriedem has joined #openstack-qa20:18
*** lucasagomes is now known as lucas-beer20:19
jrollsomeone mind helping me out on this devstack patch? first step in the ironic grenade plugin cluster https://review.openstack.org/#/c/255878/20:22
*** sabeen1 has joined #openstack-qa20:24
*** yottatsa has quit IRC20:28
*** alex_xu has quit IRC20:30
*** rossella_s has quit IRC20:30
*** rossella_s has joined #openstack-qa20:31
openstackrecheckConsole logs not available after 13:24s for gate-nova-pep8 242251,16,3ea3dca20:31
*** alex_xu has joined #openstack-qa20:33
*** lucas-beer has quit IRC20:34
*** dims has quit IRC20:35
*** dims has joined #openstack-qa20:35
*** sabeen3 has joined #openstack-qa20:39
*** sabeen1 has quit IRC20:39
*** lucasagomes has joined #openstack-qa20:40
*** e0ne has quit IRC20:41
*** jasonsb has joined #openstack-qa20:43
*** _nadya_ has joined #openstack-qa20:44
openstackrecheckConsole logs not available after 13:26s for gate-grenade-dsvm-neutron 256000,2,9f5913920:44
*** Swami has quit IRC20:44
mtreinishSam-I-Am: yeah, I'd just recheck it20:51
melwittmtreinish: does adding a skip decorator to the setup_credentials method of a class make tempest skip all the tests in that class?20:57
openstackrecheckConsole logs not available after 13:29s for gate-nova-pep8 250757,8,b6ebfc920:58
*** zackf has quit IRC20:58
mtreinishmelwitt: I would expect it to (although I don't think I've ever done that before) The decorator should raise a skip exception when setup_credentials is called20:58
mtreinishand setup_credentials is called as part of setupClass20:58
mtreinishmelwitt: https://github.com/openstack/tempest/blob/master/tempest/test.py#L236-L26320:59
melwittmtreinish: ah, thank you. so it's indirect. is it better to just add the skip_checks method and check conf and raise in there?21:00
mtreinishmelwitt: what are you looking at?21:01
melwittmtreinish: reviewing this patch https://review.openstack.org/#/c/225199/21/tempest/api/compute/admin/test_security_group_default_rules.py,cm21:01
mtreinishyeah that should just be an if and raise in skip_checks()21:02
mtreinishso should the existing neutron skip decorator21:02
melwittmtreinish: I accidentally did all this work yesterday not knowing someone else had a patch up and I'm looking at differences in what we did. I used skip_checks there but now I see the decorator on setup_credentials does the same thing21:02
melwittokay, good to know21:02
mtreinishI guess it's functionally no different, but we put that phase there to do what the decorator is doing21:03
melwittyeah. in case you can't attach to an existing setup method I suppose21:04
*** zackf has joined #openstack-qa21:07
openstackrecheckConsole logs not available after 13:24s for gate-nova-pep8 255410,6,de2c05a21:11
*** Swami has joined #openstack-qa21:13
*** _nadya_ has quit IRC21:16
*** tnguyen1 has quit IRC21:21
*** yottatsa has joined #openstack-qa21:21
*** yottatsa has quit IRC21:22
*** yottatsa_ has joined #openstack-qa21:23
*** cdent has joined #openstack-qa21:24
openstackrecheckConsole logs not available after 13:24s for gate-nova-python27 255975,1,e07519621:25
openstackgerritxing-yang proposed openstack/tempest: Add tempest tests for Consistency Group  https://review.openstack.org/25221321:25
*** yottatsa_ has quit IRC21:25
*** tsufiev has quit IRC21:28
*** agireud has quit IRC21:31
*** asselin has joined #openstack-qa21:31
*** armax has joined #openstack-qa21:31
*** asselin__ has quit IRC21:32
*** tsufiev has joined #openstack-qa21:32
*** yottatsa has joined #openstack-qa21:37
openstackrecheckConsole logs not available after 13:33s for gate-horizon-npm-run-lint 255854,3,f34a92321:38
*** yottatsa has quit IRC21:40
*** yottatsa has joined #openstack-qa21:41
*** agireud has joined #openstack-qa21:43
*** rbrndt has quit IRC21:43
*** agireud has quit IRC21:48
*** agireud has joined #openstack-qa21:51
*** dimtruck is now known as zz_dimtruck21:52
openstackrecheckConsole logs not available after 13:31s for gate-swift-python34 255233,2,ec82c0421:52
*** Swami has quit IRC21:52
*** yottatsa has quit IRC21:59
openstackgerritMatthew Treinish proposed openstack/openstack-health: Fix mean runtime value on jobs page  https://review.openstack.org/25611221:59
openstackgerritMatthew Treinish proposed openstack/openstack-health: Add skips data to the jobs page  https://review.openstack.org/25611321:59
*** yottatsa has joined #openstack-qa22:00
*** hitalia has quit IRC22:01
*** hitalia has joined #openstack-qa22:05
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck: Add query for oslo.utils netifaces bug 1524991  https://review.openstack.org/25611522:05
openstackbug 1524991 in oslo.utils "moving netifaces to extras in 3.1.0 breaks the world" [Critical,Fix released] https://launchpad.net/bugs/1524991 - Assigned to Joshua Harlow (harlowja)22:05
mriedemmtreinish: ^ for tracking22:05
openstackrecheckConsole logs not available after 13:24s for gate-nova-python27 245153,2,f6aa80f22:05
mriedemto cleanup the uncategorized bugs page i mean22:05
*** maht has quit IRC22:06
*** maht has joined #openstack-qa22:06
mtreinishmriedem: heh, I knew what you meant. +A22:06
*** alex_xu has quit IRC22:07
*** alex_xu has joined #openstack-qa22:09
*** hogepodge has quit IRC22:10
*** jogo has quit IRC22:11
mtreinishandreaf, timothyb89: so I've been playing a bit more with the line graphs, we really need to do something like: http://www.d3noob.org/2014/04/adding-in-zero-values-into-time-series.html to all the graphs22:12
mtreinishI was playing with a historical bar chart format instead of using line and it handles the gaps in the data correctly, but it looks weird22:12
*** hogepodge has joined #openstack-qa22:13
openstackgerritMerged openstack-infra/elastic-recheck: Add query for oslo.utils netifaces bug 1524991  https://review.openstack.org/25611522:13
openstackbug 1524991 in oslo.utils "moving netifaces to extras in 3.1.0 breaks the world" [Critical,Fix released] https://launchpad.net/bugs/1524991 - Assigned to Joshua Harlow (harlowja)22:13
timothyb89mtreinish: that's a good point, some of the charts have been looking a bit funny without that22:13
*** Swami has joined #openstack-qa22:14
mtreinishtimothyb89: is that something you could take a look at? It's stretching my js skills a bit too much22:14
*** jogo has joined #openstack-qa22:14
mtreinishI could try to do it on the rest api side, that wouldn't be too hard. But I'll have to zero pad all the time series we return22:15
timothyb89mtreinish: sure, it doesn't look bad ... probably can't do much today, but I'll put it on my to-do list for tomorrow22:15
mtreinishok cool, thanks22:15
*** moravec has quit IRC22:18
openstackrecheckConsole logs not available after 13:23s for gate-glance-releasenotes 229756,6,15fe0d322:19
*** moravec has joined #openstack-qa22:19
*** moravec has quit IRC22:19
*** moravec has joined #openstack-qa22:20
*** david-lyle has joined #openstack-qa22:20
*** dkranz has quit IRC22:21
*** jamielennox|away is now known as jamielennox22:22
*** moravec1 has joined #openstack-qa22:23
*** openstackrecheck has quit IRC22:24
*** openstackrecheck has joined #openstack-qa22:24
*** yamahata has quit IRC22:24
*** moravec has quit IRC22:24
*** yamahata has joined #openstack-qa22:24
*** moravec1 has quit IRC22:24
*** moravec has joined #openstack-qa22:25
openstackgerritMerged openstack/tempest: Remove pre-request-validation from v2 image_client  https://review.openstack.org/25131222:25
mtreinish^^^ :( I always liked that. But, I only added it because it was there not because it was useful :)22:26
*** Swami has quit IRC22:27
*** moravec has quit IRC22:28
*** mwagner_lap has quit IRC22:31
*** agireud has quit IRC22:32
*** agireud has joined #openstack-qa22:34
*** moravec has joined #openstack-qa22:34
*** cdent has quit IRC22:42
*** vgridnev has quit IRC22:44
*** rcernin has quit IRC22:45
*** yottatsa has quit IRC22:49
openstackrecheckopenstack/nova change: https://review.openstack.org/249371 failed because of: gate-grenade-dsvm-partial-ncpu: https://bugs.launchpad.net/bugs/140090522:49
openstackLaunchpad bug 1400905 in OpenStack-Gate "Hash Sum mismatch on apt mirrors" [Undecided,Confirmed]22:49
*** hichihara has joined #openstack-qa22:50
jamielennoxandreaf: so i was looking into the domain admin mode for devstack, and talking with keystone people it seems to be a bad idea22:52
jamielennoxandreaf: basically we can enable it for keystone, but it really only makes sense when you write domain aware policy files for all of the services22:52
jamielennoxand we don't have that anywhere22:52
jamielennoxandreaf, mtreinish: so i'm not sure what we want to do here22:52
mtreinishjamielennox: ok :)22:54
mtreinishsry, I'm lacking the context right now22:54
*** david-lyle has quit IRC22:55
*** hitalia_ has joined #openstack-qa22:59
*** yottatsa has joined #openstack-qa23:00
*** hitalia has quit IRC23:00
*** armax has quit IRC23:00
*** openstackstatus has quit IRC23:01
*** armax has joined #openstack-qa23:01
*** yottatsa has quit IRC23:02
*** pglass has quit IRC23:03
*** safchain has quit IRC23:06
*** apevec has quit IRC23:09
*** mriedem has quit IRC23:14
openstackgerritMatthew Treinish proposed openstack/os-testr: Add support to ostestr to use subunit-trace color  https://review.openstack.org/25613323:18
*** regXboi has quit IRC23:20
*** sabeen3 has quit IRC23:21
*** timothyb89 has quit IRC23:25
*** yottatsa has joined #openstack-qa23:36
*** weshay has quit IRC23:40
*** tochi has joined #openstack-qa23:41
openstackgerritGhanshyam Mann proposed openstack/tempest: Add compute client base class for microversion support  https://review.openstack.org/24234623:42
openstackgerritGhanshyam Mann proposed openstack/tempest: Add logic to select the request microversion  https://review.openstack.org/24443923:42
openstackgerritGhanshyam Mann proposed openstack/tempest: Add support of schema versioning for microversion  https://review.openstack.org/24497423:42
openstackgerritGhanshyam Mann proposed openstack/tempest: Add tests for Nova microversion v2.2  https://review.openstack.org/24499623:43
gmannmtreinish: sdague:  please have a look in devstack patch for microversion testing support - https://review.openstack.org/#/c/247246/23:44
*** zackf has quit IRC23:44
gmannmtreinish: sdague you can see the Nova 2.2 version tests running on https://review.openstack.org/#/c/244996/  which is depends on devstack one23:46
*** sabeen1 has joined #openstack-qa23:47
jrollmtreinish: sdague: couple easy reviews to unstick me on ironic devstack plugin, if you don't mind :) https://review.openstack.org/255981 https://review.openstack.org/25587823:54
openstackrecheckConsole logs not available after 13:26s for gate-nova-python27 255410,9,755d4ff23:55
openstackrecheckopenstack/nova change: https://review.openstack.org/255972 failed because of: gate-tempest-dsvm-full-ceph: https://bugs.launchpad.net/bugs/146425923:55
openstackLaunchpad bug 1464259 in OpenStack Compute (nova) "Volumes tests fails often with rbd backend" [High,In progress] - Assigned to Matt Riedemann (mriedem)23:55
*** yottatsa has quit IRC23:56
*** rbak_ has quit IRC23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!