Wednesday, 2015-10-21

*** stevemar_ has joined #openstack-qa00:00
*** zhangjn has joined #openstack-qa00:00
*** tmatsu_ has joined #openstack-qa00:02
*** jasonsb has joined #openstack-qa00:02
*** stevemar_ has quit IRC00:04
*** tmatsu__ has joined #openstack-qa00:04
*** heyongli has quit IRC00:04
*** heyongli has joined #openstack-qa00:05
*** tmatsu has quit IRC00:05
*** tmatsu_ has quit IRC00:07
*** pvaneck has quit IRC00:10
*** krotscheck has quit IRC00:11
*** EinstCrazy has quit IRC00:13
*** zhangjn has quit IRC00:13
*** EinstCrazy has joined #openstack-qa00:13
*** heyongli has quit IRC00:14
*** heyongli has joined #openstack-qa00:15
*** tmatsu has joined #openstack-qa00:18
*** EinstCrazy has quit IRC00:18
mtreinishglauco, timothyb89: http://health.openstack.org/tests00:19
*** krotscheck has joined #openstack-qa00:19
*** tmatsu__ has quit IRC00:21
*** tmatsu_ has joined #openstack-qa00:21
*** devkulkarni has joined #openstack-qa00:22
*** yamamoto has joined #openstack-qa00:23
*** achanda has quit IRC00:23
*** heyongli has quit IRC00:24
*** tmatsu has quit IRC00:25
*** heyongli has joined #openstack-qa00:25
*** achanda has joined #openstack-qa00:26
*** rfolco_ has joined #openstack-qa00:31
*** lutostag has quit IRC00:32
*** heyongli has quit IRC00:35
*** lutostag has joined #openstack-qa00:35
*** nic has quit IRC00:35
*** heyongli has joined #openstack-qa00:36
*** jecarey has joined #openstack-qa00:42
*** yamamoto has quit IRC00:42
*** heyongli has quit IRC00:45
*** heyongli has joined #openstack-qa00:46
*** jecarey has quit IRC00:46
*** EinstCrazy has joined #openstack-qa00:55
*** heyongli has quit IRC00:55
*** heyongli has joined #openstack-qa00:56
*** boris-42 has quit IRC00:58
*** tpeoples has joined #openstack-qa00:58
*** zhangjn has joined #openstack-qa01:01
*** markvoelker has joined #openstack-qa01:02
*** jasonsb has quit IRC01:03
*** heyongli has quit IRC01:05
*** heyongli has joined #openstack-qa01:06
*** devkulkarni has quit IRC01:11
*** tmatsu_ has quit IRC01:15
*** heyongli has quit IRC01:16
*** heyongli has joined #openstack-qa01:17
*** tmatsu has joined #openstack-qa01:17
*** hichihara has joined #openstack-qa01:21
*** zhangjn has quit IRC01:22
*** zhangjn has joined #openstack-qa01:22
openstackrecheckConsole logs not available after 13:21s for gate-horizon-python34 229677,16,6b445ef01:24
*** tmatsu has quit IRC01:24
*** zhangjn has quit IRC01:24
*** heyongli has quit IRC01:26
*** heyongli has joined #openstack-qa01:27
*** devkulkarni has joined #openstack-qa01:28
*** salv-orlando has joined #openstack-qa01:32
*** zhangjn has joined #openstack-qa01:32
*** dims has quit IRC01:34
*** heyongli has quit IRC01:36
openstackrecheckConsole logs not available after 13:21s for gate-grenade-dsvm-neutron 233869,2,4d30bab01:37
*** heyongli has joined #openstack-qa01:37
*** yamamoto has joined #openstack-qa01:42
*** Poornima has joined #openstack-qa01:46
*** heyongli has quit IRC01:46
*** salv-orlando has quit IRC01:46
*** heyongli has joined #openstack-qa01:47
*** devkulkarni has quit IRC01:48
*** yamamoto has quit IRC01:48
*** heyongli has quit IRC01:57
*** heyongli has joined #openstack-qa01:58
*** hitalia has quit IRC01:59
*** tpeoples has quit IRC02:00
*** mwagner_ has joined #openstack-qa02:02
*** stevemar_ has joined #openstack-qa02:02
*** heyongli has quit IRC02:07
*** heyongli has joined #openstack-qa02:08
*** jasonsb has joined #openstack-qa02:13
*** Poornima has quit IRC02:16
*** heyongli has quit IRC02:17
*** rfolco_ has quit IRC02:17
*** jdandrea has quit IRC02:17
*** heyongli has joined #openstack-qa02:18
*** jecarey has joined #openstack-qa02:19
*** luqas has quit IRC02:25
*** heyongli has quit IRC02:27
*** heyongli has joined #openstack-qa02:28
*** yamamoto has joined #openstack-qa02:30
*** rfolco_ has joined #openstack-qa02:30
*** boris-42 has joined #openstack-qa02:30
*** yamahata has quit IRC02:32
*** heyongli has quit IRC02:38
*** heyongli has joined #openstack-qa02:39
*** tpeoples has joined #openstack-qa02:39
*** shausy has joined #openstack-qa02:40
*** markvoelker has quit IRC02:42
SpamapSaww damnit02:46
SpamapSI could have tuned more02:46
SpamapSlog-bin = 0 isn't what I meant02:47
*** heyongli has quit IRC02:48
*** heyongli has joined #openstack-qa02:49
openstackrecheckConsole logs not available after 13:21s for gate-tempest-dsvm-cells 237799,3,d6701b402:50
*** achanda has quit IRC02:53
*** Sakthi has joined #openstack-qa02:54
*** achanda has joined #openstack-qa02:56
SpamapSwhoa this is weird.. reading from the sql file is blocking for long periods of time.. even though I'm only reading 8MB at a time.02:56
*** achanda has quit IRC02:57
*** tpeoples has quit IRC02:57
*** heyongli has quit IRC02:58
*** heyongli has joined #openstack-qa02:59
*** morgan has quit IRC03:00
*** tpeoples has joined #openstack-qa03:00
*** shausy has quit IRC03:05
*** tpeoples has quit IRC03:07
*** heyongli has quit IRC03:08
*** heyongli has joined #openstack-qa03:09
openstackgerritSteve Martinelli proposed openstack-dev/devstack: WIP change `swift post` to openstackclient cli command  https://review.openstack.org/23786003:16
*** heyongli has quit IRC03:19
*** heyongli has joined #openstack-qa03:20
*** mylu has joined #openstack-qa03:24
*** mylu has quit IRC03:25
*** zhangjn has quit IRC03:26
*** mylu has joined #openstack-qa03:26
*** heyongli has quit IRC03:29
*** heyongli has joined #openstack-qa03:30
*** tpeoples has joined #openstack-qa03:31
*** tochi has quit IRC03:33
*** heyongli has quit IRC03:39
*** heyongli has joined #openstack-qa03:40
*** salv-orlando has joined #openstack-qa03:45
*** heyongli has quit IRC03:49
*** heyongli has joined #openstack-qa03:50
openstackgerritVincent Hou proposed openstack/tempest: Add tempest tests for volume migration  https://review.openstack.org/19544303:51
*** salv-orlando has quit IRC03:55
*** rfolco_ has quit IRC03:56
openstackgerritMerged openstack/openstack-health: Ensure we log exceptions on 500 responses  https://review.openstack.org/23280903:58
*** heyongli has quit IRC04:00
*** heyongli has joined #openstack-qa04:01
*** tochi has joined #openstack-qa04:04
*** heyongli has quit IRC04:10
*** heyongli has joined #openstack-qa04:11
*** zhangjn has joined #openstack-qa04:12
*** zhangjn has quit IRC04:19
*** heyongli has quit IRC04:20
*** heyongli has joined #openstack-qa04:21
*** zhangjn has joined #openstack-qa04:23
openstackgerritSyed Ahsan Shamim Zaidi proposed openstack-dev/devstack: Change in neutron for devstack configuration controller node  https://review.openstack.org/23778004:23
*** achanda has joined #openstack-qa04:27
*** tpeoples has quit IRC04:28
*** heyongli has quit IRC04:30
*** heyongli has joined #openstack-qa04:31
*** jecarey_ has joined #openstack-qa04:32
*** achanda has quit IRC04:32
*** jecarey has quit IRC04:34
*** achanda has joined #openstack-qa04:35
openstackgerritSteve Martinelli proposed openstack-dev/devstack: change `swift post` to openstackclient cli command  https://review.openstack.org/23786004:39
*** heyongli has quit IRC04:41
*** heyongli has joined #openstack-qa04:42
*** mylu has quit IRC04:46
*** SridharG has joined #openstack-qa04:46
*** mylu has joined #openstack-qa04:46
openstackgerritSteve Martinelli proposed openstack-dev/devstack: Use openstackclient in swift exercises  https://review.openstack.org/23787104:48
*** mylu has quit IRC04:50
*** heyongli has quit IRC04:51
*** heyongli has joined #openstack-qa04:52
*** mylu has joined #openstack-qa04:53
*** heyongli has quit IRC05:01
*** heyongli has joined #openstack-qa05:02
*** yfried__ has quit IRC05:03
*** artom has quit IRC05:05
*** mylu has quit IRC05:09
*** mylu has joined #openstack-qa05:09
*** heyongli has quit IRC05:11
*** heyongli has joined #openstack-qa05:12
*** mylu has quit IRC05:13
*** salv-orlando has joined #openstack-qa05:13
*** openstackgerrit has quit IRC05:16
*** morgan has joined #openstack-qa05:16
*** yamahata has joined #openstack-qa05:16
*** openstackgerrit has joined #openstack-qa05:16
*** aopincar has joined #openstack-qa05:18
*** salv-orlando has quit IRC05:19
*** stevemar_ has quit IRC05:19
*** stevemar_ has joined #openstack-qa05:19
openstackrecheckConsole logs not available after 13:23s for gate-tempest-pep8 195443,40,d63d27f05:20
*** heyongli has quit IRC05:22
*** stevemar_ has quit IRC05:22
*** heyongli has joined #openstack-qa05:22
*** SridharG has left #openstack-qa05:25
*** Triveni has joined #openstack-qa05:25
*** shausy has joined #openstack-qa05:29
*** bkopilov has joined #openstack-qa05:31
*** heyongli has quit IRC05:32
*** heyongli has joined #openstack-qa05:33
*** bkopilov has quit IRC05:37
*** heyongli has quit IRC05:42
*** shausy has quit IRC05:42
*** shausy has joined #openstack-qa05:43
*** heyongli has joined #openstack-qa05:43
*** morgan has quit IRC05:45
*** yamahata has quit IRC05:46
*** zhangjn has quit IRC05:47
*** apevec has joined #openstack-qa05:48
openstackrecheckConsole logs not available after 13:22s for gate-cinder-python34 201500,10,a23df2f05:48
*** heyongli has quit IRC05:52
*** heyongli has joined #openstack-qa05:53
*** itzikb_ has joined #openstack-qa05:58
*** itzikb has joined #openstack-qa05:59
*** morgan has joined #openstack-qa06:01
*** itzikb_ has quit IRC06:02
*** heyongli has quit IRC06:03
*** heyongli has joined #openstack-qa06:03
*** yfried__ has joined #openstack-qa06:09
*** mylu has joined #openstack-qa06:10
*** itzikb has quit IRC06:12
*** heyongli has quit IRC06:13
*** heyongli has joined #openstack-qa06:14
*** mylu has quit IRC06:15
*** yfried__ is now known as yfried|afk06:20
*** SridharG has joined #openstack-qa06:22
*** heyongli has quit IRC06:23
*** heyongli has joined #openstack-qa06:24
*** yfried|afk is now known as yfried__06:28
*** neeti has joined #openstack-qa06:31
*** e0ne has joined #openstack-qa06:32
*** armax has quit IRC06:32
*** yfried has joined #openstack-qa06:32
*** yfried__ has quit IRC06:33
*** heyongli has quit IRC06:33
*** vgridnev has joined #openstack-qa06:34
*** heyongli has joined #openstack-qa06:34
*** nadya has joined #openstack-qa06:34
*** pbredenb has quit IRC06:35
*** pbredenb has joined #openstack-qa06:36
*** jamielennox is now known as jamielennox|away06:37
*** yfried is now known as yfried|afk06:38
*** yfried has joined #openstack-qa06:41
*** e0ne has quit IRC06:42
*** safchain has joined #openstack-qa06:43
*** heyongli has quit IRC06:44
*** yfried|afk has quit IRC06:45
*** heyongli has joined #openstack-qa06:45
*** salv-orlando has joined #openstack-qa06:46
*** e0ne has joined #openstack-qa06:47
*** nadya has quit IRC06:52
*** heyongli has quit IRC06:54
*** heyongli has joined #openstack-qa06:55
openstackgerritAriel Opincaru proposed openstack-dev/devstack: Enable ssh validation for Neutron  https://review.openstack.org/23511806:56
SpamapSmtreinish: -rw-rw---- 1 mysql mysql  41G Oct 21 01:59 test_run_metadata.ibd07:00
SpamapSmtreinish: still loading :-P07:00
openstackgerritVincent Hou proposed openstack/tempest: Add tempest tests for volume migration  https://review.openstack.org/19544307:02
*** anshul has joined #openstack-qa07:02
*** BharatK has joined #openstack-qa07:03
*** heyongli has quit IRC07:04
*** heyongli has joined #openstack-qa07:05
openstackgerritImran Hayder Malik proposed openstack/tempest: Add logging to hostname_equals_servername function  https://review.openstack.org/21013207:11
*** yfried_ has joined #openstack-qa07:12
*** yfried_ is now known as yfried|afk07:12
*** yfried has quit IRC07:12
*** k4n0 has joined #openstack-qa07:13
*** heyongli has quit IRC07:14
openstackgerritImran Hayder Malik proposed openstack/tempest: Add logging to hostname_equals_servername function  https://review.openstack.org/21013207:15
*** vgridnev has quit IRC07:15
*** heyongli has joined #openstack-qa07:15
openstackgerritVincent Hou proposed openstack/tempest: Add tempest tests for volume migration  https://review.openstack.org/19544307:15
*** yfried|afk is now known as yfried_07:16
*** ifarkas has joined #openstack-qa07:16
*** gamado has joined #openstack-qa07:17
*** gamado has quit IRC07:18
*** gamado has joined #openstack-qa07:18
*** gamado has quit IRC07:19
*** gamado has joined #openstack-qa07:19
*** zhangjn has joined #openstack-qa07:19
*** zhangjn has quit IRC07:19
*** bnemec has quit IRC07:19
*** zhangjn has joined #openstack-qa07:20
*** vgridnev has joined #openstack-qa07:24
*** bnemec has joined #openstack-qa07:25
*** heyongli has quit IRC07:25
*** heyongli has joined #openstack-qa07:25
*** e0ne has quit IRC07:27
*** jongchoi has joined #openstack-qa07:31
*** e0ne has joined #openstack-qa07:31
*** yfried__ has joined #openstack-qa07:34
*** heyongli has quit IRC07:35
*** heyongli has joined #openstack-qa07:36
*** yfried_ has quit IRC07:37
*** nadya has joined #openstack-qa07:40
*** zhangjn has quit IRC07:42
*** EinstCrazy has quit IRC07:42
*** EinstCrazy has joined #openstack-qa07:43
*** heyongli has quit IRC07:45
*** jlanoux has joined #openstack-qa07:46
*** heyongli has joined #openstack-qa07:46
*** salv-orlando has quit IRC07:46
*** zhangjn has joined #openstack-qa07:49
*** jordanP has joined #openstack-qa07:52
*** heyongli has quit IRC07:55
*** heyongli has joined #openstack-qa07:56
*** dims has joined #openstack-qa07:58
*** k4n0 has quit IRC07:59
*** EinstCrazy has quit IRC08:01
*** EinstCrazy has joined #openstack-qa08:02
*** dims has quit IRC08:05
*** heyongli has quit IRC08:06
openstackgerritMarian Horban proposed openstack/tempest: Added processing /compute URL for getting list of versions  https://review.openstack.org/23030808:06
*** heyongli has joined #openstack-qa08:06
*** dtantsur|afk is now known as dtantsur08:07
*** yfried has joined #openstack-qa08:08
*** yfried__ has quit IRC08:08
openstackgerritSean M. Collins proposed openstack-dev/devstack: Enable L3 service in the single interface neutron guide  https://review.openstack.org/23792208:09
*** achanda has quit IRC08:10
*** achanda has joined #openstack-qa08:13
*** sshnaidm has joined #openstack-qa08:14
*** achanda has quit IRC08:15
*** heyongli has quit IRC08:16
*** rossella_s has joined #openstack-qa08:17
*** heyongli has joined #openstack-qa08:17
*** achanda has joined #openstack-qa08:20
*** gfidente|afk is now known as gfidente08:23
openstackgerritAriel Opincaru proposed openstack/tempest: WIP - Enhance attach_detach_volume test  https://review.openstack.org/23792808:24
*** vgridnev has quit IRC08:26
*** heyongli has quit IRC08:26
*** heyongli has joined #openstack-qa08:27
*** luqas has joined #openstack-qa08:29
*** nadya has quit IRC08:34
*** heyongli has quit IRC08:36
*** e0ne has quit IRC08:37
*** heyongli has joined #openstack-qa08:37
openstackgerritSyed Ahsan Shamim Zaidi proposed openstack-dev/devstack: Change in neutron for devstack configuration controller node docs: Add additional configuration in Neutron guide  https://review.openstack.org/23778008:38
*** heyongli has quit IRC08:47
*** heyongli has joined #openstack-qa08:47
*** jongchoi has quit IRC08:48
*** achanda has quit IRC08:48
*** heyongli has quit IRC08:57
*** heyongli has joined #openstack-qa08:58
*** luqas__ has joined #openstack-qa08:59
*** luqas has quit IRC09:00
openstackgerritSyed Ahsan Shamim Zaidi proposed openstack-dev/devstack: docs: Add additional configuration in Neutron guide  https://review.openstack.org/23778009:01
*** openstackgerrit has quit IRC09:01
*** openstackgerrit has joined #openstack-qa09:01
*** amotoki has joined #openstack-qa09:01
openstackrecheckConsole logs not available after 13:30s for gate-cinder-pep8 237912,1,a3e626f09:02
*** hichihara has quit IRC09:03
*** heyongli has quit IRC09:07
*** sshnaidm has quit IRC09:08
*** heyongli has joined #openstack-qa09:08
*** yfried is now known as yfried|afk09:16
*** yfried|afk is now known as yfried09:16
*** e0ne has joined #openstack-qa09:17
*** heyongli has quit IRC09:17
openstackgerritOleksii Butenko proposed openstack-dev/devstack: Add flag for test_incremental_backup.  https://review.openstack.org/23766109:18
*** heyongli has joined #openstack-qa09:18
openstackgerritOleksii Butenko proposed openstack-dev/devstack: Add flag for test_incremental_backup.  https://review.openstack.org/23766109:20
*** aix has joined #openstack-qa09:21
openstackgerritOleksii Butenko proposed openstack/tempest: Create new tests for incremental backup in cinder.  https://review.openstack.org/23537109:22
*** sshnaidm has joined #openstack-qa09:22
*** vgridnev has joined #openstack-qa09:22
*** dtantsur is now known as dtantsur|brb09:25
*** heyongli has quit IRC09:28
*** heyongli has joined #openstack-qa09:29
*** k4n0 has joined #openstack-qa09:30
*** openstackgerrit has quit IRC09:31
*** openstackgerrit has joined #openstack-qa09:31
*** yfried is now known as yfried|afk09:34
*** salv-orlando has joined #openstack-qa09:36
*** nadya has joined #openstack-qa09:38
*** heyongli has quit IRC09:38
*** nadya has quit IRC09:39
*** heyongli has joined #openstack-qa09:39
*** nadya has joined #openstack-qa09:42
*** yfried|afk is now known as yfried09:43
*** rossella_s has quit IRC09:46
*** heyongli has quit IRC09:48
*** heyongli has joined #openstack-qa09:49
*** heyongli has quit IRC09:58
*** salv-orlando has quit IRC09:59
*** heyongli has joined #openstack-qa09:59
*** yfried is now known as yfried|afk10:00
*** pc_m has joined #openstack-qa10:01
*** vgridnev has quit IRC10:07
*** vgridnev has joined #openstack-qa10:07
openstackgerritAndrea Frittoli proposed openstack/tempest: Prepare cred_client for migration  https://review.openstack.org/23304210:08
openstackgerritAndrea Frittoli proposed openstack/tempest: Factor up config dependent credential classes  https://review.openstack.org/23304310:08
openstackgerritAndrea Frittoli proposed openstack/tempest: Remove dependency from credentials domain CONF  https://review.openstack.org/23310310:08
openstackgerritAndrea Frittoli proposed openstack/tempest: Drop admin_role CONF dependency from cred provider  https://review.openstack.org/18516710:08
openstackgerritAndrea Frittoli proposed openstack/tempest: Stop validating pre-provisioned credentials  https://review.openstack.org/23304010:08
openstackgerritAndrea Frittoli proposed openstack/tempest: Fix unit tests for migration  https://review.openstack.org/23304110:08
openstackgerritAndrea Frittoli proposed openstack/tempest: Remove CredentialProvider deps to CONF  https://review.openstack.org/18514910:08
openstackgerritAndrea Frittoli proposed openstack/tempest: Remove preprov provider dependencies from CONF  https://review.openstack.org/23420010:08
*** gszasz has joined #openstack-qa10:08
*** shuquan has joined #openstack-qa10:08
*** heyongli has quit IRC10:09
*** heyongli has joined #openstack-qa10:09
*** Sakthi has quit IRC10:12
*** mylu has joined #openstack-qa10:13
*** Sakthi has joined #openstack-qa10:17
*** mylu has quit IRC10:17
*** heyongli has quit IRC10:19
*** heyongli has joined #openstack-qa10:20
*** yfried|afk is now known as yfried10:20
*** apevec has quit IRC10:24
*** grafuls has quit IRC10:25
*** piyush110786 has joined #openstack-qa10:26
*** jaypipes has joined #openstack-qa10:26
*** ChanServ sets mode: +o jaypipes10:26
*** salv-orlando has joined #openstack-qa10:27
*** heyongli has quit IRC10:29
*** flaper87 has quit IRC10:29
openstackgerritSean Dague proposed openstack-infra/devstack-gate: use cp always instead of mv / cp logic  https://review.openstack.org/23690110:29
*** heyongli has joined #openstack-qa10:30
*** EinstCrazy has quit IRC10:33
*** dims has joined #openstack-qa10:34
*** ccarrara has joined #openstack-qa10:34
*** EinstCrazy has joined #openstack-qa10:34
andreafsdague: I'm trying to find out when a devstack plugin was initially introduced - I tried git blame on the registry but that does not seem reliable http://paste.openstack.org/show/476975/10:34
*** flaper87 has joined #openstack-qa10:35
*** flaper87 has quit IRC10:35
*** flaper87 has joined #openstack-qa10:35
*** shuquan has quit IRC10:35
*** stevemar_ has joined #openstack-qa10:35
andreafsdague: perhaps the first commit on the repo is a good enough approximation, or do you have any better idea?10:35
*** achanda has joined #openstack-qa10:36
*** shuquan has joined #openstack-qa10:36
sdagueandreaf: which plugin? or in general?10:36
andreafsdague: in general - I'm trying to make a time based graph to show plugin-in adoption10:37
*** achanda has quit IRC10:37
*** shuquan has quit IRC10:37
sdagueah, yeh, the registry isn't going to be useful, people tend to not update that10:37
sdagueso I'd say look for the merge times of devstack/plugin.sh in various repositories10:37
*** stevemar_ has quit IRC10:38
*** shuquan has joined #openstack-qa10:38
andreafsdague: ok - I'll try that - hopefully the list from the registry is up to date at least :)10:38
andreafsdague: thanks10:38
sdagueI am sure that it is not10:39
sdagueso, the way to solve this is to probe all the git repos in openstack looking for devstack/plugin.sh10:39
*** heyongli has quit IRC10:39
sdagueor, possibly examine commits in project-config for when test jobs got added, but that's probably harder10:39
*** grafuls has joined #openstack-qa10:40
andreafsdague: ok, thanks, I think I'll try the brute force approach on all repos10:40
andreafsdague: at least I don't have to worry about stackforge anymore10:40
sdagueyep10:40
*** salv-orlando has quit IRC10:40
*** heyongli has joined #openstack-qa10:41
sdagueI've been considering the brute force approach to populate the registry10:41
sdagueso that's a thing that you should post somewhere once you write it and we can turn it into a detector10:41
*** yfried is now known as yfried|afk10:45
*** dtantsur|brb is now known as dtantsur10:49
*** heyongli has quit IRC10:50
*** nadya has quit IRC10:50
*** yfried|afk is now known as yfried10:50
*** heyongli has joined #openstack-qa10:51
andreafsdague: ok10:52
andreafsdague: well first I'm cloning all openstack repos - I don't know of any way of searching them without actually cloning - even though there could be some git magic to just download the git log and search it10:54
*** shuquan has quit IRC10:54
sdagueoh, actually10:55
sdagueyou could probably poke gerrit for the answer10:55
dmelladoandreaf: you can use the github api to just check the commits10:56
dmelladoi.e https://api.github.com/repos/openstack/tempest/commits10:57
*** shuquan has joined #openstack-qa10:57
dmelladobut don't know if that'd be useful for you ;)10:57
sdaguefile:^devstack/plugin.sh status:merged10:57
*** heyongli has quit IRC11:00
*** heyongli has joined #openstack-qa11:01
*** shuquan has quit IRC11:02
*** shuquan has joined #openstack-qa11:03
*** shuquan has quit IRC11:05
openstackrecheckConsole logs not available after 13:27s for gate-tempest-python34 230308,3,0b161c611:09
*** aopincar has quit IRC11:09
*** heyongli has quit IRC11:10
openstackgerritOleksii Butenko proposed openstack/tempest: Create new tests for incremental backup in cinder.  https://review.openstack.org/23537111:11
*** heyongli has joined #openstack-qa11:11
*** aysyd has joined #openstack-qa11:12
openstackgerritOleksii Butenko proposed openstack/tempest: Create new tests for incremental backup in cinder.  https://review.openstack.org/23537111:12
*** grafuls has quit IRC11:13
*** aysyd has quit IRC11:13
*** shausy has quit IRC11:14
*** aysyd has joined #openstack-qa11:15
*** EinstCrazy has quit IRC11:16
openstackgerritOleksii Butenko proposed openstack-dev/devstack: Add flag for test_incremental_backup.  https://review.openstack.org/23766111:16
*** heyongli has quit IRC11:20
openstackgerritSean Dague proposed openstack-infra/devstack-gate: use cp always instead of mv / cp logic  https://review.openstack.org/23690111:21
*** heyongli has joined #openstack-qa11:22
*** zhangjn has quit IRC11:22
*** aix has quit IRC11:24
*** aysyd has quit IRC11:25
*** grafuls has joined #openstack-qa11:26
*** jecarey_ has quit IRC11:29
*** aysyd has joined #openstack-qa11:29
*** piyush110786 has quit IRC11:30
*** salv-orlando has joined #openstack-qa11:30
*** jffische has joined #openstack-qa11:30
*** heyongli has quit IRC11:31
*** heyongli has joined #openstack-qa11:32
*** e0ne has quit IRC11:37
*** jffische has quit IRC11:38
*** heyongli has quit IRC11:41
*** glauco has quit IRC11:41
*** glauco has joined #openstack-qa11:41
*** EinstCrazy has joined #openstack-qa11:42
*** glauco has quit IRC11:42
*** heyongli has joined #openstack-qa11:42
*** glauco_ has joined #openstack-qa11:42
*** nadya has joined #openstack-qa11:45
openstackrecheckConsole logs not available after 13:25s for gate-grenade-dsvm 185149,15,c8a08bf11:46
*** tochi has quit IRC11:49
*** glauco___ has joined #openstack-qa11:51
*** heyongli has quit IRC11:51
*** heyongli has joined #openstack-qa11:52
*** glauco_ has quit IRC11:53
*** e0ne has joined #openstack-qa11:54
andreafdmellado, sdague: ok thanks - I think for now I'll just go with the download, we can make it nicer if it becomes a tool :)11:58
*** EinstCrazy has quit IRC11:59
openstackrecheckConsole logs not available after 13:49s for gate-tempest-dsvm-neutron-full-juno 233103,7,8b01e2312:00
*** aix has joined #openstack-qa12:01
*** heyongli has quit IRC12:01
*** heyongli has joined #openstack-qa12:03
*** Sakthi has quit IRC12:03
*** manas has joined #openstack-qa12:03
*** weshay_xchat has joined #openstack-qa12:03
*** devkulkarni has joined #openstack-qa12:07
openstackrecheckopenstack/cinder change: https://review.openstack.org/207866 failed because of: gate-tempest-dsvm-full: https://bugs.launchpad.net/bugs/150136612:09
openstackLaunchpad bug 1501366 in OpenStack Compute (nova) "libvirtError: Error while building firewall: Some rules could not be created for interface" [High,Confirmed]12:09
*** heyongli has quit IRC12:12
*** sayali has quit IRC12:12
*** heyongli has joined #openstack-qa12:13
openstackgerritOleksii Butenko proposed openstack/tempest: Create new tests for incremental backup in cinder.  https://review.openstack.org/23537112:14
openstackgerritOleksii Butenko proposed openstack/tempest: Create new tests for incremental backup in cinder.  https://review.openstack.org/23537112:15
*** openstackgerrit has quit IRC12:16
*** openstackgerrit has joined #openstack-qa12:16
*** grafuls has quit IRC12:16
*** jecarey has joined #openstack-qa12:17
*** rfolco_ has joined #openstack-qa12:19
*** vgridnev has quit IRC12:20
*** yamamoto has quit IRC12:21
*** heyongli has quit IRC12:22
*** heyongli has joined #openstack-qa12:23
*** Triveni has quit IRC12:28
*** devkulkarni has quit IRC12:29
*** vgridnev has joined #openstack-qa12:29
*** heyongli has quit IRC12:32
*** heyongli has joined #openstack-qa12:33
*** jecarey has quit IRC12:33
*** jecarey has joined #openstack-qa12:34
*** markvoelker has joined #openstack-qa12:35
*** edmondsw has joined #openstack-qa12:35
*** boris-42 has quit IRC12:38
*** jecarey has quit IRC12:38
*** heyongli has quit IRC12:42
*** heyongli has joined #openstack-qa12:44
*** yfried has quit IRC12:45
openstackgerritCaio Carrara proposed openstack/openstack-health: Add sort options to columns in tests page  https://review.openstack.org/23803712:45
*** aysyd has quit IRC12:46
*** aysyd has joined #openstack-qa12:46
openstackrecheckConsole logs not available after 13:21s for gate-tempest-dsvm-full 236901,7,b298e2a12:48
*** BharatK has quit IRC12:50
*** devkulkarni has joined #openstack-qa12:52
*** heyongli has quit IRC12:53
openstackgerritCaio Carrara proposed openstack/openstack-health: Change the api config loading  https://review.openstack.org/23438712:53
*** salv-orlando has quit IRC12:53
*** heyongli has joined #openstack-qa12:54
*** sayali has joined #openstack-qa12:54
*** jecarey has joined #openstack-qa12:55
*** tpeoples has joined #openstack-qa12:58
*** jecarey has quit IRC13:02
*** jffische has joined #openstack-qa13:02
*** jecarey has joined #openstack-qa13:03
*** stevemar_ has joined #openstack-qa13:03
*** heyongli has quit IRC13:03
openstackrecheckConsole logs not available after 15:07s for gate-tempest-dsvm-nova-v20-api 237999,1,ff1883213:04
*** heyongli has joined #openstack-qa13:04
*** stevemar_ has quit IRC13:07
*** salv-orlando has joined #openstack-qa13:07
*** jecarey has quit IRC13:07
*** stevemar_ has joined #openstack-qa13:09
*** dkranz has joined #openstack-qa13:11
*** aysyd has quit IRC13:12
*** aysyd has joined #openstack-qa13:12
*** stevemar_ has quit IRC13:12
*** aysyd has quit IRC13:13
*** aysyd has joined #openstack-qa13:13
*** heyongli has quit IRC13:13
*** heyongli has joined #openstack-qa13:14
*** yamamoto has joined #openstack-qa13:14
*** manas has quit IRC13:14
*** gamado has quit IRC13:16
*** stevemar_ has joined #openstack-qa13:17
openstackrecheckConsole logs not available after 13:22s for gate-swift-pep8 209329,2,06ae63f13:18
*** dramalho has joined #openstack-qa13:20
*** kiran-r has joined #openstack-qa13:21
*** jecarey has joined #openstack-qa13:21
openstackgerritJohn F. Fischer proposed openstack/tempest-lib: Migrated server_groups_client.py  https://review.openstack.org/22898913:23
*** heyongli has quit IRC13:23
*** heyongli has joined #openstack-qa13:25
*** kiran-r has quit IRC13:30
ccarraramtreinish: Hello :) Do you mind if we get this to continue? https://review.openstack.org/#/c/23128713:32
ccarraraalso, do you have any recommendation about it and/or what is missing?13:33
*** heyongli has quit IRC13:34
*** neeti has quit IRC13:34
*** Sakthi has joined #openstack-qa13:34
*** heyongli has joined #openstack-qa13:35
openstackrecheckConsole logs not available after 13:23s for gate-tempest-dsvm-neutron-full 232620,3,9bc556313:35
*** jdandrea has joined #openstack-qa13:40
*** heyongli has quit IRC13:44
*** dims has quit IRC13:45
*** heyongli has joined #openstack-qa13:45
*** dims has joined #openstack-qa13:46
*** artom has joined #openstack-qa13:46
openstackrecheckConsole logs not available after 13:22s for gate-tempest-dsvm-full 235371,9,ed0414713:48
*** sayali has quit IRC13:53
*** sayali has joined #openstack-qa13:53
*** devkulkarni has quit IRC13:54
*** stevemar_ has quit IRC13:54
*** heyongli has quit IRC13:54
mtreinishccarrara: heh, I never mind13:54
mtreinishccarrara: the big things were that I didn't like the run time graph formatting (I prefered what I did for subunit2sql-graph's equiv command)13:55
mtreinishthe success failure graph was kinda weird (because of the missing data iirc)13:55
*** malini has joined #openstack-qa13:55
*** heyongli has joined #openstack-qa13:55
mtreinishand there should probably be a table of recent runs13:55
*** malini has left #openstack-qa13:58
mtreinishccarrara, glauco___: did you see we got the api server running for real at http://health.openstack.org ?13:59
mtreinishbut it looks like its returning 500 on every request right now13:59
*** sayali has quit IRC13:59
ccarraramtreinish: great! I didn't.13:59
mtreinishit worked last night after we got it up, my guess is it's a db connection issue13:59
mtreinishI'll follow up in -infra see if we can get error logs14:00
ccarraragreat news. Thanks for sharing with us :)14:00
ccarraramtreinish: you can request /status and see that database is not working.14:00
*** vgridnev has quit IRC14:01
ccarrarathanks glauco___ for /status endpoint :)14:01
*** sayali has joined #openstack-qa14:02
mtreinishccarrara: oh, right forgot about that. Unfortunately it doesn't help too much with debugging why it's not available :)14:02
*** vgridnev has joined #openstack-qa14:02
*** dramalho has quit IRC14:02
*** dustins has joined #openstack-qa14:03
ccarraraI agree.. it's just a start point. :)14:03
*** e0ne has quit IRC14:03
*** heyongli has quit IRC14:04
*** achanda has joined #openstack-qa14:05
*** heyongli has joined #openstack-qa14:06
*** tristanC has quit IRC14:07
*** jongchoi has joined #openstack-qa14:08
*** achanda has quit IRC14:09
*** mfisher_ora has joined #openstack-qa14:13
*** heyongli has quit IRC14:15
*** sayali has quit IRC14:15
*** heyongli has joined #openstack-qa14:16
*** k4n0 has quit IRC14:16
*** sayali has joined #openstack-qa14:17
*** rbak has joined #openstack-qa14:18
ccarraramtreinish: seems that we need merge this review in subunit2sql (https://review.openstack.org/#/c/231282/3) to continue with per test view. Any plan to do that?14:22
*** heyongli has quit IRC14:25
*** j_king has joined #openstack-qa14:26
andreafccarrara, mtreinish: +A on that14:26
*** heyongli has joined #openstack-qa14:26
*** j_king has left #openstack-qa14:26
ccarraraandreaf: thanks :)14:26
*** jongchoi has quit IRC14:28
*** j_king has joined #openstack-qa14:29
ccarraramtreinish: andreaf: are there any plan to a new subunit2sql version to get this last ^^ change?14:29
mtreinishccarrara: I always have a plan :)14:29
mtreinishbut in this case I might wait just a little bit, because we just pushed a release14:30
openstackgerritMerged openstack-infra/devstack-gate: Remove os-loganalyze from PROJECTS  https://review.openstack.org/23552414:30
ccarraraok, np14:30
*** mhorban_ has joined #openstack-qa14:31
andreafmtreinish, mkoderer, oomichi, afazekas: can I have https://review.openstack.org/#/c/233040/6 re-reviewed? it was approved already but gate exposed an issue in unit tests after rebase, so I had to change one exception type - it would be nice if it could be re-approved quickly14:33
*** pglass has joined #openstack-qa14:33
*** grafuls has joined #openstack-qa14:35
*** heyongli has quit IRC14:35
*** heyongli has joined #openstack-qa14:36
openstackgerritMerged openstack-infra/subunit2sql: Add a db api method to get a list of test_runs by test.test_id  https://review.openstack.org/23128214:36
openstackrecheckopenstack/glance change: https://review.openstack.org/237101 failed because of: gate-tempest-dsvm-postgres-full: https://bugs.launchpad.net/bugs/150136614:37
openstackLaunchpad bug 1501366 in OpenStack Compute (nova) "libvirtError: Error while building firewall: Some rules could not be created for interface" [High,Confirmed]14:37
openstackgerritMartin Hickey proposed openstack-dev/devstack: Use stevedore aliases for interface_driver configuration  https://review.openstack.org/23751914:37
*** zz_dimtruck is now known as dimtruck14:38
*** dspano has joined #openstack-qa14:39
*** ccarrara has quit IRC14:43
*** heyongli has quit IRC14:45
openstackgerritMartin Hickey proposed openstack-dev/devstack: Use stevedore aliases for interface_driver configuration  https://review.openstack.org/23751914:46
*** heyongli has joined #openstack-qa14:46
openstackgerritMatthew Treinish proposed openstack/openstack-health: Make connection pool settings configurable  https://review.openstack.org/23811814:46
*** yamamoto has quit IRC14:46
mtreinishdavid-lyle, jhesketh, regXboi, timothyb89: ^^^ that should fix our connection timeout issues14:48
mtreinishwell hopefully14:48
* mtreinish hopes he did setting the defaults with config parser correctly14:48
*** tuannguyen has joined #openstack-qa14:48
*** devkulkarni has joined #openstack-qa14:49
mtreinishdoesn't look like it after reading the docs14:50
openstackgerritMatthew Treinish proposed openstack/openstack-health: Make connection pool settings configurable  https://review.openstack.org/23811814:52
*** dspano has quit IRC14:53
*** stevemar_ has joined #openstack-qa14:55
*** stevemar_ has quit IRC14:56
*** heyongli has quit IRC14:56
*** e0ne has joined #openstack-qa14:56
*** heyongli has joined #openstack-qa14:57
*** sayali has quit IRC14:58
j_kinghm.14:58
* j_king oops, wrong window.14:59
*** stevemar_ has joined #openstack-qa14:59
openstackgerritMatthew Treinish proposed openstack/openstack-health: Add a rest endpoint to get a list of the run metadata keys  https://review.openstack.org/22697614:59
*** sayali has joined #openstack-qa15:00
*** sabeen has joined #openstack-qa15:01
*** apevec has joined #openstack-qa15:03
*** apevec has quit IRC15:03
*** apevec has joined #openstack-qa15:03
*** weshay_xchat is now known as weshay15:04
*** dspano has joined #openstack-qa15:05
*** heyongli has quit IRC15:06
openstackgerritJoseph Lanoux proposed openstack/tempest: WIP - Migrate scenario tests ssh-auth-strategy  https://review.openstack.org/22557515:07
*** heyongli has joined #openstack-qa15:07
*** ccarmack has joined #openstack-qa15:07
*** glauco___ is now known as glauco15:08
*** yamamoto has joined #openstack-qa15:09
*** regXboi has joined #openstack-qa15:12
*** stevema__ has joined #openstack-qa15:13
andreafsdague, dmellado, mtreinish: not necessarily the most efficient solution, but it works: http://paste.openstack.org/show/477037/ - hopefully I can do something similar for grenade and tempest plugins15:14
*** devkulkarni has joined #openstack-qa15:14
mtreinishandreaf: heh, it works15:14
mtreinishthe same approach should work for tempest plugins15:15
mtreinishjust search for the entry_point in the projects setup.cfg15:15
andreafmtreinish: do you know a nice gnuplot command to make a timeline graph from something like that?15:16
*** heyongli has quit IRC15:16
*** stevemar_ has quit IRC15:16
mtreinishandreaf: not off the top of my head, sry15:17
*** heyongli has joined #openstack-qa15:17
*** EinstCrazy has joined #openstack-qa15:17
andreafmtreinish: no worries I'll fine something15:17
mtreinishandreaf: I think your missing some, like: https://github.com/openstack-infra/nodepool/blob/master/devstack/plugin.sh wasn't on your paste15:18
dmelladoandreaf: great ;)15:18
andreafmtreinish: let me check15:18
*** dramalho has joined #openstack-qa15:19
*** aysyd has quit IRC15:20
andreafmtreinish: uhm yes my network went down in the middle of cloning and the clone was attached to my console, so it stopped - I was unlucky enough to hit a repo with devstack15:20
mtreinishandreaf: haha15:21
*** aysyd has joined #openstack-qa15:21
*** ccneill has joined #openstack-qa15:22
*** aysyd has quit IRC15:26
*** nicholasgoracke has joined #openstack-qa15:26
*** heyongli has quit IRC15:26
*** SridharG has left #openstack-qa15:27
openstackgerritMatthew Treinish proposed openstack/openstack-health: Make connection pool settings configurable  https://review.openstack.org/23811815:27
mtreinishregXboi: ^^^15:27
*** heyongli has joined #openstack-qa15:27
*** sabeen2 has joined #openstack-qa15:28
mtreinishregXboi: also we've got the api server running for real now at health.openstack.org15:28
*** hitalia has joined #openstack-qa15:28
*** yamamoto_ has joined #openstack-qa15:29
*** armax has joined #openstack-qa15:29
*** aysyd has joined #openstack-qa15:30
*** ccneill has quit IRC15:30
*** sabeen has quit IRC15:31
*** dims_ has joined #openstack-qa15:31
*** tnguyennc has joined #openstack-qa15:31
regXboimtreinish: review left and very cool!15:32
*** yamamoto has quit IRC15:32
*** dzamboni has joined #openstack-qa15:33
*** ccneill has joined #openstack-qa15:34
*** tnguyennc has left #openstack-qa15:34
*** dims has quit IRC15:35
*** shausy has joined #openstack-qa15:35
*** tuannguyen has left #openstack-qa15:36
*** heyongli has quit IRC15:37
*** heyongli has joined #openstack-qa15:38
mtreinishregXboi: thanks15:38
mtreinishregXboi: we should have the frontend being deployed soonish too: https://review.openstack.org/23616515:38
regXboimtreinish: ooo, shiny! (in a completely good way)15:39
*** tuannguyen has joined #openstack-qa15:39
andreafmtreinish: oh, cool, I didn't know ^^^ port 80?15:40
regXboiand I threw a +1 its way :)15:40
openstackrecheckConsole logs not available after 13:25s for gate-tempest-python34 235371,9,8dc585915:41
openstackrecheckopenstack/glance change: https://review.openstack.org/227180 failed gate-tempest-dsvm-postgres-full in the gate queue with an unrecognized error15:42
mtreinishandreaf: yeah, there's not need to run it on some weird port, it's http and the only thing running on that server15:42
*** ccarrara has joined #openstack-qa15:42
andreafmtreinish: nice, it works: http://health.openstack.org/runs15:42
*** EinstCrazy has quit IRC15:42
*** tpeoples has quit IRC15:43
*** aysyd has quit IRC15:43
mtreinishandreaf: heh, well until we leave it alone enough and the db connections timeout15:45
*** ccarrara has quit IRC15:45
*** vgridnev has quit IRC15:46
*** aysyd has joined #openstack-qa15:46
openstackgerritGlauco Oliveira proposed openstack/openstack-health: Add unit tests around ConfigService  https://review.openstack.org/23814615:47
*** heyongli has quit IRC15:47
*** heyongli has joined #openstack-qa15:48
*** tnguyennc has joined #openstack-qa15:50
*** gfidente is now known as gfidente|afk15:51
*** EinstCrazy has joined #openstack-qa15:53
*** yamahata has joined #openstack-qa15:55
*** ccarrara has joined #openstack-qa15:56
*** shausy has quit IRC15:57
*** heyongli has quit IRC15:57
*** heyongli has joined #openstack-qa15:58
*** dkranz has quit IRC15:59
*** vgridnev has joined #openstack-qa15:59
*** stevema__ has quit IRC16:00
*** jecarey_ has joined #openstack-qa16:00
*** luqas__ has quit IRC16:01
*** luqas has joined #openstack-qa16:02
*** tpeoples has joined #openstack-qa16:02
openstackgerritJoseph Lanoux proposed openstack/tempest: WIP - Migrate scenario tests ssh-auth-strategy  https://review.openstack.org/22557516:02
*** jecarey_ has quit IRC16:02
*** jecarey_ has joined #openstack-qa16:03
openstackgerritGlauco Oliveira proposed openstack/openstack-health: Add unit tests around ConfigService  https://review.openstack.org/23814616:03
*** jecarey has quit IRC16:03
*** jlanoux has quit IRC16:07
*** dtantsur is now known as dtantsur|afk16:07
*** heyongli has quit IRC16:07
*** heyongli has joined #openstack-qa16:08
*** nadya has quit IRC16:09
*** bnemec has quit IRC16:10
*** yamahata has quit IRC16:11
*** yamahata has joined #openstack-qa16:11
*** EinstCrazy has quit IRC16:11
*** nic has joined #openstack-qa16:12
*** e0ne has quit IRC16:16
*** e0ne has joined #openstack-qa16:17
*** luqas has quit IRC16:17
*** bnemec has joined #openstack-qa16:17
*** heyongli has quit IRC16:18
*** EinstCrazy has joined #openstack-qa16:18
*** luqas has joined #openstack-qa16:19
*** heyongli has joined #openstack-qa16:19
*** pc_m is now known as pc_m_AWAY16:20
openstackrecheckConsole logs not available after 13:26s for gate-tempest-dsvm-full 222173,7,649b18916:23
*** achanda has joined #openstack-qa16:28
*** heyongli has quit IRC16:28
*** heyongli has joined #openstack-qa16:29
*** jecarey_ has quit IRC16:31
*** zhangjn has joined #openstack-qa16:31
*** jasonsb has quit IRC16:32
SpamapSmtreinish: -rw-rw---- 1 mysql mysql  63G Oct 21 11:32 test_run_metadata.ibd16:32
mtreinishSpamapS: still going?16:33
SpamapSmtreinish:            Rows: 19032594816:33
SpamapSin test_run_metadata16:33
mtreinishSpamapS: it should be ~2x test_runs16:34
mtreinishbecause there are tags and attrs16:34
SpamapSmtreinish: perhaps enums would be doable with test_run_metadata? Do the keys change much?16:34
*** jecarey_ has joined #openstack-qa16:34
SpamapSmtreinish: at this point it's getting slower and slower.. I actually switched to pv, thinking maybe pipemeter had a bug, but it's just really.. really painful to insert this many rows16:35
*** dims_ has quit IRC16:36
mtreinishSpamapS: hmm, probably not. I kept the metadata tables free form key value because I thought there might be other deployment specific stuff used in those tables16:36
mtreinishbut that may only apply to run_metadata16:36
*** stevemar_ has joined #openstack-qa16:36
*** dims has joined #openstack-qa16:36
mtreinishccarrara, glauco: when you get a sec: https://review.openstack.org/23811816:37
mtreinishthat'll be good for the prod server16:38
glaucomtreinish: checking!16:38
*** heyongli has quit IRC16:38
*** heyongli has joined #openstack-qa16:39
SpamapSmtreinish: well anyway, I've imported 20GB of the 47GB uncompressed dump file. :P16:39
SpamapSmtreinish: so, yeah, tomorrow. :-P16:40
mtreinishSpamapS: oh, I just realized the typo, I meant to say we probably could switch to enum16:40
*** stevemar_ has quit IRC16:41
mtreinishbecause my original idea is probably not valid for test_run_metadata :)16:41
*** zhangjn has quit IRC16:41
SpamapSmtreinish: it would be quite painful to switch back. :-P16:41
*** EinstCrazy has quit IRC16:41
SpamapSmtreinish: anyway, let's consider this a pile of learning for all of us: columns need to be extremely well thought out in any database bigger than 5GB ;)16:42
ccarraramtreinish: nice idea about connection pool setting, but what you think to do it based on this? https://review.openstack.org/#/c/234387/16:42
*** amotoki has quit IRC16:42
mtreinishccarrara: well now that we're running a server with the current config, we have to handle the switch to that gracefully16:43
mtreinishso when we land the patch we don't break the server16:43
mtreinishso I think in the meantime land it as is so we get the benefits now and then rebase the new config patch on top of it16:44
*** nic has quit IRC16:44
mtreinishSpamapS: heh, yeah I definitely should have done more thought (and asking questions) when I first started16:44
mtreinishSpamapS: I have been thinking we might want to start over from scratch: https://review.openstack.org/#/c/203252/16:45
ccarraramtreinish: ok. np.16:46
mtreinishccarrara: my concern with switching to 234387 right now is when that lands I think it'll break the server16:47
mtreinishbecause it doesn't know how to read the config file we're making in the puppet16:47
SpamapSmtreinish: hm, I don't think the whole schema is bong. It just needs some love. :)16:47
SpamapSmtreinish: oh ok I see, start with a new schema and just import the data into it.16:48
*** heyongli has quit IRC16:48
SpamapSmtreinish: Maybe I'll make a second db with this schema and try importing into it. ;)16:49
openstackrecheckConsole logs not available after 15:52s for gate-tempest-dsvm-postgres-full 231948,7,52e07e216:49
mtreinishSpamapS: yeah something like that. I hadn't really worked out the migration half of that commit yet16:49
*** heyongli has joined #openstack-qa16:49
mtreinishbecause I think having a sort of automatic way to migrate everything over to the new schema branch would be good16:49
mtreinishbut I was thinking instead of trying to figure out how to construct migrations to move to the new schema starting fresh might be easier16:50
*** nicholasgoracke has quit IRC16:52
glaucomtreinish: as part of your patch, could we include defaults on etc/openstack-health-api.conf?16:53
glaucoor de we want to get rid of it from the repo?16:54
mtreinishglauco: well the example in etc/openstack-health-api.conf is for running locally16:54
mtreinishI'm not sure connection pool settings make a difference in the single threaded test server16:54
glaucomtreinish: they probably don't, but if there isn't anything in there, it throws an exception16:55
mtreinishglauco: hmm, I thought I set it with defaults16:56
*** heyongli has quit IRC16:59
*** zigo_ has quit IRC16:59
*** heyongli has joined #openstack-qa17:00
*** zigo has joined #openstack-qa17:00
*** jordanP has quit IRC17:04
mtreinishglauco: hmm, yeah it looks like the defaults aren't working17:04
mtreinishglauco: -1 it17:04
*** nadya has joined #openstack-qa17:06
SpamapSmtreinish: it's important to note that alter table is highly optimized17:06
SpamapSmtreinish: if you can get a migration done in a single batch alter, it's for the best.17:06
SpamapSmtreinish: using new table/swap is really only for the times when you need to keep online-access working.17:06
mtreinishSpamapS: ok, my main concern was with the trove db's tmp storage limitations17:07
mtreinishwe had issues using alter table last time17:07
*** ccarmack has quit IRC17:08
mtreinishdavid-lyle: so when I decided to bother with testing it locally, it blew up saying it couldn't find the new options17:08
mtreinishso I need to figure out what I did wrong on setting defaults17:09
*** dramalho has quit IRC17:09
david-lyleare we using an older version?17:09
mtreinishdavid-lyle: of?17:09
*** heyongli has quit IRC17:09
david-lylewait which new option?17:09
david-lyleoh for the defaults17:09
mtreinishdavid-lyle: the patch you just +A'd :)17:09
david-lyleI was reading the sqlalchemy docs17:10
*** heyongli has joined #openstack-qa17:10
SpamapSmtreinish: oh yeah I forgot about that17:10
mtreinishdavid-lyle: oh, right. Yeah this is in the local config parsing17:10
SpamapSmtreinish: did we raise hell with Rackspace about that?17:10
SpamapSbecause, that's pretty silly17:11
mtreinishSpamapS: hmm, not sure17:11
*** vgridnev has quit IRC17:11
mtreinishjroll: did I complain to you about the trove issue we had on rax like 6 months ago?17:11
jrollmtreinish: not that I remember no17:12
*** safchain has quit IRC17:12
mtreinishdavid-lyle: http://paste.openstack.org/show/477061/17:12
jrollmtreinish: or was it the idle timeout thing?17:12
SpamapSjroll: the trove instances store mysql temp files on a tmpfs partition rather than the data partition17:12
jrolloh, that's awesome17:12
SpamapSjroll: this leads to the inability to alter large tables sometimes.17:13
jroll:(17:13
jrollright17:13
SpamapSNow, _most_ alters will just make a new table inside the same db17:13
SpamapSbut IIRC, this one was doing something that required building a _MASSIVE_ index.17:13
SpamapSwhich makes a tempfile17:13
mtreinishSpamapS: it was adding 2 columns17:13
jrollyeah I get it17:13
SpamapSfor filesort17:13
SpamapSmtreinish: oh that needed temp space too??17:13
jrollI'm sad to say I can't help much other than to put in a ticket :/17:13
SpamapSjroll: probably will mean more if we do it so we can provide direct evidence as "customers" (even if our time is donated by RAX ;)17:14
mtreinishjroll: heh, that's probably more than what mordred and I did back when it happened :)17:14
SpamapSI want some of that sweet sweet fanatical support.17:14
*** ccarmack has joined #openstack-qa17:15
mtreinishSpamapS: I guess, the commit to work around it was: https://review.openstack.org/#/c/164838/17:15
*** sabeen2 has quit IRC17:15
*** yamamoto_ has quit IRC17:17
jrollSpamapS: lol17:17
david-lylemtreinish: what is default?17:17
jrollSpamapS: do let me know if you need me to poke people, though idk if I know anyone on that team17:18
regXboimtreinish: ping - tempest q for you17:18
*** salv-orl_ has joined #openstack-qa17:18
mtreinishdavid-lyle: the config section17:19
mtreinishregXboi: shoot17:19
regXboimtreinish: I want to run a scenario test, which I expect to fail, but I *don't* want it to clean up after itself - I want to look at the state when the failure occurred - is there a simple way I can do that?17:19
*** heyongli has quit IRC17:19
mtreinishregXboi: hmm, not that I know of, short of commenting out any addCleanups17:20
*** dramalho has joined #openstack-qa17:20
mtreinishthis is actually a commonish question, and I wish I had a better answer17:20
regXboimtreinish: yah - that felt like a meat-axe17:20
*** heyongli has joined #openstack-qa17:20
*** salv-orlando has quit IRC17:21
mtreinishregXboi: I normally hate using debuggers, but a pdb breakpoint might do what you want too17:21
*** olaph has joined #openstack-qa17:21
mtreinishyou'll just have to call subunit.run or testtools.run directly (there is an ostestr flag to do that for you)17:21
*** devkulkarni has quit IRC17:21
*** Swami has joined #openstack-qa17:22
SpamapSmtreinish: I actually love that style, because you can perform that migration out of band if need be. ;)17:22
SpamapSthis is weird17:22
SpamapSso mysqldump embeds "ALTER TABLE xxx DISABLE KEYS"17:23
SpamapSwhich means you don't build indexes until the end, or so I thoguht..17:23
SpamapS   Index_length: 3802965606417:23
SpamapSThat explains why this is going so damn slow.17:23
SpamapSBut I can't figure out why the disable keys statement didn't happen.17:23
*** pasquier-s has quit IRC17:25
*** yamamoto has joined #openstack-qa17:25
*** pasquier-s has joined #openstack-qa17:27
*** jasonsb has joined #openstack-qa17:28
SpamapSoh.. I'm just ignorant is all http://dba.stackexchange.com/questions/76565/mysqldumps-disable-keys-have-no-effect-on-import17:28
SpamapSso perhaps if I try another import I will simply drop the keys17:29
*** tchaypo has quit IRC17:29
*** heyongli has quit IRC17:29
glaucomtreinish: ok!17:30
*** heyongli has joined #openstack-qa17:30
*** tchaypo has joined #openstack-qa17:31
*** stevemar_ has joined #openstack-qa17:32
mtreinishglauco: so I do set defaults, or at least I try to, that's what the dict in the ConfigParser init is supposed to do17:32
mtreinishunless I misread the docs17:32
glaucomtreinish: let me try again here17:33
mtreinishglauco: I'm getting the same failure locally17:33
mtreinishso it's clearly not right17:33
mtreinishI was just saying I did try to set a default :)17:33
openstackrecheckConsole logs not available after 15:49s for gate-grenade-dsvm-partial-ncpu 232585,4,09f75ab17:35
*** heyongli has quit IRC17:40
*** heyongli has joined #openstack-qa17:41
*** amotoki has joined #openstack-qa17:43
*** salv-orl_ has quit IRC17:45
*** amotoki has quit IRC17:48
*** e0ne has quit IRC17:49
*** heyongli has quit IRC17:50
*** vgridnev has joined #openstack-qa17:50
*** heyongli has joined #openstack-qa17:51
*** dramalho has quit IRC17:54
*** yamamoto has quit IRC17:55
openstackrecheckConsole logs not available after 13:29s for gate-tempest-dsvm-postgres-full 225575,5,d868e6617:55
*** dramalho has joined #openstack-qa17:57
*** stevemar_ has quit IRC17:58
*** luqas has quit IRC18:00
*** heyongli has quit IRC18:00
regXboimtreinish: yeah - looks like I'm going to try the pdb route18:01
*** heyongli has joined #openstack-qa18:01
*** nic has joined #openstack-qa18:02
*** sabeen has joined #openstack-qa18:02
*** shardy is now known as shardy_afk18:02
*** dkranz has joined #openstack-qa18:03
*** dims has quit IRC18:03
*** jffische has quit IRC18:04
*** dims has joined #openstack-qa18:04
*** luqas has joined #openstack-qa18:04
*** asselin has quit IRC18:06
*** asselin has joined #openstack-qa18:06
openstackrecheckConsole logs not available after 13:21s for gate-grenade-dsvm 234986,10,6703b6718:08
*** yamahata has quit IRC18:08
*** sabeen2 has joined #openstack-qa18:08
*** vgridnev has quit IRC18:10
*** hemna is now known as hemnafk18:10
*** heyongli has quit IRC18:10
*** Sakthi has quit IRC18:11
*** heyongli has joined #openstack-qa18:11
*** Sakthi has joined #openstack-qa18:11
*** sabeen has quit IRC18:12
*** aix has quit IRC18:12
*** vgridnev has joined #openstack-qa18:12
*** vgridnev has quit IRC18:14
*** rfolco_ has quit IRC18:19
*** jecarey_ has quit IRC18:19
*** ccneill has quit IRC18:19
*** pc_m_AWAY is now known as pc_m18:19
*** jecarey has joined #openstack-qa18:20
*** asselin has quit IRC18:21
*** heyongli has quit IRC18:21
*** rfolco has joined #openstack-qa18:21
openstackrecheckConsole logs not available after 13:24s for gate-tempest-dsvm-neutron-full 216378,16,61341b718:22
*** heyongli has joined #openstack-qa18:22
*** rfolco has quit IRC18:23
*** jecarey_ has joined #openstack-qa18:23
*** jecarey has quit IRC18:24
*** vgridnev has joined #openstack-qa18:25
*** rfolco has joined #openstack-qa18:25
*** salv-orlando has joined #openstack-qa18:25
*** pvaneck has joined #openstack-qa18:26
*** asselin has joined #openstack-qa18:27
*** sshnaidm has quit IRC18:28
*** heyongli has quit IRC18:31
*** jffische has joined #openstack-qa18:31
*** heyongli has joined #openstack-qa18:32
*** austin81 has joined #openstack-qa18:32
*** dzamboni has quit IRC18:33
*** devkulkarni has joined #openstack-qa18:33
*** pglbutt has joined #openstack-qa18:33
*** pglass_ has joined #openstack-qa18:34
*** yfried has joined #openstack-qa18:34
openstackrecheckConsole logs not available after 13:22s for gate-cinder-python27 221442,6,abe7ade18:35
*** pglass has quit IRC18:35
openstackgerritGlauco Oliveira proposed openstack/openstack-health: Add unit tests around HealthService  https://review.openstack.org/23820718:36
*** pglbutt has quit IRC18:37
openstackgerritGlauco Oliveira proposed openstack/openstack-health: Fix `gulp unit`  https://review.openstack.org/23778418:40
timothyb89glauco: thanks for fixing!18:41
*** heyongli has quit IRC18:41
glaucotimothyb89: ;)18:42
glaucotimothyb89: sorry for the delay. Really focused on writing these unit tests18:42
*** heyongli has joined #openstack-qa18:42
timothyb89glauco: not a problem at all18:42
*** Swami has quit IRC18:43
*** amotoki has joined #openstack-qa18:44
openstackgerritGlauco Oliveira proposed openstack/openstack-health: Add unit tests around ConfigService  https://review.openstack.org/23814618:44
openstackgerritGlauco Oliveira proposed openstack/openstack-health: Add unit tests around HealthService  https://review.openstack.org/23820718:44
*** amotoki has quit IRC18:49
openstackrecheckConsole logs not available after 13:23s for gate-glance-python27 227180,2,de024ca18:49
*** heyongli has quit IRC18:51
*** heyongli has joined #openstack-qa18:52
*** yamamoto has joined #openstack-qa18:55
openstackgerritBrant Knudson proposed openstack-dev/devstack: Grant nova service user only service role  https://review.openstack.org/17522218:55
openstackgerritMerged openstack/openstack-health: Fix `gulp unit`  https://review.openstack.org/23778418:56
*** yamahata has joined #openstack-qa18:57
regXboimtreinish: ping (for when you are back)18:58
*** nadya has quit IRC18:59
*** yamamoto has quit IRC19:00
adam_ganyone know if the devstack plugin override-defaults can be used to override which branches of non-plugin repos get used? ie, can i override NOVA_BRANCH there?19:00
mtreinishregXboi: I'm back19:01
regXboimtreinish: so the plot (s/th)ickens19:02
*** heyongli has quit IRC19:02
regXboiI ran that single scenario test and ... of course ... it passed19:02
mtreinishregXboi: not sthinckens?19:02
openstackrecheckConsole logs not available after 13:31s for gate-cinder-python34 231936,4,b522dc119:02
regXboino, sickens/thickens :)19:02
mtreinishregXboi: heh, yeah races are fun like that19:02
*** heyongli has joined #openstack-qa19:03
openstackgerritMarc Koderer proposed openstack/tempest-plugin-cookiecutter: Initial version of cookiecutter-tempest-plugin  https://review.openstack.org/23742419:03
mtreinishregXboi: so I don't know of a way to run the full suite in parallel with testr and have pdb enabled19:03
mtreinishunless you launch things twice19:03
regXboiso I'm now thinking of just calling something blantant like exit to force things to stop19:04
*** jasonsb has quit IRC19:04
regXboimy question is ... is there a way I can call exit that won't run the cleanup/teardown code?19:04
*** ifarkas has quit IRC19:04
mtreinishregXboi: it shouldnt, it should exit that worker19:04
*** krtaylor has quit IRC19:04
mtreinishyou'll still have the other ones running though19:05
mtreinishor at least I think that's what'll happen19:05
mtreinishI've never actually tried it before19:05
regXboimtreinish: I was going to run single threaded19:05
regXboialthough that will be painful in itself :(19:05
mtreinishok, then you don't have to worry about the other workers19:05
mtreinishregXboi: well running in parallel shouldn't matter. I don't think testr exits everything if it gets a non-zero exit code from one process19:06
regXboihmm... ok, I'll try the blunt os._exit19:06
* regXboi goes and wields meat-axs19:07
regXboier meat-axes19:07
*** stevemar_ has joined #openstack-qa19:07
mtreinishasselin: so how did you get defaults working on the e-r config patch/what am I doing wrong here: https://review.openstack.org/23811819:07
*** Swami has joined #openstack-qa19:10
*** jasonsb has joined #openstack-qa19:11
*** heyongli has quit IRC19:12
*** Sakthi2 has joined #openstack-qa19:12
*** heyongli has joined #openstack-qa19:13
clarkbadam_g: I think you can since the plugins are sourced after the stackrc?19:13
*** Sakthi has quit IRC19:14
*** stevemar_ has quit IRC19:15
*** stevemar_ has joined #openstack-qa19:16
*** achanda has quit IRC19:16
openstackrecheckConsole logs not available after 13:29s for gate-tempest-dsvm-full 238160,1,438fa3f19:16
*** mylu has joined #openstack-qa19:16
openstackgerritMatthew Treinish proposed openstack/openstack-health: Make connection pool settings configurable  https://review.openstack.org/23811819:17
mtreinishdavid-lyle, glauco: ^^^ lets try that again19:17
glaucomtreinish: checking!19:17
mtreinishI'm not sure what I'm doing wrong with the defaults there, so I decided to take the hammer approach19:17
*** krtaylor has joined #openstack-qa19:17
*** Sakthi2 has quit IRC19:18
*** devkulkarni has quit IRC19:19
*** gfidente|afk has quit IRC19:20
*** stevemar_ has quit IRC19:20
mtreinishdavid-lyle: do you have any thoughts on: https://review.openstack.org/23273919:22
*** heyongli has quit IRC19:22
*** heyongli has joined #openstack-qa19:23
*** vgridnev has quit IRC19:25
*** vgridnev has joined #openstack-qa19:28
adam_gclarkb, but when running on devstack slave, wouldnt that be ignored since its relying on whatever is already checked out in NOVA_DIR?19:29
*** vgridnev has quit IRC19:29
openstackrecheckConsole logs not available after 13:23s for gate-tempest-dsvm-full 134095,7,6e30d1119:30
clarkbadam_g: iirc no19:30
clarkbadam_g: its a hak you can do to test dependnet changes before gerrit had depends-on19:30
*** vgridnev has joined #openstack-qa19:30
clarkbyou shouldn't do it without a real need IMO but if its part of the config I think it will work19:30
*** dkranz has quit IRC19:30
adam_gclarkb, k. ones running now, fingers crossed19:32
*** shardy_afk is now known as shardy19:32
*** heyongli has quit IRC19:32
*** heyongli has joined #openstack-qa19:33
adam_gclarkb, or maybe you have a better idea: we're running 1 week behind integrated release. we haven't cut stable/liberty (trying to do that today), so our master needs to test against stable/liberty of other projects19:33
clarkbadam_g: set devstack-gate branch override to stable/liberty19:35
clarkbadam_g: all of your changes will be tested using the zuul ref and everything else will fall back to stable/liberty19:36
clarkbadam_g: it is how we do cross version testing for things like clients and libs (or how we used to)19:36
adam_gclarkb, that'd work except we have 3 repos19:36
clarkbadam_g: should work until they get stable/liberty branche sbecause master is the fallback fallback19:37
adam_g... or, if stable/liberty does not exsist, does it fallback to master for that repo?19:37
adam_gword19:37
*** mylu has quit IRC19:37
*** vgridnev has quit IRC19:40
*** mylu has joined #openstack-qa19:41
*** nadya has joined #openstack-qa19:42
*** heyongli has quit IRC19:43
openstackrecheckConsole logs not available after 13:24s for gate-horizon-tox-py27dj18 232735,4,795054d19:43
*** hitalia has quit IRC19:43
*** heyongli has joined #openstack-qa19:44
openstackgerritMerged openstack-infra/devstack-gate: use cp always instead of mv / cp logic  https://review.openstack.org/23690119:46
mtreinishregXboi: if you get a sec can you take another look at: https://review.openstack.org/#/c/238118/19:47
mtreinishthe defaults with config parser weren't working so I had to take a more brute force approach19:47
regXboiyeah that is brute force19:47
regXboidoes it work now?19:48
mtreinishit does when I test it locally19:48
mtreinishI'm still not 100% that the connection pooling settings will fix our issue on the prod server19:48
regXboimtreinish: well... let's find out19:48
mtreinishbut it can't hurt, and it's my best guess right now19:48
mtreinishregXboi: thanks19:49
regXboiyw19:49
openstackgerritMerged openstack/openstack-health: Add unit tests around ConfigService  https://review.openstack.org/23814619:50
mtreinishclarkb: ^^^ ok I think that should fix the connection issues on health.o.o19:51
*** heyongli has quit IRC19:53
*** heyongli has joined #openstack-qa19:54
*** vgridnev has joined #openstack-qa19:54
openstackgerritMerged openstack/stackviz: Fix karma-coverage version, use `gulp unit` to run unit tests  https://review.openstack.org/23554719:55
*** vgridnev has quit IRC19:56
openstackgerritMerged openstack/openstack-health: Make connection pool settings configurable  https://review.openstack.org/23811819:57
*** glauco has quit IRC19:57
openstackrecheckConsole logs not available after 13:25s for gate-keystone-python34 209132,17,da6e0b319:57
*** glauco_ has joined #openstack-qa19:58
*** mylu has quit IRC19:59
*** mylu has joined #openstack-qa19:59
*** vgridnev has joined #openstack-qa20:01
*** vgridnev has quit IRC20:03
*** heyongli has quit IRC20:03
*** mylu has quit IRC20:04
*** heyongli has joined #openstack-qa20:04
*** vgridnev has joined #openstack-qa20:06
*** openstackstatus has joined #openstack-qa20:07
*** ChanServ sets mode: +v openstackstatus20:07
*** dimtruck is now known as zz_dimtruck20:11
*** ccarrara has quit IRC20:12
*** heyongli has quit IRC20:13
*** glauco__ has joined #openstack-qa20:14
*** heyongli has joined #openstack-qa20:14
*** jecarey_ has quit IRC20:15
*** jecarey has joined #openstack-qa20:16
*** achanda has joined #openstack-qa20:16
*** glauco_ has quit IRC20:17
*** dims has quit IRC20:18
*** jaypipes has quit IRC20:18
*** jffische has quit IRC20:18
*** dims has joined #openstack-qa20:18
*** dustins has quit IRC20:19
*** zz_dimtruck is now known as dimtruck20:19
*** jecarey has quit IRC20:20
*** achanda has quit IRC20:22
*** salv-orlando has quit IRC20:22
*** heyongli has quit IRC20:24
*** heyongli has joined #openstack-qa20:25
*** rbak has quit IRC20:25
asselinmtreinish, i'm back...looking20:26
openstackgerritMatthew Treinish proposed openstack/openstack-health: Stop trying to set defaults with the prescribed method  https://review.openstack.org/23824120:28
*** rbak has joined #openstack-qa20:28
mtreinishasselin: heh, thanks it's already landed and it broke the prod server20:28
mtreinish^^^ is my new fix20:28
asselinmtreinish, this is what I did: https://review.openstack.org/#/c/235044/8/elastic_recheck/cmd/uncategorized_fails.py20:29
mtreinishasselin: yeah for me the dict in init didn't do anything in local testing20:29
asselinso no need for try exceptions20:29
mtreinishit would always raise a NoOpt exception20:29
mtreinishand for the prod server it exploded: http://paste.openstack.org/show/477077/20:30
asselinoh really? it was working for me....but I wasn't using the 'default' section20:30
*** vgridnev has quit IRC20:31
*** jecarey has joined #openstack-qa20:31
asselinmtreinish, but this line could have issues: db_uri = config.get('default', 'db_uri')20:31
*** vgridnev has joined #openstack-qa20:32
mtreinishasselin: why? it's mandatory without a default20:32
asselinmtreinish, ok20:33
openstackgerritAustin Clark proposed openstack/stackviz: Adds unit tests for datasetservice, homeCtrl  https://review.openstack.org/23557820:33
mtreinishasselin: I was banging my head against a wall this afternoon on getting it to work as the docs say20:34
mtreinishand just gave up :(20:34
*** heyongli has quit IRC20:34
asselinI understand...I only got my patch working with thanks to pdb20:34
*** heyongli has joined #openstack-qa20:35
asselinmtreinish, so in your patch, if those values are set, do they actually get used?20:35
asselinset in the conf file20:36
mtreinishasselin: they should, because it won't raise a NoOpt exception20:36
mtreinishso the get() will work20:36
openstackgerritAustin Clark proposed openstack/stackviz: Adds unit tests for datasetservice, homeCtrl  https://review.openstack.org/23557820:38
asselinmtreinish, what does /etc/openstack-health.conf look like?20:38
mtreinishasselin: right now it's just: http://git.openstack.org/cgit/openstack-infra/puppet-openstack-health/tree/templates/openstack-health.conf.erb20:38
mtreinishasselin: there is a sample file packaged for local dev in etc/ in the openstack-health repo too20:39
openstackrecheckConsole logs not available after 13:28s for gate-tempest-dsvm-large-ops 238222,1,42a4a5b20:39
asselinyeah I haven't been looking at openstack-health...my patches are for elastic-recheck20:39
mtreinishasselin: sure, I just pinged you because I knew you just did the same thing for e-r20:40
mtreinishglauco__, david-lyle, regXboi, jhesketh, timothyb89: https://review.openstack.org/23824120:41
*** glauco__ is now known as glauco20:41
mtreinishto fix the fun failures on the prod server: http://paste.openstack.org/show/477077/20:41
regXboimtreinish: you want a "rage merge" on this one?20:42
*** achanda has joined #openstack-qa20:42
mtreinishregXboi: heh sure, it can't make it worse20:43
asselinmtreinish, not sure why taking out those defaults would fix/change anything20:43
* mtreinish just jinxed it20:43
mtreinishasselin: so I have my hacky workaround with the try except blocks20:43
regXboimtreinish: yeah you probably did20:43
mtreinishthat failure is caused by the real default mechanism trying to work and failing20:43
mtreinishtake that out of the equation it'll fall back to the hacky method which I tested locally as working20:44
regXboimtreinish: glauco__ beat me to it - so it's a real merge20:44
*** heyongli has quit IRC20:44
glaucoregXboi: sorry! Couldn't help doing my first A+20:44
glauco:)20:44
regXboiglauco: no worries :)20:45
*** amotoki has joined #openstack-qa20:45
*** heyongli has joined #openstack-qa20:45
* regXboi goes back to chasing race conditions20:45
*** achanda has quit IRC20:46
*** nic has quit IRC20:46
*** tnguyennc has quit IRC20:46
*** salv-orlando has joined #openstack-qa20:50
*** nadya has quit IRC20:50
*** tuannguyen has quit IRC20:51
openstackgerritMerged openstack/openstack-health: Stop trying to set defaults with the prescribed method  https://review.openstack.org/23824120:51
*** aopincar has joined #openstack-qa20:51
*** artom has quit IRC20:53
*** shardy has quit IRC20:54
*** austin81 has left #openstack-qa20:54
*** heyongli has quit IRC20:54
*** artom has joined #openstack-qa20:55
*** salv-orlando has quit IRC20:55
*** heyongli has joined #openstack-qa20:55
*** achanda has joined #openstack-qa20:57
openstackgerritMerged openstack/stackviz: Adds unit tests for datasetservice, homeCtrl  https://review.openstack.org/23557820:58
*** pc_m has quit IRC20:58
openstackgerritMerged openstack/tempest: Stop validating pre-provisioned credentials  https://review.openstack.org/23304021:00
*** heyongli has quit IRC21:05
*** heyongli has joined #openstack-qa21:06
*** achanda has quit IRC21:10
*** stevemar_ has joined #openstack-qa21:11
*** jongchoi_ has joined #openstack-qa21:11
*** ccarmack has quit IRC21:15
*** heyongli has quit IRC21:15
*** Swami has quit IRC21:15
*** heyongli has joined #openstack-qa21:16
*** Swami has joined #openstack-qa21:17
*** regXboi has quit IRC21:20
openstackrecheckConsole logs not available after 13:23s for gate-grenade-dsvm 231862,2,6b4e6ab21:22
*** ccarmack has joined #openstack-qa21:23
*** heyongli has quit IRC21:25
*** heyongli has joined #openstack-qa21:26
SpamapSmtreinish: oo, test_run_metadata finally finished21:28
SpamapS-rw-rw---- 1 mysql mysql  79G Oct 21 15:38 test_run_metadata.ibd21:29
mtreinishSpamapS: nice21:29
mtreinishwas that the last table it was working through?21:29
SpamapSno21:29
SpamapStest_runs now21:29
*** dspano has quit IRC21:29
SpamapSbut that one is going _WAY_ faster21:30
mtreinishheh, you can't win21:30
mtreinishSpamapS: hmm, that's surprising21:30
mtreinishit has more indexes and more data21:30
SpamapSweirder is that this box seems to be flushing stuff out of the VFS cache for no reason21:30
SpamapSOh hm, maybe its the 64GB I gave to mysql's buffer pool21:31
*** amotoki has quit IRC21:31
* mtreinish wishes he had one of those boxes21:31
SpamapSmtreinish: it's not all that great21:31
SpamapSthe I/O system is _REALLY_ slow21:31
SpamapSjust a RAID1 Megaraid on bad SATA21:31
mtreinishits just big numbers for bragging rights21:32
SpamapSI'd trade you this for an 8 core box with 10x SSD RAID1021:32
SpamapSwhoa wait21:33
SpamapSyou have an index on VALUE?21:33
SpamapSmtreinish: is that used?21:33
mtreinishthe biggest I have is an overclocked 4 core (with ht) box with 16GB of ram and 2x ssds not raided and a 10k rpm hdd21:33
mtreinishit is used on run_metadata to do some filtering, but it should be a composite index (key, value)21:34
mtreinishlike to filter jobs that ran as part of project foo21:34
SpamapS  Cardinality: 174542021:34
mtreinishor were build_name blah21:34
mtreinishSpamapS: devananda recommended I do it21:34
SpamapSmtreinish: well if you do select by those things, it's good21:34
SpamapSbut it's also a massive index, 1530 bytes per key21:35
SpamapSand there are 1.7 million keys.. ;)21:35
devanandamtreinish: ohhai21:35
mtreinishSpamapS: there are a few queries that do it: https://github.com/openstack-infra/subunit2sql/blob/master/subunit2sql/db/api.py#L28221:35
*** heyongli has quit IRC21:36
mtreinishSpamapS: well, on run_metadata it's used21:36
openstackrecheckConsole logs not available after 13:23s for gate-tempest-dsvm-postgres-full 238134,2,f58129d21:36
mtreinishI'm not sure we actually need it on test_run_metadata21:36
devanandamtreinish: this is re: our conversation in tel aviv, ya?21:36
mtreinishdevananda: yeah21:36
*** heyongli has joined #openstack-qa21:36
moravecmtrenish: is test_run_metadata really needed as a separate table?  Looks to me like attrs and tags *could* be added to test_runs as 1st class cols….21:37
SpamapSmtreinish: is that called by something else?21:37
mtreinishmoravec: they probably could21:37
mtreinishSpamapS: is what called by something else?21:38
mtreinishtest_run_metadata?21:38
*** nibalizer has joined #openstack-qa21:38
SpamapSmtreinish: "get_runs_by_key_value"21:39
SpamapSmtreinish: It's not used in the code base other than tests.21:39
mtreinishSpamapS: it's used by openstack-health's rest api21:40
SpamapSmtreinish: ah ok, so that's a truly public db api. ACK21:40
mtreinishSpamapS: https://github.com/openstack/openstack-health/blob/master/openstack_health/api.py#L6521:40
mtreinishSpamapS: I think there are a couple other functions which do similar key value filtering on run_metadata21:40
*** aopincar has quit IRC21:41
*** dmorita has joined #openstack-qa21:41
SpamapSmtreinish: ok, so this is another one where using latin1 (since it is just full of python identifiers right?) will probably just generally make everything better.21:41
*** dramalho has quit IRC21:41
mtreinishSpamapS: yeah latin1 should work there, I don't think any of the zuul metadata needs unicode21:42
clarkbuh21:43
clarkblet me think about that21:43
devanandaheh21:43
clarkbmtreinish: in theory all of our stuff is utf821:43
clarkbbut in practice I don't think we typically have any utf8 in use21:43
SpamapSlike, for intance, if we can get all of the keys in the join down to bigint size, and latin1's for the varchar(255)'s, it's possible we can just raise max_heap_table_size to big enough to fit the temptables in RAM..21:43
SpamapSand that will make those queries faster by a factor of 10-100 in my experience.21:43
mtreinishclarkb: yeah that's what I meant, in practice21:43
SpamapSIt would be good to actually explicitly state it in the API21:44
devanandamtreinish: what about test names where the test is asserting utf8 support, or for translation tests?21:44
SpamapSso there's no data loss21:44
devanandaI seem to remember a few of those, but I don't know if they're around // in the data set you're tracking21:44
clarkbya  Ithink you may have a sad time if you don't allow utf821:45
SpamapStags and attrs are never free form? Right? Are there other keys being considered that might have free-form user-significant strings in them?21:45
devanandaI'm looking but I'm fairly sure some test names include non-latin1 chars. and I'm sure some test data (and thus possible test output) does21:45
clarkbSpamapS: the test names themselves21:45
clarkbSpamapS: and potentially the job names21:46
SpamapStest names aren't always python ids?21:46
*** heyongli has quit IRC21:46
clarkbSpamapS: they are, python allows utf821:46
SpamapSoh wow21:46
SpamapSdid not know that21:46
devanandacould an assertion failure's output be captured in the "value" field here?21:46
clarkbyou have to set a pragma like thing in the source file but it works21:46
devanandaif so -- then we def need to support utf821:46
devanandaat least in that field21:46
*** heyongli has joined #openstack-qa21:47
SpamapSso21:47
SpamapSwe're flirting with "time to use elasticsearch" here21:47
SpamapSlooking at how this index is used..21:47
SpamapSit's just BARELY structured enough for the database.21:47
SpamapSsphinx, elasticsearch, solr, something, would do a much better job of querying unstructured arbitrary text.21:48
mtreinishSpamapS: well, it's kinda unstructured by design. because we want to keep subunit2sql general purpose21:48
mtreinishand the metadata is infra specific21:48
clarkbSpamapS: https://www.python.org/dev/peps/pep-0263/ if you end up being curious how you can use snowman as a variable name21:48
SpamapSmtreinish: sure, but you can't do unstructured search efficiently in mysql. Period.21:48
clarkbwe could postgres >_>21:49
devanandaSpamapS speaks truth21:49
SpamapSclarkb: piece_of_poo=snowman .. :-P21:49
SpamapSclarkb: same problem21:49
SpamapSit's not the query interface that is the problem21:49
SpamapSit's the storage model21:49
clarkbSpamapS: they claim that their unstructured search is faster than many of these reverse index db things21:49
*** Swami has quit IRC21:49
SpamapSIt's super awesome, no doubt.21:49
SpamapSBut you'll end up reimplementing elasticsearch or one of the other ones if you ever have to scale it beyond a few users and a largeish feed of data.21:50
moravecnot sure which queries are unstructured here?21:51
SpamapSmoravec: anything that touches key+value is just an attempt at wrangling the unstructured bit of the data.21:51
devanandaSpamapS: hey, I like k/v stores21:52
SpamapSdevananda: they are webscale21:52
moravecI'd say we could de-normalize a bit to boost performance - so instead of key/value, just make that data a real column.21:52
devanandaSpamapS: exactly21:52
SpamapSmoravec: except that would be a massive amount of data and not useful as an index. To search it..........21:53
* SpamapS points at search engines21:53
mtreinishmoravec: and we can't really do that because the metadata is deployment specific21:53
moravecbuild_name as a column would make a fine index21:53
mtreinishSpamapS: heh21:53
SpamapSif it is truly just _tags_, that works fine.21:54
devanandaSpamapS: at least it is key=key AND value=value ... it could be worse ...21:54
devanandaAND value LIKE '%value%'21:54
SpamapS"show me all the records where foo=bar" ... that can, totally, be handled in mysql21:54
SpamapSbut that is where the line is drawn.21:54
*** dmorita has quit IRC21:54
mtreinishSpamapS: I don't think we'll ever add more than that21:54
SpamapSYeah, LIKE == fail21:54
SpamapSwell, LIKE + %%21:54
SpamapSLIKE 'xxx%' is actually an o-k pattern with small keys. But it's almost never sufficient.21:55
devanandaSpamapS: WHERE foo=bar AND baz=kazoo; is also reasonable when there is a compound index on (foo, baz)21:55
clarkbwe do have a large elasticsearch cluster21:55
clarkbmtreinish: if you want to play with using an index on it thats fine with me21:55
SpamapSmtreinish: ok, but the length and content of the data is a problem. Can we at least wrangle key as a varchar(32) charset=latin1 ?21:55
clarkbmtreinish: but I will be doing a full cluster restart after the summit to upgrade21:55
mtreinishclarkb: I'll keep that in mind, I don't know when I'll get time to play around with that21:56
SpamapShaving key as short as possible will cut the index size nearly in half21:56
*** heyongli has quit IRC21:56
devanandaSpamapS: oh - I think this is the issue: https://github.com/openstack-infra/subunit2sql/blob/master/subunit2sql/db/models.py#L10621:56
mtreinishSpamapS: we might be able to, it depends on the zuul metadata I guess21:56
SpamapSlike, right now, key ends up as 765 bytes in each index entry.21:56
lifelessfail etc should be enumable21:56
openstackgerritTim Buckley proposed openstack/openstack-health: Remove unnecessary <base> tag.  https://review.openstack.org/23826621:56
clarkbmtreinish: its actually pretty easy to just start an elasticsearch locally too since they don't need any auth (can't do it een)21:56
timothyb89mtreinish: this should get things up and running ^^21:57
clarkbyou just get full api access like a boss21:57
devanandaPK is a UUID && the indexes are full length21:57
*** heyongli has joined #openstack-qa21:57
SpamapSlifeless: yeah I was thinking that too, having a key enum would be ideal, but mtreinish was worried maybe it won't be flexible enough that way I think.21:57
mtreinishSpamapS: for test_run.status it's fine21:57
SpamapSdevananda: yes I've already made a patch to do that...21:57
mtreinishwhich is what lifeless was talking about21:57
SpamapSdevananda: but sqlite hated me21:57
devanandaah21:58
devanandalolsqlite21:58
SpamapSI know21:58
SpamapS>:|21:58
* SpamapS would love to see scope wrangled back into just mysql21:58
devanandamtreinish: I thought I had suggested using BIGINT for all the keys, and using prefixes on the indexes ....21:58
SpamapSdevananda: I'm sure you did, because thats like, such a glaring thing.. :)21:58
devanandaya21:58
mtreinishdevananda: you did iirc, it was a matter of adding the migration to do that21:58
SpamapSdevananda: It's a rather tortuous migration, and I'm looking at what that will do to query performance now.21:58
mtreinishand I hadn;t gotten to it21:59
devanandaahh21:59
SpamapSbut.. I'm being naive loading data..21:59
devanandanor did I. clearly.21:59
SpamapSand it's been going 12 hours now, and will take at least 8 more.21:59
timothyb89glauco, david-lyle: any chance you can take a look at this patch? https://review.openstack.org/#/c/238266/21:59
moravecmtrenish: ok, I understand if there are other usecases than the example query you asked me to evaluate….but in that instance, changing from key/value to specific columns would avoid a biga$$ join21:59
moravecWHERE run_metadata.`key` = 'build_name' AND run_metadata.value = 'gate-tempest-dsvm-full’21:59
moravecbecomes21:59
moravecWHERE runs.build_name = 'gate-tempest-dsvm-full’21:59
mtreinishtimothyb89: if someone doesn't beat me to it, I'll +a when jenkins gets back22:00
timothyb89mtreinish: ah, okay, cool22:00
mtreinishit's simple enough and needed now that we're hosting that for reals22:00
*** Swami has joined #openstack-qa22:01
mtreinishmoravec: sure I understand what you're saying, but there are other use cases which we can't really discard22:01
mtreinishits just causing headaches for the infra db22:01
mtreinishwhich is much bigger than any other use case22:01
SpamapSmoravec: that join is only a problem because the joi keys are so damn big.22:01
SpamapSjoin22:02
*** tpeoples has quit IRC22:02
SpamapSmoravec: joining on bigints would be NBD22:02
*** jongchoi_ has quit IRC22:02
moravecmtrenish: ok, got it. unfortunately it seems we cannot implement the logic to query the db as-is, though…so I was trying to think of ways to optimize22:02
*** openstackrecheck has quit IRC22:04
*** openstackrecheck has joined #openstack-qa22:04
*** jongchoi_ has joined #openstack-qa22:05
mtreinishtimothyb89: ok, +A22:05
timothyb89mtreinish: thanks!22:06
mtreinishI got to run right now, I'll check back in a bit to see if that fixes it22:06
timothyb89cool, fingers crossed22:06
*** heyongli has quit IRC22:06
*** cody-somerville has quit IRC22:06
*** jamielennox|away is now known as jamielennox22:07
*** heyongli has joined #openstack-qa22:07
*** jongchoi_ has quit IRC22:10
openstackgerritMerged openstack/openstack-health: Remove unnecessary <base> tag.  https://review.openstack.org/23826622:15
clarkbI would expect puppet to pick up ^ in ~15 minutes22:16
clarkbthough puppetboard should give a much better indication22:16
openstackgerritImran Hayder Malik proposed openstack/tempest: Add logging to hostname_equals_servername function  https://review.openstack.org/21013222:16
*** heyongli has quit IRC22:17
*** pc_m has joined #openstack-qa22:17
*** pglass_ has quit IRC22:17
*** heyongli has joined #openstack-qa22:17
*** rfolco has quit IRC22:19
*** vgridnev has quit IRC22:19
*** salv-orlando has joined #openstack-qa22:22
timothyb89clarkb: puppetboard seems to think it finished, but I'm not seeing the changes reflected22:24
clarkbtimothyb89: have you cached the files?22:24
timothyb89clarkb: ah, I may have misread, looks like there should still be some tasks remaining22:25
timothyb89clarkb: that, or move-static-files isn't running22:26
clarkbdoesn't look like a cahce problem22:27
*** heyongli has quit IRC22:27
*** heyongli has joined #openstack-qa22:27
clarkbthe trigger wasn't fired22:28
clarkbtimothyb89: the build dir looks correct, so it did build, not sure why it idnd't mv22:33
timothyb89clarkb: that's good at least22:33
clarkbthe files in the /srv/static path definitely didn't update so the mv never fired22:33
*** dimtruck is now known as zz_dimtruck22:35
*** jecarey has quit IRC22:36
*** jasonsb has quit IRC22:37
*** pc_m has quit IRC22:37
*** heyongli has quit IRC22:37
openstackrecheckConsole logs not available after 13:24s for gate-cinder-pep8 238255,1,916258522:38
*** heyongli has joined #openstack-qa22:38
*** salv-orlando has quit IRC22:40
*** jasonsb has joined #openstack-qa22:42
openstackgerritMerged openstack/tempest: Remove CredentialProvider deps to CONF  https://review.openstack.org/18514922:43
*** gszasz has quit IRC22:44
*** heyongli has quit IRC22:47
*** heyongli has joined #openstack-qa22:48
*** mfisher_ora has quit IRC22:49
*** tnguyennc has joined #openstack-qa22:53
*** otherwiseguy has quit IRC22:53
*** heyongli has quit IRC22:58
*** rbak has quit IRC22:58
*** heyongli has joined #openstack-qa22:59
*** sabeen2 has quit IRC23:01
*** tnguyennc has left #openstack-qa23:03
*** heyongli has quit IRC23:08
*** markvoelker has quit IRC23:08
*** heyongli has joined #openstack-qa23:09
*** nicholasgoracke has joined #openstack-qa23:09
*** otherwiseguy has joined #openstack-qa23:11
*** heyongli has quit IRC23:18
*** yamamoto has joined #openstack-qa23:18
*** heyongli has joined #openstack-qa23:19
*** mfalatic has quit IRC23:22
*** diegows has joined #openstack-qa23:23
*** weshay has quit IRC23:23
*** nicholasgoracke has quit IRC23:24
*** yamamoto has quit IRC23:26
*** amotoki has joined #openstack-qa23:28
*** heyongli has quit IRC23:28
*** dims_ has joined #openstack-qa23:29
*** heyongli has joined #openstack-qa23:29
*** dims__ has joined #openstack-qa23:31
*** dims has quit IRC23:31
*** amotoki has quit IRC23:33
*** dims_ has quit IRC23:34
*** nicholasgoracke has joined #openstack-qa23:37
*** salv-orlando has joined #openstack-qa23:37
*** Swami has quit IRC23:38
*** heyongli has quit IRC23:39
*** heyongli has joined #openstack-qa23:40
*** tochi has joined #openstack-qa23:40
*** dmellado has quit IRC23:40
*** ccneill has joined #openstack-qa23:42
*** oomichi has joined #openstack-qa23:43
*** ccneill has quit IRC23:48
*** heyongli has quit IRC23:49
*** heyongli has joined #openstack-qa23:50
*** aysyd has quit IRC23:52
*** yamamoto has joined #openstack-qa23:55
*** salv-orlando has quit IRC23:57
*** heyongli has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!