Thursday, 2016-06-23

*** tqtran has quit IRC00:03
*** stevemar has quit IRC00:13
*** stevemar has joined #openstack-trove00:14
*** stevemar has quit IRC00:18
*** stevemar has joined #openstack-trove00:29
*** stevemar has quit IRC00:49
*** stevemar has joined #openstack-trove00:50
*** cheneydc has joined #openstack-trove00:58
*** stevemar has quit IRC01:00
*** stevemar has joined #openstack-trove01:00
*** imandhan has quit IRC01:05
*** stevemar has quit IRC01:05
*** imandhan has joined #openstack-trove01:05
*** imandhan has quit IRC01:10
*** imandhan has joined #openstack-trove01:10
*** stevemar has joined #openstack-trove01:13
*** jinxing has joined #openstack-trove01:28
*** cdelatte has quit IRC01:38
*** stevemar has quit IRC01:40
*** stevemar has joined #openstack-trove01:40
*** jinxing has quit IRC01:44
*** jinxing has joined #openstack-trove01:45
*** jinxing has quit IRC01:49
*** abruanese has quit IRC01:50
*** tqtran has joined #openstack-trove02:01
*** tqtran has quit IRC02:05
*** stevemar has quit IRC02:14
*** jinxing has joined #openstack-trove02:32
*** stevemar has joined #openstack-trove02:34
*** imandhan has quit IRC02:37
*** imandhan has joined #openstack-trove02:38
*** stevemar has quit IRC02:39
*** imandhan has quit IRC02:43
*** jinxing has quit IRC02:44
*** jinxing has joined #openstack-trove02:47
*** stevemar has joined #openstack-trove02:57
*** stevemar has quit IRC03:20
*** stevemar has joined #openstack-trove03:28
*** stevemar has quit IRC03:32
*** stevemar has joined #openstack-trove03:35
*** stevemar has quit IRC03:35
*** stevemar has joined #openstack-trove03:36
*** links has joined #openstack-trove03:51
*** sgotliv_ has joined #openstack-trove04:05
*** diga has joined #openstack-trove04:33
*** cheneydc has quit IRC05:10
*** jinxing has quit IRC05:34
*** diga has quit IRC05:36
*** jinxing has joined #openstack-trove05:37
*** tqtran has joined #openstack-trove06:02
*** tqtran has quit IRC06:06
*** rcernin has joined #openstack-trove06:15
*** imandhan has joined #openstack-trove06:18
haypohello. as i wrote in https://review.openstack.org/#/c/322195/ : backup.test_backup_models test fails randomly. i would like to try to reproduce the issue locally, but i'm not sure how to run the unit test?06:45
*** imandhan has quit IRC07:02
*** rcernin has quit IRC07:02
*** tesseract- has joined #openstack-trove07:13
*** tesseract- has quit IRC07:14
*** tesseract- has joined #openstack-trove07:14
*** rcernin has joined #openstack-trove07:17
*** jinxing has quit IRC08:03
*** diga has joined #openstack-trove08:15
haypoamrith: hello. i saw that Petr Malik ran the Jenkins job multiple times on my https://review.openstack.org/#/c/322195/ "Run Python 3 unit tests in parallel" change, i understood that it was to ensure that the job was stable08:32
haypoamrith: i noticed that backup.test_backup_models was unstable and so i blacklisted it on python 3, until we understand why08:33
haypoamrith: since i removed it (removed in patch set 10), jenkins succeeded twice which is good :)08:34
haypoamrith: i'm trying to say that i wasn't 100% confident that my change was stable, but without backup.test_backup_models it looks like it *is* now stable ;)08:34
*** rcernin has quit IRC08:50
*** rcernin has joined #openstack-trove09:02
*** tqtran has joined #openstack-trove09:03
*** tqtran has quit IRC09:08
*** dmk0202 has joined #openstack-trove09:09
*** pcaruana has joined #openstack-trove09:51
*** tosky has joined #openstack-trove09:55
*** sgotliv__ has joined #openstack-trove09:56
*** sgotliv_ has quit IRC09:57
*** dmk0202 has quit IRC10:29
*** ewilson has joined #openstack-trove10:32
*** ewilson has quit IRC10:36
amrithhaypo, to run the unit test locally I run python -m testtools.run ... test class ...10:41
amrithI don't know how you'd do this in python34 or whether the same thing woudl work10:42
amrithi notice that there's only one patch remaining to merge on the python34 blueprint; I assume you'll be pushing up more?10:42
amrithyou should read the notes from yesterday's trove meeting and https://review.openstack.org/#/c/332933/10:43
haypoamrith: well, using testtools.run & tox -e py34, backup.test_backup_models doesn't fail here...10:44
haypoamrith: should i setup a database to run the unit test?10:44
amrithnot to run unittests10:45
amrithbut is it a unit test that is unstable?10:45
*** miqui has joined #openstack-trove10:46
amrithare you talking about the failure:10:46
amrithbackup.test_backup_models.BackupORMTest.test_list_for_instance10:46
amrithhttp://logs.openstack.org/95/322195/5/check/gate-trove-python34-db/81f9f68/console.html.gz#_2016-06-15_09_15_18_70410:46
haypoamrith: backup.test_backup_models failed once on python 3 for an unknown reason, http://logs.openstack.org/95/322195/9/check/gate-trove-python34-db/65710dc/10:46
haypoamrith: i chose to blacklist it to investigate later10:47
haypoamrith: hum. http://logs.openstack.org/95/322195/5/check/gate-trove-python34-db/81f9f68/console.html.gz#_2016-06-15_09_15_18_704 failed with ...CREATE TABLE...,10:48
amrith<blanket-disclaimer. I THINK>10:48
amriththe issue you have is that the parallelism is somehow broken10:48
haypobut http://logs.openstack.org/95/322195/9/check/gate-trove-python34-db/65710dc/ failed 3 times : 2 ALTER TABLE, 1 CREATE TABLE10:48
amrithand multiple threads are running through migrations10:48
amrithand are attempting to recreate the trove schema10:48
amrithWhat's the number in {%d}10:48
amrithis that the test thread ?10:49
haypo"{%d}" <= i don't know what you are talking about10:49
amrithif so, then I'd look for example at the failure at http://logs.openstack.org/95/322195/9/check/gate-trove-python34-db/65710dc/console.html#_2016-06-22_03_32_06_70776910:49
amrithin the output line10:49
amrith2016-06-22 03:31:58.535132 | {5} taskmanager.test_vertica_clusters.VerticaTaskManagerStrategyTest.test_task_manager_api_class [0.000442s] ... ok10:49
amrithWhat is {5}10:49
amrith2016-06-22 03:27:41.442187 | {5} backup.test_backup_models.BackupCreateTest.test_create_backup_swift_token_invalid [0.140276s] ... FAILED10:50
amrithwhat is {5}10:50
haypoamrith: ah, probably the worker process identifier from 0 to 710:50
amrithSo I'd see what test that ran before that already created the table in question10:51
amrithor already performed the alter table in question10:51
amriththe test isn't stable10:51
amrithbecause the testing framework is likely picking tests to run in a non-deterministic way10:51
haypoamrith: python 2.7 also runs tests in parallel using 8 processes, http://logs.openstack.org/95/322195/9/check/gate-trove-python27-db/190e9d4/console.html10:51
amrithyes, but maybe with different dependencies10:51
amrithand a different (potentially) safe sequence10:51
amrithmaybe the problem exists in py2710:51
haypobut python 3.4 is more verbose *thanks to* os-testr10:52
amrithbut we just don't hit it10:52
amrithfor some other reason or reasons10:52
amrithI'm not pointing to py34 being the problem10:52
amrithmaybe the dependencies are wrong10:52
haypoamrith: i wouldn't be surprised if python 2 already has the bug10:52
amritheventually, you are attempting to do something that has already been done10:52
amrithcreating a table10:52
haypofor me, it became common to "find" bugs with python 3 which already existed before10:52
amrithaltering a table10:52
amriththat is good10:52
amrithi think that's what testing is about10:52
haypoit took us 2 weeks to identify a race condition in glance, the bug exists in python 2 as well10:52
amrith2 weeks to find a race condition is nothing10:53
amrithhard ones take years10:53
haypoamrith: does trove use a real mysql database?10:53
haypo"hard ones take years" haha10:53
amrithin these tests it uses sqllite10:53
amrithwhat do you mean 'haha'10:53
haypoamrith: haha = lol10:53
haypoin french10:53
amrithwell, I know what it means10:53
amrithI guess you've never dealt with bugs like that10:53
haypoamrith: each test cannot use a separated and temporary database?10:54
amrithit would be kind of expensive10:54
haypoah10:54
hayposo you should maybe disable parallelism :) or put a lock10:54
haypoamrith: for following changes: i'm waiting that you approve my latest py3 trove change ;)10:55
amrithi see now why you think race conditions that take years to find are a laughing matter.10:56
amrithThe last car I owned was paid for by finding one such bug.10:56
amrithor shall we say explaining one such bug.10:56
haypoif such bug is blocking a project, you can fix it quickly by investing more resources on it10:58
haypousually, such bug is so rare that nobody cares10:58
haypofor example, here a single recheck worls around it ;)10:58
haypoworks*10:59
amrithlet me find my copy of the "Mythical Man Month"11:00
openstackgerritVictor Stinner proposed openstack/trove: Replace MySQL-Python with PyMySQL  https://review.openstack.org/33325811:12
openstackgerritVictor Stinner proposed openstack/trove: Port test_pagination on Python 3  https://review.openstack.org/33326211:16
haypoamrith: ^^ ok, a few more changes11:16
*** amrith has quit IRC11:16
*** amrith has joined #openstack-trove11:17
openstackgerritVictor Stinner proposed openstack/trove: Port galera and redis cluster tests to Python 3  https://review.openstack.org/33326711:25
*** dmk0202 has joined #openstack-trove11:33
*** xb_ has joined #openstack-trove11:48
*** diga has quit IRC12:06
*** M00nr41n has quit IRC12:37
*** aliadil has joined #openstack-trove12:39
*** Ravikiran_K has joined #openstack-trove12:50
openstackgerritVictor Stinner proposed openstack/trove: Replace MySQL-Python with PyMySQL  https://review.openstack.org/33325813:16
*** catintheroof has joined #openstack-trove13:32
*** Ravikiran_K has quit IRC13:53
*** itisha has joined #openstack-trove13:55
*** ewilson has joined #openstack-trove13:56
*** diga has joined #openstack-trove13:57
*** diga has quit IRC14:12
*** trevormc has joined #openstack-trove14:15
*** kfox1111 is now known as kfox1111_away14:17
*** abruanese has joined #openstack-trove14:33
*** links has quit IRC14:41
*** pcaruana has quit IRC14:41
*** amit213 has quit IRC15:04
*** tqtran has joined #openstack-trove15:06
*** tqtran has quit IRC15:10
*** haypo has quit IRC15:21
*** haypo has joined #openstack-trove15:24
openstackgerritVictor Stinner proposed openstack/trove: Switch from MySQL-python to PyMySQL  https://review.openstack.org/18440015:26
*** dmk0202 has quit IRC15:46
*** xb_ has quit IRC15:57
*** xb_ has joined #openstack-trove16:03
*** tesseract- has quit IRC16:17
*** johnma has joined #openstack-trove16:23
*** M00nr41n has joined #openstack-trove17:02
*** M00nr41n has quit IRC17:09
*** tqtran has joined #openstack-trove17:13
*** M00nr41n has joined #openstack-trove17:22
*** tosky has quit IRC17:34
*** rcernin has quit IRC17:38
*** imandhan has joined #openstack-trove17:44
*** tosky has joined #openstack-trove17:54
*** M00nr41n has quit IRC18:29
*** georgelorch has quit IRC18:38
*** georgelorch has joined #openstack-trove18:50
*** xb_ has quit IRC19:00
*** amit213 has joined #openstack-trove19:00
*** sgotliv__ has quit IRC19:14
*** tellesnobrega has left #openstack-trove19:23
*** arist has quit IRC19:44
*** arist has joined #openstack-trove19:45
openstackgerritMerged openstack/trove: Update 'myisam-recover-options' config template  https://review.openstack.org/31527119:53
*** abruanese has quit IRC20:27
*** itisha has quit IRC20:27
*** ctracey has quit IRC20:27
*** zigo has quit IRC20:27
*** dalees has quit IRC20:27
*** _hanhart has quit IRC20:27
*** zacksh_ has quit IRC20:27
*** dalees has joined #openstack-trove20:27
*** abruanese has joined #openstack-trove20:28
*** zacksh has joined #openstack-trove20:28
*** zigo has joined #openstack-trove20:29
*** ctracey has joined #openstack-trove20:29
*** itisha has joined #openstack-trove20:31
openstackgerritMerged openstack/trove-integration: Add another 'fault' flavor  https://review.openstack.org/31656620:58
*** aliadil has quit IRC21:07
*** ozialien10 has quit IRC21:08
*** catintheroof has quit IRC21:21
*** ewilson has quit IRC21:24
*** tosky has quit IRC22:28
*** trevormc has quit IRC22:33
*** dkehn has joined #openstack-trove22:38
*** dkehn has quit IRC22:41
*** irdkehn has joined #openstack-trove22:42
openstackgerritPetr Malik proposed openstack/trove: Use common methods for cluster validation  https://review.openstack.org/32068722:44
*** dkehn_ has joined #openstack-trove22:45
*** rcernin has joined #openstack-trove23:16

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!