*** tqtran has quit IRC | 00:03 | |
*** stevemar has quit IRC | 00:13 | |
*** stevemar has joined #openstack-trove | 00:14 | |
*** stevemar has quit IRC | 00:18 | |
*** stevemar has joined #openstack-trove | 00:29 | |
*** stevemar has quit IRC | 00:49 | |
*** stevemar has joined #openstack-trove | 00:50 | |
*** cheneydc has joined #openstack-trove | 00:58 | |
*** stevemar has quit IRC | 01:00 | |
*** stevemar has joined #openstack-trove | 01:00 | |
*** imandhan has quit IRC | 01:05 | |
*** stevemar has quit IRC | 01:05 | |
*** imandhan has joined #openstack-trove | 01:05 | |
*** imandhan has quit IRC | 01:10 | |
*** imandhan has joined #openstack-trove | 01:10 | |
*** stevemar has joined #openstack-trove | 01:13 | |
*** jinxing has joined #openstack-trove | 01:28 | |
*** cdelatte has quit IRC | 01:38 | |
*** stevemar has quit IRC | 01:40 | |
*** stevemar has joined #openstack-trove | 01:40 | |
*** jinxing has quit IRC | 01:44 | |
*** jinxing has joined #openstack-trove | 01:45 | |
*** jinxing has quit IRC | 01:49 | |
*** abruanese has quit IRC | 01:50 | |
*** tqtran has joined #openstack-trove | 02:01 | |
*** tqtran has quit IRC | 02:05 | |
*** stevemar has quit IRC | 02:14 | |
*** jinxing has joined #openstack-trove | 02:32 | |
*** stevemar has joined #openstack-trove | 02:34 | |
*** imandhan has quit IRC | 02:37 | |
*** imandhan has joined #openstack-trove | 02:38 | |
*** stevemar has quit IRC | 02:39 | |
*** imandhan has quit IRC | 02:43 | |
*** jinxing has quit IRC | 02:44 | |
*** jinxing has joined #openstack-trove | 02:47 | |
*** stevemar has joined #openstack-trove | 02:57 | |
*** stevemar has quit IRC | 03:20 | |
*** stevemar has joined #openstack-trove | 03:28 | |
*** stevemar has quit IRC | 03:32 | |
*** stevemar has joined #openstack-trove | 03:35 | |
*** stevemar has quit IRC | 03:35 | |
*** stevemar has joined #openstack-trove | 03:36 | |
*** links has joined #openstack-trove | 03:51 | |
*** sgotliv_ has joined #openstack-trove | 04:05 | |
*** diga has joined #openstack-trove | 04:33 | |
*** cheneydc has quit IRC | 05:10 | |
*** jinxing has quit IRC | 05:34 | |
*** diga has quit IRC | 05:36 | |
*** jinxing has joined #openstack-trove | 05:37 | |
*** tqtran has joined #openstack-trove | 06:02 | |
*** tqtran has quit IRC | 06:06 | |
*** rcernin has joined #openstack-trove | 06:15 | |
*** imandhan has joined #openstack-trove | 06:18 | |
haypo | hello. as i wrote in https://review.openstack.org/#/c/322195/ : backup.test_backup_models test fails randomly. i would like to try to reproduce the issue locally, but i'm not sure how to run the unit test? | 06:45 |
---|---|---|
*** imandhan has quit IRC | 07:02 | |
*** rcernin has quit IRC | 07:02 | |
*** tesseract- has joined #openstack-trove | 07:13 | |
*** tesseract- has quit IRC | 07:14 | |
*** tesseract- has joined #openstack-trove | 07:14 | |
*** rcernin has joined #openstack-trove | 07:17 | |
*** jinxing has quit IRC | 08:03 | |
*** diga has joined #openstack-trove | 08:15 | |
haypo | amrith: hello. i saw that Petr Malik ran the Jenkins job multiple times on my https://review.openstack.org/#/c/322195/ "Run Python 3 unit tests in parallel" change, i understood that it was to ensure that the job was stable | 08:32 |
haypo | amrith: i noticed that backup.test_backup_models was unstable and so i blacklisted it on python 3, until we understand why | 08:33 |
haypo | amrith: since i removed it (removed in patch set 10), jenkins succeeded twice which is good :) | 08:34 |
haypo | amrith: i'm trying to say that i wasn't 100% confident that my change was stable, but without backup.test_backup_models it looks like it *is* now stable ;) | 08:34 |
*** rcernin has quit IRC | 08:50 | |
*** rcernin has joined #openstack-trove | 09:02 | |
*** tqtran has joined #openstack-trove | 09:03 | |
*** tqtran has quit IRC | 09:08 | |
*** dmk0202 has joined #openstack-trove | 09:09 | |
*** pcaruana has joined #openstack-trove | 09:51 | |
*** tosky has joined #openstack-trove | 09:55 | |
*** sgotliv__ has joined #openstack-trove | 09:56 | |
*** sgotliv_ has quit IRC | 09:57 | |
*** dmk0202 has quit IRC | 10:29 | |
*** ewilson has joined #openstack-trove | 10:32 | |
*** ewilson has quit IRC | 10:36 | |
amrith | haypo, to run the unit test locally I run python -m testtools.run ... test class ... | 10:41 |
amrith | I don't know how you'd do this in python34 or whether the same thing woudl work | 10:42 |
amrith | i notice that there's only one patch remaining to merge on the python34 blueprint; I assume you'll be pushing up more? | 10:42 |
amrith | you should read the notes from yesterday's trove meeting and https://review.openstack.org/#/c/332933/ | 10:43 |
haypo | amrith: well, using testtools.run & tox -e py34, backup.test_backup_models doesn't fail here... | 10:44 |
haypo | amrith: should i setup a database to run the unit test? | 10:44 |
amrith | not to run unittests | 10:45 |
amrith | but is it a unit test that is unstable? | 10:45 |
*** miqui has joined #openstack-trove | 10:46 | |
amrith | are you talking about the failure: | 10:46 |
amrith | backup.test_backup_models.BackupORMTest.test_list_for_instance | 10:46 |
amrith | http://logs.openstack.org/95/322195/5/check/gate-trove-python34-db/81f9f68/console.html.gz#_2016-06-15_09_15_18_704 | 10:46 |
haypo | amrith: backup.test_backup_models failed once on python 3 for an unknown reason, http://logs.openstack.org/95/322195/9/check/gate-trove-python34-db/65710dc/ | 10:46 |
haypo | amrith: i chose to blacklist it to investigate later | 10:47 |
haypo | amrith: hum. http://logs.openstack.org/95/322195/5/check/gate-trove-python34-db/81f9f68/console.html.gz#_2016-06-15_09_15_18_704 failed with ...CREATE TABLE..., | 10:48 |
amrith | <blanket-disclaimer. I THINK> | 10:48 |
amrith | the issue you have is that the parallelism is somehow broken | 10:48 |
haypo | but http://logs.openstack.org/95/322195/9/check/gate-trove-python34-db/65710dc/ failed 3 times : 2 ALTER TABLE, 1 CREATE TABLE | 10:48 |
amrith | and multiple threads are running through migrations | 10:48 |
amrith | and are attempting to recreate the trove schema | 10:48 |
amrith | What's the number in {%d} | 10:48 |
amrith | is that the test thread ? | 10:49 |
haypo | "{%d}" <= i don't know what you are talking about | 10:49 |
amrith | if so, then I'd look for example at the failure at http://logs.openstack.org/95/322195/9/check/gate-trove-python34-db/65710dc/console.html#_2016-06-22_03_32_06_707769 | 10:49 |
amrith | in the output line | 10:49 |
amrith | 2016-06-22 03:31:58.535132 | {5} taskmanager.test_vertica_clusters.VerticaTaskManagerStrategyTest.test_task_manager_api_class [0.000442s] ... ok | 10:49 |
amrith | What is {5} | 10:49 |
amrith | 2016-06-22 03:27:41.442187 | {5} backup.test_backup_models.BackupCreateTest.test_create_backup_swift_token_invalid [0.140276s] ... FAILED | 10:50 |
amrith | what is {5} | 10:50 |
haypo | amrith: ah, probably the worker process identifier from 0 to 7 | 10:50 |
amrith | So I'd see what test that ran before that already created the table in question | 10:51 |
amrith | or already performed the alter table in question | 10:51 |
amrith | the test isn't stable | 10:51 |
amrith | because the testing framework is likely picking tests to run in a non-deterministic way | 10:51 |
haypo | amrith: python 2.7 also runs tests in parallel using 8 processes, http://logs.openstack.org/95/322195/9/check/gate-trove-python27-db/190e9d4/console.html | 10:51 |
amrith | yes, but maybe with different dependencies | 10:51 |
amrith | and a different (potentially) safe sequence | 10:51 |
amrith | maybe the problem exists in py27 | 10:51 |
haypo | but python 3.4 is more verbose *thanks to* os-testr | 10:52 |
amrith | but we just don't hit it | 10:52 |
amrith | for some other reason or reasons | 10:52 |
amrith | I'm not pointing to py34 being the problem | 10:52 |
amrith | maybe the dependencies are wrong | 10:52 |
haypo | amrith: i wouldn't be surprised if python 2 already has the bug | 10:52 |
amrith | eventually, you are attempting to do something that has already been done | 10:52 |
amrith | creating a table | 10:52 |
haypo | for me, it became common to "find" bugs with python 3 which already existed before | 10:52 |
amrith | altering a table | 10:52 |
amrith | that is good | 10:52 |
amrith | i think that's what testing is about | 10:52 |
haypo | it took us 2 weeks to identify a race condition in glance, the bug exists in python 2 as well | 10:52 |
amrith | 2 weeks to find a race condition is nothing | 10:53 |
amrith | hard ones take years | 10:53 |
haypo | amrith: does trove use a real mysql database? | 10:53 |
haypo | "hard ones take years" haha | 10:53 |
amrith | in these tests it uses sqllite | 10:53 |
amrith | what do you mean 'haha' | 10:53 |
haypo | amrith: haha = lol | 10:53 |
haypo | in french | 10:53 |
amrith | well, I know what it means | 10:53 |
amrith | I guess you've never dealt with bugs like that | 10:53 |
haypo | amrith: each test cannot use a separated and temporary database? | 10:54 |
amrith | it would be kind of expensive | 10:54 |
haypo | ah | 10:54 |
haypo | so you should maybe disable parallelism :) or put a lock | 10:54 |
haypo | amrith: for following changes: i'm waiting that you approve my latest py3 trove change ;) | 10:55 |
amrith | i see now why you think race conditions that take years to find are a laughing matter. | 10:56 |
amrith | The last car I owned was paid for by finding one such bug. | 10:56 |
amrith | or shall we say explaining one such bug. | 10:56 |
haypo | if such bug is blocking a project, you can fix it quickly by investing more resources on it | 10:58 |
haypo | usually, such bug is so rare that nobody cares | 10:58 |
haypo | for example, here a single recheck worls around it ;) | 10:58 |
haypo | works* | 10:59 |
amrith | let me find my copy of the "Mythical Man Month" | 11:00 |
openstackgerrit | Victor Stinner proposed openstack/trove: Replace MySQL-Python with PyMySQL https://review.openstack.org/333258 | 11:12 |
openstackgerrit | Victor Stinner proposed openstack/trove: Port test_pagination on Python 3 https://review.openstack.org/333262 | 11:16 |
haypo | amrith: ^^ ok, a few more changes | 11:16 |
*** amrith has quit IRC | 11:16 | |
*** amrith has joined #openstack-trove | 11:17 | |
openstackgerrit | Victor Stinner proposed openstack/trove: Port galera and redis cluster tests to Python 3 https://review.openstack.org/333267 | 11:25 |
*** dmk0202 has joined #openstack-trove | 11:33 | |
*** xb_ has joined #openstack-trove | 11:48 | |
*** diga has quit IRC | 12:06 | |
*** M00nr41n has quit IRC | 12:37 | |
*** aliadil has joined #openstack-trove | 12:39 | |
*** Ravikiran_K has joined #openstack-trove | 12:50 | |
openstackgerrit | Victor Stinner proposed openstack/trove: Replace MySQL-Python with PyMySQL https://review.openstack.org/333258 | 13:16 |
*** catintheroof has joined #openstack-trove | 13:32 | |
*** Ravikiran_K has quit IRC | 13:53 | |
*** itisha has joined #openstack-trove | 13:55 | |
*** ewilson has joined #openstack-trove | 13:56 | |
*** diga has joined #openstack-trove | 13:57 | |
*** diga has quit IRC | 14:12 | |
*** trevormc has joined #openstack-trove | 14:15 | |
*** kfox1111 is now known as kfox1111_away | 14:17 | |
*** abruanese has joined #openstack-trove | 14:33 | |
*** links has quit IRC | 14:41 | |
*** pcaruana has quit IRC | 14:41 | |
*** amit213 has quit IRC | 15:04 | |
*** tqtran has joined #openstack-trove | 15:06 | |
*** tqtran has quit IRC | 15:10 | |
*** haypo has quit IRC | 15:21 | |
*** haypo has joined #openstack-trove | 15:24 | |
openstackgerrit | Victor Stinner proposed openstack/trove: Switch from MySQL-python to PyMySQL https://review.openstack.org/184400 | 15:26 |
*** dmk0202 has quit IRC | 15:46 | |
*** xb_ has quit IRC | 15:57 | |
*** xb_ has joined #openstack-trove | 16:03 | |
*** tesseract- has quit IRC | 16:17 | |
*** johnma has joined #openstack-trove | 16:23 | |
*** M00nr41n has joined #openstack-trove | 17:02 | |
*** M00nr41n has quit IRC | 17:09 | |
*** tqtran has joined #openstack-trove | 17:13 | |
*** M00nr41n has joined #openstack-trove | 17:22 | |
*** tosky has quit IRC | 17:34 | |
*** rcernin has quit IRC | 17:38 | |
*** imandhan has joined #openstack-trove | 17:44 | |
*** tosky has joined #openstack-trove | 17:54 | |
*** M00nr41n has quit IRC | 18:29 | |
*** georgelorch has quit IRC | 18:38 | |
*** georgelorch has joined #openstack-trove | 18:50 | |
*** xb_ has quit IRC | 19:00 | |
*** amit213 has joined #openstack-trove | 19:00 | |
*** sgotliv__ has quit IRC | 19:14 | |
*** tellesnobrega has left #openstack-trove | 19:23 | |
*** arist has quit IRC | 19:44 | |
*** arist has joined #openstack-trove | 19:45 | |
openstackgerrit | Merged openstack/trove: Update 'myisam-recover-options' config template https://review.openstack.org/315271 | 19:53 |
*** abruanese has quit IRC | 20:27 | |
*** itisha has quit IRC | 20:27 | |
*** ctracey has quit IRC | 20:27 | |
*** zigo has quit IRC | 20:27 | |
*** dalees has quit IRC | 20:27 | |
*** _hanhart has quit IRC | 20:27 | |
*** zacksh_ has quit IRC | 20:27 | |
*** dalees has joined #openstack-trove | 20:27 | |
*** abruanese has joined #openstack-trove | 20:28 | |
*** zacksh has joined #openstack-trove | 20:28 | |
*** zigo has joined #openstack-trove | 20:29 | |
*** ctracey has joined #openstack-trove | 20:29 | |
*** itisha has joined #openstack-trove | 20:31 | |
openstackgerrit | Merged openstack/trove-integration: Add another 'fault' flavor https://review.openstack.org/316566 | 20:58 |
*** aliadil has quit IRC | 21:07 | |
*** ozialien10 has quit IRC | 21:08 | |
*** catintheroof has quit IRC | 21:21 | |
*** ewilson has quit IRC | 21:24 | |
*** tosky has quit IRC | 22:28 | |
*** trevormc has quit IRC | 22:33 | |
*** dkehn has joined #openstack-trove | 22:38 | |
*** dkehn has quit IRC | 22:41 | |
*** irdkehn has joined #openstack-trove | 22:42 | |
openstackgerrit | Petr Malik proposed openstack/trove: Use common methods for cluster validation https://review.openstack.org/320687 | 22:44 |
*** dkehn_ has joined #openstack-trove | 22:45 | |
*** rcernin has joined #openstack-trove | 23:16 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!