Thursday, 2016-03-03

*** toddjohn_ has joined #openstack-mistral00:27
*** toddjohn_ has quit IRC00:31
larrie_kongto everyone here, I'm Lingxian, I changed my nickname, again. actually I'm not a fun of changing name frequently, but a good friend of NZ gave me an English name, Larris Kong(I didn't have a 'formal' English name before), and I like it so much. So, I decide to also change my irc name to larris. I surfix kong in the end just in case you didn't recognize me.00:35
larrie_kongok, back to work. rakhmerov, are we ready for m-3?00:36
larrie_kongi think today is the deadline00:36
larrie_kongooh, sorry, s/larris/larre, still don't get used to it00:37
larrie_kongf**k, wrong again, Larrie Kong, I'm Larrie, I'm Larrie, ok, Larrie, I like it.00:40
larrie_kongCTRL+L00:41
openstackgerritWinson Chan proposed openstack/python-mistralclient: Fix cacert and insecure options on HTTP requests  https://review.openstack.org/28694200:47
larrie_kongnmakhotkin, akuznetsova , please help to review https://review.openstack.org/#/c/286288/, we need it to be merged in mistral-spec m-300:49
*** larrie_kong is now known as kong01:04
*** cheneydc has joined #openstack-mistral01:06
openstackgerritWinson Chan proposed openstack/python-mistralclient: Fix cacert and insecure options on HTTP requests  https://review.openstack.org/28694201:20
openstackgerritCheney proposed openstack/mistral: Fix the problem when parse config file  https://review.openstack.org/28754901:32
*** ninag has joined #openstack-mistral01:37
*** ninag has quit IRC01:37
*** bobh has joined #openstack-mistral01:37
*** bobh has quit IRC01:45
*** openstackgerrit has quit IRC01:47
*** openstackgerrit has joined #openstack-mistral01:48
*** bobh has joined #openstack-mistral01:50
*** bobh has quit IRC01:55
kongping nmakhotkin02:00
kongping rakhmerov02:01
*** bobh has joined #openstack-mistral02:50
*** achanda has joined #openstack-mistral03:11
*** igormarnat has quit IRC03:26
*** nmakhotkin has quit IRC03:26
*** nmakhotkin has joined #openstack-mistral03:26
*** igormarnat_ has joined #openstack-mistral03:26
*** igormarnat_ is now known as igormarnat03:26
*** bobh has quit IRC03:30
openstackgerritMerged openstack/mistral: Add release notes for M-3  https://review.openstack.org/28628503:51
*** achanda has quit IRC04:28
*** achanda has joined #openstack-mistral05:11
rakhmerov:))06:17
rakhmerovkong: still here?06:19
rakhmerovif yes, for how long?06:19
rakhmerovkong: no problems from my side to make a release06:22
rakhmerov_gryf: on functional/unit tests, what you said is right to me. It's basically how we try to organize tests in Mistral06:25
rakhmerovMaybe I'm missing something, I just didn't understand what else you think we should do to make it more clear06:26
rakhmerov?06:26
*** jtomasek has joined #openstack-mistral06:33
_gryfrakhmerov, If I run the tox -e unit in mistral, there is a several services spining out, isn't it?06:50
_gryfs/tox -eunit/tox -epy27/06:51
_gryfwhich in unit tests does not happen usually (i'm comparing it mostly how in Nova tests are organized)06:51
_gryfrakhmerov, also, FWIW, unit tests should run fast. Mistral isn't a huge project, therefore I'd expect, that ut with a building the env by tox would take at most a minute or so.06:53
_gryffrankly, I've never been able to run the tests succesfully on my local machine06:54
_gryfrakhmerov, maybe i'm missing something obvious, or I have a bad luck, or just stupid (cannot exlude anything of those ;)06:55
*** bhaskarduvvuri has joined #openstack-mistral06:55
rakhmerov_gryf: what several services do you mean?06:56
_gryfbut for some reason the only environment I succesfully run the tests was 1core virtual machine06:56
_gryfrakhmerov, not sure. doesn't executors are spined out to take the job out of the tests code?06:57
rakhmerov_gryf: hm... it's weird. On my machine they always run successfully :)06:57
_gryfrakhmerov, so it must bve definitely something with my env :D06:57
rakhmerov_gryf: no, unit tests don't spin up anything06:57
rakhmerovif it really happens (and I'll see an evidence of that) this should be considered as a huge bug06:58
rakhmerovand we gotta fix it asap06:58
rakhmerovunit tests only run fake transport (in-memory MQ) and sqlite DB, that's it06:58
_gryfrakhmerov, http://paste.openstack.org/show/489087/ this is the output from yesterday06:58
rakhmerovno api servers, no rabbit, no mysql, no executors as separate processes06:59
_gryfthere was a lot more output like that06:59
rakhmerovyes, I see06:59
rakhmerovok, let me be honest with you06:59
rakhmerovI quite know why it's happening06:59
rakhmerovit's because we still have concurrent bugs in the code07:00
rakhmerovmy guess is that no so many but we do07:00
_gryfmhmm07:00
_gryfso the code is racy, or the tests?07:00
rakhmerovI believe both07:00
_gryfbummer07:00
rakhmerovand especially they occur in unit tests07:00
rakhmerovit's not so bad, don't worry :)07:00
rakhmerovto the great extent it's related with using sqlite in unit tests07:01
rakhmerovbecause it's not a decent production DB07:01
_gryfright07:01
rakhmerovso some things designed based on TX knowledge etc. may not work properly with sqlite07:01
rakhmerovit's a known problem07:01
_gryfyeah07:02
_gryfgot it.07:02
rakhmerovthat's why we also added a gate to run everything against postgres07:02
rakhmerovbut it's not 100% finished07:02
_gryfalthough in my understanding all things based on db communication in UT shouldn't be cut off?07:02
rakhmerovwe need to finish it07:02
_gryfi mean07:02
rakhmerovand create similar gate for mysql07:02
_gryfshouldn't we operate on the objects only, without touching the db?07:03
rakhmerov_gryf: no, practically it's impossible07:03
rakhmerovwe need some mock for a DB anyway07:03
rakhmerovtoo many things are related to that07:03
rakhmerovthat mock in our case is sqlite07:04
rakhmerova solution that I see is something like:07:04
rakhmerov1. Investigate and understand typical problems caused by using sqlite07:04
rakhmerov2. Create tooling specifically for UT to workaround these problems and use them in UT07:05
rakhmerov3. Complete gates to run UT against Mysql and Postgres w/o those workarounds07:05
rakhmerovthat will give us confidence that all is fine07:06
_gryfok, got that. btw, how can I set up the tests to be executed against postgre?07:07
rakhmerovooh, let me see07:08
rakhmerovthere was an CLI option to do that07:08
_gryfif the sqlite is the problem, maybe it would be easier for me to set up the proper db engine and use it for the tests locally07:08
rakhmerovyes, maybe07:08
rakhmerovthe problem with a normal DB is that tests don't run in parallel07:09
rakhmerovbecause they share a real DB07:09
_gryfok07:09
rakhmerovso they run sequentially and take very long time (look at our postgres gate)07:09
_gryfso the tests take more time07:09
rakhmerovyeah07:09
rakhmerovof course, it could be solved too07:09
rakhmerovbut it's not yet07:09
rakhmerov~24 min for the gate07:10
rakhmerovnot really usable for the local development07:10
_gryfright. it's way too long07:11
rakhmerov./run_tests.sh -V --db-type postgresql07:11
rakhmerovthis is how our gate runs tests07:11
_gryfrakhmerov, thanks, i'll try that07:12
rakhmerovok07:12
_gryfand see how it's troublesome for me :)07:12
_gryfok, running the tests. so far so good :)07:17
openstackgerritMerged openstack/mistral-specs: Copy implemented spec files to the implemented folder  https://review.openstack.org/28628807:19
*** tshtilma has joined #openstack-mistral07:20
*** achanda has quit IRC07:31
*** achanda has joined #openstack-mistral07:49
*** tshtilma has quit IRC07:50
*** bhaskarduvvuri has quit IRC07:57
*** bhaskarduvvuri has joined #openstack-mistral08:02
*** bhaskarduvvuri has quit IRC08:14
*** achanda has quit IRC08:32
*** LimorStotland has joined #openstack-mistral08:41
_gryfrakhmerov, Ran 381 tests in 3605.433s FAILED (failures=58, skipped=5)09:05
rakhmerovwooohoo09:05
rakhmerovthat's pretty bad09:05
rakhmerovI assume that something is wrong with your environment09:05
_gryfthat's possible :)09:06
rakhmerovneed to look at logs09:06
_gryfalthough it's a plain ubuntu 14.04 with devstack on it09:06
_gryfwhere can i find them?09:08
*** bhaskarduvvuri has joined #openstack-mistral09:18
*** LimorStotland has quit IRC09:30
*** LimorStotland has joined #openstack-mistral09:31
*** openstackgerrit_ has joined #openstack-mistral09:54
*** openstackgerrit_ has quit IRC10:02
*** cheneydc has quit IRC10:02
kongguys, mistral for m-3 have been released. https://review.openstack.org/#/c/287690/10:31
*** tshtilma has joined #openstack-mistral10:41
*** bhaskarduvvuri has quit IRC11:08
*** toddjohn_ has joined #openstack-mistral11:21
*** toddjohn_ has quit IRC11:26
*** LimorStotland has quit IRC11:28
*** LimorStotland has joined #openstack-mistral11:53
*** LimorStotland has quit IRC11:57
*** openstackgerrit has quit IRC12:03
*** openstackgerrit has joined #openstack-mistral12:03
*** LimorStotland has joined #openstack-mistral12:27
*** dprince has joined #openstack-mistral12:40
*** dprince has quit IRC12:46
*** LimorStotland has quit IRC12:51
*** dprince has joined #openstack-mistral12:53
*** bhaskarduvvuri has joined #openstack-mistral12:59
*** tshtilma has quit IRC13:25
*** toddjohn_ has joined #openstack-mistral13:28
*** xenogear has quit IRC13:36
*** bhaskarduvvuri has quit IRC13:41
*** ninag has joined #openstack-mistral13:42
*** tshtilma has joined #openstack-mistral13:44
*** xenogear has joined #openstack-mistral14:00
*** toddjohn_ has quit IRC14:03
*** toddjohn_ has joined #openstack-mistral14:03
*** toddjohn_ has quit IRC14:08
*** bobh has joined #openstack-mistral14:24
*** toddjohn_ has joined #openstack-mistral14:38
*** LimorStotland has joined #openstack-mistral14:46
*** LimorStotland has quit IRC14:48
*** vgnbkr_ has joined #openstack-mistral15:17
*** achanda has joined #openstack-mistral15:33
*** tshtilma has quit IRC15:33
*** achanda has quit IRC15:39
*** tshtilma has joined #openstack-mistral15:42
*** ninag has quit IRC16:57
*** ninag has joined #openstack-mistral17:01
*** gyee has joined #openstack-mistral17:01
*** ninag_ has joined #openstack-mistral17:02
*** ninag has quit IRC17:05
*** ninag_ has quit IRC17:06
*** toddjohn_ has quit IRC17:09
*** toddjohn_ has joined #openstack-mistral17:09
*** toddjohn_ has quit IRC17:14
*** bobh has quit IRC17:25
*** toddjohn_ has joined #openstack-mistral17:26
*** tshtilma has quit IRC17:37
*** ninag has joined #openstack-mistral17:52
*** ninag_ has joined #openstack-mistral17:52
*** ninag has quit IRC17:56
*** bobh has joined #openstack-mistral18:08
*** Ephur has joined #openstack-mistral18:12
*** Ephur_ has joined #openstack-mistral18:16
*** Ephur has quit IRC18:18
*** tshtilma has joined #openstack-mistral18:46
*** gyee has quit IRC18:46
*** Ephur_ has quit IRC20:10
*** xenogear has quit IRC20:48
*** xenogear has joined #openstack-mistral20:50
*** gyee has joined #openstack-mistral20:55
*** vgnbkr_ has quit IRC21:02
*** tshtilma has quit IRC21:29
*** bobh has quit IRC21:53
*** toddjohn_ has quit IRC21:54
*** bobh has joined #openstack-mistral22:00
*** bobh has quit IRC22:02
*** Ephur has joined #openstack-mistral22:06
*** jtomasek has quit IRC22:19
*** dprince has quit IRC22:36
*** toddjohn_ has joined #openstack-mistral22:38
*** ninag_ has quit IRC22:47
*** toddjohn_ has quit IRC22:54
*** toddjohn_ has joined #openstack-mistral22:54
*** toddjohn_ has quit IRC22:55
*** toddjohn_ has joined #openstack-mistral22:55
*** toddjohn_ has quit IRC23:26

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!