Tuesday, 2016-01-26

*** dshulyak has joined #openstack-solar05:54
openstackgerritDmitry Shulyak proposed openstack/solar: Add upstart config for solar-worker  https://review.openstack.org/27066507:44
openstackgerritDmitry Shulyak proposed openstack/solar: Implement timelimit mechanism based on tracking of tasks  https://review.openstack.org/27076608:23
openstackgerritDmitry Shulyak proposed openstack/solar: Support configurable retries on orchestration layer  https://review.openstack.org/27203608:42
openstackgerritDmitry Shulyak proposed openstack/solar: Improve fixtures for functional tests  https://review.openstack.org/27206508:42
openstackgerritDmitry Shulyak proposed openstack/solar: Remove duplicated code in orchestration/scheduler  https://review.openstack.org/27213008:42
*** salmon_ has joined #openstack-solar09:19
pigmejhello dima :)09:20
dshulyakhi09:28
pigmejdshulyak: so https://review.openstack.org/#/c/271446/4/solar/dblayer/solar_models.py@123809:30
pigmejfirst there then I can add comment to code but it will be huge or useless09:30
dshulyak:) can you make it small and usefull?09:31
pigmejhard09:31
pigmej:D09:31
pigmejso we need to update because DB knows the missing part09:31
pigmejin concurrent env (with siblings enabled) we could have siblings there09:31
dshulyakso after save self.lockers wont be updated, even if there is different res[‘lockers’] in response09:33
pigmejwell, it will be because of conflict resolver09:34
pigmejbut our dblayer will be unaware of this09:35
pigmejso I added this part to fix this problem09:35
pigmejbecause in dblayer we assume that whatever we store => is correct, and will be not altered, which is *not* the case in locking + siblings09:35
pigmejbecause other concurrent process could store some data too, so db returns data may be missing for us09:36
dshulyaki would expect that if i save and i have conflict - than my data in dblayer will be concistent with resolved one09:36
pigmejyeah, after this save it is09:37
pigmejI could later add more pretty solution for that09:37
pigmejand somehow make it transparent09:38
dshulyakit seems to me that it should be done in conflict_resolver09:38
pigmejyup09:38
*** nihilifer has joined #openstack-solar09:38
pigmejthat's what I meant by "more pretty solution"09:38
pigmejhey nihilifer :)09:38
nihiliferhey pigmej09:39
salmon_dshulyak: how can I test all your changes? Do you have a branch with all changes?09:55
dshulyakthey should be ordered, but looks like init script is not in tree09:58
pigmejdshulyak: they conflict a bit09:58
dshulyakhm09:58
pigmejtimelimit conflict with zerorpc tree09:59
pigmejI did manual merge, then some code review only09:59
pigmejbecause we need to merge it asap then fix09:59
pigmejbecause it's already too big :D09:59
dshulyakyeah, i messed up the order at some point10:00
dshulyaki will do rebases now10:00
*** dshulyak has quit IRC10:01
*** dshulyak has joined #openstack-solar10:02
dshulyakrebased, now you can git checkout -d 272130 (it is the latest patchset), and then start solar-worker in foreground or vagrant provision solar-dev10:21
dshulyakoh crap, this one conflicts with one of mine - https://review.openstack.org/#/c/271446/10:22
dshulyakwe should merge it probably10:22
dshulyaksalmon_: pigmej ^10:22
pigmejyeah10:26
pigmejnow wait for jenkins :D10:26
openstackgerritMerged openstack/solar: Fix locking problems  https://review.openstack.org/27144610:29
openstackgerritDmitry Shulyak proposed openstack/solar: Implement timelimit mechanism based on tracking of tasks  https://review.openstack.org/27076610:40
openstackgerritDmitry Shulyak proposed openstack/solar: Add implementation of puller with pool of threads and tracking of tasks  https://review.openstack.org/27076510:40
openstackgerritDmitry Shulyak proposed openstack/solar: Support configurable retries on orchestration layer  https://review.openstack.org/27203610:40
openstackgerritDmitry Shulyak proposed openstack/solar: Improve fixtures for functional tests  https://review.openstack.org/27206510:40
openstackgerritDmitry Shulyak proposed openstack/solar: Re-start sqlite session before retry and after succesful acquire  https://review.openstack.org/27118010:40
openstackgerritDmitry Shulyak proposed openstack/solar: Add upstart config for solar-worker  https://review.openstack.org/27066510:40
openstackgerritDmitry Shulyak proposed openstack/solar: Remove duplicated code in orchestration/scheduler  https://review.openstack.org/27213010:40
openstackgerritDmitry Shulyak proposed openstack/solar: Zerorpc worker for orchestration modules  https://review.openstack.org/26916610:40
dshulyakpigmej: salmon_ : ok, now there should be no conflicts and everything should work both with sqlite and riak10:40
salmon_dshulyak: ok, thx10:40
dshulyakbut for jenkins we will need another /etc/default/solar-worker variables10:42
dshulyakhm or not10:43
dshulyakyou have vagrant user there10:43
salmon_yup10:44
openstackgerritJedrzej Nowak proposed openstack/solar: Bump version to 0.2.0  https://review.openstack.org/27246610:54
pigmejdshulyak: merge and review11:00
pigmejpbr enforces that11:00
dshulyak0.1.1 ?11:01
dshulyaki guess it doesnt matter11:02
pigmej0.1.1 would be fix for 0.111:03
openstackgerritDmitry Shulyak proposed openstack/solar: Support configurable retries on orchestration layer  https://review.openstack.org/27203611:21
openstackgerritMerged openstack/solar: Bump version to 0.2.0  https://review.openstack.org/27246611:38
pigmejdshulyak: https://review.openstack.org/#/c/272036/ still conflicts for me11:42
openstackgerritDmitry Shulyak proposed openstack/solar: Improve fixtures for functional tests  https://review.openstack.org/27206511:45
openstackgerritDmitry Shulyak proposed openstack/solar: Remove duplicated code in orchestration/scheduler  https://review.openstack.org/27213011:45
dshulyakpigmej: please try again11:46
openstackgerritDmitry Shulyak proposed openstack/solar: Timeout support for scheduled tasks  https://review.openstack.org/27250112:15
openstackgerritJedrzej Nowak proposed openstack/solar: Fix incorrect ansible_library path  https://review.openstack.org/27254313:57
pigmejsalmon_: ^13:58
salmon_dshulyak: pigmej all examples are working with new worker :)14:36
dshulyakcool14:37
pigmejyeah :)14:38
pigmejdshulyak: we're going to merge it ;) fixes later;D14:38
pigmejbtw after your recent changes we probably should enhance our hadlers for "progress" capability, isn't iT?14:38
dshulyakyeah, now we have more options14:41
pigmej:)14:41
dshulyakriak ate halt of my memory14:45
dshulyakit is only 500 m, but still :)14:46
pigmej?14:46
pigmejbitcask ?14:46
dshulyakno, leveldb14:46
dshulyakbasically i already restarted vm + added more memory, so i will debug more next time14:47
pigmejhmm, leveldb shouldn't cache that much14:52
pigmejbut it's configurabel14:52
pigmejit's like 30% of all memory by default14:52
pigmej:)14:52
openstackgerritMerged openstack/solar: Zerorpc worker for orchestration modules  https://review.openstack.org/26916615:00
openstackgerritMerged openstack/solar: Add upstart config for solar-worker  https://review.openstack.org/27066515:01
openstackgerritDmitry Shulyak proposed openstack/solar: Fix simple statistics of a plan execution  https://review.openstack.org/27257415:01
pigmejdshulyak: you should start wokring on documentation ;d15:04
pigmejworking*15:04
openstackgerritMerged openstack/solar: Re-start sqlite session before retry and after succesful acquire  https://review.openstack.org/27118015:04
*** dshulyak has quit IRC15:25
*** dshulyak has joined #openstack-solar15:26
openstackgerritTomasz 'Zen' Napierala proposed openstack/solar: Added internal architecture diagram and fixed some doc errors  https://review.openstack.org/27258815:26
openstackgerritMerged openstack/solar: Added internal architecture diagram and fixed some doc errors  https://review.openstack.org/27258815:43
openstackgerritMerged openstack/solar: Add implementation of puller with pool of threads and tracking of tasks  https://review.openstack.org/27076515:46
openstackgerritMerged openstack/solar: Implement timelimit mechanism based on tracking of tasks  https://review.openstack.org/27076615:46
openstackgerritMerged openstack/solar: Support configurable retries on orchestration layer  https://review.openstack.org/27203615:46
openstackgerritMerged openstack/solar: Improve fixtures for functional tests  https://review.openstack.org/27206515:47
openstackgerritMerged openstack/solar: Remove duplicated code in orchestration/scheduler  https://review.openstack.org/27213015:47
openstackgerritMerged openstack/solar: Timeout support for scheduled tasks  https://review.openstack.org/27250115:47
pigmejhttps://review.openstack.org/#/c/272543/ dshulyak please review :)16:42
*** salmon_ has quit IRC17:05
*** salmon_ has joined #openstack-solar17:05
*** bogdando has quit IRC17:06
dshulyakwow you merged all my stuff17:10
openstackgerritMerged openstack/solar: Fix incorrect ansible_library path  https://review.openstack.org/27254317:15
*** openstackgerrit has quit IRC17:17
*** openstackgerrit has joined #openstack-solar17:17
*** bogdando has joined #openstack-solar17:19
pigmejdshulyak: yeah we did, is it wrong ?17:20
pigmej:)17:20
salmon_dshulyak: should we revert it? :P17:21
pigmejsalmon_: `push -f` :P17:21
openstackgerritJedrzej Nowak proposed openstack/solar: Removed global ansible library  https://review.openstack.org/27213517:22
pigmejit's rebased salmon_ dshulyak17:24
openstackgerritLukasz Oles proposed openstack/solar: Clean repository after removing celery  https://review.openstack.org/27266317:26
dshulyak-1 for revert17:27
dshulyaki was just surprised17:27
dshulyakany interesting updates on configdb?17:27
openstackgerritLukasz Oles proposed openstack/solar: Clean repository after removing celery  https://review.openstack.org/27266317:27
pigmejdshulyak: not yet, because they came to office like 5PM17:28
pigmejwhy this https://review.openstack.org/#/c/272574/ waits forever ?17:29
dshulyakpigmej: what do you mean? jenkins?17:31
pigmejyeah17:31
openstackgerritJedrzej Nowak proposed openstack/solar: Fix simple statistics of a plan execution  https://review.openstack.org/27257417:35
pigmejdshulyak: I rebased your change :)17:36
dshulyakyou decided to help it17:36
pigmejyup17:37
pigmejit was not even in queue :P17:37
*** salmon_ has quit IRC17:52
openstackgerritMerged openstack/solar: Fix simple statistics of a plan execution  https://review.openstack.org/27257417:53
*** dshulyak has quit IRC19:37
*** angdraug has joined #openstack-solar21:12

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!