Friday, 2015-01-30

*** kgriffs|afk is now known as kgriffs00:07
*** bradjones has quit IRC00:56
*** fifieldt has quit IRC01:00
*** bradjones has joined #openstack-zaqar01:00
*** amitgandhinz has joined #openstack-zaqar01:17
*** achanda_ has joined #openstack-zaqar01:19
*** achanda has quit IRC01:23
*** achanda_ has quit IRC01:24
*** amitgandhinz has quit IRC01:28
*** bradjones has quit IRC02:00
*** amalagon has quit IRC02:00
*** bradjones has joined #openstack-zaqar02:02
*** kgriffs is now known as kgriffs|afk02:12
*** bradjones has quit IRC03:00
openstackgerritFei Long Wang proposed openstack/zaqar: Add REST API for notification/subscriptions  https://review.openstack.org/14243203:00
*** bradjones has joined #openstack-zaqar03:03
*** amalagon has joined #openstack-zaqar03:11
*** amalagon has quit IRC03:15
*** kgriffs|afk is now known as kgriffs03:16
*** kgriffs is now known as kgriffs|afk03:25
*** bradjones has quit IRC03:30
*** cpallares has joined #openstack-zaqar03:31
*** bradjones has joined #openstack-zaqar03:37
*** flwang has quit IRC03:37
*** flwang has joined #openstack-zaqar03:52
openstackgerritFei Long Wang proposed openstack/zaqar: Implement webhook notifier driver  https://review.openstack.org/15152904:12
*** flwang has quit IRC04:12
*** achanda has joined #openstack-zaqar04:36
*** achanda has quit IRC04:40
*** achanda has joined #openstack-zaqar04:49
*** amalagon has joined #openstack-zaqar05:01
*** diga has joined #openstack-zaqar05:04
*** achanda has quit IRC05:20
*** achanda has joined #openstack-zaqar05:31
*** achanda has quit IRC05:41
*** achanda has joined #openstack-zaqar05:58
*** echevemaster has quit IRC06:09
openstackgerritOpenStack Proposal Bot proposed openstack/zaqar: Imported Translations from Transifex  https://review.openstack.org/15154906:23
*** achanda has quit IRC06:24
*** achanda has joined #openstack-zaqar06:25
*** achanda has quit IRC06:54
*** exploreshaifali has joined #openstack-zaqar08:03
exploreshaifaligoooooooooood morning!!!08:19
*** amalagon has quit IRC08:25
*** amalagon has joined #openstack-zaqar08:25
*** exploreshaifali has quit IRC09:58
*** jasondotstar has quit IRC12:12
*** exploreshaifali has joined #openstack-zaqar13:58
*** sriram has joined #openstack-zaqar14:10
*** jasondotstar has joined #openstack-zaqar14:15
*** openstackstatus has joined #openstack-zaqar14:21
*** ChanServ sets mode: +v openstackstatus14:21
-openstackstatus- NOTICE: zuul isn't running jobs since ~10:30 utc, investigation underway14:26
*** ChanServ changes topic to "zuul isn't running jobs since ~10:30 utc, investigation underway"14:26
*** mpanetta has joined #openstack-zaqar14:32
*** miqui_ has joined #openstack-zaqar14:39
*** ametts has joined #openstack-zaqar15:04
*** amitgandhinz has joined #openstack-zaqar15:04
vkmchelloooo15:28
kragnizoooolleh15:28
exploreshaifaliheeeoooolllll15:29
exploreshaifali:P15:29
cpallaresehllooo15:30
vkmcppuuuuuuusthaw!15:30
cpallares.reverof siht ekil gnipyt trats dluohs ew ebyaM15:32
exploreshaifalivkmc, pleas can we continue with decoupling message_controller and QueueController ?15:32
exploreshaifalivkmc, https://etherpad.openstack.org/p/exploreshaifali-opw-split-layers15:32
vkmccpallares, doog sdnuos15:33
vkmcexploreshaifali, sure, I have to finish some stuff first... in the mean time, are you already familiar on how the pipeline works?15:33
exploreshaifalivkmc, I am not much familiar but yes of course I will keep digging :)15:34
vkmcexploreshaifali, ok, its crutial we understand how are things managed in that side in order to use it and add the missing feature :)15:34
exploreshaifaliokay vkmc Thanks!15:35
kragniz!sdrawkcab kcin ym sthgilhgih issri ym gniht doog :serallapc15:35
openstackkragniz: Error: "sdrawkcab" is not a valid command.15:35
vkmcexploreshaifali, also, if you have a moment, I'd really appreciate if you can help us with the reviews15:36
vkmcmoar eyes the better!15:36
exploreshaifalivkmc, yes yes sure15:37
exploreshaifaliI was looking at flwang1's subscription patch, but everything seemed correct to me15:37
*** achanda has joined #openstack-zaqar15:37
cpallareslol15:38
cpallares !emosewa si tahT :zingark15:39
vkmcexploreshaifali, cool!15:39
vkmcexploreshaifali, make him happy with a +1 then :P15:39
exploreshaifalivkmc, okay :D15:39
*** achanda has quit IRC15:43
*** kragniz is now known as zingark15:53
*** vkmc is now known as cmkv16:03
exploreshaifalilol :D16:04
cmkvI dare you exploreshaifali16:05
*** exploreshaifali is now known as ilafiahserolpxe16:05
*** sriram is now known as marris16:05
* marris likes his new name16:06
* cmkv too16:06
ilafiahserolpxeyes marris looks good16:06
*** marris is now known as marirs16:06
* marirs just re-encoded himself16:06
* cmkv imagine using this nick for the openstack summits16:06
cmkv'oh you are msklfmsdf on irc right?'16:07
marirsha16:07
zingarkhaha16:07
marirscomplete anonymity16:07
marirskinda like tor, hehe.16:08
ilafiahserolpxelol16:08
cmkvhahaha marirs +1!16:08
* marirs assigns bugs to aidfhlaksdfgj, next day there is no aidfhlaksdfgj16:09
marirseveryones random again.16:09
marirshaha16:09
cmkvaahhaha16:09
cmkvnobody fix anything16:09
cmkvthis is boris-42 fault16:09
ilafiahserolpxeboris-42,  will be 24-sirob16:11
ilafiahserolpxesirob too looks good16:11
marirsjust imagine if somebody's name is a palindrome, heh.16:12
cmkvthat would be the best nick ever16:12
ilafiahserolpxevkmcmkv16:13
cmkvI like how you think ilafiahserolpxe16:13
cmkv:P16:13
ilafiahserolpxeaahhh /me didn't look nice :|16:13
ilafiahserolpxesriramarirs16:14
ilafiahserolpxe^ looks good :D16:14
*** ChanServ changes topic to "OpenStack Queuing and Notification Service || Smile :D || Meetings every Monday @ 21:00 UTC/15:00 UTC || Wiki: https://wiki.openstack.org/wiki/Zaqar || Paste: http://paste.openstack.org/ || Send messages and make some noise :D"16:14
-openstackstatus- NOTICE: zuul is running again and changes have been reenqueud. seehttp://status.openstack.org/zuul/ before rechecking if in doubt16:14
marirshaha16:16
marirsits like bond, james bond16:17
marirsmarirs, sriram marirs.16:17
marirsI like that :D16:17
boris-42cmkv: lol?16:18
boris-42cmkv: my fault?)16:18
zingarkboris-42: it's sometimes your fault16:19
cmkvboris-42, I don't know, you tell me16:19
ilafiahserolpxewe all are reading from backward to see what is boris-42's fault :P16:19
ilafiahserolpxereverse engineering16:19
boris-42lol16:20
ilafiahserolpxe:D16:20
boris-42I need more alcohol16:20
ilafiahserolpxeI need another nick name16:20
boris-42lol16:20
zingarkboris-42: akdov16:20
*** cpallares is now known as serallapc16:21
ilafiahserolpxelohocla16:21
cmkvboris-42, you gave vodka to zingark again and he started all this nonsense16:21
serallapcI've joined the trend.16:21
ilafiahserolpxesense-non zingark16:21
boris-42doolbniakdov16:22
ilafiahserolpxeserallapc, pu ti peek16:22
zingarkserallapc: emoclew16:22
ilafiahserolpxelol16:22
ilafiahserolpxehey lol is palindrome16:23
ilafiahserolpxe**lol**16:23
boris-42cmkvkmc16:23
*** mpanetta has quit IRC16:29
*** mpanetta has joined #openstack-zaqar16:30
*** amalagon has quit IRC16:32
serallapchi mpanetta16:33
*** amalagon has joined #openstack-zaqar16:33
ilafiahserolpxempanetta, is confused who is serallapc16:33
ilafiahserolpxeattenapm16:34
*** jasondotstar has quit IRC16:36
*** amalagon has quit IRC16:37
mpanettaHi :)16:40
mpanettaMan you guys all rotate your nicks? lol16:41
mpanettaOh16:41
mpanettaReversed them16:41
cmkvno16:41
* cmkv puts innocent face16:41
zingarkI'd never do such a devious thing16:42
mpanettaUh huh16:42
*** kgriffs|afk is now known as kgriffs16:42
cmkvkgriffs did that16:42
mpanettaSure, blame him :P16:43
ilafiahserolpxewho is blaming kgriffs ??16:52
ilafiahserolpxeno one did that :P16:52
ilafiahserolpxeall was boris-42 fault16:52
kgriffsadmit it, you guys miss me. ;)16:53
ilafiahserolpxeno no one do that sffirgk16:53
serallapchaha true kgriffs16:54
*** amalagon has joined #openstack-zaqar16:54
serallapcIt's harder to blame stuff on kgriffs when he's not around :P16:55
ilafiahserolpxelol16:55
kgriffsindeed. :)16:56
*** zingark is now known as krangiz17:07
*** krangiz is now known as kragniz17:07
*** ilafiahserolpxe has quit IRC17:38
*** cmkv has quit IRC18:08
*** diga_ has joined #openstack-zaqar18:10
*** vkmc has joined #openstack-zaqar18:13
*** vkmc has quit IRC18:13
*** vkmc has joined #openstack-zaqar18:13
*** achanda has joined #openstack-zaqar18:16
*** serallapc is now known as cpallares18:29
-openstackstatus- NOTICE: Gerrit and Zuul will be offline from 1900 to 1930 UTC for project renames18:43
*** achanda has quit IRC18:44
*** achanda has joined #openstack-zaqar18:45
-openstackstatus- NOTICE: Gerrit and Zuul are offline until 1930 UTC for project renames19:09
*** ChanServ changes topic to "Gerrit and Zuul are offline until 1930 UTC for project renames"19:09
*** marirs is now known as sriram19:10
*** jasondotstar has joined #openstack-zaqar19:10
mpanettaAell crap19:10
mpanettaI guess that means no prs can be merged today19:11
*** flwang has joined #openstack-zaqar19:23
*** ChanServ changes topic to "OpenStack Queuing and Notification Service || Smile :D || Meetings every Monday @ 21:00 UTC/15:00 UTC || Wiki: https://wiki.openstack.org/wiki/Zaqar || Paste: http://paste.openstack.org/ || Send messages and make some noise :D"19:31
-openstackstatus- NOTICE: Gerrit is back online19:32
*** exploreshaifali has joined #openstack-zaqar19:36
exploreshaifalivkmc, whenever you will get time, we need to discuss about message_controller solution.19:55
vkmcexploreshaifali, sure20:01
vkmcexploreshaifali, did you already check the pipeline usage in the storage driver?20:01
exploreshaifalivkmc, I am trying to understand its code there20:02
exploreshaifalistorage/pipeling20:03
vkmcexploreshaifali, cool20:03
vkmcif you check out bootstrap.py20:03
vkmcwe initialize the pipeline with the controllers20:03
vkmcrequired for the storage to work20:04
exploreshaifalivkmc, https://github.com/openstack/zaqar/blob/master/zaqar/bootstrap.py#L10720:05
*** openstackgerrit has quit IRC20:06
*** openstackgerrit has joined #openstack-zaqar20:07
vkmcexploreshaifali, exactly20:11
exploreshaifaliyes20:11
vkmcthe else branch covers the case in which we are not using pooling20:11
vkmcnow, if you check out what this does https://github.com/openstack/zaqar/blob/master/zaqar/bootstrap.py#L10420:11
vkmcnope, sorry20:12
vkmcL10820:13
vkmccalls this https://github.com/openstack/zaqar/blob/master/zaqar/storage/pipeline.py20:13
vkmcwhich creates for every single controller a pipeline20:13
exploreshaifalivkmc, so for any storage service/action we are calling pipeline.DataDriver ?20:15
exploreshaifalis/any/every20:15
vkmcyeah20:16
vkmcso basically, what flavio suggested to do, is add a method in the messagecontroller20:16
vkmcthat will be inside the pipeline20:17
vkmcand when a queue_purge is requested, we get that method from the pipeline and proceed to remove all the messages20:17
vkmcbut the queuecontroller doesn't have a messagecontroller20:17
vkmcexploreshaifali, does that make sense?20:21
exploreshaifalivkmc, first I want to know, here pipeline work as entry point ?20:21
exploreshaifalior what pipeline stand for here ?20:21
*** flwang has quit IRC20:24
exploreshaifaliand re solution - I need to add a class something like QueueMessageHandler inside mongodb/messages https://github.com/openstack/zaqar/blob/master/zaqar/storage/mongodb/messages.py#L12020:25
exploreshaifaliright?20:25
exploreshaifalibut what I am suppose to define in that class ?20:26
vkmcyeah, the pipeline work as a entry point20:27
vkmcand yeah, you need to add the class20:27
vkmcand there you put a create method with the same signature as queuecontroller20:28
vkmcand then you register that in the queue's pipeline20:29
exploreshaifalivkmc, s/create/delete method?20:29
vkmcexploreshaifali, yes, sorry :)20:30
exploreshaifali\me face palm -- vkmc said sorry :-O20:30
vkmchahaha20:31
exploreshaifaliok so there I need to put delete method20:31
vkmcyes20:31
exploreshaifaliand register it in queue's pipeline-- I am searching for queue's pipeline20:32
exploreshaifalivkmc, from where we call bootstrap.py ?20:37
exploreshaifalior it is called whenever we call any zaqar command ?20:38
vkmcexploreshaifali, bootstrap.py is called when we issue the 'zaqar-server' command20:38
vkmchttps://github.com/openstack/zaqar/blob/master/zaqar/cmd/server.py#L3720:38
vkmcexploreshaifali, there are not many examples of pipeline usage in mongodb driver20:40
vkmcexploreshaifali, but check out how it has been used in redis20:40
exploreshaifaliokay :)20:41
exploreshaifaliso where is queue's pipeline ? I am searcing it20:41
vkmcexploreshaifali, its initialized here https://github.com/openstack/zaqar/blob/master/zaqar/storage/pipeline.py#L108-L11220:43
exploreshaifalivkmc, but it is under DataDriver class20:44
*** diga_ has quit IRC20:44
exploreshaifaliit will be storage.pipeline.DataDriver.queue_controller20:45
exploreshaifalithough it should be storage.pipeline.QueueController20:45
exploreshaifalivkmc, please scold me if I am saying anything stupid20:46
exploreshaifali:P20:46
vkmcexploreshaifali, I'd guess you should create a ControlDriver and move the queues there20:47
vkmcexploreshaifali, its not stupid... I don't even know, this came from flaper87's mind after all :P haha20:47
exploreshaifalihahaha20:47
exploreshaifaliso if I will create ControlDriver and out queue_controller there(which seems intuitive to me too) but then we need to call storage.ControlDriver20:48
exploreshaifaliinstead of storage.DataDriver at some or other places20:48
exploreshaifaliabout which I am no idea20:48
vkmcexploreshaifali, well... there is a control() init in bootstrap as well20:49
vkmcI should check out how that would work20:49
exploreshaifaliinside it we are just calling utils.load_storage_driver20:50
exploreshaifalito initiate storage/mongodb/ControlDriver20:50
exploreshaifaliin case of mongodb20:50
exploreshaifalionly bootstrap.storage is calling pipeline20:51
vkmcyeah20:51
exploreshaifaliI think I have confused you too20:52
exploreshaifalilets right now think only in the way flaper87 thought20:53
vkmcthe main issue here is that there is no pipeline in the control side20:53
vkmcand... if we are splitting the planes20:53
exploreshaifaliyea that is what I was thinking20:54
vkmcwe should split the pipe how it is right now as well20:54
vkmcso we end up falling in the same problem again20:54
exploreshaifalivkmc, so logically I should first create one storage.pipeline.ControlDriver class20:55
exploreshaifalibut if I will create it than too what will it do ?20:55
exploreshaifaliatm all the tasks are working without it20:56
exploreshaifaliwhat will we put inside pipeline.CntrolDriver20:56
vkmcexactly20:56
exploreshaifaliso once I will discuss re having a separate pipeline for ControlDriver with flaper8720:57
vkmcyeah, I'll try to think about it20:57
exploreshaifalibut for now what flaper87 said as second step is -  then add that to the entry-points and let the pipeline do its job20:58
vkmcyeah, but he forgot that the queue pipeline is in the datadriver and... if we are consistent enough, we should remove that from it as well20:58
vkmcor create a generic pipe and get away with it20:58
exploreshaifaliadd that to the entry points means adding the delete  method of newly created class inside queue's pipeline ?20:58
exploreshaifalivkmc, yes20:59
exploreshaifaliso we need to think more20:59
vkmcso... in front of every controller in the pipe there are a serie of operations to do20:59
vkmcso before calling the controller, those actions are performed20:59
vkmcthat is the goal of having a pipeline20:59
vkmcso... if we add the deletion before calling the queue controller21:00
vkmcwe would be succeding with the deletion without having a reference to the message controller inside the queue controller21:00
* exploreshaifali reading above line 2-3 times21:01
vkmcthe reference would be in the pipeline :p21:01
exploreshaifalivkmc, yes yes21:02
exploreshaifaliit makes sense21:02
exploreshaifalibut I have gap - how pipeline and QueueController are connected ?21:03
vkmcso... we have a pipeline21:03
vkmcthat has several stages21:03
vkmcin those stages we have the controllers21:03
exploreshaifalivkmc, please can you give me few examples of those controllers?21:04
vkmchttps://github.com/openstack/zaqar/blob/master/zaqar/storage/pipeline.py#L8521:04
vkmchere https://github.com/openstack/zaqar/blob/master/zaqar/storage/pipeline.py#L111 is the queue controller added to the pipeline21:05
exploreshaifaliok21:06
vkmcby default, the pipeline only contains the controllers21:06
vkmchttps://github.com/openstack/zaqar/blob/master/zaqar/storage/pipeline.py#L28-L3521:06
exploreshaifaliok21:08
vkmcto understand this kind of design decisions... is good to look the blueprints that once were made to address this changes21:08
vkmchttps://blueprints.launchpad.net/zaqar/+spec/storage-pipeline21:08
exploreshaifaliokay21:10
vkmcI knew this was kgriffs fault21:11
vkmchttps://review.openstack.org/#/c/51049/21:11
exploreshaifalihahaha21:13
exploreshaifaliyes kgriffs Scapegoat21:13
exploreshaifali:P21:13
exploreshaifalioh this time it is actually kgriffs 's falult :P21:14
exploreshaifalijust now saw it was his patch21:14
kgriffslol21:15
vkmchaha21:15
vkmckgriffs, YOUUUU21:15
kgriffsthe pipeline what flaper87's idea originally21:15
vkmcyeah21:15
* kgriffs ducks21:15
exploreshaifaliyea atm we can blame flaper87 :P21:16
vkmckgriffs, all good? :)21:16
vkmcexploreshaifali, well... basically, we will have to readapt that pipeline21:26
exploreshaifaliok21:27
exploreshaifalivkmc, things are bit clear to me now, I need to understand pipeline to mongodb/driver.DataDriver connectivity21:29
exploreshaifaliand then we can think how to proceed further21:30
vkmcexploreshaifali, yeah21:31
exploreshaifalicool :)21:31
exploreshaifalivkmc, tHanKs!!!21:31
exploreshaifali:D21:32
vkmcexploreshaifali, I didn't help much haha... but well21:32
vkmclet's keep brainstorming on that21:32
exploreshaifaliyeah :)21:32
exploreshaifaliand main thing is you gave your time to me vkmc21:33
exploreshaifalithanks for that21:33
exploreshaifaliit is something most precious21:33
*** achanda has quit IRC21:39
*** achanda has joined #openstack-zaqar21:39
vkmcexploreshaifali, if that comes with a super fancy algorithm that fixes the design issue with the data/control plane... the better!21:40
vkmchaha21:40
vkmcbut we will get to that21:40
vkmc:)21:40
exploreshaifali:)21:42
*** amitgandhinz has quit IRC21:43
*** achanda has quit IRC21:43
*** achanda has joined #openstack-zaqar21:48
*** achanda has quit IRC21:49
*** amitgandhinz has joined #openstack-zaqar21:56
*** jasondotstar has quit IRC21:56
*** achanda has joined #openstack-zaqar22:00
*** cpallares has quit IRC22:03
*** miqui_ is now known as miqui_away22:07
*** mpanetta has quit IRC22:08
*** achanda has quit IRC22:10
*** achanda has joined #openstack-zaqar22:12
*** amalagon has quit IRC22:16
*** sriram has quit IRC22:16
*** exploreshaifali has quit IRC22:21
*** achanda has quit IRC22:45
*** achanda has joined #openstack-zaqar22:46
*** achanda has quit IRC22:50
*** kgriffs is now known as kgriffs|afk22:56
*** amitgandhinz has quit IRC23:02
*** amalagon has joined #openstack-zaqar23:04
*** jasondotstar has joined #openstack-zaqar23:05
*** achanda has joined #openstack-zaqar23:26
*** ametts has quit IRC23:34
*** achanda has quit IRC23:39
*** achanda has joined #openstack-zaqar23:44
*** achanda has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!