Sunday, 2015-12-13

*** manishg has quit IRC00:24
*** manishg has joined #openstack-lbaas00:28
*** Kiall has quit IRC00:47
*** Kiall has joined #openstack-lbaas00:49
*** manishg has quit IRC00:50
*** manishg has joined #openstack-lbaas00:56
*** manishg has quit IRC01:01
*** manishg has joined #openstack-lbaas01:06
*** mixos has joined #openstack-lbaas01:19
*** mixos has quit IRC01:25
*** manishg has quit IRC01:26
*** bana_k has quit IRC01:29
*** manishg has joined #openstack-lbaas01:57
*** manishg has quit IRC02:49
*** ducttape_ has joined #openstack-lbaas02:49
*** ducttape_ has quit IRC03:09
*** ducttape_ has joined #openstack-lbaas03:35
*** ducttape_ has quit IRC03:38
*** armax has joined #openstack-lbaas04:26
*** armax_ has joined #openstack-lbaas04:30
*** armax has quit IRC04:31
*** armax_ is now known as armax04:31
*** blogan_ has joined #openstack-lbaas04:54
*** manishg has joined #openstack-lbaas05:19
*** armax has quit IRC05:40
*** manishg has quit IRC05:45
*** manishg has joined #openstack-lbaas05:48
*** mixos has joined #openstack-lbaas05:57
*** manishg has quit IRC06:40
*** manishg has joined #openstack-lbaas06:52
*** manishg has quit IRC06:52
openstackgerritBrandon Logan proposed openstack/octavia: Get Me A Load Balancer Controller  https://review.openstack.org/25701307:01
*** mixos has quit IRC07:01
*** blogan_ has quit IRC07:07
*** manishg has joined #openstack-lbaas07:15
*** manishg has quit IRC07:27
*** manishg has joined #openstack-lbaas07:28
*** manishg has quit IRC07:33
*** nmagnezi has joined #openstack-lbaas07:43
*** manishg has joined #openstack-lbaas07:58
*** manishg has quit IRC08:15
*** mhickey has joined #openstack-lbaas08:30
*** yamamoto has joined #openstack-lbaas08:56
*** mhickey has quit IRC09:02
*** yamamoto has quit IRC09:50
*** yamamoto has joined #openstack-lbaas09:54
*** yamamoto has quit IRC09:59
*** yamamoto has joined #openstack-lbaas10:03
*** yamamoto has quit IRC10:15
*** xgerman has quit IRC10:26
*** sballe has quit IRC10:29
*** ramishra_ has quit IRC10:32
*** ctracey has quit IRC10:32
*** rcernin has joined #openstack-lbaas10:35
*** dougwig has quit IRC10:36
*** ramishra_ has joined #openstack-lbaas10:44
*** dougwig has joined #openstack-lbaas10:45
*** ctracey has joined #openstack-lbaas10:49
*** sballe has joined #openstack-lbaas10:49
*** xgerman has joined #openstack-lbaas10:51
*** ig0r__ has joined #openstack-lbaas11:03
*** ig0r_ has quit IRC11:05
openstackgerritKobi Samoray proposed openstack/neutron-lbaas: (WIP) Add support X-Forwarded-For header  https://review.openstack.org/25596311:24
*** rcernin has quit IRC11:34
*** kobis1 has quit IRC12:04
*** nmagnezi has quit IRC12:40
*** ducttape_ has joined #openstack-lbaas12:57
*** ducttape_ has quit IRC13:05
*** rcernin has joined #openstack-lbaas13:14
*** ducttape_ has joined #openstack-lbaas13:21
*** ducttape_ has quit IRC13:25
*** ducttape_ has joined #openstack-lbaas13:58
*** yamamoto has joined #openstack-lbaas14:03
*** ducttape_ has quit IRC14:11
*** nmagnezi has joined #openstack-lbaas14:14
*** ducttape_ has joined #openstack-lbaas14:39
*** yamamoto has quit IRC14:42
*** kobis has joined #openstack-lbaas14:44
*** ducttape_ has quit IRC14:44
*** yamamoto has joined #openstack-lbaas14:46
*** manishg has joined #openstack-lbaas14:52
*** ducttape_ has joined #openstack-lbaas14:56
*** kobis has quit IRC14:57
*** kobis has joined #openstack-lbaas14:57
*** kobis has quit IRC15:04
*** manishg has quit IRC15:10
*** ducttape_ has quit IRC15:22
*** ducttape_ has joined #openstack-lbaas15:22
*** manishg has joined #openstack-lbaas15:32
*** ducttape_ has quit IRC15:37
*** ducttape_ has joined #openstack-lbaas15:44
*** ducttape_ has quit IRC15:44
*** kobis has joined #openstack-lbaas15:45
*** ducttape_ has joined #openstack-lbaas15:46
*** kobis1 has joined #openstack-lbaas15:48
*** kobis has quit IRC15:49
*** kobis1 has quit IRC15:50
*** manishg has quit IRC15:51
*** kobis has joined #openstack-lbaas15:52
*** yamamoto has quit IRC16:00
*** yamamoto has joined #openstack-lbaas16:02
*** yamamoto has quit IRC16:03
*** ducttape_ has quit IRC16:14
*** ducttape_ has joined #openstack-lbaas16:18
*** kobis has quit IRC16:22
*** ducttape_ has quit IRC16:23
*** mixos has joined #openstack-lbaas16:28
*** mixos has quit IRC16:48
*** armax has joined #openstack-lbaas16:56
*** ianbrown has quit IRC17:18
*** ducttape_ has joined #openstack-lbaas17:19
*** armax has quit IRC17:22
*** ducttape_ has quit IRC17:25
*** armax has joined #openstack-lbaas17:28
*** armax has quit IRC17:33
*** rcernin has quit IRC17:36
*** manishg has joined #openstack-lbaas17:39
*** mixos has joined #openstack-lbaas17:53
*** dougwig has quit IRC18:06
*** bradjones has quit IRC18:06
*** dougwig has joined #openstack-lbaas18:06
*** whydidyoustealmy has joined #openstack-lbaas18:08
*** ctracey_ has joined #openstack-lbaas18:10
*** ig0r_ has joined #openstack-lbaas18:11
*** ramishra__ has joined #openstack-lbaas18:11
*** bradjones has joined #openstack-lbaas18:11
*** bradjones has quit IRC18:11
*** bradjones has joined #openstack-lbaas18:11
*** ctracey has quit IRC18:13
*** ramishra_ has quit IRC18:13
*** barra204 has quit IRC18:13
*** openstackgerrit has quit IRC18:13
*** ig0r__ has quit IRC18:13
*** ramishra__ is now known as ramishra_18:14
*** ctracey_ is now known as ctracey18:14
*** rcernin has joined #openstack-lbaas18:16
*** manishg has quit IRC18:30
*** rcernin has quit IRC18:39
*** manishg has joined #openstack-lbaas18:41
*** manishg has quit IRC18:43
*** manishg has joined #openstack-lbaas18:44
*** mixos has quit IRC18:47
*** dnovosel is now known as dnovosel__18:48
*** kobis has joined #openstack-lbaas18:51
*** mixos has joined #openstack-lbaas18:54
ptoohillI think im going to redo the graph/decider flow to just do a if check...19:12
ptoohillThat or duplicate all the flows with slight tweakings so i can sorta reuse things19:12
ptoohillany objections? Reuse of the flows are impossible, and even more so no, i dont see a use for them if we have to duplicate everything19:14
ptoohillnow*19:14
*** mixos has quit IRC19:16
ptoohillI wish i would have looked at that review more before it got merged19:17
*** manishg has quit IRC19:18
*** ducttape_ has joined #openstack-lbaas19:22
*** ducttape_ has quit IRC19:26
*** kobis has quit IRC19:31
*** crc32|znc has quit IRC19:33
*** jorgem[away] has quit IRC19:33
*** HenryG has quit IRC19:33
*** clduser has quit IRC19:33
*** dnovosel__ has quit IRC19:33
*** albertom has quit IRC19:34
*** kfox1111 has quit IRC19:34
*** blogan has quit IRC19:34
*** kbyrne has quit IRC19:34
*** ptoohill has quit IRC19:34
*** crc32|znc has joined #openstack-lbaas19:34
*** clduser has joined #openstack-lbaas19:34
*** HenryG has joined #openstack-lbaas19:34
*** jorgem[away] has joined #openstack-lbaas19:34
*** dnovosel__ has joined #openstack-lbaas19:34
*** albertom has joined #openstack-lbaas19:34
*** kfox1111 has joined #openstack-lbaas19:34
*** blogan has joined #openstack-lbaas19:34
*** kbyrne has joined #openstack-lbaas19:34
*** ptoohill has joined #openstack-lbaas19:34
johnsomptoohill which flow are you talking about?20:01
johnsomptoohill FYI, you might want to look at the active/standby failover flow code.  I have been working with the taskflow team and we now have fully functional deciders, especially for subflows.  failover is the first to use this.  At some point I need to go back and simplify the other flows and make them all into one flow again now that the bug is fixed.20:13
ptoohilljohnsom: I need to be able to pass data in to the graph flow, this is not allowed. Ill take a look, but for my workflow, ive bashed my brains trying several different solutions, nothing is working the way i would think it should20:26
*** armax has joined #openstack-lbaas20:26
*** rcernin has joined #openstack-lbaas20:26
ptoohillget_amphora_for_lb_subflow, thats the flow that is the gateway to the rest of the build20:26
ptoohilli cant pass data to it because its not part of the providers. Ill take a look at the fail over, but i think my workflow is a bit different20:27
johnsomYou can pass data into flows using the storage engine.  It's how we pass data task to task or inject data into the initial flow20:27
*** nmagnezi has quit IRC20:27
johnsomCheck out this patch: https://review.openstack.org/#/c/253724/20:28
ptoohillYea, but i have subflows that do not store to the engine, i get 'invalid providers'20:28
johnsomOk, that is odd.  I pass a lot of data in and out of the subflows20:29
ptoohillSo, for my example, i build list of network id/port ids, then attempt to pass it along so the amps will get built as such. This is not allowed with graph flow20:29
johnsomAre you trying to use a pre-release Taskflow?  I know when we were working on the bug fix it was broken for a bit as it was trying to get data from the wrong branch of the decider20:30
ptoohillThis is a mess, im going to just cut losses right now, because if i have to re-refactor when your stuff gets in this is going to be a nightmare20:30
ptoohillim not utilizing the decider, maybe thats my problem i dont understand this20:30
ptoohilli wanted to reuse the active-standby code but be able to pass in the network configs20:31
ptoohillit yells that my data isnt from a proper provider20:31
johnsomYou can definitely pass data along in the graph flows.  Graph flows are just different as you have to explicitely link each task20:31
ptoohillthats the problem...20:31
ptoohillso i need to add these random tasks that would let my task, and allow the graph flow to be generic20:32
ptoohilllet my task work*20:32
ptoohillthis isnt working20:32
ptoohillSo, that means i need to duplicate the workflow and call the ones with specific flows20:32
johnsomShould work.  Is it the decider with subflow that is complaining?20:32
ptoohillThis is incredibly difficult to work with20:32
ptoohillget_amphora_for_lb_subflow20:32
ptoohillnetworkids is populated here, but it wont even compile because im trying to pass data in that isnt part of the providers20:33
ptoohilli guess i just dont understand the mess20:33
ptoohillso youre saying i need to link it20:33
ptoohillthough i did do that and got the same message, possible because i added several20:33
johnsomDo you have code up I can look at?20:33
ptoohillcan you have many link to one? i didnt see that as part of the method def20:34
ptoohilli have the patch up where i realized things werent going to work, everything else is local and messy, id hate to push it up20:34
johnsomOk.  I'm not 100% following so let me ask some questions (if you have time, it is Sunday, if you want to pick it up tomorrow we can do that too).20:35
ptoohillI told my boss i would have this done today, so i have time :/20:35
johnsomSo you have some data you want to pass through the flow.  Is the data produced in a task (i.e. a provides) or need to be passed into a flow at the start?20:36
ptoohillIts provided from a flow called prior to the decider20:37
ptoohillwhich is another issue itself20:37
ptoohillI cant call the flows, making them a subflow because they need an arg20:37
ptoohillbut thats another issue that can be worked around, its really ugly, but it works20:38
johnsomOk, that is fine.  So in a task, before the deciders you have a task that has a provides, i.e.20:38
johnsomhttps://github.com/openstack/octavia/blob/master/octavia/controller/worker/tasks/database_tasks.py#L4920:38
johnsomCreateAmphoraInDB returns the amphora.id, which20:38
ptoohillessentially, im calling another flow that calls two tasks, but yes20:39
johnsomIs called like this: https://github.com/openstack/octavia/blob/master/octavia/controller/worker/flows/amphora_flows.py#L4820:40
ptoohillwell yes20:40
ptoohilla task is called from a flow?20:41
johnsomSo that line says, run this task, take it's return and store it as whatever constants.AMPHORA_ID string is.20:41
ptoohillim following the basic steps of taskflow, thats not the problem20:41
*** rcernin has quit IRC20:41
ptoohillyes20:41
ptoohillim not following here, it seems like youre unsure i even have the flows set up right20:41
johnsomOk, I was just trying to give an example of storing data from a task, into a flow.20:41
ptoohillyea, im past all that, ive had this all working before20:42
ptoohillive fought with taskflow for several months now20:42
johnsomWell, I'm not sure where the problem is, so I was starting at the beginning.  Sometimes that sparks ideas, etc.20:42
ptoohillfair enough20:42
ptoohillThe problem is the graph flow doesnt like data thats not part of its providers20:42
ptoohillso you CANNOT pass data from another task unless its part of that flow already20:43
ptoohillanother flow*20:43
johnsomOk.  The next thing is if you need to pass a stored item into a task as a different name, you use rebind to change the name of a stored item for a specific task20:43
ptoohillnot about renaming or anything like that either20:43
ptoohillits a limitation of taskflow20:43
ptoohilli cannot reuse this the way i need to. The only solution is to build similar flows all the way down the line with my tweaks20:44
johnsomCorrect on if one flow stores data, another flow cannot access it.  The storage is only shared inside one flow and it's subflows20:44
ptoohillyou would think so right?20:44
ptoohilli thought so too20:44
ptoohilland tried it several ways you would have thought it would work20:44
ptoohilltry this20:44
ptoohillsample of my controller worker work-around to get past some of the other taskflow issues20:45
ptoohillhttps://gist.github.com/the2hill/9a6bec20346e4ae5812d20:45
ptoohillcan ignore the last two, but notice my 'pre' flow, that populates data for network config stuff20:45
ptoohillthen when i try to call the rest of the flow it wont work, the graph flow complains20:46
johnsomLooking.  Also, take a look at this bug we just fixed last week and see if that relates: https://bugs.launchpad.net/taskflow/+bug/147946620:46
openstackLaunchpad bug 1479466 in taskflow "The needs to treat subflows as standalone entity" [Undecided,New]20:46
ptoohillreally it complains on load20:46
ptoohillthat is part of it20:46
johnsomOk, give me a minute20:46
ptoohillbut they said they wont fix it because thats the way its supposed to be20:46
ptoohillwell, they said they could look into it20:46
ptoohillbut20:46
ptoohillbut that is indeed whats causing me issues20:47
ptoohilland theres no 'clean' way around it20:47
johnsomWhat, the bug?  No, we fixed it last week.  It's up for review right now20:47
ptoohillmaybe im thinking of another20:47
ptoohillthe one that was in comment, checking20:47
*** rcernin has joined #openstack-lbaas20:48
ptoohillok, so then maybe i just need to update taskflow and itll let me pass other data in?20:48
ptoohillhttps://bugs.launchpad.net/taskflow/+bug/1479466 This bug was fixed?20:48
openstackLaunchpad bug 1479466 in taskflow "The needs to treat subflows as standalone entity" [Undecided,New]20:48
johnsomOk, wait a second.  So this code is four, separate flows....20:48
ptoohillyea, as a work around for other mess...20:49
johnsomYeah, Josh, Min, and I have been working on it for the last two weeks.20:49
ptoohillits the same problem though20:49
ptoohilland prior to active-standby it worked20:49
johnsomSo, four flows is bad.  We really only want one flow so it reverts correctly.20:49
ptoohillso its not merged20:49
ptoohilllol....20:49
ptoohillwell, if this was easier to work with then that would be the case..20:49
ptoohilli only have it like this because it doesnt want to work other ways20:50
ptoohilland ive since changed this up, that was just example to help you get idea of my problem20:50
ptoohillThe problem right now, is that the graph flow wont take data from a flow outside of its providers20:50
johnsomYeah, the way this code is, you have store = A, flow one get A as it's store, works with it, chnages it.  Flow b gets store A, but all of those previous changes are lost, it is using the initial definition of store.20:52
ptoohillSo, unless what you guys were working on actually solves my issues, i need to duplicate the flows with my tweaks. That resolves have multiple flows being called and i can reuse them between other flows20:52
ptoohillyea, that was another issue youre right, but not the problem i was trying to explain20:53
johnsomSo, what you need is one flow, add these flows as sub-flows to that one flow.20:53
ptoohillI think taskflow is going to get me to quit my job and go back to welding20:53
ptoohillthats still not the problem, i guess im not explaining it correctly. Thanks for the help though johnsom20:53
johnsomI'm really sorry you are frustrated.  It is rough to get into, but the more I use it the more I understand the value.20:54
ptoohilli still dont see value in this mess. ive dealt with it for several months and its only getting harder to deal with and read20:54
*** armax has quit IRC20:55
ptoohilland i cant get it to do what i need without duplicating everything.. so to me its useless20:55
johnsomWell, I'm happy to spend the time and help.  I think we are getting to the problem.21:00
johnsomIf there are deciders in the flow, it is quite possible you hit the bug where there is a main flow, deciders, goes down branch a, comes back to main flow and it "IGNORES" the rest of the main flow.  That is what we just fixed.21:01
johnsomIt made the failover flow much cleaner after we got that fixed.21:02
ptoohillMy issue is that im trying to call the deciders flow with information not populated inside of the linked flows21:02
ptoohillit doesnt like that, and i dont think theres a way around it21:02
johnsomYou can store AMP in the main flow, go down a decider into branch A, and access AMP inside branch A21:03
ptoohillso, that means i need to recreate flows up to and a little past the deciders flows with my other flows to populate the proper data21:03
ptoohillwith the fixes youve made?21:03
johnsomThat worked without the fixes21:03
ptoohillThen this isnt the same thing21:03
johnsomThat works with 1.25 taskflow21:03
ptoohillunless i have old taskflow21:04
ptoohillim on 1.2521:04
johnsomCheck, you really want 1.25.  If you are getting the "IGNORES" in debug, that is where you will need our fix21:04
ptoohillThe issue im seeing is i try to call the create lb flow, which calls the decider flow and all that. But prior to calling the creat_lb i populated network data21:05
ptoohillonce it gets to the decider it tells me network_ids doesnt belong to the one of two provider that were possible21:06
ptoohillthe only way ive gotten this to work is add those flows where i called them before, to actually call them further down the chain. This isnt what i need21:06
ptoohillso i cant have a 'pre' flow that gathers data and then calls the create workflow21:07
ptoohilland i need this21:07
johnsomThat works21:07
johnsomI have done it.  Should I try to right a small sample app?21:08
ptoohillsure, ill undo some of the workaround ive done and push that up too21:08
ptoohillbecause that doesnt work for me21:08
ptoohillim about to go to kids bball game though, ill be on a bit later21:08
johnsomOk, let me give a go, I will post a gist in this channel.  Will that work or would e-mail be better for you?21:09
ptoohillmaybe its because network ids is used in the flow further down and the error message i was getting was because of a conflict21:09
ptoohilli have bouncer, ill see scroll back21:09
johnsomYeah, the rebind thing gets me when I forget to use it.  Ok, I will write a sample app and post a gist here21:10
johnsomEnjoy bball21:10
ptoohillbut i need to use network_ids though21:10
ptoohilli cant rebind that21:10
ptoohillit needs to be netowrk_ids so the other flows picks it up21:10
ptoohillor i have the same issues about having to duplicate things21:10
johnsomrebind just renames objects for task reuse issues that have name conflicts21:11
ptoohillyea21:11
ptoohillso that means if i get past the decider error, i have to rework the other flows to take my rebound arg?21:12
ptoohillim trying to reuse thigns here21:12
johnsomNope, you shouldn't have to change the flows21:12
ptoohillso if i rebind network_ids to net_ids, the flows looking for network_ids is still going to pick it up?21:13
ptoohillthats how that works?21:13
*** gomarivera has joined #openstack-lbaas21:13
johnsomnope, you would only rebind if you have network_ids, but the subflow or tasks expect net_ids.21:13
ptoohill..21:13
*** armax has joined #openstack-lbaas21:14
johnsomOtherwise if they are all looking for network_ids you are good, they will all pull it correct from the storage21:14
ptoohillthen rebind wont solve my decider problem21:14
ptoohillyea, that was what i was thinking, so this wouldnt solve my issue21:14
ptoohillfun stuff21:14
ptoohilli have to head out, when i get back ill undo some of the stuff and put it back to show the issue im having21:15
johnsomOk, I will have some sample code too21:16
*** ducttape_ has joined #openstack-lbaas21:23
*** ducttape_ has quit IRC21:27
*** elarson_ is now known as elarson21:36
*** manishg has joined #openstack-lbaas21:45
*** ianbrown has joined #openstack-lbaas21:55
*** ianbrown has quit IRC21:58
*** manishg has quit IRC21:58
johnsomptoohill https://gist.github.com/johnsom/4878395e92a82e8c11a622:00
johnsomSee if I understood what you are trying to do.22:01
*** ianbrown has joined #openstack-lbaas22:13
*** rcernin has quit IRC22:30
*** ducttape_ has joined #openstack-lbaas22:45
*** ducttape_ has quit IRC22:47
*** armax has quit IRC22:58
*** yuanying has joined #openstack-lbaas23:00
*** yuanying has quit IRC23:00
ptoohilljohnsom: This is just showing two flows and no data is being taken from before the decider and used after the decider23:32
ptoohillThis is doing exactly whats already there23:33
ptoohillin our code23:33
ptoohillwell i see store task now23:33
ptoohillso i have to return a random name, then rebind it to the name thats used elsewhere for this to work?23:34
ptoohillor do i need to do, in all the flows that i shouldnt need to touch, to rebind? this isnt making sense23:35
ptoohillSo, i have quite a mess here, im pretty deep into reworking things. Ill try to explain it again23:43
ptoohillAttempting to reuse the create_load_balancer flow23:43
ptoohillI have a flow prior to this that makes the create_lb a subflow essentially, within the first flow i create data, the next flow inline is the create_lb flow, that flow then calls the create_amp graph flow, the graphflow complains that the data i sent is not part of its providers23:44
ptoohillSo your solution would be me duplicating the flows to add in what i need23:44
ptoohillsince i cant call the individual flows from the controller and i need to reuse them i dont see another way to do it besides replicating. The example you pasted wont work for my case23:45
ptoohillunless this example means i just need to rebind network_ids to network_ids and itll magically work23:48
ptoohillbut that still means that would have to be done everywhere and is just as bad, but i really dont think this is the case23:49
*** rsanchez87 has joined #openstack-lbaas23:51

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!