*** bengrue has quit IRC | 00:01 | |
*** Guest85964 has quit IRC | 00:02 | |
*** dwcramer has quit IRC | 00:13 | |
*** vladimir3p has quit IRC | 00:20 | |
*** vladimir3p has joined #openstack-meeting | 00:20 | |
*** rnirmal has quit IRC | 00:23 | |
*** zns has quit IRC | 00:24 | |
*** dwcramer has joined #openstack-meeting | 00:30 | |
*** cdub has quit IRC | 00:37 | |
*** bengrue has joined #openstack-meeting | 00:39 | |
*** dragondm has quit IRC | 00:52 | |
*** nati2__ has quit IRC | 00:55 | |
*** bengrue has quit IRC | 00:59 | |
*** cdub has joined #openstack-meeting | 01:08 | |
*** nati2 has joined #openstack-meeting | 01:15 | |
*** dendrobates is now known as dendro-afk | 01:17 | |
*** sandywalsh has quit IRC | 01:17 | |
*** danwent has quit IRC | 01:34 | |
*** dwcramer has quit IRC | 01:45 | |
*** ohnoimdead has quit IRC | 01:57 | |
*** dwcramer has joined #openstack-meeting | 01:58 | |
*** adjohn has quit IRC | 01:59 | |
*** jog0 has joined #openstack-meeting | 02:07 | |
*** anotherjesse has quit IRC | 02:07 | |
*** dolphm has quit IRC | 02:11 | |
*** jdurgin has quit IRC | 02:16 | |
*** jakedahn has joined #openstack-meeting | 02:17 | |
*** jog0 has left #openstack-meeting | 02:20 | |
*** jog0 has joined #openstack-meeting | 02:20 | |
*** jog0 has joined #openstack-meeting | 02:20 | |
*** gyee has quit IRC | 02:26 | |
*** deshantm_laptop_ has joined #openstack-meeting | 02:30 | |
*** reed has joined #openstack-meeting | 02:34 | |
*** deshantm_laptop has quit IRC | 02:34 | |
*** anotherjesse has joined #openstack-meeting | 02:41 | |
*** dwcramer has quit IRC | 03:06 | |
*** nati2 has quit IRC | 03:16 | |
*** dwcramer has joined #openstack-meeting | 03:18 | |
*** dwalleck has joined #openstack-meeting | 03:21 | |
*** nati2 has joined #openstack-meeting | 03:22 | |
*** cdub has quit IRC | 03:32 | |
*** nati2 has quit IRC | 03:36 | |
*** adjohn has joined #openstack-meeting | 03:37 | |
*** mdomsch has joined #openstack-meeting | 03:45 | |
*** vladimir3p has quit IRC | 03:55 | |
*** deshantm_laptop_ has quit IRC | 04:03 | |
*** deshantm_laptop has joined #openstack-meeting | 04:04 | |
*** rohitk has quit IRC | 04:04 | |
*** rohitk has joined #openstack-meeting | 04:22 | |
*** nati2 has joined #openstack-meeting | 04:23 | |
*** dolphm has joined #openstack-meeting | 04:24 | |
*** cdub has joined #openstack-meeting | 04:47 | |
*** dolphm_ has joined #openstack-meeting | 04:48 | |
*** dolphm has quit IRC | 04:50 | |
*** dolphm has joined #openstack-meeting | 05:00 | |
*** dolphm_ has quit IRC | 05:03 | |
*** dwcramer has quit IRC | 05:08 | |
*** vladimir3p has joined #openstack-meeting | 05:09 | |
*** nati2 has quit IRC | 05:12 | |
*** dolphm has quit IRC | 05:15 | |
*** rohitk has quit IRC | 05:15 | |
*** rohitk has joined #openstack-meeting | 05:16 | |
*** dolphm_ has joined #openstack-meeting | 05:25 | |
*** deshantm_laptop has quit IRC | 06:00 | |
*** vladimir3p has quit IRC | 06:07 | |
*** danwent has joined #openstack-meeting | 06:14 | |
*** dolphm_ has quit IRC | 06:28 | |
*** dolphm has joined #openstack-meeting | 06:30 | |
*** zns has joined #openstack-meeting | 06:36 | |
*** danwent has quit IRC | 06:54 | |
*** jog0 has quit IRC | 07:02 | |
*** dolphm has quit IRC | 07:08 | |
*** dolphm has joined #openstack-meeting | 07:28 | |
*** dolphm has quit IRC | 07:32 | |
*** adjohn has quit IRC | 07:55 | |
*** vladimir3p has joined #openstack-meeting | 08:04 | |
*** vladimir3p has quit IRC | 08:09 | |
*** jog0 has joined #openstack-meeting | 08:18 | |
*** dwalleck has quit IRC | 08:24 | |
*** jog0 has quit IRC | 08:33 | |
*** cdub has quit IRC | 09:21 | |
*** darraghb has joined #openstack-meeting | 09:23 | |
*** reed has quit IRC | 09:37 | |
*** cdub has joined #openstack-meeting | 09:40 | |
*** reed has joined #openstack-meeting | 09:53 | |
*** reed has quit IRC | 10:14 | |
*** zns1 has joined #openstack-meeting | 10:25 | |
*** zns has quit IRC | 10:26 | |
*** adjohn has joined #openstack-meeting | 11:15 | |
*** zns1 has quit IRC | 11:28 | |
*** adjohn has quit IRC | 11:37 | |
*** cdub has quit IRC | 11:48 | |
*** reed has joined #openstack-meeting | 12:41 | |
*** dwcramer has joined #openstack-meeting | 12:56 | |
*** dprince has joined #openstack-meeting | 13:03 | |
*** dwcramer has quit IRC | 13:20 | |
*** mdomsch has quit IRC | 13:21 | |
*** dwcramer has joined #openstack-meeting | 13:36 | |
*** deshantm_laptop has joined #openstack-meeting | 13:41 | |
*** dwcramer has quit IRC | 13:44 | |
*** dwcramer has joined #openstack-meeting | 14:00 | |
*** deshantm_laptop_ has joined #openstack-meeting | 14:30 | |
*** deshantm_laptop_ has quit IRC | 14:32 | |
*** deshantm_laptop_ has joined #openstack-meeting | 14:32 | |
*** deshantm_laptop has quit IRC | 14:33 | |
*** deshantm_laptop_ has quit IRC | 14:34 | |
*** deshantm_laptop has joined #openstack-meeting | 14:34 | |
*** dwcramer has quit IRC | 14:36 | |
*** jaypipes has joined #openstack-meeting | 14:39 | |
*** zns has joined #openstack-meeting | 14:50 | |
*** dwcramer has joined #openstack-meeting | 14:56 | |
*** AlanClark has joined #openstack-meeting | 14:59 | |
*** mattray has joined #openstack-meeting | 15:02 | |
*** reed has quit IRC | 15:05 | |
*** mdomsch has joined #openstack-meeting | 15:07 | |
*** GheRivero_ has joined #openstack-meeting | 15:14 | |
*** dendro-afk is now known as dendrobates | 15:27 | |
*** dwalleck has joined #openstack-meeting | 15:28 | |
*** vladimir3p has joined #openstack-meeting | 15:44 | |
*** dwalleck has quit IRC | 15:45 | |
*** GheRivero_ has quit IRC | 15:50 | |
*** jakedahn has quit IRC | 15:50 | |
*** rohitk has quit IRC | 15:51 | |
*** rohitk has joined #openstack-meeting | 15:52 | |
*** mdomsch has quit IRC | 16:00 | |
*** mdomsch has joined #openstack-meeting | 16:01 | |
*** dendrobates is now known as dendro-afk | 16:03 | |
*** dendro-afk is now known as dendrobates | 16:04 | |
*** dragondm has joined #openstack-meeting | 16:05 | |
*** dendrobates is now known as dendro-afk | 16:06 | |
*** danwent has joined #openstack-meeting | 16:09 | |
*** rohitk has quit IRC | 16:13 | |
*** cdub has joined #openstack-meeting | 16:32 | |
*** jakedahn has joined #openstack-meeting | 16:43 | |
*** jaypipes has quit IRC | 16:52 | |
*** jakedahn has quit IRC | 16:54 | |
*** jakedahn has joined #openstack-meeting | 16:54 | |
*** dwalleck has joined #openstack-meeting | 16:56 | |
*** rohitk has joined #openstack-meeting | 16:59 | |
*** dolphm has joined #openstack-meeting | 17:18 | |
*** dwalleck has quit IRC | 17:34 | |
*** dwalleck has joined #openstack-meeting | 17:36 | |
*** jog0 has joined #openstack-meeting | 17:46 | |
*** jaypipes has joined #openstack-meeting | 17:50 | |
*** dprince has quit IRC | 17:51 | |
*** renuka has joined #openstack-meeting | 17:51 | |
*** jog0 has quit IRC | 17:53 | |
*** mdomsch_ has joined #openstack-meeting | 17:58 | |
*** mdomsch has quit IRC | 17:59 | |
renuka | shall we start the volume meeting? | 18:00 |
---|---|---|
renuka | do we have the volume folks here? | 18:00 |
vladimir3p | hi | 18:02 |
vladimir3p | is there anybody else? | 18:03 |
renuka | vladimir3p: hi, i am not sure | 18:03 |
vladimir3p | sorry, I missed couple previous meetings | 18:04 |
*** jdurgin has joined #openstack-meeting | 18:04 | |
DuncanT | Hi | 18:04 |
DuncanT | Sorry, just got here | 18:04 |
renuka | vladimir3p: that's alright | 18:04 |
renuka | #startmeeting | 18:04 |
openstack | Meeting started Thu Nov 17 18:04:55 2011 UTC. The chair is renuka. Information about MeetBot at http://wiki.debian.org/MeetBot. | 18:04 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic. | 18:04 |
renuka | #topic openstack volume | 18:05 |
*** openstack changes topic to "openstack volume" | 18:05 | |
renuka | vladimir3p: did you have a chance to decide on whether you could implement the scheduler? | 18:05 |
vladimir3p | yes, I will do it | 18:05 |
vladimir3p | are there any other volunteers? | 18:05 |
renuka | did not hear back from anyone | 18:06 |
vladimir3p | :-) | 18:06 |
*** jdg has joined #openstack-meeting | 18:06 | |
renuka | do you have an estimate of when you could start, how long it might take, etc? | 18:06 |
*** dprince has joined #openstack-meeting | 18:07 | |
vladimir3p | we were quite busy with our internal tasks | 18:07 |
vladimir3p | most likely closer to the end of next week I will have time to start it | 18:07 |
vladimir3p | ah, it will be a thanksgiving | 18:08 |
vladimir3p | so, week after that | 18:08 |
renuka | right :) and how much work do you think it is? | 18:08 |
vladimir3p | IMHO, max couple of days :-) | 18:08 |
vladimir3p | I will actually need to extend the new distributed scheduler | 18:09 |
vladimir3p | to allow operations with volumes as well | 18:09 |
renuka | right, did you get a chance to look at the meeting minutes/logs for the affinity work? | 18:10 |
vladimir3p | sorry, had no chance to look at them | 18:10 |
vladimir3p | can you pls briefly summarize what you've decided? | 18:10 |
vladimir3p | or I can take a look later | 18:10 |
renuka | DuncanT: would you like to give a summary/update? | 18:11 |
renuka | Not sure if he is around, the blueprint is here: http://wiki.openstack.org/VolumeAffinity | 18:12 |
DuncanT | I've not had chance to start on anything yet, and I've not yet heard back on a definitive answer on generic key/value .v. adding a new named field | 18:12 |
vladimir3p | I've seen this BP | 18:13 |
renuka | so i think we agreed that we should have, at create, a field for affinity and anti-affinity | 18:13 |
DuncanT | The basics of it are in the blueprint though - I was hoping to get vladimir's opinion on whether it is just a special case of general free-form constraints? | 18:13 |
renuka | which expresses the volumes/instances to which affinity/anti-affinity exists | 18:13 |
*** medberry is now known as mka | 18:13 | |
renuka | for example affinity: vol-0000001, i-000006 | 18:14 |
*** mka is now known as medberry | 18:14 | |
vladimir3p | I agree that it is a special case. The question if we would like to address the afinity/anti-af in "general" way or just allow vendors to implement it by their own | 18:14 |
*** adjohn has joined #openstack-meeting | 18:14 | |
vladimir3p | I can imagine the discussion re: what afinitiy/anti-afinity rules may have higher priorities, etc | 18:15 |
DuncanT | renuka: That's certainly the the approach I'm assuming, but vish was going to check with the API folks as to whether a generic key-value pair system was appropriate instead since placement rules in general are hard to predict and we don't want to be adding ten million new fields | 18:15 |
vladimir3p | like if you indicate both affinity to vol and instance - which one is the preferred one | 18:15 |
DuncanT | vladimir3p: I'd assume it would be vendor specific, at least for a while | 18:15 |
vladimir3p | yeah. in the past I've suggested to add a special placement/scheduling requirements | 18:16 |
renuka | vladimir3p: why not order the affinity: <highest priority> <next highest>.... | 18:16 |
vladimir3p | but it didn't come through I suppose | 18:16 |
*** mdomsch_ has quit IRC | 18:16 | |
vladimir3p | renuka: yep, this is definitely an option | 18:16 |
*** GheRivero_ has joined #openstack-meeting | 18:17 | |
vladimir3p | at the same time you may want to have a list of objects with the same priority | 18:17 |
renuka | DuncanT: for now I suggest we go with the extension that has the basic affinity/anti-affinity keywords | 18:17 |
vladimir3p | in volume_create request? | 18:17 |
renuka | this seems fairly well defined a problem, so I do not see the need for a generic field at this point | 18:17 |
vladimir3p | or in volume_type params? | 18:17 |
DuncanT | renuka: That's what I play on doing, it won't take long to change it if a different interface is desired | 18:18 |
*** ohnoimdead has joined #openstack-meeting | 18:18 | |
DuncanT | *plan | 18:18 |
renuka | vladimir3p: It probably doesn't matter if non-conflicting things have the same priority and are expressed one after another | 18:18 |
renuka | if we do not do this, we will have a lot of complexity in the code to deal with "what happens if the user specifies conflicting goals to be at the same priority" | 18:19 |
vladimir3p | ok, anyway meanwhile we can plan to put an infrastructure in and allow other vendors to override it | 18:20 |
DuncanT | vladimir3p: Agreed | 18:21 |
renuka | #idea In volume create, affinity is expressed as affinity_to: <highest priority> <next highest>... etc | 18:21 |
renuka | vladimir3p: do you have an ideas about this infrastructure? | 18:22 |
vladimir3p | renuka: or anti-affinity | 18:22 |
vladimir3p | I propose to add those fields as "per request" and not in volume types | 18:22 |
vladimir3p | as we may need to specify for each volume (of the same type) where to put it | 18:23 |
DuncanT | vladimir3p: They absolutely are 'per-request' | 18:23 |
renuka | #idea same as above for anti-affinity | 18:23 |
DuncanT | anti-affinity exactly the same | 18:23 |
vladimir3p | DuncanT: yep | 18:23 |
vladimir3p | there were ideas to use special metadata keywords | 18:23 |
vladimir3p | this is an option as well... | 18:23 |
DuncanT | As far as whether the scheduler can do anything useful with them, I have no strong view - we have very little requirement from the scheduler | 18:24 |
vladimir3p | regardless of how we will deliver it - the idea is to be able on scheduler level to acces them | 18:24 |
DuncanT | meta-data keywords is basically the generic key-value idea | 18:24 |
renuka | vladimir3p: you mean keywords other than affinity and anti-affinity? | 18:25 |
vladimir3p | DuncanT: yes. Don't know if we want to reserve some keywords for that | 18:25 |
renuka | vladimir3p: or were you saying this in general, and not with respect to affinity alone | 18:25 |
*** jog0 has joined #openstack-meeting | 18:25 | |
vladimir3p | renuka: yes. For now we have no other keywords that we need | 18:26 |
vladimir3p | from our perspective we have following requirements for the scheduler: | 18:26 |
vladimir3p | 1. to be able to create multiple volumes in one call | 18:26 |
vladimir3p | 2. to be able on scheduler level to determine host abilities | 18:26 |
renuka | vladimir3p: I am usually wary of adding generic key value pairs to requests where behavior can be defined... the documentation and behavior becomes hard to keep up with it | 18:27 |
vladimir3p | 3. to be able to specify that particular volume should not be allocated from hosts where other volumes are allocated (anti-affinity) | 18:27 |
vladimir3p | renuka; agree | 18:27 |
DuncanT | renuka: The problem with that is it means all values must be defined, which removes vendor flexibiltiy | 18:27 |
renuka | DuncanT: at this stage, we are having vendors come up and state their requirements, so we should deal with it individually ... | 18:28 |
DuncanT | Allowing arbitary keywords, even with the proviso that they are only for advisory data, gives more flexibility | 18:28 |
renuka | DuncanT: what I mean is, where we need generic key-value pairs like at some point for scheduler rules, we can use them... but we should not use them before that point | 18:29 |
*** dwalleck has quit IRC | 18:30 | |
renuka | DuncanT: like i said, if these are scheduler rules, then maybe we should have a keyword "scheduler-rules" and add these as arbitrary strings that can be passed | 18:31 |
renuka | this will ensure that suddenly no one starts using the generic key value input for defining entirely different behavior | 18:31 |
DuncanT | In our case they aren't really scheduler rules though, they're just extra data to pass to the driver | 18:32 |
DuncanT | renuka: I'll think about what other examples I can come up with. It isn't something that needs a decision now | 18:32 |
renuka | agreed | 18:32 |
*** jog0 has left #openstack-meeting | 18:32 | |
vladimir3p | so, seems like our options are: a. in request structure to have a special field like scheduler/placement requirement. b. put same keyword in meta-data. c. no special keywords - just put to meta-data whatever you want and driver later will look (or not look) at metadata | 18:33 |
renuka | vladimir3p: would it be alright to add an action for you to start the implementation of the scheduler first week of december? | 18:34 |
vladimir3p | yep, put it in | 18:34 |
renuka | #action vladimir3p to start scheduler implementation in the first week of december | 18:34 |
renuka | the other reason to go with known keywords as far as possible is to be able to provide usage strings and maybe at some point auto completion | 18:36 |
vladimir3p | ok guys, do we have anything else to discuss? | 18:38 |
DuncanT | I've nothing this week | 18:38 |
renuka | me neither | 18:38 |
renuka | should we call it a day then? | 18:38 |
vladimir3p | yep. | 18:39 |
DuncanT | Yup | 18:39 |
renuka | #endmeeting | 18:39 |
*** openstack changes topic to "Openstack Meetings: http://wiki.openstack.org/Meetings | Minutes: http://eavesdrop.openstack.org/meetings/openstack-meeting/2011/" | 18:39 | |
openstack | Meeting ended Thu Nov 17 18:39:13 2011 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 18:39 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/openstack-meeting/2011/openstack-meeting.2011-11-17-18.04.html | 18:39 |
vladimir3p | have a great weekend and we will talk in .. 2 weeks | 18:39 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/openstack-meeting/2011/openstack-meeting.2011-11-17-18.04.txt | 18:39 |
openstack | Log: http://eavesdrop.openstack.org/meetings/openstack-meeting/2011/openstack-meeting.2011-11-17-18.04.log.html | 18:39 |
*** renuka has quit IRC | 18:41 | |
*** carlp has quit IRC | 18:42 | |
*** gyee has joined #openstack-meeting | 18:43 | |
vishy | DuncanT: generic key value | 18:43 |
*** carlp has joined #openstack-meeting | 18:45 | |
DuncanT | vishy: Thanks, I'll go that way and let people know next week | 18:45 |
DuncanT | Hopefully I'll have the code by then | 18:45 |
DuncanT | There really isn't much to it | 18:46 |
*** df1 has joined #openstack-meeting | 18:50 | |
*** dendro-afk is now known as dendrobates | 18:53 | |
*** darraghb has quit IRC | 19:00 | |
*** jdg has quit IRC | 19:08 | |
*** vishy has quit IRC | 19:13 | |
*** comstud has quit IRC | 19:13 | |
*** vishy has joined #openstack-meeting | 19:13 | |
*** comstud has joined #openstack-meeting | 19:13 | |
*** jog0_ has joined #openstack-meeting | 19:20 | |
*** jog0_ has quit IRC | 19:21 | |
*** jog0 has joined #openstack-meeting | 19:21 | |
*** dendrobates is now known as dendro-afk | 19:22 | |
*** jog0 has left #openstack-meeting | 19:23 | |
*** dendro-afk is now known as dendrobates | 19:34 | |
*** blamar has quit IRC | 19:39 | |
*** blamar has joined #openstack-meeting | 19:39 | |
*** mirrorbox has quit IRC | 19:43 | |
*** mirrorbox has joined #openstack-meeting | 19:43 | |
*** mikeyp has joined #openstack-meeting | 19:45 | |
*** anotherjesse has joined #openstack-meeting | 19:46 | |
*** maoy has joined #openstack-meeting | 19:57 | |
maoy | hi anybody here? | 20:00 |
*** moneymoney has joined #openstack-meeting | 20:02 | |
moneymoney | join http://www.bemabux.com/?ref=p4ncho | 20:02 |
moneymoney | http://www.bemabux.com/?ref=p4ncho | 20:02 |
moneymoney | http://www.bemabux.com/?ref=p4nchohttp://www.bemabux.com/?ref=p4ncho | 20:02 |
moneymoney | http://www.bemabux.com/?ref=p4ncho | 20:02 |
moneymoney | http://www.bemabux.com/?ref=p4ncho | 20:02 |
moneymoney | http://www.bemabux.com/?ref=p4ncho | 20:02 |
moneymoney | http://www.bemabux.com/?ref=p4ncho | 20:02 |
moneymoney | http://www.bemabux.com/?ref=p4ncho | 20:02 |
moneymoney | http://www.bemabux.com/?ref=p4ncho | 20:02 |
moneymoney | http://www.bemabux.com/?ref=p4ncho | 20:02 |
*** moneymoney has left #openstack-meeting | 20:02 | |
mikeyp | present ! | 20:03 |
mikeyp | do we have a quorum ? | 20:03 |
maoy | looks like just you and me mikeyp | 20:03 |
mikeyp | ok, we can have a short meeting I guess | 20:05 |
mikeyp | #startmeeting Orchestration | 20:05 |
openstack | Meeting started Thu Nov 17 20:05:29 2011 UTC. The chair is mikeyp. Information about MeetBot at http://wiki.debian.org/MeetBot. | 20:05 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic. | 20:05 |
*** openstack changes topic to " (Meeting topic: Orchestration)" | 20:05 | |
maoy | #topic workflow engines | 20:05 |
mikeyp | #topic workflow engines | 20:06 |
*** openstack changes topic to "workflow engines (Meeting topic: Orchestration)" | 20:06 | |
maoy | :) | 20:06 |
maoy | i was wondering about the error handling in the mailing list | 20:07 |
mikeyp | we dont have an agenda full agenda - I think it's workflow engines, eventlet/zookeeper, and anything else | 20:07 |
mikeyp | ok | 20:07 |
maoy | i'm interested more in they handle runtime errors | 20:07 |
*** rohitk has quit IRC | 20:07 | |
maoy | and also if it deal with some failure issues, such as a node is crashed | 20:08 |
mikeyp | main thing I noticed was that exceptions are just raised; there didn't appear to be any concept of exception handling specific to the workflow. | 20:08 |
maoy | is the exception raised in another node (or another Python interpreter)? | 20:08 |
mikeyp | it's single threaded, no conecpt of concurrency or parallelism. | 20:09 |
maoy | got it | 20:09 |
maoy | but we need something that can handle those | 20:09 |
*** mattray has quit IRC | 20:10 | |
*** anotherjesse has quit IRC | 20:10 | |
*** anotherjesse has joined #openstack-meeting | 20:11 | |
mikeyp | definitely, but I didn't find any cloud-grade (tm) workflows libraries | 20:11 |
mikeyp | it's raises the larger point of how this will all work together - think we need Sandy for that. | 20:12 |
maoy | ok. i'll put some thoughts on that too. | 20:12 |
maoy | i'll try to convert my powerpoint proposal to a wiki page before next meeting. | 20:12 |
mikeyp | the strawman I have in my head is 'orchestration' is a reliable service, that calls into other openstack services. | 20:12 |
maoy | now that i've read though the nova code i have a better idea how to fit in the code.. | 20:13 |
maoy | yes | 20:13 |
mikeyp | I'm not sure what the granularity would be, either in initial or later releases. | 20:13 |
maoy | i think combining that, with more orchestration cooperation logic inside the compute/network nodes, we have something there. | 20:14 |
mikeyp | it seems like TROPIC could support fine grained control. | 20:14 |
maoy | the "orchestrator" might actually nicely fit with the scheduler | 20:14 |
*** anotherjesse_ has joined #openstack-meeting | 20:15 | |
mikeyp | agreed - I see changes there. | 20:15 |
maoy | mike, can you elaborate in "fine grained control"? | 20:16 |
mikeyp | just the general level of steps. | 20:16 |
maoy | ok | 20:16 |
mikeyp | so today, the operations are pretty high level. Schedule calls create, and a large number of things happen. | 20:17 |
*** anotherjesse has quit IRC | 20:17 | |
*** anotherjesse_ is now known as anotherjesse | 20:17 | |
mikeyp | should those individual operations be coordinated by orchestration ? | 20:18 |
maoy | i think if they are non trivial, e.g. takes a while to finish | 20:18 |
maoy | they should report their status | 20:18 |
maoy | so that the orchestrator could 1) know what's going on | 20:19 |
maoy | 2) if it's stuck/dead/crashed | 20:19 |
maoy | 3) abort, or restart if necessary | 20:19 |
*** anotherjesse has quit IRC | 20:19 | |
*** dolphm_ has joined #openstack-meeting | 20:19 | |
mikeyp | #action get sandys input on granularity of orchestration | 20:20 |
maoy | the state of the workflow progress should be available | 20:21 |
maoy | it could be either in database, or in zookeeper | 20:21 |
maoy | right now, the task_state column is kind of like that | 20:21 |
maoy | but can definitely be improved | 20:22 |
mikeyp | yes - when I'v done this in the past, workflow runs independently of other operations, and can be interrogated | 20:22 |
*** dolphm has quit IRC | 20:23 | |
*** dwalleck has joined #openstack-meeting | 20:23 | |
mikeyp | in your TROPIC work, where there multiple workflow servers ? | 20:24 |
maoy | i also like to use the analogy of the OS process | 20:24 |
*** dolphm_ has quit IRC | 20:24 | |
maoy | we essentially need to build mechanisms to track the distributed processes as a coherent workflow | 20:24 |
maoy | restart, or abort it if necessary | 20:24 |
maoy | if you look at those business workflow management software, they are solving a different problem | 20:26 |
maoy | yes. in TROPIC we call them controllers | 20:26 |
maoy | there are multiple of them | 20:27 |
mikeyp | business workflow tends to focus on process control, rather than process execution. | 20:27 |
maoy | but only one is elected as leader to make decisions | 20:27 |
mikeyp | so one is active, the others are 'standby' or failover ? | 20:27 |
maoy | yes | 20:28 |
mikeyp | got it - thats what I thoiugh the paper said. | 20:28 |
maoy | it's hard to make distributed decision. :) | 20:28 |
maoy | although possible, we run the numbers and seems one active is fast enough | 20:29 |
maoy | i also looked at the other proposal mentioned in last meeting | 20:29 |
maoy | from dragon | 20:29 |
maoy | i felt it's very similar to the ppt file I sent | 20:30 |
mikeyp | I#topic pacemaker | 20:30 |
mikeyp | #topic pacemaker | 20:30 |
*** openstack changes topic to "pacemaker (Meeting topic: Orchestration)" | 20:30 | |
mikeyp | I haven't really reviewed it, was mostly looking at libraries. | 20:30 |
mikeyp | what are the main differences ? | 20:31 |
maoy | between dragon's and mine? | 20:31 |
mikeyp | yes | 20:31 |
maoy | mine also proposes to keep logs so that we can automatic rollback | 20:32 |
*** nati2 has joined #openstack-meeting | 20:32 | |
*** dolphm has joined #openstack-meeting | 20:33 | |
maoy | hold one | 20:33 |
maoy | i need to refresh my memory. :) | 20:33 |
maoy | #action maoy gives dragon proposal feedback | 20:34 |
maoy | i'll do this in an email after the meeting | 20:34 |
mikeyp | #action maoy gives dragon proposal feedback | 20:34 |
mikeyp | ok, I will also review it. | 20:35 |
*** dolphm has quit IRC | 20:35 | |
maoy | i don't know much about pacemaker | 20:35 |
mikeyp | #action mikeyp to review dragon's proposal | 20:35 |
maoy | the picture of pacemaker seems to suggest that corosync is a dependency which i also know nothing about | 20:36 |
maoy | i got zookeeper working with eventlet | 20:37 |
maoy | so that's not a concern. | 20:37 |
mikeyp | #link https://lists.launchpad.net/openstack/msg03767.html dragondm's proposal | 20:37 |
mikeyp | #topic zookeeper / eventlet | 20:37 |
*** openstack changes topic to "zookeeper / eventlet (Meeting topic: Orchestration)" | 20:37 | |
*** dprince has quit IRC | 20:37 | |
mikeyp | yes, I saw that, good progress. | 20:38 |
mikeyp | #topic vm-stat transitions | 20:38 |
*** openstack changes topic to "vm-stat transitions (Meeting topic: Orchestration)" | 20:38 | |
mikeyp | The proposed vm state transitions are in review | 20:38 |
mikeyp | #link https://review.openstack.org/#change,1695 | 20:39 |
mikeyp | They seem to be held up, but I'm reviewing the changes anyways. | 20:39 |
mikeyp | I should have said state transition management | 20:40 |
maoy | somehow i felt that the solution they proposed is a little too complicated | 20:41 |
maoy | i remember i saw a big state transition table in the summit | 20:41 |
maoy | hopefully it can be simplified, otherwise it's hard to debug | 20:42 |
mikeyp | hopefully, orchestration can remove some of the complications. | 20:42 |
maoy | exactly | 20:43 |
mikeyp | so, what else do we have ? | 20:43 |
mikeyp | #topic wrap up | 20:43 |
*** openstack changes topic to "wrap up (Meeting topic: Orchestration)" | 20:43 | |
maoy | not much | 20:43 |
maoy | next week is thanksgiving | 20:44 |
mikeyp | OK, then lets wrap up till Sandy can review - I know he was out of pocket travelling today. | 20:44 |
maoy | cool | 20:45 |
mikeyp | #action mikeyp to send email re: next week schedule | 20:45 |
mikeyp | ok, ttyl. | 20:45 |
mikeyp | #endmeeting | 20:45 |
*** openstack changes topic to "Openstack Meetings: http://wiki.openstack.org/Meetings | Minutes: http://eavesdrop.openstack.org/meetings/openstack-meeting/2011/" | 20:45 | |
openstack | Meeting ended Thu Nov 17 20:45:48 2011 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 20:45 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/openstack-meeting/2011/openstack-meeting.2011-11-17-20.05.html | 20:45 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/openstack-meeting/2011/openstack-meeting.2011-11-17-20.05.txt | 20:45 |
openstack | Log: http://eavesdrop.openstack.org/meetings/openstack-meeting/2011/openstack-meeting.2011-11-17-20.05.log.html | 20:45 |
maoy | bye | 20:46 |
mikeyp | bye | 20:46 |
*** maoy has quit IRC | 20:46 | |
*** jaypipes has quit IRC | 20:52 | |
zykes- | danwent: around ? :) | 21:01 |
*** jaypipes has joined #openstack-meeting | 21:07 | |
*** mdomsch has joined #openstack-meeting | 21:18 | |
*** dolphm has joined #openstack-meeting | 21:23 | |
*** mdomsch has quit IRC | 21:34 | |
*** nati2 has quit IRC | 21:35 | |
*** mikeyp has left #openstack-meeting | 21:40 | |
*** troytoman-away is now known as troytoman | 21:50 | |
*** dwcramer has quit IRC | 21:52 | |
*** cdub has quit IRC | 21:55 | |
*** dendrobates is now known as dendro-afk | 22:00 | |
*** dendro-afk is now known as dendrobates | 22:03 | |
*** nati2 has joined #openstack-meeting | 22:03 | |
*** deshantm_laptop has quit IRC | 22:10 | |
*** nati2 has quit IRC | 22:12 | |
*** nati2 has joined #openstack-meeting | 22:56 | |
*** GheRivero_ has quit IRC | 23:02 | |
*** novas0x2a|laptop has joined #openstack-meeting | 23:11 | |
*** novas0x2a|laptop is now known as Guest53334 | 23:12 | |
*** dwalleck has quit IRC | 23:17 | |
*** Guest53334 has quit IRC | 23:22 | |
*** anotherjesse has joined #openstack-meeting | 23:40 | |
*** zns has quit IRC | 23:46 | |
*** donaldngo_hp has joined #openstack-meeting | 23:51 | |
*** AlanClark has quit IRC | 23:51 | |
*** troytoman is now known as troytoman-away | 23:56 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!