| *** sarob_ has quit IRC | 00:01 | |
| *** tanisdl has quit IRC | 00:02 | |
| *** megan_w has joined #openstack-meeting-alt | 00:02 | |
| *** megan_w has quit IRC | 00:03 | |
| *** megan_w has joined #openstack-meeting-alt | 00:04 | |
| *** megan_w has quit IRC | 00:09 | |
| *** akuznetsov has quit IRC | 00:40 | |
| *** esp has quit IRC | 00:44 | |
| *** lastidiot has joined #openstack-meeting-alt | 00:49 | |
| *** yidclare has quit IRC | 01:07 | |
| *** arborism has quit IRC | 01:12 | |
| *** IlyaE has quit IRC | 01:13 | |
| *** esp has joined #openstack-meeting-alt | 01:15 | |
| *** IlyaE has joined #openstack-meeting-alt | 01:15 | |
| *** esp has quit IRC | 01:16 | |
| *** IlyaE has quit IRC | 01:30 | |
| *** jergerber has joined #openstack-meeting-alt | 01:38 | |
| *** IlyaE has joined #openstack-meeting-alt | 01:45 | |
| *** IlyaE has quit IRC | 01:50 | |
| *** qwerty_nor has quit IRC | 01:52 | |
| *** IlyaE has joined #openstack-meeting-alt | 02:00 | |
| *** IlyaE has quit IRC | 02:14 | |
| *** sarob has joined #openstack-meeting-alt | 02:28 | |
| *** jergerber has quit IRC | 02:30 | |
| *** jergerber has joined #openstack-meeting-alt | 02:32 | |
| *** sarob has quit IRC | 02:37 | |
| *** sarob has joined #openstack-meeting-alt | 02:38 | |
| *** sarob has quit IRC | 02:42 | |
| *** sarob has joined #openstack-meeting-alt | 02:46 | |
| *** vkmc has quit IRC | 02:48 | |
| *** qwerty_nor has joined #openstack-meeting-alt | 03:04 | |
| *** jrodom has joined #openstack-meeting-alt | 03:09 | |
| *** jergerber has quit IRC | 03:11 | |
| *** dosaboy has quit IRC | 03:19 | |
| *** dosaboy has joined #openstack-meeting-alt | 03:21 | |
| *** sarob has quit IRC | 03:22 | |
| *** sarob has joined #openstack-meeting-alt | 03:22 | |
| *** bdpayne has quit IRC | 03:23 | |
| *** sarob has quit IRC | 03:26 | |
| *** HenryG has quit IRC | 03:28 | |
| *** IlyaE has joined #openstack-meeting-alt | 03:56 | |
| *** SergeyLukjanov has joined #openstack-meeting-alt | 04:05 | |
| *** ekarlso has quit IRC | 04:07 | |
| *** ekarlso has joined #openstack-meeting-alt | 04:07 | |
| *** yidclare has joined #openstack-meeting-alt | 04:11 | |
| *** dosaboy_ has joined #openstack-meeting-alt | 04:21 | |
| *** dosaboy has quit IRC | 04:24 | |
| *** IlyaE has quit IRC | 04:27 | |
| *** yamahata has quit IRC | 04:27 | |
| *** IlyaE has joined #openstack-meeting-alt | 04:28 | |
| *** jrodom has quit IRC | 04:30 | |
| *** vipul is now known as vipul-away | 04:30 | |
| *** IlyaE has quit IRC | 04:30 | |
| *** yamahata has joined #openstack-meeting-alt | 04:32 | |
| *** sarob has joined #openstack-meeting-alt | 04:33 | |
| *** sarob has quit IRC | 04:38 | |
| *** dosaboy has joined #openstack-meeting-alt | 04:45 | |
| *** dosaboy_ has quit IRC | 04:46 | |
| *** IlyaE has joined #openstack-meeting-alt | 04:48 | |
| *** vipul-away is now known as vipul | 04:55 | |
| *** lastidiot has quit IRC | 04:57 | |
| *** IlyaE has quit IRC | 05:00 | |
| *** IlyaE has joined #openstack-meeting-alt | 05:03 | |
| *** IlyaE has quit IRC | 05:04 | |
| *** sarob has joined #openstack-meeting-alt | 05:22 | |
| *** abaron has joined #openstack-meeting-alt | 05:54 | |
| *** SergeyLukjanov has quit IRC | 05:57 | |
| *** IlyaE has joined #openstack-meeting-alt | 06:03 | |
| *** IlyaE has quit IRC | 06:04 | |
| *** SergeyLukjanov has joined #openstack-meeting-alt | 06:06 | |
| *** SergeyLukjanov has quit IRC | 06:10 | |
| *** IlyaE has joined #openstack-meeting-alt | 06:16 | |
| *** sarob has quit IRC | 06:16 | |
| *** sarob has joined #openstack-meeting-alt | 06:17 | |
| *** IlyaE has quit IRC | 06:20 | |
| *** sarob has quit IRC | 06:21 | |
| *** SergeyLukjanov has joined #openstack-meeting-alt | 06:41 | |
| *** sarob has joined #openstack-meeting-alt | 07:28 | |
| *** sarob has quit IRC | 07:32 | |
| *** koudaddy_ has joined #openstack-meeting-alt | 08:37 | |
| *** demorris has joined #openstack-meeting-alt | 10:25 | |
| *** SergeyLukjanov has quit IRC | 10:46 | |
| *** SergeyLukjanov has joined #openstack-meeting-alt | 10:47 | |
| *** demorris has quit IRC | 11:02 | |
| *** SergeyLukjanov has quit IRC | 11:16 | |
| *** SergeyLukjanov has joined #openstack-meeting-alt | 11:17 | |
| *** SergeyLukjanov has quit IRC | 11:20 | |
| *** pcm_ has joined #openstack-meeting-alt | 11:21 | |
| *** SergeyLukjanov has joined #openstack-meeting-alt | 11:24 | |
| *** HenryG has joined #openstack-meeting-alt | 11:38 | |
| *** vkmc has joined #openstack-meeting-alt | 11:55 | |
| *** vkmc has joined #openstack-meeting-alt | 11:55 | |
| *** sballe has joined #openstack-meeting-alt | 13:05 | |
| *** SergeyLukjanov has quit IRC | 13:08 | |
| *** SergeyLukjanov has joined #openstack-meeting-alt | 13:11 | |
| *** SergeyLukjanov has quit IRC | 13:23 | |
| *** jrodom has joined #openstack-meeting-alt | 13:35 | |
| *** demorris has joined #openstack-meeting-alt | 13:35 | |
| *** pdmars has joined #openstack-meeting-alt | 13:39 | |
| *** jcru has joined #openstack-meeting-alt | 13:39 | |
| *** SergeyLukjanov has joined #openstack-meeting-alt | 13:45 | |
| *** flaper87 has joined #openstack-meeting-alt | 13:47 | |
| *** ben_duyujie has joined #openstack-meeting-alt | 13:50 | |
| *** djohnstone has joined #openstack-meeting-alt | 13:52 | |
| *** markwash has joined #openstack-meeting-alt | 13:53 | |
| *** zhiyan has joined #openstack-meeting-alt | 13:58 | |
| markwash | o/ | 14:03 |
|---|---|---|
| flaper87 | \o/ | 14:03 |
| zhiyan | hey | 14:03 |
| markwash | #startmeeting glance | 14:03 |
| openstack | Meeting started Thu Jul 18 14:03:38 2013 UTC. The chair is markwash. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:03 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:03 |
| *** openstack changes topic to " (Meeting topic: glance)" | 14:03 | |
| openstack | The meeting name has been set to 'glance' | 14:03 |
| zhiyan | \o/ | 14:03 |
| flaper87 | \o/ | 14:03 |
| zhiyan | :) | 14:03 |
| markwash | #topic agenda | 14:03 |
| *** openstack changes topic to "agenda (Meeting topic: glance)" | 14:03 | |
| markwash | hi folks | 14:04 |
| zhiyan | hi markwash | 14:04 |
| flaper87 | Hi markwash | 14:04 |
| flaper87 | lol | 14:04 |
| markwash | at the end of next meeting, I wanna have a pretty good idea of what we're trying to deliver over havana-3 | 14:04 |
| zhiyan | btw, thank you all, for review and landing my patch to H2 | 14:04 |
| markwash | but is there other stuff folks want to talk about today? | 14:04 |
| flaper87 | zhiyan: thank you for working on that | 14:05 |
| zhiyan | https://etherpad.openstack.org/glance-havana3-blueprints | 14:05 |
| zhiyan | flaper87: :-D, thanks you! | 14:05 |
| markwash | yes, thanks to zhiyan and all the reviewers. . I think ttx was impressed that we didn't have to drop anything in the last two weeks of h2 | 14:05 |
| zhiyan | coool! | 14:05 |
| zhiyan | markwash: could you pls take a look above link? do you think they are make your sense? | 14:06 |
| markwash | looking | 14:07 |
| *** SergeyLukjanov has quit IRC | 14:07 | |
| markwash | I think those are all good, but I'm still a little unclear about "global state management" | 14:07 |
| markwash | that sounds kind of like something nova does that is problematic | 14:07 |
| zhiyan | maybe i can create BPs for that (except Enable task, others are all I added) | 14:07 |
| flaper87 | markwash: following our former plan to get Glance "Out There" - reading, making it a public service - I'd love to see async workers move forward | 14:08 |
| markwash | #topic havana 3 blueprints | 14:08 |
| *** openstack changes topic to "havana 3 blueprints (Meeting topic: glance)" | 14:08 | |
| markwash | flaper87: +1 | 14:08 |
| flaper87 | This is the patch for that | 14:08 |
| flaper87 | #link https://blueprints.launchpad.net/glance/+spec/async-glance-workers | 14:08 |
| flaper87 | blueprint* | 14:08 |
| markwash | I think we might have a critical mass at this point | 14:08 |
| zhiyan | markwash's draft : https://review.openstack.org/#/c/31874/2 | 14:08 |
| zhiyan | flaper87: +1 | 14:08 |
| markwash | I have a better idea how I think it should work (my draft is not up to date) | 14:08 |
| flaper87 | since the registry stuff is ready, I can focus on that and help you with that blueprint | 14:09 |
| zhiyan | markwash: yes, i'd like post our discussing summary (IRC) to a etherpad page, if you like | 14:09 |
| flaper87 | also, I think this is important - still sticking to our former plan - to have some quotas in glance. IMHO, we should track this down as well | 14:10 |
| flaper87 | #link https://blueprints.launchpad.net/glance/+spec/glance-basic-quotas | 14:10 |
| *** cp16net is now known as cp16net|away | 14:10 | |
| zhiyan | flaper87: could you pls add them to that etherpad page also? | 14:11 |
| markwash | yeah, I think that is just looking for workers at this point | 14:11 |
| markwash | s/workers/developers | 14:12 |
| zhiyan | :) | 14:12 |
| markwash | not to be confused with image workers / async processing | 14:12 |
| flaper87 | markwash: I know John was looking at it (re quotas) | 14:12 |
| zhiyan | maybe that's truth, 'developer' = 'worker' :) | 14:12 |
| *** ben_duyujie has quit IRC | 14:12 | |
| markwash | we could implement async just as a mechanical turk with glance developers manually doing image conversions on their laptops | 14:13 |
| flaper87 | markwash: LOOOOL | 14:13 |
| *** flwang has joined #openstack-meeting-alt | 14:13 | |
| markwash | that might cause a security problem I guess :-) | 14:13 |
| zhiyan | https://etherpad.openstack.org/glance-async-task-discussing | 14:13 |
| markwash | zhiyan thanks | 14:14 |
| markwash | flwang: o/ | 14:15 |
| flwang | markwash:o/ | 14:15 |
| markwash | zhiyan: can you describe the scrubber changes in some more detail? | 14:16 |
| markwash | I'm interested in refactoring it as well, principally to make testing it less brittle and slow | 14:16 |
| zhiyan | markwash: ok, for now, the biggest issue for it is about 'multiple-locations' supporting IMO | 14:17 |
| *** flaper87 has quit IRC | 14:17 | |
| *** flaper87 has joined #openstack-meeting-alt | 14:17 | |
| *** SergeyLukjanov has joined #openstack-meeting-alt | 14:18 | |
| markwash | zhiyan: okay cool, makes sense | 14:18 |
| zhiyan | currently scrubber not support that at all, actually if image has more then one location there, and glance configured using scrubber to remove image, the glance-api will raise exception when use delete image. | 14:18 |
| zhiyan | s/use/user | 14:19 |
| flaper87 | zhiyan: I think I lost the first message, re scrubber. Sorry. Can you re-send it ? | 14:19 |
| zhiyan | and other code also need be refactoring | 14:19 |
| zhiyan | ok, for now, the biggest issue for it is about 'multiple-locations' supporting IMO | 14:19 |
| flaper87 | zhiyan: +1 | 14:19 |
| markwash | I'm also a bit confused about its architecture, not to complicate the discussion, but. . . | 14:20 |
| markwash | it tends to use a local process consuming a file-backed queue of locations to delete | 14:20 |
| zhiyan | flaper87: actually, i checked scrubber code, IMO it's not so clear... | 14:20 |
| markwash | though it can also periodically query the database and shove images into the local queue for processing | 14:21 |
| markwash | its very scatter brained | 14:21 |
| markwash | and yet, its only a small LOC | 14:21 |
| markwash | meaning to say, its not that hard to replace | 14:21 |
| zhiyan | markwash: yes, but i'm not followed your last point .. | 14:22 |
| markwash | when I was looking at it for testing purposes, I thought the best thing would be a rewrite | 14:22 |
| zhiyan | markwash: are you meaning scrubber can be removing? or some change | 14:22 |
| markwash | I don't think we can remove it, because we need something to handle pending deletes | 14:23 |
| zhiyan | markwash: ok, for change what? | 14:23 |
| zhiyan | markwash: yes, i think so. but not clear what you want to rewrite..sorry | 14:23 |
| markwash | zhiyan: I was just thinking of completely rewriting the component that handles pending_deletes | 14:24 |
| markwash | so probably completely replace glance-scrubber | 14:24 |
| zhiyan | markwash: using async-task? | 14:24 |
| zhiyan | or just internal refactoring? | 14:24 |
| markwash | just internal refactoring | 14:24 |
| zhiyan | for glance-scrubber .. ok | 14:24 |
| zhiyan | i will check it when i do that, and I'd like / we can discussing details. | 14:25 |
| flaper87 | I haven't looked at scrubber that much | 14:25 |
| *** lastidiot has joined #openstack-meeting-alt | 14:25 | |
| zhiyan | flaper87: it's easy, small | 14:25 |
| zhiyan | but as markwash said, currently it read delete 'task/request' from file | 14:26 |
| markwash | so, I mention that only as a green light to folks if they want to be a bit drastic with it | 14:26 |
| flaper87 | zhiyan: yeah, I wonder if we'll be ever be able to get rid of it, perhaps using async-workers | 14:26 |
| zhiyan | markwash: aha, thanks. | 14:27 |
| markwash | zhiyan: are those blueprints in the etherpad that you added all things you plan to work on? | 14:27 |
| markwash | or are some of them just general suggestions of things you think need to be done | 14:27 |
| *** IlyaE has joined #openstack-meeting-alt | 14:28 | |
| zhiyan | flaper87: yes, async-task will be good. asynchronous delete image. but there is a issue for async-task, it need support reliable persistent task queue supporing. | 14:28 |
| zhiyan | markwash: i'd like create them, but i'm not sure i have enough bandwidth do all of them, you know. | 14:29 |
| flaper87 | zhiyan: agreed | 14:29 |
| flaper87 | markwash: btw, I remembered another blueprint that I think is important for H-3 | 14:29 |
| markwash | zhiyan: makes sense, can you put your name by the ones you *definitely* want to work on, including teh ones already in progress? | 14:29 |
| flaper87 | markwash: store credentials being saved in the DB | 14:29 |
| markwash | flaper87: ah good point, I think iccha has some current work on that | 14:29 |
| * flaper87 is trying to find the blueprint | 14:29 | |
| markwash | unfortunately the rackspace folks cannot be here today, they have a corporate thing, not just protesting us :-) | 14:30 |
| zhiyan | markwash: sure, will do. | 14:30 |
| flaper87 | markwash: yeah, she mentioned it, we should sync with her about that | 14:30 |
| flaper87 | markwash: LOL | 14:30 |
| flwang | markwash: do we want plan the task bp into h-3? | 14:30 |
| markwash | flwang: I think we do | 14:31 |
| zhiyan | https://review.openstack.org/#/c/34801/ ? | 14:31 |
| markwash | flwang: it is very important and there are several interested folks | 14:31 |
| flaper87 | markwash: and this one: https://blueprints.launchpad.net/glance/+spec/glance-cache-path | 14:31 |
| flwang | markwash: yep, but obviously, we need more discussion | 14:31 |
| flaper87 | I think the cache one is pretyt important as well. | 14:31 |
| flwang | flaper87: agree +1 | 14:32 |
| flwang | I'd like to see the cache management is improved | 14:32 |
| markwash | yeah, there have been some definite requests around that | 14:32 |
| *** demorris has quit IRC | 14:33 | |
| zhiyan | flaper87: markwash: i really think we should write them down to etherpad page | 14:33 |
| markwash | +1 | 14:33 |
| markwash | I just added the cache path one | 14:33 |
| * flaper87 gets the other ones | 14:33 | |
| zhiyan | thanks | 14:33 |
| *** mclarenst has joined #openstack-meeting-alt | 14:34 | |
| *** rnirmal has joined #openstack-meeting-alt | 14:34 | |
| zhiyan | btw, i just know iccha is a lady...since flaper87 use 'she'.. | 14:34 |
| markwash | flwang: you're planning on working on the task / async stuff during h3, correct? | 14:34 |
| flwang | yep | 14:35 |
| flaper87 | zhiyan: she is and she rocks! :D | 14:35 |
| flwang | but I think I need you guys support | 14:35 |
| flwang | to make sure the design is correct :) | 14:35 |
| markwash | flwang: sure thing | 14:35 |
| flaper87 | flwang: +1 | 14:35 |
| flaper87 | flwang: where are you based? | 14:35 |
| markwash | also there are some other folks for whom async processing is very important, and we need to make sure they are in the discussion | 14:35 |
| flwang | flaper87, Beijing, China | 14:35 |
| flaper87 | flwang: cool! | 14:36 |
| markwash | currently nikhil is assigned on the blueprint, but I know he's been very busy with some other work as well and would welcome your work | 14:36 |
| *** bourke has joined #openstack-meeting-alt | 14:36 | |
| flwang | markwash: yep, we have started some discussion since yesterday | 14:36 |
| flwang | flaper87: where are you based? | 14:37 |
| zhiyan | flwang: paste again for you, a summary we discussed yesterday. https://etherpad.openstack.org/glance-async-task-discussing | 14:37 |
| *** mclarenst is now known as mclaren | 14:37 | |
| flwang | zhiyan: great, thanks | 14:37 |
| flaper87 | flwang: I'll take the cache management one, hopefully, the common oslo cache will land soon as well and we can pull that in | 14:37 |
| flaper87 | flwang: Como, Italy | 14:37 |
| flaper87 | flwang: pull me in into the async workers discussions, pls :) | 14:38 |
| markwash | flaper87: have you seen https://blueprints.launchpad.net/glance/+spec/refactoring-move-caching-out-of-middleware ? | 14:38 |
| flwang | flaper87: nice, I love pizza | 14:38 |
| zhiyan | flwang: markwash: and me pls | 14:38 |
| flwang | flaper87: sure thing | 14:38 |
| flwang | zhiyan: sure | 14:39 |
| *** lastidiot has quit IRC | 14:40 | |
| markwash | flaper87: I'd be interested in seeing if we can address that refactoring during the process, or if its too much to take on | 14:40 |
| flaper87 | markwash: mmh, I think I did and forgot. That makes more sense than having a cache service as we discussed once | 14:40 |
| markwash | I'm pretty sad about the way the cache lives at the wsgi middleware layer and thus has to duplicate all the formatting logic | 14:40 |
| flaper87 | markwash: I think we can do it and it makes sense | 14:40 |
| flwang | markwash: +1 | 14:41 |
| flaper87 | also, multiple-location landed already, that will help us on addressing john's comments as well | 14:41 |
| markwash | I think we've got good initial coverage of our h3 blueprints, I'll try to update the pages this week and follow up with questions for folks | 14:42 |
| zhiyan | markwash: flaper87: the BP make sense to me, but i don't think jbresnah's thoughts is right (in whiteboard) maybe i not followed his comments well | 14:42 |
| flaper87 | zhiyan: that came from another discussion about having some kind of service for it, IIRC. I'm pretty sure we have to discuss that a bit further | 14:42 |
| flaper87 | perhaps in our next meeting | 14:43 |
| markwash | zhiyan: I think the idea is that for admins, cache could be managed as another location on the image | 14:43 |
| markwash | I'd like to open up the dicussion in case folks have general issues they want to bring up | 14:43 |
| flaper87 | markwash: o/ | 14:43 |
| markwash | #topic open discussion | 14:43 |
| zhiyan | markwash: i'd like to know them all | 14:43 |
| *** openstack changes topic to "open discussion (Meeting topic: glance)" | 14:43 | |
| flaper87 | o/ | 14:43 |
| markwash | flaper87: go for it | 14:44 |
| zhiyan | markwash: do you think it's time to take a look again on https://blueprints.launchpad.net/nova/+spec/image-multiple-location | 14:44 |
| zhiyan | it's for nova side, but related with glance | 14:44 |
| flaper87 | I'm pretty concerned about the client and it's support for glance's v2, I know iccha and esheffield are working on it | 14:44 |
| zhiyan | thanks for you earlier input for that btw. | 14:44 |
| flaper87 | so, I was planning to take less bps for H-3 and dedicate some more time to the client | 14:45 |
| zhiyan | flaper87: oh, yes, cinder guy ping me again for it, in yesterday cinder weekly meeting | 14:45 |
| flaper87 | but, the client needs some review-help | 14:45 |
| markwash | flaper87: that would make me crazy happy | 14:45 |
| zhiyan | flaper87: just because glanceclient has gay on v2 client, causes cinder has some limitation | 14:45 |
| zhiyan | markwash know that | 14:46 |
| zhiyan | a defect | 14:46 |
| flaper87 | markwash: cool, so, I'll sync with iccha and esheffield and dedicate more time to it | 14:46 |
| markwash | flaper87: noted, I'll double down my efforts to review client patches | 14:46 |
| markwash | should be easy to do, after all 2 * 0 = 0 :-) | 14:47 |
| flaper87 | markwash: question: How are client releases planned? I know those are just tags but when do they happen? | 14:47 |
| markwash | it essentially has its own roadmap | 14:47 |
| markwash | for now, the roadmap issues are v2 support and deprecating legacy I believe | 14:47 |
| flaper87 | markwash: ok, so it's feature based | 14:47 |
| flaper87 | once those are covered, we can release a new version | 14:48 |
| markwash | yeah, it is not tied into the general openstack release | 14:48 |
| flaper87 | oke-doke! | 14:48 |
| markwash | I'm still really interested in someone basically taking on the client as pseudo-ptl, honestly | 14:48 |
| markwash | because I keep accidentally ignoring it to focus on the server side | 14:48 |
| flaper87 | markwash: I raised my hand the last time :D | 14:48 |
| *** tanisdl has joined #openstack-meeting-alt | 14:49 | |
| markwash | I think you'd be a good fit, but we probably have to sync up more to make the transition | 14:49 |
| zhiyan | markwash: flaper87: can you take a look on https://review.openstack.org/#/c/37616/ ? | 14:49 |
| zhiyan | for resolve this: https://bugs.launchpad.net/glance/+bug/1202391 | 14:49 |
| markwash | zhiyan: yes, thanks for that | 14:49 |
| flaper87 | markwash: yup, we should also ask iccha! | 14:50 |
| zhiyan | +2 pls, if you ok, just don't like other guys say my patch block something. :) | 14:50 |
| flwang | is it time to call for reviewer ? :) | 14:50 |
| flaper87 | oke, that was my point for the open discussion | 14:50 |
| flaper87 | :D | 14:50 |
| bourke | was wondering did anyone have any thoughts on the topic of unicode in exceptions... | 14:51 |
| flaper87 | bourke: ? | 14:51 |
| zhiyan | bourke: https://review.openstack.org/#/c/37421/ ? | 14:51 |
| bourke | flaper87: both yourself and zhiyan have a nice fairly similar solution there | 14:51 |
| flaper87 | zhiyan: https://review.openstack.org/#/c/36658/ | 14:52 |
| flaper87 | :D | 14:52 |
| zhiyan | yes, i lean from flaper87 :) | 14:52 |
| bourke | flaper87: but was wondering what about other exceptions. is it something that could be wrapped in a function and used in multiple places? | 14:52 |
| zhiyan | aha, since you give me a comment, so i checked your patch, and got it | 14:52 |
| flwang | markwash: flaper87: may I get your comments about this https://review.openstack.org/#/c/37511/ ? | 14:52 |
| zhiyan | bourke: can we take care that be case by case? defect driven maybe more easy | 14:53 |
| flaper87 | zhiyan: +! | 14:53 |
| flaper87 | zhiyan: +1 | 14:53 |
| bourke | sure thing | 14:53 |
| *** tanisdl has quit IRC | 14:53 | |
| zhiyan | bourke: thanks you for you raise this up, i just forget it... | 14:54 |
| *** tanisdl has joined #openstack-meeting-alt | 14:54 | |
| markwash | flwang: I like that you are getting the latest oslo.rpc code, but I'd still slightly prefer to see it in another patch | 14:54 |
| markwash | flwang: maybe you can ask the other submitter to update their patch with the latest code? | 14:54 |
| zhiyan | markwash: yes https://review.openstack.org/#/c/37184/ | 14:54 |
| flaper87 | flwang: have you looked at the new oslo.messaging? | 14:55 |
| flaper87 | I wonder whether it is worth to pull oslo's rpc code into glance instead of waiting 'til new oslo.messaging is ready | 14:55 |
| zhiyan | 5 mins left | 14:55 |
| *** pdmars has quit IRC | 14:56 | |
| flwang | flaper87: nope, what's up? | 14:56 |
| markwash | flaper87: I think the goal here is to use notifier, which depends on rpc | 14:56 |
| flwang | markwash: yes | 14:56 |
| *** pdmars has joined #openstack-meeting-alt | 14:56 | |
| flaper87 | markwash: indeed, that notifier will depend on oslo.messaging by the end of H-3 | 14:56 |
| markwash | flaper87: well, that's pretty nice | 14:57 |
| bourke | oh, one other thing, if someone could take a look at https://review.openstack.org/#/c/35286/ that would be much appreciated | 14:57 |
| flaper87 | is it worth to pull all that in instead of waiting for that migration to happen ? | 14:57 |
| flwang | flaper87: any blueprint or bug to track that? | 14:57 |
| flaper87 | flwang: erm, let me check | 14:57 |
| markwash | bourke: looks like an easy +2 approve, will check immediately after mtg | 14:57 |
| bourke | markwash: thanks! | 14:57 |
| markwash | flaper87: do you know if its like "early h3" for being ready? or last minute? | 14:58 |
| zhiyan | and https://review.openstack.org/#/c/36884/ and https://review.openstack.org/#/c/37222/ | 14:58 |
| flwang | flaper87: it oslo.messaging is the direction, it would be nice to do that | 14:58 |
| flaper87 | markwash: I'd say last minute | 14:58 |
| *** akuznetsov has joined #openstack-meeting-alt | 14:58 | |
| markwash | any other folks have last minute notices or announcements? | 14:59 |
| flwang | markwash: so I still can't get approve for my fix ? O:-) | 14:59 |
| flwang | flaper87: any comments? | 14:59 |
| flaper87 | flwang: TBH, I'd wait for that before pulling oslo's notification in | 14:59 |
| flaper87 | because oslo.rpc has some config parameters that might change when oslo.messaging is complete | 15:00 |
| zhiyan | markwash: just notice, pls review https://review.openstack.org/#/c/37616/ for fix https://bugs.launchpad.net/glance/+bug/1202391 | 15:00 |
| flaper87 | among other things | 15:00 |
| markwash | flaper87: that makes sense | 15:00 |
| *** pdmars has quit IRC | 15:01 | |
| flwang | markwash: how do you think? IMO, I think we can do the refactoring for notifier and follow up the change of oslo.messaging | 15:01 |
| *** demorris has joined #openstack-meeting-alt | 15:01 | |
| *** megan_w has joined #openstack-meeting-alt | 15:01 | |
| markwash | we can, but it increases the operational burden | 15:01 |
| markwash | I think we have to clear out now folks | 15:01 |
| markwash | thanks errbody | 15:02 |
| flaper87 | kk, good meeting! Thanks to all!! | 15:02 |
| markwash | #endmeeting | 15:02 |
| flwang | back to our channel | 15:02 |
| *** openstack changes topic to "OpenStack meetings (alternate)" | 15:02 | |
| zhiyan | thanks | 15:02 |
| openstack | Meeting ended Thu Jul 18 15:02:11 2013 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:02 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/glance/2013/glance.2013-07-18-14.03.html | 15:02 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/glance/2013/glance.2013-07-18-14.03.txt | 15:02 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/glance/2013/glance.2013-07-18-14.03.log.html | 15:02 |
| *** mclaren has quit IRC | 15:02 | |
| *** flaper87 has left #openstack-meeting-alt | 15:02 | |
| *** jrodom has quit IRC | 15:02 | |
| *** sballe has quit IRC | 15:03 | |
| *** jrodom has joined #openstack-meeting-alt | 15:03 | |
| markwash | bourke: btw I reviewed your patch, one note in there I'd like you to check out | 15:04 |
| bourke | markwash: thanks, will check that out now | 15:05 |
| *** lastidiot has joined #openstack-meeting-alt | 15:11 | |
| *** vipul is now known as vipul-away | 15:13 | |
| *** bdpayne has joined #openstack-meeting-alt | 15:20 | |
| *** lastidiot has quit IRC | 15:21 | |
| *** markwash has quit IRC | 15:23 | |
| *** lastidiot has joined #openstack-meeting-alt | 15:24 | |
| *** sarob has joined #openstack-meeting-alt | 15:33 | |
| *** sarob has quit IRC | 15:36 | |
| *** sarob has joined #openstack-meeting-alt | 15:36 | |
| *** SergeyLukjanov has quit IRC | 15:40 | |
| *** sarob has quit IRC | 15:40 | |
| *** SergeyLukjanov has joined #openstack-meeting-alt | 15:43 | |
| *** sarob has joined #openstack-meeting-alt | 15:44 | |
| *** vipul-away is now known as vipul | 15:52 | |
| *** pdmars has joined #openstack-meeting-alt | 15:55 | |
| *** yidclare has left #openstack-meeting-alt | 16:02 | |
| *** yidclare has joined #openstack-meeting-alt | 16:05 | |
| *** yidclare has left #openstack-meeting-alt | 16:05 | |
| *** yidclare has joined #openstack-meeting-alt | 16:05 | |
| *** yidclare has left #openstack-meeting-alt | 16:06 | |
| *** SergeyLukjanov has quit IRC | 16:06 | |
| *** hub_cap has left #openstack-meeting-alt | 16:07 | |
| *** demorris has quit IRC | 16:07 | |
| *** qwerty_nor has quit IRC | 16:14 | |
| *** zhiyan has quit IRC | 16:20 | |
| *** SergeyLukjanov has joined #openstack-meeting-alt | 16:30 | |
| *** jrodom has quit IRC | 16:36 | |
| *** jcru is now known as jcru|away | 16:43 | |
| *** esp has joined #openstack-meeting-alt | 16:43 | |
| *** esp has left #openstack-meeting-alt | 16:43 | |
| *** mattf has joined #openstack-meeting-alt | 16:46 | |
| *** jrodom has joined #openstack-meeting-alt | 16:46 | |
| *** jrodom has quit IRC | 16:49 | |
| *** sarob_ has joined #openstack-meeting-alt | 16:53 | |
| *** sarob has quit IRC | 16:57 | |
| *** pdmars has quit IRC | 16:57 | |
| *** markwash has joined #openstack-meeting-alt | 16:58 | |
| *** pdmars has joined #openstack-meeting-alt | 16:58 | |
| *** sarob_ has quit IRC | 16:58 | |
| *** sarob has joined #openstack-meeting-alt | 16:59 | |
| *** jergerber has joined #openstack-meeting-alt | 16:59 | |
| *** pdmars has quit IRC | 17:02 | |
| *** markwash_ has joined #openstack-meeting-alt | 17:05 | |
| *** markwash has quit IRC | 17:06 | |
| *** markwash_ is now known as markwash | 17:06 | |
| *** akuznetsov has quit IRC | 17:28 | |
| *** akuznetsov has joined #openstack-meeting-alt | 17:39 | |
| *** Riddhi has joined #openstack-meeting-alt | 17:42 | |
| *** Riddhi has quit IRC | 17:44 | |
| *** Riddhi has joined #openstack-meeting-alt | 17:45 | |
| *** demorris has joined #openstack-meeting-alt | 17:46 | |
| *** Riddhi has quit IRC | 17:48 | |
| *** Riddhi has joined #openstack-meeting-alt | 17:49 | |
| *** Nadya has joined #openstack-meeting-alt | 17:52 | |
| *** ruhe has joined #openstack-meeting-alt | 17:58 | |
| SergeyLukjanov | Savanna team meeting will be here in 5 minutes | 17:58 |
| *** crobertsrh has joined #openstack-meeting-alt | 18:00 | |
| *** jcru|away is now known as jcru | 18:00 | |
| *** dmitryme has joined #openstack-meeting-alt | 18:00 | |
| *** marcos_sb has joined #openstack-meeting-alt | 18:02 | |
| *** nkonovalov__ has joined #openstack-meeting-alt | 18:02 | |
| *** pdmars has joined #openstack-meeting-alt | 18:03 | |
| SergeyLukjanov | hi everyone! | 18:04 |
| SergeyLukjanov | where is a savanna team? :) | 18:04 |
| ruhe | o/ | 18:04 |
| *** jmaron has joined #openstack-meeting-alt | 18:05 | |
| SergeyLukjanov | ok, I think we should start | 18:06 |
| SergeyLukjanov | #startmeeting savanna | 18:07 |
| openstack | Meeting started Thu Jul 18 18:07:08 2013 UTC. The chair is SergeyLukjanov. Information about MeetBot at http://wiki.debian.org/MeetBot. | 18:07 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 18:07 |
| *** openstack changes topic to " (Meeting topic: savanna)" | 18:07 | |
| openstack | The meeting name has been set to 'savanna' | 18:07 |
| SergeyLukjanov | #topic Agenda | 18:07 |
| SergeyLukjanov | #info General news | 18:07 |
| SergeyLukjanov | #info Other updates | 18:07 |
| SergeyLukjanov | #info Action items from the last meeting | 18:07 |
| SergeyLukjanov | #info Next gen architecture | 18:07 |
| *** openstack changes topic to "Agenda (Meeting topic: savanna)" | 18:07 | |
| SergeyLukjanov | #info EDP discusion | 18:07 |
| SergeyLukjanov | #info General discussion | 18:07 |
| SergeyLukjanov | #topic General news | 18:08 |
| *** openstack changes topic to "General news (Meeting topic: savanna)" | 18:08 | |
| SergeyLukjanov | #info Savanna 0.2 has been successfully released! | 18:08 |
| SergeyLukjanov | both savanna and savanna-dashboard available at pypi and tarballs.openstack.org | 18:09 |
| SergeyLukjanov | #info Docs has been updated before release | 18:09 |
| SergeyLukjanov | Tons of docs has been written and now I think our docs looks pretty good | 18:10 |
| SergeyLukjanov | there are user guide, dev guide and quick start in docs | 18:10 |
| SergeyLukjanov | #link https://savanna.readthedocs.org/en/0.2/ | 18:11 |
| SergeyLukjanov | #info HDP plugin has been merged and targeted to be released in 0.2.1 version | 18:11 |
| *** cp16net|away is now known as cp16net | 18:11 | |
| SergeyLukjanov | Thanks for Hortonworks team! | 18:11 |
| *** Riddhi has quit IRC | 18:11 | |
| SergeyLukjanov | are there anybody from Hortonworks here? | 18:11 |
| SergeyLukjanov | ok, let's move on | 18:12 |
| SergeyLukjanov | #info Instances deletion has been implemented for cluster scaling | 18:12 |
| jmaron | yes - I'm here | 18:12 |
| SergeyLukjanov | jmaron, hi, my congratulations! | 18:12 |
| *** Riddhi has joined #openstack-meeting-alt | 18:12 | |
| jmaron | thanks | 18:12 |
| SergeyLukjanov | Nadya, thank you for continuously improving Hadoop scaling feature! | 18:13 |
| SergeyLukjanov | #info Minor bug fixes and improvements | 18:13 |
| SergeyLukjanov | #info Savanna 0.2.1 release planned to July, 29 | 18:14 |
| Nadya | SergeyLukjanov, thanks :) | 18:14 |
| SergeyLukjanov | #topic Other updates | 18:14 |
| *** openstack changes topic to "Other updates (Meeting topic: savanna)" | 18:14 | |
| SergeyLukjanov | team, are there any other updates? | 18:14 |
| SergeyLukjanov | #info A lot of new unit and integration tests has been added | 18:15 |
| SergeyLukjanov | let's move on | 18:15 |
| SergeyLukjanov | #topic Action items from the last meeting | 18:15 |
| *** openstack changes topic to "Action items from the last meeting (Meeting topic: savanna)" | 18:15 | |
| SergeyLukjanov | #info we have no action items from the last meeting | 18:16 |
| SergeyLukjanov | :) | 18:16 |
| SergeyLukjanov | #topic Next generation Savanna architecture | 18:16 |
| *** openstack changes topic to "Next generation Savanna architecture (Meeting topic: savanna)" | 18:16 | |
| SergeyLukjanov | I've prepared a small document that describes our current vision on improving Savanna architecture | 18:17 |
| *** Riddhi has quit IRC | 18:17 | |
| SergeyLukjanov | #link https://wiki.openstack.org/wiki/Savanna/NextGenArchitecture | 18:17 |
| SergeyLukjanov | I'm planning to add more details to it tomorrow and prepare blueprints for all key stuff | 18:18 |
| *** IlyaE has quit IRC | 18:18 | |
| SergeyLukjanov | feel free to comment, ask questions | 18:18 |
| *** Riddhi has joined #openstack-meeting-alt | 18:18 | |
| *** jrodom has joined #openstack-meeting-alt | 18:19 | |
| SergeyLukjanov | I'll post this link to the mailing lists when it'll be finished | 18:19 |
| SergeyLukjanov | the main goal it is to make Savanna scalable | 18:19 |
| SergeyLukjanov | are there any question on it now? | 18:20 |
| *** sballe has joined #openstack-meeting-alt | 18:20 | |
| SergeyLukjanov | ok, let's move on | 18:20 |
| SergeyLukjanov | #topic EDP | 18:20 |
| *** openstack changes topic to "EDP (Meeting topic: savanna)" | 18:20 | |
| SergeyLukjanov | rune, akuznetsov, are there any questions or updates from your side? | 18:20 |
| SergeyLukjanov | sorry again, s/rune/ruhe/ | 18:21 |
| ruhe | we're working in etherpad doc now | 18:21 |
| ruhe | #link https://etherpad.openstack.org/edp_v3_components | 18:21 |
| akuznetsov | tmckayrh created a sequence diagram | 18:22 |
| akuznetsov | #link https://wiki.openstack.org/wiki/Savanna/EDP_Sequences | 18:22 |
| ruhe | as we agreed with tmckayrh (Trevor) today we will work together on the etherpad to add more details for each component | 18:22 |
| ruhe | right now it is very raw and mostly based on blueprints published by akuznetsov | 18:23 |
| ruhe | good news: we're aligned with Trevor and Chad on the EDP vision. so i expect good progress on this document | 18:25 |
| SergeyLukjanov | are there anything more about edp? | 18:25 |
| crobertsrh | I continue to evolve the UI mockups for EDP: https://wiki.openstack.org/wiki/Savanna/UIMockups/JobCreation | 18:26 |
| ruhe | there are several open questions, but i think it'll be better to solve them in mailing list | 18:26 |
| ruhe | questions are about Oozie and about division of responsibilities between plugin and EDP component | 18:27 |
| ruhe | crobertsrh, mockups look good to me | 18:28 |
| akuznetsov | crobertsrh, I proposed following changes for job parameters page | 18:29 |
| crobertsrh | thanks. Still evolving a bit as the api becomes clearer | 18:29 |
| akuznetsov | #link https://wiki.openstack.org/w/images/f/f0/JobParameters.png | 18:29 |
| akuznetsov | crobertsrh do you have some comments? | 18:30 |
| crobertsrh | akuznetsov: ack. That seems like a reasonable approach there. | 18:30 |
| ruhe | i don't have anything else on EDP | 18:31 |
| ruhe | for those who might not know: EDP = Elastic Data Processing | 18:31 |
| SergeyLukjanov | are there any other thoughts on EDP? | 18:31 |
| *** jrodom has quit IRC | 18:32 | |
| SergeyLukjanov | ok, thank you guys for updates | 18:32 |
| SergeyLukjanov | #info General discussion | 18:32 |
| *** jrodom has joined #openstack-meeting-alt | 18:33 | |
| SergeyLukjanov | #topic General discussion | 18:33 |
| *** openstack changes topic to "General discussion (Meeting topic: savanna)" | 18:33 | |
| SergeyLukjanov | if there no questions or news we can end meeting | 18:35 |
| SergeyLukjanov | #info JFYI you can always use openstack-dev@lists.openstack.org mailing lists and #savanna irc channel to find us and ask your questions | 18:35 |
| SergeyLukjanov | #endmeeting | 18:35 |
| *** openstack changes topic to "OpenStack meetings (alternate)" | 18:35 | |
| openstack | Meeting ended Thu Jul 18 18:35:53 2013 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 18:35 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/savanna/2013/savanna.2013-07-18-18.07.html | 18:35 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/savanna/2013/savanna.2013-07-18-18.07.txt | 18:35 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/savanna/2013/savanna.2013-07-18-18.07.log.html | 18:35 |
| *** dmitryme has left #openstack-meeting-alt | 18:41 | |
| *** IlyaE has joined #openstack-meeting-alt | 18:44 | |
| *** jrodom has quit IRC | 18:49 | |
| *** esheffield has joined #openstack-meeting-alt | 18:51 | |
| *** esheffield has left #openstack-meeting-alt | 18:51 | |
| *** zyuan has joined #openstack-meeting-alt | 18:53 | |
| *** cppcabrera has joined #openstack-meeting-alt | 18:56 | |
| *** amitgandhi has joined #openstack-meeting-alt | 18:56 | |
| *** malini has joined #openstack-meeting-alt | 18:58 | |
| *** bryansd has joined #openstack-meeting-alt | 19:00 | |
| *** kgriffs has joined #openstack-meeting-alt | 19:00 | |
| *** flaper87 has joined #openstack-meeting-alt | 19:03 | |
| *** jrodom has joined #openstack-meeting-alt | 19:03 | |
| *** Sriram has joined #openstack-meeting-alt | 19:03 | |
| kgriffs | o/ | 19:03 |
| flaper87 | \o/ | 19:04 |
| kgriffs | let's get this party started | 19:04 |
| megan_w | woohoo | 19:04 |
| kgriffs | #topic marconi | 19:05 |
| kgriffs | #startmeeting marconi | 19:05 |
| openstack | Meeting started Thu Jul 18 19:05:16 2013 UTC. The chair is kgriffs. Information about MeetBot at http://wiki.debian.org/MeetBot. | 19:05 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 19:05 |
| *** openstack changes topic to " (Meeting topic: marconi)" | 19:05 | |
| openstack | The meeting name has been set to 'marconi' | 19:05 |
| cppcabrera | Woot | 19:05 |
| flaper87 | \o/ | 19:05 |
| kgriffs | #topic review actions from last time | 19:05 |
| *** openstack changes topic to "review actions from last time (Meeting topic: marconi)" | 19:05 | |
| kgriffs | #link http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-07-11-19.03.html | 19:05 |
| kgriffs | 1.oz_akan_ and flaper87 to investigate mongo insert performance | 19:05 |
| flaper87 | kgriffs: It wasn't possible to do that, we'll have to schedule it for next week | 19:06 |
| kgriffs | ok | 19:06 |
| kgriffs | #action oz_akan_ and flaper87 to investigate mongo insert performance | 19:06 |
| kgriffs | 2. flaper87 to document client cleanup | 19:07 |
| flaper87 | kgriffs: I started it here: https://etherpad.openstack.org/apiclient-marconi and folks helped me out | 19:07 |
| flaper87 | Alessio added a bunch of stuff there | 19:07 |
| kgriffs | sweet. can we get these turned into bugs/bp's? | 19:07 |
| cppcabrera | Yup. I can do that today. | 19:08 |
| * cppcabrera volunteers for action | 19:08 | |
| kgriffs | imaginary internet bonus points (IIBP's) for anyone who helps! | 19:08 |
| flaper87 | cppcabrera: I'll help you with that | 19:08 |
| *** sarob has quit IRC | 19:08 | |
| *** mattf has left #openstack-meeting-alt | 19:08 | |
| cppcabrera | Awesome, flaper87! | 19:08 |
| kgriffs | #action cppcabrera, flaper87 to turn apiclient-marconi etherpad into bps/bugs | 19:08 |
| *** sarob has joined #openstack-meeting-alt | 19:09 | |
| kgriffs | 3. flaper87 to merge patches | 19:09 |
| kgriffs | well, that's rather specific, isn't it? | 19:09 |
| kgriffs | :p | 19:09 |
| cppcabrera | Hahaha | 19:09 |
| flaper87 | wheheheheheh | 19:09 |
| cppcabrera | Common lib patches were merged. | 19:09 |
| flaper87 | yeah, and we pointed out what needs to be done next | 19:09 |
| kgriffs | sweet. nice work | 19:10 |
| cppcabrera | I think the input validation framework is still pending? Is that correct? | 19:10 |
| zyuan | yes. | 19:10 |
| flaper87 | yup | 19:10 |
| kgriffs | 4. flaper87, cppcabrera to finalize client design | 19:10 |
| cppcabrera | We certainly rocked out on that item last week. All kinds of brainstorming happened. | 19:10 |
| Sriram | +1 | 19:10 |
| flaper87 | indeed +1 | 19:10 |
| kgriffs | still some loose ends there? | 19:10 |
| cppcabrera | #link https://wiki.openstack.org/wiki/Python_Marconi_Client | 19:10 |
| flaper87 | cppcabrera: good work on that! | 19:11 |
| cppcabrera | #link https://wiki.openstack.org/wiki/Marconi/specs/zmq/api/v1 | 19:11 |
| * flaper87 didn't know that page exists. | 19:11 | |
| flaper87 | glad it does | 19:11 |
| flaper87 | cppcabrera: +1 | 19:11 |
| zyuan | there are many thoughts on the input validation, while the auther is not in the office. | 19:11 |
| cppcabrera | A few loose ends remain, mostly in regards to adding polling support (drafting that now), and... some I can't think of yet. :P | 19:11 |
| kgriffs | #action cppcabrera to tie up loose ends re python-marconicient v1 design | 19:12 |
| kgriffs | 5. zyuan to write up metadata handling proposal and review next time | 19:12 |
| cppcabrera | +1. I'll pick all your brains on that. :D | 19:12 |
| zyuan | wrote, as in the comment | 19:13 |
| * kgriffs wonders if cppcabrera is secretly a zombie | 19:13 | |
| zyuan | see card #287 | 19:13 |
| zyuan | QAQ | 19:13 |
| kgriffs | ok, let's take that topic now | 19:13 |
| *** cp16net is now known as cp16net|away | 19:13 | |
| kgriffs | #topic metadata handling proposal | 19:13 |
| *** openstack changes topic to "metadata handling proposal (Meeting topic: marconi)" | 19:13 | |
| *** sarob has quit IRC | 19:13 | |
| kgriffs | zyuan: you have the floor. :D | 19:14 |
| *** vipul is now known as vipul-away | 19:14 | |
| *** vipul-away is now known as vipul | 19:14 | |
| kgriffs | (15 minutes) | 19:14 |
| kgriffs | (for this topic) | 19:14 |
| zyuan | first i want to clearify | 19:15 |
| kgriffs | I've discussed this at length already with zyuan, so I'll sit on the sidelines for a bit | 19:15 |
| zyuan | the checking is costly. | 19:15 |
| zyuan | because the checking is to check have a user used a _name we already defined" | 19:16 |
| zyuan | not just to check whether the user have _ prefix in their metadata | 19:16 |
| zyuan | to distinguish "their" metadata from ours, we have to check all the _ prefixed metadata one by one | 19:17 |
| zyuan | 1st it decreases runtime performance | 19:17 |
| zyuan | 2nd it makes it hard for us to define new _names | 19:18 |
| zyuan | (the list will become longer and longer) | 19:18 |
| zyuan | (and can hardly be driver-specific) | 19:18 |
| cppcabrera | I agree on the performance portion. It's O(n), given n is the number of metadata fields defined. The actual check can be against a dictionary of reserved names O(1). So O(n) * O(1). | 19:18 |
| flaper87 | TBH, I was thinking about that as forbidding anything starting with _ | 19:19 |
| zyuan | cppcabrera: trust me, never think O(1) is cheap | 19:19 |
| flaper87 | that will avoid having to have a secondary list with reserved words | 19:19 |
| zyuan | O(1) is cost -- when compared with 1 | 19:19 |
| flaper87 | if we don't want to use _ for reserved metadata, we can pick another prefix | 19:20 |
| zyuan | flaper87: i considered about that. | 19:20 |
| zyuan | like C++'s std namespace | 19:20 |
| zyuan | we can have our own | 19:20 |
| cppcabrera | Hmm... namespaced metadata... that sounds pretty awesome. | 19:20 |
| zyuan | but the core problem is not changed: what if a user expend the std namespace and add their own stuff? | 19:20 |
| zyuan | (some programmers really open the std namespace....) | 19:21 |
| cppcabrera | No need to check user meta - that can be bundled as "metadata" : { "user" : { "mine" : ...} } and ours can be in "metadata" : { "private": { ... } } | 19:21 |
| cppcabrera | What if used that kind of scheme? | 19:21 |
| flaper87 | well, the limit is up to us. What about just keeping everything in a separate metadata field that we *don't* return? | 19:21 |
| cppcabrera | flaper87: Roughly what I was thinking. | 19:22 |
| flaper87 | cppcabrera: :P | 19:22 |
| zyuan | then user can't see their configurations | 19:22 |
| flaper87 | my turn to squize your brain | 19:22 |
| kgriffs | flaper87: we would need a different resource type to support setting it | 19:22 |
| flaper87 | :D | 19:22 |
| cppcabrera | :) | 19:22 |
| zyuan | when i was implementing per-queue grace, i found that we have to return it | 19:22 |
| flaper87 | kgriffs: that would make acl easier, wouldn't it ? | 19:22 |
| kgriffs | so, either same resource type with reserved sub-document name (namespace) or two different resources | 19:23 |
| flaper87 | btw, just thinking outloud | 19:23 |
| amitgandhi | reserved namespacing +1 | 19:23 |
| zyuan | as i said, a reserved namespace does not solve the problem intrinsincally. | 19:24 |
| kgriffs | zyuan: pls elaborate | 19:24 |
| zyuan | check or not check is the 1st problem | 19:24 |
| zyuan | how to reserve -- 2nd problem | 19:25 |
| flaper87 | zyuan: if we don;t answer the 2nd we won't be able to answer the 1st, IMHO | 19:25 |
| kgriffs | let's assume we namespace reserved variables | 19:25 |
| kgriffs | (for the sake of argument) | 19:25 |
| kgriffs | how does that effect 1st problem? | 19:26 |
| kgriffs | affect | 19:26 |
| zyuan | my opinion is, it does not. | 19:26 |
| zyuan | if you want to enforce the checking, you need to perform the checking wherever you have "reserved" things. | 19:27 |
| cppcabrera | I does change the check a lot, in my eyes. It changes the check from verifying whether *any* field in metadata is a reserved one to checking whether the PATCH operation contains a document that identifies itself with the key "reserved". | 19:28 |
| *** marcos_sb has quit IRC | 19:28 | |
| cppcabrera | Hmm... | 19:28 |
| kgriffs | but we want to allow them to PATCH that portion, no? | 19:29 |
| cppcabrera | Right. I got things mixed. :P | 19:29 |
| zyuan | oh, then you need to verify *any* fields in your reserved interface | 19:29 |
| *** vipul is now known as vipul-away | 19:29 | |
| zyuan | s/interface/namespace/ | 19:29 |
| cppcabrera | I was thinking of the "create metadata" and thought I meant patch, heh. | 19:29 |
| cppcabrera | But yeah, we disallow users from creating new metadata fields in the reserved space. | 19:29 |
| cppcabrera | s/space/namespace | 19:30 |
| zyuan | there is no PATCH opt for queue; only PUT | 19:30 |
| cppcabrera | zyuan: Yup, I remembered after I posted my sentence. :) | 19:30 |
| Sriram | yes. i think there is a patch for only for claims. | 19:30 |
| zyuan | then you have to check the names under the reserved namespace | 19:30 |
| flaper87 | but, the reserved metadata should be used internally, right? | 19:30 |
| *** cp16net|away is now known as cp16net | 19:30 | |
| Sriram | *ignore first for | 19:30 |
| kgriffs | so, sounds like namespacing maybe helps psychologically, but not necessarily technically? | 19:31 |
| zyuan | kgriffs: yes. it may looks clearer, but the problem is still there. | 19:31 |
| zyuan | (but to me, i think _ is enough...) | 19:31 |
| zyuan | (if your argument is like "who will touch 'metadata'") | 19:32 |
| flaper87 | I think we should think about a real use-case | 19:32 |
| flaper87 | (For the sake of the argument) | 19:32 |
| kgriffs | go for it | 19:32 |
| zyuan | (i can answer "who will touch _names?") | 19:32 |
| * cppcabrera wishes we had a whiteboard to think this one out | 19:32 | |
| * kgriffs budgets a few more minutes for this topic | 19:32 | |
| Sriram | +1, a real use-case will help. | 19:32 |
| cppcabrera | +1 flaper87 | 19:32 |
| kgriffs | stand by | 19:33 |
| zyuan | example, if we have a field (w/o namespace/prefix) | 19:33 |
| zyuan | called "grace" | 19:33 |
| zyuan | with prefix | 19:33 |
| flaper87 | so, when we first talk about reserved emtadata, IIRC, we were thinking about having different custom TTL per queue | 19:33 |
| flaper87 | I mean, queue level TTL, IIRC | 19:33 |
| zyuan | it's "_grace" | 19:33 |
| flaper87 | or grace | 19:33 |
| zyuan | if you want to do the checking, you need to keep a list of those names | 19:34 |
| kgriffs | yes, that's a good example - queue-level defaults if not specified per message/claim | 19:34 |
| zyuan | and theck the global namespace | 19:34 |
| cppcabrera | +1 for context | 19:34 |
| zyuan | if we use a reserved namespace instead | 19:34 |
| flaper87 | so, having a queue level default means we have to read it everytime a message will be posted | 19:34 |
| zyuan | say, "metadata" | 19:34 |
| zyuan | then the global namespace become | 19:34 |
| kgriffs | flaper87: yes, but we could cache I suppose | 19:34 |
| zyuan | {"metadata" : {"grace": 60}} | 19:35 |
| flaper87 | which means that it won't be enough to have *just* the queue id when doing that | 19:35 |
| kgriffs | (memcached/redis colocated on app server) | 19:35 |
| flaper87 | kgriffs: right right, just bringing the worst case scenario | 19:35 |
| flaper87 | well, actually, that helps with the context | 19:35 |
| zyuan | then you need to open the "metadata" field and keep checking the reserved names.... | 19:35 |
| kgriffs | anyway, let's hold off on that tangent until another time | 19:35 |
| flaper87 | so, lets think we have this cache system | 19:35 |
| zyuan | problems become more: "metadata" may not be a dict.... | 19:35 |
| flaper87 | what would we put into that cache if we have everything mixed? | 19:36 |
| flaper87 | we would have to separate *our* metadata from user's and store it in the cache | 19:36 |
| flaper87 | so, that makes me think that a separate field for that would make sense | 19:36 |
| *** arborism has joined #openstack-meeting-alt | 19:37 | |
| zyuan | i think it's ok to store anything metadata in the cache | 19:37 |
| zyuan | it's actually more simple, and cheap if we have a configurable json parser | 19:37 |
| *** sarob has joined #openstack-meeting-alt | 19:37 | |
| zyuan | i mean, a proposed parser which can stop parsing at some level of the elements | 19:37 |
| zyuan | and don't forget, we have size limit on queue metadata -- as a whole | 19:38 |
| flaper87 | zyuan: but that requiers more memory, right? And we'll have to update it everytime the metadata is updated. (re putting everything on cache) | 19:38 |
| zyuan | we have size limit, the space should not matter that much | 19:39 |
| kgriffs | we could also compress with snappy | 19:39 |
| zyuan | the thing matter may be the performance -- with our own namespace, the processing logic becomes more complex | 19:39 |
| flaper87 | but you'd be counting the reserved metadata size as part of the queue metadata size | 19:39 |
| kgriffs | but idk if cache is faster than mongo if you have it centralized | 19:39 |
| flaper87 | unless we split them | 19:39 |
| kgriffs | here is how splitting into two resource types may look: | 19:40 |
| kgriffs | https://etherpad.openstack.org/queuing-scratch | 19:40 |
| zyuan | which is not nessasory, from my point of view | 19:40 |
| cppcabrera | +1 kgriffs (a whiteboard!) | 19:40 |
| cppcabrera | i like this separation of config from metadata... | 19:41 |
| kgriffs | meta would have no size checks except valid JSON and size | 19:41 |
| cppcabrera | *I | 19:41 |
| cppcabrera | config would have type checks, since we know what they are ahead of time. | 19:41 |
| flaper87 | I prefer the second one | 19:42 |
| zyuan | then what's the queue metadata for? what if user PUT garbage into the /meta | 19:42 |
| kgriffs | for our first release, we just don't reference the config/settings/whatever resource in the home document | 19:42 |
| kgriffs | so, we kick the can down the road and have more time to come up with a good solution | 19:42 |
| kgriffs | I think we just ignore garbage fields | 19:42 |
| kgriffs | but still check overal doc size for sanity | 19:43 |
| cppcabrera | Sounds good to me. | 19:44 |
| flaper87 | +1 | 19:44 |
| kgriffs | zyuan: I'm not saying this solves the fundamental problem of schema checking vs. backwards compat with clients, but it lets us divide and conquer | 19:44 |
| Sriram | yes, this looks good. | 19:44 |
| malini | this is one of the longest 15 minutes :) | 19:45 |
| zyuan | soo... what's the plan for the 1st release? | 19:45 |
| kgriffs | if we go with this, then what happens if you GET /v1/queues/foo | 19:45 |
| kgriffs | 405 ? | 19:45 |
| zyuan | PUT has no content at all? | 19:46 |
| kgriffs | or do we leave as-is, and later add /queues/foo/defaults | 19:46 |
| kgriffs | the original design was based on swift semantics, where they overload metadata headers to do fancy things | 19:46 |
| kgriffs | I wonder if that is the best approach after all? | 19:47 |
| cppcabrera | x-delete-at, x-delete-after... | 19:47 |
| zyuan | /queues/foo/defaults looks too fancy to me.... | 19:47 |
| *** malini has left #openstack-meeting-alt | 19:47 | |
| *** akuznetsov has quit IRC | 19:47 | |
| flaper87 | can we have /queues/foo/meta/foo ? | 19:47 |
| *** jrodom has quit IRC | 19:47 | |
| flaper87 | in the first release? | 19:47 |
| flaper87 | then we'll add more things when needed | 19:48 |
| *** jrodom has joined #openstack-meeting-alt | 19:48 | |
| flaper87 | s/meta/metadata/ | 19:48 |
| kgriffs | what's the lat "foo" | 19:48 |
| kgriffs | s/lat/last | 19:48 |
| kgriffs | ? | 19:48 |
| kgriffs | (almost time for a vote) | 19:48 |
| flaper87 | ah remove that foo | 19:48 |
| flaper87 | /queue/foo/metadata/ | 19:48 |
| zyuan | my option: leave things as-is | 19:48 |
| flaper87 | if we leave things as they are, we, most likely, will have to break backward compatibility in our next release | 19:49 |
| *** oz_akan_ has joined #openstack-meeting-alt | 19:49 | |
| kgriffs | zyuan: as-is, including reserved prefix? | 19:49 |
| zyuan | i don't like to invent needs | 19:49 |
| zyuan | kgriffs: we have that in doc, and we don't care the guys want to challge us | 19:50 |
| *** SergeyLukjanov has quit IRC | 19:51 | |
| zyuan | does the current design close the door of a more fancy metadata? | 19:51 |
| *** ruhe has quit IRC | 19:51 | |
| flaper87 | no if we decide to have reserved words (and checks) within the existing metadata | 19:51 |
| flaper87 | but if we want to split them, then yes | 19:51 |
| *** amitgandhi has quit IRC | 19:51 | |
| zyuan | i'm OK with two metadata plan; i'm c++ guy :) | 19:52 |
| *** akuznetsov has joined #openstack-meeting-alt | 19:52 | |
| flaper87 | so, vote? as-is or add new metadata resource to the queue ? | 19:53 |
| kgriffs | #startvote Should we keep queue metadata API as is (a), create a metadata type (b), or keep as-is, but not reserve a prefix, adding one or more new settings types later? a, b, c | 19:53 |
| openstack | Begin voting on: Should we keep queue metadata API as is (a), create a metadata type (b), or keep as-is, but not reserve a prefix, adding one or more new settings types later? Valid vote options are a, b, c. | 19:53 |
| openstack | Vote using '#vote OPTION'. Only your last vote counts. | 19:53 |
| flaper87 | #vote a | 19:53 |
| flaper87 | #vote b | 19:53 |
| flaper87 | sorry | 19:53 |
| flaper87 | arrg | 19:53 |
| flaper87 | :) | 19:53 |
| kgriffs | fortunately, only last vote counts. :D | 19:54 |
| flaper87 | indeed :P | 19:54 |
| cppcabrera | #vote b | 19:54 |
| Sriram | #vote b | 19:54 |
| zyuan | #vote a | 19:54 |
| zyuan | ... | 19:54 |
| kgriffs | anyone else in the room? | 19:54 |
| zyuan | the explaination looks... confusing.... | 19:55 |
| zyuan | what exactly (b) is? | 19:55 |
| kgriffs | that is what flaper87 proposed | 19:55 |
| megan_w | kgriffs: in the room, but trust you guys to decide | 19:55 |
| kgriffs | :D | 19:56 |
| kgriffs | "/queue/foo/metadata" | 19:56 |
| zyuan | then (c) looks not so good. | 19:56 |
| zyuan | why adding new routes in the future conflict with reserving _names now? | 19:57 |
| kgriffs | zyuan: it is cleaner, if we add _foo, then harder to migrate that to a different resource later | 19:58 |
| kgriffs | #showvote | 19:58 |
| openstack | a (1): zyuan | 19:58 |
| openstack | b (3): cppcabrera, Sriram, flaper87 | 19:58 |
| kgriffs | anyone want to change their vote? | 19:58 |
| zyuan | clean... he he | 19:59 |
| flaper87 | kgriffs: u gotta vote | 19:59 |
| kgriffs | you have 10 seconds | 19:59 |
| bryansd | #vote b | 19:59 |
| kgriffs | #vote b | 19:59 |
| * bryansd votes for pop-tarts, too | 19:59 | |
| kgriffs | heh | 19:59 |
| Sriram | +1 for pop tarts :D | 19:59 |
| kgriffs | #endvote | 19:59 |
| openstack | Voted on "Should we keep queue metadata API as is (a), create a metadata type (b), or keep as-is, but not reserve a prefix, adding one or more new settings types later?" Results are | 19:59 |
| openstack | a (1): zyuan | 19:59 |
| * cppcabrera votes for donuts | 19:59 | |
| openstack | b (5): bryansd, kgriffs, cppcabrera, Sriram, flaper87 | 19:59 |
| * flaper87 gives bryansd pop-tarts | 19:59 | |
| kgriffs | ok, so this is obviously a breaking change. Let's get it done ASAP | 20:00 |
| cppcabrera | That's all the time we have, I believe. Any closing comments? | 20:00 |
| * bryansd is bringing doughnuts tomorrow | 20:00 | |
| kgriffs | so, quick one about priorities | 20:00 |
| zyuan | i'm looking at the board and in deep thinking... | 20:00 |
| kgriffs | let's finalize API, continue focus on bugs and robustness and performance | 20:00 |
| flaper87 | kgriffs: +1 (and client) | 20:01 |
| kgriffs | right | 20:01 |
| kgriffs | focus on HTTP transport for now, ZMQ is lower priority | 20:01 |
| *** Sriram has quit IRC | 20:01 | |
| flaper87 | +1 | 20:01 |
| oz_akan_ | we need to finalize placement service design | 20:01 |
| *** Sriram has joined #openstack-meeting-alt | 20:01 | |
| cppcabrera | +1 | 20:02 |
| flaper87 | oz_akan_: we're planning to discuss it on Monday | 20:02 |
| flaper87 | since Amit will be out tomorrow | 20:02 |
| kgriffs | ok, let's talk metadata implementation in #openstack-marconi | 20:02 |
| flaper87 | rock on | 20:02 |
| flaper87 | great work everyone | 20:02 |
| oz_akan_ | ok | 20:02 |
| flaper87 | Those bugs are afraid of us | 20:03 |
| kgriffs | #action oz_akan, amit, flaper87 to finalize placement service strategy | 20:03 |
| kgriffs | #endmeeting | 20:03 |
| *** openstack changes topic to "OpenStack meetings (alternate)" | 20:03 | |
| openstack | Meeting ended Thu Jul 18 20:03:47 2013 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 20:03 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-07-18-19.05.html | 20:03 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-07-18-19.05.txt | 20:03 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-07-18-19.05.log.html | 20:03 |
| kgriffs | thanks guys! | 20:03 |
| oz_akan_ | thanks | 20:03 |
| cppcabrera | :) | 20:04 |
| *** cppcabrera has left #openstack-meeting-alt | 20:04 | |
| Sriram | Woot! | 20:04 |
| *** flaper87 has left #openstack-meeting-alt | 20:04 | |
| *** RajeshMohan has quit IRC | 20:06 | |
| *** RajeshMohan has joined #openstack-meeting-alt | 20:06 | |
| *** vipul-away is now known as vipul | 20:06 | |
| *** RajeshMohan has quit IRC | 20:06 | |
| *** RajeshMohan has joined #openstack-meeting-alt | 20:06 | |
| *** pcm_ has quit IRC | 20:13 | |
| *** Nadya has quit IRC | 20:13 | |
| *** RajeshMohan has quit IRC | 20:15 | |
| *** akuznetsov has quit IRC | 20:17 | |
| *** kgriffs is now known as kgriffs_afk | 20:18 | |
| *** IlyaE has quit IRC | 20:19 | |
| *** jmaron has quit IRC | 20:26 | |
| *** abaron has quit IRC | 20:29 | |
| *** bryansd has left #openstack-meeting-alt | 20:29 | |
| *** markwash has quit IRC | 20:32 | |
| *** sarob_ has joined #openstack-meeting-alt | 20:32 | |
| *** markwash has joined #openstack-meeting-alt | 20:34 | |
| *** sarob__ has joined #openstack-meeting-alt | 20:34 | |
| *** sarob_ has quit IRC | 20:35 | |
| *** sarob has quit IRC | 20:36 | |
| *** nkonovalov__ has quit IRC | 20:49 | |
| *** sarob__ has quit IRC | 20:54 | |
| *** sarob has joined #openstack-meeting-alt | 20:54 | |
| *** jmaron has joined #openstack-meeting-alt | 20:56 | |
| *** Riddhi has quit IRC | 20:58 | |
| *** Riddhi has joined #openstack-meeting-alt | 20:58 | |
| *** sarob has quit IRC | 20:59 | |
| *** vipul is now known as vipul-away | 21:00 | |
| *** djohnstone has quit IRC | 21:01 | |
| *** jmaron has quit IRC | 21:06 | |
| *** sarob has joined #openstack-meeting-alt | 21:07 | |
| *** sarob has quit IRC | 21:08 | |
| *** sarob has joined #openstack-meeting-alt | 21:09 | |
| *** sarob has quit IRC | 21:13 | |
| *** vipul-away is now known as vipul | 21:15 | |
| *** sarob has joined #openstack-meeting-alt | 21:16 | |
| *** demorris has quit IRC | 21:16 | |
| *** crobertsrh is now known as _crobertsrh | 21:29 | |
| *** pdmars has quit IRC | 21:30 | |
| *** Sriram has quit IRC | 21:31 | |
| *** jmaron has joined #openstack-meeting-alt | 21:32 | |
| *** jmaron has quit IRC | 21:39 | |
| *** kgriffs_afk is now known as kgriffs | 21:41 | |
| *** oz_akan_ has quit IRC | 21:42 | |
| *** vkmc has quit IRC | 21:44 | |
| *** megan_w has quit IRC | 21:55 | |
| *** sarob has quit IRC | 21:59 | |
| *** sarob has joined #openstack-meeting-alt | 22:02 | |
| *** jcru has quit IRC | 22:23 | |
| *** lastidiot has quit IRC | 22:23 | |
| *** jmaron has joined #openstack-meeting-alt | 22:35 | |
| *** jmaron has quit IRC | 22:40 | |
| *** akuznetsov has joined #openstack-meeting-alt | 22:49 | |
| *** akuznetsov has quit IRC | 22:51 | |
| *** jmaron has joined #openstack-meeting-alt | 23:01 | |
| *** sarob has quit IRC | 23:02 | |
| *** sarob has joined #openstack-meeting-alt | 23:02 | |
| *** sarob has quit IRC | 23:03 | |
| *** sarob_ has joined #openstack-meeting-alt | 23:03 | |
| *** vipul is now known as vipul-away | 23:03 | |
| *** vipul-away is now known as vipul | 23:09 | |
| *** jrodom has quit IRC | 23:19 | |
| *** vipul is now known as vipul-away | 23:25 | |
| *** vipul-away is now known as vipul | 23:26 | |
| *** sarob_ has quit IRC | 23:34 | |
| *** jmaron has quit IRC | 23:34 | |
| *** sarob has joined #openstack-meeting-alt | 23:35 | |
| *** sarob has quit IRC | 23:39 | |
| *** IlyaE has joined #openstack-meeting-alt | 23:41 | |
| *** jrodom has joined #openstack-meeting-alt | 23:41 | |
| *** markwash has quit IRC | 23:44 | |
| *** jergerber has quit IRC | 23:44 | |
| *** demorris has joined #openstack-meeting-alt | 23:46 | |
| *** jergerber has joined #openstack-meeting-alt | 23:52 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
