| *** IlyaE has joined #openstack-meeting-alt | 00:11 | |
| *** demorris has quit IRC | 00:16 | |
| *** pcm_ has quit IRC | 00:17 | |
| *** IlyaE has quit IRC | 00:21 | |
| *** Riddhi has joined #openstack-meeting-alt | 00:27 | |
| *** IlyaE has joined #openstack-meeting-alt | 00:39 | |
| *** IlyaE has quit IRC | 00:50 | |
| *** bdpayne has quit IRC | 00:50 | |
| *** dina_belova has joined #openstack-meeting-alt | 00:50 | |
| *** NikitaKonovalov has joined #openstack-meeting-alt | 00:54 | |
| *** dina_belova has quit IRC | 00:55 | |
| *** IlyaE has joined #openstack-meeting-alt | 00:57 | |
| *** demorris has joined #openstack-meeting-alt | 00:58 | |
| *** NikitaKonovalov has quit IRC | 00:58 | |
| *** IlyaE has quit IRC | 01:05 | |
| *** pdmars has quit IRC | 01:08 | |
| *** demorris has quit IRC | 01:13 | |
| *** vipul is now known as vipul-away | 01:26 | |
| *** ErikB has quit IRC | 01:43 | |
| *** esp1 has joined #openstack-meeting-alt | 01:43 | |
| *** esp1 has quit IRC | 01:49 | |
| *** dina_belova has joined #openstack-meeting-alt | 01:52 | |
| *** NikitaKonovalov has joined #openstack-meeting-alt | 01:55 | |
| *** dina_belova has quit IRC | 01:56 | |
| *** tanisdl has quit IRC | 01:57 | |
| *** NikitaKonovalov has quit IRC | 01:59 | |
| *** colinmcnamara has joined #openstack-meeting-alt | 02:02 | |
| *** anteaya has quit IRC | 02:26 | |
| *** ErikB has joined #openstack-meeting-alt | 02:29 | |
| *** HenryG has joined #openstack-meeting-alt | 02:34 | |
| *** vipul-away is now known as vipul | 02:35 | |
| *** HenryG has quit IRC | 02:42 | |
| *** SergeyLukjanov has joined #openstack-meeting-alt | 02:50 | |
| *** dina_belova has joined #openstack-meeting-alt | 02:51 | |
| *** ErikB has quit IRC | 02:54 | |
| *** NikitaKonovalov has joined #openstack-meeting-alt | 02:56 | |
| *** NikitaKonovalov has quit IRC | 03:00 | |
| *** SergeyLukjanov has quit IRC | 03:05 | |
| *** dina_belova has quit IRC | 03:15 | |
| *** bdpayne has joined #openstack-meeting-alt | 03:50 | |
| *** bdpayne has quit IRC | 03:51 | |
| *** IlyaE has joined #openstack-meeting-alt | 03:54 | |
| *** NikitaKonovalov has joined #openstack-meeting-alt | 03:56 | |
| *** NikitaKonovalov has quit IRC | 04:01 | |
| *** IlyaE has quit IRC | 04:15 | |
| *** IlyaE has joined #openstack-meeting-alt | 04:19 | |
| *** markmcclain has quit IRC | 04:36 | |
| *** basha has joined #openstack-meeting-alt | 04:39 | |
| *** basha has quit IRC | 04:46 | |
| *** basha has joined #openstack-meeting-alt | 04:48 | |
| *** NikitaKonovalov has joined #openstack-meeting-alt | 04:57 | |
| *** NikitaKonovalov has quit IRC | 05:01 | |
| *** dina_belova has joined #openstack-meeting-alt | 05:15 | |
| *** IlyaE has quit IRC | 05:15 | |
| *** dina_belova has quit IRC | 05:16 | |
| *** lastidiot has quit IRC | 05:20 | |
| *** basha has quit IRC | 05:24 | |
| *** dina_belova has joined #openstack-meeting-alt | 05:25 | |
| *** basha has joined #openstack-meeting-alt | 05:30 | |
| *** IlyaE has joined #openstack-meeting-alt | 05:37 | |
| *** dina_belova has quit IRC | 05:52 | |
| *** basha has quit IRC | 06:00 | |
| *** aignatov has quit IRC | 06:04 | |
| *** aignatov has joined #openstack-meeting-alt | 06:04 | |
| *** NikitaKonovalov has joined #openstack-meeting-alt | 06:11 | |
| *** saurabhs has quit IRC | 06:15 | |
| *** dina_belova has joined #openstack-meeting-alt | 06:20 | |
| *** dina_belova has quit IRC | 06:25 | |
| *** salv-orlando has joined #openstack-meeting-alt | 06:25 | |
| *** mestery_ has joined #openstack-meeting-alt | 06:34 | |
| *** mestery has quit IRC | 06:36 | |
| *** stanlagun has quit IRC | 06:36 | |
| *** stanlagun has joined #openstack-meeting-alt | 06:44 | |
| *** dina_belova has joined #openstack-meeting-alt | 06:44 | |
| *** dina_belova has quit IRC | 06:50 | |
| *** salv-orlando has quit IRC | 06:50 | |
| *** NikitaKonovalov has quit IRC | 06:53 | |
| *** enikanorov-w has quit IRC | 06:54 | |
| *** basha has joined #openstack-meeting-alt | 06:54 | |
| *** enikanorov-w has joined #openstack-meeting-alt | 06:54 | |
| *** dina_belova has joined #openstack-meeting-alt | 06:55 | |
| *** IlyaE has quit IRC | 06:58 | |
| *** NikitaKonovalov has joined #openstack-meeting-alt | 07:04 | |
| *** basha has quit IRC | 07:07 | |
| *** dina_belova has quit IRC | 07:08 | |
| *** aignatov has quit IRC | 07:09 | |
| *** IlyaE has joined #openstack-meeting-alt | 07:09 | |
| *** aignatov has joined #openstack-meeting-alt | 07:10 | |
| *** IlyaE has quit IRC | 07:14 | |
| *** User199 has joined #openstack-meeting-alt | 07:14 | |
| *** User199 has quit IRC | 07:15 | |
| *** Tien has joined #openstack-meeting-alt | 07:15 | |
| *** sergmelikyan has quit IRC | 07:17 | |
| *** Tien has quit IRC | 07:19 | |
| *** Riddhi has quit IRC | 07:22 | |
| *** NikitaKonovalov has quit IRC | 07:28 | |
| *** colinmcnamara has quit IRC | 07:37 | |
| *** NikitaKonovalov has joined #openstack-meeting-alt | 07:47 | |
| *** dina_belova has joined #openstack-meeting-alt | 07:59 | |
| *** SergeyLukjanov has joined #openstack-meeting-alt | 07:59 | |
| *** NikitaKo_ has joined #openstack-meeting-alt | 08:02 | |
| *** NikitaKonovalov has quit IRC | 08:04 | |
| *** NikitaKo_ has quit IRC | 08:04 | |
| *** NikitaKonovalov has joined #openstack-meeting-alt | 08:04 | |
| *** dina_belova has quit IRC | 08:10 | |
| *** dina_belova has joined #openstack-meeting-alt | 08:28 | |
| *** sreshetnyak has joined #openstack-meeting-alt | 08:40 | |
| *** ruhe has joined #openstack-meeting-alt | 08:44 | |
| *** basha has joined #openstack-meeting-alt | 08:54 | |
| *** basha has quit IRC | 09:01 | |
| *** salv-orlando has joined #openstack-meeting-alt | 09:07 | |
| *** salv-orlando has quit IRC | 09:21 | |
| *** NikitaKonovalov has quit IRC | 09:33 | |
| *** NikitaKonovalov has joined #openstack-meeting-alt | 09:36 | |
| *** NikitaKonovalov has quit IRC | 09:42 | |
| *** dina_belova has quit IRC | 09:57 | |
| *** salv-orlando has joined #openstack-meeting-alt | 10:01 | |
| *** ruhe has quit IRC | 10:04 | |
| *** basha has joined #openstack-meeting-alt | 10:25 | |
| *** SergeyLukjanov has quit IRC | 10:41 | |
| *** NikitaKonovalov has joined #openstack-meeting-alt | 10:42 | |
| *** ruhe has joined #openstack-meeting-alt | 10:45 | |
| *** NikitaKonovalov has quit IRC | 10:46 | |
| *** dina_belova has joined #openstack-meeting-alt | 10:58 | |
| *** dina_belova has quit IRC | 11:02 | |
| *** mugsie has left #openstack-meeting-alt | 11:06 | |
| *** NikitaKonovalov has joined #openstack-meeting-alt | 11:10 | |
| *** dina_belova has joined #openstack-meeting-alt | 11:11 | |
| *** SergeyLukjanov has joined #openstack-meeting-alt | 11:11 | |
| *** sergmelikyan has joined #openstack-meeting-alt | 11:40 | |
| *** pcm_ has joined #openstack-meeting-alt | 11:52 | |
| *** HenryG has joined #openstack-meeting-alt | 11:58 | |
| *** pdmars has joined #openstack-meeting-alt | 12:22 | |
| *** ruhe has quit IRC | 12:32 | |
| *** NikitaKonovalov has quit IRC | 12:43 | |
| *** NikitaKonovalov has joined #openstack-meeting-alt | 12:47 | |
| *** ruhe has joined #openstack-meeting-alt | 12:54 | |
| *** ruhe has quit IRC | 12:59 | |
| *** basha has quit IRC | 13:14 | |
| *** basha has joined #openstack-meeting-alt | 13:21 | |
| *** pcm_ has quit IRC | 13:24 | |
| *** pcm_ has joined #openstack-meeting-alt | 13:25 | |
| *** flwang has joined #openstack-meeting-alt | 13:41 | |
| *** Riddhi has joined #openstack-meeting-alt | 13:48 | |
| *** djohnstone has joined #openstack-meeting-alt | 13:51 | |
| *** NikitaKonovalov has quit IRC | 13:53 | |
| *** anteaya has joined #openstack-meeting-alt | 13:53 | |
| *** dhellmann_ is now known as dhellmann | 13:57 | |
| *** markwash has joined #openstack-meeting-alt | 13:59 | |
| *** Riddhi has quit IRC | 13:59 | |
| *** jbresnah has joined #openstack-meeting-alt | 13:59 | |
| markwash | #startmeeting glance | 14:00 |
|---|---|---|
| *** zhiyan has joined #openstack-meeting-alt | 14:00 | |
| openstack | Meeting started Thu Aug 1 14:00:13 2013 UTC and is due to finish in 60 minutes. The chair is markwash. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
| *** openstack changes topic to " (Meeting topic: glance)" | 14:00 | |
| openstack | The meeting name has been set to 'glance' | 14:00 |
| brianr | hi mark | 14:00 |
| markwash | brianr: o/ | 14:00 |
| flwang | o/ | 14:01 |
| iccha | \o | 14:01 |
| zhiyan | ops, time changed? | 14:01 |
| *** SergeyLukjanov has quit IRC | 14:01 | |
| jbresnah | o/ | 14:01 |
| nikhil | o/ | 14:01 |
| *** NikitaKonovalov has joined #openstack-meeting-alt | 14:02 | |
| flwang | markwash: what's the agenda today? | 14:02 |
| markwash | good question! | 14:02 |
| markwash | #topic agenda | 14:02 |
| *** openstack changes topic to "agenda (Meeting topic: glance)" | 14:02 | |
| markwash | I meant to talk about documentation stuff some last week but forgot | 14:03 |
| *** hemanth_ has joined #openstack-meeting-alt | 14:03 | |
| flwang | yep, good topic | 14:03 |
| flwang | the homework assigned to you :) | 14:03 |
| markwash | and I'd like to review any blueprint progress we've made, give people a chance to highlight reviews | 14:03 |
| zhiyan | good point | 14:04 |
| markwash | so, from me *blueprint progress and *docs | 14:04 |
| markwash | any other items folks want to talk about that aren't covered under bp progress? | 14:04 |
| *** esheffield has joined #openstack-meeting-alt | 14:05 | |
| markwash | okay, maybe we'll think of something along the way | 14:05 |
| markwash | #topic docs | 14:06 |
| *** openstack changes topic to "docs (Meeting topic: glance)" | 14:06 | |
| markwash | so I did finally contact annegentle | 14:06 |
| jbresnah | perhaps a review day/bug squash day | 14:06 |
| iccha | markwash: and? | 14:06 |
| markwash | and I got a great response, main items were | 14:07 |
| markwash | glance/doc/source should contain stuff for contributors, which is probably a good catchall for design, relevant history, and api spec plans | 14:07 |
| markwash | and openstack/image-api should contain our spec documentation | 14:07 |
| markwash | also openstack/api-site/ is for api reference, but I'm not really sure what that means apart from the spec. . . | 14:08 |
| markwash | I haven't taken the chance to determine what kind of state those various places are in | 14:08 |
| flwang | markwash: i think the api-site is update to date, just need recheck | 14:08 |
| iccha | yeah the different between image-api and api-site? | 14:08 |
| flwang | iccha: +1 what's the image-api mean here? | 14:09 |
| markwash | one final thing, before I forget, is openstack/openstack-manuals for installation / administration info, there might be some elements of that we want to contribute to as developers | 14:10 |
| markwash | iccha: I'm as confused as anyone about the distinction | 14:10 |
| iccha | i feel like we need a doc day or something, or atleast split the effort. the current document is in different states from some info being incorrect, inconsistent to some latest details being there | 14:11 |
| *** markmcclain has joined #openstack-meeting-alt | 14:11 | |
| iccha | dont know if thats stretching it | 14:11 |
| *** markmcclain has quit IRC | 14:12 | |
| markwash | something to that tune would make a lot of sense | 14:12 |
| *** markmcclain has joined #openstack-meeting-alt | 14:12 | |
| markwash | it also looks like there's a divide in the image-api repo | 14:13 |
| flwang | so until now, we mentioned: 1. openstack/doc/source 2. api-site 3. installation/admin doc | 14:13 |
| markwash | with v1 in docbooks, and v2 in markdown | 14:13 |
| brianr | api-site looks like a split from openstack-manuals, it's got the quickstart guides in it | 14:14 |
| brianr | i wish they would stop moving stuff, it is very confusing | 14:14 |
| zhiyan | brianr: +1 | 14:15 |
| markwash | I'm stuggling for a strategy, how we can have the most impact before H is released | 14:15 |
| *** NikitaKonovalov has quit IRC | 14:15 | |
| iccha | markwash: maybe we should start with the doc/source becuase thats something as devs we can start working on right away | 14:15 |
| flwang | iccha: +1 | 14:16 |
| markwash | I buy that | 14:16 |
| iccha | and then if we have the meat information, it can be ported to other places | 14:16 |
| iccha | the installation guide may require some additional work tho | 14:16 |
| brianr | i will get info into the "operator docs" (which you haven't mentioned!) | 14:16 |
| flwang | I can recheck the api-site | 14:16 |
| markwash | sorry, slightly distracted, cats attacking each other | 14:17 |
| brianr | flwang: +1 , that needs to be updated for the current glanceclient | 14:17 |
| markwash | brianr: which operator docs? | 14:17 |
| flwang | operator guide? | 14:18 |
| brianr | https://github.com/openstack/openstack-manuals | 14:18 |
| brianr | it's where the common images properties went for grizzly | 14:18 |
| markwash | okay gotcha | 14:18 |
| brianr | it's where some config info for protected props should go | 14:18 |
| markwash | it might also make sense as a first effort for people to go through and submit patches to remove the out-of-date or incorrect portions of whatever is out there | 14:18 |
| iccha | so apart from the 3 points flwang listed there is a 4. operator docs? | 14:18 |
| markwash | I'm not sure there is a lot of that, but there might be some | 14:19 |
| markwash | oh and, FWIW we're not necessarily on the hook for all of these | 14:19 |
| markwash | hence, starting with the one in our source tree does make a lot of sense | 14:19 |
| flwang | yep | 14:19 |
| markwash | so it sounds like we have some volunteers to look into and assess the ones on our list? | 14:20 |
| brianr | yep | 14:20 |
| flwang | flwang: api-site, brianr: operators doc | 14:20 |
| iccha | markwash: +1 there must be some sort of split up so we dont step on notes. an etherpad or soem sort of communication so we all know whose looking into what | 14:20 |
| *** boris-42 has joined #openstack-meeting-alt | 14:21 | |
| iccha | even if its just docs in glance repo | 14:21 |
| boris-42 | Hi all | 14:21 |
| boris-42 | =) | 14:21 |
| iccha | hey boris-42 | 14:21 |
| flwang | iccha: can you help create a etherpad link to track this? | 14:21 |
| iccha | https://etherpad.openstack.org/glance_documentation_efforts | 14:21 |
| flwang | then we can update our status on that and everyone know each other's focus to avoid overlap | 14:21 |
| flwang | cool | 14:22 |
| flwang | thanks | 14:22 |
| *** lastidiot has joined #openstack-meeting-alt | 14:22 | |
| markwash | so did we agree the first step is essentially review? | 14:23 |
| markwash | or is that already done to some extent elsewhere? | 14:24 |
| flwang | markwash: i agree the first item we need to do is figuring out the out-of-date stuff | 14:24 |
| brianr | i think iccha and eddie already did a review | 14:25 |
| brianr | it's on an etherpad somewhere | 14:25 |
| markwash | ah, lord, apparently I'm just completely behind on this issue :-/ | 14:25 |
| iccha | markwash: i think it could be done simelatanesouly. while some ppl identity the purpose/state of soem resources. we need to identify a central source of truth where we start contributing | 14:25 |
| brianr | we should probably file documentation bugs | 14:25 |
| iccha | https://etherpad.openstack.org/glance_etherpad_list - etherpad of all glance etherpads . the stuff esheffield and me worked on is like api related | 14:26 |
| brianr | that way, we won't step on each otehr | 14:26 |
| markwash | brianr, iccha: +1 | 14:26 |
| markwash | brianr: are those like bugs to a specific project? or just glance bugs with some docs tag? | 14:27 |
| brianr | markwash: it's kind of complicated, like take a look at this one:https://bugs.launchpad.net/openstack-manuals/+bug/1195473 | 14:28 |
| brianr | so it's a bug for openstack-manuals, and it's linked back to glance | 14:28 |
| *** basha has quit IRC | 14:28 | |
| markwash | gotcha, that makes sense | 14:29 |
| brianr | i think if we are going to write doc, we do something like that | 14:29 |
| brianr | if we just want to alert the doc people, we put the doc impact tag in the regular bug | 14:29 |
| iccha | hmm ok so here is the thing. if we make it too complicated it might deter ppl from going into quick update glance docs mode. so either we need one person owning maintaining this docs bugs and make sure they get tagged and etc or ppl being able to just enter what they re doing and jump onto it. | 14:29 |
| brianr | iccha: you are right, it is a PITA | 14:30 |
| brianr | how about i follow up with Anne and get better instructions about how/where we should file stuff | 14:30 |
| iccha | brianr: sounds good and if meanwhile ppl feel like updating glance/doc/source they are welcome to file a bug and do it? | 14:30 |
| iccha | thanks for taking the onerous task brianr :) | 14:31 |
| markwash | okay, we have *some* action items here | 14:32 |
| brianr | yes, i think we own glance/doc/source, so we do whatever we want there | 14:32 |
| iccha | so maybe action item is brianr will give us a step by step how to file glance doc bugs and which projects to associate it with? | 14:32 |
| iccha | brianr: +1 on us gettign started with this if we want and keep contributing to glance/doc/source but remembering to file a bug for it before | 14:33 |
| markwash | and flwang, you had said you were going to look into api-site somewhat? | 14:33 |
| flwang | markwash: yep, will check if it's update to date and update it | 14:33 |
| flwang | make sense? | 14:34 |
| markwash | good | 14:34 |
| *** lastidiot has quit IRC | 14:34 | |
| markwash | let's move on to blueprints, any objections? | 14:34 |
| brianr | no objections! | 14:34 |
| iccha | go for it! | 14:34 |
| markwash | #topic current blueprint progress | 14:34 |
| *** openstack changes topic to "current blueprint progress (Meeting topic: glance)" | 14:34 | |
| markwash | iccha: brianr indicated you would most likely begin work on api protected properties this week | 14:35 |
| markwash | did that come to pass? | 14:35 |
| iccha | markwash: some intial work has started https://github.com/isethi/glance/tree/protected_p | 14:35 |
| markwash | timeline for H-3 still feels reasonable? | 14:36 |
| markwash | iccha: ^^ | 14:36 |
| iccha | markwash: yes def doable | 14:36 |
| markwash | cool | 14:37 |
| brianr | anyone interested in protected properties, please take a look at https://wiki.openstack.org/wiki/Glance-property-protections-product and put questions on the FAQ if you have 'em | 14:37 |
| markwash | how about async work, there are a number of people interested in that. . any progress? | 14:37 |
| markwash | flwang: brianr ^^ ? | 14:37 |
| brianr | flwang and nikhil have been working on an etherpad | 14:37 |
| iccha | whats the link ? :p need to add it to https://etherpad.openstack.org/glance_etherpad_list | 14:38 |
| brianr | i think anyone interested should take a look, and let's meet today or tomorrow? | 14:38 |
| flwang | Ihttps://etherpad.openstack.org/havana-glance-requirements | 14:38 |
| markwash | sketching out code design, basically? | 14:38 |
| brianr | https://etherpad.openstack.org/havana-glance-requirements | 14:38 |
| brianr | and some use cases to provoke design | 14:38 |
| nikhil | markwash: code design, rearch, more use cases(corner cases) etc | 14:38 |
| nikhil | basically, a careful one to implement so it seems | 14:39 |
| *** dina_belova has quit IRC | 14:39 | |
| nikhil | added some comments based on convo last night | 14:39 |
| flwang | nikhil: did you touch the task api part? | 14:39 |
| iccha | i remember markwash had some poc work on async workers | 14:39 |
| markwash | brianr: meeting tomorrow could be great | 14:39 |
| iccha | +1 | 14:39 |
| nikhil | people state adding in your names there | 14:40 |
| flwang | iccha: yep, I know that. I'm going to implement it based on markwash's work | 14:40 |
| brianr | flwang: what time zone are you in? | 14:40 |
| nikhil | flwang: brianr markwash iccha we need to divide tasks | 14:40 |
| flwang | Beijing, China | 14:40 |
| nikhil | flwang: he means wrt UTC | 14:40 |
| flwang | so I think UTC+8:00 | 14:40 |
| markwash | I'd like to attend as well | 14:41 |
| brianr | would this time work? | 14:41 |
| markwash | probably | 14:42 |
| nikhil | brianr: may be a doodle? | 14:42 |
| nikhil | in UTC :) | 14:42 |
| flwang | brianr: you can plan it on my night, it's ok | 14:42 |
| brianr | so 14:00 UTC, i think? | 14:42 |
| markwash | Friday night glance party! | 14:43 |
| flwang | the tomorrow, the same time? | 14:43 |
| markwash | byob | 14:43 |
| jbresnah | heh | 14:43 |
| brianr | etherpad party! | 14:43 |
| flwang | brianr: it works for me | 14:43 |
| markwash | let's sort this out after the meeting if we aren't already settled | 14:43 |
| markwash | zhiyan: got any reviews to highlight for us for your various bps? | 14:44 |
| zhiyan | https://review.openstack.org/#/c/37222/3 | 14:44 |
| zhiyan | probable need flaper87 input: https://review.openstack.org/#/c/37421/1 | 14:44 |
| markwash | ah yes, that second one looks a little stuck | 14:44 |
| markwash | I tried to wrap my head around the issues, and couldn't quite figure it out | 14:45 |
| markwash | but I know jerdfelt is a smart guy, so I'm a little worried | 14:45 |
| markwash | zhiyan: maybe sometime we can track that down on irc with flaper87 and jerdfelt | 14:46 |
| markwash | today or tomorrow. . I think he's in my timezone | 14:46 |
| *** NikitaKonovalov has joined #openstack-meeting-alt | 14:46 | |
| markwash | zhiyan: does that cover it for now? | 14:46 |
| zhiyan | and for Scrubber-refactoring, i'm working on it, as our discussed, but from tomorrow to next Tuesday i need attend a meetings in office, will spend some time on that.. | 14:46 |
| markwash | gotcha | 14:46 |
| markwash | jbresnah: any work on super simple quotas? | 14:46 |
| zhiyan | markwash: so, sorry, seems i'm not available tomorrow... | 14:47 |
| markwash | (which I forgot to add to the H-3 list, but will fix immediately) | 14:47 |
| markwash | zhiyan: I'll ask flaper about it next I see him then | 14:47 |
| jbresnah | markwash: yeah i have a patch out there | 14:47 |
| jbresnah | https://review.openstack.org/#/c/37993 | 14:47 |
| jbresnah | zhiyan: left some comments that i am addressing, but the general idea is there | 14:47 |
| jbresnah | i also have a nova patch, but that is OT here | 14:48 |
| jbresnah | but it relates to direct-url work | 14:48 |
| markwash | cool | 14:48 |
| markwash | boris-42: your group has a number of db-related patches out for the oslo db blueprints | 14:49 |
| *** megan_w has joined #openstack-meeting-alt | 14:49 | |
| markwash | care to mention them or other concerns here? | 14:49 |
| boris-42 | markwash not so much=) | 14:49 |
| boris-42 | markwash so we are working in whole openstack, we would like to use common DB code in all projects | 14:49 |
| zhiyan | jbresnah: btw, as i mentioned, seems nfs-driver patch maybe drop some challenge in for your 'metadata' idea (which based on file-store) ... | 14:49 |
| boris-42 | nova, neutron, cinder, ironic already use this code | 14:50 |
| boris-42 | and there is no problems with it | 14:50 |
| markwash | yeah, it looks like there are a number of good fixes in the patches | 14:50 |
| iccha | i do know that this will offer some benefits like tpooling and softdelete code. but i am not sure if it has anything missing which glance needs | 14:50 |
| markwash | I'm a little meh on the timestamp mixins. . not sure that DRY really goes that far I guess | 14:51 |
| boris-42 | markwash It will | 14:51 |
| boris-42 | markwash but it requires migrations | 14:51 |
| jbresnah | zhiyan: perhaps, but there are other filesystem stores besides nfs | 14:51 |
| zhiyan | iccha: +1 ,also interested in that part. | 14:51 |
| jbresnah | and other storage systems besides file, etc | 14:52 |
| boris-42 | markwash using oslo db code is just start point | 14:52 |
| boris-42 | markwash of global DB cleanup | 14:52 |
| boris-42 | markwash such as soft_delete + unique constraints, alembic instead of sqlaclhemy-migrate | 14:52 |
| *** jmontemayor has joined #openstack-meeting-alt | 14:52 | |
| boris-42 | markwash and so on | 14:53 |
| zhiyan | seems cool | 14:53 |
| markwash | boris-42: out of curiousity, have you or your team thought much about non-sql based backends? | 14:53 |
| boris-42 | we would like to use non-sql, to allow easier way to make now downtime updates | 14:54 |
| boris-42 | but it will be soooo hard to put it in OpenStack=) | 14:54 |
| iccha | markwash: was it you or someone else who was mentioning some sort of db abtraction so its database indepedent | 14:54 |
| boris-42 | in nova, cinder we have db.api | 14:54 |
| boris-42 | iccha ^ | 14:54 |
| markwash | iccha: I have some work in that direction, but not a lot of push from anyone internally to push it further | 14:54 |
| boris-42 | it allows us to isolate and implement different backends | 14:55 |
| *** NikitaKonovalov has quit IRC | 14:55 | |
| boris-42 | But this thing is connected with unit tests | 14:55 |
| boris-42 | and unit tests should be run also with different backends | 14:55 |
| flwang | markwash: did you mean we are interested in using no-sql as the db backend? such as mongo? Hbase? | 14:55 |
| markwash | flwang: yes | 14:55 |
| flwang | great, I love it | 14:56 |
| markwash | mostly I'm interested in redefining the db abstraction layer so that it doesn't implicitly put business logic in the db drivers | 14:56 |
| boris-42 | markwash flwang first of all we should make our tests independent from sqlalchemy | 14:56 |
| markwash | boris-42: I think we have that to a fair degree in glance | 14:56 |
| markwash | anyway, I'd be interested in your perspective on what we do have there | 14:56 |
| markwash | boris-42: any reviews you want to highlight here? I know we can find them as well, so maybe that is enough | 14:57 |
| nikhil | markwash: +1 interested in db abstraction (a lot) | 14:57 |
| boris-42 | markwash about db abstraction | 14:57 |
| flwang | we can take some reference from ceilometer | 14:57 |
| *** ruhe has joined #openstack-meeting-alt | 14:57 | |
| esheffield | +1 likewise - I was actually giving some thought to non-sql approaches this morning | 14:57 |
| boris-42 | markwash I am not sure that full isolation of logic and DB is good poing | 14:57 |
| flwang | I will do some investigation | 14:57 |
| markwash | #topic open discussion | 14:57 |
| *** openstack changes topic to "open discussion (Meeting topic: glance)" | 14:57 | |
| boris-42 | markwash it is clear | 14:58 |
| markwash | (seems like that's what we're doing) | 14:58 |
| markwash | boris-42: there are some definite risks | 14:58 |
| brianr | quick tasks question: so we have asynchronous image tasks, s'pose someone starts an export and then deletes the image, do we: | 14:58 |
| brianr | 1 - end task with error, they were stupid | 14:58 |
| brianr | 2 - "lock" the image somehow until the task is completed | 14:58 |
| brianr | this will be a problem for cloning since the glance-to-glance coordination may take some time, you originate task request in region T but the image is in region S, someone else working in your account in image S doesn't know about the clone request, and could delete image before it gets cloned | 14:58 |
| brianr | i'm wondering whether something like the task_state that nova has on instances might be needed here? | 14:58 |
| jbresnah | brianr: there are many issues regarding the asycn task work like that which concern me actually | 14:58 |
| *** SergeyLukjanov has joined #openstack-meeting-alt | 14:59 | |
| boris-42 | markwash hmm I have some thoughts about DB code and tests in glance | 14:59 |
| iccha | jbresnah: do u see any overlap with staccato? | 14:59 |
| boris-42 | markwash as we should make baby steps | 14:59 |
| bourke | will throw this out, have added a blueprint for porting Swift's ratelimiting to Glance. Is this something people would be interested in? | 14:59 |
| markwash | brianr: also, 3 - use reference counts for deletes. . . task would hold a temporary reference. . that might be very strained | 14:59 |
| flwang | brianr: we need some "lock" just like Nova does | 14:59 |
| brianr | guess we r out of time, should we discuss on mailing list? | 14:59 |
| flwang | or the glance irc channel? | 15:00 |
| jbresnah | iccha: good questions, in some areas yes | 15:00 |
| boris-42 | markwash probably it will be best solution to implement db.api as in Nova (it is pretty easy), and remove dependency from sqla in tests?) | 15:00 |
| jbresnah | iccha: but i worry about going to far down the road into becoming a generic job scheduler | 15:00 |
| brianr | flwang: maybe after async worker meeting tomorrow? | 15:00 |
| nikhil | flwang: not on irc | 15:00 |
| nikhil | seems like many poepl are interested | 15:00 |
| ameade_ | time | 15:00 |
| ameade_ | lol | 15:00 |
| nikhil | and don't want to miss on input | 15:00 |
| brianr | ok, i will send out my question to mailing list | 15:01 |
| flwang | nikhil: ok, got | 15:01 |
| jbresnah | brianr: i think you would need tpo reference count the image | 15:01 |
| nikhil | thanks | 15:01 |
| nikhil | we need atomicity | 15:01 |
| flwang | it's time to run | 15:01 |
| markwash | #endmeeting | 15:01 |
| *** openstack changes topic to "OpenStack meetings (alternate)" | 15:01 | |
| openstack | Meeting ended Thu Aug 1 15:01:33 2013 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:01 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/glance/2013/glance.2013-08-01-14.00.html | 15:01 |
| nikhil | and seems like db is the best/convinient place to do so | 15:01 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/glance/2013/glance.2013-08-01-14.00.txt | 15:01 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/glance/2013/glance.2013-08-01-14.00.log.html | 15:01 |
| *** cp16net is now known as cp16net|away | 15:02 | |
| *** markwash has quit IRC | 15:04 | |
| *** cp16net|away is now known as cp16net | 15:07 | |
| *** lastidiot has joined #openstack-meeting-alt | 15:09 | |
| *** boris-42 has quit IRC | 15:11 | |
| *** NikitaKonovalov has joined #openstack-meeting-alt | 15:16 | |
| *** dina_belova has joined #openstack-meeting-alt | 15:19 | |
| *** zhiyan has left #openstack-meeting-alt | 15:20 | |
| *** tanisdl has joined #openstack-meeting-alt | 15:25 | |
| *** basha has joined #openstack-meeting-alt | 15:36 | |
| *** rnirmal has joined #openstack-meeting-alt | 15:37 | |
| *** markwash has joined #openstack-meeting-alt | 15:38 | |
| *** markwash_ has joined #openstack-meeting-alt | 15:43 | |
| *** markwash has quit IRC | 15:45 | |
| *** markwash_ is now known as markwash | 15:45 | |
| *** dina_belova has quit IRC | 15:47 | |
| *** SergeyLukjanov has quit IRC | 15:48 | |
| *** NikitaKonovalov has quit IRC | 15:50 | |
| *** sarob has joined #openstack-meeting-alt | 16:01 | |
| *** IlyaE has joined #openstack-meeting-alt | 16:01 | |
| *** ruhe has quit IRC | 16:01 | |
| *** tmckayrh has joined #openstack-meeting-alt | 16:04 | |
| *** Riddhi has joined #openstack-meeting-alt | 16:07 | |
| *** jmontemayor has quit IRC | 16:10 | |
| *** jmontemayor has joined #openstack-meeting-alt | 16:13 | |
| *** dina_belova has joined #openstack-meeting-alt | 16:20 | |
| *** basha has quit IRC | 16:22 | |
| *** saurabhs has joined #openstack-meeting-alt | 16:22 | |
| *** SergeyLukjanov has joined #openstack-meeting-alt | 16:25 | |
| *** saurabhs has left #openstack-meeting-alt | 16:28 | |
| *** jmontemayor has quit IRC | 16:32 | |
| *** jmontemayor has joined #openstack-meeting-alt | 16:35 | |
| *** ruhe has joined #openstack-meeting-alt | 16:39 | |
| *** esp has joined #openstack-meeting-alt | 16:39 | |
| *** cp16net is now known as cp16net|away | 16:44 | |
| *** NikitaKonovalov has joined #openstack-meeting-alt | 16:46 | |
| *** sarob has quit IRC | 16:49 | |
| *** sarob has joined #openstack-meeting-alt | 16:49 | |
| *** NikitaKonovalov has quit IRC | 16:51 | |
| *** bourke has quit IRC | 16:51 | |
| *** jmontemayor has quit IRC | 16:52 | |
| *** pdmars has quit IRC | 16:53 | |
| *** sarob has quit IRC | 16:54 | |
| *** ruhe has quit IRC | 16:56 | |
| *** esp has left #openstack-meeting-alt | 16:58 | |
| *** ben_duyujie has joined #openstack-meeting-alt | 17:03 | |
| *** boris-42 has joined #openstack-meeting-alt | 17:05 | |
| *** NikitaKonovalov has joined #openstack-meeting-alt | 17:13 | |
| *** sarob has joined #openstack-meeting-alt | 17:20 | |
| *** vipul is now known as vipul-away | 17:21 | |
| *** sarob has quit IRC | 17:25 | |
| *** vipul-away is now known as vipul | 17:31 | |
| *** ben_duyujie has quit IRC | 17:31 | |
| *** ben_duyujie has joined #openstack-meeting-alt | 17:33 | |
| *** dina_belova has quit IRC | 17:43 | |
| *** mattf has joined #openstack-meeting-alt | 17:44 | |
| *** IlyaE has quit IRC | 17:45 | |
| *** sarob has joined #openstack-meeting-alt | 17:51 | |
| *** Nadya has joined #openstack-meeting-alt | 17:52 | |
| *** IvanBerezovskiy has joined #openstack-meeting-alt | 17:54 | |
| *** sarob has quit IRC | 17:56 | |
| SergeyLukjanov | savanna meeting will be here in 7 minutes | 17:57 |
| *** vipul is now known as vipul-away | 17:58 | |
| *** dmitryme has joined #openstack-meeting-alt | 17:58 | |
| *** _crobertsrh has joined #openstack-meeting-alt | 17:58 | |
| *** NikitaKonovalov has quit IRC | 18:02 | |
| *** aignatov_ has joined #openstack-meeting-alt | 18:02 | |
| *** NikitaKonovalov has joined #openstack-meeting-alt | 18:03 | |
| *** vipul-away is now known as vipul | 18:03 | |
| *** ErikB has joined #openstack-meeting-alt | 18:04 | |
| *** benl_ has joined #openstack-meeting-alt | 18:05 | |
| *** Nadya_ has joined #openstack-meeting-alt | 18:05 | |
| *** pdmars has joined #openstack-meeting-alt | 18:05 | |
| *** akuznetsov has joined #openstack-meeting-alt | 18:05 | |
| *** Nadya has quit IRC | 18:06 | |
| SergeyLukjanov | howdy folks, I think we can start the meeting | 18:06 |
| aignatov_ | hi | 18:06 |
| SergeyLukjanov | #startmeeting savanna | 18:06 |
| openstack | Meeting started Thu Aug 1 18:06:59 2013 UTC and is due to finish in 60 minutes. The chair is SergeyLukjanov. Information about MeetBot at http://wiki.debian.org/MeetBot. | 18:07 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 18:07 |
| *** openstack changes topic to " (Meeting topic: savanna)" | 18:07 | |
| openstack | The meeting name has been set to 'savanna' | 18:07 |
| SergeyLukjanov | #topic Agenda | 18:07 |
| SergeyLukjanov | #info News / updates | 18:07 |
| SergeyLukjanov | #info Action items from the last meeting | 18:07 |
| SergeyLukjanov | #info General discussion | 18:07 |
| *** openstack changes topic to "Agenda (Meeting topic: savanna)" | 18:07 | |
| SergeyLukjanov | #topic News / updates | 18:07 |
| *** openstack changes topic to "News / updates (Meeting topic: savanna)" | 18:07 | |
| aignatov_ | whos around beside me and Sergey? ;) | 18:07 |
| *** IlyaE has joined #openstack-meeting-alt | 18:07 | |
| mattf | i am | 18:08 |
| tmckayrh | me too | 18:08 |
| SergeyLukjanov | #info Savanna 0.2.1 released has been released with bunch of bug fixes and improvements | 18:08 |
| dmitryme | me here | 18:08 |
| aignatov_ | cool | 18:08 |
| SergeyLukjanov | #link http://lists.openstack.org/pipermail/openstack-dev/2013-July/012747.html | 18:08 |
| *** ben_duyujie has quit IRC | 18:08 | |
| SergeyLukjanov | ^^ announcement of 0.2.1 release with details | 18:08 |
| SergeyLukjanov | #link https://wiki.openstack.org/wiki/Savanna/ReleaseNotes/0.2.1 | 18:08 |
| SergeyLukjanov | ^^ release notes | 18:08 |
| mattf | congrats on getting it out! | 18:08 |
| SergeyLukjanov | HDP plugin has been postponed to be polished and released in 0.2.2 version | 18:09 |
| SergeyLukjanov | I mean HDP plugin release | 18:09 |
| SergeyLukjanov | #info active work started on both EDP and scaling component | 18:10 |
| SergeyLukjanov | #info we are working now on implementing conductor abstraction | 18:10 |
| *** benl__ has joined #openstack-meeting-alt | 18:11 | |
| SergeyLukjanov | aignatov_, akuznetsov, are there any updates on EDP side? | 18:11 |
| aignatov_ | ok, my updates about EDP. I mostly worked this week on Oozie service integration into vanilla Plugin | 18:11 |
| SergeyLukjanov | and Nadya too, sorry | 18:11 |
| aignatov_ | it's done i think | 18:11 |
| akuznetsov | first version of REST API for EDP was merged to trunk | 18:11 |
| *** cp16net|away is now known as cp16net | 18:12 | |
| aignatov_ | Oozie integration code is already merged | 18:12 |
| *** benl_ has quit IRC | 18:12 | |
| aignatov_ | also I put dib elements of oozie installation | 18:12 |
| Nadya_ | on this week I worked on workflow.xml helper. Initial version will be on review tomorrow | 18:12 |
| aignatov_ | #link https://review.openstack.org/#/c/39671/ | 18:12 |
| akuznetsov | also we plan to interact with cluster via Oozie and created a simple REST client for Oozie | 18:13 |
| aignatov_ | got reasonable comment frrom matt already)) | 18:13 |
| akuznetsov | it also merged to the trunk | 18:13 |
| aignatov_ | mattf, thx, I will do wget and tar installation | 18:13 |
| aignatov_ | waiting also Ivan's comments | 18:13 |
| mattf | yeah, minor stuff. you should plow forward. | 18:13 |
| aignatov_ | also I upload compiled oozie.tar.gz library to our CDN | 18:14 |
| SergeyLukjanov | tmckayrh, do you have any updates? | 18:14 |
| Nadya_ | there are some differences in workflow.xml between hive, pig and mapreduce jobs so I think it would be useful to write helpers for all this things | 18:14 |
| *** jbresnah has left #openstack-meeting-alt | 18:15 | |
| aignatov_ | its here | 18:15 |
| aignatov_ | #link http://a8e0dce84b3f00ed7910-a5806ff0396addabb148d230fde09b7b.r31.cf1.rackcdn.com/oozie-3.3.2.tar.gz | 18:15 |
| tmckayrh | I am working on learning SqlAlchemy/Flask usage in savanna as a precursor to supporting Swift in the Job Source component | 18:15 |
| tmckayrh | I added some notes to the Savanna EDP api draft etherpad yesterday. | 18:15 |
| tmckayrh | There may be a mistake in the sequence diagrams having to do with job code retrieval | 18:16 |
| aignatov_ | could someone post a link here to etherpad?) | 18:16 |
| tmckayrh | Also, I wonder if we should change terminology slighly | 18:16 |
| SergeyLukjanov | tmckayrh, we are now working on rewriting db-related code to make it more consistent, btw we'll help to port changes if you'll have questions | 18:16 |
| tmckayrh | yes, hold on... | 18:16 |
| tmckayrh | #link https://etherpad.openstack.org/savanna_API_draft_EDP_extensions | 18:16 |
| aignatov_ | tmckayrh, thx | 18:17 |
| _crobertsrh | I'm working on the UI for Job Sources. commenting out the actual api calls until they are ready to go. Seems to be going well so far, but I have yet to bring anything very "dynamic" to the UI yet. | 18:17 |
| Nadya_ | tmckayrh, if you have questions about swift integration please post your question in irc. I dealt with swift in savanna | 18:18 |
| SergeyLukjanov | tmckayrh, _crobertsrh, folks, I remember that you have several concerns yesterday? | 18:18 |
| tmckayrh | my terminology question is as follows: "Job Source" means a storage facility for jobs. But "source" often means "code" as well. So "job source" could be ambiguous. | 18:18 |
| benl__ | I have a little question about that draft. I hope im not missing anytihng. You create a job execution by specifying a cluster ID. why doesnt the GET method doesnt specify the used cluster? | 18:19 |
| *** ruhe has joined #openstack-meeting-alt | 18:19 | |
| SergeyLukjanov | about Job Source naming and scm | 18:19 |
| akuznetsov | for pig and hive source and code will be the same | 18:19 |
| *** mestery_ is now known as mestery | 18:20 | |
| tmckayrh | So this is where it starts to get confusing :) Suppose we have Pig and Hive jobs stored in a git repository | 18:20 |
| tmckayrh | The "Job Source" is the git, as I see it. The Job Source component manages information about the git repository and how to access it. | 18:21 |
| tmckayrh | Files in the git are "job source code" | 18:21 |
| SergeyLukjanov | benl__, am I understand you correctly that we need to have cluster_id in job? | 18:21 |
| benl__ | I meant job execution | 18:22 |
| SergeyLukjanov | benl__, thx, it's a good point | 18:22 |
| *** sarob has joined #openstack-meeting-alt | 18:22 | |
| benl__ | :) | 18:22 |
| tmckayrh | So for example, maybe "Job Source Component" could be "Job Depot Component" or similar. | 18:22 |
| akuznetsov | I added the cluster_id to the job execution object | 18:22 |
| SergeyLukjanov | akuznetsov, thx | 18:23 |
| aignatov_ | thx | 18:23 |
| *** sreshetnyak has quit IRC | 18:24 | |
| tmckayrh | SergeyLukjanov, the other issue we chatted about is that the draft API had "Hive" as a type in the Job Source Object example, but I changed it to "Swift". It seems to me that "type" for that object should be git, svn, mercurial, swift, hdfs, internal (for the savanna db), etc. | 18:24 |
| SergeyLukjanov | what are you think about "Job Origin"? | 18:24 |
| tmckayrh | type is describes the storage facility, not what is stored there | 18:24 |
| *** sreshetnyak has joined #openstack-meeting-alt | 18:24 | |
| tmckayrh | I like Job Origin | 18:24 |
| _crobertsrh | Job Origin works for me | 18:24 |
| SergeyLukjanov | akuznetsov, aignatov_, Nadya_? | 18:25 |
| SergeyLukjanov | #vote Rename "Job Source" to "Job Origin" | 18:25 |
| SergeyLukjanov | it's not working O_O | 18:25 |
| SergeyLukjanov | #startvote Rename "Job Source" to "Job Origin" | 18:26 |
| openstack | Unable to parse vote topic and options. | 18:26 |
| tmckayrh | So would we rename "Job Source Component" to "Job Origin Component" as well as the classes defined there? | 18:26 |
| akuznetsov | tmckayrh possible we should have a two types in Job Source components one of type there job is stored and second is the type of job like HIve, Pig etc. | 18:26 |
| tmckayrh | akuznetsov, could be. A single repo could store multiple types, though, so maybe a list? My git can contain anything :) | 18:27 |
| SergeyLukjanov | #startvote Rename "Job Source" to …? "Job Depot", "Job Origin" | 18:27 |
| openstack | Begin voting on: Rename "Job Source" to …? Valid vote options are , Job, Depot, Job, Origin, . | 18:27 |
| openstack | Vote using '#vote OPTION'. Only your last vote counts. | 18:27 |
| *** sarob has quit IRC | 18:27 | |
| tmckayrh | I'm thinking the facility type is helpful for finding plugins, etc. | 18:27 |
| SergeyLukjanov | oooops | 18:27 |
| SergeyLukjanov | #undo | 18:27 |
| openstack | Removing item from minutes: <ircmeeting.items.Link object at 0x22d9110> | 18:27 |
| SergeyLukjanov | #endvote | 18:27 |
| openstack | Voted on "Rename "Job Source" to …?" Results are | 18:27 |
| SergeyLukjanov | let's not use voting :) | 18:28 |
| Nadya_ | what about Job Home? | 18:28 |
| * tmckayrh laughs | 18:28 | |
| tmckayrh | Home is also good. | 18:28 |
| SergeyLukjanov | #startvote Rename "Job Source" to …? JobDepot, JobOrigin, JobHome | 18:28 |
| openstack | Begin voting on: Rename "Job Source" to …? Valid vote options are JobDepot, JobOrigin, JobHome. | 18:28 |
| openstack | Vote using '#vote OPTION'. Only your last vote counts. | 18:28 |
| ruhe | so, there are two things here "Job Source" where the actual code resides. And Job Storage where we'll compiled jar files, Pig scripts, etc, etc | 18:28 |
| dmitryme | to me, origin is better | 18:28 |
| SergeyLukjanov | looks like it's working good | 18:28 |
| ruhe | *we'll keep compiled | 18:28 |
| dmitryme | #vote JobOrigin | 18:28 |
| _crobertsrh | #vote JobOrigin | 18:29 |
| NikitaKonovalov | #vote JobOrigin | 18:29 |
| SergeyLukjanov | #vote JobOrigin | 18:29 |
| Nadya_ | #vote JobHome | 18:29 |
| ruhe | #vote JobStorage | 18:29 |
| openstack | ruhe: JobStorage is not a valid option. Valid options are JobDepot, JobOrigin, JobHome. | 18:29 |
| *** sarob has joined #openstack-meeting-alt | 18:29 | |
| aignatov_ | ruhe, I'm just thinking about the same question) | 18:29 |
| tmckayrh | #vote JobOrigin | 18:29 |
| akuznetsov | I removed type from Job Source object and two fields storage_type and job_type | 18:29 |
| aignatov_ | #vote JobHome | 18:29 |
| akuznetsov | #vote JobDepot | 18:29 |
| *** sarob has quit IRC | 18:30 | |
| SergeyLukjanov | #endvote | 18:30 |
| openstack | Voted on "Rename "Job Source" to …?" Results are | 18:30 |
| openstack | JobDepot (1): akuznetsov | 18:30 |
| openstack | JobOrigin (5): tmckayrh, NikitaKonovalov, dmitryme, _crobertsrh, SergeyLukjanov | 18:30 |
| openstack | JobHome (2): Nadya_, aignatov_ | 18:30 |
| SergeyLukjanov | + JobStorage: ruhe | 18:30 |
| aignatov_ | ok, let it be JobOrigin) | 18:30 |
| SergeyLukjanov | looks like we name it Job Origin :) | 18:30 |
| *** sarob has joined #openstack-meeting-alt | 18:31 | |
| SergeyLukjanov | tmckayrh, what about SCM? | 18:31 |
| tmckayrh | so please check my understanding. based on ^^, the Job Origin Component will manage the registration of Job Origins. We can define Job Origins there. It can also interact with plugins for particular origin types so that raw, executable job script code can be retrieved from a particular Job Origin (which may be an scm storing jobs of multiple types like Pig, Hive, jar, oozie, etc) | 18:31 |
| aignatov_ | belt__, do akuznetsov's changes resolve your question about cluster_id in job execution? | 18:32 |
| benl__ | yeah, looks good now :) | 18:33 |
| ruhe | shold JobOrigin manage different storages for the jobs, like Swift, Gluster, HDSF etc? | 18:33 |
| tmckayrh | SergeyLukjanov, I was wondering yesterday if we define each supported SCM as it's own job origin type. So, rather than have a single type "SCM" we would have "git, mercurial, etc" as distinct job origin types. | 18:34 |
| tmckayrh | ruhe, I thought that was the intention. | 18:34 |
| dmitryme | tmckayrh: +1 | 18:35 |
| _crobertsrh | I think that would make it easier UI-wise to know which fields need to be displayed for a given type. +1 | 18:35 |
| dmitryme | I would prefer different types | 18:35 |
| SergeyLukjanov | dmitryme, tmckayrh, +1 for have different types | 18:35 |
| *** ruhe_ has joined #openstack-meeting-alt | 18:36 | |
| ruhe_ | the second question: should it also support different build systems: mvn, gradle, ant, make … ? | 18:37 |
| SergeyLukjanov | ruhe_, lein... | 18:37 |
| tmckayrh | I should update the sequence diagram to reflect this thinking, that the Job Manager on execute() pass "job id" and "job origin id" to the Job Origin component, which then handles interacting with plugins to retrieve the actual code. Agreed? | 18:37 |
| *** ruhe has quit IRC | 18:37 | |
| ruhe_ | tmckayrh, agree | 18:38 |
| akuznetsov | ruhe_ I think this support is valuable, but this not for this development phase | 18:38 |
| aignatov_ | +1 | 18:38 |
| tmckayrh | ruhe_, how does the Job Origin component interact with build? | 18:38 |
| Nadya_ | tmckayrh, we will process all pig, hive, jar through oozie, right? | 18:39 |
| tmckayrh | Nadya_, yes, we seemed to have consensus on that. I think it's a great idea. | 18:39 |
| tmckayrh | Nadya_, hmm, that brings up a good question.... | 18:40 |
| akuznetsov | ruhe_ Job Origin can download a job code for execution form build server | 18:40 |
| Nadya_ | tmckayrh, yes, great:) just to clarify | 18:40 |
| tmckayrh | If we autowrap scripts in Oozie, does that happen before the job is stored, or after we retrieve it but before it is submitted to the cluster for execution? | 18:40 |
| tmckayrh | Maybe it's better to wrap on the fly, so that a Hive job can still be a Hive job in case external storage is used by something other than savanna | 18:41 |
| tmckayrh | in other words, wrap it late, just before submission | 18:41 |
| Nadya_ | tmckayrh, I'm working on this now. for each job we will create it's own workflow.xml | 18:41 |
| aignatov_ | i agree with this idea | 18:41 |
| akuznetsov | tmckayrh it will happen after downloading job code and before job execution | 18:41 |
| aignatov_ | on the fly I mean | 18:41 |
| Nadya_ | tmckayrh, on the fly, yes | 18:41 |
| tmckayrh | +1 | 18:41 |
| ruhe_ | tmckayrh, akuznetsov, just to clarify. JobOrigin doesn't deal with java source code, or any other type of source code. it just works compiled binaries. right? | 18:42 |
| tmckayrh | I don't know the answer to that :) | 18:42 |
| akuznetsov | in this case end use will not need to know the oozie | 18:42 |
| tmckayrh | I was thinking of it as uncompiled code, I admit | 18:43 |
| Nadya_ | ruhe_, +1 | 18:43 |
| *** dina_belova has joined #openstack-meeting-alt | 18:43 | |
| akuznetsov | ruhe_ yes, not now in this phase, possible in feature we add this functionality | 18:43 |
| ruhe_ | compilation from source code is a nice feature, but it should be dealt with by another component | 18:44 |
| aignatov_ | ruhe_, i also agree with you, it's complex to build code in this stage of EDP develompment | 18:44 |
| Nadya_ | I think it should be separate component for jos sources (binaries I mean) | 18:44 |
| * tmckayrh has been writing Python too long | 18:44 | |
| *** _crobertsrh has quit IRC | 18:45 | |
| benl__ | So the user must compile against machines similar to the ones in the cluster? | 18:45 |
| akuznetsov | ruhe_, also in case of pig and hive we don't need a compilation | 18:45 |
| *** vipul is now known as vipul-away | 18:45 | |
| aignatov_ | i think we can create job compilation and building on top of well-created JobOrigin - the component whish stores binaries, pig scripts, not code right now | 18:45 |
| SergeyLukjanov | benl__, jars are not OS-dependent | 18:46 |
| ruhe_ | akuznetsov, sometimes we need, actually in most cases people are using UDFs for Pig script. UDF is written in java and compiled to jar | 18:46 |
| dmitryme | but that is true in case of C jobs | 18:46 |
| benl__ | Yeah I was refering C jobs | 18:47 |
| aignatov_ | yes, benl, also pig and hive scripts are also translated to hadoop job with known structures | 18:47 |
| Nadya_ | benl_, SerjeyLukjanov, what about java version? | 18:47 |
| akuznetsov | benl__ in most cases user need to compile a java and it is cross platform language, so it is not a problem to build jar on windows when run on linux | 18:47 |
| ruhe_ | dmitryme, benl__, why would someone write jobs in C? just wondering | 18:47 |
| dmitryme | Nadya_: I think with Java it is simpler: you just need to find JDK of the given version | 18:48 |
| akuznetsov | benl__ dmitryme this is a not typical use case for Hadoop | 18:48 |
| dmitryme | ruhe_: I don't know, but there is Hadoop Pipes for some reason here | 18:48 |
| benl__ | I was thinking of "streaming" jobs | 18:48 |
| SergeyLukjanov | let's start from the pre-compiled jobs | 18:48 |
| dmitryme | I guess for faster execution | 18:48 |
| *** dina_belova has quit IRC | 18:49 | |
| SergeyLukjanov | it's ok for the 0.3 version to postpone sources compilation and etc. | 18:49 |
| akuznetsov | benl_ for streaming API users often use a scripting language like python and perl | 18:49 |
| benl__ | Okay, thanks | 18:50 |
| SergeyLukjanov | are there any other questions to discuss or concerns around the EDP topic? | 18:51 |
| tmckayrh | okay, so Job Origins will only store "binary" jobs which can be wrapped in Oozie for now (not that I really need to care about that, I think, in implementing the API) | 18:51 |
| SergeyLukjanov | tmckayrh, I think it'll be ok for now | 18:52 |
| tmckayrh | okay, thanks. Very helpful meeting for me! | 18:52 |
| aignatov_ | +1 tmckayrh | 18:52 |
| Nadya_ | agreed | 18:52 |
| SergeyLukjanov | we should design "source" jobs management in future | 18:52 |
| ruhe_ | do we have a BP for EDP dashboard? | 18:53 |
| tmckayrh | maybe we should add a blueprint for "source" management, too | 18:53 |
| SergeyLukjanov | I think nope | 18:53 |
| akuznetsov | ruhe_ you means horizon? | 18:53 |
| SergeyLukjanov | (to ruhe) | 18:53 |
| ruhe_ | yes | 18:53 |
| aignatov_ | tmckayrh, please create the new one | 18:54 |
| akuznetsov | not yet | 18:54 |
| SergeyLukjanov | tmckayrh, yes, it'll be good to create bp for it | 18:54 |
| ruhe_ | _crobertsrh, would you do that? | 18:54 |
| tmckayrh | okay | 18:54 |
| *** dina_belova has joined #openstack-meeting-alt | 18:54 | |
| tmckayrh | #action tmckayrh will make a blueprint for an uncompiled source code management component | 18:54 |
| ruhe_ | #action _crobertsrh create blueprint for EDP Horizon dashboard (since Robert is working on UI part) | 18:55 |
| tmckayrh | I think we lost crobertsrh but we can assign it | 18:55 |
| ruhe_ | sorry (*Chad) | 18:55 |
| SergeyLukjanov | I think that's all areund EDP | 18:56 |
| SergeyLukjanov | around* | 18:56 |
| SergeyLukjanov | #topic Action items from the last meeting | 18:56 |
| *** openstack changes topic to "Action items from the last meeting (Meeting topic: savanna)" | 18:56 | |
| SergeyLukjanov | there are two action items | 18:56 |
| SergeyLukjanov | Sergey to create an issue to cover image creation for HDP plugin | 18:56 |
| SergeyLukjanov | aignatov to create a blueprint for ubuntu packaging | 18:56 |
| aignatov_ | done | 18:56 |
| SergeyLukjanov | #link https://bugs.launchpad.net/savanna/+bug/1206249 | 18:56 |
| SergeyLukjanov | #link https://blueprints.launchpad.net/savanna/+spec/savanna-in-ubuntu | 18:56 |
| SergeyLukjanov | and we have several minutes before the end of meeting :) | 18:57 |
| SergeyLukjanov | #topic General discussion | 18:57 |
| *** openstack changes topic to "General discussion (Meeting topic: savanna)" | 18:57 | |
| tmckayrh | can I add actions still? | 18:57 |
| aignatov_ | sure | 18:57 |
| SergeyLukjanov | yep, sure | 18:57 |
| tmckayrh | #action tmckayrh will update sequence diagrams and etherpad to show proper flow and the rename of Job Source Component to Job Origin Component | 18:58 |
| tmckayrh | I suppose the blueprint name needs to change too? | 18:58 |
| tmckayrh | Is that easy to do? | 18:58 |
| ruhe_ | it's easy | 18:58 |
| ruhe_ | but you might not have permissions. i'm not sure | 18:59 |
| tmckayrh | that's what I was wondering. | 18:59 |
| SergeyLukjanov | tmckayrh, just ping me if you will have any questions | 18:59 |
| benl__ | If its alright with everyone I'd like to have a go at the PKI bp. I assume you expect it to be used as a middleware in the same way its done in Swift? | 18:59 |
| akuznetsov | tmckayrh I have a permissions you can assign this action to me | 18:59 |
| tmckayrh | okay | 19:00 |
| tmckayrh | #action akuznetsov will rename the Job Source Component to Job Origin Component | 19:00 |
| tmckayrh | thanks! | 19:00 |
| SergeyLukjanov | benl__, PKI tokens are not working now with Savanna now | 19:00 |
| tmckayrh | oops, I meant in the blueprint | 19:00 |
| SergeyLukjanov | benl__, we doesn't dig into it | 19:00 |
| SergeyLukjanov | benl__, feel free to investigate/fix it | 19:01 |
| SergeyLukjanov | we out of time for today... | 19:01 |
| benl__ | Alright | 19:01 |
| SergeyLukjanov | let's move to the #savanna channel | 19:01 |
| SergeyLukjanov | thanks folks! | 19:01 |
| SergeyLukjanov | #info JFYI you can always use openstack-dev@lists.openstack.org mailing lists and #savanna irc channel to find us and ask your questions | 19:02 |
| SergeyLukjanov | #endmeeting | 19:02 |
| *** openstack changes topic to "OpenStack meetings (alternate)" | 19:02 | |
| openstack | Meeting ended Thu Aug 1 19:02:08 2013 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 19:02 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/savanna/2013/savanna.2013-08-01-18.06.html | 19:02 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/savanna/2013/savanna.2013-08-01-18.06.txt | 19:02 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/savanna/2013/savanna.2013-08-01-18.06.log.html | 19:02 |
| *** tmckayrh is now known as tmckay_latelunch | 19:04 | |
| *** IvanBerezovskiy has left #openstack-meeting-alt | 19:04 | |
| *** mattf has left #openstack-meeting-alt | 19:04 | |
| *** sarob has quit IRC | 19:09 | |
| *** aignatov_ has quit IRC | 19:11 | |
| *** tmckay_latelunch is now known as tmckay | 19:17 | |
| *** tmckay is now known as tmckayrh | 19:17 | |
| *** NikitaKonovalov has quit IRC | 19:18 | |
| *** vipul-away is now known as vipul | 19:18 | |
| *** boris-42 has quit IRC | 19:19 | |
| *** boris-42 has joined #openstack-meeting-alt | 19:20 | |
| *** NikitaKonovalov has joined #openstack-meeting-alt | 19:21 | |
| *** akuznetsov has quit IRC | 19:22 | |
| *** benl__ has quit IRC | 19:24 | |
| *** dina_belova has quit IRC | 19:29 | |
| *** benl_ has joined #openstack-meeting-alt | 19:31 | |
| *** NikitaKonovalov has quit IRC | 19:35 | |
| *** NikitaKonovalov has joined #openstack-meeting-alt | 19:36 | |
| *** rnirmal has quit IRC | 19:36 | |
| *** benl__ has joined #openstack-meeting-alt | 19:38 | |
| *** benl_ has quit IRC | 19:42 | |
| *** dina_belova has joined #openstack-meeting-alt | 19:44 | |
| *** ruhe_ has quit IRC | 19:45 | |
| *** benl__ has quit IRC | 19:52 | |
| *** sreshetnyak has quit IRC | 20:01 | |
| *** cp16net is now known as cp16net|away | 20:06 | |
| *** dina_belova has quit IRC | 20:06 | |
| *** benl_ has joined #openstack-meeting-alt | 20:07 | |
| *** dina_belova has joined #openstack-meeting-alt | 20:08 | |
| *** cp16net|away is now known as cp16net | 20:12 | |
| *** Nadya_ has quit IRC | 20:13 | |
| *** dina_belova has quit IRC | 20:18 | |
| *** rnirmal has joined #openstack-meeting-alt | 20:19 | |
| *** jmontemayor has joined #openstack-meeting-alt | 20:22 | |
| *** pcm_ has quit IRC | 20:29 | |
| *** HenryG has quit IRC | 20:30 | |
| *** Riddhi has quit IRC | 20:30 | |
| *** IlyaE has quit IRC | 20:33 | |
| *** boris-42 has quit IRC | 20:38 | |
| *** cp16net is now known as cp16net|away | 20:43 | |
| *** jmontemayor has quit IRC | 20:46 | |
| *** jmontemayor has joined #openstack-meeting-alt | 20:47 | |
| *** cp16net|away is now known as cp16net | 20:48 | |
| *** IlyaE has joined #openstack-meeting-alt | 20:50 | |
| *** vipul is now known as vipul-away | 20:52 | |
| *** jmontemayor has quit IRC | 20:54 | |
| *** megan_w has quit IRC | 21:00 | |
| *** enikanorov has quit IRC | 21:00 | |
| *** SergeyLukjanov has quit IRC | 21:00 | |
| *** benl_ has quit IRC | 21:01 | |
| *** enikanorov has joined #openstack-meeting-alt | 21:05 | |
| *** vipul-away is now known as vipul | 21:05 | |
| *** IlyaE has quit IRC | 21:06 | |
| *** benl_ has joined #openstack-meeting-alt | 21:06 | |
| *** enikanorov_ has joined #openstack-meeting-alt | 21:07 | |
| *** enikanorov has quit IRC | 21:09 | |
| *** demorris has joined #openstack-meeting-alt | 21:11 | |
| *** NikitaKonovalov has quit IRC | 21:12 | |
| *** venkatesh has joined #openstack-meeting-alt | 21:14 | |
| *** djohnstone has quit IRC | 21:16 | |
| *** dmitryme has quit IRC | 21:21 | |
| *** dina_belova has joined #openstack-meeting-alt | 21:29 | |
| *** dina_belova has quit IRC | 21:33 | |
| *** venkatesh has quit IRC | 21:37 | |
| *** zane has joined #openstack-meeting-alt | 21:37 | |
| *** zane has quit IRC | 21:37 | |
| *** zane has joined #openstack-meeting-alt | 21:37 | |
| *** zane has quit IRC | 21:44 | |
| *** ben_duyujie has joined #openstack-meeting-alt | 21:47 | |
| *** tmckayrh has left #openstack-meeting-alt | 21:53 | |
| *** pcm_ has joined #openstack-meeting-alt | 21:55 | |
| *** pcm_ has quit IRC | 21:56 | |
| *** pcm_ has joined #openstack-meeting-alt | 21:57 | |
| *** NikitaKonovalov has joined #openstack-meeting-alt | 22:13 | |
| *** rnirmal has quit IRC | 22:15 | |
| *** NikitaKonovalov has quit IRC | 22:17 | |
| *** lastidiot has quit IRC | 22:21 | |
| *** aignatov has quit IRC | 22:25 | |
| *** aignatov has joined #openstack-meeting-alt | 22:26 | |
| *** nmakhotkin has quit IRC | 22:28 | |
| *** plomakin has quit IRC | 22:29 | |
| *** plomakin has joined #openstack-meeting-alt | 22:29 | |
| *** demorris has quit IRC | 22:32 | |
| *** benl_ has quit IRC | 22:32 | |
| *** benl_ has joined #openstack-meeting-alt | 22:32 | |
| *** Riddhi has joined #openstack-meeting-alt | 22:38 | |
| *** nmakhotkin has joined #openstack-meeting-alt | 22:42 | |
| *** IlyaE has joined #openstack-meeting-alt | 22:45 | |
| *** IlyaE has quit IRC | 22:52 | |
| *** IlyaE has joined #openstack-meeting-alt | 22:53 | |
| *** IlyaE has quit IRC | 22:55 | |
| *** benl_ has quit IRC | 22:55 | |
| *** salv-orlando has quit IRC | 23:02 | |
| *** NikitaKonovalov has joined #openstack-meeting-alt | 23:13 | |
| *** NikitaKonovalov has quit IRC | 23:18 | |
| *** benl_ has joined #openstack-meeting-alt | 23:26 | |
| *** benl_ has quit IRC | 23:33 | |
| *** pdmars has quit IRC | 23:36 | |
| *** lastidiot has joined #openstack-meeting-alt | 23:52 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!