*** tanisdl has quit IRC | 00:11 | |
*** lastidiot has joined #openstack-meeting-alt | 00:17 | |
*** vipul is now known as vipul|away | 00:38 | |
*** amytron has joined #openstack-meeting-alt | 00:42 | |
*** grapex has quit IRC | 00:45 | |
*** amytron has quit IRC | 00:45 | |
*** amytron has joined #openstack-meeting-alt | 00:47 | |
*** lifeless_ has joined #openstack-meeting-alt | 00:48 | |
*** amytron has quit IRC | 00:48 | |
*** amytron has joined #openstack-meeting-alt | 00:49 | |
*** lifeless has quit IRC | 00:50 | |
*** lifeless_ is now known as lifeless | 00:52 | |
*** amytron has quit IRC | 00:52 | |
*** lifeless has quit IRC | 00:53 | |
*** bdpayne has quit IRC | 00:54 | |
*** lifeless has joined #openstack-meeting-alt | 00:54 | |
*** amytron has joined #openstack-meeting-alt | 00:55 | |
*** lifeless has quit IRC | 00:59 | |
*** vipul|away is now known as vipul | 01:05 | |
*** amytron has quit IRC | 01:06 | |
*** amytron has joined #openstack-meeting-alt | 01:07 | |
*** lifeless has joined #openstack-meeting-alt | 01:08 | |
*** Riddhi has joined #openstack-meeting-alt | 01:24 | |
*** amytron has quit IRC | 01:24 | |
*** amytron has joined #openstack-meeting-alt | 01:25 | |
*** amytron has quit IRC | 01:36 | |
*** amytron has joined #openstack-meeting-alt | 01:37 | |
*** grapex has joined #openstack-meeting-alt | 01:41 | |
*** amytron has quit IRC | 01:41 | |
*** grapex has quit IRC | 01:41 | |
*** grapex has joined #openstack-meeting-alt | 01:41 | |
*** amytron has joined #openstack-meeting-alt | 01:41 | |
*** yamahata has quit IRC | 01:46 | |
*** amytron has quit IRC | 01:56 | |
*** amytron has joined #openstack-meeting-alt | 01:58 | |
*** yamahata has joined #openstack-meeting-alt | 02:03 | |
*** grapex has quit IRC | 02:14 | |
*** amytron has quit IRC | 02:14 | |
*** amytron has joined #openstack-meeting-alt | 02:14 | |
*** demorris has joined #openstack-meeting-alt | 02:18 | |
*** markwash has joined #openstack-meeting-alt | 02:21 | |
*** Riddhi has quit IRC | 02:22 | |
*** cp16net is now known as cp16net|away | 02:39 | |
*** amytron has quit IRC | 02:39 | |
*** cp16net|away is now known as cp16net | 02:39 | |
*** amytron has joined #openstack-meeting-alt | 02:41 | |
*** cp16net is now known as cp16net|away | 02:49 | |
*** cp16net|away is now known as cp16net | 02:55 | |
*** demorris has quit IRC | 03:16 | |
*** amytron has quit IRC | 03:16 | |
*** amytron has joined #openstack-meeting-alt | 03:17 | |
*** sdake_ has quit IRC | 03:23 | |
*** sdake_ has joined #openstack-meeting-alt | 03:24 | |
*** sdake_ has quit IRC | 03:24 | |
*** sdake_ has joined #openstack-meeting-alt | 03:24 | |
*** pcm__ has quit IRC | 03:24 | |
*** SergeyLukjanov has joined #openstack-meeting-alt | 03:36 | |
*** amytron has quit IRC | 03:36 | |
*** amytron has joined #openstack-meeting-alt | 03:37 | |
*** cp16net is now known as cp16net|away | 03:42 | |
*** amytron has quit IRC | 03:42 | |
*** amytron has joined #openstack-meeting-alt | 03:43 | |
*** amytron has quit IRC | 03:56 | |
*** amytron has joined #openstack-meeting-alt | 03:57 | |
*** akuznetsov has joined #openstack-meeting-alt | 04:40 | |
*** amytron has quit IRC | 04:40 | |
*** amytron has joined #openstack-meeting-alt | 04:41 | |
*** amytron has joined #openstack-meeting-alt | 04:44 | |
*** Bobball has quit IRC | 04:48 | |
*** euanh has quit IRC | 04:48 | |
*** amytron has quit IRC | 04:51 | |
*** amytron has joined #openstack-meeting-alt | 04:52 | |
*** euanh has joined #openstack-meeting-alt | 04:56 | |
*** Bobball has joined #openstack-meeting-alt | 04:59 | |
*** amytron has quit IRC | 04:59 | |
*** Bobball is now known as Guest88546 | 04:59 | |
*** amytron has joined #openstack-meeting-alt | 05:00 | |
*** lastidiot has quit IRC | 05:14 | |
*** SergeyLukjanov has quit IRC | 05:28 | |
*** amytron has quit IRC | 05:31 | |
*** amytron has joined #openstack-meeting-alt | 05:32 | |
*** akuznetsov has quit IRC | 05:57 | |
*** dhellmann-away has quit IRC | 06:12 | |
*** IlyaE has joined #openstack-meeting-alt | 06:16 | |
*** amytron has quit IRC | 06:16 | |
*** amytron has joined #openstack-meeting-alt | 06:16 | |
*** amytron_ has joined #openstack-meeting-alt | 06:30 | |
*** amytron has quit IRC | 06:30 | |
*** amytron_ is now known as amytron | 06:30 | |
*** akuznetsov has joined #openstack-meeting-alt | 06:34 | |
*** amytron has quit IRC | 06:40 | |
*** sungju_ has quit IRC | 06:46 | |
*** IlyaE has quit IRC | 06:53 | |
*** IlyaE has joined #openstack-meeting-alt | 06:56 | |
*** sdake_ has quit IRC | 07:15 | |
*** dhellmann has joined #openstack-meeting-alt | 07:15 | |
*** dhellmann has quit IRC | 07:29 | |
*** akuznetsov has quit IRC | 07:33 | |
*** qwerty_nor has joined #openstack-meeting-alt | 07:45 | |
*** johnthetubaguy has joined #openstack-meeting-alt | 07:56 | |
*** IlyaE has quit IRC | 08:04 | |
*** johnthetubaguy1 has joined #openstack-meeting-alt | 08:20 | |
*** akuznetsov has joined #openstack-meeting-alt | 08:21 | |
*** johnthetubaguy has quit IRC | 08:23 | |
*** Guest88546 is now known as Bobba | 08:37 | |
*** euan has joined #openstack-meeting-alt | 08:50 | |
*** Bobba has quit IRC | 08:50 | |
*** euan is now known as Guest25460 | 08:51 | |
*** BobBall has joined #openstack-meeting-alt | 08:51 | |
*** euan_ has joined #openstack-meeting-alt | 08:51 | |
*** BobBall is now known as Guest45527 | 08:51 | |
*** euanh_ has joined #openstack-meeting-alt | 08:52 | |
*** Guest45527 has quit IRC | 08:52 | |
*** BobBall_ has joined #openstack-meeting-alt | 08:52 | |
*** euanh has quit IRC | 08:54 | |
*** Guest25460 has quit IRC | 08:54 | |
*** euan_ has quit IRC | 08:56 | |
*** euan_ has joined #openstack-meeting-alt | 08:56 | |
*** euanh_ has quit IRC | 08:56 | |
*** johnthetubaguy1 is now known as johnthetubaguy | 09:26 | |
*** akuznetsov has quit IRC | 09:26 | |
*** johnthetubaguy has quit IRC | 09:31 | |
*** johnthetubaguy has joined #openstack-meeting-alt | 09:34 | |
*** akuznetsov has joined #openstack-meeting-alt | 09:36 | |
*** BobBall_ is now known as Bobba | 09:41 | |
*** SergeyLukjanov has joined #openstack-meeting-alt | 09:45 | |
*** akuznetsov has quit IRC | 09:49 | |
*** johnthetubaguy has quit IRC | 10:00 | |
*** johnthetubaguy has joined #openstack-meeting-alt | 10:00 | |
*** sungju has joined #openstack-meeting-alt | 10:18 | |
*** akuznetsov has joined #openstack-meeting-alt | 10:20 | |
*** akuznetsov has quit IRC | 10:27 | |
*** akuznetsov has joined #openstack-meeting-alt | 10:34 | |
*** johnthetubaguy1 has joined #openstack-meeting-alt | 10:36 | |
*** johnthetubaguy has quit IRC | 10:38 | |
*** SergeyLukjanov has quit IRC | 10:49 | |
*** SergeyLukjanov has joined #openstack-meeting-alt | 10:59 | |
*** johnthetubaguy1 is now known as johnthetubaguy | 11:22 | |
*** grapex has joined #openstack-meeting-alt | 11:43 | |
*** qwerty_nor has quit IRC | 11:45 | |
*** pcm__ has joined #openstack-meeting-alt | 11:46 | |
*** mestery_ has joined #openstack-meeting-alt | 11:46 | |
*** mestery has quit IRC | 11:50 | |
*** HenryG has joined #openstack-meeting-alt | 11:53 | |
*** grapex has quit IRC | 12:01 | |
*** SergeyLukjanov has quit IRC | 13:00 | |
*** grapex has joined #openstack-meeting-alt | 13:00 | |
*** markwash has quit IRC | 13:08 | |
*** markwash has joined #openstack-meeting-alt | 13:08 | |
*** npasqua has joined #openstack-meeting-alt | 13:16 | |
*** demorris has joined #openstack-meeting-alt | 13:16 | |
*** briancline has quit IRC | 13:18 | |
*** jergerber has quit IRC | 13:20 | |
*** briancline has joined #openstack-meeting-alt | 13:22 | |
*** dosaboy has joined #openstack-meeting-alt | 13:27 | |
*** mtreinish has joined #openstack-meeting-alt | 13:34 | |
*** openstack has joined #openstack-meeting-alt | 13:41 | |
*** ChanServ sets mode: +o openstack | 13:41 | |
*** openstack has joined #openstack-meeting-alt | 13:52 | |
*** ChanServ sets mode: +o openstack | 13:52 | |
*** Bobba has quit IRC | 13:54 | |
*** BobBall has joined #openstack-meeting-alt | 13:54 | |
*** euan_ has quit IRC | 13:58 | |
*** esheffield has joined #openstack-meeting-alt | 14:00 | |
markwash | Hi Folks | 14:00 |
---|---|---|
markwash | o/ | 14:00 |
zhiyan1 | hi | 14:00 |
rosmaita | hi | 14:01 |
iccha | o/ | 14:01 |
zhiyan1 | hi iccha | 14:01 |
esheffield | hey markwash! | 14:01 |
esheffield | \o | 14:01 |
iccha | hey zhiyan1 | 14:01 |
markwash | lets start loggin | 14:01 |
markwash | #startmeeting glance | 14:01 |
openstack | Meeting started Thu Jun 6 14:01:30 2013 UTC. The chair is markwash. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:01 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:01 |
*** openstack changes topic to " (Meeting topic: glance)" | 14:01 | |
openstack | The meeting name has been set to 'glance' | 14:01 |
ameade | yo | 14:01 |
*** jbresnah has joined #openstack-meeting-alt | 14:01 | |
markwash | so, time change seems to work okay for east coast | 14:01 |
jbresnah | wave | 14:02 |
zhiyan1 | yes :) thanks | 14:02 |
markwash | jbresnah: hi! | 14:02 |
zhiyan1 | hi jbresnah | 14:02 |
iccha | it must be really early for PST ppl | 14:02 |
markwash | jbresnah: glad you could make it! | 14:02 |
rosmaita | jbresnah gets the worst time for a meeting award | 14:02 |
markwash | iccha: not really, worst for hawaii | 14:02 |
iccha | dedication and love for glance jbresnah | 14:02 |
markwash | but this way zhiyan1 can be here more easily, (though it is pretty late!) | 14:03 |
zhiyan1 | :) | 14:03 |
* jbresnah is taking coffee intravenously | 14:03 | |
markwash | so anybody got anything they want to add to the informal agenda for today? | 14:03 |
zhiyan1 | yes, yes, cinder-glance-store.. | 14:03 |
markwash | zhiyan1: check | 14:03 |
markwash | #link https://wiki.openstack.org/wiki/Meetings/Glance#Agenda_for_Next_Meeting | 14:03 |
markwash | has the rough outlines, I'm most interested in ongoing blueprints today | 14:04 |
iccha | esheffield: and me just have some updates on documentation, not much though | 14:04 |
markwash | cool | 14:04 |
jbresnah | I would like to talk about the multiple locations bp if possible | 14:04 |
markwash | jbresnah: deal | 14:05 |
zhiyan1 | yes, cool | 14:05 |
*** grapex has left #openstack-meeting-alt | 14:05 | |
*** flaper87 has joined #openstack-meeting-alt | 14:05 | |
rosmaita | if there is time i would like to mention import/export/clone | 14:05 |
markwash | for zhiyan1's glance-cinder-driver work, there is this etherpad | 14:05 |
markwash | #link https://etherpad.openstack.org/linked-template-image | 14:05 |
flaper87 | o/ | 14:05 |
markwash | folks might want to take a look through that before we get to it later on in the meeting | 14:05 |
zhiyan1 | hi flaper87. | 14:05 |
flaper87 | zhiyan1: hey :) | 14:06 |
zhiyan1 | thanks mark, yes, thatis:) | 14:06 |
* nikhil is eavsdroppping | 14:06 | |
markwash | #topic New Blueprints (fast-style!) | 14:06 |
*** openstack changes topic to "New Blueprints (fast-style!) (Meeting topic: glance)" | 14:06 | |
markwash | Is anyone in interested in checking the sanity of a few blueprints this week? | 14:07 |
flaper87 | o/ | 14:07 |
markwash | specifically to help out marking them as approved | 14:07 |
jbresnah | sure, any in particular? | 14:07 |
iccha | i thought we already though cross id was sane | 14:07 |
flaper87 | jbresnah: dude, you're awake | 14:07 |
flaper87 | T_T | 14:07 |
*** mclaren has joined #openstack-meeting-alt | 14:07 | |
flaper87 | go to sleep | 14:07 |
markwash | first there is | 14:07 |
flaper87 | :P | 14:07 |
markwash | #link https://blueprints.launchpad.net/glance/+spec/ability-to-separate-snapshots-and-images | 14:07 |
jbresnah | flaper87: partially | 14:07 |
markwash | second there is | 14:08 |
markwash | #link https://blueprints.launchpad.net/glance/+spec/cross-service-request-id | 14:08 |
*** cp16net|away is now known as cp16net | 14:08 | |
flaper87 | markwash: there's a thread in the mailing list about the cross-service-... | 14:08 |
markwash | and as a third option there is | 14:08 |
markwash | #link https://blueprints.launchpad.net/glance/+spec/use-oslo-common-db-code | 14:08 |
rosmaita | first one: can this just be done with metadata and the back end sorts things out? | 14:09 |
* markwash looks | 14:09 | |
flaper87 | I'll take the last one | 14:09 |
flaper87 | :D | 14:09 |
*** DuncanT has joined #openstack-meeting-alt | 14:09 | |
markwash | rosmaita: possibly | 14:09 |
jbresnah | markwash: I put out comments on the first 2 | 14:09 |
ameade | are we talking about the 1st one yet? | 14:10 |
rosmaita | because there are a lot more use cases than just RAID level | 14:10 |
ameade | or all of them at once :P | 14:10 |
jbresnah | i think the second is a solid idea, and seems to be going on in other OS projects | 14:10 |
iccha | +1 jbresnah | 14:10 |
flaper87 | jbresnah: it is | 14:10 |
markwash | +1 jbresnah | 14:10 |
rosmaita | +1 jbresnah | 14:10 |
markwash | it looks like we have plenty of interest | 14:11 |
jbresnah | so i would say we can call the second one approved | 14:11 |
flaper87 | hahaha | 14:11 |
flaper87 | :D | 14:11 |
markwash | I think the task here for each one is either to get more feedback, or to just yell at me to approve it | 14:11 |
markwash | yeah +1 I'm approving the request id one now | 14:11 |
ameade | +1 on the 2nd, am I crazy markwash or didn't we implement that together a long time ago? | 14:11 |
markwash | yeah I thought we did :-) | 14:11 |
markwash | okay looks good for new bps | 14:13 |
zhiyan1 | seems use-oslo-common-db-code is good to approval also, marwash? | 14:13 |
zhiyan1 | sorry, markwash | 14:13 |
markwash | no worries! | 14:13 |
markwash | the oslo-common-db-code one is still a little unclear to me | 14:13 |
flaper87 | zhiyan1: I'd like to have more info about that one | 14:13 |
flaper87 | how he's planning to do it | 14:13 |
flaper87 | the impact | 14:13 |
markwash | I'm hesitant about "common db" code because glance is very coupled to its schema still | 14:13 |
iccha | yeah what implications it entails | 14:13 |
zhiyan1 | is those code ready in oslo? | 14:13 |
markwash | and I don't want us to suddenly be very coupled with all the other projects schema as well | 14:13 |
zhiyan1 | i'm not sure for that | 14:13 |
flaper87 | zhiyan1: yup, most of it | 14:13 |
mclaren | markwash: also if we want to look at zero downtime with glance it may complicate it? | 14:14 |
zhiyan1 | ok, just port code and landing down to glance, right? .. | 14:14 |
mclaren | ie with glance first | 14:14 |
markwash | mclaren: o/ ! | 14:14 |
flaper87 | TBH, that one sounds more like Ith release to me, but I'll get more feedback | 14:14 |
markwash | zhiyan1: it just may not be the right idea yet | 14:14 |
zhiyan1 | flaper87: goot it | 14:14 |
markwash | #topic Blueprints in progress | 14:15 |
*** openstack changes topic to "Blueprints in progress (Meeting topic: glance)" | 14:15 | |
zhiyan1 | seems, we need feedback to make sure it work well then to landing :) | 14:15 |
markwash | jbresnah, want to talk about multiple locations? | 14:15 |
jbresnah | yeah | 14:15 |
ameade | did we ever decide on bp #1? | 14:15 |
markwash | ameade, no, I think some folks were going to look into it more closely? | 14:15 |
markwash | should I have actioned somebody? | 14:15 |
jbresnah | markwash: i put a question on it | 14:16 |
flaper87 | markwash: me for #3 | 14:16 |
jbresnah | i can chase it a bit more, but maybe i can talk it out with ameade first | 14:16 |
*** djohnstone has joined #openstack-meeting-alt | 14:16 | |
jbresnah | i may be missing the intention | 14:16 |
markwash | #action flaper87 evaluate use-oslo-common-db-code | 14:16 |
markwash | #action jbresnah continue evaluating ability-to-separate-snapshots-and-images once there is feedback | 14:17 |
markwash | seems like we're good | 14:17 |
markwash | others feel free to participate in those | 14:17 |
jbresnah | cool | 14:18 |
* markwash yields to jbresnah about multiple locations | 14:18 | |
zhiyan1 | jbresnah, could you pls talk about multiple locations? i really need it | 14:18 |
zhiyan1 | :) | 14:18 |
jbresnah | i have a patch out there that i added comments to | 14:18 |
jbresnah | i have not had a chance yet to see if anyone replied | 14:19 |
jbresnah | has anyone had a chance to see it? | 14:19 |
zhiyan1 | https://review.openstack.org/#/c/30517/ ? | 14:19 |
jbresnah | no, i abandoned that | 14:19 |
zhiyan1 | yes, which one? sorry | 14:19 |
jbresnah | https://review.openstack.org/#/c/31591/ | 14:19 |
jbresnah | markwash had thoughts on how to do it with PATCH | 14:20 |
markwash | jbresnah: ah, good point about the restriction of multiple slashes | 14:20 |
jbresnah | which i agree with | 14:20 |
zhiyan1 | cool, i will check it later | 14:20 |
jbresnah | just need to finalize the API | 14:20 |
jbresnah | i also have: | 14:20 |
markwash | I originally put in that restriction because I thoguht json-pointer was a bit much to implement | 14:20 |
jbresnah | https://review.openstack.org/#/c/31306/ | 14:20 |
markwash | I think we could remove the restriction now but it might take some more code | 14:20 |
jbresnah | markwash: is it openstack policy tho? | 14:21 |
jbresnah | | http://docs.openstack.org/api/openstack-image-service/2.0/content/restricted-json-pointers.html | 14:21 |
markwash | jbresnah: no no, I just wrote that as a CYA kind of thing | 14:21 |
jbresnah | i could hard code a special case for /locations/ somewhat easily | 14:21 |
jbresnah | heh ok | 14:21 |
markwash | the new format would be backwards compatible | 14:21 |
markwash | so I think this is all great progress | 14:22 |
markwash | and I'll keep reviewing! | 14:22 |
*** lastidiot has joined #openstack-meeting-alt | 14:22 | |
jbresnah | markwash: so should i loosen the restriction? | 14:22 |
markwash | jbresnah: yes I think so | 14:22 |
jbresnah | in the general case? | 14:22 |
markwash | jbresnah: that would be okay but we probably have to put in some code restrictions to make sure most properties can only be strings | 14:23 |
markwash | I don't think we want to support requests that add user properties that are lists or json objects | 14:23 |
jbresnah | actually i ran into something with that yesterday | 14:23 |
jbresnah | i think there are restrictions there | 14:23 |
*** xwizard has quit IRC | 14:23 | |
markwash | okay cool | 14:23 |
jbresnah | i was trying to implement the last way, where the list is changed all at once | 14:24 |
*** djohnstone has quit IRC | 14:24 | |
zhiyan1 | one sample question jbresnah, is this 'remove: [{"remove": "add", "path": "/locations", "value": <url>}]' should be this 'remove: [{"op": "remove", "path": "/locations", "value": <url>}]' ? | 14:24 |
jbresnah | and errors come back saying it can only be a string, i didn't get far into it | 14:24 |
markwash | lets talk about it later today in #openstack-glance | 14:24 |
jbresnah | cool | 14:24 |
mclaren | dumb question: do these locations contain credentials? if so do they pick up the metadata_encryption setting? | 14:24 |
jbresnah | zhiyan1: yeah that seems right | 14:24 |
markwash | mclaren: I think they should pick up the encryption setting | 14:24 |
mclaren | thx | 14:25 |
jbresnah | mclaren: yeah they should | 14:25 |
markwash | some of that should have already been done maybe? but I'll check again | 14:25 |
*** djohnstone has joined #openstack-meeting-alt | 14:25 | |
markwash | so folks should keep reviewing multiple locations code | 14:25 |
zhiyan1 | markwash: could you pls show me the url about metadata_encryption ? | 14:25 |
jbresnah | mclaren: they could contain such info, that is up to the admin adding the location | 14:25 |
jbresnah | mclaren: we sort of changed the approach and there is a bit of a buyer-beware attitude with this one | 14:26 |
mclaren | gotcha | 14:26 |
* flaper87 needs to dig more into multiple-locations | 14:26 | |
markwash | zhiyan1: can you remind me after the meeting? I'll dig around and find it | 14:26 |
jbresnah | zhiyan1: at some point i would like to talk to you about your interest in this bp | 14:26 |
zhiyan1 | sure | 14:26 |
jbresnah | zhiyan1: cool, i want to make sure i am addressing all needs | 14:26 |
markwash | anything else on multiple locations? next is glance-cinder-driver | 14:27 |
zhiyan1 | yes, for glance-cinder-store, if you checked https://etherpad.openstack.org/linked-template-image , there are some dependencies for implementation, and all about cinder: attach volume to host / direct volume IO. | 14:27 |
jbresnah | markwash: i think that is good for here, just some follow up convos | 14:27 |
*** npasqua has quit IRC | 14:27 | |
zhiyan1 | so, i dont want to blocked from that, can can dev now...so, i have talked a lot of glance-cinder-store before with mark :) , and seems there a three choice for me.. | 14:27 |
zhiyan1 | A simple approach: | 14:28 |
zhiyan1 | 1) upload image to glance non-cinder store | 14:28 |
zhiyan1 | 2) tell cinder to create a volume from that image | 14:28 |
zhiyan1 | 3) register the image to cinder store, use image id (from step 1) + volume id (from step 2) as the location | 14:28 |
zhiyan1 | (each step is a separate api call) | 14:28 |
zhiyan1 | B. multi-locations approach | 14:28 |
zhiyan1 | C. final solution | 14:28 |
zhiyan1 | after cinder have a pretty method to support attach volume to host / direct volume io (base on 'brick'/cinder-agent, in H3 or I1), i will change the cinder store driver to read/write image data from remote volume driectly but not separate handling.. | 14:28 |
*** amytron has joined #openstack-meeting-alt | 14:29 | |
markwash | cool | 14:29 |
markwash | in the multi locations approach | 14:29 |
zhiyan1 | :), so jbresnah: i'm just now sure about #B | 14:29 |
markwash | the idea is that you create the image with a non-cinder store | 14:30 |
markwash | then ask cinder to create a volume from it | 14:30 |
zhiyan1 | how to let glance-cinder-store match your plan? or any thoughts/comments? | 14:30 |
markwash | and then register the cinder volume as a location on the image | 14:30 |
zhiyan1 | markwash: yes, that of #A plan | 14:30 |
markwash | the caveat is that the cinder store location would *not* support getting image data directly | 14:30 |
iccha | so B is an improvement over approach A ? with addition pf multiple locations? | 14:30 |
markwash | zhiyan1: I thought I was describing plan B | 14:31 |
zhiyan1 | iccha: i think, yes | 14:31 |
zhiyan1 | yes, pls | 14:31 |
*** amytron has quit IRC | 14:31 | |
*** lastidiot has quit IRC | 14:31 | |
jbresnah | i do not quite have my head around this yet, sorry | 14:31 |
flaper87 | mmh, cinder-store changes how glance's stores work, IMHO. I'm not fully against it but we need to figure it out a bit better | 14:31 |
iccha | who will ask cinder to create volume from glance? is it glance or user? | 14:32 |
*** amytron has joined #openstack-meeting-alt | 14:32 | |
zhiyan1 | api user | 14:32 |
flaper87 | My first comment is that multiple-locations is a must for it to happen - assuming I got the idea right. | 14:32 |
jbresnah | does cinder act as a glance client at that point or does it have special privledges? | 14:33 |
markwash | flaper87: yeah, thats my concern as well. it seems strange to have a location that you can't really "get" | 14:33 |
flaper87 | can the cinder location be a property of the image? | 14:33 |
zhiyan1 | flaper87: yes, yes, i'd like address C# plan directly , but i check with cinder team from two weekly meeting, not sure there is a clear plan to address what i/cinder-store need | 14:33 |
markwash | flaper87: but I think it could be fine if we figure out a clean way to do it | 14:33 |
flaper87 | instad of a separate store ? | 14:33 |
flaper87 | instead* | 14:33 |
jbresnah | markwash: why can you not get it? | 14:33 |
markwash | flaper87: yes, actually it can be a property of the image, in the form of a block device mapping property | 14:34 |
markwash | jbresnah: because the only way to get it right now is to attach the volume as a device directly to the glance api host | 14:34 |
*** Riddhi has joined #openstack-meeting-alt | 14:34 | |
flaper87 | markwash: that makes more sense to me than having a separate store | 14:34 |
markwash | which may be okay too, but feels super squicky to me | 14:34 |
zhiyan1 | jbresnah:cinder volume as a image, so it's glance's client. but i don't think there's a special privledges for cinder.. | 14:34 |
jbresnah | is the end use case so nova can find a volume to boot via glance? | 14:35 |
flaper87 | jbresnah: think so | 14:35 |
markwash | jbresnah: basically | 14:35 |
flaper87 | ok, I got it right then | 14:35 |
*** Riddhi has quit IRC | 14:35 | |
jbresnah | so someone can 'get' the volume? | 14:35 |
iccha | would the cinder store know that this image exists in glance other stores? or does glance become central point of authoirty over images/volume images now? | 14:35 |
markwash | I think there is a constraint that the image should be bootable the "normal" way too | 14:35 |
jbresnah | it just depends on where they are and what they can do? | 14:35 |
markwash | iccha: in proposal B, glance stores the info in the locations table, cinder just treats the volume as usual | 14:36 |
markwash | jbresnah: well, they can't download it through the http api | 14:37 |
flaper87 | markwash: iccha wich I think makes more sense | 14:37 |
jbresnah | markwash: oh i see, so if it is the only location then it changes glance's assumed functionality | 14:37 |
markwash | jbresnah: right | 14:37 |
markwash | so maybe we just make it explicit that stores that can't download can't be the only locations ? | 14:38 |
markwash | wow I failed at explicit I think | 14:38 |
flaper87 | lol | 14:38 |
markwash | images must have at least one location that can be downloaded from to be active | 14:38 |
markwash | that is fewer negatives | 14:38 |
iccha | should we have additional info along with location to indicate store type or downloadable or not kind of information? | 14:38 |
jbresnah | i think this is a fallout from the marriage of registry/replica service and data transfer service | 14:38 |
flaper87 | I think this shouldn't be used as a store and that services consuming images should check if the image has a "volume" property | 14:39 |
jbresnah | i dont see it as horrible to have a EWECANTSERVETHATDATA | 14:39 |
zhiyan1 | markwash: we need keep forward-compatible i think, need support download, so justa localtion is not ok | 14:39 |
jbresnah | ... i probably should have used spaces | 14:39 |
markwash | haha | 14:39 |
markwash | zhiyan1: it seems so strange though for people to want to download a volume from glance | 14:40 |
iccha | it might be ok to image info which locations you cant download from as long as there is a way to indicate downloadable locations vs not volumes etc | 14:40 |
iccha | because glance is image registry service basically right | 14:40 |
jbresnah | so far i like having it as just another location, and throwing an error if you try to download it with only that location available | 14:40 |
*** qwerty_nor has joined #openstack-meeting-alt | 14:40 | |
jbresnah | but i think i need to understand hte nova use case better | 14:40 |
esheffield | +1 jbresnah | 14:40 |
*** Riddhi has joined #openstack-meeting-alt | 14:41 | |
jbresnah | iccha: yeah there should be a way to check if something is available for download | 14:41 |
jbresnah | how does nova boot from a volume now? a specific flag saying use thing volume ID instead of an image ID? | 14:42 |
markwash | something like that, but I don't recall exactly | 14:42 |
flaper87 | I don't think that just throwing an error when trying the service tries to download the image is good enough | 14:42 |
jbresnah | and is the idea to make it always an image ID and pick the volume from that image ID in certain cases? | 14:42 |
zhiyan1 | jbresnah: this change not cover boot-from-volume, client need give volume id | 14:42 |
flaper87 | the location should contain that info, somehow | 14:42 |
mclaren | have we considered a /volumes resource? | 14:43 |
jbresnah | i am confused because a volume boot has such different semantics over an image | 14:43 |
jbresnah | so nova couldnt just pick a volume from glance without the use specifically saying to | 14:43 |
markwash | mclaren: not that I know of | 14:43 |
jbresnah | so i think i dont get the use case | 14:44 |
markwash | should we maybe have a followup discussion? | 14:44 |
markwash | give folks more time to prepare? | 14:44 |
flaper87 | markwash: +1 | 14:44 |
markwash | okay cool | 14:44 |
iccha | +1 | 14:44 |
zhiyan1 | ok, thanks | 14:44 |
markwash | #action markwash schedule a followup meeting about the cinder store (at a time that is convenient to zhiyan please!) | 14:44 |
markwash | There were several other ongoing blueprints | 14:45 |
zhiyan1 | thanks guys :) | 14:45 |
flaper87 | zhiyan1: thank you | 14:45 |
markwash | #topic async processing | 14:45 |
*** openstack changes topic to "async processing (Meeting topic: glance)" | 14:45 | |
markwash | I added a random assortment of ideas in code https://review.openstack.org/#/c/31874/1 | 14:45 |
markwash | let me know if you want me to add you as a reviewer, it is a draft so its restricted | 14:45 |
flaper87 | markwash: I commented on that draft few minutes ago | 14:46 |
markwash | and also its pretty unclear still how some important parts would work | 14:46 |
markwash | cool! | 14:46 |
ameade | markwash: add meh | 14:46 |
esheffield | markwash: I'd like to see that too | 14:46 |
zhiyan1 | markwash, pls add me? | 14:47 |
markwash | sure | 14:47 |
rosmaita | and me and nikhil | 14:47 |
nikhil | +1 | 14:47 |
markwash | nikhil is on it | 14:47 |
mclaren | markwash: me too if you can, thanks | 14:47 |
markwash | okay I'm going to resubmit it as not a draft :-) | 14:47 |
nikhil | I see that it's giving read only error in gerrit markwash | 14:47 |
markwash | and jenkins can just deal | 14:47 |
nikhil | thanks | 14:47 |
flaper87 | markwash: or, you could charge $10 for adding folks | 14:47 |
markwash | haha | 14:48 |
flaper87 | :D | 14:48 |
nikhil | or just link us to ur github branch ? | 14:48 |
markwash | #topic documentation | 14:48 |
*** openstack changes topic to "documentation (Meeting topic: glance)" | 14:48 | |
nikhil | markwash: ^^ | 14:48 |
markwash | iccha, esheffield updates about docs | 14:48 |
markwash | ? | 14:48 |
iccha | https://etherpad.openstack.org/glance_v1_vs_v2 | 14:48 |
markwash | looks like new stuff at the top? | 14:48 |
iccha | the top part of etherpad has list of places where glance / image services documentation resides and how out of date/ missing info/incorrect info is listed | 14:49 |
markwash | #link https://etherpad.openstack.org/glance_v1_vs_v2 | 14:49 |
*** Ekaterina_F has joined #openstack-meeting-alt | 14:49 | |
iccha | and also what the new documentation may need | 14:49 |
markwash | looks pretty good! | 14:49 |
zhiyan1 | yes,yes, seems good | 14:50 |
iccha | the basic skeletal work of v1 vs v2 exists below, would be great to have ppl add in any info missed, or any other quirks or differences they have noticed in v2 vs v1 for ppl who would like to switch to be aware of | 14:50 |
jbresnah | iccha: for v2 update it would be nice to see something about how "Content-Type: application/openstack-images-v2.0-json-patch and "Content-Type: application/openstack-images-v2.1-json-patch differ | 14:50 |
markwash | I'll review that some more and then maybe we can figure out which thing we want to do next | 14:50 |
zhiyan1 | shall we push some encoding hits to the doc? | 14:51 |
zhiyan1 | probable somebady use non-ascii code string as the properties or some fields :) | 14:51 |
iccha | yes sure feel free to add anything you think which should be there | 14:51 |
iccha | this is a very rough repository of all our collective knowledge | 14:51 |
markwash | jbresnah: yeah hmm.. we should really push people in the direction of v2.1 and just ask that they never think about v2.0 if possible | 14:51 |
markwash | hmm | 14:52 |
flaper87 | lol | 14:52 |
markwash | v2.0 was compatible with draft 03 of the json-patch spec | 14:52 |
markwash | v2.1 is compatible with the approved rfc version | 14:52 |
markwash | 6902 I think? | 14:52 |
iccha | jbresnah: that ll be great to add , are u volunteering to add it to etherpad :p | 14:52 |
markwash | :-D | 14:52 |
flaper87 | iccha: he is | 14:52 |
flaper87 | :D | 14:52 |
jbresnah | iccha: heh, i would but i asked because i need to learn the differences! | 14:52 |
markwash | #topic import export clone | 14:52 |
*** openstack changes topic to "import export clone (Meeting topic: glance)" | 14:52 | |
markwash | rosmaita: a little bit of time. . . | 14:53 |
rosmaita | ok, thanks, i think we're mostly agreed that a new resource is ok | 14:53 |
rosmaita | so post to /images/actions and get back a location | 14:53 |
rosmaita | like /images/actions/UUID | 14:53 |
rosmaita | then you poll the UUID | 14:53 |
rosmaita | what you get back ... | 14:53 |
*** Ekaterina_F has quit IRC | 14:54 | |
rosmaita | depends on what was in your request, something like { "import" : "stuff" } | 14:54 |
rosmaita | likewise for export, clone | 14:54 |
rosmaita | and what you get when you poll the UUID coudl be different too | 14:54 |
rosmaita | that's actually my quyestions | 14:54 |
zhiyan1 | rosmaia: actually, i really not get the benefits from upload/download to import/export :) sorry for that, i have checked your wiki, but .. | 14:55 |
nikhil | +1 | 14:55 |
nikhil | rosmaita: +1 | 14:55 |
rosmaita | in nova actions, there are 9, 7 dont return bodies | 14:55 |
markwash | rosmaita: I had some thoughts in code about what an action would look like | 14:55 |
rosmaita | the 2 that do return different bodies | 14:55 |
rosmaita | markwash: cool | 14:55 |
markwash | should be able to see it here in https://review.openstack.org/#/c/31874/1 now | 14:55 |
*** tanisdl has joined #openstack-meeting-alt | 14:56 | |
esheffield | rosmaita: is the UUID basically an action identifier or the UUID of the image on which the action was taken? I assume the former? | 14:56 |
rosmaita | action identifier | 14:56 |
nikhil | markwash: yeah | 14:57 |
nikhil | thanks | 14:57 |
markwash | zhiyan1: the main benefit is that upload directly sets the data with no modifications | 14:57 |
markwash | zhiyan1: import and export allow the format to change or for other lengthy processing to take place | 14:57 |
rosmaita | zhiyan1: have u seen the mailing list discussion? | 14:58 |
zhiyan1 | yes, but not catch them... | 14:58 |
zhiyan1 | week ago, right? | 14:58 |
markwash | (2 minutes left) | 14:58 |
rosmaita | right | 14:58 |
flaper87 | :( | 14:58 |
zhiyan1 | sorry, rosmaita, seems i need pick it up :( | 14:58 |
rosmaita | zhiyan1: we cna talk in openstack-glance after mtg if you like | 14:58 |
markwash | flaper87: did I skip you? | 14:59 |
zhiyan1 | goood :) thanks rosmaita. | 14:59 |
flaper87 | markwash: yup, registry-driver :D | 14:59 |
markwash | #topic registry driver | 14:59 |
*** openstack changes topic to "registry driver (Meeting topic: glance)" | 14:59 | |
zhiyan1 | :) 30s | 14:59 |
markwash | I don't *think* there is anyone after us | 14:59 |
flaper87 | very quick, I'd love some feedback about this: http://lists.openstack.org/pipermail/openstack-dev/2013-June/009839.html | 14:59 |
markwash | and won't turn into a pumpkin for another hour | 14:59 |
* ameade secretly just watched said disney movie | 15:00 | |
flaper87 | the driver is *almost* done, I need to finish some tests that are being blocked by the fact that we don't have a way to deserialize datetimes | 15:00 |
markwash | russelb seemed to be poo-poo-ing that for some reason | 15:00 |
jbresnah | heh ameade | 15:01 |
zhiyan1 | yes, you means primitive call right? | 15:01 |
flaper87 | so, I was thinking we could do something like nova does (convert strtime into datetime in the db_api function) | 15:01 |
markwash | in json, it seems like datetimes should be objects that self-identify somehow | 15:01 |
flaper87 | markwash: some reason that 1) I still don't get 2) I disagree with what I got | 15:01 |
markwash | flaper87: nod | 15:02 |
flaper87 | I don't think we need to define new models just to serialize / deserialize datetimes (which is what he's suggesting | 15:02 |
flaper87 | the other thing, that implementation won't land 'til H-3 | 15:02 |
flaper87 | which is bad for us | 15:02 |
*** tanisdl has quit IRC | 15:02 | |
flaper87 | so, my suggestions are: 1) Implement datetime deserialization 2) do it in the sqlalchemy driver when needed | 15:02 |
flaper87 | #2 is the easiest | 15:03 |
flaper87 | but not the best, IMHO | 15:03 |
flaper87 | that's just a workaround | 15:03 |
markwash | so do you want feedback on the ML or here or some other way? | 15:03 |
ameade | i can't figure why a strtime would be getting to the sqlalchemy layer | 15:03 |
ameade | but i haven't been paying much attention to this | 15:03 |
flaper87 | both work for me, but if we do it in the m-l we better make sure to find a consensus | 15:04 |
ameade | oh rpc stuff right? | 15:04 |
markwash | flaper87: then I better just talk to you in #openstack-glance :-) | 15:04 |
*** lastidiot has joined #openstack-meeting-alt | 15:04 | |
flaper87 | markwash: +1 | 15:04 |
flaper87 | ameade: yup rpc stuff | 15:04 |
flaper87 | :( | 15:05 |
markwash | #topic quick open discussion | 15:05 |
*** openstack changes topic to "quick open discussion (Meeting topic: glance)" | 15:05 | |
flaper87 | I mean, :) | 15:05 |
flaper87 | :D | 15:05 |
flaper87 | can I say, We rock ? | 15:05 |
flaper87 | ok, I said it | 15:05 |
markwash | does this meeting time work out okay? | 15:05 |
ameade | flaper87: we should just have all the services on one node :P | 15:05 |
markwash | we had mclaren and zhiyan so that part was great | 15:05 |
ameade | markwash: +1 | 15:05 |
mclaren | this time is great for me | 15:05 |
iccha | yup i agree good to have eveyrone included | 15:05 |
nikhil | +1 | 15:05 |
zhiyan1 | :) | 15:06 |
* flaper87 thinks that jbresnah felt asleep again | 15:06 | |
markwash | jbresnah: can you deal with this once every two weeks? | 15:06 |
flaper87 | works for me, though | 15:06 |
ameade | i dunno about having everyone here but the time is good | 15:06 |
ameade | :P | 15:06 |
markwash | haha | 15:06 |
flaper87 | ameade: lol | 15:06 |
rosmaita | +1 | 15:06 |
markwash | okay cool, Imma call it | 15:06 |
jbresnah | markwash: yeah probably | 15:06 |
markwash | :-) | 15:06 |
ameade | peace out | 15:06 |
markwash | #endmeeting | 15:07 |
*** openstack changes topic to "OpenStack meetings (alternate)" | 15:07 | |
openstack | Meeting ended Thu Jun 6 15:07:02 2013 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:07 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/glance/2013/glance.2013-06-06-14.01.html | 15:07 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/glance/2013/glance.2013-06-06-14.01.txt | 15:07 |
openstack | Log: http://eavesdrop.openstack.org/meetings/glance/2013/glance.2013-06-06-14.01.log.html | 15:07 |
flaper87 | w00000000t | 15:07 |
markwash | next week meeting will be at the other time | 15:07 |
flaper87 | kk | 15:08 |
zhiyan1 | ok | 15:08 |
*** flaper87 has left #openstack-meeting-alt | 15:08 | |
*** tanisdl has joined #openstack-meeting-alt | 15:09 | |
*** bdpayne has joined #openstack-meeting-alt | 15:32 | |
*** mclaren has quit IRC | 15:41 | |
*** djohnstone has quit IRC | 15:57 | |
*** djohnstone has joined #openstack-meeting-alt | 15:59 | |
*** Riddhi_ has joined #openstack-meeting-alt | 16:00 | |
*** tanisdl has quit IRC | 16:01 | |
*** Riddhi_ has quit IRC | 16:01 | |
*** Riddhi has quit IRC | 16:03 | |
*** Riddhi has joined #openstack-meeting-alt | 16:06 | |
*** IlyaE has joined #openstack-meeting-alt | 16:06 | |
*** tanisdl has joined #openstack-meeting-alt | 16:08 | |
*** dnosovit1ky has quit IRC | 16:13 | |
*** djohnstone has quit IRC | 16:30 | |
*** djohnstone has joined #openstack-meeting-alt | 16:30 | |
*** djohnstone has quit IRC | 16:33 | |
*** cp16net is now known as cp16net|away | 16:33 | |
*** djohnstone has joined #openstack-meeting-alt | 16:34 | |
*** johnthetubaguy has quit IRC | 16:37 | |
*** johnthetubaguy has joined #openstack-meeting-alt | 16:37 | |
*** akuznetsov has quit IRC | 16:40 | |
*** tanisdl_ has joined #openstack-meeting-alt | 16:45 | |
*** saurabhs has joined #openstack-meeting-alt | 16:45 | |
*** tanisdl has quit IRC | 16:47 | |
*** tanisdl_ is now known as tanisdl | 16:47 | |
*** IlyaE has quit IRC | 16:56 | |
*** cp16net|away is now known as cp16net | 17:04 | |
*** esp has joined #openstack-meeting-alt | 17:09 | |
*** Nikita has joined #openstack-meeting-alt | 17:10 | |
*** Nikita has quit IRC | 17:10 | |
*** esp has left #openstack-meeting-alt | 17:11 | |
*** nkonovalov has joined #openstack-meeting-alt | 17:12 | |
*** zhiyan1 has quit IRC | 17:18 | |
*** johnthetubaguy has quit IRC | 17:19 | |
*** dmitryme has joined #openstack-meeting-alt | 17:20 | |
*** HenryG has quit IRC | 17:27 | |
*** susanne-balle has joined #openstack-meeting-alt | 17:27 | |
*** johnthetubaguy has joined #openstack-meeting-alt | 17:28 | |
*** Riddhi has quit IRC | 17:33 | |
*** pcm__ has quit IRC | 17:34 | |
*** mestery_ is now known as mestery | 17:36 | |
*** pcm___ has joined #openstack-meeting-alt | 17:36 | |
*** Riddhi has joined #openstack-meeting-alt | 17:38 | |
*** BalleS_ has joined #openstack-meeting-alt | 17:41 | |
*** Riddhi has quit IRC | 17:43 | |
*** susanne-balle has quit IRC | 17:44 | |
*** dhellmann has joined #openstack-meeting-alt | 17:45 | |
*** kagan has joined #openstack-meeting-alt | 17:45 | |
*** Nadya has joined #openstack-meeting-alt | 17:57 | |
*** mattf has joined #openstack-meeting-alt | 17:58 | |
*** IlyaE has joined #openstack-meeting-alt | 17:58 | |
*** aignatov2 has joined #openstack-meeting-alt | 18:00 | |
SergeyLukjanov | Hi everyone | 18:02 |
SergeyLukjanov | Savanna meeting will start in 5 minutes | 18:02 |
*** jmaron has joined #openstack-meeting-alt | 18:04 | |
SergeyLukjanov | Should we wait for someone? | 18:04 |
Nadya | I think we'll start in 1 min | 18:05 |
jmaron | John and Erik will not be joining today, if that's who you are waiting for... | 18:05 |
Nadya | oh, ok | 18:05 |
SergeyLukjanov | jmaron, yep, thank you | 18:05 |
SergeyLukjanov | I think we can start | 18:05 |
Nadya | #startmeeting | 18:06 |
openstack | Nadya: Error: A meeting name is required, e.g., '#startmeeting Marketing Committee' | 18:06 |
Nadya | #startmeeting savanna | 18:06 |
openstack | Meeting started Thu Jun 6 18:06:09 2013 UTC. The chair is Nadya. Information about MeetBot at http://wiki.debian.org/MeetBot. | 18:06 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 18:06 |
*** openstack changes topic to " (Meeting topic: savanna)" | 18:06 | |
openstack | The meeting name has been set to 'savanna' | 18:06 |
*** akuznetsov has joined #openstack-meeting-alt | 18:06 | |
Nadya | here is our agenda for today: | 18:06 |
Nadya | 1. Action items from previous meeting | 18:07 |
Nadya | 2. Updates | 18:07 |
Nadya | 3. convert() method | 18:07 |
Nadya | 4. IP discovery | 18:07 |
Nadya | #topic Action items | 18:08 |
*** openstack changes topic to "Action items (Meeting topic: savanna)" | 18:08 | |
Nadya | So, we had the following: | 18:08 |
Nadya | ACTION: ruhe add more details to savanna-dashboard blueprint (nprivalova, 18:52:38) | 18:08 |
Nadya | ACTION: SergeyLukjanov to update pluggable provisioning mechanism CR with latest ctx vision (SergeyLukjanov, 18:53:00) | 18:08 |
Nadya | ACTION: EricB create bp for Ambari (nprivalova, 18:56:43) | 18:08 |
Nadya | Sergey L, please update | 18:08 |
SergeyLukjanov | yep, thank you | 18:08 |
*** Riddhi has joined #openstack-meeting-alt | 18:08 | |
*** highlycaffeinate has joined #openstack-meeting-alt | 18:09 | |
SergeyLukjanov | ok, we are working on the core part and I think that the beta version will be available tomorrow | 18:09 |
SergeyLukjanov | oh, actions update) | 18:09 |
SergeyLukjanov | sorry | 18:09 |
SergeyLukjanov | we was added details to BPs (links to mockups) | 18:10 |
Nadya | it is usefull info, anyway :) | 18:10 |
SergeyLukjanov | and I think that info about beta version of core part is actual for this question | 18:10 |
jmaron | ctx updates? | 18:10 |
*** Riddhi has quit IRC | 18:11 | |
*** ruhe has joined #openstack-meeting-alt | 18:11 | |
SergeyLukjanov | aignatov send the letter with some details about using helpers | 18:11 |
SergeyLukjanov | ctx is partially implemented currently | 18:11 |
jmaron | ah..ok | 18:11 |
aignatov2 | I'v just replied on your question, jon | 18:11 |
SergeyLukjanov | if you have some specific question, you're welcome :) | 18:11 |
*** Riddhi has joined #openstack-meeting-alt | 18:11 | |
SergeyLukjanov | additionally, I think that we can make a call between me and plugin writer to discuss some things | 18:12 |
Nadya | We saw that Eric publiched blueprint so let`s move on | 18:12 |
SergeyLukjanov | I mean integration we the core part | 18:12 |
jmaron | ok | 18:13 |
Nadya | #topic Updates | 18:13 |
*** openstack changes topic to "Updates (Meeting topic: savanna)" | 18:13 | |
Nadya | Alex I, please update | 18:14 |
aignatov2 | ok, I'm working on vanilla plugin implementation | 18:14 |
aignatov2 | it's draft version on gerrit | 18:14 |
aignatov2 | you can observe it | 18:15 |
aignatov2 | #link https://review.openstack.org/#/c/31532/ | 18:15 |
SergeyLukjanov | it could be used as an example of using tools | 18:15 |
aignatov2 | jon, regarding your question, in my implemntation i'm operating only with cluster object | 18:16 |
SergeyLukjanov | generally, there is no need to directly operate with context write know | 18:16 |
jmaron | remind me which question that was? ;) | 18:16 |
jmaron | oh…ok. now I understand. | 18:16 |
aignatov2 | Plugin Context object thread in savanna-all | 18:17 |
Nadya | From my side: I'm preparing HOWTO document about Hadoop-Swift integration. Will start to work on Savanna integration tomorrow | 18:17 |
aignatov2 | another my update: also we have updated CR about fedora elements | 18:18 |
aignatov2 | there are some issues with installing rpm packages | 18:18 |
SergeyLukjanov | mattf, thank you for contributing there | 18:18 |
ruhe | mattf, did you have a chance to build image with Fedora? | 18:19 |
aignatov2 | packages is not installing properly | 18:19 |
mattf | my pleasure | 18:19 |
mattf | i didn't see the update, i must have fumbled on following the repo | 18:19 |
aignatov2 | just working on it to resolve issues | 18:19 |
ruhe | it's not there yet, we faced some issues, which could be caused by image-builder itself | 18:19 |
aignatov2 | link to CR | 18:20 |
aignatov2 | #link https://review.openstack.org/#/c/31218/ | 18:20 |
SergeyLukjanov | are there any other updates? | 18:20 |
SergeyLukjanov | jmaron, maybe from your side? | 18:20 |
mattf | i didn't complete building a fedora image after i learned you were already working on it | 18:20 |
Nadya | does anyone else have updates? | 18:21 |
mattf | i'll take a look at 31218 | 18:21 |
jmaron | we are progressing well with the ambari plugin. we're at the point where we need to make sure the integration with savanna api is complete and working, hence my questions about setting up a virtual env | 18:21 |
jmaron | and we'll need to migrate some of our functionality to the ctx helpers, though I imagine we could keep some of that as is for the first iteration | 18:22 |
jmaron | (direct use of ssh etc) | 18:22 |
SergeyLukjanov | jmaron, I think we can have a talk with you about it, let's discuss it after the meeting | 18:22 |
aignatov2 | mattf, please feel free to comment it, Ivan sent several questions to diskimage-builder guys, but there is no answeres yet ( | 18:22 |
jmaron | ok | 18:23 |
mattf | aignatov2, have a pointer to the dib questions? | 18:23 |
aignatov2 | one sec | 18:24 |
SergeyLukjanov | here it is | 18:24 |
SergeyLukjanov | #link http://lists.openstack.org/pipermail/openstack-dev/2013-June/009938.html | 18:24 |
Nadya | #topic convert() method | 18:25 |
*** openstack changes topic to "convert() method (Meeting topic: savanna)" | 18:25 | |
Nadya | Sergey L, please | 18:25 |
SergeyLukjanov | mm, I want to take a small story about how we see this functionality | 18:25 |
*** jbresnah has left #openstack-meeting-alt | 18:25 | |
SergeyLukjanov | in todays discussions we are extend templates to include all information from cluster | 18:25 |
aignatov2 | mattf, It will be great to have rhel and/or centos instructions for creating cloud images to work with Savanna | 18:26 |
SergeyLukjanov | so, we want to make user able to create cluster from cluster template specifying only cluster name and user key | 18:26 |
aignatov2 | do you have any thoughts? As I know DIB doesn't support these distros( | 18:26 |
SergeyLukjanov | due to this update it'll be cool if plugins would convert plugin-specific config files to cluster template | 18:26 |
mattf | aignatov2, #link https://github.com/mattf/savanna/blob/RDO-quickstart/doc/source/rdo_quickstart.rst <- first draft of single node setup, rdo has changed a bit recently that's slowed production of the multi-node instructions | 18:27 |
SergeyLukjanov | it provide an absolutely wide flexibility of using them | 18:27 |
SergeyLukjanov | btw cluster template could contain node groups description w/o node groups templates | 18:27 |
mattf | aignatov2, i have dib working on fedora 17 to produce ubuntu savanna images and vanilla fedora images. i had to submit a few patches to dib to get it working. | 18:28 |
Nadya | by the way, we are discussing convert() method for the flow when user wants to create cluster from some configuration file which cannot be parsed by Savana. So it is needed to convert it into Template or cluster object | 18:28 |
SergeyLukjanov | I'll describe it with additional details tomorrow | 18:28 |
SergeyLukjanov | jamaron, do you have any thoughts on adjusting convert to converting config file to cluster template? | 18:28 |
SergeyLukjanov | sorry, jmaron | 18:28 |
jmaron | just so I understand: you are proposing that the convert method be changed from populating the cluster object to actually creating a savanna cluster template? | 18:29 |
SergeyLukjanov | yes, because we want to make cluster templates fully describe cluster | 18:29 |
aignatov2 | mattf, that's really cool instruction. can we add these instruction to the main savanna repo in future? | 18:30 |
mattf | absolutely | 18:30 |
SergeyLukjanov | so, if this cluster template will provide some configs that could be overrided while cluster creation than it will be an additional flexibility | 18:30 |
aignatov2 | great! | 18:30 |
jmaron | once the cluster object is populated, it would be a simple matter for the controller/UI to relate the information in the returned cluster object, the process it goes through to create a cluster object model anyhow | 18:30 |
SergeyLukjanov | and it could provide an ability for users to make some configs changes | 18:30 |
SergeyLukjanov | jmaron, do you have plans to extract some config params from config file to cluster object> | 18:32 |
SergeyLukjanov | ? | 18:32 |
jmaron | whether we are using standard or provider specific templates, remember that both are essentially tied to a specific provider | 18:32 |
SergeyLukjanov | yep, cluster templates are provider-specific too | 18:32 |
SergeyLukjanov | I mean that you can extract some parameter from the provier-specific config | 18:32 |
Nadya | jmaron, have you already started to implement convert()? | 18:32 |
jmaron | that's what convert() does, per the email exchange from a few days ago... | 18:32 |
jmaron | config properties in the provider template are populated into the cluster user_inputs | 18:33 |
SergeyLukjanov | jmaron, I'm very sorry, there are tons of discussions on this topic... | 18:33 |
ruhe | jmaron, convert() reruns cluster object which is essentially the same as cluster template | 18:33 |
jmaron | agreed | 18:34 |
SergeyLukjanov | rune, yes, that's I mean :) | 18:34 |
jmaron | we'd still prefer to return a populated cluster object. persisting the contents of that cluster object into a template is probably an option the UI could support | 18:34 |
ruhe | so, if we make convert() to return cluster template, we don't loose anything. we just get all the features which templates have - user will have a lot of options to view/edit them | 18:35 |
Nadya | jmaron, have you already started to implement convert()? | 18:35 |
jmaron | we've completed it | 18:35 |
SergeyLukjanov | jmaron, I think it'll be clearer to use only one flow for cluster creation - from templates and supporting cluster template creation from provider-specific config file | 18:36 |
SergeyLukjanov | you still can use extra in it | 18:36 |
dmitryme | jmaron, it would be great if you can already share your code | 18:36 |
dmitryme | in that case we could find differences between your and our code earlier | 18:36 |
jmaron | perhaps early next week. we still need to refine some and John, who wrote it, is out for the next couple of days | 18:37 |
SergeyLukjanov | provider-specific templates is in general equals to our cluster templates | 18:37 |
*** markwash_ has joined #openstack-meeting-alt | 18:38 | |
jmaron | I don't understand why we need to return a cluster template rather than a cluster. a template is simply a representation of the cluster object. call __repr__ if you like to get the template out of it. why generate a file as part of the runtime functionality? | 18:39 |
SergeyLukjanov | I think that codebase will not be changed if convert to cluster templates instead of cluster | 18:39 |
ruhe | jmaron, you don't need to generate a file. you only need to generate an object representing cluster template | 18:40 |
*** IlyaE has quit IRC | 18:40 | |
jmaron | which is basically the cluster object! | 18:40 |
SergeyLukjanov | but cluster is an instance of cluster template | 18:41 |
jmaron | so? | 18:41 |
SergeyLukjanov | and user can create cluster template from pconfig file | 18:41 |
*** markwash has quit IRC | 18:41 | |
*** markwash_ is now known as markwash | 18:41 | |
SergeyLukjanov | and then just use it to creating clusters | 18:41 |
jmaron | you want the conversion to occur prior to the creation flow? | 18:41 |
SergeyLukjanov | I think that we should discuss it when you share your code | 18:41 |
SergeyLukjanov | jmaron, yes | 18:42 |
Nadya | jmaron, I see your point. Let`s postpone this discussion, we need to look at code | 18:42 |
ruhe | let's move this conversation to the mailing list or to #savanna | 18:42 |
jmaron | I think we're just confusing the users more. We should be aiming to streamline the flow into a simple "pick your template" whether it's a savanna or provider one, iterate thru the steps, and submit | 18:42 |
SergeyLukjanov | to not create some different flows of cluster creation that could be not clear for end-users | 18:42 |
SergeyLukjanov | I think that it's great that we share that vision with team | 18:43 |
SergeyLukjanov | and let's continue discussions later | 18:43 |
jmaron | I would say we've just added a separate flow (convert your template). the UI can be structured in such a way that the steps are clear and unified | 18:44 |
jmaron | ok | 18:44 |
Nadya | jmaron, will we have 2 different cluster-creatin UI-flow? | 18:44 |
Nadya | jmaron, I understood, 1 flow :) | 18:45 |
SergeyLukjanov | in fact we just want to make some small changes in UI :) | 18:45 |
SergeyLukjanov | but let's go on | 18:45 |
SergeyLukjanov | :) | 18:45 |
Nadya | #topic IP discovery | 18:45 |
*** openstack changes topic to "IP discovery (Meeting topic: savanna)" | 18:45 | |
SergeyLukjanov | I propose the BP for the simple implementation of it | 18:46 |
SergeyLukjanov | here it is | 18:46 |
SergeyLukjanov | #link https://blueprints.launchpad.net/savanna/+spec/ips-discovery-mechanism | 18:46 |
SergeyLukjanov | are there any thoughts on it? | 18:46 |
jmaron | we took a look at that implementation. at the moment that looks acceptable | 18:47 |
rnirmal | why define them again in savanna.. can't they be defined in nova and in savanna just refer to which network maps to management / private and public | 18:47 |
mattf | i've some, but they're incomplete | 18:47 |
rnirmal | and savanna can use the appropriate ips for the instances provided by nova | 18:48 |
jmaron | that's the problem - we've encountered deployments where that private/public distinction isn't clear | 18:48 |
SergeyLukjanov | rnirmal, it's not clear to determine which addresses should be used for different purposes | 18:48 |
mattf | the mananagement ip makes sense if you think about it as = "internal" or "public", not necessarily by itself. i don't think savanna generates enough traffic to warrant its own network | 18:48 |
rnirmal | SergeyLukjanov: well won't that be part of the provider or who ever is setting it up to sync that | 18:49 |
mattf | i'm not bought into the idea of "discovering" via savanna config - it appears it's duplicate config with the authoritative existing in nova-network / quantum | 18:49 |
mattf | i.e. if you change floating ips in nova-network you also have to inform savanna -> leads to complications for admins | 18:49 |
SergeyLukjanov | nova-network/quantum are both doesn't provide an ability to understand which ip is available for user | 18:49 |
mattf | fyi, my current floating range isn't easily expressed as x.y.z/p | 18:50 |
SergeyLukjanov | and which should be used for communication between Hadoop nodes | 18:50 |
mattf | quite possible we should be requesting enhancement in nn/q then | 18:50 |
rnirmal | not sure don't all the ips provided by nova-network or quantum accessible by the user | 18:50 |
*** Riddhi has quit IRC | 18:50 | |
jmaron | that's great and the ideal - but we're seeing deployments where the private, public, float ip distinction isn't made clear via nova and there is reluctance to change the networking | 18:51 |
mattf | i was hoping to look into the ability to tag interfaces, i.e. pub=10.0.0.1,priv=192.168.0.0 on instances, then config savanna to have internal_ip=priv, public_id=pub -- but i haven't had a chance yet | 18:51 |
mattf | rnirmal, that's probably true, it'd be scoped to the tenant, but savanna knows tenant -- that's another good reason to not use savanna config | 18:52 |
mattf | ...you'll end up needing [networks] for each potential tenant? | 18:52 |
SergeyLukjanov | if fact we can demand on networks names or specify networks in savanna | 18:52 |
rnirmal | mattf: agree | 18:52 |
*** markwash has quit IRC | 18:52 | |
mattf | i'm also not clear on why the internal_ip would be added to /etc/hosts | 18:52 |
rnirmal | that would be for name resolution for hadoop I suppose | 18:53 |
dmitryme | rnimal: exactly | 18:53 |
mattf | (fyi, this is all half formed, i was hoping to think it through more before responding on savanna-all) | 18:53 |
jmaron | but don't all those os based solutions assume that the given OS provider is willing to modify their networking to accommodate the solution? | 18:53 |
rnirmal | jmaron: but not sure how defining them within savanna is going to help either | 18:54 |
*** vipul is now known as vipul|away | 18:54 | |
*** vipul|away is now known as vipul | 18:54 | |
jmaron | they have to be defined somewhere | 18:54 |
jmaron | and if you can't control the OS stack | 18:54 |
mattf | jmaron, there's definitely an issue around best practices. if an OS deployment isn't naming interfaces in a consistent / discoverable way, it's hard to do discovery | 18:54 |
jmaron | savanna is your only choice | 18:54 |
rnirmal | nova provides tagged ips as such public=10.127.1.15; private=192.168.0.15 | 18:54 |
jmaron | and that's exactly what we're finding | 18:54 |
rnirmal | or whatever be their names | 18:54 |
SergeyLukjanov | generally, I do not like this approach too, but I have no ideas to implement this functionality... | 18:54 |
jmaron | rnirmal: not in a deployment I saw this week | 18:55 |
rnirmal | and in savanna just map them to what savanna understands as internal and public ips | 18:55 |
SergeyLukjanov | rnirmal, our OS installed in dev lab doesn't provide such tags | 18:55 |
*** flaper87 has joined #openstack-meeting-alt | 18:55 | |
jmaron | neither does the deployment at a customer site | 18:55 |
mattf | and the one in my site is different from jmaron's | 18:55 |
jmaron | and the customer will not change the deployment | 18:55 |
SergeyLukjanov | jmaron, +1 | 18:56 |
aignatov2 | guys, 5 minutes left | 18:56 |
rnirmal | hmm ok so how would you see implementing that within savanna | 18:56 |
mattf | there's still the idea of being able to discover by querying the tenant | 18:56 |
jmaron | with a sub-optimal approach ;) | 18:56 |
jmaron | mattf: I'd need to understand that better | 18:56 |
mattf | i tend to de-dup config, because config is so easy for people to get wrong | 18:57 |
*** Riddhi has joined #openstack-meeting-alt | 18:57 | |
mattf | jmaron, me too | 18:57 |
mattf | it's definitely a complex topic and worthy of some focused time | 18:57 |
rnirmal | :) but on instance create does savanna pass in network info ? | 18:57 |
mattf | +1 SergeyLukjanov for generating a bp so we have a place to discuss, but i'm skeptical w/ the current proposal | 18:57 |
SergeyLukjanov | mattf, can you point us to API that provides info about networks destination? | 18:57 |
*** Riddhi has quit IRC | 18:57 | |
*** malini has joined #openstack-meeting-alt | 18:58 | |
mattf | SergeyLukjanov, not atm, that's what i haven't gotten to yet in forming my understanding | 18:58 |
*** ametts has joined #openstack-meeting-alt | 18:58 | |
ruhe | if there is a way to to get that info about tenant from nova/quantum, it would be great | 18:58 |
rnirmal | another topic to add to this discussion would be private networks support for the hadoop internal ips | 18:58 |
jmaron | that would be the ideal | 18:58 |
mattf | if there isn't, it's an opportunity for the savanna community to contribute to the openstack networking community | 18:59 |
SergeyLukjanov | BP creation is ok | 18:59 |
SergeyLukjanov | mattf, we want to support not only the trunk version of openstack | 18:59 |
*** Riddhi has joined #openstack-meeting-alt | 18:59 | |
mattf | SergeyLukjanov, well, short term there's no feature, long term we should aim for closer integration w/ os networking | 19:00 |
mattf | in between, who knows | 19:00 |
*** kgriffs has joined #openstack-meeting-alt | 19:00 | |
jmaron | savanna filtering approach could be viewed as "last resort" but workable in some deployments, I suppose | 19:00 |
mattf | we should continue on #savanna and savanna-all | 19:00 |
Nadya | yes | 19:00 |
Nadya | we are out of time :( | 19:01 |
Nadya | Thank you all | 19:01 |
*** cppcabrera has joined #openstack-meeting-alt | 19:01 | |
mattf | thanks all | 19:01 |
jmaron | thanks | 19:01 |
aignatov2 | thanks | 19:01 |
ruhe | thanks | 19:01 |
SergeyLukjanov | thank you guys | 19:01 |
Nadya | #endmeeting | 19:01 |
*** openstack changes topic to "OpenStack meetings (alternate)" | 19:01 | |
openstack | Meeting ended Thu Jun 6 19:01:43 2013 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 19:01 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/savanna/2013/savanna.2013-06-06-18.06.html | 19:01 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/savanna/2013/savanna.2013-06-06-18.06.txt | 19:01 |
openstack | Log: http://eavesdrop.openstack.org/meetings/savanna/2013/savanna.2013-06-06-18.06.log.html | 19:01 |
kgriffs | marconi team - we are testing out mumble for this meeting, with notes taken with meetbot. | 19:02 |
*** nkonovalov has quit IRC | 19:03 | |
kgriffs | some folks are having trouble connecting | 19:04 |
kgriffs | shall we just do IRC only this time, or go to plan B (G+)? | 19:04 |
*** mattf has left #openstack-meeting-alt | 19:04 | |
*** ruhe has left #openstack-meeting-alt | 19:04 | |
flaper87 | plan B | 19:05 |
*** jmaron has left #openstack-meeting-alt | 19:05 | |
*** megan_w has joined #openstack-meeting-alt | 19:05 | |
cppcabrera | plan B works for me. | 19:05 |
kgriffs | OK | 19:05 |
kgriffs | stand by | 19:05 |
*** Nadya has quit IRC | 19:06 | |
ametts | Oh. Plan B is G+. I thought Plan B was IRC. I'm so confused.... | 19:06 |
*** jrodom has joined #openstack-meeting-alt | 19:06 | |
* flaper87 will fix someday that stupid ,ic | 19:07 | |
flaper87 | mic | 19:07 |
cppcabrera | Plan A.1 is IRC. | 19:08 |
kgriffs | https://plus.google.com/hangouts/_/2b91b6fea2d02e4c67c6657e98afedafa19abb4e | 19:09 |
*** vipul is now known as vipul|away | 19:09 | |
kgriffs | trying to figure out how to do "on air" in the new interface | 19:09 |
*** kagan has quit IRC | 19:09 | |
kgriffs | give me 2 minutes, otherwise plan C - plain-old-irc | 19:09 |
kgriffs | :p | 19:09 |
flaper87 | isn't it hangout public ? | 19:10 |
flaper87 | I mean, public circles | 19:10 |
kgriffs | yes, but I wanted to record for posterity | 19:10 |
flaper87 | oh, I see | 19:10 |
flaper87 | erm, mmh, erm! | 19:11 |
flaper87 | no idea | 19:11 |
kgriffs | can everyone join this | 19:11 |
kgriffs | https://plus.google.com/hangouts/_/43e14b608e33ae127ec6ab4852f0128ae0d8a878 | 19:11 |
kgriffs | this second one is "on air" | 19:11 |
*** akuznetsov has quit IRC | 19:11 | |
kgriffs | first topic: experimenting with new ways to collaborate. :p | 19:12 |
ametts | Did you start the meetbot meeting? | 19:12 |
kgriffs | flaper87: you coming? | 19:12 |
flaper87 | kgriffs: yup | 19:13 |
flaper87 | joining | 19:13 |
kgriffs | #startmeeting marconi | 19:14 |
openstack | Meeting started Thu Jun 6 19:14:20 2013 UTC. The chair is kgriffs. Information about MeetBot at http://wiki.debian.org/MeetBot. | 19:14 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 19:14 |
*** openstack changes topic to " (Meeting topic: marconi)" | 19:14 | |
openstack | The meeting name has been set to 'marconi' | 19:14 |
kgriffs | #link http://youtu.be/sDUw1Je_JJE | 19:15 |
flaper87 | I'm in but I can't hear anything | 19:16 |
kgriffs | it said you left | 19:16 |
kgriffs | https://plus.google.com/hangouts/_/43e14b608e33ae127ec6ab4852f0128ae0d8a878 | 19:16 |
kgriffs | try again? | 19:16 |
ametts | Flavio Percoco Premoli joined group chat. | 19:16 |
ametts | Flavio Percoco Premoli left group chat. | 19:16 |
ametts | Flavio Percoco Premoli joined group chat. | 19:16 |
ametts | Flavio Percoco Premoli left group chat. | 19:16 |
kgriffs | you were there for a sec | 19:17 |
flaper87 | it throws some error on the video call | 19:17 |
kgriffs | can you do sound only? | 19:17 |
kgriffs | ok, give up? | 19:17 |
kgriffs | #topic audio meetings | 19:18 |
*** openstack changes topic to "audio meetings (Meeting topic: marconi)" | 19:18 | |
kgriffs | #action flaper87 to fix his mic | 19:18 |
kgriffs | :D | 19:18 |
flaper87 | sorry guys, this stupid update doesn't seem to work correctly | 19:18 |
flaper87 | LOOOL | 19:18 |
kgriffs | #topic H1 milestone closure | 19:19 |
*** openstack changes topic to "H1 milestone closure (Meeting topic: marconi)" | 19:19 | |
flaper87 | I think I'm in | 19:19 |
*** Nadya has joined #openstack-meeting-alt | 19:19 | |
flaper87 | kgriffs: saw you | 19:19 |
kgriffs | ok, let's try again another time - i think it had something to do with the "on air" | 19:19 |
kgriffs | so, re H1 | 19:20 |
flaper87 | kk | 19:20 |
kgriffs | it is now behind us | 19:20 |
kgriffs | so, we need to update the bp's and trello cards | 19:20 |
flaper87 | kk | 19:20 |
kgriffs | we made good progress on all the stuff we planned, but just didn't bring them all to closure | 19:21 |
kgriffs | so, I can just move back everything, but wanted to ask if there was anything we had scoped for H1 that turned out to be lower priority and should be moved maybe to H3 instead of H2 | 19:22 |
kgriffs | https://trello.com/board/openstack-marconi/511403287d138cd6200078e0 | 19:22 |
* flaper87 checking | 19:23 | |
kgriffs | for example, "validate input" I think we need before launch, but not immediate | 19:23 |
kgriffs | (look at the "next up") | 19:23 |
kgriffs | I'm wondering if we need that "next up" list, or just merge with the milestone lists? | 19:23 |
flaper87 | kgriffs: +1 for merge | 19:24 |
kgriffs | any objections? | 19:24 |
flaper87 | the more focus in 1 column we can be the better | 19:24 |
flaper87 | focused* | 19:24 |
*** sdake_ has joined #openstack-meeting-alt | 19:25 | |
*** sdake_ has quit IRC | 19:25 | |
*** sdake_ has joined #openstack-meeting-alt | 19:25 | |
kgriffs | #agreed Merge "next up" list with milestone list | 19:25 |
kgriffs | also, I'd like to add a Havana-3.a | 19:26 |
flaper87 | kgriffs: +1 | 19:26 |
kgriffs | Basically, I would like something to target for "pretty much production ready" | 19:26 |
kgriffs | H3 will be for stabilization and whatever | 19:27 |
flaper87 | makes sense | 19:27 |
flaper87 | there's a limit for introducing new features | 19:28 |
kgriffs | OK, let me do this. I will take a first pass and moving the cards around, and you guys can complain loudly in #openstack-marconi if you don't like what you see. | 19:28 |
flaper87 | IIRC it is september | 19:28 |
flaper87 | ok | 19:28 |
flaper87 | LIKE THIS ? | 19:28 |
kgriffs | that's about right. :D | 19:28 |
ametts | Is some of the Havana-2 stuff optional? We really going to add WebScoket, qpid, Kombu, etc? | 19:29 |
kgriffs | #action kgriffs to clean up trello board, get things prioritized better | 19:29 |
flaper87 | ametts: I read those as "Nice to Have" | 19:29 |
flaper87 | TBH | 19:29 |
ametts | Me too. | 19:29 |
kgriffs | so, re incubation, can we put all the alternate drivers in September-ish timeframe? | 19:30 |
flaper87 | but we should definitely target them and focus on the column as "Must Have" | 19:30 |
flaper87 | kgriffs: sure | 19:30 |
kgriffs | OK | 19:30 |
kgriffs | #topic bugs | 19:31 |
*** openstack changes topic to "bugs (Meeting topic: marconi)" | 19:31 | |
kgriffs | So, just wanted to get updates on bug fixes that are in progress | 19:31 |
malini | before that, can we also define a time line for the marconi client ? | 19:32 |
flaper87 | kgriffs: I was working on Autoreconnect | 19:32 |
kgriffs | malini: let's do that next topic | 19:32 |
flaper87 | that discussion is still pending | 19:32 |
kgriffs | #link https://bugs.launchpad.net/marconi/+bug/1169821 | 19:32 |
kgriffs | OK | 19:32 |
kgriffs | so, let's talk about that for a couple mins | 19:33 |
flaper87 | so, It basically works but it could be improved before letting it land | 19:33 |
flaper87 | cool | 19:33 |
kgriffs | ok, so your wrapper is only for reads, correct? | 19:33 |
* kgriffs is looking | 19:34 | |
flaper87 | nope | 19:34 |
flaper87 | it is for everything, basically | 19:34 |
flaper87 | the big problem are reads, though | 19:34 |
flaper87 | the reason for that is that reads happen in the Cursor | 19:34 |
kgriffs | oh, is there any danger of getting part way through a bulk insert and getting a disconnect error? | 19:35 |
kgriffs | (ConnectionFailure) | 19:35 |
flaper87 | Autoreconnect should be raised before sending the bulk | 19:35 |
flaper87 | so, it would just retry | 19:35 |
kgriffs | #link https://review.openstack.org/#/c/30230/2/marconi/storage/mongodb/utils.py | 19:35 |
kgriffs | if the socket connection simply get's dropped, what happens? | 19:36 |
flaper87 | pymongo tries to connect without raising any error | 19:36 |
flaper87 | it raises an error when that attempt of connection fails | 19:36 |
kgriffs | even halfway through a write? | 19:37 |
flaper87 | ah, you mean in the middle of the operation | 19:37 |
flaper87 | erm, well... | 19:37 |
flaper87 | we could remove the retry stuff | 19:37 |
kgriffs | basically, I just want to be sure we aren't doing a generic retry halfway through an insert, since the caller needs to reset the generator | 19:37 |
flaper87 | I'm honestly not sure whether we should be handling it at all. I mean, Marconi doesn't know what to do when AutoReconnect happens | 19:39 |
flaper87 | right? It just knows there was an error | 19:39 |
flaper87 | should we just return an error in the API? | 19:39 |
flaper87 | that question is valid even if we handle the Autoreconnect | 19:39 |
flaper87 | since mongodb might be completely innaccesible | 19:39 |
flaper87 | (dunno if that word exists) | 19:39 |
flaper87 | The other thing is that Cursors are lazy | 19:40 |
kgriffs | well, the trouble is, in the case of a bulk message post, there is no way to know how many messages succeeded if we drop the connection halfway through. I guess with Mongo there isn't much to do about it? | 19:40 |
flaper87 | and none of the read operations will raise any error until they are truly consumed | 19:40 |
flaper87 | and that happens in the transport side | 19:40 |
kgriffs | kk | 19:40 |
kgriffs | so, iterating that cursor could raise an AutoReconnect? | 19:41 |
flaper87 | yup | 19:41 |
flaper87 | so, crazy idea | 19:41 |
kgriffs | the plot thickens... | 19:41 |
*** sdake_ has quit IRC | 19:42 | |
flaper87 | what if we have some kind of "abstract decorator" implemented in every storage that "knows" how to handle "storage specific errors" that might happen in the transport side? | 19:42 |
*** sdake_ has joined #openstack-meeting-alt | 19:42 | |
*** sdake_ has quit IRC | 19:42 | |
*** sdake_ has joined #openstack-meeting-alt | 19:42 | |
flaper87 | or just possible exceptions | 19:42 |
flaper87 | so that it is possible to do in the transport side something like | 19:42 |
kgriffs | ok, so the transport could ask the driver for that thing, maybe it could be a context manager? | 19:43 |
flaper87 | try ... except self.storage.CatchThatStuff: ... | 19:43 |
kgriffs | yeah, ok | 19:43 |
flaper87 | yeah, something like that | 19:43 |
kgriffs | something like that could work | 19:43 |
flaper87 | oke-doke | 19:43 |
kgriffs | ok, so we have two things to solve here | 19:43 |
kgriffs | first, reads | 19:43 |
kgriffs | second, writes | 19:43 |
malini | maybe we are getting too focussed on a single bug ? *brings out her irritating cow bell* | 19:43 |
ametts | Rock on, malini! | 19:44 |
kgriffs | do we need to experiment to see if AutoReconnect errors are possible halfway through a bulk insert? | 19:44 |
kgriffs | heh | 19:44 |
flaper87 | I think they are | 19:44 |
kgriffs | OK, let's move on, but sounds like there's some homework | 19:44 |
flaper87 | at least a ConnectionFailure could be raised | 19:44 |
ametts | And hey, if everything works besides reads and writes, we're good... no? | 19:44 |
flaper87 | ok, I'll re-write that patch along these lines | 19:44 |
kgriffs | OK, can u verify what happens with bulk inserts? | 19:45 |
flaper87 | kgriffs: will do | 19:45 |
kgriffs | (simulate a primary failover, see what happens) | 19:45 |
kgriffs | excellent | 19:45 |
flaper87 | ametts: as far as deletes work, we're fine | 19:45 |
flaper87 | :P | 19:45 |
ametts | Sounds like an awesome queue. :) | 19:45 |
kgriffs | #action flaper87 to experiment with bulk insert behavior on mongo connection errors | 19:45 |
* flaper87 STFU | 19:45 | |
kgriffs | #action flaper87 to update AutoReconnect patch to handle read cursor errors | 19:46 |
kgriffs | ok, I know this bug is also in progress, any quick thoughts before we move off the bugs topic? | 19:47 |
kgriffs | #link https://bugs.launchpad.net/marconi/+bug/1187280 | 19:47 |
*** aignatov2 has left #openstack-meeting-alt | 19:47 | |
flaper87 | patch waiting for review | 19:47 |
kgriffs | kk, I think we can land this one pretty quickly. Looks like Jenkins is happy again | 19:48 |
kgriffs | Can everyone re-review? | 19:48 |
* flaper87 hates eventlet | 19:48 | |
ametts | FWIW, there's a fair amount of overlap between several of these bugs, input validation, and failing system tests. | 19:48 |
flaper87 | marconi/tests/common/__init__.py | 19:49 |
flaper87 | renamed from lib/marconi_paste.py | 19:49 |
flaper87 | WTF? | 19:49 |
flaper87 | Jenkins is crazy | 19:49 |
kgriffs | yes, the remaining bugs are mostly due to holes in the implementation re the API spec | 19:49 |
kgriffs | heh | 19:49 |
*** dmitryme has quit IRC | 19:49 | |
kgriffs | #topic blueprints | 19:49 |
*** openstack changes topic to "blueprints (Meeting topic: marconi)" | 19:49 | |
flaper87 | ametts: they exist just to make us beleive we're going faster | 19:49 |
kgriffs | QA cluster news? | 19:49 |
flaper87 | we can close 2 bugs with 1 patch | 19:49 |
* flaper87 STFU | 19:49 | |
flaper87 | I know, I've said it before | 19:49 |
ametts | flaper87: LOL | 19:49 |
* kgriffs didn't hear anything | 19:50 | |
malini | We havent made much progress on the QA cluster since last time | 19:50 |
* kgriffs sad panda | 19:50 | |
kgriffs | any blocking issues? | 19:50 |
malini | its just that oz_akan had other priorities this week | 19:51 |
kgriffs | kk, will he be back on this next week? | 19:51 |
malini | yes | 19:51 |
kgriffs | kk, keep us posted | 19:52 |
ametts | QA cluster runs system tests with every commit? | 19:52 |
*** SergeyLukjanov has quit IRC | 19:52 | |
malini | its not hooked into jenkins yet | 19:52 |
malini | But we'll be there soon | 19:52 |
kgriffs | +1 | 19:52 |
kgriffs | how about performance tests? | 19:52 |
malini | I have the xmls (i.e defining scenarios/loads etc.) ready | 19:53 |
malini | So we are ready to run them when we have the cluster | 19:53 |
kgriffs | excellent | 19:53 |
kgriffs | nice work | 19:53 |
malini | Also, can I move those xmls to the marconi repo ? | 19:53 |
malini | under tests/performance ? | 19:53 |
kgriffs | and that will be triggered by patch submissions as well? | 19:53 |
malini | yes | 19:53 |
kgriffs | flaper87: thoughts on where those should live? | 19:54 |
* ametts Wants to make sure we save time for a quick marconiclient discussion | 19:54 | |
*** Riddhi has quit IRC | 19:54 | |
flaper87 | mmhh, not right now, not sure if those should go into the tree | 19:54 |
kgriffs | ok, let's discuss in #openstack-marconi | 19:55 |
malini | ok | 19:55 |
flaper87 | kk | 19:55 |
kgriffs | #topic python-marconiclient | 19:55 |
*** openstack changes topic to "python-marconiclient (Meeting topic: marconi)" | 19:55 | |
kgriffs | next steps, timing? | 19:55 |
malini | we are stalled on the client because of Alessio's patch. | 19:55 |
*** mtreinish has quit IRC | 19:55 | |
ametts | Just noticed that stackforge/python-marconiclient doesn't have jdprax's original stuff in it, but it does have Alessio's patch pending. | 19:55 |
ametts | What's the plan -- we start with the patch and fold in jdprax's original stuff? | 19:56 |
flaper87 | ametts: so, the plan was to give alessio's code a try, and help improving that code | 19:56 |
flaper87 | The code proposed there is meant to be a shared client library that will, eventually, land in oslo | 19:57 |
flaper87 | but, it needs a lot of work and cleaning | 19:57 |
kgriffs | can malini help with that work and cleaning? | 19:57 |
*** mtreinish has joined #openstack-meeting-alt | 19:57 | |
ametts | Ok -- so that forms the base and it gets called by other stuff for marconi-specific things? | 19:58 |
malini | I emailed Alessio & at this point he badly needs reviews to merge his stuff into oslo-incubator | 19:58 |
kgriffs | wait - I thought he was merging this into python-marconiclient first? | 19:58 |
ametts | Is there anything of value that gets reused from the jdprax stuff? | 19:58 |
flaper87 | kgriffs: yup | 19:58 |
*** vipul|away is now known as vipul | 19:58 | |
flaper87 | first into marconiclient | 19:58 |
flaper87 | kgriffs: malini can help for sure | 19:59 |
malini | hmm..So we dont need the oslo incubator stuff ? | 19:59 |
flaper87 | we should start reviewing that patch 'til the last bit | 19:59 |
*** djohnstone1 has joined #openstack-meeting-alt | 19:59 | |
*** Riddhi has joined #openstack-meeting-alt | 19:59 | |
malini | So if we can get https://review.openstack.org/#/c/29255 fixed, we shud be good to go ? | 20:00 |
kgriffs | (note: we are out of time, let's wrap up) | 20:00 |
flaper87 | malini: sort of, yeah | 20:00 |
flaper87 | we can keep discussing this stuff right now on #os-marconi | 20:01 |
*** djohnstone has quit IRC | 20:01 | |
kgriffs | #action malini and flaper87 to continue api client discussion elsewhere | 20:01 |
kgriffs | two parting thoughts | 20:01 |
*** Riddhi_ has joined #openstack-meeting-alt | 20:02 | |
kgriffs | malini, can you add a few very basic security tests, maybe just fuzzing? | 20:02 |
kgriffs | one possibility: http://gauntlt.org/ | 20:02 |
malini | yes, I'll start looking at what we can add | 20:02 |
kgriffs | second thought, please review this RFC on the project: https://etherpad.openstack.org/queuing-scratch | 20:02 |
kgriffs | ok, thanks folks | 20:02 |
kgriffs | we will shift some agenda items to next week. | 20:03 |
kgriffs | #endmeeting | 20:03 |
*** openstack changes topic to "OpenStack meetings (alternate)" | 20:03 | |
openstack | Meeting ended Thu Jun 6 20:03:31 2013 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 20:03 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-06-06-19.14.html | 20:03 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-06-06-19.14.txt | 20:03 |
openstack | Log: http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-06-06-19.14.log.html | 20:03 |
*** Riddhi has quit IRC | 20:04 | |
*** Riddhi_ is now known as Riddhi | 20:04 | |
*** dosaboy has quit IRC | 20:07 | |
kgriffs | Notes copied to wiki: https://wiki.openstack.org/wiki/Meetings/Marconi#Previous_meetings | 20:08 |
*** flaper87 has left #openstack-meeting-alt | 20:08 | |
*** Riddhi has quit IRC | 20:09 | |
*** Riddhi has joined #openstack-meeting-alt | 20:09 | |
*** qwerty_nor has quit IRC | 20:10 | |
*** highlycaffeinate has left #openstack-meeting-alt | 20:10 | |
*** ametts has left #openstack-meeting-alt | 20:10 | |
*** dmitryme has joined #openstack-meeting-alt | 20:12 | |
*** mtreinish has quit IRC | 20:13 | |
*** malini is now known as malini_away | 20:14 | |
*** mtreinish has joined #openstack-meeting-alt | 20:15 | |
*** pcm___ has quit IRC | 20:15 | |
*** cppcabrera has left #openstack-meeting-alt | 20:17 | |
*** kagan has joined #openstack-meeting-alt | 20:18 | |
*** tanisdl_ has joined #openstack-meeting-alt | 20:19 | |
*** tanisdl has quit IRC | 20:21 | |
*** tanisdl_ is now known as tanisdl | 20:21 | |
*** SergeyLukjanov has joined #openstack-meeting-alt | 20:33 | |
*** Nadya has quit IRC | 20:33 | |
*** johnthetubaguy has quit IRC | 20:43 | |
*** Nadya has joined #openstack-meeting-alt | 20:45 | |
*** Nadya has quit IRC | 20:50 | |
*** megan_w has quit IRC | 21:00 | |
*** jrodom_ has joined #openstack-meeting-alt | 21:01 | |
*** jrodom_ has quit IRC | 21:01 | |
*** jrodom has quit IRC | 21:04 | |
*** jrodom has joined #openstack-meeting-alt | 21:05 | |
*** jrodom has quit IRC | 21:10 | |
*** mtreinish has quit IRC | 21:13 | |
*** jrodom has joined #openstack-meeting-alt | 21:14 | |
*** jrodom has quit IRC | 21:20 | |
*** bdpayne has quit IRC | 21:20 | |
*** Riddhi has quit IRC | 21:21 | |
*** demorris has quit IRC | 21:21 | |
*** Riddhi has joined #openstack-meeting-alt | 21:26 | |
*** dmitryme has quit IRC | 21:32 | |
*** amytron has quit IRC | 21:34 | |
*** malini_away is now known as malini | 21:37 | |
*** malini has left #openstack-meeting-alt | 21:38 | |
*** jrodom has joined #openstack-meeting-alt | 21:47 | |
*** jrodom has quit IRC | 21:47 | |
*** jrodom has joined #openstack-meeting-alt | 21:48 | |
*** demorris has joined #openstack-meeting-alt | 21:58 | |
*** kgriffs has left #openstack-meeting-alt | 21:59 | |
*** dhellmann is now known as dhellmann-away | 22:02 | |
*** markwash has joined #openstack-meeting-alt | 22:06 | |
*** SergeyLukjanov has quit IRC | 22:15 | |
*** esheffield has quit IRC | 22:17 | |
*** djohnstone1 has quit IRC | 22:18 | |
*** lastidiot has quit IRC | 22:27 | |
*** sdake_ has quit IRC | 22:33 | |
*** markwash has quit IRC | 22:35 | |
*** markwash has joined #openstack-meeting-alt | 22:36 | |
*** vipul has quit IRC | 22:36 | |
*** vipul has joined #openstack-meeting-alt | 22:48 | |
*** rnirmal has quit IRC | 22:48 | |
*** pcm__ has joined #openstack-meeting-alt | 22:58 | |
*** pcm__ has quit IRC | 22:58 | |
*** pcm__ has joined #openstack-meeting-alt | 22:59 | |
*** vipul has quit IRC | 23:01 | |
*** jrodom has quit IRC | 23:04 | |
*** vipul has joined #openstack-meeting-alt | 23:04 | |
*** seanrob has joined #openstack-meeting-alt | 23:09 | |
*** seanrob_ has joined #openstack-meeting-alt | 23:12 | |
*** seanrob has quit IRC | 23:16 | |
*** BalleS_ has quit IRC | 23:16 | |
*** sdake_ has joined #openstack-meeting-alt | 23:19 | |
*** sdake_ has quit IRC | 23:19 | |
*** sdake_ has joined #openstack-meeting-alt | 23:19 | |
*** jrodom has joined #openstack-meeting-alt | 23:22 | |
*** seanrob_ has quit IRC | 23:24 | |
*** seanrob has joined #openstack-meeting-alt | 23:24 | |
*** seanrob has quit IRC | 23:28 | |
*** lastidiot has joined #openstack-meeting-alt | 23:34 | |
*** seanrob has joined #openstack-meeting-alt | 23:34 | |
*** seanrob_ has joined #openstack-meeting-alt | 23:37 | |
*** seanrob has quit IRC | 23:37 | |
*** seanrob has joined #openstack-meeting-alt | 23:43 | |
*** seanrob__ has joined #openstack-meeting-alt | 23:44 | |
*** seanrob has quit IRC | 23:45 | |
*** seanrob_ has quit IRC | 23:46 | |
*** seanrob__ has quit IRC | 23:48 | |
*** demorris has quit IRC | 23:48 | |
*** seanrob has joined #openstack-meeting-alt | 23:48 | |
*** Riddhi has quit IRC | 23:50 | |
*** kagan has quit IRC | 23:50 | |
*** Riddhi has joined #openstack-meeting-alt | 23:51 | |
*** zzs has joined #openstack-meeting-alt | 23:51 | |
*** Riddhi has quit IRC | 23:52 | |
*** seanrob_ has joined #openstack-meeting-alt | 23:55 | |
*** seanrob has quit IRC | 23:55 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!