19:00:11 #startmeeting ironic 19:00:12 Meeting started Mon Apr 21 19:00:11 2014 UTC and is due to finish in 60 minutes. The chair is devananda. Information about MeetBot at http://wiki.debian.org/MeetBot. 19:00:13 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 19:00:15 The meeting name has been set to 'ironic' 19:00:23 o/ 19:00:25 hi all! 19:00:29 as usual, the agenda is here 19:00:30 #link https://wiki.openstack.org/wiki/Meetings/Ironic 19:00:30 Hi 19:00:33 o/ 19:00:48 yesterday was the deadline for summit proposals -- and the summit's coming up really soon! 19:00:58 so i'd like to talk about the **18** proposals we have alraedy received 19:01:07 :) 19:01:07 and how to prioritize them, since we only have 4 slots 19:01:40 #link http://summit.openstack.org 19:01:50 wow 18 19:01:58 #topic summit proposals 19:02:01 devananda: there's plenty of unconference time for things that don't get slots, yes? 19:02:15 jroll: there is unconference time, yes 19:02:26 cool :) 19:02:32 another aspect everyone should be aware of 19:02:42 our four slots are on tuesday, co-timed with the cross-project workshops 19:02:48 which some of us will need to attend, too 19:03:08 :) 19:03:08 o/ 19:03:39 of the 18 sessions, broadly, i see a few categories of topics 19:03:55 scale/speed/stability 19:04:21 new features/third-party drivers/make it work for some particular flavor of hardware 19:04:49 architectural changes 19:05:18 my opinion is that, geting everyone together to talk about a *specific* feature or third-party driver or piece of hardware 19:05:23 is not an efficient use of those four slots 19:05:35 +1 19:05:37 and those proposals are better run in the unconference space during the week 19:05:45 i'd like y'all's opinion on that 19:05:48 * jroll nods 19:05:51 +1 19:05:52 +1 19:05:57 That seems quite reasonable to me. 19:06:15 ok, cool 19:06:16 +1 19:06:17 yeah makes sense for me as well 19:06:34 I (somewhat selfishly) wonder if the agent model counts as a specific feature or more of an architecture thing :) 19:06:38 architectural things are a bit more important for everyone to be involved in // aware of 19:06:48 jroll: right - i was just going to point that out 19:06:48 +1 19:06:56 Yeah, I was actually thinking of the agent stuff as the possible exception 19:06:56 since we've talked about making it the default at some point 19:06:58 ok 19:07:05 Though I don't have a strongly-vested interested 19:07:07 i'd put the following sessions in that category 19:07:15 http://summit.openstack.org/cfp/details/405 19:07:29 http://summit.openstack.org/cfp/details/325 19:07:33 http://summit.openstack.org/cfp/details/225 19:07:46 jroll, yeah I think we are going towards having the agent as default (I expect it at least) 19:07:50 http://summit.openstack.org/cfp/details/121 19:07:57 http://summit.openstack.org/cfp/details/100 19:08:12 #405? Multi-tenancy using Ironic 19:08:15 for those that dont want to click everthing 19:08:45 oh, there's a few others too. i'll just type out the titles... 19:09:23 multitenancy, chassis level operations (two proposals), widnows deployment, hardware control functions 19:09:54 and IPA, which seems to require some rearchitecture 19:10:07 or at least some changes to architecture, to do what ya'll want 19:10:41 i think we can condense all that into two sessions 19:10:52 (but maybe i'm overly optimistic) 19:12:17 devananda: how do you see multitenancy as part of the session 19:12:53 that could lead us down several rabbit holes (no pun intented) 19:12:58 yep 19:13:19 every time that comes up, it leads us into long unresolvable discussions of firmware security 19:13:24 but 19:13:42 there are some things we can do to mitigate the other aspects 19:14:07 i dont feel like that needs a session unto itself. we'll just rehash those discussions from the last summit 19:14:37 +1 I would put that one in the if theres time catagory 19:15:11 I feel like multi-tenancy is a good one to bump to unconf so we can all argue for a few hours :) 19:15:25 k 19:15:31 friendly arguments of course :P 19:15:39 I would be happy to sit down and talk about it.. just not sure its worth one of or pressious slots 19:15:47 jroll: sure 19:15:48 I think it'd be interesting if we could be fairly aggressive in identifying things we need to hash out in separate discussions 19:15:49 you know we won't be able to stop that one on time 19:15:54 For that one 19:16:22 jroll: i think that some usable action items can come out of it (doc the risks, do better network isolation, etc) 19:16:22 we could do it over drinks.. :) might be more fun that way 19:16:48 NobodyCam: +1 19:16:52 devananda: agreed 19:16:57 also, i think we need a session to discuss what the road towards graduation looks like 19:17:03 a whole session jsut for that 19:17:17 +1 with defined action items 19:17:26 NobodyCam, +1! 19:17:26 I'd like to get the nova people in on that if y'all feel it's necessary 19:17:29 (at the end) 19:17:33 getting Ironic to graduate is my primary goal for the project this cycle 19:17:47 devananda, +1, I put one up, but I think we need to have the nova one first 19:17:50 jroll: that's a separate session :) 19:17:52 #Link http://summit.openstack.org/cfp/details/215 19:18:04 so the nova one CANT happen first 19:18:05 ah, ok 19:18:06 yeah that ^ 19:18:12 nova track is wed/thu/fri 19:18:16 our track is tuesday 19:18:16 :/ 19:18:35 hm 19:18:35 Oh, tangential, but I updated https://etherpad.openstack.org/p/IronicGraduationDiscussion based on the changes to the upstream doc 19:18:40 matty_dubs: thanks! 19:18:53 but we can go to nova with a well defined plan for our graduation 19:18:58 lucasagomes: do you feel we should wait until after the nova session to have the "road to juno" session in an unconference room? 19:19:28 devananda, I do... we have a hard depedency on the things on nova 19:19:40 I think it would be better for us to have a plan and make changes if we need to based on nova's input 19:19:42 mikal: hi! you're probably not awake yet, but this would be a good question for you, too. let's chat later :) 19:19:48 lucasagomes: indeed 19:20:12 devananda, we can make sure we are prepare for the nova one, have the topics and arguments up and ready 19:20:24 and then after it the ironic one should be quite straight forward 19:20:29 we would know what to do 19:20:41 I think we should have the session tuesday, and then maybe loop back around after the nova talks 19:20:57 as needed 19:20:57 lucasagomes: independent of nova, we can discuss what else is required 19:21:03 jroll: + that would be my first vote. 19:21:06 testing, docs, ceilometer ,horizon, etc 19:21:26 right, yeah... 19:21:35 we're supposed to integrate with all of those too, and so far, haven't done much 19:21:36 is ceilometer a requirement for graduation? 19:22:48 jroll, hmm I don't think we are... I'm a bit confused about it as well 19:22:58 jroll: heat and horizon definitely are. there's discussion/implication that integration with all integrated projects is required 19:23:06 jroll: I do not think so... nova Bmdoes not work with Ceilometer currently 19:23:07 heat doesn't apply in our case, fwiw 19:23:21 NobodyCam: it doesn't have to do with what nova-bm does/not do 19:23:30 new integrated prjoects must integrate with existing integrated projects 19:23:30 ack :) 19:23:39 jroll, we need to have pair functionality with nova bm, and it's not deprecated... so if someone implements some ceilometer integration in nova bm that will become a graduation requirement for us as well 19:23:44 ok 19:23:46 yeah 19:23:54 lucasagomes: hm, well, no one should do that -- but we still need it, IMO 19:24:09 because we've got a clear interaction point with ceilometer, discussion at the last summit with them about it, 19:24:10 devananda, yeah, I would -1 that in nova bm >:D 19:24:16 and ongoing work on the ML and in gerrit for it 19:24:32 similarly, nova-bm has no horizon plugin, but we'll need it 19:24:33 anyway 19:24:33 let 19:24:38 devananda, yup, eglynn is the new ceilometer ptl and I think he's looking at ironic 19:24:41 not nova bm for it 19:24:48 let's unwind to the topic of sessions (not have one now :) ) 19:25:05 i think there's a lot for us to talk about, in addition to the nova-bm deprecation plan 19:25:05 heehe 19:25:33 so, i see 3 slots filled so far 19:25:37 1. road to juno 19:25:43 2. ironic-python-agent 19:25:53 3. other architectural changes 19:26:01 (i'll merge several proposals and come up with a list of those) 19:26:19 fourth slot -- what's going to be the most useful for everyone? 19:26:20 4. how to track all teh ironic etherpads :-p 19:26:26 ^^ 19:26:27 NobodyCam: metapad! 19:26:31 hehehe 19:27:19 lol 19:27:28 i'm seeing ya'lls input here 19:27:30 how about changing blue print to be review based worth a session? 19:27:36 I'd like to talk about scalability 19:27:37 ah 19:27:46 jroll, +1 19:27:48 NobodyCam: is anybody against that? are there hard questions to answer? 19:27:55 NobodyCam: i dont think that's worth a whole session. no one has objected ... 19:28:25 jroll: scalability and performance seems like a good topic 19:28:39 scalability problems seems to be the one, since the main (or one of) characteristics of openstack is scalability 19:28:55 ack. :) scalability to me also implys we have the ablity to messure our perforamce 19:29:45 it's much more useful to talk about scalability 19:29:47 when we have hard numbers 19:29:59 anyone have resources (hardware and time) to do some benchmarks 19:30:01 ? 19:30:09 someone was working on that... 19:30:15 * jroll tries to think of who exactly 19:30:31 boris-42 was talking about rally, iirc 19:30:36 I have hardware and might could find some time, but I don't want to make any promises 19:30:37 #link http://summit.openstack.org/cfp/details/275 19:30:38 yes 19:30:47 we will probably do some scale testing ourselves... soon 19:30:52 i suppose we already did some 19:30:57 wrt that that thread starvation issue 19:30:58 right 19:31:00 :) 19:31:06 aiui, rally would let us get perf data from runs inside a cloud 19:31:24 I think romcheg was looking at some benchmarks as well 19:31:34 devananda: afaik romcheg is working right now on implementing some rally related stuff to test API performance 19:31:36 i'm thinking more along the lines of a) on real hardware b) meaasuring concurrency c) changing parameters, like # of conductors, and seeing how (b) changes 19:31:49 so API perf is useful but not the whole picture 19:32:15 at least it is something to discuss 19:32:20 i'm also very interested in conductor performance, identifying IO/network bottlenetcks (and validating suspected ones) 19:32:28 I don't have much experience with this, but I have access to a small number of beefy boxes if that's useful. 19:32:39 seems there is enough about scalability that could fill a slot 19:32:47 matty_dubs: beefy boxes == test with lots of VMs 19:32:50 right, I'm more interested in conductor performance 19:33:08 matty_dubs: but that should be fairly easy with devstack. change # of VMs, then issue lots of "nova boot" 19:33:47 matty_dubs: do you have time to work on that? I'm happy to assist -- I have several years' experience with benchmarking systems 19:34:09 devananda: I can probably make some time for this, but I'd need some guidance. 19:34:14 I'm also the son of a performance engineer ;) 19:34:20 :) 19:34:36 matty_dubs: thanks! let's talk after the meeting 19:34:40 Sure thing. 19:35:05 ok! going to give a few more minutes if anyone has thoughts/objections/ 19:35:23 or feels like omg-i-have-to-talk-about-kittens at the summit 19:35:34 devananda: boris-42 is sitting next to me in the office so i could be helpful, but i prefer to concentrate on IPA stuff 19:35:35 and then move on 19:35:54 +1 for fourth slot being on scalability 19:35:59 vkozhukalov: we need to benchmark deploying through IPA too :) 19:36:07 vkozhukalov: having some API performance tests from rally would be great 19:36:25 scalability & kittens 19:36:33 NobodyCam: Sold! 19:36:38 jroll: i'd love to see a comparative test on real hw between dib's ramdisk and IPA 19:36:57 devananda: jroll: ok, will think about what i can do 19:36:58 NobodyCam, +1, kittens r nice, we should have pics of kittens while deploying a node... we can fetch them from flickr or something 19:37:11 http://dailykitten.com 19:37:24 lol 19:37:31 #agreed summit slot usage will be: road to juno, IPA, other arch changes, perf & scaling. 19:37:43 ++ 19:37:52 http://dailykitten.com/feed/ = KaaS? (Kittens as a Service) 19:37:56 #action devananda to merge and bump other sessions, see about reserving a block of unconference space 19:38:01 w/ pictures of cute kittens 19:38:09 devananda: agreed about comparisons 19:38:17 #action matty_dubs to do some benchmarks of ironic-conductor scalability 19:38:47 thanks everyone! moving on 19:38:53 #topic blueprint design process 19:39:01 matty_dubs: lol...Kaas++++ 19:39:10 anyone _not_ know what this topic is in reference to? 19:39:53 #link http://lists.openstack.org/pipermail/openstack-dev/2014-April/033081.html 19:39:56 just in case :) 19:40:13 the only think I was un happy with was... "the create bad BP" but I can also see the need for a place holder 19:40:25 I think bad is the wrong word 19:40:26 s/think/thing/ 19:40:29 devananda, using gerrit to manage/approve bps? 19:40:35 lucasagomes: yes 19:40:36 maybe skeleton is a better word for that 19:40:45 or incomplete 19:40:47 or place holder 19:40:51 sure 19:40:52 ya ++ 19:40:55 +1 place holder 19:40:56 lucasagomes: nova has adopted this. neutron and tripleo and several other projects are moving towards it as well 19:41:01 anything other then "BAD: 19:41:02 there's a summit track on this, too 19:41:09 #link http://summit.openstack.org/cfp/details/3 19:41:38 given that, I'm inclined to hold off on implementing anything in Ironic until after that summit track 19:41:44 s/track/session/ 19:42:04 devananda, right... I think it's a good move (as I expressed in the ML), we def need a better way to track bps and approve them 19:42:14 I would vote to adopt the nova standard after reviewing it 19:42:40 cool 19:42:54 one thing I feel about the nova model, is that the template they use for creating a bp is hmm too complicated... I felt that they assume that they person that is proposing the bluepring knows everything before they start 19:43:03 so I think we should have it a bit more flexible 19:43:16 approve the idea, but leave some implementations details 19:43:17 for later 19:43:26 devananda: and is a bit much for our needs 19:43:31 lucasagomes: *nod* 19:43:46 +1 lucas 19:44:03 devananda, it's hard to figure out everything that is needed and going to impact before actually start coding it 19:44:11 I kind of like the implementation being in it 19:44:13 we need a flexible template for the submitions 19:44:19 you can leave it blank on first iterations of the BP review. 19:44:24 comstud, me too, but it's not always possible 19:44:37 to get an idea if it's worth figuring out the implementation 19:44:44 comstud, yeah, having some "phases" of development is fine for me 19:44:53 comstud: right, but wherever this gets written down should explicitly say that so people aren't -1 with 'lol incomplete' 19:45:05 if you don't review the implementation... 19:45:07 Isn't that how patches unfold anyway? Multiple revisions with inline comments? 19:45:13 you'll get a lot of crap code that you have to just -2 anyway 19:45:16 lucasagomes: yes. I see this process as a way to reduce the amount of forgotten gottcha's incountered implamenting BP's 19:45:25 i dunno, just my thoughts offhand 19:45:46 is it supposed that we'll start implementing only after final approval of bp? or we are going to have kind of stages? 19:45:47 and the amount of very incomplete/vague BPs that get left hanging (or rejected) because LP is a terrible forum 19:45:50 to discuss features 19:46:00 vkozhukalov: yes -- implementation only after BP is approved 19:46:22 vkozhukalov: one purpose is to create a better system for discussion of features (impact, implementationd etails, API changes, etc) 19:46:22 Is there a risk that BPs will take as long to review as patches? Potentially bouncing around for weeks? 19:46:32 matty_dubs: yes! that's good though! 19:46:36 I think impl before BP is approved is fine.. it's up to you if you want to risk your time 19:46:40 it's sometimes nice to have reference 19:46:51 it just won't be +A'd until BP is +A'd 19:46:54 heh 19:46:54 yeah i like that ^ as well 19:47:07 but we can't approve it before it's approved 19:47:12 I mean, can't approve the code 19:47:23 comstud: ++ yes dev just understands that the BP may get changed 19:47:33 lucasagomes: yes 19:47:42 one (if not the main) purpose of this is to create a better system for discussion of features (impact, implementationd etails, API changes, etc) 19:47:49 since launchpad blueprint interface is really terrible for that discussion 19:48:01 it's a good reference point, once the feature is agreed upon, though 19:48:05 eg, for generating release notes 19:48:17 devananda: how will BP tracking work? 19:48:20 just look at any blueprint that's been around for a few months and had a lengthy design discussion 19:48:29 Shrews: see the original email. it's detailed there 19:48:58 Shrews: tldr; review in gerrit -> +2/+A -> copy/paste to launchpad -> don't change after that (except for status updates) 19:49:29 devananda: will that cut/past be done by the approver? 19:49:30 #agreed a more formal (ie, in gerrit) BP review process is good, but we're not going to implement anything until (after) the summit 19:50:01 #agreed and we need to strike a balance, appropriate for Ironic, between beign too heavy-handed with early requirements and stifling developers 19:50:28 we've got 10 min left, so i'd like to move on 19:50:38 #topic integration tests 19:50:49 adam_g: any updates from last week? 19:51:10 so 19:51:14 http://logs.openstack.org/92/89392/1/check/check-tempest-dsvm-virtual-ironic/26a0ac0/logs/testr_results.html.gz 19:51:24 all is passing except one neutron test, which im working on right now 19:51:33 awesome! 19:51:35 the functional scenario test is up and passing. should have everything green this week and we can start relying on it 19:52:08 nice! 19:52:15 thats about it on the QA side 19:52:20 adam_g: think it's time that we prepare a change to infra to enable it? 19:52:43 devananda, as in get it added as a non-voting job to the other pipelines? 19:52:46 adam_g, good stuff! 19:53:24 adam_g: at least move it out of experimental 19:53:26 on the tripleO tests I am not seeing the node post back to our api. I am not seeing any errors in the deploy it self, so I am digging into firewall type issues atm 19:53:50 devananda, sure. what projects do we want it checking? ironic, nova, neutron, tempest, devstack? or everything? 19:54:07 adam_g: same ones where tempest-dsvm-ironic runs today 19:54:25 NobodyCam, where are they running? i wrestled with similar issues last week and it turned out to be firewalling 19:54:57 adam_g: actually, i think it -virtual-ironic is already a non-voting job in all the right places 19:55:02 NobodyCam, or, do you have a URL of some failed results? 19:55:23 devananda, okay, cool. ill see what needs to change to get it moved out of experimental and set it as WIP till our tests are green 19:55:42 adam_g: any tripleO-undercloud-ironic test from https://review.openstack.org/#/c/85529/ 19:55:45 thanks 19:56:09 #topic open discussion 19:56:27 4 minutes left :) 19:57:03 * NobodyCam is really thinking of how to work in Kaas as a ironic easter egg 19:57:29 devananda, I will try to break the oslo messaging patch into small pieces tomorrow 19:57:37 devananda, thanks for the review 19:57:37 rebuild command is nearly done. just need to deal with nova not liking that the node is already powered on. 19:58:15 lucasagomes: I'm OK with it beign a large patch -- it's very interrelated 19:58:18 lucasagomes: just hard to review 19:58:48 devananda, yeah... lots of changes and the commit message is horrible listing all the changes as bullet points 19:59:17 one minute 19:59:53 Shrews: good stuff! perhaps we can just turn the ndoe off at the right time? :) 20:00:17 ok, thanks everyone! can't wait to see ya'll at the summit in a few weeks!!! 20:00:19 Thank you all! great meeting 20:00:27 is there a meeting next week 20:00:42 Is it a holiday? 20:00:47 NobodyCam: why wouldn't there be? 20:00:54 afaik, we have 2 more meetings before the summit 20:00:56 ??? not sure 20:01:02 :) 20:01:04 ok 20:01:08 #endmeeting