17:00:04 #startmeeting ironic 17:00:05 Meeting started Mon Mar 13 17:00:04 2017 UTC and is due to finish in 60 minutes. The chair is dtantsur. Information about MeetBot at http://wiki.debian.org/MeetBot. 17:00:06 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 17:00:07 o/ 17:00:08 The meeting name has been set to 'ironic' 17:00:16 o/ 17:00:19 o/ 17:00:19 o/ 17:00:25 o/ 17:00:26 o/ 17:00:30 o/ 17:00:37 o/ 17:00:39 o/ 17:00:52 \o 17:00:56 welcome everyone, thanks for coming! 17:00:58 \o/ 17:01:02 let's give folks a few more minutes to join 17:01:07 o/ 17:01:12 o/ 17:01:14 o/ 17:01:17 o/ 17:01:25 \o 17:01:38 o/ 17:01:48 o/ 17:01:55 as usual, our agenda is at 17:01:58 #link https://wiki.openstack.org/wiki/Meetings/Ironic 17:02:11 a few things to discuss today, good :) 17:02:18 #topic Announcements / Reminders 17:02:31 the main announcement is that the pike priorities are approved! 17:02:35 o/ 17:02:37 #link http://specs.openstack.org/openstack/ironic-specs/priorities/pike-priorities.html 17:02:41 o/ 17:02:55 so, I've updated the whiteboard with all the topics we have there 17:03:18 you have a few minutes more to write your status updates ;) 17:03:23 (but please do it in advance) 17:03:32 also 17:03:59 please keep generating ideas for ops adopt-a-project: 17:04:02 #link https://etherpad.openstack.org/p/ops-adopt-a-project-pike 17:04:37 next, a boot-from-volume subteam meeting is scheduled now: 17:04:41 #link https://wiki.openstack.org/wiki/Meetings/Ironic-BFV 17:04:51 please add to your calendars, if you're interested 17:05:06 and the last thing from me: 17:05:09 #info dtantsur is checking health of 3rdparty CI currently. If you get a email, please act accordingly. 17:05:11 dtantsur: who is "ops" re: that etherpad 17:05:26 dtantsur: Is that some kind of OpenStack Operators group? 17:05:30 JayF: osic ops team :P 17:05:34 JayF, details are there, but I think there is a group of ops interested in improving certain projects 17:05:37 melvin's thing 17:05:39 ah, yeah, this is more detailed ;) 17:05:55 jroll: okay, that answers my question. Was curious if it was the OSIC thing or something different 17:05:59 :) 17:06:16 dtantsur: i didn't understand the last thing. 'if you get a email...'.? 17:06:16 anyone has anything else to announce? or any questions? 17:06:22 rloo, if you don 17:06:29 o/ 17:06:29 don't get a email - no need to bother 17:06:33 dtantsur: what email? 17:06:50 rloo, sigh, which you did not get, because you're not a 3rdparty CI owner 17:06:59 dtantsur: you mean, if you send an email? 17:07:05 dtantsur: OH. 17:07:05 o/ 17:07:13 dtantsur: thx for explaining. 17:07:25 I'm writing to certain folks maintaining about 3rdparty CI about problems I've spotted 17:07:29 I think the third announcement (3rd party CI) kills one item from the Discussion section! 17:07:46 soliosg, not entirely kills, let's get to it in its time 17:07:54 ack 17:07:56 anything else? questions? 17:07:59 dtantsur: thx, i didn't know if you meant if our patch got 3rd party CI failure or somethin' like that 17:08:18 rloo, sorry, please bear with my English :) 17:08:30 (5 months more!) 17:08:32 dtantsur: no worries; that's why i asked :D 17:08:47 dtantsur: you aren't counting down, are you? ;) 17:08:54 ofc I'm not ;) 17:08:58 * JayF bear metals with dtantsur's english 17:09:06 \o/ 17:09:10 ok, moving on :) 17:09:15 #topic Review subteam status reports 17:09:27 we need MOAR of them! 17:09:29 #link https://etherpad.openstack.org/p/IronicWhiteBoard 17:09:38 starting with line 94 17:10:15 * jlvillal sometimes wonders if dtantsur knows about "more" ;) 17:10:28 * dtantsur does not, obviously :) 17:10:36 :D 17:10:36 TheJulia: can i update the BFV status stuff? 17:10:56 TheJulia: I don't think L119 is still true? 17:11:19 * TheJulia raI just removed 119 17:11:32 thx TheJulia! 17:12:00 rloo: and the real answer is I would expect anyone to be willing/able to update anything that is pertinent, but that is just me :) 17:12:16 o/ 17:12:29 TheJulia: yes, just didn't know if you were in midst of updating or not :) 17:12:38 is mario around? 17:12:43 he's out 17:12:46 I was and then was distracted 17:12:49 JayF, re rescue report, do you think we could just link to the gerrit topic instead of listing all patches? 17:12:50 mario did some work on the osc default api version change 17:13:03 #info Almost complete with making multi-node multi-tenant grenade working. This has been a long road. Will need to change the experimental job to a non-voting job. 17:13:07 dtantsur: sure, I can update it for that way next week 17:13:11 thnx 17:13:16 dtantsur: better way to clean that up is for more reviews and landings ;) 17:13:39 true :) 17:13:57 With mario out this week, I'll try to update those patches based onreview feeback 17:14:44 so not much status wrt network-related stuff 17:15:14 yep. I hope it's because I only added the new subteams today. 17:15:27 nice that redfish driver spec has been approved! 17:15:33 \o/ 17:15:40 JayF, ++ I will keep on reviewing the rescue stuff, it's close I think 17:15:43 rloo, ++ o/ 17:15:53 lucasagomes: so is sushy under ironic umbrella? 17:16:04 rloo, not yet, this is something i would like to discuss 17:16:13 perhaps open discussion today ? 17:16:28 yep, let's leave it (I'm +1) 17:16:36 * leave it for open discussions 17:17:16 2 minutes to review the subteam reports 17:17:47 lucasagomes: i added a note about sushy & ironic in that subteam thing 17:17:59 rloo, oh ok thanks 17:18:06 * rloo good with subteam reports 17:18:31 before we move on: quick poll: do we find our Trello board still useful? answers: yes/no/let's talk later? 17:18:39 * dtantsur votes no 17:18:46 yes if it is kept up to date 17:18:56 I'm also a no, too many different ways of tracking work 17:19:05 I never looked at the trello board, personally 17:19:05 no 17:19:20 I was mostly the only one that updated it, and so assumed I was the only one that looked at it 17:19:36 and the subteam reports are now good enough that I rarely use it 17:19:37 I looked at it 17:19:51 i look at it sometimes, because that info isn't readily available anywhere else. if we put that info in subteam reports, then we don't need. 17:19:56 and it was misleading for me, but only because it seemed outdated 17:20:00 rloo: which info? 17:20:12 ok, this does not seem like an easy win, let's postpone is till open discussion, or even bring to the ML 17:20:14 overall, nova & ironic specs, patches 17:20:21 ah 17:20:25 it was just a quick poll, thanks :) 17:20:32 #topic Deciding on priorities for the coming week 17:20:39 * jroll votes no, just for the record 17:21:02 priority #1 has been in merge conflict for some time, we should remove that 17:21:10 ++ just wanted to propose 17:21:20 I'd also remove node tags, takes more time than we expected 17:21:36 and get rescue there instead. or BFV. or both. 17:21:42 +1 17:21:56 we need to keep pushing on BFV or we won't get it done this cycle 17:21:57 +1 for rescue 17:22:05 need to get some chunk of it done each week 17:22:13 the standalone stuff that vsaienk0 is working is in good shape as well 17:22:14 let's take the first patch of BFV, and a couple of rescue 17:22:18 * dtantsur finds links 17:22:26 (I haven't looked at the fixes you pushed today yet vsaienk0 sorry, didn't have time) 17:22:38 jroll: priority 1 = stand-alone testing? 17:23:03 don't ask me, I have no clue what's going on :) 17:23:08 oh that 17:23:20 jroll: From your comment on "merge conflict" 17:23:22 jlvillal: no, it was previously some tempest tests for portgroups/vifs 17:23:34 jroll: Ah, okay. Thanks! 17:23:39 jlvillal, I've removed the item with conflicts 17:23:45 now yes, it's number one for me 17:23:56 Thanks. I wasn't fast enough reading the whiteboard... 17:24:16 I'm not going to be here next Monday, but I'd suggest for next week we make rescue patches a priority 17:24:16 JayF, what should we take from rescue? 17:24:28 I would wait until next week as mario is out this week 17:24:29 I suggest taking one patch from it already 17:24:31 ah, ack 17:24:32 * lucasagomes is not Jayf, but he thinks the API part 17:24:35 I'll get it through at least one round of review today 17:24:35 TheJulia: sorry, remind me. how much of bfv needs to land before doing the nova part? all of it? 17:24:39 s/today/this week/ 17:24:42 * dtantsur looks around 17:24:48 and then if everyone bears down on it next week we can land it 17:24:51 Redfish driver then? seems like an easy win 17:24:59 rloo: The majority of it, and the volume connection API 17:25:04 dtantsur: how do we feel about related nova patches going in there? 17:25:04 s/driver/hardware type/, right? :) 17:25:19 yeah it's only a hardware type and 2 interfaces (power and management) 17:25:26 TheJulia: ok, would be good to work backwards from nova deadlines, to have an idea as to when to target the work 17:25:32 I didn't create a old-style driver, I think we don't need it. right ? 17:25:39 lucasagomes: +1 from me 17:25:42 rloo: agreed 17:25:45 JayF, you mean, on the list? well, depends on how actionable from our part they are 17:25:47 lucasagomes: ++ exactly, it's explicitly disallowed to create new oldstyle drivers iirc 17:25:52 cool 17:26:08 dtantsur: frantically looking for the link, but gerrit doesn't share my urgency 17:26:19 JayF: dtantsur: fwiw, I plan to start keeping my own list of important nova patches, and asking for help with reviews when needed 17:26:43 jroll, that would be super helpful 17:26:43 idk that we need the whole team prioritizing nova patches 17:26:56 ++ (though I do keep a list in my gertty) 17:26:59 dtantsur: jroll: https://review.openstack.org/#/c/441544 is the one I was referring to, honestly I just want someone ironic other than just me to look at it :) 17:27:10 ya, figured, already on my list :) 17:27:17 * jroll says that before it loads... 17:27:19 yeah 17:27:21 that one :D 17:27:25 JayF, will check as well 17:27:34 still don't think it should be on the list for everyone tbh 17:27:39 so redfish driver is optional. maybe we should instead review ipa rest api version spec instead? 17:27:47 dtantsur: I'm fine with that, just like I said, goal was more-than-just-jay :) 17:27:57 also fault support spec needs reviews 17:27:59 rloo, just wanted to get it out of our radar finally 17:28:24 dtantsur: i understand, but the ones that need spec reviews will never move along w/o the specs being approved. 17:28:29 * dtantsur is worried about landing too many specs before we land code from previous specs 17:28:39 dtantsur: and those ones have higher priority than redfish driver 17:28:43 i need reviews on the custom deployment steps as well 17:29:10 i have a pair of -1s to answer, but i'd like to get more feedback 17:29:14 everyone's spec needs review ;) I'd like to move specs to "finished", not only "approved" from time to time ;) 17:29:17 fault support spec is probably not close enough to be a priority 17:29:20 yolanda: yes, but that is optional, the others i mentioned are higher priority 17:29:25 but I'd love for more interested people to look at it, as we have a new patchset up 17:29:32 but if everyone thinks I'm wrong, I'm ready to drop specs there instead 17:29:39 JayF: what do you mean, the spec needs more work for fault support? 17:30:01 Yeah, I think we're going to have to prototype some of the code to wrap oour heads fully around the driver apis for it 17:30:17 but the rest APIs are 100% laid out 17:30:29 JayF: so we shouldn't review it for now? 17:30:48 I would love a review from folks, but I don't think it's priority, and anyone reviewing should be aware it's about 80% done 17:31:01 JayF: ok, going to add a comment to that effect. 17:31:17 IPA API seems close, so I'd take it instead of low-priority E-Tags https://review.openstack.org/#/c/341086/ 17:31:27 wdyt? 17:31:43 I'm not opposed 17:31:50 rloo? 17:31:53 I haven't reviewed that yet but sounds fine, /me adds to his list 17:31:53 sigh. no, i think we should leave etags spec. 17:32:11 cuz... there was movement in that spec last week, probably? cuz it was a priority. we should get it approved soon. 17:32:30 dtantsur: but i think it would be good to add ipa api version spec too 17:32:39 ok, 6 items be it. please work hard :) 17:33:04 I hope sambetts_ is around to update it 17:33:31 we have 6 items on priorities. any more comments? 17:33:40 * dtantsur wants to move to the discussion 17:33:41 if anyone finds out about sambetts_ availability; if he isn't, please scratch that priority 17:34:03 or we can update it ourselves 17:34:40 meanwhile, who wants to be the bug triager this week? mjturek wanna continue? :) 17:35:01 dtantsur: I wouldn't mind! I'm getting the swing of it 17:35:11 cool! 17:35:15 fyi - https://etherpad.openstack.org/p/ironic-bug-triage 17:35:21 #action mjturek to continue helping with bug triage 17:35:26 #link https://etherpad.openstack.org/p/ironic-bug-triage 17:35:37 keeping a summary of what I changed 17:35:42 thanks! 17:35:45 np 17:35:49 thanks for doing that, mjturek :) 17:35:56 any comments before we move on? 17:35:59 np jroll :) 17:36:22 #topic Impressions about third party CI gate jobs that usually fail, reasons they fail, and how we can help to fix them 17:36:36 as I already said, I started reaching out to maintainers about their CI 17:36:47 still, it's a bit hard to measure quality of each CI 17:36:53 do we have any formal metrics? 17:37:01 also soliosg, sorry, it was your topic :) 17:37:39 this site gives some pass/fail metrics http://ci-watch.tintri.com/project?project=ironic&time=7+days 17:37:41 Yeah, I added this item because it seems we don't pay attention to 3rd party jobs now, passing or failing 17:37:46 jroll++ I was using it 17:37:50 #link http://ci-watch.tintri.com/project?project=ironic&time=7+days 17:38:07 soliosg, I do. but I agree, it's hard to pay attention when they are random 17:38:20 I also don't like HTTPS error on half (or all?) of logs sites 17:38:36 ya, we need to get folks improving these systems 17:38:43 #action dtantsur this week goes over the list of CI and contacts maintainers if he spots any problems 17:38:47 Thanks soliosg and dtantsur. I do sometimes wonder if some of the 3rd Party CI is not living by the spirit of what we want. Since I see so many of them fail again and again. 17:38:49 which is something I started already 17:39:08 And one purpose of the 3rd Party CI is so they can keep their drivers in tree 17:39:18 I've even see one CI passing on a patch when our CI was all red 17:39:30 I'm going to follow up with the maintainers on it 17:39:42 dtantsur: Right, such randomness is what makes difficult to pay attention to 17:40:09 dtantsur: I'd personally be interested in a summary of that work, maybe to the mailing list? 17:40:23 dtantsur: i.e. if a given 3rd party CI is super reliable, that's a great input to code reviewing, as is the alternate 17:40:24 when we initiated this, did we note down what we expected from 3rd parties? wrt success/failure rates, etc? 17:40:31 JayF, which kind of summary? I don't want to call names, though they're obvious 17:40:54 rloo: yeah, I remember that stated in the spec 17:41:11 dtantsur: Calling names being specifically what I wanted; like "These CIs: blah, blah, blah, are passing reliable, whereas these have the following issues..." 17:41:20 dtantsur: not so much to call them out but to inform me as a reviewier 17:41:22 rloo: yeah, we kinda dropped the ball on getting it in docs: https://docs.openstack.org/developer/ironic/dev/third-party-ci.html 17:41:23 dtantsur: but up to you 17:41:35 rloo: the spec has some rough numbers though 17:41:47 JayF, ok, I'll think about it. I still need more data collected, 7 days is not too much. 17:41:52 jroll: we should pick up the ball then... 17:41:52 slightly related: would you prefer a consistently failing CI still reporting? (context: I am one of maintainers of IBM PowerKVM CI, and turned off reporting on ironic for now) 17:42:28 good question 17:42:36 maybe we should have some status page for such cases 17:42:39 mmedvede, do we have such information exposed somewhere? 17:42:42 rloo: sure, I don't know that I have time 17:42:46 vdrok, we have a wiki, in theory 17:42:58 #link https://wiki.openstack.org/wiki/ThirdPartySystems 17:43:01 jroll: heh, let's ask for a volunteer :) 17:43:31 dtantsur: oh, cool 17:43:36 FYI these are the third party CI requirements for all of openstack, which includes a wiki page for each system: 17:43:38 #link https://docs.openstack.org/infra/system-config/third_party.html 17:43:40 mmedvede, yours is not marked as being down on https://wiki.openstack.org/wiki/ThirdPartySystems 17:44:03 dtantsur: so, we use the same user also for nova, so it is fine there 17:44:11 I'm using this wiki page, and its subpages to figure out the expected status 17:44:23 mmedvede, well, you can at least update the "comments" field with "broken for ironic" or something 17:44:31 dtantsur: ack 17:44:36 thanks! 17:45:30 anyone wants to pick back https://docs.openstack.org/developer/ironic/dev/third-party-ci.html ? 17:46:16 dtantsur: if nobody picks it up now, if someone can summarize it in a bug I bet I can find someone to pick it up 17:46:32 whoever does, should talk to krtaylor to find out where its at 17:46:35 JayF, well, I'd pick it, but I don't know certain details, like required changes 17:46:40 summary: "decide on final third party CI requirements and write them down" 17:46:41 ++ for talking to krtaylor first 17:46:50 dtantsur: do you plan any requirements change for 3rd party CI? 17:46:53 the second part of that is easy 17:46:56 the first not so much 17:47:02 nicodemos, not before we make them reliably working.. 17:47:12 fyi krtaylor is out today 17:47:14 (e.g. decide if requiring to report within 8 hours is reasonable or not) 17:47:30 let's start with collecting some statistics and reporting back 17:47:43 there's some details here but they are old, need to be reviewed again http://specs.openstack.org/openstack/ironic-specs/specs/6.2/third-party-ci.html 17:47:44 I can figure out gerrit API and write something like a custom dashboard (if there is no existing) 17:47:48 I have noticed at least one CI voting a day or two later. 17:47:53 sounds like an action? 17:48:03 dtantsur: ++ 17:48:15 thx dtantsur for volunteering ++ 17:48:17 dtantsur: maybe talk to cinder PTL, they might have something already 17:48:33 #action dtantsur to collect / write a tool / find a tool to collect advanced statistics about 3rdparty CI 17:48:37 jroll++ 17:49:03 what about that ci page -- JayF wanted someone to open a bug against it? 17:49:16 let's open a placeholder bug for sure 17:49:34 rloo: I only wanted a bug because then it's easier to delegate 17:49:38 something like "Populate this page with real data: " 17:49:42 rloo: if someone is going to JFDI I don't care abouta bug :) 17:50:03 ok, no bug needed. if someone wants one, please open it. 17:50:06 let's move on now :) 17:50:10 10 minute warning 17:50:12 yeah, let's move on 17:50:21 #topic Status check on having a local copy of tempest manager.py 17:50:33 tl;dr: do we still need it? soliosg, pas-ha? 17:50:51 I believe we still needed 17:51:20 soliosg: why 17:51:21 From Andrea's reply to pas-ha, it sounded like QA wants to stick to the original plan 17:51:25 yup, I guess the outcome of the ML discussion was to have it 17:51:38 so that not to increase the amount of jobs 17:51:51 That is how I read the email thread. Need to make a local copy in Ironic. 17:51:56 soliosg: please update that patch then, with link to mailing list and the summary, and then lets get on with it :) 17:52:05 rloo, ++ 17:52:09 yeah, it's only temporary, let's just get it done 17:52:25 note that a follow-up to this patch should be trimming this file down to what's needed for our CI to pass.. 17:52:34 Ack 17:52:38 just in case temporary is not too temporary.. 17:52:43 thanks soliosg! 17:53:01 #agreed we'll continue with carrying manager.py (or it's slimmer version) in-tree for now 17:53:12 moving on? 17:53:19 #topic Boston summit/forum brainstorming 17:53:26 #link http://lists.openstack.org/pipermail/openstack-dev/2017-March/113115.html 17:53:38 rloo, that's you 17:53:52 to be clear, my intent was NOT to actually do brainstorming today. i just wanted to bring it up 17:54:14 what is ironic's involvment (if any) going to be at the summit forum. 17:54:15 yeah. this may be driven by people who actually go to Boston 17:54:17 Have we created an etherpad yet? 17:54:24 there's action items on there, fwiw, we should do those 17:54:24 not me 17:54:26 I haven't 17:54:48 I can start an etherpad, but it's probably not fair for me to populate it, as I don't plan to go 17:54:48 rloo: I know at least 2 ironic people that plan to go 17:55:02 as a group/ironic, do we actually want/care about this? 17:55:16 https://etherpad.openstack.org/p/BOS-ironic-brainstorming ? 17:55:21 dtantsur: as PTL, I think you should help populate it, surely you have questions for deployers/ops/users :) 17:55:33 thx TheJulia! 17:55:34 rloo: about getting fedback from deployers/ops/users? I hope we do 17:55:43 I can help, sure, but I want people actually present to be aware of it ;) 17:55:47 jroll: i hope so too but didn't want to assume anything ;) 17:55:52 I care about it, and I can put some stuff in sometime over the next few days 17:55:53 dtantsur: yeah, fair 17:55:53 thanks TheJulia 17:55:56 #link https://etherpad.openstack.org/p/BOS-ironic-brainstorming 17:56:03 TheJulia: thanks! 17:56:25 anything else here before we move on? 17:56:41 #topic Open discussion 17:56:46 lucasagomes, sushy time? ;) 17:56:50 also 3 minutes left 17:56:51 well 4 minutes heh 17:57:01 so, sushy under the Ironic umbrella. What do you guys think about it ? 17:57:03 +2 17:57:06 +2 17:57:12 +a 17:57:13 the library is pretty small, 792 LOC with unittests included 17:57:13 lol 17:57:14 +2 17:57:16 lol 17:57:16 ok 17:57:16 if we position sushy as ironic-specific redfish library, it should be under ironic governance for sure 17:57:28 +2 we want redfish :) 17:57:30 dtantsur: which we should :) 17:57:47 if we plan on general-purpose library.. I hope we don't :) 17:57:49 ok I will put a patch for the governance doing that then :D 17:58:06 what are the options? if it isn't under ironic umbrella, then what? 17:58:07 what's ironic planfor redfish-python? 17:58:10 dtantsur: if someone wants to make it a general purpose lib, I suggest we let them and try to rope them into revieiwng more ironic things ;) 17:58:16 rloo: I'd assume not-big-tent, not governed at all 17:58:18 dtantsur, it's ironic-specific and I prefer to keep it that way 17:58:27 JayF++ 17:58:42 Ironicers, I'd like to ask some review in https://review.openstack.org/#/c/408298 17:58:55 wanyen, I think the idea was, when pyhton-redfish is mature enough we will re-evaluate it 17:59:04 wanyen: we don't plan to use python-redfish, there are architectural problems with it that make it a bad fit for ironic right now 17:59:09 and what lucasagomes said :) 17:59:16 wanyen, that's what I got from the spec, because at the moment (you can check the comments in the spec itself) we can't use it 17:59:20 I like to understand Ironic's plan for redfish-python lib. 17:59:28 it would remove some custom code from oneview drivers and use ironic deploy implementation instead :) 17:59:32 wanyen, it's in the spec 17:59:33 wanyen, let's talk about it when it's ready 17:59:51 nicodemos, will try to get to it 17:59:53 and we're at time 17:59:55 yep 17:59:55 ish 17:59:58 thanks everyone 17:59:59 thanks dtantsur ! 18:00:02 o/ 18:00:02 thank you all 18:00:04 thks all! 18:00:04 #endmeeting