17:00:48 <jlvillal> #startmeeting ironic_qa
17:00:48 <openstack> Meeting started Wed Jun  8 17:00:48 2016 UTC and is due to finish in 60 minutes.  The chair is jlvillal. Information about MeetBot at http://wiki.debian.org/MeetBot.
17:00:49 <openstack> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote.
17:00:51 <openstack> The meeting name has been set to 'ironic_qa'
17:00:56 <JayF> o/
17:00:58 <jroll> \o
17:00:59 <sambetts> o/
17:01:00 <rpioso> \o
17:01:00 <krtaylor> o/
17:01:03 <rloo> o/
17:01:08 <cdearborn> \o
17:01:15 <jlvillal> This snuck up on me as I was getting excited about Grenade :)
17:01:26 <jlvillal> As always the Agenda is at: https://wiki.openstack.org/wiki/Meetings/Ironic-QA
17:01:38 <jlvillal> #topic Announcements
17:01:56 <jlvillal> #info Grenade is almost done. One patch remaining to be merged!
17:02:22 <rloo> :D
17:02:23 <vdrok> o/
17:02:49 <devananda> \o
17:03:34 <jlvillal> #info Thank you to everyone who has worked on this. I would like to especially thank vdrok and vsaienko for their great work! спасибо!
17:03:46 <vdrok> :D
17:04:00 <jlvillal> Those are all the announcements I have before moving on to the Grenade section.
17:04:00 <vdrok> thanks jlvillal
17:04:01 <jroll> \o/
17:04:06 <jlvillal> Anyone have any announcements?
17:04:12 <jlvillal> vdrok: No, thank you :)
17:04:32 <jlvillal> Okay moving on
17:04:35 <jlvillal> #topic Grenade
17:05:09 <jlvillal> #info Down to one patch remaining. https://review.openstack.org/#/c/316662/  Currently has one +2 and a LOT of +1s
17:05:31 <jlvillal> #info JayF has graciously volunteered to submit a patch to move Grenade jobs from experimental to non-voting
17:05:41 <jroll> ++
17:06:01 <JayF> https://review.openstack.org/327246 Upgrade Ironic grenade jobs to -nv in check queue
17:06:16 <jlvillal> #info https://review.openstack.org/327246 Upgrade Ironic grenade jobs to -nv in check queue
17:06:29 <rloo> when it becomes non-voting, it'll be done for every patch, right?
17:06:34 <jlvillal> As a note Grenade jobs do take a long time to run.  About 90 minutes.
17:06:39 <jlvillal> rloo: Correct.
17:06:55 <rloo> OH. 90 minutes. wow.
17:07:05 <jlvillal> rloo: Currently it is experimental. So only ran if someone did a "check experimental" comment
17:07:14 <devananda> jlvillal: what projects' pipelines do you plan to put that job in?
17:07:17 <thiagop> Great job, folks
17:07:19 <jlvillal> Yeah, it basically runs the tests twice.
17:07:33 <jlvillal> devananda: openstack/ironic
17:07:44 <vdrok> oops https://review.openstack.org/#/c/319336/
17:07:54 <jlvillal> vdrok: ??
17:07:54 <vdrok> jayf jlvillal ^
17:08:08 <vdrok> there is another one already
17:08:33 <rloo> vasyl is one step ahead of us :)
17:08:39 <JayF> Shouldn't we also have the job -nv on grenade as well?
17:08:42 <JayF> So grenade doesn't break us?
17:09:01 <devananda> JayF: yea, tht's what I was thinking
17:09:10 <jroll> is partial doing what we expect it to yet? (what does it do today)
17:09:38 <jlvillal> #info We should propose to have the Ironic grenade job as non-voting on the Grenade job.
17:09:39 <JayF> I'll abandon my patch and comment on the one vdrok linked
17:09:53 <vdrok> thanks JayF
17:09:55 <devananda> JayF: we may or may not be able to make the job voting on grenade itself, but at least maintaining an -nv job there will help us spot issues
17:09:58 <jroll> I don't feel like we should have a non-voting job on partial if it isn't doing what we want (and iirc it isn't)
17:10:18 <JayF> What is the expected difference?
17:10:22 <vdrok> jroll: yep, I think so too
17:10:39 <jroll> JayF: partial should upgrade only conductor, not api
17:10:42 <jlvillal> I am not sure if partial is doing what it should be doing. I haven't dug into it.
17:10:48 <thiagop> What about the "post" pipeline?
17:10:49 <jlvillal> vdrok: Do you know?
17:11:11 <vdrok> jlvillal: iirc it only does the ironic upgrade
17:11:30 <vdrok> stops both api and conductor and then starts them again
17:11:33 <jroll> which is useful - but not what we're trying to do (yet)
17:11:39 <jlvillal> But maybe upgrading too much then?
17:11:45 <jroll> thiagop: that's for jobs that run after merge, tests aren't useful there
17:12:08 <jlvillal> So jroll, you want partial to only upgrade the conductor.  Correct?
17:12:28 <jroll> yes, that's intended to test the in-between for rolling upgrades
17:13:10 <thiagop> jroll: since grenade is an "upgrade" job, we could still fix things before the next release if the job is on post, right?
17:13:39 <jlvillal> #info Grenade partial job should only upgrade the Ironic Conductor service and not the Ironic API service
17:13:48 <jroll> thiagop: idk if I get your point or question?
17:13:50 <JayF> thiagop: post jobs are for things like publishing
17:14:01 <JayF> thiagop: you don't run post jobs to make sure things work, because they're post merge and that's too late
17:14:13 <jroll> thiagop: the goal is run non-voting for a bit, make sure it's stable, then make it voting in check/gate so we can't merge a break in
17:14:43 <thiagop> jroll: understood
17:14:50 <jlvillal> jroll: So we think the partial job is currently upgrading both Ironic services. Is that okay to be a non-voting job until we fix it to be only Conductor?
17:14:56 <jlvillal> Or hold off it until it is?
17:15:09 <JayF> I mean the only reason to promote it before it's working would be to avoid another round of reviews
17:15:11 <JayF> which is a silly reason imo
17:15:22 <JayF> and somewhat wasteful of resources
17:15:23 <jroll> thiagop: (fwiw, this is the usual process)
17:15:31 <jroll> yeah, that will just waste resources
17:15:34 <rloo> hold off. why spend 90 minutes on grenade when you don't have to
17:15:42 <jroll> ++
17:15:43 <thiagop> jroll: I know it is, just thinking about the time it tooks to run
17:16:05 <jlvillal> Are we talking about post jobs or the partial jobs. /me getting confused.
17:16:11 <jroll> thiagop: I think it's worth the extra 30 minutes to make sure we don't break master
17:16:34 <jlvillal> +++
17:16:38 <jroll> jlvillal: the partial jobs, would be a waste of resources
17:16:58 <jlvillal> Okay. So only make the one Grenade job voting for now
17:17:00 <jroll> (until they do the right thing)
17:17:06 <jroll> non-voting, but yes
17:17:24 <rloo> right, jroll commented in the patch https://review.openstack.org/#/c/319336/
17:17:27 <jroll> yep
17:17:36 <jlvillal> Just refreshed and saw. Thanks
17:18:03 <jlvillal> #info Will want to get the standard Grenade job made non-voting.  partial should not be made non-voting until we have partial only upgrading the conductor.
17:18:44 <jlvillal> Anything else for Grenade?
17:19:11 <jlvillal> Okay.
17:19:30 <jlvillal> Once again thanks to everyone :)
17:19:42 <jlvillal> #topic Functional testing
17:19:42 <sambetts> \o/
17:19:51 <jlvillal> Any updates?
17:19:58 <jroll> I have one!
17:20:04 <jlvillal> :)
17:20:08 <jroll> we decided last week to remove this from the agenda, iirc
17:20:09 <krtaylor> oh, I was going to remove this and General topics
17:20:11 <jroll> until someone is working on it
17:20:13 <jroll> :)
17:20:16 <krtaylor> yes
17:20:19 <krtaylor> :)
17:20:28 <jlvillal> #info remove functional testing from the agenda
17:20:34 <jlvillal> #topic 3rd Party CI
17:20:46 * krtaylor is doing that now
17:20:50 <jlvillal> Thanks
17:20:51 <krtaylor> oh, in  asec
17:21:02 <jlvillal> The floor now belongs to krtaylor
17:21:10 <jroll> I keep saying I'm going to get stackalytics updated but I've been lagging on that, apologies :(
17:21:21 <krtaylor> nothing to report from me, anyone have anyhting to discuss?
17:21:27 <krtaylor> jroll, what to update?
17:21:36 <jroll> krtaylor: rather make sure it's up to date
17:21:39 <jroll> e.g. drac driver is missing
17:21:41 <rloo> add an action item for jroll pleez
17:21:50 <krtaylor> jroll, gotcha
17:22:01 <jroll> rloo: it's already on personal todo list, that won't help me (but if it helps you bug me then maybe it's useful) :)
17:22:22 <rloo> jroll: just something to add to this meeting :D
17:22:26 <jroll> heh
17:22:29 <jroll> ok
17:22:49 <jlvillal> rloo: Add it to the Trello board ;)
17:23:01 <rloo> jroll: is that something that someone else could do instead?
17:23:16 <jroll> rloo: probably
17:23:26 <jroll> I tend to try and take gruntwork like that so y'all don't have to
17:23:47 <rloo> jroll: oh, thought it would be good to spread the gruntwork around.
17:23:53 <sambetts> I updated the Cisco drivers on there, shouldn't some of the driver owners be responsible for updating it?
17:24:00 * rloo doesn't volunteer though
17:24:03 <jroll> rloo: I'm happy to pass it off
17:24:09 <krtaylor> I'll take that on
17:24:12 <jroll> the reason I took it is I wanted to make very sure it was accurate
17:24:23 * jroll is a perfectionist here and there
17:24:27 <krtaylor> I've already crawled through most of it anyway
17:24:35 <jroll> krtaylor: <3, feel free to ping me for a review
17:24:48 <krtaylor> jroll, I can do it and then go over it with you for completeness
17:24:51 <krtaylor> ys
17:24:56 <jroll> ++
17:24:58 <jroll> thanks
17:25:13 <krtaylor> I've been using this too: http://ci-watch.tintri.com/project?project=ironic&time=7+days
17:25:26 <krtaylor> for watching what systems are reporting
17:25:36 <jroll> oh nice
17:25:50 <jroll> ++
17:25:57 * jroll puts on whiteboard so he can find it later
17:26:18 <sambetts> ++
17:26:21 <krtaylor> its also in the CI status wiki table header
17:26:24 <krtaylor> #link http://ci-watch.tintri.com/project?project=ironic&time=7+days
17:26:37 <krtaylor> oh, jlvillal may need to do that
17:26:48 <jroll> nah, #link works for everyone
17:26:54 <krtaylor> oh, good
17:27:00 <jlvillal> krtaylor: You can do it.
17:27:40 <thiagop> nice link krtaylor
17:28:15 <krtaylor> #action krtaylor to go through stackalytics and make sure all test systems are there, then review with jroll
17:28:52 <krtaylor> anything else from anyone on CI topics?
17:29:01 <JayF> Yes, but not 3rd party ci
17:29:28 <jlvillal> krtaylor: done?
17:29:51 <krtaylor> sure, lets move on
17:29:55 <jlvillal> #topic Open Discussion
17:30:01 <jlvillal> The floor is open.
17:30:14 <jlvillal> I think I saw JayF with his hand up...
17:30:21 <JayF> So I obviously got something merged last week to make Ironic jobs use tinyipa and ipxe instead of bigipa and regular-pxe
17:30:40 <JayF> I attempted to prove this lowered time it took to run CI using graphite.o.o, but it looked like wait_time values weren't populated
17:30:56 <JayF> if anyone knows how to navigate that stuff better than I, I'd love to be able to show a difference in speed of CI since the change
17:31:14 <JayF> the pass/fail rate is a little better, but honestly not enough data to make a call there yet
17:31:22 <JayF> that's all I wanted to say/ask
17:33:10 <jlvillal> Thanks JayF
17:33:17 <jlvillal> Anything else from anyone?
17:33:37 <JayF> Apparently everyone knows how to grab stats from the gate pipeline as well as I do :P
17:33:42 <JayF> (that is, not at all, lol)
17:34:15 <jlvillal> JayF: I'd love to learn how to do that!
17:34:32 <JayF> so would I, but I spent a little bit of time on it, got nowhere, and couldn't get anyone to help
17:34:38 <jlvillal> :(
17:34:45 <JayF> so I moved on to other things since it looks like those stats just don't exist in graphite
17:34:50 <jroll> JayF: might be worth a dev list email
17:35:03 <jroll> so it doesn't get lost in scrollback, and others can pick up on it
17:35:17 <JayF> and it'll be visible to qa and infra people
17:35:24 <jroll> ya
17:35:27 <JayF> Maybe so. Just didn't know if it was important enough to be worth it
17:35:37 <jroll> they're always keen on teaching people how to fish
17:35:46 <jroll> otherwise people just keep asking one by one
17:35:53 <jlvillal> JayF: I think an email would be worthwhile
17:36:22 <JayF> added it to my todo list
17:36:27 <jlvillal> thanks
17:36:37 <jlvillal> Okay, I think we seem to be done.
17:36:51 <jlvillal> Thanks everyone. Talk next week.
17:36:55 <jroll> thanks jlvillal
17:37:09 <JayF> o/
17:37:16 <jlvillal> Thanks to krtaylor for covering for me for the last two weeks with one planned and one unplanned absence :(
17:37:22 <vdrok> o/
17:37:28 <jlvillal> #endmeeting