21:04:15 #startmeeting nova 21:04:17 Meeting started Thu Sep 25 21:04:15 2014 UTC and is due to finish in 60 minutes. The chair is dansmith. Information about MeetBot at http://wiki.debian.org/MeetBot. 21:04:18 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 21:04:20 The meeting name has been set to 'nova' 21:04:21 #chair mriedem 21:04:22 Current chairs: dansmith mriedem 21:04:28 #link https://wiki.openstack.org/wiki/Meetings/Nova#Agenda_for_next_meeting 21:04:30 does that work? 21:04:33 I'm on a cell connection, so I can't run it 21:04:35 mriedem: yep, go 21:04:45 ok, juno rc1 21:04:51 o/ 21:04:53 sdague just dumped 3 bugs on the list, those are in the agenda now 21:04:56 oh yeah who's here? 21:05:02 o/ 21:05:07 o/ 21:05:09 o/ 21:05:10 o/ 21:05:15 o/ 21:05:38 cool so juno rc1 is supposed to be today 21:05:45 this is the rc1 bug list https://launchpad.net/nova/+milestone/juno-rc1 21:05:48 #link https://launchpad.net/nova/+milestone/juno-rc1 21:06:15 o/ 21:06:18 9 open, 6 of those in progress 21:06:44 sounds like we might have a patch for something similar to https://bugs.launchpad.net/nova/+bug/1373962 21:06:45 Launchpad bug 1373962 in nova "LVM backed VM fails to launch" [High,Confirmed] 21:06:55 so if someone can dig that up (ML?) it'd be good 21:07:15 another confirmed is https://bugs.launchpad.net/neutron/+bug/1357476 21:07:19 Launchpad bug 1357476 in nova "Timeout waiting for vif plugging callback for instance" [Critical,Confirmed] 21:07:25 dansmith: you improved logging for that, 21:07:28 but not sure if anything has changed 21:07:32 or if we've noticed 21:07:43 ah, yeah, was waiting to get a post-patch hit on that 21:07:45 mikal noted we should untarget from rc1 if it's not being worked, i'd second that 21:08:02 we should try to see if it's still getting hit before we do I think 21:08:10 ok 21:08:12 at least so we know if it is a thing we're capable of looking at 21:08:19 do we have a query? 21:08:19 I'm out tomorrow, otherwise I'd do that tomorrow 21:08:21 * mriedem looks 21:08:24 we must 21:08:37 running it 21:08:47 #link http://lists.openstack.org/pipermail/openstack-dev/2014-September/046741.html 21:08:56 that's the ML post about the LVM issue with config drive 21:08:57 #action see if https://bugs.launchpad.net/neutron/+bug/1357476 is still a problem 21:08:59 Launchpad bug 1357476 in nova "Timeout waiting for vif plugging callback for instance" [Critical,Confirmed] 21:09:08 0 hits in 7 days 21:09:28 heh, well, can't be that big of a deal then 21:09:32 I say untarget 21:09:35 ok i'll untarget 21:09:48 so, on the LVM thing 21:10:07 looks like maybe mikal thought that the only consequence was not being able to have an LVM-formatted configdrive 21:10:19 is this flwang's patch for rbd then? 21:10:22 but I think the bug is about using LVM breaking configdrive incidentally, right? 21:10:38 I don't think so, that's for evacuate and unrelated AFAICT 21:10:41 ok 21:11:35 it's not popping out to me if there is a related patch up for that issue from the ML 21:11:38 anyway, moving on 21:12:05 this is the other rc1 bug https://bugs.launchpad.net/nova/+bug/1323658 21:12:07 Launchpad bug 1323658 in nova "Nova resize/restart results in guest ending up in inconsistent state with Neutron" [Critical,Confirmed] 21:12:10 yeah, don't see it 21:12:27 arosen isn't here 21:12:35 so, on that 21:12:44 I worked with him for a few days to try to get to the bottom of it 21:12:55 he actually thinks that it's a sequencing thing in the tempest test, 21:13:02 and not something that actually matters in the real world 21:13:12 ok, still top gate bug 21:13:17 but tempest... 21:13:22 yeah, but not critical for the release as a result 21:13:27 based on what I heard last 21:13:33 so, painful, but not something we need to hold up for 21:13:48 ok, i'll untarget rc1 21:14:28 ok so that leaves the lvm thing for rc1 21:14:36 anything else on rc1? 21:14:40 When mikal pops up, 21:14:50 we should make sure he looks at the LVM thing, since we think he might've broke it 21:15:16 then he can decide if it can wait for rc2 or if it's worth delaying rc1 21:15:27 sure, we have mikal's revert linked into the bug 21:15:48 what's the tag for a new topic? topic? 21:15:59 I think 21:16:04 #topic bugs 21:16:14 like a pro 21:16:19 \o/ 21:16:34 i added 3 bugs here https://wiki.openstack.org/wiki/Meetings/Nova#Weekly_Nova_team_meeting 21:16:52 one is the lvm config drive rc1 bug 21:17:07 one is https://bugs.launchpad.net/nova/+bug/1371677 which is our happy periodic task / resize timeout bug 21:17:09 Launchpad bug 1371677 in nova "Race in resource tracker causes 500 response on deleting during verify_resize state " [Critical,Fix committed] 21:17:24 since e-r is backed up to hell we don't know if dansmith's latest pach for that has resolved it 21:17:30 still like five hours away from e-r showing us anything 21:17:54 we suspect we still need some logic in the libvirt driver to check if the volume exists before calling (blocking) blockdev to get the volume size, because danpb said that'll hang if the volume is gone 21:17:57 which is causing the timeout 21:18:07 well, 21:18:09 i didn't get a chance to work on that today 21:18:13 but we'll be doing that without the lock, 21:18:22 so it will only delay the periodic, but not really a probem right? 21:18:32 i'd have to double check 21:18:39 that's my understanding, FWIW 21:18:42 Its also odd that we have an RPC CALL (versus cast) in nova-delete in this case 21:18:55 jogo: cyeoh said there were some notes in the code on why that is 21:18:59 i didn't look last night though 21:19:05 yeah, there is some reson 21:19:08 mriedem: yeah but I think we can do better 21:19:08 I forget why 21:19:15 cyeoh said some other race 21:19:24 dansmith: it has to check the source of the migrate 21:19:30 before moving on or something 21:19:37 dansmith: ok, so you moved the lock past this now: 21:19:37 resources = self.driver.get_available_resource(self.nodename) 21:19:39 but maybe long term we can move this logic to the conductor so it can be async 21:19:44 mriedem: right 21:19:45 that's what would be eventually hitting the blockdev call 21:19:45 ok 21:19:48 from API 21:20:07 alright, so thinking dansmith's fix is good 21:20:13 we'll find out when e-r flushes 21:20:31 the 3rd bug that sdague had listed was https://bugs.launchpad.net/keystone/+bug/1188189 21:20:33 Launchpad bug 1188189 in cinder "Some server-side 'SSL' communication fails to check certificates (use of HTTPSConnection)" [High,In progress] 21:20:44 that's an ssl issue, which is really like 5 bugs in nova apparently 21:20:51 sounds like there are separate bugs opened for each 21:21:02 so if people want something to work on, pick those up 21:21:27 #link https://bugs.launchpad.net/keystone/+bug/1188189/comments/54 21:21:31 those are the separate bugs 21:21:55 anything else on bugs? i guess checkout the 'in progress' rc1 bugs for code reviews 21:22:11 since we can't tag rc1 until those are closed out probably 21:22:26 moving on 21:22:32 #topic gate status 21:22:45 #link http://status.openstack.org/elastic-recheck/ 21:22:49 as noted e-r is backed up 21:22:53 so we don't know the true state of the gate right now 21:23:19 i think we've got fixes out for the top nova bugs in there right now though 21:23:32 hell, the wsgi test was deleted :) 21:23:37 heh 21:23:44 jogo: anything on gate? 21:23:54 categorization rate is high http://status.openstack.org/elastic-recheck/data/uncategorized.html 21:23:59 but that will also change when e-r flushes 21:24:21 mriedem: http://jogo.github.io/gate/ is looking decent 21:24:24 and looks like https://review.openstack.org/#/c/122291/ was approved, that was a gate issue 21:24:52 moving on 21:24:53 mriedem: that page uses graphite so its up to date 21:25:02 ok 21:25:10 yeah things seem to be moving at least 21:25:34 #topic open discussion 21:25:48 agenda says summit topics 21:25:52 #link https://etherpad.openstack.org/p/kilo-nova-summit-topics 21:26:02 like most etherpads it's a mess 21:26:04 :) 21:26:25 anyone have anything on summit topics? 21:26:58 regarding kilo and the bp/spec process, 21:27:19 we approved jogo's https://review.openstack.org/#/c/116699/ and https://review.openstack.org/#/c/112733/ will probably be approved when johnthetubaguy wakes up 21:27:33 still need to work out some of the runway stuff https://review.openstack.org/#/c/115410/ 21:28:00 any other topics? sub-teams? 21:28:10 please no. 21:28:16 end early? 21:28:19 +1 21:28:23 +1 21:28:23 :-) 21:28:28 #endmeeting