Monday, 2017-11-27

*** jkilpatr has quit IRC00:22
*** kumarmn has quit IRC00:24
*** hiro-kobayashi has joined #openstack-meeting-alt00:37
*** dave-mccowan has joined #openstack-meeting-alt00:40
*** hieulq has joined #openstack-meeting-alt00:52
*** salv-orlando has joined #openstack-meeting-alt00:52
*** kumarmn has joined #openstack-meeting-alt00:53
*** tovin07_ has joined #openstack-meeting-alt00:56
*** _pewp_ has quit IRC00:57
*** _pewp_ has joined #openstack-meeting-alt00:58
*** salv-orlando has quit IRC00:58
*** yuanying has quit IRC00:59
*** dave-mccowan has quit IRC01:09
*** kumarmn has quit IRC01:12
*** yuanying has joined #openstack-meeting-alt01:12
*** kumarmn has joined #openstack-meeting-alt01:13
*** kumarmn has quit IRC01:16
*** ijw has joined #openstack-meeting-alt01:19
*** trungnv has joined #openstack-meeting-alt01:19
*** hongbin has joined #openstack-meeting-alt01:19
*** yangyapeng has joined #openstack-meeting-alt01:22
*** ijw has quit IRC01:23
*** dave-mccowan has joined #openstack-meeting-alt01:24
*** yamamoto has joined #openstack-meeting-alt01:29
*** kumarmn has joined #openstack-meeting-alt01:48
*** salv-orlando has joined #openstack-meeting-alt01:54
*** salv-orlando has quit IRC02:00
*** kumarmn has quit IRC02:17
*** dalgaaf has quit IRC02:20
*** dalgaaf has joined #openstack-meeting-alt02:20
*** gcb has joined #openstack-meeting-alt02:33
*** salv-orlando has joined #openstack-meeting-alt02:56
*** caowei has joined #openstack-meeting-alt02:57
*** dave-mccowan has quit IRC03:01
*** salv-orlando has quit IRC03:02
*** dave-mccowan has joined #openstack-meeting-alt03:07
*** kumarmn has joined #openstack-meeting-alt03:15
*** dave-mccowan has quit IRC03:18
*** kumarmn has quit IRC03:20
*** sridharg has joined #openstack-meeting-alt03:23
*** jiaopen__ has joined #openstack-meeting-alt03:29
*** jiaopeng_ has joined #openstack-meeting-alt03:29
*** yangyapeng has quit IRC03:45
*** kumarmn has joined #openstack-meeting-alt03:57
*** salv-orlando has joined #openstack-meeting-alt03:57
*** daidv has joined #openstack-meeting-alt04:00
*** salv-orlando has quit IRC04:04
*** hiro-kobayashi_ has joined #openstack-meeting-alt04:04
*** hiro-kobayashi has quit IRC04:04
*** kumarmn has quit IRC04:07
*** yangyapeng has joined #openstack-meeting-alt04:09
*** hongbin has quit IRC04:12
*** yangyapeng has quit IRC04:14
*** julim has joined #openstack-meeting-alt04:19
*** yangyapeng has joined #openstack-meeting-alt04:25
*** links has joined #openstack-meeting-alt04:26
*** anilvenkata has joined #openstack-meeting-alt04:28
*** kumarmn has joined #openstack-meeting-alt04:31
*** kumarmn has quit IRC04:31
*** kumarmn has joined #openstack-meeting-alt04:31
*** michchap has quit IRC04:34
*** bhavik1 has joined #openstack-meeting-alt04:35
*** yamamoto has quit IRC04:43
*** ijw has joined #openstack-meeting-alt04:47
*** yamamoto has joined #openstack-meeting-alt04:49
*** hongbin has joined #openstack-meeting-alt04:51
*** skramaja has joined #openstack-meeting-alt04:53
*** salv-orlando has joined #openstack-meeting-alt04:59
*** salv-orlando has quit IRC05:05
*** kumarmn has quit IRC05:09
*** kumarmn has joined #openstack-meeting-alt05:17
*** kumarmn has quit IRC05:22
*** adisky_ has joined #openstack-meeting-alt05:29
*** yamamoto has quit IRC05:44
*** hongbin has quit IRC05:46
*** dklyle has joined #openstack-meeting-alt05:47
*** yamamoto has joined #openstack-meeting-alt05:48
*** david-lyle has quit IRC05:48
*** chyka has joined #openstack-meeting-alt05:54
*** jiaopeng_ has quit IRC05:58
*** jiaopen__ has quit IRC05:58
*** jiaopeng_ has joined #openstack-meeting-alt05:59
*** jiaopen__ has joined #openstack-meeting-alt05:59
*** jiaopen__ is now known as jiaopengju_05:59
*** salv-orlando has joined #openstack-meeting-alt06:01
*** salv-orlando has quit IRC06:07
*** chhavi has joined #openstack-meeting-alt06:11
*** janki has joined #openstack-meeting-alt06:15
*** janki has quit IRC06:16
*** janki has joined #openstack-meeting-alt06:17
*** dsariel has joined #openstack-meeting-alt06:18
*** macermak has joined #openstack-meeting-alt06:19
*** jbadiapa has joined #openstack-meeting-alt06:30
*** d0ugal has quit IRC06:35
*** spectr has joined #openstack-meeting-alt06:44
*** rcernin has quit IRC06:47
*** d0ugal has joined #openstack-meeting-alt06:48
*** rcernin has joined #openstack-meeting-alt06:49
*** chyka has quit IRC06:53
*** mjura has joined #openstack-meeting-alt06:54
*** spectr has quit IRC06:55
*** salv-orlando has joined #openstack-meeting-alt07:03
*** oidgar has joined #openstack-meeting-alt07:08
*** marios has joined #openstack-meeting-alt07:08
*** salv-orlando has quit IRC07:09
*** songjian has quit IRC07:11
*** kumarmn has joined #openstack-meeting-alt07:12
*** songjian has joined #openstack-meeting-alt07:12
*** gcb has quit IRC07:13
*** kumarmn has quit IRC07:17
*** jiaope___ has joined #openstack-meeting-alt07:23
*** jiaopen__ has joined #openstack-meeting-alt07:23
*** jiaopengju_ has quit IRC07:23
*** jiaopeng_ has quit IRC07:23
*** junboli has joined #openstack-meeting-alt07:25
*** oidgar has quit IRC07:26
*** rcernin has quit IRC07:28
*** mguiney has quit IRC07:31
*** ccamacho has quit IRC07:32
*** ccamacho has joined #openstack-meeting-alt07:32
*** salv-orlando has joined #openstack-meeting-alt07:36
*** salv-orlando has quit IRC07:37
*** salv-orlando has joined #openstack-meeting-alt07:37
*** maciejjozefczyk has quit IRC07:43
*** guinm has joined #openstack-meeting-alt07:46
*** jtomasek has joined #openstack-meeting-alt07:47
*** guinm is now known as valkyrie_07:47
*** valkyrie_ is now known as valkyrja07:47
*** valkyrja has quit IRC07:47
*** guinm has joined #openstack-meeting-alt07:48
*** vds has joined #openstack-meeting-alt07:52
*** guinm is now known as help07:52
*** help is now known as Guest6108307:53
*** Guest61083 is now known as guinm07:53
*** guinm has quit IRC08:03
*** yamamoto has quit IRC08:04
*** coolsvap has joined #openstack-meeting-alt08:05
*** guinm has joined #openstack-meeting-alt08:10
*** gcb has joined #openstack-meeting-alt08:12
*** belmoreira has joined #openstack-meeting-alt08:22
*** lpetrut has joined #openstack-meeting-alt08:22
*** kobis has joined #openstack-meeting-alt08:24
*** michchap has joined #openstack-meeting-alt08:26
*** bfernando has joined #openstack-meeting-alt08:26
*** oidgar has joined #openstack-meeting-alt08:27
*** yamamoto has joined #openstack-meeting-alt08:33
*** jpena|off is now known as jpena08:38
*** matrohon has joined #openstack-meeting-alt08:40
*** hiro-kobayashi_ has quit IRC08:41
*** fzdarsky has joined #openstack-meeting-alt08:43
*** yamamoto has quit IRC08:51
*** rossella_s has joined #openstack-meeting-alt08:57
*** MarkBaker has joined #openstack-meeting-alt09:01
*** bhavik1 has quit IRC09:04
*** jchhatbar has joined #openstack-meeting-alt09:12
*** janki has quit IRC09:13
*** lpetrut has quit IRC09:26
*** oidgar has quit IRC09:27
*** derekh has joined #openstack-meeting-alt09:28
*** yamamoto has joined #openstack-meeting-alt09:31
*** spectr has joined #openstack-meeting-alt09:37
*** spectr has quit IRC09:37
*** yamamoto has quit IRC09:39
*** lpetrut has joined #openstack-meeting-alt09:44
*** nijaba has quit IRC10:01
*** tovin07_ has quit IRC10:04
*** junboli has quit IRC10:04
*** sdague has joined #openstack-meeting-alt10:07
*** nijaba has joined #openstack-meeting-alt10:09
*** nijaba has quit IRC10:09
*** nijaba has joined #openstack-meeting-alt10:09
*** jiaope___ has quit IRC10:10
*** jiaopen__ has quit IRC10:10
*** lpetrut has quit IRC10:11
*** dsariel has quit IRC10:13
*** sambetts_ has joined #openstack-meeting-alt10:16
*** spectr has joined #openstack-meeting-alt10:22
*** kumarmn has joined #openstack-meeting-alt10:23
*** spectr has quit IRC10:23
*** yamamoto has joined #openstack-meeting-alt10:27
*** kumarmn has quit IRC10:27
*** lpetrut has joined #openstack-meeting-alt10:29
*** egallen has joined #openstack-meeting-alt10:30
*** yamamoto has quit IRC10:32
*** MarkBaker has quit IRC10:39
*** MarkBaker has joined #openstack-meeting-alt10:45
*** sridharg has quit IRC10:46
*** yamamoto has joined #openstack-meeting-alt10:53
*** yamamoto has quit IRC10:55
*** cgoncalves has quit IRC10:56
*** cgoncalves has joined #openstack-meeting-alt10:57
*** sambetts_ is now known as sambetts10:57
*** cgoncalves has quit IRC10:57
*** cgoncalves has joined #openstack-meeting-alt10:58
*** yamamoto has joined #openstack-meeting-alt11:01
*** ianw has quit IRC11:03
*** ianw_ has joined #openstack-meeting-alt11:03
*** ianw_ is now known as ianw11:04
*** yamamoto has quit IRC11:06
*** finucannot is now known as stephenfin11:07
*** _pewp_ has quit IRC11:10
*** rfolco has joined #openstack-meeting-alt11:11
*** _pewp_ has joined #openstack-meeting-alt11:14
*** alexchadin has joined #openstack-meeting-alt11:19
*** ccamacho is now known as ccamacho|doc11:22
*** chyka has joined #openstack-meeting-alt11:24
*** chhavi__ has joined #openstack-meeting-alt11:24
*** chhavi has quit IRC11:25
*** chyka has quit IRC11:29
*** dsariel has joined #openstack-meeting-alt11:29
*** yamamoto has joined #openstack-meeting-alt11:31
*** spectr has joined #openstack-meeting-alt11:35
*** spectr has quit IRC11:35
*** yamamoto has quit IRC11:36
*** caowei has quit IRC11:37
*** bfernando has quit IRC11:39
*** alexchadin has quit IRC11:40
*** chhavi__ has quit IRC11:41
*** alexchadin has joined #openstack-meeting-alt11:41
*** erlon has joined #openstack-meeting-alt11:42
*** gcb has quit IRC11:45
*** alexchadin has quit IRC11:51
*** alexchadin has joined #openstack-meeting-alt11:51
*** omolchanov__ has quit IRC11:53
*** ying_zuo has quit IRC11:53
*** kmalloc has quit IRC11:54
*** hrybacki has quit IRC11:54
*** csatari has quit IRC11:54
*** ildikov has quit IRC11:54
*** zaro has quit IRC11:54
*** timsim has quit IRC11:54
*** xgerman_ has quit IRC11:54
*** timirnich has quit IRC11:55
*** aprice___ has quit IRC11:55
*** zaro has joined #openstack-meeting-alt11:55
*** hrybacki has joined #openstack-meeting-alt11:55
*** omolchanov__ has joined #openstack-meeting-alt11:55
*** timsim has joined #openstack-meeting-alt11:56
*** aprice___ has joined #openstack-meeting-alt11:56
*** kmalloc has joined #openstack-meeting-alt11:56
*** xgerman_ has joined #openstack-meeting-alt11:56
*** timirnich has joined #openstack-meeting-alt11:56
*** csatari has joined #openstack-meeting-alt11:56
*** ildikov has joined #openstack-meeting-alt11:56
*** fzdarsky is now known as fzdarsky|afk12:00
*** jiaopeng_ has joined #openstack-meeting-alt12:00
*** jiaopen__ has joined #openstack-meeting-alt12:00
*** yamamoto has joined #openstack-meeting-alt12:01
*** raildo has joined #openstack-meeting-alt12:05
*** yangyapeng has quit IRC12:06
*** yamamoto has quit IRC12:06
*** dave-mccowan has joined #openstack-meeting-alt12:08
*** dave-mcc_ has joined #openstack-meeting-alt12:09
*** alexchadin has quit IRC12:09
*** alexchadin has joined #openstack-meeting-alt12:10
*** dave-mccowan has quit IRC12:12
*** jkilpatr has joined #openstack-meeting-alt12:13
*** jkilpatr has quit IRC12:14
*** jkilpatr has joined #openstack-meeting-alt12:14
*** oidgar has joined #openstack-meeting-alt12:15
*** fried_turkey is now known as efried12:18
*** fzdarsky|afk is now known as fzdarsky12:20
*** oidgar has quit IRC12:22
*** szaher has quit IRC12:22
*** giblet is now known as gibi12:24
*** szaher has joined #openstack-meeting-alt12:25
*** links has quit IRC12:29
*** ttsiouts has joined #openstack-meeting-alt12:31
*** ccamacho|doc is now known as ccamacho12:33
*** oidgar has joined #openstack-meeting-alt12:35
*** alexchadin has quit IRC12:35
*** alexchadin has joined #openstack-meeting-alt12:36
*** kumarmn has joined #openstack-meeting-alt12:38
*** jiaopen__ has quit IRC12:40
*** jiaopeng_ has quit IRC12:40
*** kumarmn has quit IRC12:43
*** links has joined #openstack-meeting-alt12:43
*** sridharg has joined #openstack-meeting-alt12:46
*** yamamoto has joined #openstack-meeting-alt12:47
*** lpetrut has quit IRC12:48
*** yamamoto has quit IRC12:51
*** jpena is now known as jpena|lunch12:55
*** chyka has joined #openstack-meeting-alt12:56
*** yangyapeng has joined #openstack-meeting-alt12:56
*** lpetrut has joined #openstack-meeting-alt12:57
*** chyka has quit IRC13:00
*** dprince has joined #openstack-meeting-alt13:05
*** jkilpatr has quit IRC13:11
*** markvoelker has quit IRC13:16
*** markvoelker has joined #openstack-meeting-alt13:16
*** chyka has joined #openstack-meeting-alt13:18
*** chyka has quit IRC13:23
*** ansmith has joined #openstack-meeting-alt13:24
*** skramaja has quit IRC13:27
*** jkilpatr has joined #openstack-meeting-alt13:29
*** gcb has joined #openstack-meeting-alt13:31
*** daidv has quit IRC13:38
*** bfernando has joined #openstack-meeting-alt13:42
*** lpetrut has quit IRC13:42
*** lpetrut has joined #openstack-meeting-alt13:42
*** yamamoto has joined #openstack-meeting-alt13:45
*** yamamoto has quit IRC13:45
*** takashin has joined #openstack-meeting-alt13:48
*** lpetrut has quit IRC13:48
*** lpetrut has joined #openstack-meeting-alt13:49
*** yamamoto has joined #openstack-meeting-alt13:49
*** jpena|lunch is now known as jpena13:49
*** ying_zuo has joined #openstack-meeting-alt13:51
*** haleyb|away is now known as haleyb13:53
*** coolsvap has quit IRC13:54
*** cdent has joined #openstack-meeting-alt13:56
*** jaypipes has joined #openstack-meeting-alt13:56
*** mriedem has joined #openstack-meeting-alt13:56
*** lpetrut has quit IRC13:57
*** yamamoto has quit IRC13:57
*** apetrich has quit IRC13:58
*** apetrich has joined #openstack-meeting-alt13:59
edleafe#startmeeting nova_scheduler14:00
openstackMeeting started Mon Nov 27 14:00:10 2017 UTC and is due to finish in 60 minutes.  The chair is edleafe. Information about MeetBot at http://wiki.debian.org/MeetBot.14:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.14:00
*** openstack changes topic to " (Meeting topic: nova_scheduler)"14:00
openstackThe meeting name has been set to 'nova_scheduler'14:00
cdento/14:00
efried\o14:00
ttsioutso/14:00
takashino/14:00
edleafeGood UGT morning! Who's here?14:00
jaypipeso/14:00
alex_xuo/14:00
*** karthiks has quit IRC14:01
cdentOver the week I learned that jaypipes is running for the senate14:01
jaypipesquoi?14:01
cdent“child bride"14:01
jaypipesahahaha14:02
* edleafe missed the reference14:02
* efried too14:02
jaypipesover the weekend I learned edleafe got really high.14:02
edleafethat I did!14:02
cdenthttps://twitter.com/jaypipes/status/93449088347877376214:02
edleafejaypipes: you little devil14:03
* bauzas waves14:03
jaypipesso... on to scheduler things :)14:03
edleafeyeah14:03
edleafe#topic Tell me what's going on14:03
*** openstack changes topic to "Tell me what's going on (Meeting topic: nova_scheduler)"14:03
*** lei-zh has joined #openstack-meeting-alt14:03
cdent#link what’s going on http://lists.openstack.org/pipermail/openstack-dev/2017-November/124886.html14:04
edleafeI got back from 10 days away from the 'puter, and have nothing prepared14:04
edleafeSo raise your hand if you want to discuss something14:04
efriedI think the topic accumulated_nits accidentally got sprayed around a whole series by git restack.14:04
efriedmahbad14:04
efriedMost of that should have been bp/nested-resource-providers probably.14:05
efrieduh, no.14:05
efriedbut not accumulated_nits14:05
efriedAnyway, IMO the most pressing need right now is getting core reviews on the n-r-p series and starting to get that merged.14:05
efriedIt's going to be prerequisite to a couple of other critical things.14:06
cdenti agree!14:06
cdent(damn, I just missed an “I concur” opportunity)14:06
edleafeyeah, these long-running series become a pain when they get stale14:06
edleafeI concur!14:06
jaypipesthat and the refactor series which also has a bunch of func tests and traits handling14:06
bauzaswell, I'll look14:06
efried#link bottom of the n-r-p series: https://review.openstack.org/#/c/377138/14:07
bauzas(well, once I'll done with my internal problems :p )14:07
efriedjaypipes ++14:07
edleafeI haven't looked at the alternate host series yet, but I assume it's still being held back while details are being picked over14:08
* edleafe probably has several more weeks of rebase fun with that14:08
efried#link current bottom of the refactor series: https://review.openstack.org/#/c/516782/1114:08
efriedActually ^ is the last patch in the refactor series proper.14:09
efriedBut it's anchoring a pile of other stuff.14:09
efriedincluding tests and traits handling, as jaypipes said.14:09
*** alexchadin has quit IRC14:10
efriedI think the biggest to-do on top of the n-r-p series is getting n-r-p affordance for allocation candidates.14:10
* cdent concurs14:10
efriedjaypipes or alex_xu Do you have that cued up anywhere (locally) yet?14:11
jaypipesefried: yes, and then settling on the update_provider_tree() implementation14:11
edleafeAre we still aiming for "merge shit early" like we said at PTG? It sure doesn't feel like it14:11
alex_xui don't have anything14:11
jaypipesedleafe: we've merged quite a bit so far, actually.14:11
efriedAgree, though the summit + thanksgiving really put a crimp in things.14:11
jaypipesedleafe: personally, I'd like to see the alternate hosts stuff make progress this week.14:12
cdenthere comes christmas too :(14:12
efriedyeah14:12
edleafejaypipes: it isn't as critical path as n-r-p, though14:12
efriedSo I'll follow edleafe's "merge shit early" with: The next 2-3 weeks we should have some kind of official focussed review-and-merge-shit push.14:13
jaypipesedleafe: it's still priority over n-r-p, though, according to my last recollection of priorities (alternate hosts, traits handling and move operation cleanup)14:13
efriedjaypipes I didn't think those three were in any particular priority order.14:13
jaypipesefried: let's make it official then.14:13
edleafeefried: yeah, I didn't get a sense of ordering either14:14
jaypipesefried: they're not. they're just the 3 priorities. n-r-p isn't actually a priority for Queens...14:14
cdentthat’s not my recollection? I thought we said at ptg that nrp was pre-req for traits and RT cleanup14:14
cdentor was that just “before shared”?14:15
jaypipescdent: right. before shared.14:15
* jaypipes notes that shared stuff has been the source of most bugs in the allocation candidates code so far...14:15
jaypipesin any case, it all is related.14:15
*** kumarmn has joined #openstack-meeting-alt14:15
jaypipesso let's make this week the official "push this shit" week.14:15
efriedhttps://etherpad.openstack.org/p/nova-ptg-queens-placement L47-5514:16
* cdent wonders if we can make every week officially push this shit?14:16
efriedRight - "shared" was deferred out of Q.14:16
efriedcdent Baby steps14:16
*** fnaval has joined #openstack-meeting-alt14:16
alex_xushould I rebase this patch https://review.openstack.org/480379?14:16
efriedalex_xu I would say that's probably a lower priority than reviews, if you had to pick one or the other.14:17
efriedThough you've been pretty well on top of reviews.14:17
jaypipesefried: can you check to see if alex_xu's tests from the dependent patch on above is included in the refactor suite (from you or gibi)?14:17
efriedYeah, given how we're not doing shared RPs for Q, we sure have spent a lot of time on it...14:18
efriedjaypipes You talking about https://review.openstack.org/#/c/480379/22/nova/tests/functional/db/test_resource_provider.py ?14:18
jaypipesyeah14:18
efriedjaypipes Will do.14:18
alex_xuFor this patch https://review.openstack.org/517119, we still needs to ensure the traits work well for shared case, right?14:19
jaypipesgawd, maybe I was confusing the generic device manager with n-r-p w.r.t priorities in Queens. guh, I must be getting old. :(14:20
jaypipeseither that or everything is running into everything else in my mind at this poitn.14:20
cdentit does all run together14:20
efriedI feel like we still have some architectural work to do on sharing + traits.14:20
edleafejaypipes: that's the definition of getting old14:20
* edleafe knows14:21
efriedIn general, we should be looking for opportunities to defer work on sharing RPs.14:21
efriedWhich we haven't been doing especially well, tbh.  I'm probably the most guilty.14:21
* cdent concurs14:21
cdentwhen it feature freeze?14:21
cdents/it/is/14:21
bauzasMilestone-314:22
cdentwhat is the date of Milestone-3 ?14:22
alex_xuJan 2214:22
alex_xu#link https://releases.openstack.org/queens/schedule.html14:22
bauzashttps://releases.openstack.org/queens/schedule.html14:22
bauzasdammit, burned14:22
cdentthanks was nearly there14:22
jaypipesso basically 6 weeks, if you count western holiday week a goner.14:22
bauzascorrect14:23
bauzasR-514:23
bauzasand we are R-1314:23
efriedJan 25 according to https://wiki.openstack.org/wiki/Nova/Queens_Release_Schedule -- a whole three extra days!14:23
bauzasyeah, because we do that by Thursdays14:24
efriedphew14:24
bauzassome projects do that by Tuesdays14:24
bauzasbut the relmanagement team accepts all the milestones during those 3 days14:24
bauzashope that's clearer14:24
bauzasthe real crux is : do we still need to discuss design problems now ?14:25
efriedI really hope not.14:25
bauzastbh, n-r-p is the top prio14:25
efriedHopefully the design discussions are minor enough to be contained within reviews.14:25
bauzasif we need to discuss problems during the implementation14:25
efriedE.g. the update_provider_tree stuff14:25
bauzasyeah14:25
bauzasthat's my point14:26
efriedSo far that effort has been doing well on that count.14:26
bauzaswe had a long series of discussions when we reviewed the scheduler claims14:26
bauzasif we need to discuss like we did for that, then huh14:26
efriedCourse it was pretty straightforward when it was just me & jaypipes having the discussions :)14:26
jaypipesefried: I've always maintained that there will need to be kinks worked out once real clients were using the n-r-p stuff. and now that XenAPI has a proposed patch up, that's shaking that implementation detail tree a bit. which is a good thing.14:28
efried++14:28
edleafeall the more reason to merge and then update in subsequent patches14:28
efried+++14:28
* cdent concurs14:28
* efried looks around...14:29
efriedThere's three cores in attendance, and two of them are authors of the patches in question.14:29
bauzasjaypipes: yeah, the Xen team is having 3 people working on the VGPU feature, so they can help14:29
bauzas(while only me for libvirt :p )14:29
edleafeefried: we can nag the others later in -nova14:29
*** GeraldK has joined #openstack-meeting-alt14:29
efriedYuh, we need to socialize our "official" review push week to the likes of dansmith, stephenfin, etc.14:29
bauzasefried: here I definitely want to help but struggle with time14:30
bauzasNFV FTW14:30
* gibi can help with some of the reviews in n-r-p14:30
efriedRight.  It can't all be on the shoulders of one or two cores.14:30
edleafeWe seem to agree on this. Anything else to discuss?14:30
* edleafe has to dig out from a ton of backlog emails14:31
cdentmy pending placement stuff is pretty ready for whoever would like to look14:32
jaypipescdent: link pls14:32
*** links has quit IRC14:32
cdent#link some gabbit clean up https://review.openstack.org/#/c/513057/14:32
cdent#link symmetric get and put and post to /allocations: https://review.openstack.org/#/c/510626/14:32
cdent#link cache headers and requisite changes to objects: https://review.openstack.org/#/c/521639/14:33
*** belmoreira has quit IRC14:33
jaypipesdanke14:33
*** gcb has quit IRC14:33
cdent#link fixup to get proper formatted errors: https://review.openstack.org/#/c/518223/14:33
cdentin other news I’ve started messing around with a containered placement service to see what breaks when it is isolated and/or used in parallel. one fun bug so far:14:34
cdent#link config for middleware bug: https://bugs.launchpad.net/nova/+bug/173449114:35
openstackLaunchpad bug 1734491 in OpenStack Compute (nova) "placement keystonemiddleware_authtoken ignores OS_PLACEMENT_CONFIG_DIR" [Undecided,In progress] - Assigned to Chris Dent (cdent)14:35
cdentAlso there’s a new bug related to request ids, requiring some clean up on nova side:14:35
cdent#link request id bug: https://bugs.launchpad.net/nova/+bug/173462514:35
openstackLaunchpad bug 1734625 in OpenStack Compute (nova) "placement: Request IDs are not passed to placement service" [Undecided,In progress] - Assigned to Takashi NATSUME (natsume-takashi)14:36
jaypipescool, thanks for investigfating that cdent14:36
edleafewhy would placement care about nova-isms like request id?14:36
efriedrequest IDs are openstack-isms now.14:37
cdentedleafe: see: https://review.openstack.org/#/c/523007/14:37
mriedemthis is a bug that's affecting the gate, which only efried and i have looked at so far i think https://bugs.launchpad.net/nova/+bug/173166814:37
openstackLaunchpad bug 1731668 in OpenStack Compute (nova) "placement: claim allocations fails with IndexError in _ensure_lookup_table_entry" [High,Confirmed]14:37
cdentthe incoming request id ought to be respected in the logs14:37
cdentmriedem, jaypipes : is that code subject to the big refactoring that jay and eric have done?14:38
efriedcdent Which, the bug?14:39
mriedemthere was a refactor that hit this code recently14:39
cdentyeah, the ensure look up table14:39
mriedemnote the bug is a few weeks old at this point14:39
jaypipesmriedem: no, I don't think that code was touched.14:41
*** noslzzp has joined #openstack-meeting-alt14:43
* efried concurs14:43
jaypipesmriedem: I will take that bug14:43
mriedemit may be a latent bug, idk14:43
efriedThe refactor was all about GET /allocation_candidates.  That bug is in stuff that touches project/user IDs.14:43
* cdent writes efried a cheque14:43
* efried makes fun of cdent's British spelling of cheque.14:43
jaypipesmriedem: yeah, I think I know what it is.14:43
efriedjaypipes Note the "related fix" in the bug report - some discussion of the race condition there (and a possible "fix")14:44
jaypipesmriedem: we're not catching the right exception and it's dropping out of the except block without running that fetchall() again.14:44
efriedAh, or that.14:44
jaypipesefried: almost guarantee we're getting a DBDeadlock error, not a duplicate error.14:44
jaypipesefried: and that's causing this.14:45
efriedcool14:45
efriedYeah, cause that race should be way too hard to hit for the frequency with which we're seeing the error.14:45
*** rmascena has joined #openstack-meeting-alt14:45
efriedmriedem jaypipes I could put up an investigative patch that logs the exception.14:46
jaypipesefried: I'll do it.14:46
efriedack14:46
*** raildo has quit IRC14:48
jaypipesI think we just need to catch sa.exc.IntegrityError instead... but I'll check it out.14:48
edleafeok, anything else?14:48
efriedWho's got the #action to socialize the review push?14:49
* edleafe thinks efried just volunteered14:50
* efried thinks it should be someone with more clout.14:50
efriedI can compose an email for the dev list14:52
* edleafe thinks it should be someone with social skills, leaving himself out14:52
edleafe#action efried to socialize review priorities to other nova cores14:54
efriedack14:54
edleafeAnything else? Or shall we call it a day?14:54
cdentcall it14:54
* edleafe just confused non-native English speakers14:54
edleafeOK, thanks everyone!14:55
edleafe#endmeeting14:55
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings"14:55
openstackMeeting ended Mon Nov 27 14:55:03 2017 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)14:55
openstackMinutes:        http://eavesdrop.openstack.org/meetings/nova_scheduler/2017/nova_scheduler.2017-11-27-14.00.html14:55
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/nova_scheduler/2017/nova_scheduler.2017-11-27-14.00.txt14:55
openstackLog:            http://eavesdrop.openstack.org/meetings/nova_scheduler/2017/nova_scheduler.2017-11-27-14.00.log.html14:55
* alex_xu confused14:55
*** mriedem has left #openstack-meeting-alt14:56
*** julim has quit IRC14:57
*** takashin has left #openstack-meeting-alt14:57
*** salv-orlando has quit IRC14:57
*** yamamoto has joined #openstack-meeting-alt14:57
*** manjeets_ has joined #openstack-meeting-alt14:58
*** salv-orlando has joined #openstack-meeting-alt14:58
*** yamahata has quit IRC14:59
*** yamahata has joined #openstack-meeting-alt15:00
*** lei-zh has quit IRC15:01
*** salv-orlando has quit IRC15:03
*** reedip_ has joined #openstack-meeting-alt15:03
*** yamamoto has quit IRC15:04
*** iyamahat has joined #openstack-meeting-alt15:05
*** marst has joined #openstack-meeting-alt15:12
*** bnemec has quit IRC15:13
*** felipemonteiro has joined #openstack-meeting-alt15:14
*** felipemonteiro_ has joined #openstack-meeting-alt15:16
*** felipemonteiro has quit IRC15:20
*** cdent has quit IRC15:24
*** yangyapeng has quit IRC15:24
*** reedip_ has quit IRC15:25
*** rmascena has quit IRC15:25
*** hongbin has joined #openstack-meeting-alt15:35
*** oidgar has quit IRC15:35
*** julim has joined #openstack-meeting-alt15:38
*** julim has quit IRC15:39
*** julim has joined #openstack-meeting-alt15:42
*** bnemec has joined #openstack-meeting-alt15:54
*** manjeets_ has quit IRC15:54
*** yangyapeng has joined #openstack-meeting-alt15:58
*** salv-orlando has joined #openstack-meeting-alt15:58
*** mjura has quit IRC16:01
*** kobis has quit IRC16:01
*** yangyapeng has quit IRC16:02
*** jchhatbar has quit IRC16:03
*** salv-orlando has quit IRC16:04
*** markstur has joined #openstack-meeting-alt16:05
*** belmoreira has joined #openstack-meeting-alt16:09
*** songjian has quit IRC16:09
*** songjian has joined #openstack-meeting-alt16:09
*** bbzhao has quit IRC16:09
*** bzhao has quit IRC16:10
*** alex_xu has quit IRC16:11
*** GeraldK has quit IRC16:12
*** bzhao has joined #openstack-meeting-alt16:14
*** bbzhao has joined #openstack-meeting-alt16:15
*** markstur_ has joined #openstack-meeting-alt16:18
*** macermak has quit IRC16:21
*** markstur has quit IRC16:22
*** apetrich has quit IRC16:22
*** apetrich has joined #openstack-meeting-alt16:24
*** sdague has quit IRC16:26
*** shaohe_feng has quit IRC16:27
*** alex_xu has joined #openstack-meeting-alt16:27
*** shaohe_feng has joined #openstack-meeting-alt16:31
*** raildo has joined #openstack-meeting-alt16:32
*** sdague has joined #openstack-meeting-alt16:33
*** belmoreira has quit IRC16:35
*** chyka has joined #openstack-meeting-alt16:40
*** jpena is now known as jpena|brb16:44
*** marios has quit IRC16:45
*** salv-orlando has joined #openstack-meeting-alt17:00
*** gyee_ has joined #openstack-meeting-alt17:00
*** felipemonteiro_ has quit IRC17:05
*** salv-orlando has quit IRC17:06
*** salv-orlando has joined #openstack-meeting-alt17:15
*** salv-orlando has quit IRC17:16
*** salv-orlando has joined #openstack-meeting-alt17:16
*** iyamahat has quit IRC17:25
*** jpena|brb is now known as jpena17:25
*** rwsu has joined #openstack-meeting-alt17:32
*** dsariel has quit IRC17:33
*** efried is now known as efried_rollin17:38
*** matrohon has quit IRC17:39
*** chyka has quit IRC17:39
*** chyka has joined #openstack-meeting-alt17:40
*** lpetrut has joined #openstack-meeting-alt17:41
*** bfernando has quit IRC17:45
*** harlowja has joined #openstack-meeting-alt17:47
*** cdent has joined #openstack-meeting-alt17:56
*** anilvenkata has quit IRC17:59
*** derekh has quit IRC18:02
*** cdent has left #openstack-meeting-alt18:03
*** belmoreira has joined #openstack-meeting-alt18:04
*** markvoelker has quit IRC18:10
*** sridharg has quit IRC18:11
*** felipemonteiro has joined #openstack-meeting-alt18:17
*** SimAloo has joined #openstack-meeting-alt18:18
*** hc1324 has joined #openstack-meeting-alt18:18
*** SimAloo has quit IRC18:18
*** felipemonteiro_ has joined #openstack-meeting-alt18:18
*** hc1324 is now known as SimAloo18:18
*** jpena is now known as jpena|off18:20
*** felipemonteiro has quit IRC18:22
*** fzdarsky is now known as fzdarsky|afk18:23
*** lpetrut has quit IRC18:25
*** vds has quit IRC18:27
*** lpetrut has joined #openstack-meeting-alt18:33
*** gouthamr has joined #openstack-meeting-alt18:52
*** belmoreira has quit IRC18:52
*** belmoreira has joined #openstack-meeting-alt18:53
*** lpetrut has quit IRC19:01
*** ccamacho has quit IRC19:02
*** hughhalf has quit IRC19:09
*** HeOS has quit IRC19:09
*** lpetrut has joined #openstack-meeting-alt19:09
*** hughhalf has joined #openstack-meeting-alt19:13
*** HeOS has joined #openstack-meeting-alt19:21
*** salv-orlando has quit IRC19:28
*** salv-orlando has joined #openstack-meeting-alt19:28
*** cansu has joined #openstack-meeting-alt19:34
*** yangyapeng has joined #openstack-meeting-alt19:34
*** felipemonteiro_ has quit IRC19:38
*** yangyapeng has quit IRC19:39
*** matrohon has joined #openstack-meeting-alt19:45
*** ssathaye has joined #openstack-meeting-alt19:46
*** dsariel has joined #openstack-meeting-alt19:52
*** ijw has quit IRC19:56
*** sambetts is now known as sambetts|afk19:59
dave-mcc_@startmeeting barbican20:02
*** dave-mcc_ is now known as dave-mccowan20:04
*** dalgaaf has quit IRC20:08
dave-mccowan#startmeeting barbican20:09
openstackMeeting started Mon Nov 27 20:09:03 2017 UTC and is due to finish in 60 minutes.  The chair is dave-mccowan. Information about MeetBot at http://wiki.debian.org/MeetBot.20:09
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.20:09
*** openstack changes topic to " (Meeting topic: barbican)"20:09
openstackThe meeting name has been set to 'barbican'20:09
dave-mccowan#endmeeting20:09
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings"20:09
openstackMeeting ended Mon Nov 27 20:09:43 2017 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)20:09
openstackMinutes:        http://eavesdrop.openstack.org/meetings/barbican/2017/barbican.2017-11-27-20.09.html20:09
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/barbican/2017/barbican.2017-11-27-20.09.txt20:09
openstackLog:            http://eavesdrop.openstack.org/meetings/barbican/2017/barbican.2017-11-27-20.09.log.html20:09
*** dalgaaf has joined #openstack-meeting-alt20:14
ssathayeHello Dave20:15
ssathayeSorry ran late. Could not join this week. Will try and join next week.20:15
*** dalgaaf has quit IRC20:18
*** slaweq has joined #openstack-meeting-alt20:19
*** slaweq has quit IRC20:20
*** slaweq has joined #openstack-meeting-alt20:20
*** aprice___ has quit IRC20:21
*** dalgaaf has joined #openstack-meeting-alt20:24
*** yamahata has quit IRC20:32
*** efried_rollin is now known as efried20:38
*** iyamahat has joined #openstack-meeting-alt20:45
*** caboucha has joined #openstack-meeting-alt20:46
*** leong has joined #openstack-meeting-alt20:58
*** markstur has joined #openstack-meeting-alt21:01
leong#startmeeting product_working_group21:02
openstackMeeting started Mon Nov 27 21:02:49 2017 UTC and is due to finish in 60 minutes.  The chair is leong. Information about MeetBot at http://wiki.debian.org/MeetBot.21:02
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.21:02
*** openstack changes topic to " (Meeting topic: product_working_group)"21:02
openstackThe meeting name has been set to 'product_working_group'21:02
leong#Rollcall21:02
*** markstur_ has quit IRC21:03
leongis anyone here for Product team meeting?21:03
*** yamahata has joined #openstack-meeting-alt21:04
*** dsariel has quit IRC21:07
leong#info meeting call off due to not enough quorum21:10
leong#endmeetin21:10
leong#endmeeting21:10
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings"21:10
openstackMeeting ended Mon Nov 27 21:10:54 2017 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)21:10
openstackMinutes:        http://eavesdrop.openstack.org/meetings/product_working_group/2017/product_working_group.2017-11-27-21.02.html21:10
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/product_working_group/2017/product_working_group.2017-11-27-21.02.txt21:10
openstackLog:            http://eavesdrop.openstack.org/meetings/product_working_group/2017/product_working_group.2017-11-27-21.02.log.html21:10
*** rockyg has joined #openstack-meeting-alt21:13
*** jtomasek has quit IRC21:19
*** rasca has quit IRC21:22
*** ijw has joined #openstack-meeting-alt21:22
*** rockyg has quit IRC21:25
*** Shrews has joined #openstack-meeting-alt21:27
*** benj_ has quit IRC21:30
*** ijw has quit IRC21:30
*** benj_ has joined #openstack-meeting-alt21:31
*** belmoreira has quit IRC21:34
*** cansu has quit IRC21:38
*** ijw has joined #openstack-meeting-alt21:39
*** matrohon has quit IRC21:42
*** ansmith has quit IRC21:42
*** ijw has quit IRC21:43
*** raildo has quit IRC21:47
*** markstur_ has joined #openstack-meeting-alt21:51
*** markstur has quit IRC21:54
*** apetrich has quit IRC21:57
*** apetrich has joined #openstack-meeting-alt21:57
*** Arkady_Kanevsky has joined #openstack-meeting-alt21:59
*** lpetrut has quit IRC21:59
fungiand then much zuulishness ensued22:00
jeblairanyone else around?22:00
jheskethYep :-)22:01
SpamapSI'm around, but don't have much to discuss.22:01
*** dmsimard has joined #openstack-meeting-alt22:01
Shrewshi22:01
dmsimardohai22:01
SpamapSI'm just a Zuul in love.22:01
* dmsimard I have two topics, I'll add them to wiki right now22:01
*** julim has quit IRC22:02
jeblairdmsimard: can you add 'roadmap' to the top of the list? :)22:02
*** julim has joined #openstack-meeting-alt22:02
jeblairdmsimard: and i think you can delete the two topics from last time22:02
dmsimardjeblair: sure22:02
jeblairiirc clarkb isn't expecting to be back for another 30m22:03
fungithat's what i understood as well22:03
dmsimardjeblair: updated agenda22:04
dmsimardit's one topic after all, my other one is better suited for -infra22:04
dmsimardkind of an in-between one :)22:04
Arkady_Kanevskyanybody from Product WG?22:04
jeblairwell, strictly speaking the executors is also probably an infra topic now22:04
pabelangero/22:04
pabelangerthat is better22:04
mordredo/22:05
jeblairArkady_Kanevsky: i think the zuul meeting is scheduled now22:05
dmsimardjeblair: it's about the ara sqlite middleware22:05
jeblairArkady_Kanevsky: i think product wg was 1 hour ago22:05
dmsimardso logs.o.o22:05
dmsimardoh, you mean executors version -- sure, I guess that can be infra too22:05
Arkady_Kanevskythanks22:06
jeblair#startmeeting zuul22:06
dmsimardok /me scratches it off22:06
openstackMeeting started Mon Nov 27 22:06:10 2017 UTC and is due to finish in 60 minutes.  The chair is jeblair. Information about MeetBot at http://wiki.debian.org/MeetBot.22:06
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.22:06
*** openstack changes topic to " (Meeting topic: zuul)"22:06
openstackThe meeting name has been set to 'zuul'22:06
jeblairdmsimard: it's also a grey area :)  not completely out of scope, but perhaps not intrinsic to zuul itself22:06
*** julim has quit IRC22:07
jeblairdmsimard: maybe let's stick it at the end22:07
jeblairwhich it already is22:07
jeblair#link agenda https://wiki.openstack.org/wiki/Meetings/Zuul22:07
jeblair#link previous meeting http://eavesdrop.openstack.org/meetings/zuul/2017/zuul.2017-11-20-22.07.html22:07
dmsimardjeblair: the meeting participants are largely the same, let's talk about it tomorrow :p22:07
jeblair#topic Roadmap22:07
*** openstack changes topic to "Roadmap (Meeting topic: zuul)"22:07
*** MarkBaker has quit IRC22:07
jeblairbased on a discussion right before summit, i've moved our roadmap into storyboard22:08
jeblair#link roadmap in storyboard https://storyboard.openstack.org/#!/board/5322:08
jeblairi *just* finished typing everything in22:08
fungistill has that new board smell22:08
jeblairthat's one story for each line in the roadmap email i sent22:08
jeblairin most cases, i just put in a bare-bones description of what the item is22:09
*** ijw has joined #openstack-meeting-alt22:09
pabelangergreat22:09
Shrewsthat must have been fun data entry22:09
jeblairif you have a particular interest in an item, or know what it means, please do update the descriptions with more explanation22:09
fungiperhaps a meta-item, but at what point do we merge back to master?22:09
jeblairfungi: good question, let's talk about that next22:09
*** markvoelker has joined #openstack-meeting-alt22:09
fungik22:09
fungiwondered if it was missing from the roadmap, or at a different level than the roadmap22:10
jeblairi *almost* finsished assigning folks to the tasks i know about22:10
*** caboucha has quit IRC22:10
*** ijw has quit IRC22:10
jeblairplease assign yourself if you're working on something with no assignee22:10
jeblairthat's a fully automatic board22:10
jeblairthe entries are all stories, and the rows are generated by queries based on tags22:11
jeblairso a story tagged with zuulv3.0 will appear in the first column22:11
jeblairzuul v3.1 in the second22:11
jeblairer "zuulv3.1"22:11
jeblairand "zuulv3.x" in the third22:12
jeblairi had one or two more categories in the email, i'm not sure if it's useful to break it down further or not...22:12
clarkbo/22:12
dmsimardfwiw I made progress on the json/finger:// issue last week and I have a huge draft email I was going to send out but I figured I'd sleep on it and take another look this week, I'll add a comment on the story.22:12
jeblairi'd love to have "3.0 in progress" and "3.0 todo", but that would require the kind of script we were using for the initial zuulv3 board, since storyboard can't do that query natively.22:13
jeblairif folks think that's really important, i can set that up.  it's not too hard.22:13
jeblairdmsimard: what's the json/finger:// issue?22:14
dmsimardThe zuul_json truncated problem that leads up to a finger:// URL22:14
jeblairdmsimard: ah cool22:14
*** Arkady_Kanevsky has quit IRC22:15
dmsimardI got rabbit-holed into trying to understand how we could avoid finger:// URLs altogether but it's a bit complicated :)22:15
*** dprince has quit IRC22:16
jeblairdmsimard: you're talking about the issue where zuul_json is broken, yeah?22:16
jeblairdmsimard: https://storyboard.openstack.org/#!/story/2001329 ?22:16
dmsimardyeah, due to a callback bug with some tasks22:16
dmsimardyes22:16
dmsimardI'm writing a comment there to describe the issue a bit right now.22:16
jeblairokay.  my preference would be to fix that bug and not focus on the way it manifests as an error.22:17
* dmsimard nods22:17
jeblairwe should probably come up with a process for adding new things22:18
dmsimardI have access to a zuul v3 instance now (thanks tristanC and team) it's easy to reproduce so it's just a matter of having time to spend on it22:18
jeblairi don't have a suggestion for a process for adding new items to the roadmap at the moment, so for now, maybe let's just discuss things in #zuul22:19
jeblairwe'll come up with something later22:19
jeblairi see the 'release 3.0' lane as a burn-down list for us to do the 3.0 release22:20
jeblairso if there's something there you can help with, please do -- either by assigning yourself and hacking on it, or reviewing changes related to it22:20
jeblairanything else about the roadmap?22:21
*** d0ugal has quit IRC22:21
jeblairplease let me know if it's useful, or not useful.22:21
jeblair#topic merging into master22:22
*** openstack changes topic to "merging into master (Meeting topic: zuul)"22:22
jeblairi think last week the topic of merging into master came up, and there was some support22:22
fungiasap? immediately prior to tagging 3.0.0? somewhere in between?22:22
*** ijw has joined #openstack-meeting-alt22:22
clarkbI think it would be good to get done as soon as resonably possible. THe bulk of the 3.0 work is done and the master branches have largely been dormant. This will make it clear release is imminent and that future dev focus is on the newer stuff22:23
jeblairi'm inclined to merge asap -- at least in my mind, the criteria for merging into master was when infra was running v3, and shortly before the release.22:23
clarkbit will force us to sort out some of the deployment tooling transition stuff too which is good22:23
fungiand do we preemptively branch a stable/2.x from current master, or just tag it 2.6.1 and then branch when we find we need to append there?22:24
dmsimardIs a merge even possible ? Or is that a kind of git push --force kind of thing ?22:24
clarkbfungi: I think we just tag and if we need to branch later22:24
jeblairdmsimard: 'git merge --strategy ours' or however you spell that22:24
jeblairclarkb: ++22:24
pabelangerfor nodepool, merging back to master will make things a little easier upgrading our nodepool-builders. So +1 for that, but we can use feature/zuulv3 and do the dance with patches22:24
fungidmsimard: a "merge" is always possible, if we choose the right strategy ("ours" will basically be an overwrite)22:24
jeblairpabelanger: yeah, i think this conversation applies to both repos22:25
dmsimardTIL22:25
fungiright, i assumed we were talking about merging in zuul and nodepool repos more or less synchronously22:25
dmsimardwill come in handy because I'll need to merge back feature/1.0 into master for ARA as well, thanks for that :D22:25
SpamapS+1 for merge to master soon. Do we have any I'm progress fixes for 2.x?22:25
SpamapSIn22:25
jeblairSpamapS: not that i'm aware of -- all the urgent gerrit upgrade stuff has merged into master and made it into a release22:26
clarkband the jenkins + nodepool stuff merged iirc22:26
fungi#link https://review.openstack.org/#/q/project:openstack-infra/zuul+is:open22:26
fungi#undo22:26
fungi#link https://review.openstack.org/#/q/project:openstack-infra/zuul+is:open+branch:master22:26
jeblairprobably the next step is to start an infra mailing list thread about it, to make sure we coordinate with folks deploying from master22:27
jeblairi'm happy to start that22:27
fungiwe have _lots_ of open zuul repo changes for master, looks like22:27
SpamapSjeblair: indeed. A long runway for them to speak up seems like a good idea.22:27
jeblairi think after that we need to sort out the puppet-openstackci deployment bits.  i'd love it if someone else volunteered to drive that.22:27
jeblairi don't think it's that hard (we discussed driving everything from a zuulv3 switch argument), but some care will need to be taken.22:28
clarkband probably want to have at least one third party ci group/individual following along for early feedback22:28
jeblairi'll ask for a volunteer for that on the mailing list22:29
SpamapSFor the open changes.. perhaps a script that automatically WIP's them all with a friendly note? I mean, they'll likely merge conflict anyway, so might be the nice thing to do to let authors know why their change is stagnating and unlikely to move forward.22:29
fungii can take care of mass-wip'ing, that's trivial via gertty (no need for a script)22:30
fungijust process-mark all changes matching the above query and then review them all in one shot22:30
fungis/i/i or anyone/22:30
SpamapS\o/ gertty22:30
clarkbttx forwarded someone to us that was interested in getting involved in the more sysadminy bits during openstack day france. Possible they would be interested in working through some of the puppet for this22:31
fungiwell, any zuul-core reviewer can at any rate22:31
clarkbThats kind of jumping into the deep end but probably in a good way :)22:31
jeblair#action jeblair start email thread about merging into master22:31
clarkbI'll try to get them on the mailing list and lurking in irc and see what they are interested in poking at22:32
jeblairfungi: yeah, it may be worth taking a pass through and triaging some of those into "handled by zuulv3" "irrevenant in zuulv3" "please re-propose to zuulv3"22:32
fungiwhile i think it's great if someone new wants to handle the puppet module updates, that may be an extraordinary amount of pressure since it's a task which is blocking some time-sensitive roadmap actions22:32
pabelangerI can likey start work on puppet-openstackci, if somebody else doesn't do so before me22:33
clarkbfungi: ya thats true, but I also think it will likely largely be mechanical puppet api updates which if familiar with puppet should be straightforward22:33
clarkb(if not familiar with puppet then likely not a good first task)22:33
fungiif it turns out to be a fairly trivial amount of work there, then i agree that would be a great way to get to know the rest of the team ;)22:33
*** rcernin has joined #openstack-meeting-alt22:34
jeblairsince we're already in the openstack / zuul grey area...22:34
jeblair#topic Update ARA version on executors22:34
*** openstack changes topic to "Update ARA version on executors (Meeting topic: zuul)"22:34
*** leong has quit IRC22:35
clarkbis ara something we should just ensure latest on the executors?22:35
jeblair#link https://review.openstack.org/51674022:35
jeblairapparently this is tricky in puppet22:35
*** smyers has quit IRC22:36
dmsimardI meant to ask the TC if ara was something we could put in upper constraints, however it wouldn't really make sense in the context of zuul22:36
clarkbthe trick is to just call pip directly22:36
clarkbwith an onlyif clause that checks the version of ara against what is available22:36
*** beekhof_the_bruc is now known as beekhof_the_jit22:37
clarkbI can help with that if necessary22:37
dmsimardI have to step away momentarily :( but I wanted to unblock that review somehow because there are some fixes in there we want (such as the firefox permalink issue)22:37
dmsimardbrb22:37
jeblairit's also possible to solve this by declaring ara an extra dependency of zuul, but i'd prefer to avoid that and actually generalize the callback mechanism anyway.22:37
*** smyers has joined #openstack-meeting-alt22:37
jeblairso if there's a way to fix 516740, that's what i'd prefer22:37
jeblairclarkb: can you take that over then?22:38
dmsimardjeblair: I've already cut down the amount of deps in 1.0 (at least 3 dependencies gone) and started splitting the components22:38
clarkbbut basically exec resource that calls pip with all the options necessary, then onlyif paratmer (This is likely the trickiest bit to get that check right)22:38
dmsimardso it's WIP22:38
dmsimardbrb22:38
clarkbjeblair: ya I can work on a new patchset to do the thing I describe22:38
jeblairclarkb: thanks!22:38
jeblair#action clarkb fix https://review.openstack.org/516740 to call pip directly22:38
jeblair#topic Open Discussion22:39
*** openstack changes topic to "Open Discussion (Meeting topic: zuul)"22:39
jeblairanyone have anything else?22:39
clarkbis there any outstanding cleanup work?22:39
clarkbdeleting servers, removing dead puppet code, etc?22:39
fungii almost have an etherpad with a list of the v2 (master) changes proposed for zuul and nodepool22:39
fungi#link https://etherpad.openstack.org/p/zuulv2-outstanding-change-triage22:40
fungithat's where it'll appear in a few minutes22:40
jeblairclarkb: i think there are still some disabled tests in zuul22:40
jeblairclarkb: i can't think of examples of the 2 things you cited22:41
pabelangerI'd like to get a few eyes on https://review.openstack.org/521324/ Add support for shared ansible_host in inventory now that dmsimard has added a few notes22:41
pabelangerclarkb: we likey can delete the release slaves, I can look at that tomorrow22:41
Shrewsjust an FYI for folks, i'm fairly certain that the cause of the finger daemon dying on the executor VMs is b/c of OOM issues. zuul-executor is chosen for killing, but it's actually the child of that process (the finger daemon) being killed22:41
Shrewsthis was discussed in #zuul, but mentioning here for wider exposure22:42
pabelangerWe also restarted zuulv3 late last week, to address memory issues. It was just about to hit 15GB of RAM22:42
jeblairShrews: now that i think about that more -- i wonder why zuul is using so much memory... i mean, ansible is doing all the work22:42
jeblairShrews: you're fairly certain it's the main process that's using lots of ram?22:43
jeblairShrews: oh, i wonder if there's some ansible output buffering the executor is doing that's using lots of ram22:43
jeblairpabelanger: how long had it run, do you know?22:44
Shrewsjeblair: yes. kern.log outputs the mem usage of things before killing22:44
jeblairShrews: know how much it was using in absolute terms?22:45
fungiokay, that etherpad linked earlier is now complete: 133 open zuul changes and 65 open nodepool changes on master at the moment22:45
pabelangerjeblair: about a week I think, that was the last time I had restarted it22:45
fungialso worth noting, we still have a couple open changes on nodepool's feature/gearman-zk-shim branch. presumably those can go away?22:45
jeblairpabelanger: hrm.  we should be able to do better than that.22:45
pabelangerjeblair: but, I can get a more exact number22:45
Shrewsjeblair: http://paste.openstack.org/raw/627522/22:46
Shrewsthat was from ze422:46
jeblairfungi: yeah, i think so.  we can probably abandon them and delete the branch.  let's double check with mordred.22:46
pabelangerjeblair: yah, memory does seem to spike when new patchsets with .zuul.yaml are added22:46
jeblairpabelanger: did we have a bunch all at once?22:46
jeblairmaybe we should graph that as a metric22:46
pabelangerthis time, it was chef repos that were coming online22:46
pabelangerjeblair: yah, about 6 patches22:46
fungijeblair: pabelanger: was the zuul scheduler memory consumption maybe due to someone posting a new flurry of dynamic reconfiguration triggering changes?22:46
fungier, i guess you already went there22:47
jeblairShrews: know the units for that by any chance?22:47
mordredjeblair, fungi: we can definitely delete anyhting on feature/gearman-zk-shim22:47
mordredfungi: I can abandon those right now22:47
jeblairmordred: want to go ahead and delete the branch?22:47
fungithanks mordred!22:47
jeblairanyone object to deleting the feature/gearman-zk-shim branch?22:48
Shrewsjeblair: i do not22:48
pabelanger++22:48
fungifar from it, i wholeheartedly endorse deletion of that branch now22:48
mordredjeblair: yah - can do22:48
fungihaving more than one feature branch open for a repo seems like a recipe for problems, to me22:48
jeblairShrews: i think it may be 4k pages22:48
mordredfungi, jeblair22:49
mordredfungi, jeblair: done22:49
funginow we just have some ~200 pre-v3 changes to zuul and nodepool to figure out what to do with ;)22:49
jeblairShrews: so that's 4.6 GB of ram.  it seems like a lot.22:50
clarkbfungi: we probably want to sort them by features vs bugfixes22:50
clarkbfungi: bugfixes consider merging based on severity, features point to v3 things?22:50
fungiagreed, some means of grouping/tagging would make sense next22:50
jeblairShrews: may be a leak in the executor?22:50
Shrewsjeblair: "Nov 23 00:26:22 ze04 kernel: [8494719.679223] git invoked oom-killer: gfp_mask=0x26000c0, order=2, oom_score_adj=0"22:50
Shrewsjeblair: does that mean a git operation is triggering it?22:51
*** ansmith has joined #openstack-meeting-alt22:51
fungii think it means git asked for some memory, the kernel realized it had none, and then excitement ensued22:51
fungior hilarity, depending on your mood22:52
jeblairyeah, so not really git's fault.  just in the wrong place at the wrong time22:52
Shrewsjust wondering it the git operations are using more memory than we expect. at any rate, probably a #zuul discussion22:52
fungiprobability is the number of git operations mean that an allocation request from a git process is statistically likely to make the next request22:53
fungier, be the next request, whatever22:53
fungiyour highest-churn processes are the ones most likely to trigger an oom action, but the process using the most memory could easily be something else22:54
Shrews*nod*22:54
fungithe sacrificed children mentioned in the log are the most likely culprits22:55
fungi[Thu Nov 23 00:26:21 2017] Killed process 20080 (zuul-executor) total-vm:850552kB, anon-rss:8900kB, file-rss:6048kB22:56
*** SimAloo has quit IRC22:56
Shrewsfungi: in this case, the child was using much less memory than the parent22:56
Shrewsbut the child was chosen, thus no more finger process22:56
* fungi avoids making a lotr reference involving us being down to only 9 fingers22:57
jeblairwe're about at time22:58
jeblairso thanks everyone!22:58
jeblair#endmeeting22:59
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings"22:59
openstackMeeting ended Mon Nov 27 22:59:04 2017 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)22:59
openstackMinutes:        http://eavesdrop.openstack.org/meetings/zuul/2017/zuul.2017-11-27-22.06.html22:59
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/zuul/2017/zuul.2017-11-27-22.06.txt22:59
openstackLog:            http://eavesdrop.openstack.org/meetings/zuul/2017/zuul.2017-11-27-22.06.log.html22:59
*** ijw has quit IRC22:59
*** Shrews has left #openstack-meeting-alt22:59
*** ijw has joined #openstack-meeting-alt23:15
*** pbourke has quit IRC23:23
*** dave-mccowan has quit IRC23:24
*** ircuser-1 has joined #openstack-meeting-alt23:24
*** slaweq has quit IRC23:25
*** pbourke has joined #openstack-meeting-alt23:25
*** slaweq has joined #openstack-meeting-alt23:27
*** julim has joined #openstack-meeting-alt23:32
*** slaweq has quit IRC23:33
*** chyka_ has joined #openstack-meeting-alt23:33
*** julim has quit IRC23:35
*** chyka has quit IRC23:36
*** kumarmn has quit IRC23:40
*** marst has quit IRC23:57

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!