Friday, 2018-07-13

*** takashin has joined #openstack-placement00:12
openstackgerritMerged openstack/nova master: Update process doc to be more generic about point of contact  https://review.openstack.org/58231200:30
openstackgerritMerged openstack/nova master: Handle rebuild of instances with image traits  https://review.openstack.org/56949800:43
openstackgerritVu Cong Tuan proposed openstack/nova-specs master: Switch to stestr  https://review.openstack.org/58128401:04
openstackgerritmelanie witt proposed openstack/nova master: Add functional regression test for bug 1778305  https://review.openstack.org/58240701:34
openstackgerritmelanie witt proposed openstack/nova master: Don't generate service UUID for deleted services  https://review.openstack.org/58240801:34
openstackbug 1778305 in OpenStack Compute (nova) "Nova may erronously look up service version of a deleted service, when hostname have been reused" [Undecided,In progress] https://launchpad.net/bugs/1778305 - Assigned to melanie witt (melwitt)01:34
openstackgerritmelanie witt proposed openstack/nova master: Add functional regression test for bug 1764556  https://review.openstack.org/58243501:34
openstackbug 1764556 in OpenStack Compute (nova) ""nova list" fails with exception.ServiceNotFound if service is deleted and has no UUID" [Medium,In progress] https://launchpad.net/bugs/176455601:34
openstackgerritChen proposed openstack/nova master: fix cellv2 delete_host  https://review.openstack.org/58217101:51
openstackgerritJulia Kreger proposed openstack/nova master: ironic: provide facilities to gracefully navigate versions  https://review.openstack.org/58241601:53
openstackgerritJulia Kreger proposed openstack/nova master: virt/ironic: Implement rescue and unrescue  https://review.openstack.org/41648701:56
*** mriedem has quit IRC02:04
openstackgerritTakashi NATSUME proposed openstack/nova master: Transform instance.live_migration_force_complete notification  https://review.openstack.org/48056102:19
openstackgerritYikun Jiang (Kero) proposed openstack/nova master: Microversion 2.64 - Use new format policy in server group  https://review.openstack.org/56753402:32
openstackgerritYikun Jiang (Kero) proposed openstack/nova master: Microversion 2.64 - Use new format policy in server group  https://review.openstack.org/56753402:44
openstackgerritZhenyu Zheng proposed openstack/nova master: Use ThreadPoolExecutor for max_concurrent_live_migrations  https://review.openstack.org/56350502:45
openstackgerritMerged openstack/nova master: Follow up for Ie49d605c66062d2548241d7e04f5a2a6b98c011e  https://review.openstack.org/58229202:45
openstackgerritMerged openstack/nova master: Add policy field to ServerGroup notification object  https://review.openstack.org/56340102:45
openstackgerritMerged openstack/nova master: Change the ServerGroupAntiAffinityFilter to adapt to new policy  https://review.openstack.org/57116602:59
openstackgerritEric Fried proposed openstack/nova master: WIP: Compute: Handle reshaped provider trees  https://review.openstack.org/57623603:32
openstackgerritYikun Jiang (Kero) proposed openstack/nova master: Fix all invalid obj_make_compatible test case  https://review.openstack.org/57424003:44
openstackgerritHironori Shiina proposed openstack/nova master: ironic: Log an error when API version is not available  https://review.openstack.org/58244704:35
*** e0ne has joined #openstack-placement05:10
*** tetsuro has joined #openstack-placement05:28
*** e0ne has quit IRC05:50
*** e0ne has joined #openstack-placement05:58
*** e0ne has quit IRC05:59
*** e0ne has joined #openstack-placement06:01
*** e0ne has quit IRC06:06
*** e0ne has joined #openstack-placement06:06
*** e0ne has quit IRC06:09
*** e0ne has joined #openstack-placement06:17
*** e0ne_ has joined #openstack-placement06:21
*** e0ne has quit IRC06:22
*** e0ne has joined #openstack-placement06:22
openstackgerritYikun Jiang (Kero) proposed openstack/nova master: Fix all invalid obj_make_compatible test case  https://review.openstack.org/57424006:26
*** e0ne_ has quit IRC06:26
*** tssurya has joined #openstack-placement06:29
*** e0ne_ has joined #openstack-placement06:33
*** e0ne_ has quit IRC06:33
*** e0ne has quit IRC06:35
*** e0ne has joined #openstack-placement06:40
openstackgerritYikun Jiang (Kero) proposed openstack/nova master: Address nits in server group policy series  https://review.openstack.org/58161606:43
openstackgerritHironori Shiina proposed openstack/nova master: ironic: Log an error when API version is not available  https://review.openstack.org/58244706:45
openstackgerritZhenyu Zheng proposed openstack/nova master: Compute: add support to abort queued live migration  https://review.openstack.org/56854206:45
*** tetsuro has quit IRC06:48
*** e0ne has quit IRC06:48
*** tetsuro has joined #openstack-placement06:49
*** tetsuro has quit IRC06:57
openstackgerritOpenStack Proposal Bot proposed openstack/nova master: Imported Translations from Zanata  https://review.openstack.org/57801906:58
*** tssurya has quit IRC06:58
openstackgerritZhenyu Zheng proposed openstack/nova master: Fix ServerMigrationSampleJsonTestsV2_24 to use its own sample file  https://review.openstack.org/58156206:59
*** tetsuro has joined #openstack-placement07:00
*** tssurya has joined #openstack-placement07:00
*** peereb has joined #openstack-placement07:18
openstackgerritZhenyu Zheng proposed openstack/nova master: Compute: add support to abort queued live migration  https://review.openstack.org/56854207:41
openstackgerritZhenyu Zheng proposed openstack/nova master: Fix ServerMigrationSampleJsonTestsV2_24 to use its own sample file  https://review.openstack.org/58156207:53
*** ttsiouts has joined #openstack-placement08:00
*** e0ne has joined #openstack-placement08:07
*** tetsuro has quit IRC08:18
*** takashin has left #openstack-placement08:30
*** gibi is now known as giblet_off08:35
*** tetsuro has joined #openstack-placement08:35
*** tetsuro has quit IRC08:45
*** tetsuro has joined #openstack-placement08:45
*** tetsuro has quit IRC08:51
*** ttsiouts has quit IRC08:59
*** tetsuro has joined #openstack-placement09:01
openstackgerrittianhui proposed openstack/nova master: Change default video model from cirrus to vga  https://review.openstack.org/58247109:03
*** ttsiouts has joined #openstack-placement09:14
*** tetsuro has quit IRC09:39
openstackgerritChen proposed openstack/nova master: Clean up group members in db when delete  https://review.openstack.org/58140309:43
openstackgerrithuanhongda proposed openstack/nova-specs master: Return "deleted" and "estimated_reclaim" time of instance for admin  https://review.openstack.org/58163809:57
*** tetsuro has joined #openstack-placement10:04
openstackgerritChen proposed openstack/nova master: fix cellv2 delete_host  https://review.openstack.org/58217110:07
*** ttsiouts has quit IRC10:08
*** ttsiouts has joined #openstack-placement11:08
openstackgerritMerged openstack/nova master: Imported Translations from Zanata  https://review.openstack.org/57801911:16
*** edmondsw has joined #openstack-placement11:33
*** jaypipes is now known as leakypipes12:34
leakypipesefried: ping me when you're around. we need to talk about this reshape DB work.12:34
leakypipesefried: basically, if you want me to take a strategy of "determine the actual changes that need to be performed instead of replacing the world", I will need to not call any of the existing methods like AllocationList.create_all() because they are destructive and blow away all allocations for all consumers involved in the allocation list object before re-creating them. If you want me to do that, so be it, but it's not the "replace the12:38
leakypipesworld" strategy that everyone (except me) wanted to go with.12:38
leakypipes(and if it sounds like I'm annoyed because I'd originally suggested to do a PATCH operation with the caller just stating the changes that needed to be performed, it's because I am indeed annoyed)12:40
*** mriedem has joined #openstack-placement12:40
leakypipesI'm going to get some more coffee and go work on some other code for a while. ping me when you're ready to discuss and hopefully I'll be a bit calmer.12:40
* leakypipes works on being calmer and less aggressive12:42
*** leakypipes is now known as smokypipes12:42
*** tetsuro has quit IRC12:45
*** tetsuro has joined #openstack-placement12:45
*** tetsuro has quit IRC12:45
*** ttsiouts has quit IRC12:54
*** smokypipes is now known as leakypipes12:58
mriedemi know what can calm you down https://review.openstack.org/#/c/574488/12:59
mriedemwink wink12:59
leakypipesmriedem: done13:12
openstackgerritSurya Seetharaman proposed openstack/nova master: Online migration tool for populating queued-for-delete  https://review.openstack.org/58253613:12
*** edleafe is now known as figleaf13:21
openstackgerritMerged openstack/nova master: Adapt _validate_instance_group_policy to new policy model  https://review.openstack.org/57146513:31
mriedemhot dog!13:34
*** peereb has quit IRC13:44
*** ttsiouts has joined #openstack-placement14:00
*** efried is now known as fried_rice14:11
fried_riceleakypipes: I'm here.14:12
fried_riceleakypipes: Are you saying that an existing PUT /allocations/{c} or POST /allocations operation will a) not check consumer gens and/or b) reset the gens to 0? That doesn't seem right.14:14
fried_riceleakypipes: I don't think we need to go full PATCH to make this work.  If you're not already in the middle, wanna let me dork with it for a few minutes?14:15
fried_ricemriedem, leakypipes: I just noticed the placement api ref is missing response examples for GET /allocations <1.1214:39
fried_riceIsn't that where the allocations were in list format?14:40
mriedemno,14:40
mriedemi think you're thinking of the changes to PUT and POST where we changed those to match GET14:41
mriedemhttps://developer.openstack.org/api-ref/placement/#request-microversions-1-0-1-1114:41
fried_riceokay, cool.14:41
mriedemPUT < 1.12 was list format14:41
fried_riceThen I agree with dansmith (and PS5 me).14:42
*** ttsiouts has quit IRC14:43
fried_ricemriedem: left comments on heal allocs. If you can refute my argument (again) I'll +A.14:46
*** ttsiouts has joined #openstack-placement14:50
mriedemfried_rice: as in the thing i already replied to and noted that cdent was inline with the same thinking?14:57
mriedemoh nvm i see15:00
mriedemso if i understand correctly, GET /allocations/consumer_id 1.0 -> 1.27 is the exact same *except* for project_id/user_id returned in the top of the response body starting in 1.1215:01
mriedemRIGHT?!15:01
fried_ricemriedem: Yes, that seems to be true (checked in the source code as well)15:02
fried_ricei.e. resp.json()['allocations'] never changed (even up to 1.29)15:03
mriedemso the requested change is to just always request 1.12 right?15:03
mriedembut i can keep the kwarg to return the full response vs just the resp.json()['allocations'] part right?15:04
mriedembecause i'm not going to update all callers of this method in this change15:04
mriedemand will flip a gd table if i have to do it before15:04
fried_ricemriedem: Correct15:08
fried_ricemriedem: Though I would like to see you flip a table.15:09
leakypipesmriedem: ftr, I'm totally cool with doing any of those change for heal_allocations() in a followup.15:09
mriedemi'm doing the thing now15:09
leakypipesmriedem: I'd prefer to see that merged and make progress vs nitpicking it to death.15:09
mriedemrunning tests now15:09
fried_riceleakypipes: Not for the fact that we want to backport this, I would agree.15:10
mriedemnaw it's fine, i just wasn't making the connection on the 1.12 thing until now15:10
mriedemand was confusing it with PUT /allocations 1.12 and the request body format change15:10
leakypipesmriedem: lots to be confused about for sure.15:10
mriedemplacement is starting to get hair where there previously was no hair15:11
mriedemit's confusing times15:11
* mriedem would tweet that if he tweeted15:11
fried_riceleakypipes: Regarding reshaper, you want me to play with the "straddling inventory changes" thing?15:12
leakypipesfried_rice: you can if you want15:16
leakypipesfried_rice: in other words, I'm not going to stop you.15:17
openstackgerritChen proposed openstack/nova master: fix cellv2 delete_host  https://review.openstack.org/58217115:18
leakypipesfried_rice: I think you will find that you're not going to be able to use any of the existing methods: AllocationList.create_all() and ResourceProvider.set_inventory().15:18
leakypipesfried_rice: because they blow away history and re-create it all from scratch.15:18
fried_riceleakypipes: noted.15:18
fried_riceleakypipes: Isn't AllocationList.create_all() (now replace_all()) what we use from PUT /allocations/{c} ?15:19
leakypipesfried_rice: yes.15:20
leakypipesfried_rice: and POST /allocations15:20
fried_riceleakypipes: okay, so my goal is to use that guy.  It's the inventory changes I want to split up.15:20
leakypipesfried_rice: good luck.15:21
fried_riceleakypipes: I'm talking about doing it in three steps, total.15:21
fried_riceleakypipes: Not splitting into individual pieces.15:21
leakypipesfried_rice: like I said, good luck :)15:21
fried_riceleakypipes: i.e. [Inventory changes that don't remove any inventories] [AllocationList.replace_all()] [Inventory changes that delete inventories]15:21
leakypipesfried_rice: don't use ResourceProvider.set_inventory() then, since it'll blow away all your inventory records for the provider.15:22
fried_riceleakypipes: I should be able to use whatever the API uses to set inventories.  Cause you can change inventories with allocations from the API as long as the end result still has the resource classes you started with.  Even if you're reducing capacity below what's allocated, we let you go "into the red" that way.15:24
leakypipesfried_rice: like I said, good luck :) I'll be listening for your cries of horror.15:27
fried_riceack15:27
fried_rice^ not a cry of horror (yet)15:27
leakypipesfried_rice: no, that would have been "eck" or "eek".15:29
*** ttsiouts has quit IRC15:30
*** ttsiouts has joined #openstack-placement15:33
openstackgerritMatt Riedemann proposed openstack/nova master: Heal allocations with incomplete consumer information  https://review.openstack.org/57448815:39
openstackgerritMatt Riedemann proposed openstack/nova master: Refactor _heal_instances_in_cell  https://review.openstack.org/57789615:39
openstackgerritMatt Riedemann proposed openstack/nova master: Use consumer generation in _heal_allocations_for_instance  https://review.openstack.org/57790515:39
mriedemfried_rice: leakypipes: ^15:40
fried_ricemriedem: +215:41
leakypipesmriedem: the sarlacc pits await.15:44
mriedemYES15:45
mriedemjust aim a little higher15:45
mriedemnow you've got me craving colt 4515:45
leakypipes:)15:46
mriedemmelwitt: ^ another runways slot will open up today15:46
melwitt /fistpump15:47
mriedemfor https://review.openstack.org/#/c/416487/ which needs a 2nd +215:47
melwittyeah, I've got those on my list if someone doesn't get to them first15:47
melwittoh, that's next in the runways queue, gotcha15:48
*** ttsiouts has quit IRC15:52
openstackgerritMatt Riedemann proposed openstack/nova master: Skip more rebuild tests for cells v1 job  https://review.openstack.org/58171715:53
*** tssurya has quit IRC15:53
*** e0ne has quit IRC15:54
fried_riceleakypipes: You gonna have a look at the reshaper client side WIP for sanity today?16:04
leakypipesfried_rice: sure. link?16:04
fried_ricehttps://review.openstack.org/#/c/576236/16:04
fried_ricereally just to make sure I'm following what we agreed on, and there are no wild surprising things in there16:05
fried_riceleakypipes: Note I've also got a spec amendment up: https://review.openstack.org/#/c/582350/16:05
*** fried_rice is now known as fried_rolls16:18
openstackgerritMatt Riedemann proposed openstack/nova master: Use ThreadPoolExecutor for max_concurrent_live_migrations  https://review.openstack.org/56350516:47
openstackgerritMatt Riedemann proposed openstack/nova master: Compute: add support to abort queued live migration  https://review.openstack.org/56854216:47
openstackgerritMatt Riedemann proposed openstack/nova master: Fix ServerMigrationSampleJsonTestsV2_24 to use its own sample file  https://review.openstack.org/58156216:47
openstackgerritStephen Finucane proposed openstack/nova master: conf: Add '[neutron] physnets' and related options  https://review.openstack.org/56444017:41
openstackgerritStephen Finucane proposed openstack/nova master: libvirt: Start populating NUMACell.network_metadata field  https://review.openstack.org/56444117:41
openstackgerritStephen Finucane proposed openstack/nova master: scheduler: Start utilizing RequestSpec.network_metadata  https://review.openstack.org/56445217:41
openstackgerritStephen Finucane proposed openstack/nova master: Assorted cleanups from numa-aware-vswitches series  https://review.openstack.org/58265117:41
*** fried_rolls is now known as fried_rice18:15
*** tssurya has joined #openstack-placement18:32
openstackgerritMatt Riedemann proposed openstack/nova master: API: add support to abort queued live migration in microversion 2.64  https://review.openstack.org/57313618:33
openstackgerritMatt Riedemann proposed openstack/nova master: Compute: add support to abort queued live migration  https://review.openstack.org/56854218:46
openstackgerritMatt Riedemann proposed openstack/nova master: Fix ServerMigrationSampleJsonTestsV2_24 to use its own sample file  https://review.openstack.org/58156218:46
openstackgerritMatt Riedemann proposed openstack/nova master: API: add support to abort queued live migration in microversion 2.64  https://review.openstack.org/57313618:46
*** tssurya has quit IRC18:59
fried_riceleakypipes: Got that approach to work just fine.  Posting in a sec.19:01
fried_riceleakypipes: it also checks consumer gens correctly (did the =99 thing and it broke as expected)19:02
openstackgerritEric Fried proposed openstack/nova master: PoC: reshaper guts with inventory two-step  https://review.openstack.org/58266319:07
fried_riceleakypipes: ^^19:08
fried_ricefor your perusal and ultimate squashage if you think it's workable.19:08
leakypipesack19:09
*** tssurya has joined #openstack-placement19:21
openstackgerritMerged openstack/nova master: Heal allocations with incomplete consumer information  https://review.openstack.org/57448819:27
fried_ricemelwitt, mriedem: That's a runway slot? ^19:28
*** tssurya_ has joined #openstack-placement19:30
mriedemfried_rice: as in one is open?19:31
mriedemfried_rice: it was the last remaining item in the add-consumer-generation bp19:31
fried_ricemriedem: right19:31
mriedemso it was in a slot yes19:31
mriedemnow it can be out of the slot19:31
fried_riceright19:31
* fried_rice kicks translator19:31
mriedemi'm not sure if you're saying it shouldn't have been slotted, or "it's merged so let's free up the slot"19:32
fried_ricethe latter19:32
mriedemwell then i wholeheartedly agree19:34
fried_ricesomething about a dutchie19:34
fried_ricewhich, by the way, Renae also had never heard of.19:34
fried_riceand she *did* grow up in this country, in the '80s19:34
mriedemtbf,19:35
mriedemi wasn't familiar with that song in my youth19:35
fried_riceyou would have been in diapers when it came out19:35
* fried_rice assumes you're not in diapers currently19:35
mriedemi guess that's accurate19:36
mriedemborn in 8119:36
mriedemas for whether or not i'm currently still soiling myself, that's for me to know19:37
leakypipesfried_rice: good work on that reshaping reshaper into a reshaped shapely shape. once I'm done with a local patch I'll pull yours and squash.19:38
fried_riceleakypipes: Schweetness19:38
leakypipesfried_rice: I think you meant "reschweetness".19:40
*** tssurya_ has quit IRC19:40
fried_riceI should be working on my German.  Resüssekeit19:41
openstackgerritMatt Riedemann proposed openstack/nova master: Handle HostMappingNotFound when deleting a compute service  https://review.openstack.org/58267419:43
openstackgerritMatt Riedemann proposed openstack/nova master: Stop using HostAPI.service_delete  https://review.openstack.org/58268020:00
*** e0ne has joined #openstack-placement20:12
*** tssurya_ has joined #openstack-placement20:18
*** tssurya has quit IRC20:22
*** tssurya_ has quit IRC20:23
*** tssurya has joined #openstack-placement20:23
*** mriedem has quit IRC20:40
fried_riceleakypipes: How do you feel about us shoving all the reshaper patches into a series at this point? Double-edged sword: better because we can keep the dependencies straight without Depends-On weirdness, but awkward because three different authors.20:56
fried_riceleakypipes: If you haven't gotten started yet, I can do that and squash in the inventory two-step thing. Then start working on expanding tests for cdent's microversion patch (to do real reshapes in addition to the existing sniff tests) and adding tests for the client side.20:58
leakypipesfried_rice: go for it. still trying to fix bugs on a diff patch21:00
fried_riceack21:00
leakypipesfried_rice: please re-add in the LOG statements when you rebase/squash21:00
fried_riceleakypipes: You have a local edit for the nits on your reshaper db patch?21:00
fried_riceleakypipes: ('Done' responses to comments but no new PS in gerrit)21:00
leakypipesfried_rice: I do but they were tiny. feel free to fix those yourself when rebasing.21:01
fried_riceight21:01
leakypipesty sir21:01
*** tssurya_ has joined #openstack-placement21:27
*** tssurya has quit IRC21:29
*** e0ne_ has joined #openstack-placement21:42
*** e0ne has quit IRC21:42
-openstackstatus- NOTICE: logs.openstack.org is offline, causing POST_FAILURE results from Zuul. Cause and resolution timeframe currently unknown.21:51
*** ChanServ changes topic to "logs.openstack.org is offline, causing POST_FAILURE results from Zuul. Cause and resolution timeframe currently unknown."21:51
fried_riceleakypipes: Having transaction misbehavior on reshape. You around?21:54
fried_riceleakypipes: So we're doing three steps: 1) inventory hybrid; 2) allocations; 3) inventory final21:56
fried_riceWhen I make step 2 fail (with a bogus consumer generation) the rp gen bump from step 1 isn't getting rolled back.21:56
fried_riceactually, even if I make step 1 fail, same thing, the rp gen is still getting bumped.21:59
fried_riceoh.  This is probably because I'm inside of whatever layer (wsgi?) does the outermost rollbacky thing, huh22:00
fried_riceI guess I'll test this from the outside via gabbi in the microversion patch.22:01
*** figleaf is now known as edleafe22:05
*** e0ne_ has quit IRC22:12
*** e0ne has joined #openstack-placement22:13
leakypipesfried_rice: yup. everything needs to be done within the reshape() function. see my comment in the docstring of that function22:16
fried_riceleakypipes: But it is.22:16
fried_riceleakypipes: So your test sets up the original invs & allocs; then it calls reshaper.22:16
leakypipesfried_rice: well, if that's the case, save what you have and push. I'll take a looksie tomorrow late morning (I'm off for the night now)22:17
fried_riceleakypipes: What I'm doing is, before I call reshaper, I muck with a generation somewhere.  Call reshaper, and it fails, as it should, because gen mismatch.  So far so good.22:17
leakypipesfried_rice: k22:17
fried_riceleakypipes: Then I fix the generation - back to its original value - and call reshaper again.  It should succeed, because the failed one should have rolled back.22:17
fried_ricebut it doesn't - I get ConcurrentUpdate again.22:17
fried_riceand debug printfs show that rp gens are staying incremented.22:18
fried_riceSo either the transaction behavior is supposed to happen *outside* of the scope of reshaper, or... something else.22:18
leakypipesfried_rice: unfortunately, I'm taking off for the night. like I mentioned, feel free to push what you have and I'll have a look tomorrow?22:19
fried_riceight22:20
fried_ricethanks22:20
leakypipessorry man22:20
openstackgerritEric Fried proposed openstack/nova master: perform reshaper operations in single transaction  https://review.openstack.org/58238322:28
openstackgerritEric Fried proposed openstack/nova master: WIP: [placement] Add /reshaper handler for POST  https://review.openstack.org/57692722:28
openstackgerritEric Fried proposed openstack/nova master: WIP: Compute: Handle reshaped provider trees  https://review.openstack.org/57623622:28
*** edmondsw has quit IRC22:31
*** e0ne has quit IRC22:33
*** fried_rice is now known as efried22:36
*** tssurya_ has quit IRC23:26
*** edmondsw has joined #openstack-placement23:26
*** leakypipes is now known as jaypipes23:31
*** edmondsw has quit IRC23:31
*** ChanServ changes topic to "See https://docs.openstack.org/nova/latest/user/placement.html and https://developer.openstack.org/api-ref/placement/"23:35
-openstackstatus- NOTICE: logs.openstack.org is back on-line. Changes with "POST_FAILURE" job results should be rechecked.23:35

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!