Tuesday, 2019-10-08

*** takashin has joined #openstack-nova00:00
*** hoonetorg has joined #openstack-nova00:06
*** gyee has quit IRC00:07
*** slaweq has joined #openstack-nova00:11
*** slaweq has quit IRC00:15
*** markvoelker has joined #openstack-nova00:23
*** markvoelker has quit IRC00:28
openstackgerritMerged openstack/nova master: docs: Rewrite host aggregate, availability zone docs  https://review.opendev.org/66713300:30
*** brinzhang has joined #openstack-nova00:33
openstackgerritMerged openstack/nova master: fixtures: Handle iterable params for 'NeutronFixture.list_*'  https://review.opendev.org/68679600:39
openstackgerritMerged openstack/nova master: fixtures: Store 'device_id' when creating port in NeutronFixture  https://review.opendev.org/68679700:45
*** tetsuro has quit IRC01:05
*** tetsuro has joined #openstack-nova01:16
*** markvoelker has joined #openstack-nova01:26
*** yaawang has quit IRC01:30
*** yaawang has joined #openstack-nova01:31
*** markvoelker has quit IRC01:37
*** markvoelker has joined #openstack-nova01:37
*** BjoernT has joined #openstack-nova01:40
*** markvoelker has quit IRC01:42
*** yaawang has quit IRC01:42
*** BjoernT has quit IRC01:43
*** yaawang has joined #openstack-nova01:44
*** boxiang has joined #openstack-nova01:48
*** yonglihe has joined #openstack-nova01:52
*** macz has joined #openstack-nova01:55
*** macz has quit IRC02:00
*** markvoelker has joined #openstack-nova02:02
*** yikun has joined #openstack-nova02:02
*** slaweq has joined #openstack-nova02:11
*** tetsuro has quit IRC02:14
*** slaweq has quit IRC02:16
openstackgerritJing Zhang proposed openstack/nova master: [WIP] Default mem_page_size to small for pinned instances  https://review.opendev.org/68607902:17
*** tetsuro has joined #openstack-nova02:17
*** rnoriega_ has joined #openstack-nova02:19
openstackgerritya.wang proposed openstack/nova-specs master: Re-propose expose-auto-converge-post-copy spec for Ussuri  https://review.opendev.org/68719902:43
*** ricolin has joined #openstack-nova02:47
*** igordc has quit IRC02:52
*** takashin has left #openstack-nova03:03
*** yaawang has quit IRC03:07
*** yaawang has joined #openstack-nova03:07
*** igordc has joined #openstack-nova03:19
*** tetsuro has quit IRC03:37
*** tetsuro has joined #openstack-nova03:38
*** tkajinam has joined #openstack-nova03:49
*** markvoelker has quit IRC03:49
*** yaawang has quit IRC04:06
*** yaawang has joined #openstack-nova04:08
*** mkrai has joined #openstack-nova04:08
*** slaweq has joined #openstack-nova04:11
*** slaweq has quit IRC04:16
*** mkrai has quit IRC04:18
*** fungi has quit IRC04:21
*** fungi has joined #openstack-nova04:25
*** dave-mccowan has quit IRC04:41
openstackgerritMerged openstack/nova master: Remove workaround for bug #1709118  https://review.opendev.org/52431604:57
openstackbug 1709118 in OpenStack Compute (nova) "_ContextAuthPlugin needs a refresh" [Low,Invalid] https://launchpad.net/bugs/170911804:57
*** brinzhang_ has joined #openstack-nova05:12
*** brinzhang has quit IRC05:15
*** bnemec has quit IRC05:19
*** elod has quit IRC05:26
*** brinzhang has joined #openstack-nova05:28
*** brinzhang has quit IRC05:29
*** brinzhang has joined #openstack-nova05:30
*** brinzhang has joined #openstack-nova05:31
*** brinzhang_ has quit IRC05:31
openstackgerritMerged openstack/nova master: [Gate fix] Avoid use cell_uuid before assignment  https://review.opendev.org/68699605:42
*** markvoelker has joined #openstack-nova05:50
*** markvoelker has quit IRC05:55
*** psachin has joined #openstack-nova05:59
*** yaawang has quit IRC06:06
*** yaawang has joined #openstack-nova06:07
*** slaweq has joined #openstack-nova06:11
*** brinzhang has joined #openstack-nova06:12
*** slaweq has quit IRC06:15
*** sapd1_x has joined #openstack-nova06:19
*** dtantsur|afk is now known as dtantsur06:28
*** ccamacho has quit IRC06:35
*** slaweq has joined #openstack-nova06:35
*** jaosorior has quit IRC06:41
*** trident has quit IRC06:46
*** damien_r has joined #openstack-nova06:49
*** trident has joined #openstack-nova06:49
openstackgerritBalazs Gibizer proposed openstack/nova stable/train: Error out interrupted builds  https://review.opendev.org/68721606:53
bauzasgood morning Nova07:02
*** mjozefcz has joined #openstack-nova07:05
*** rcernin has quit IRC07:05
*** ttsiouts has joined #openstack-nova07:10
*** tesseract has joined #openstack-nova07:10
gibibauzas: good morning07:13
*** tetsuro has quit IRC07:16
*** tetsuro has joined #openstack-nova07:16
*** awalende has joined #openstack-nova07:17
bauzasgibi: I was a bit on and off upstream last days so if you need some eyes, tell me07:19
*** damien_r has quit IRC07:19
gibibauzas: nothing urgent at the moment. I still want to get back to your audit patch07:21
bauzasgibi: I need to write a reno note and some docs like matt asked07:21
gibibauzas: I saw mriedem's comments. I more interested in trying your code in my devstack07:23
*** jaosorior has joined #openstack-nova07:24
bauzasgibi: that'd be awesome07:25
bauzasgibi: functional tests don't really check children allocations07:25
bauzasgibi: but hopefully it will work this time given you found the root cause last time :)07:26
*** ccamacho has joined #openstack-nova07:26
*** ttsiouts has quit IRC07:26
*** ccamacho has quit IRC07:27
*** ttsiouts has joined #openstack-nova07:27
*** ccamacho has joined #openstack-nova07:27
gibibauzas: I can try that with bandwith allocation on child RPs.07:27
bauzas++07:28
bauzasgibi: I can also do this with VGPU allocations, but i need to reboot my environment :)07:28
gibibauzas: fortunetly the bandwidth setup does not need any special hardware so it is easy for me to build a devstack07:29
bauzasyeah07:29
bauzashopefully, VGPU allocations would work with Intel GPU07:29
bauzasbut I didn't have time to test those07:29
*** mvkr has quit IRC07:30
*** ttsiouts has quit IRC07:31
openstackgerritAkihiro Motoki proposed openstack/nova master: doc: Improve PDF document structure  https://review.opendev.org/68274607:39
*** mvkr has joined #openstack-nova07:43
*** lpetrut has joined #openstack-nova07:45
*** kaisers has joined #openstack-nova07:47
*** ralonsoh has joined #openstack-nova07:48
*** ttsiouts has joined #openstack-nova07:52
dr_gogeta86good morning all07:53
*** damien_r has joined #openstack-nova08:07
*** ociuhandu has joined #openstack-nova08:16
*** mvkr has quit IRC08:21
*** tssurya has joined #openstack-nova08:22
*** sapd1_x has quit IRC08:27
*** zhubx has joined #openstack-nova08:28
*** tkajinam has quit IRC08:30
*** jaosorior has quit IRC08:32
*** boxiang has quit IRC08:32
*** mvkr has joined #openstack-nova08:34
*** derekh has joined #openstack-nova08:38
*** rpittau|afk is now known as rpittau08:38
*** xek has joined #openstack-nova08:43
*** priteau has joined #openstack-nova08:47
*** ociuhandu has quit IRC08:57
openstackgerritLee Yarwood proposed openstack/nova master: compute: Remove stale BDMs on reserve_block_device_name failure  https://review.opendev.org/68259409:05
*** pcaruana has joined #openstack-nova09:30
*** ociuhandu has joined #openstack-nova09:30
*** brinzhang_ has joined #openstack-nova09:33
*** ociuhandu has quit IRC09:35
*** brinzhang has quit IRC09:37
*** ociuhandu has joined #openstack-nova09:43
*** jaosorior has joined #openstack-nova09:44
*** markvoelker has joined #openstack-nova09:53
openstackgerritLee Yarwood proposed openstack/nova master: Add regression test for bug #1843639  https://review.opendev.org/68262109:56
openstackbug 1843639 in OpenStack Compute (nova) "libvirt: post_live_migration failures to disconnect volumes result in the rollback of live migrations" [Medium,In progress] https://launchpad.net/bugs/1843639 - Assigned to Artom Lifshitz (notartom)09:56
openstackgerritLee Yarwood proposed openstack/nova master: libvirt: Ignore volume exceptions during post_live_migration  https://review.opendev.org/68262209:56
*** markvoelker has quit IRC09:58
*** brinzhang_ has quit IRC10:01
*** tetsuro has quit IRC10:06
*** tetsuro has joined #openstack-nova10:06
openstackgerritStephen Finucane proposed openstack/nova master: doc: Improve PDF document structure  https://review.opendev.org/68274610:08
*** slaweq_ has joined #openstack-nova10:09
*** slaweq has quit IRC10:09
stephenfinbauzas: Could I ask you to push through a few trivial patches for me, please? I've a lot of stuff in flight /o\10:10
stephenfinIf you could hit https://review.opendev.org/686211 https://review.opendev.org/686901 https://review.opendev.org/684774 and https://review.opendev.org/#/c/684775/ that's be great10:11
stephenfinhttps://imgflip.com/s/meme/That-Would-Be-Great.jpg10:11
*** tetsuro has quit IRC10:11
*** tetsuro has joined #openstack-nova10:13
openstackgerritLee Yarwood proposed openstack/nova master: compute: Take an instance.uuid lock when rebooting  https://review.opendev.org/67346310:17
*** jaosorior has quit IRC10:18
*** tetsuro_ has joined #openstack-nova10:20
*** tetsuro has quit IRC10:21
*** ttsiouts has quit IRC10:22
*** tbachman has quit IRC10:25
*** bbowen has quit IRC10:38
openstackgerritBalazs Gibizer proposed openstack/nova-specs master: Support move operations with qos ports - Ussuri  https://review.opendev.org/68677910:38
gibiefried: fixed your comments in ^^10:39
*** zhubx has quit IRC10:39
*** zhubx has joined #openstack-nova10:40
openstackgerritStephen Finucane proposed openstack/nova master: docs: Remove 'adv-config', 'system-admin' subdocs  https://review.opendev.org/68440210:42
openstackgerritStephen Finucane proposed openstack/nova master: docs: Replacing underscores with dashes  https://review.opendev.org/68592910:42
openstackgerritStephen Finucane proposed openstack/nova master: docs: Strip '.rst' suffix  https://review.opendev.org/68726410:42
openstackgerritBalazs Gibizer proposed openstack/nova master: Remove @safe_connect from put_allocations  https://review.opendev.org/68657910:45
*** dklyle has quit IRC10:49
*** dklyle has joined #openstack-nova10:49
*** rcernin has joined #openstack-nova10:52
openstackgerritLee Yarwood proposed openstack/nova master: compute: refactor volume bdm rollback error handling  https://review.opendev.org/65650010:55
lyarwoodstephenfin: ^ finally updated that if you have time this wekk.10:55
lyarwoodweek*10:55
*** ociuhandu has quit IRC10:56
*** ociuhandu has joined #openstack-nova11:05
*** ttsiouts has joined #openstack-nova11:06
*** cdent has joined #openstack-nova11:09
*** jamesdenton has quit IRC11:11
*** jamesden_ has joined #openstack-nova11:11
*** gshippey has quit IRC11:14
*** slaweq_ is now known as slaweq11:15
*** xek has quit IRC11:15
*** jamesden_ has quit IRC11:19
*** jamesdenton has joined #openstack-nova11:19
sean-k-mooneystephenfin: dumb question but how to i add blueprint to the nova team meeting agenda again. there is a wiki page i think right?11:20
sean-k-mooneyhttps://wiki.openstack.org/wiki/Meetings/Nova?11:20
sean-k-mooneyim not sure if that is the agenda for last weeks meetin or thi seeks meting11:23
*** jamesdenton has quit IRC11:24
*** jamesdenton has joined #openstack-nova11:24
*** dave-mccowan has joined #openstack-nova11:28
gibisean-k-mooney: add your stuff to that agenda with a timestamp so when efried goes and updates the agenda for the next meeting he will see that your item is for the upcoming meeting11:29
sean-k-mooneythanks11:29
sean-k-mooneygibi: i bacically want to know if https://blueprints.launchpad.net/nova/+spec/inplace-rebuild-of-numa-instances can proceed as a specless blueprint or if i should write a spec11:33
sean-k-mooneybut i have updated the agenda with the timestamp as you suggesteded11:33
*** ociuhandu has quit IRC11:34
*** ociuhandu has joined #openstack-nova11:35
gibisean-k-mooney: after reading the bp, for me it seems OK to have this as specless as it is only fixing bugs11:36
*** ociuhandu has quit IRC11:40
*** bbowen has joined #openstack-nova11:40
sean-k-mooneygibi: that is what i was hoping. do you think it makes sense to group them as a blueprint as i have11:42
sean-k-mooneyi intend to fix the bug as seperate patches in the order i suggested (prevent broken behavior then skip filter if safe)11:43
gibisean-k-mooney: it is easier to track multiple bugs as a single bp so I agree with your syle11:51
gibistyle11:51
*** tetsuro_ has quit IRC11:52
kashyapstephenfin: Just noticed that (WIP) change on skipping CPU comparison check on AArch64.  Will comment there.11:52
*** tetsuro has joined #openstack-nova11:52
sean-k-mooneycool i also just fixed all the spelling issue so it should be eaiser for others to parse11:52
*** markvoelker has joined #openstack-nova11:54
gibisean-k-mooney: thanks for the spelling fix :)11:54
*** ociuhandu has joined #openstack-nova11:56
sean-k-mooneyi am trying to get back in to using grammerly more at least of non irc communications11:57
*** markvoelker has quit IRC11:59
*** markvoelker has joined #openstack-nova12:03
*** elod has joined #openstack-nova12:04
*** jaosorior has joined #openstack-nova12:08
*** jaosorior has quit IRC12:08
*** jaosorior has joined #openstack-nova12:08
*** ociuhandu has quit IRC12:11
openstackgerritBalazs Gibizer proposed openstack/nova master: Refine comments about move_allocations  https://review.opendev.org/68618212:14
openstackgerritMerged openstack/nova master: Update contributor guide for Ussuri  https://review.opendev.org/68563012:14
*** ociuhandu has joined #openstack-nova12:17
*** tetsuro has quit IRC12:20
*** jangutter_ has joined #openstack-nova12:20
*** jangutter has quit IRC12:23
*** tetsuro has joined #openstack-nova12:26
*** belmoreira has joined #openstack-nova12:26
*** gbarros has joined #openstack-nova12:38
efriedgibi: +2, thanks for the updates12:40
gibiefried: thanks for the review12:40
efriedsean-k-mooney: ack meeting agenda12:40
efriedalex_xu: Is there more that needs to be done with https://review.opendev.org/#/c/685180/ (test case for unauthed versioned discovery) and its successor (the fix for same)?12:43
*** ociuhandu has quit IRC12:44
*** pcaruana has quit IRC12:53
*** spatel has joined #openstack-nova12:55
*** mriedem has joined #openstack-nova12:59
bauzasstephenfin: dammit, just saw your courtesy ping now :)13:02
bauzasstephenfin: that's what happens when you ping people when they are on gym :)13:02
bauzasand FWIW, just clicked on the 4 changes :)13:03
*** cdent_ has joined #openstack-nova13:04
*** cdent has quit IRC13:07
*** cdent_ is now known as cdent13:07
*** lpetrut has quit IRC13:08
mriedemefried: +2 on https://review.opendev.org/#/c/686414/ now, just let dansmith know when you want to pull the trigger for rc213:12
*** nweinber__ has joined #openstack-nova13:14
*** rcernin has quit IRC13:19
*** gbarros has quit IRC13:20
openstackgerritMatt Riedemann proposed openstack/nova master: doc: link to user/index from main home page  https://review.opendev.org/68729213:23
bauzasI wonder, does the US already shifted from summer times ?13:24
bauzas(that's in general 2 weeks before Europe hence my wonders)13:24
mriedemnot yet13:24
mriedemnovember 313:24
bauzasack ok13:24
bauzasthen Europe is one week *before* this time13:25
bauzasefried: left a comment on https://review.opendev.org/#/c/685857/13:25
bauzasefried: tl;dr while I'm basically OK with the idea, I just want to clarify the fact that we can't *guarantee* mandatory things13:26
bauzasit's more or less best effort13:26
bauzasalthough I'm trying hard to stick with this...13:26
*** jangutter has joined #openstack-nova13:32
efriedbauzas: Appreciate the reviews, responding now. We can't guarantee anything in this community, as you well know. I can try to make that clearer I suppose.13:33
bauzasefried: yeah, I know you know13:33
bauzasefried: I just want to make it clear by the documentation, that's it13:33
efried++13:33
efriedaspiers: We're about to pull the trigger on the "SEV limitations" documentation for Train so we can get it into RC2. Unless the fix is, like, completely ready to go right now and you're just about to push it...13:34
sean-k-mooneybauzas: isnt the eu ment to be stoping daylight saving time this year13:35
*** xek has joined #openstack-nova13:36
sean-k-mooneye.g. the clocks will not change next summer13:36
*** tbachman has joined #openstack-nova13:36
*** jangutter_ has quit IRC13:36
bauzassean-k-mooney: well, that will be different between countries AFAICU13:37
stephenfinefried: Think you could look at https://review.opendev.org/#/c/682746/ today, before it goes into merge conflict again?13:37
sean-k-mooneybauzas: each contry will pick to keep either standard time or daylight savings time13:37
bauzasyup this13:37
sean-k-mooneybut across the eu it will nolnger change13:37
bauzasbut for example, France and Germany would no longer have same times13:38
sean-k-mooneyalso if the UK dont pick GMT/UTC i will just give up13:38
stephenfinbauzas: Cool, thanks :)13:42
efriedstephenfin: looking13:43
*** bnemec has joined #openstack-nova13:43
gibimriedem: I have a comment about qos port support in https://review.opendev.org/#/c/633293/49/nova/compute/manager.py@474213:43
mriedemgibi: tl;dr add request_spec to the prep_snapshot_based_resize_at_dest method yes?13:47
gibimriedem: yest13:47
mriedemand finish_snapshot_based_resize_at_dest13:47
gibimriedem: and for the finish_snapshot_based_resize13:47
gibiyepp13:47
mriedemok13:48
gibimriedem: and leave a todo in https://review.opendev.org/#/c/633293/49/nova/compute/manager.py to call _update_pci_request_spec_with_allocated_interface_name() to support qos ports13:49
gibiqos sriov ports13:49
gibimriedem: btw efried is +2 on the ussuri qos spec so I think it is ready for a +A https://review.opendev.org/#/c/686779/13:51
mriedemyeah, i wasn't planning on implementing the qos port support in the first round so i'm glad you're ok with todos13:54
mriedembecause it's hard enough getting this off the ground with just basic use cases13:55
gibimriedem: I'm totally OK with TODOs. I can even volunteer to help fixing those TODOs at some point13:55
gibimriedem: but I want to avoid an extra RPC bump if possible13:55
*** ociuhandu has joined #openstack-nova13:56
mriedem.yeah13:57
mriedem+W on the qos move spec13:57
gibimriedem: thanks13:57
*** mlavalle has joined #openstack-nova13:57
*** ttsiouts has quit IRC13:58
*** ttsiouts has joined #openstack-nova13:59
*** awalende has quit IRC14:00
*** ttsiouts has quit IRC14:00
*** ttsiouts has joined #openstack-nova14:00
alex_xuefried: nothing more, I just want to pick a time go through the patch again14:04
efriedalex_xu: okay, thanks. Any idea who we can get to be a second +2 there? I haven't seen johnthetubaguy in a while...14:05
*** gbarros has joined #openstack-nova14:05
alex_xuefried: good question, and we just lost ken'ichi14:05
alex_xuefried: maybe cdent and gmann can give a review on it14:06
efriedstephenfin: +A doc restructure patch14:08
cdentalex_xu: which?14:09
alex_xucdent: this one https://review.opendev.org/68518114:09
cdentthanks14:09
efriedcdent: you +1ed an earlier version of the test patch underneath it14:09
efriedAnd I was looking for your help on the fix itself before you went on vacay14:09
stephenfinefried: Thanks (y)14:10
cdentyeah, I've gone back to that a few different times, wandered around vaguely over the paste.ini stuff, got a bit sad about that, and then got distracted again. will gaze again now14:10
gmannalex_xu: efried sure, I will check that14:10
efriedcdent: yeah, the paste stuff is pretty arcane, but it turns out we're handling the URL mapping bit in nova, so I was able to hack into it a bit.14:11
efriedthanks gmann14:11
efriedIf this flies, there are other projects with the same problem that may need to take similar approaches.14:11
openstackgerritMerged openstack/nova-specs master: Support move operations with qos ports - Ussuri  https://review.opendev.org/68677914:11
efriedneutron and I think cinder14:11
cdentduring the future times of tech debt cleanup we should consider adding a wsgi entry point that doesn't use paste.ini (while keeping (perhaps deprecating) for a while the paste way)14:12
efriedcdent: I talked with lbragstad about how they cut keystone over to flask14:12
cdentI say this as the maintainer of pastedeploy paste and pastescript: I am not actually maintaining it14:13
efriedtook them a couple releases14:13
efriedbut... yes.14:13
*** tbachman has quit IRC14:13
* lbragstad has been pushing kmalloc to write up the exact approach we took 14:13
lbragstadwe piecemeal'd it because we knew we weren't going to be able to make the complete transition in a single release (but YMMV)14:14
cdentswitchign to flask would be awesome, but there are smaller steps to take if getting rid of paste.ini is the intermerdiate goal14:15
*** ganso has quit IRC14:15
efrieddansmith: Please merge the "sev busted docs" patch at 9am your time. That's 5pm for aspiers I think, a reasonable approximation of EOD.14:15
efriedcdent: intermediate steps that would actually move the ball? Or just replace one icky thing with another icky thing?14:16
dansmithefried: ack14:16
lbragstadcdent yeah - i'd be curious to know how nova tries to break that work up14:16
cdentefried: actually move the ball. all paste.ini does it assemble middleware in a configurable way. If you choose to make it not configurable, you can do the same thing in code, like what placement/deploy.py does14:16
cdentthe interior apps remain the same14:17
efriedthat makes sense. Do we have any idea whether deployments count on the configurability?14:17
lbragstadwe implemented some basic plumbing that introduced flask and incrementally moved APIs over from the old paste routers to using flask14:17
efriedlike, do deployments inject security sniffers or whatever?14:17
cdenta few years ago there was some discussion of paste.ini being an official config file, but I don't know if any hard numbers were available. that's why I was suggesting we have two diferent entry points for some duration14:18
efriedoic, with a conf switch that decides which one you're using?14:18
mriedemefried: there are deployments that inject their own middleware yes14:19
efriedcdent: community goal: "stop using paste"?14:19
*** tbachman has joined #openstack-nova14:19
efriedbtw, why is it called "paste"?14:19
cdentthat will go as well as stop using wsme (which is even less maintained)14:19
mriedemone example i know of is a middleware from inap (i think?) that translated a request to like a volume-backed flavor14:20
* lbragstad feels like that would be about 7 community goals14:20
cdentit's pastes things (wsgis) together14:20
cdentbut it doesn't fix my typing14:20
dansmithI think there was also another thing called paste that did a similar thing that this was modeled after, IIRC14:21
dansmithit's been a loong time14:21
dansmithor maybe a "paste function" in some other middleware stack14:21
* cdent expects plone was involved somehow14:21
openstackgerritBalazs Gibizer proposed openstack/nova master: Pull up compute node queries to init_host  https://review.opendev.org/68268014:22
cdentor zope14:22
dansmithI think removing it would be a big deal, meaning removing a big plug point for people14:22
lbragstad+1 dansmith - iirc we asked people over and over if there was anything they *needed* paste for in their deployments14:22
dansmithlbragstad: to be clear, I meant removing it would be a big *bad* deal for the users that make use of it14:23
efriedlbragstad: knowing zero about flask, does it also allow customization like paste does?14:24
lbragstadno - not really (or not that i'm aware of)14:24
efriedokay, so it really would be taking a nontrivial knob away from deployers.14:24
dansmithI don't think it does14:25
cdentkmalloc had a plan of some kind, but I don't know if it quite happened14:25
lbragstadcdent plan for?14:25
donnydwell also those who may use openstack in customized ways would also be effected14:25
cdentlbragstad: flask middleware customization by file14:25
donnydsay I wanted to make an an integration that isn't upstream yet, paste could also be used that way14:26
cdentI would think, that if we want to make it less configurable there would still be an option to wrap the nova wsgi application with a local custom thing: any wsgi app can be wrapped by another14:26
efriedgibi: Sorry if I'm being super dense here, but I don't see how sharing provider allocations are (even theoretically) duplicated by move_allocations14:27
gibiefried: move_allocation takes everything that is allocated by the instance_uuid and moves it to the migration_uuid including the allocation against the sharing rp. Then when the scheduler allocates on the target host is allocates again from the sharing rp14:28
cdentmriedem: since you seem to have a memory, does it contain a reference to recentish performance improvements when listing neutron ports?14:28
gibiefried: if this is a migration with shared disk, it means that during the migration there will be double disk allocation but singulare disk usage14:29
efriedgibi: It looks to me as though move_allocations always deletes the allocation from the source14:29
gibiefried: yes, then the scheduler allocates on the dest14:29
gibiefried: when I say duble allocation I mean one piece of disk allocation by the migration_uuid and one piece of allocation by the instance_uuid14:30
mriedemcdent: sorry, context?14:30
efriedbut I thought the migration UUID is allocating against the dest already14:30
gibiefried: migration uuid is allocates against the source, scheduler allocates against the dest for the intance_uuid as consumer14:31
cdentmriedem: limited context, thus the bad query, trying to see if it pinged a memory for you. basically I'm looking at an internal bug where someone is complaining about 'neutron port-list' consuming a lot of time when there are many instances, and that pinged a memory in me of reading either a bug fix or patch on the nova side related to listing ports being slow14:32
efriedgibi: ohhh, so when we're doing a migration, we (1) move_allocations(source_inst/source_host => mig_inst/source_host), and then (2) claim(dest_inst/dest_host), and then (3) delete(mig_inst/source_host)14:32
efriedAnd you're saying that during (2) we would have duplicate sharing provider allocations in theory.14:32
openstackgerritMerged openstack/nova-specs master: tox -e fast-specs  https://review.opendev.org/67335614:33
mriedemcdent: purely a neutron perf bug?14:33
mriedemor also listing servers being slow b/c of listing ports (security groups)?14:33
mriedemi know of a thing, sec14:33
gibiefried: yes. and for sharing providers this double up is not needed14:33
efriedgibi: got it, thank you.14:33
mriedemcdent: is more on the nova server listing side but it's a perf thing https://bugs.launchpad.net/nova/+bug/156765514:34
openstackLaunchpad bug 1567655 in OpenStack Compute (nova) "500 error when trying to list instances and neutron-server is down" [Medium,Confirmed]14:34
cdentmriedem: I think the thing I'm remember on the nova side was listing servers being slow because neutron being slow and I wanted to reference that thing (for more context) if I could find it, but I couldnt but though tyou might remember14:34
gibiefried: if you can suggest a better wording for the code comment in my patch please do so14:34
cdentsee, you did. thank you.14:34
cdentlet's see if that's of any use14:34
mriedemcdent: comment 16 is the summary on the perf part of it14:34
efriedgibi: It probably makes sense in context, for someone who has that flow (1)(2)(3) in their head. I'll just leave a note on the review for future me and +2. Thanks for bearing with me.14:34
gibiefried: thanks14:35
cdentmriedem: yeah, thanks that helps14:35
mriedemunrelated to listing servers, there are known inefficiencies down in the nova/network/neutronv2/api.py code where nova makes a bunch of small targeted requests to neutron for resources rather than bigger batch requests14:36
* cdent nods14:36
mriedemstuff like https://review.opendev.org/#/c/465792/14:37
cdentexcellent, thanks14:38
mriedemthere is an abandoned wip patch related to that from someone at huawei that did a much more extensive refactor to batch up the queries14:38
cdentshame about that14:39
mriedemwell, it was pretty crazy14:39
mriedemthey are probably running it in their public cloud though...14:39
*** tbachman has quit IRC14:39
mriedemthis: https://review.opendev.org/#/c/457845/14:39
cdentI bet, but if it could someday see the light of day (in a better form?) that would be grand14:39
*** ociuhandu has quit IRC14:40
mriedemif someone were serious about that effort, i think we'd want some before and after profiling numbers like what you did in placement to justify the effort14:40
mriedemi know windriver cared about that stuff because they have users with vms that have like 16 ports attached14:41
mriedem*nfv users14:41
cdentI suspect that it would be of benefit to vmware with their n-thousand instances in one nova-compute mess, but...human resources...14:42
* cdent plays a sad and familiar tune14:42
*** jmlowe has quit IRC14:42
* mriedem plays the humpty dance14:43
gibistephenfin: quick question in https://review.opendev.org/#/c/686801/3//COMMIT_MSG@914:45
mriedemalternatively neutron grows an api that is essentially a view14:45
mriedemi think ^ was bantered about since icehouse days14:45
stephenfingibi: Yup, that's what I meant. My bad14:45
* cdent looks at calendar14:45
gibistephenfin: no worries, I just wanted to 100% sure you did what you wanted to do14:46
stephenfinall good :)14:46
*** pcaruana has joined #openstack-nova14:46
gibi:)14:46
*** ganso has joined #openstack-nova14:47
*** ociuhandu has joined #openstack-nova14:51
*** ociuhandu has quit IRC14:51
*** ociuhandu has joined #openstack-nova14:52
mriedemcdent: i've restored https://review.opendev.org/#/c/465792/ to see if i can rebase that since apparently i got it working with kevinbenton's help at one point, and then see if i can tease out some before/after times in a local devstack14:56
mriedemmy guess is the server would need to have a few ports attached to notice any different14:56
mriedem*difference14:56
*** ociuhandu has quit IRC14:57
*** ociuhandu has joined #openstack-nova14:57
*** macz has joined #openstack-nova15:00
*** jmlowe has joined #openstack-nova15:01
dansmithmriedem: I was under the impression from your doc that "tox -e api_samples" would create samples I used in the new test I added15:01
*** artom has joined #openstack-nova15:01
mriedems/your/the/15:02
mriedemit should generate samples under tox/docs/api_samples yeah15:02
mriedemfor the functional api samples tests you run15:03
dansmithdo I need to create the microversion dir or something?15:03
*** ivve has joined #openstack-nova15:03
mriedemyeah i think so15:03
dansmithtox -eapi_samples didn't seem to actually run anything though, actually15:03
mriedemb/c it's tox -e api-samples15:03
mriedemnot api_samples15:03
mriedemis that a typo in the doc?15:03
dansmithgah15:03
dansmithno15:03
dansmithtypo on my end, coupled with I guess I still have that old tox that doesn't complain15:04
mriedemyou must have a busted version of tox because that would normally fail if you specify an env that doesn't exist15:04
mriedemyup15:04
mriedemi've got 3.8.015:04
dansmithI've got 3.crusty15:04
dansmithstill no dice, it fails with looking for those files15:06
dansmithmicroversion directory was created (by me) and empty15:07
dansmithdo I need to create my tpl file manually?15:09
gmanndansmith: yes, template file you need to create, tox env will generate the doc sample file for you15:09
dansmithgmann: okay the docs don't make that very clear15:10
efriedalex_xu, bauzas: responded in https://review.opendev.org/#/c/685857/ (feature liaisons)15:10
bauzascool, on a meeint15:10
bauzasmeeting*15:10
* bauzas also needs to pay attention to specs now15:10
cdentefried: did you check if x-server-management url was used anywhere? it appears to be part of the reason why you've appended /auth to the auth_url and that jarred while reviewing15:11
efriedjarred like hell when I was writing it too :(15:12
efriedcdent: I checked my devstack before and after the patch, and the headers coming back with the version document are the same with keystone/password15:12
efriedcdent: note that the noauth middleware exists solely for test, which is confusing that it's a) not under a test/ subdir, and b) documented as conf'able. That confused (me and) stephenfin as well.15:13
cdentyeah, I've left a comment about that15:13
cdentand then fell in this x-server-management hole15:13
cdentI think it is 9yo ancient history15:14
*** mjozefcz has quit IRC15:14
efriedcdent: I can't actually find reference to that header in keystone[auth|middleware]15:15
cdentit's not anywhere in .tox/py37 when i grep15:15
cdentsee: https://wiki.openstack.org/wiki/Obsolete:API for the main reference i could find15:15
openstackgerritMatt Riedemann proposed openstack/nova master: Add prep_snapshot_based_resize_at_dest compute method  https://review.opendev.org/63329315:16
openstackgerritMatt Riedemann proposed openstack/nova master: Add PrepResizeAtDestTask  https://review.opendev.org/62789015:16
openstackgerritMatt Riedemann proposed openstack/nova master: FUP for I66d8f06f19c5c631e33208580428aa843abb38d2  https://review.opendev.org/67895115:16
openstackgerritMatt Riedemann proposed openstack/nova master: Add prep_snapshot_based_resize_at_source compute method  https://review.opendev.org/63483215:16
openstackgerritMatt Riedemann proposed openstack/nova master: Add PrepResizeAtSourceTask  https://review.opendev.org/62789115:16
openstackgerritMatt Riedemann proposed openstack/nova master: Add finish_snapshot_based_resize_at_dest compute method  https://review.opendev.org/63508015:16
openstackgerritMatt Riedemann proposed openstack/nova master: Add FinishResizeAtDestTask  https://review.opendev.org/63564615:16
openstackgerritMatt Riedemann proposed openstack/nova master: Execute CrossCellMigrationTask from MigrationTask  https://review.opendev.org/63566815:16
openstackgerritMatt Riedemann proposed openstack/nova master: Plumb allow_cross_cell_resize into compute API resize()  https://review.opendev.org/63568415:16
openstackgerritMatt Riedemann proposed openstack/nova master: Filter duplicates from compute API get_migrations_sorted()  https://review.opendev.org/63622415:16
openstackgerritMatt Riedemann proposed openstack/nova master: Start functional testing for cross-cell resize  https://review.opendev.org/63625315:16
openstackgerritMatt Riedemann proposed openstack/nova master: Handle target host cross-cell cold migration in conductor  https://review.opendev.org/64259115:16
openstackgerritMatt Riedemann proposed openstack/nova master: Validate image/create during cross-cell resize functional testing  https://review.opendev.org/64259215:16
openstackgerritMatt Riedemann proposed openstack/nova master: Add zones wrinkle to TestMultiCellMigrate  https://review.opendev.org/64345015:16
openstackgerritMatt Riedemann proposed openstack/nova master: Add negative test for cross-cell finish_resize failing  https://review.opendev.org/64345115:16
openstackgerritMatt Riedemann proposed openstack/nova master: Refresh instance in MigrationTask.execute Exception handler  https://review.opendev.org/66901215:16
openstackgerritMatt Riedemann proposed openstack/nova master: Add negative test for prep_snapshot_based_resize_at_source failing  https://review.opendev.org/66901315:16
openstackgerritMatt Riedemann proposed openstack/nova master: WIP: Add confirm_snapshot_based_resize_at_source compute method  https://review.opendev.org/63705815:16
efriedcdent: results in codesearch all look crusty too.15:17
* cdent nods15:17
cdentrackspace thing15:17
*** ociuhandu has quit IRC15:17
efriedlast edit on that wiki page was 2013, but the content about that header wasn't changed since 2010.15:18
efried(assume that's what you meant by 9yo)15:18
*** gyee has joined #openstack-nova15:21
artomdansmith, are you using the service user in your image pre-cache series?15:21
*** gbarros has quit IRC15:21
dansmithartom: no, but I think the service token thing is automatic if configured no? /cc mriedem15:21
dansmithartom: meaning not specifically, but service token will be important for this to work in a lot of cases15:22
artomI thought you had to specifically get it? I'm trying to find other examples in the code15:22
efriedgibi: stephenfin: I'm going to edit the commit message on https://review.opendev.org/#/c/686801/ without rebasing everything on top of it and then fast approve it, cool?15:23
mgagnemriedem: we no longer use the middleware you mentioned (to force volume-backed flavor)15:23
gibiefried: cool with me15:23
mriedemartom: it's built in if configured15:23
dansmithartom: to use the service user as your credentials I think so, but isn't there some new thing that lets the service use its token to allow use of an expired user token?15:23
dansmithI thought that was automatic15:23
*** markvoelker has quit IRC15:24
mriedemmgagne: oh really, what changed?15:24
efrieddansmith: You have to do a thing in code to get service user melded into your context. I don't think we're doing that for cinder yet. But once that's done, it will happen automatically if the service user is set up in your conf.15:24
artommriedem, so it's automagic from our POV? Ie, if we hit the image API with an expired token, it'll convert to use the nova service user?15:25
dansmithefried: okay that doesn't jive with what mriedem just said15:25
mriedemartom: see https://github.com/openstack/nova/blob/master/nova/service_auth.py#L3615:25
mriedemefried: this is glance15:25
dansmithefried: or do you mean it's done for glance already (which covers me)?15:25
mriedemand it already goes through ^15:25
mgagnemriedem: we do have a local orchestrator for one region which requires volume-backed flavor. other regions now have local storage available for all flavors.15:25
mriedemglane was the #1 use case for the service user stuff from osic15:25
mriedemb/c of token timeouts during long snapshots15:25
efrieddansmith: sorry, I was wrong about cinder, which already does the service auth wrapper; and yes, so does glance.15:25
dansmithefried: ackj15:26
efried(swedish for 'ack' ^ )15:26
dansmithmriedem: what is the magic sauce for doing an api samples test with an empty response?15:26
mriedemi'd have to dig15:27
mriedembut i was wondering, is 202 the correct response if there is no body? should it be 204?15:27
zigoIf I run "nova host-evacuate-live", will it keep my VMs in their original availability zones?15:27
mgagnemriedem: as for the local orchestrator, the user doesn't have access to the Nova API. If he had access to the API, we would probably have to put that middleware back in. (I don't see that one coming anytime soon)15:27
dansmithmriedem: le shrug15:27
mriedemcdent: "is 202 the correct response if there is no body? should it be 204?"15:27
cdent204 is if there's no body and you're done15:28
dansmithmriedem: I guess maybe I validate the return value manually instead of calling the thing that would process a template15:28
openstackgerritEric Fried proposed openstack/nova master: nova-net: Make even more nova-net stuff optional  https://review.opendev.org/68680115:28
dansmithaight15:28
cdent202 is "imma do a bit more, check back later"15:28
mriedemcdent: yeah in this case we're not done,15:28
mriedemrpc cast to conductor15:28
mriedembut no response body15:28
dansmithyeah, async but no response15:28
gmannyou can skip the verify_response and just check the status code. that is how we did for action APIs with no response15:28
cdentin that 202 is probalby fine as long as somewhere in the response (header or body) there is a reference to how I check back later15:29
mriedemright now there is no checking back later15:29
dansmithyeah, specifically uncheckable15:29
mriedemi.e. there is no status tracking or anything15:29
* dansmith listens for cdent's head to explode15:30
cdentthen from the user's standpoint a 204 might make more sense15:30
dansmithgdi cdent15:31
dansmith202 is less work for me15:31
mriedemheh, how?15:31
cdentdansmith: have a read of https://httpstatuses.com/202 and make your choice. either is probalby fine15:31
dansmithmriedem: because 202 is done and checked in a few places already :)15:31
mriedemthat's what i figured15:31
mriedem"The 202 response is intentionally noncommittal. Its purpose is to allow a  server to accept a request for some other process (perhaps a  batch-oriented process that is only run once per day) without requiring  that the user agent's connection to the server persist until the process  is completed. "15:32
mriedemsounds spot on15:32
mriedemespecially the batch-oriented part15:32
dansmithcdent: right so we picked 202 specifically because all of those things are true.. it's async, it may or may not happen, some constraints are checked later and may cause us to do nothing with no warning15:32
dansmithmriedem: yeah, exactly15:32
dansmithonce per day batch is exactly this15:33
*** ttsiouts has quit IRC15:34
cdentyeah, 202 is probably fine15:34
mriedemunrelated to the response code, something i thought about while tossing and turning at 3am last night was that your api validation should probably check that the list of dicts is a unique set of image IDs and 400 if not15:34
dansmithmriedem: already doing that :)15:34
mriedemwhew15:34
gibibauzas: tested your latest audit patch with bandwidth and left the result in https://review.opendev.org/#/c/670112/715:34
bauzasgibi: /me is scared15:34
efriedfwiw I vote for 202 dansmith cdent mriedem15:35
gibibauzas: There is some confusing printout, and as you stated the current code does not handle child RPs15:35
bauzasgibi: thanks for the paste, very insightful15:35
* bauzas is on a meeting so i can't really digest now, but I'll certainly look at it tomorrow mornign15:36
*** ivve has quit IRC15:36
gibibauzas: cleary there is progress as the instance and the compute is found in cell1.15:36
gibibauzas: no worries. I leave for today now anyhow15:36
bauzasgibi: I appreciate your positivity :15:37
bauzas:p15:37
gibi:)15:37
* gibi leaves the building15:38
*** damien_r has quit IRC15:42
*** belmoreira has quit IRC15:45
*** rpittau is now known as rpittau|afk15:47
*** mjozefcz has joined #openstack-nova15:48
openstackgerritDan Smith proposed openstack/nova master: Add image caching API for aggregates  https://review.opendev.org/68714015:49
*** tbachman has joined #openstack-nova15:49
openstackgerritStephen Finucane proposed openstack/nova master: fixtures: Add support for security groups  https://review.opendev.org/68680215:50
openstackgerritStephen Finucane proposed openstack/nova master: fixtures: Add support for security groups  https://review.opendev.org/68680215:50
artomdansmith, left some thoughts about exception handling in your series15:50
artomdansmith, tell me if I'm way off base15:50
dansmithartom: ack, thanks15:51
dansmithmriedem: looks like the bulk of our aggregate docs are in the user guide.. is that where you think I should put my stuff?15:51
mriedemdansmith: rebase, that all recently moved and just merged15:53
mriedemhttps://docs.openstack.org/nova/latest/admin/aggregates.html15:53
dansmithmriedem: like, this week?15:53
mriedemyeah15:53
dansmithmkay15:54
mriedemhttps://review.opendev.org/#/c/667133/15:54
mriedemmerged last night15:54
mriedemefried: before i make changes please ack that i've answered your questions here https://review.opendev.org/#/c/686835/2/nova/tests/functional/test_boot_from_volume.py@19215:54
mriedemdansmith: if we had docs on the image cache in general i'd say that would be a good place but we don't have any docs about the image cache :(15:56
dansmithheh15:57
mriedemi guess another place you could stuff it is https://docs.openstack.org/nova/latest/admin/manage-the-cloud.html if that aggregates page isn't a good fit15:58
dansmitherm, the aggregates page seems better than that16:01
dansmithbut obviously something image- or imagecache-specific would be better16:01
*** cdent has quit IRC16:01
dansmithI'll add it here in minimal detail and then we should probably shoot for some imagecache doc16:01
dansmithlooks like something has reshuffled in that aggregates doc to put the usage section after the more advanced topics16:02
mriedemi think a pretty simple image cache doc could start with a high level description, list of drivers that support it, and the related config options16:02
mriedemdansmith: you'll have to wrestle with stephenfin about that16:03
*** dtantsur is now known as dtantsur|afk16:03
dansmithheh yeah all the google linkage is broken now after that admin/user shuffleup16:04
mriedemyeah i'm not surprised, the patch didn't account for redirects16:04
dansmithyeah that new aggregates page is just kindof a mess and the ordering makes no sense16:06
dansmithI guess I'll just chuck my thing at the bottom16:06
openstackgerritMerged openstack/nova master: compute: refactor volume bdm rollback error handling  https://review.opendev.org/65650016:06
openstackgerritMerged openstack/nova master: doc: Improve PDF document structure  https://review.opendev.org/68274616:06
openstackgerritMerged openstack/nova master: docs: Remove a whole load of unused images, most remainder  https://review.opendev.org/68621116:06
openstackgerritMerged openstack/nova master: trivial: Change name of network provided by NeutronFixture  https://review.opendev.org/68679816:06
openstackgerritMerged openstack/nova master: nova-net: Stop mocking the instance network cache  https://review.opendev.org/68679916:07
openstackgerritMerged openstack/nova master: trivial: Make it obvious where we're getting our names from  https://review.opendev.org/68680016:07
*** tesseract has quit IRC16:08
*** N3l1x has joined #openstack-nova16:09
mriedemluckily infra has a report of active docs 404s16:09
sean-k-mooneythe most annoying thing about google+docs is it does not priorties latest16:10
mriedemhttp://files.openstack.org/docs-404s/16:10
dansmithsean-k-mooney: that's probably good since we apparently just break our latest a lot16:11
mriedem5 /nova/latest/user/aggregates.html16:11
mriedemyeah we should have a redirect for that16:11
mriedemstephenfin: ^16:11
*** ociuhandu has joined #openstack-nova16:12
stephenfinDid I miss one?16:13
stephenfincrap, yeah, let me add it now16:13
*** sapd1_x has joined #openstack-nova16:14
mriedemdansmith: just for tracking: https://bugs.launchpad.net/nova/+bug/184730216:15
openstackLaunchpad bug 1847302 in OpenStack Compute (nova) "doc: need admin guide for the image cache" [Undecided,New]16:15
*** ociuhandu_ has joined #openstack-nova16:15
openstackgerritDan Smith proposed openstack/nova master: Add cache_image() driver method and libvirt implementation  https://review.opendev.org/68713716:16
openstackgerritDan Smith proposed openstack/nova master: Add cache_image() support to the compute rpc, api, and manager  https://review.opendev.org/68713816:16
openstackgerritDan Smith proposed openstack/nova master: Add cache_images() to conductor  https://review.opendev.org/68713916:16
openstackgerritDan Smith proposed openstack/nova master: Add image caching API for aggregates  https://review.opendev.org/68714016:16
openstackgerritDan Smith proposed openstack/nova master: WIP: Add image precaching docs for aggregates  https://review.opendev.org/68734816:16
openstackgerritMatt Riedemann proposed openstack/nova master: doc: fix formatting in mitigation-for-Intel-MDS-security-flaws  https://review.opendev.org/68735016:17
*** ociuhandu has quit IRC16:18
dansmithgibi: (or mriedem) are there any examples of not-instance-related notifications I can copy for image pre-caching?16:18
mriedemthere are notifications for aggregates and services16:19
mriedemagg add/remove host i think16:19
dansmithah yep16:19
mriedemthere are also the more generic compute_task.* ones but i'm guessing we should follow the aggregate ones since this is on the aggregates route16:20
dansmithwell, the aggregates ones are api-centric, but this would be host-centric16:20
mriedemaggregate.image.cache.start|end?16:20
dansmithi.e. "host foo started downloading a thing"16:20
dansmithno, I want it to be host-specific so you can monitor progress16:21
*** ociuhandu_ has quit IRC16:22
dansmithalthough I guess notify_about_aggregate_update could be sent from the conductor16:22
dansmithas long as it mentions the host16:22
dansmiththat would allow us to notify about timeouts, etc16:22
mriedemi think notify_about_aggregate_update is the legacy thing16:23
mriedemnotify_about_aggregate_action is the versioned notification thing16:23
mriedemthere is also a legacy notify_about_host_update for things on the os-hosts api16:23
dansmithokay16:23
mriedemand that's likely closer to what you're looking for16:23
mriedemi don't think those got converted to versioned notifications b/c the os-hosts api is deprecated16:24
*** igordc has quit IRC16:25
*** TxGirlGeek has joined #openstack-nova16:26
openstackgerritStephen Finucane proposed openstack/nova master: docs: Add redirects for '/user/aggregates'  https://review.opendev.org/68735316:27
stephenfinmriedem: ^16:27
mriedemyar matey16:27
mriedemhuh, that patch is triggering functional jobs, must have something missing in our zuul yaml blacklist16:30
dansmithmriedem: so, I'm not really sure what the rules are on our new notifications.. I think I could use AggregatePayload to convey what I want, but not sure if I should16:30
dansmithi.e. AggregatePayload(name="aggregate.imagecache.start", uuid=agg.uuid, hosts=[this_compute])16:30
mriedemno i don't think that's what you want16:30
mriedemmy guess is you'll end up creating a new single purpose thing like VolumeUsagePayload and MetricsPayload16:31
mriedemso,16:32
mriedemmaybe you're thinking of something like this:16:32
mriedem1. generic aggregate payload based thing to start the operation sent from conductor16:33
mriedem2. start/end notifications per compute which would be a new payload16:33
mriedem3. end version of #1 in conductor once it's done processing all hosts16:33
mriedemso if a consumer cares about only the overall op being done and not the host specific details they can just listen for that16:33
dansmithyeah16:34
*** macz has quit IRC16:34
mriedemso for 1 and 3 you'd use notify_about_aggregate_action16:34
mriedemwith a new action16:34
dansmithso is that a new notification and payload?16:34
mriedem#2 will be a new payload16:34
*** macz has joined #openstack-nova16:34
mriedemnotify_about_aggregate_action is what's used for the existing aggregate actions like create/delete/update meta/add and remove host16:34
dansmithmeaning, AggregateImageNotification, AggregateImagePayload16:34
sean-k-mooneyis the per host version too verbose. not that i think its a bad idea but im wonder would you jsut wait for the conductor start/end16:34
mriedemi think 1 and 3 above fit into that with a new 'cache_images' action or something16:34
dansmithsean-k-mooney: I'm already waiting in the conductor.. I want them to be able to construct the per-host status from notifications if they want, which was part of the original discussion16:35
mriedemi would start with the 1 and 3 cases in conductor since that's pretty trivial16:35
sean-k-mooneydansmith: ah ok16:35
mriedemand then separately bake in the new per-host payload and such16:35
mriedemwith gibi's input16:35
dansmithmriedem: yep, separate patch fo'sho16:36
sean-k-mooneydansmith: ya i was wondering if people would go to the effort of reconstructing the hot view but i can see wanting to do that16:36
sean-k-mooney*host16:37
dansmithsean-k-mooney: I want them to be able to so I can use that to deflect requests for a full reporting API, at least initially16:37
mriedemwas just going to say that ^16:37
sean-k-mooney:)16:37
mriedemif per host notifications are too noisy for some deployments we can make that configurable - we have an option to include bdms in instance payloads for example16:38
dansmithyeah16:41
dansmithalso, it's two notifications per image per compute.. images take a few seconds to download at a minimum in most real cases, so... meh16:41
dansmithwe have a bunch per each instance boot already16:41
*** kmalloc has left #openstack-nova16:42
*** factor has quit IRC16:43
openstackgerritMatt Riedemann proposed openstack/nova master: Skip functional test jobs for doc redirect changes  https://review.opendev.org/68735716:45
openstackgerritMatt Riedemann proposed openstack/nova master: docs: Add redirects for '/user/aggregates'  https://review.opendev.org/68735316:46
*** mjozefcz has quit IRC16:46
*** tssurya has quit IRC16:49
*** sapd1_x has quit IRC16:50
*** derekh has quit IRC16:52
dansmithmriedem: the fake notifier doesn't grab the versioned kind I guess16:54
dansmithbut I don't see a fixture or anything for that16:54
efriedmriedem: sorry, was otp, reading (https://review.opendev.org/#/c/686835/2/nova/tests/functional/test_boot_from_volume.py@192)16:54
dansmithah16:54
dansmithnevermind I think16:55
efriedmriedem: ack the above, all makes sense to me, thanks for the response.16:56
*** ivve has joined #openstack-nova16:57
*** ricolin has quit IRC17:03
*** priteau has quit IRC17:07
*** spatel has quit IRC17:14
*** ralonsoh has quit IRC17:22
*** xek_ has joined #openstack-nova17:23
*** markvoelker has joined #openstack-nova17:25
*** xek has quit IRC17:25
mriedemdansmith: you found https://github.com/openstack/nova/blob/master/nova/tests/unit/fake_notifier.py#L152 right?17:27
openstackgerritDan Smith proposed openstack/nova master: Add cache_images() to conductor  https://review.opendev.org/68713917:27
openstackgerritDan Smith proposed openstack/nova master: Add image caching API for aggregates  https://review.opendev.org/68714017:27
openstackgerritDan Smith proposed openstack/nova master: WIP: Add image precaching docs for aggregates  https://review.opendev.org/68734817:27
dansmithmriedem: yeah sorry17:27
*** dave-mccowan has quit IRC17:28
*** ccamacho has quit IRC17:29
*** markvoelker has quit IRC17:29
openstackgerritEric Fried proposed openstack/os-traits master: Add method to visualize the os-traits tree  https://review.opendev.org/68646417:35
openstackgerritMatt Riedemann proposed openstack/nova master: Add boot from volume functional test with a huge request  https://review.opendev.org/68673417:39
openstackgerritMatt Riedemann proposed openstack/nova master: Cache image GETs for multi-create/multi-BDM requests  https://review.opendev.org/68683517:39
*** gbarros has joined #openstack-nova17:43
mriedemwe might as well revert https://review.opendev.org/684118 since the logging with traceback isn't useful: http://paste.openstack.org/show/782116/17:44
efriedboo17:45
efriedmriedem: is it any worse than what was before?17:45
mriedemit's not helpful and the warning loses the cell uuid part of the message17:46
mriedemso i think it's not better17:46
*** igordc has joined #openstack-nova17:46
efriedOh, I thought the whole point was that the cell UUID was being lost before anyway.17:47
efriedbut then the unboundlocal thing means we don't have it here either17:47
efriedsad face17:47
*** dave-mccowan has joined #openstack-nova17:49
mriedemwe might have something more useful for the db layer if we extended the cell timeout since we might not be getting the root db layer failure because of connection retries in oslo.db17:50
mriedembut i'm still not sure that's going to help debug the issue17:50
mriedemwe already know that during grenade we start mysqld 3 times and at some point things go south after the last restart17:50
mriedemwe start seeing all of these "Aborted connection" errors17:51
mriedema la https://review.opendev.org/#/c/68266117:51
mriedemrandom thinking out loud,17:53
mriedemi wonder if with the instance_extra.resources stuff we've tipped the size of the instance extra queries over17:53
mriedemlooking at http://codesearch.openstack.org/?q=max_allowed_packet&i=nope&files=&repos=17:56
mriedemit looks like anywhere from 16M to 256M is pretty standard17:56
*** TxGirlGeek has quit IRC18:03
*** markvoelker has joined #openstack-nova18:06
openstackgerritEric Fried proposed openstack/nova master: Deprecate [api]auth_strategy  https://review.opendev.org/68737318:09
mriedemefried: https://review.opendev.org/687374 for the timeout to cell thing like your patch18:12
efriedack, watching18:14
efriedmriedem: ...but it didn't work afaict.18:15
*** CeeMac has joined #openstack-nova18:21
openstackgerritEric Fried proposed openstack/os-traits master: Privatize and reorganize base package methods  https://review.opendev.org/68737818:23
*** mriedem has quit IRC18:31
*** mriedem has joined #openstack-nova18:32
*** gbarros has quit IRC18:45
*** markvoelker has quit IRC18:50
*** markvoelker has joined #openstack-nova18:54
*** ianw_pto is now known as ianw18:59
*** jmlowe has quit IRC19:03
*** dave-mccowan has quit IRC19:10
*** jmlowe has joined #openstack-nova19:17
*** TxGirlGeek has joined #openstack-nova19:20
*** ociuhandu has joined #openstack-nova19:26
*** ociuhandu has quit IRC19:31
*** psachin has quit IRC19:33
openstackgerritMerged openstack/nova stable/train: docs: Highlight the current broken state of SEV  https://review.opendev.org/68641419:33
openstackgerritMerged openstack/nova master: nova-net: Make even more nova-net stuff optional  https://review.opendev.org/68680119:33
openstackgerritArtom Lifshitz proposed openstack/nova master: Helper to start computes with different HostInfos  https://review.opendev.org/68683219:36
openstackgerritArtom Lifshitz proposed openstack/nova master: Functional tests for NUMA live migration  https://review.opendev.org/67259519:36
openstackgerritArtom Lifshitz proposed openstack/nova master: [WIP] NUMA LM: Add func test for bug 1845146  https://review.opendev.org/68740419:36
openstackbug 1845146 in OpenStack Compute (nova) train "NUMA aware live migration failed when vCPU pin set" [High,Fix committed] https://launchpad.net/bugs/1845146 - Assigned to Dan Smith (danms)19:36
*** artom has quit IRC19:37
*** trident has quit IRC19:51
*** trident has joined #openstack-nova19:54
*** dave-mccowan has joined #openstack-nova19:59
*** TxGirlGeek has quit IRC20:01
*** TxGirlGeek has joined #openstack-nova20:02
*** macz has quit IRC20:05
*** TxGirlGeek has quit IRC20:06
*** nweinber__ has quit IRC20:09
openstackgerritMatt Riedemann proposed openstack/nova master: WIP: Bulk query floating IPs in _nw_info_get_ips  https://review.opendev.org/46579220:18
openstackgerritMatt Riedemann proposed openstack/nova master: DNM: Time how long _nw_info_get_ips takes  https://review.opendev.org/68741020:18
*** mtreinish has quit IRC20:21
openstackgerritMerged openstack/nova master: doc: fix formatting in mitigation-for-Intel-MDS-security-flaws  https://review.opendev.org/68735020:31
openstackgerritEric Fried proposed openstack/nova master: Deprecate [api]auth_strategy and noauth2  https://review.opendev.org/68737320:33
openstackgerritEric Fried proposed openstack/nova master: WIP: Murder NoAuthMiddleware  https://review.opendev.org/68741620:33
openstackgerritMatt Riedemann proposed openstack/nova master: doc: link to user/availability-zones from user home page  https://review.opendev.org/68716520:33
openstackgerritMatt Riedemann proposed openstack/nova master: doc: link to user/index from main home page  https://review.opendev.org/68729220:33
efriedmriedem: It turned out to be actually quite easy to bypass noauth and just stub out keystone --^20:33
efriedthere's a lot more to be done there, but I was able to get through enough pieces to convince myself that that approach is going to work.20:34
efriedthe remainder is just cleaning up the leftovers.20:34
*** xek_ has quit IRC20:34
mriedemdoes ksa/keystonemiddleware provide any fixtures for some of this?20:34
mriedemthat would be ideal rather than stubbing keystonemiddleware.auth_token.filter_factory20:35
mriedemoh hello https://github.com/openstack/keystonemiddleware/blob/master/keystonemiddleware/fixture.py20:35
*** pcaruana has quit IRC20:35
efriedmriedem: I agree, but that would be a subsequent step in any case.20:35
efriedas in, doing this is not taking away anything we were doing before, because we weren't hitting those factories at all20:36
efriedI mentioned same in my commit message20:36
efriedlbragstad: any idea if there's a fixture for keystonemiddleware.auth_token.filter_factory ?20:36
efriedah, neat20:38
efriedlbragstad: cancel, I did not read scrollback thoroughly.20:38
lbragstadyup - looks like you're on the right track20:38
*** CeeMac has quit IRC20:39
mriedemefried: ultra mega -1 on the bottom change20:40
mriedemnot the logging thing, the reno20:40
efriedmriedem: o ya, I thought of that while I was updating and then forgot again, will do.20:41
mriedemso with https://review.opendev.org/#/c/686414/ i guess we can push rc2 now yeah?20:42
mriedemare you doing that?20:42
efriedmriedem: I can, or you can, up to you.20:43
mriedemi'll push it real good20:43
efried++20:43
mriedemhttps://review.opendev.org/68741820:46
*** igordc has quit IRC20:59
*** slaweq has quit IRC20:59
*** mtreinish has joined #openstack-nova21:00
*** igordc has joined #openstack-nova21:00
eanderssonThis makes me sad21:02
eanderssonhttps://github.com/openstack/nova/blob/stable/rocky/nova/virt/libvirt/vif.py#L23221:02
eandersson:'(21:02
eanderssonI am pretty sure CentOS 7.x supports more than 8.21:02
mriedemwhy for21:02
mriedemprove it!21:03
eanderssonIn fact we have it set to a lot more than 8, but didn't realize that after upgrading it downgraded them21:03
mriedemdoes the kernel in centros 7.x have some patch that makes that more than 8?21:03
eanderssonProbably worth checking with someone from RedHat to confirm21:03
mriedemyar21:03
eanderssonMy colleague told me he pulled down the source code and confirmed21:05
*** ceryx has joined #openstack-nova21:06
openstackgerritMatt Riedemann proposed openstack/nova master: Remove dead reserve_volume compat code in _validate_bdm  https://review.opendev.org/68742721:30
mriedemeandersson: but was it patched in or something?21:30
openstackgerritMatt Riedemann proposed openstack/nova master: Remove dead reserve_volume compat code in _validate_bdm  https://review.opendev.org/68742721:31
*** bbowen has quit IRC21:34
openstackgerritMatt Riedemann proposed openstack/nova master: Remove Stein compute compat checks for volume type support  https://review.opendev.org/68742821:42
*** markvoelker has quit IRC21:43
mriedemthis is a good easy fix https://review.opendev.org/#/c/678991/21:48
*** kosa777777 has joined #openstack-nova21:49
ceryxmriedem: I'm the colleague eandersson mentioned. https://elixir.bootlin.com/linux/v3.10/source/drivers/net/tun.c#L115 has the cap set to 8, but that same file from the centos source RPM for that kernel version is https://pastebin.com/2415QjTW. Unsure what version they changed that in though.21:54
ceryxbut they set '#define MAX_TAP_QUEUES 25621:55
ceryx' rather than DEFAULT_MAX_NUM_RSS_QUEUES (which is still set to 8 in the rhel/centos version)21:55
mriedemok, i guess that's the question21:56
mriedemand if it's a centos only patch then it's pretty hard to have a condition in nova for that21:57
*** gbarros has joined #openstack-nova21:59
kosa777777I am also the colleague of eandersson and ceryx, how about having option to set it to certain number on compute itself if operator chooses to not rely on default?22:01
openstackgerritMatt Riedemann proposed openstack/nova master: WIP: Pre-validate volumes for cross_az_attach=False during create  https://review.opendev.org/68743022:03
mriedemkosa777777: i'd prefer not having options like that but not sure what others think - maybe start by reporting a bug and taking it from there22:03
*** ivve has quit IRC22:03
*** gbarros has quit IRC22:04
ceryxI checked through the centos kernel versions up through 7.7 and they all have that driver hard-coded to #define MAX_TAP_QUEUES 256 :/22:05
mriedemcan you do a git blame and find out the change that patched it?22:05
*** TxGirlGeek has joined #openstack-nova22:07
kosa777777also "platform.linux_distribution()" would determine if it is CentOS, if that is needed to distinguish Ubuntu from Centos22:11
*** gyee has quit IRC22:14
mriedemlet's start with a reported bug with options and discuss there - there could be a [workarounds] group option if people are ok with that22:14
eanderssonYea sounds good22:17
*** spatel has joined #openstack-nova22:23
kosa777777great22:26
*** rcernin has joined #openstack-nova22:26
eanderssonmriedem, do you happen to have an estimate on when we could get an initial version of the backport for making restating computes safe :P22:29
eanderssonI could probably take a stab at it, but last time the number of differences between the master and rocky code base was pretty overwhelming22:29
mriedemit starts in train which GAs on oct 17 https://wiki.openstack.org/wiki/Nova/Train_Release_Schedule - after that we can release in train 20.0.1 and move to stein + release and then rocky + release22:30
mriedemso my guess would be early november at the earliest22:31
mriedemmeaning, it's not a regression in train so we're not putting it into the train GA right now, it will be in the first patch release after the train GA22:31
mriedemthen stein and rocky as normal22:32
eanderssonYea - I mean for me it's more about the patch being pushed, but not necessarily merged.22:36
mriedemyou can propose the stein and rocky backports, there are at least 2 patches for that fix b/c there is a functional recreate test patch and then the fix patch22:36
mriedemor you can bribe gibi to move on that22:37
eanderssonHow do I bribe gibi? beer? :D22:37
mriedemgoulash22:37
openstackgerritEric Fried proposed openstack/nova master: Deprecate [api]auth_strategy and noauth2  https://review.opendev.org/68737322:43
openstackgerritEric Fried proposed openstack/nova master: WIP: Murder NoAuthMiddleware  https://review.opendev.org/68741622:43
*** spatel has quit IRC22:51
*** spatel has joined #openstack-nova22:52
*** tkajinam has joined #openstack-nova23:00
*** spatel has quit IRC23:05
*** hoonetorg has quit IRC23:12
*** N3l1x has quit IRC23:23
*** hoonetorg has joined #openstack-nova23:25
openstackgerritMatt Riedemann proposed openstack/nova master: WIP: Pre-validate volumes for cross_az_attach=False during create  https://review.opendev.org/68743023:28
mriedemdansmith: for your morrow, ^ is an alternative and much less fugly solution for the cross_az_attach=False server create issue that i was trying to fix in https://review.opendev.org/#/c/469675/23:29
mriedembasically all contained in the api so less passing of garbage down and up through the layers23:29
*** markvoelker has joined #openstack-nova23:32
*** bbowen has joined #openstack-nova23:37
*** bbowen has quit IRC23:39
*** tkajinam has quit IRC23:39
*** bbowen has joined #openstack-nova23:39
*** tkajinam has joined #openstack-nova23:40
*** TxGirlGeek has quit IRC23:45
*** mlavalle has quit IRC23:45
*** mriedem has quit IRC23:51

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!