Tuesday, 2019-07-23

*** _hemna has joined #openstack-nova00:05
*** gyee has quit IRC00:07
*** tkajinam has quit IRC00:10
*** jdillaman has quit IRC00:37
*** jdillaman has joined #openstack-nova00:38
*** betherly has joined #openstack-nova00:42
*** betherly has quit IRC00:46
*** hongbin has joined #openstack-nova00:55
*** igordc has quit IRC00:55
*** _hemna has quit IRC00:55
*** kashyap has quit IRC00:57
*** eharney has quit IRC00:57
*** TxGirlGeek has joined #openstack-nova00:58
*** bbowen has quit IRC01:02
*** bbowen has joined #openstack-nova01:02
*** imacdonn has quit IRC01:18
*** imacdonn has joined #openstack-nova01:18
*** ricolin has joined #openstack-nova01:19
*** TxGirlGeek has quit IRC01:32
*** betherly has joined #openstack-nova01:34
*** betherly has quit IRC01:38
*** tbachman has quit IRC01:41
*** whoami-rajat has joined #openstack-nova01:43
*** _erlon_ has quit IRC01:46
*** TxGirlGeek has joined #openstack-nova01:50
*** TxGirlGeek has quit IRC01:54
*** tetsuro has joined #openstack-nova01:58
*** tbachman has joined #openstack-nova02:03
*** betherly has joined #openstack-nova02:15
*** tetsuro has quit IRC02:17
*** tetsuro has joined #openstack-nova02:18
*** betherly has quit IRC02:20
*** tbachman has quit IRC02:21
*** mdbooth_ has joined #openstack-nova02:32
*** BjoernT has joined #openstack-nova02:32
*** mdbooth has quit IRC02:35
*** BjoernT has quit IRC02:36
*** BjoernT has joined #openstack-nova02:41
*** BjoernT has quit IRC02:58
*** BjoernT_ has joined #openstack-nova02:58
*** BjoernT_ has quit IRC03:07
*** artom has quit IRC03:15
*** psachin has joined #openstack-nova03:28
*** betherly has joined #openstack-nova03:29
*** artom has joined #openstack-nova03:32
*** betherly has quit IRC03:33
*** hongbin has quit IRC03:45
*** betherly has joined #openstack-nova03:49
*** hongbin has joined #openstack-nova03:50
*** hongbin has quit IRC03:50
*** betherly has quit IRC03:54
*** udesale has joined #openstack-nova04:01
*** tetsuro has quit IRC04:09
*** rcernin has quit IRC04:13
*** rcernin has joined #openstack-nova04:14
*** etp has joined #openstack-nova04:17
*** rcernin has quit IRC04:20
*** etp has quit IRC04:24
*** etp has joined #openstack-nova04:25
*** etp has quit IRC04:26
*** etp has joined #openstack-nova04:27
*** betherly has joined #openstack-nova04:31
*** betherly has quit IRC04:36
*** pcaruana has joined #openstack-nova04:43
*** betherly has joined #openstack-nova04:47
*** vishwanathj has quit IRC04:51
*** betherly has quit IRC04:51
*** vishwanathj has joined #openstack-nova04:52
*** threestrands has quit IRC05:04
*** tetsuro has joined #openstack-nova05:05
*** Luzi has joined #openstack-nova05:05
*** tetsuro has quit IRC05:08
*** ratailor has joined #openstack-nova05:13
*** TxGirlGeek has joined #openstack-nova05:16
*** maciejjozefczyk has joined #openstack-nova05:27
*** TxGirlGeek has quit IRC05:43
*** dpawlik has joined #openstack-nova05:44
*** cervigni has joined #openstack-nova05:50
cervigniHello, I am struggling to set up a compute node with VGPU. I read there is support (experimental) and I am using rocky05:51
cervignithe set up seems fine, until nova tries to use the mdev and bombs out with this error05:51
cervignivfio error: a5ddfb5b-8066-4e51-82b5-d750eecd4c58: error getting device from group 81: Input/output error05:54
cervigni(nova in debug mode)05:54
cervigni019-07-23T05:54:05.295069Z qemu-system-x86_64: -device vfio-pci,id=hostdev0,sysfsdev=/sys/bus/mdev/devices/a5ddfb5b-8066-4e51-82b5-d750eecd4c58,bus=pci.0,addr=0x6: vfio error: a5ddfb5b-8066-4e51-82b5-d750eecd4c58: error getting device from group 81: Input/output error05:55
cervigniVerify all devices in group 81 are bound to vfio-<bus> or pci-stub and not already in use05:55
*** vishwanathj has quit IRC05:55
cervignifor VGPUs do I have to enable iommu and pt ?05:59
openstackgerritya.wang proposed openstack/nova-specs master: Add spec for expose-auto-converge-post-copy  https://review.opendev.org/65168106:08
*** igordc has joined #openstack-nova06:08
*** jhesketh has quit IRC06:11
*** jhesketh has joined #openstack-nova06:11
*** igordc has quit IRC06:15
cervignianyone?06:18
*** yachik1234 has joined #openstack-nova06:23
yachik1234hello06:23
openstackgerritya.wang proposed openstack/nova-specs master: Add spec for expose-auto-converge-post-copy  https://review.opendev.org/65168106:24
openstackgerritya.wang proposed openstack/nova-specs master: Add spec for expose-auto-converge-post-copy  https://review.opendev.org/65168106:30
*** etp has quit IRC06:31
*** etp_ has joined #openstack-nova06:31
*** etp_ has quit IRC06:35
*** etp has joined #openstack-nova06:35
*** etp has quit IRC06:36
*** etp_ has joined #openstack-nova06:36
*** bhagyashris has joined #openstack-nova06:38
*** etp_ has quit IRC06:40
*** etp has joined #openstack-nova06:45
*** georgeakahiron has joined #openstack-nova06:46
*** ttsiouts has joined #openstack-nova06:48
*** kodama_ has joined #openstack-nova06:50
*** Aki-Hasegawa-27 has joined #openstack-nova06:51
openstackgerritYongli He proposed openstack/nova master: Add server sub-resource topology API  https://review.opendev.org/62147606:51
*** NewBruce has quit IRC06:53
*** slaweq has joined #openstack-nova07:07
*** tesseract has joined #openstack-nova07:09
*** rpittau|afk is now known as rpittau07:09
*** maciejjozefczyk_ has joined #openstack-nova07:20
*** zbr_ has joined #openstack-nova07:20
*** irclogbot_2 has quit IRC07:20
*** kaisers has quit IRC07:20
*** openstackstatus has quit IRC07:20
*** kaisers has joined #openstack-nova07:21
*** irclogbot_3 has joined #openstack-nova07:21
*** dansmith has quit IRC07:23
*** maciejjozefczyk has quit IRC07:23
*** francoisp has quit IRC07:23
*** zbr has quit IRC07:23
*** maciejjozefczyk_ is now known as maciejjozefczyk07:23
*** dansmith has joined #openstack-nova07:24
*** Anticimex has quit IRC07:24
*** beagles has quit IRC07:26
*** Anticimex has joined #openstack-nova07:29
*** ttsiouts has quit IRC07:42
*** ttsiouts has joined #openstack-nova07:43
*** ttsiouts has quit IRC07:48
*** avolkov has joined #openstack-nova07:58
*** priteau has joined #openstack-nova08:00
*** Aki-Hasegawa-27 has quit IRC08:13
*** mkrai_ has joined #openstack-nova08:19
*** betherly has joined #openstack-nova08:20
*** ivve has joined #openstack-nova08:22
*** ttsiouts has joined #openstack-nova08:22
*** ralonsoh has joined #openstack-nova08:26
openstackgerritBhagyashri Shewale proposed openstack/nova master: WIP: Report PCPU to placement  https://review.opendev.org/67222108:26
openstackgerritBhagyashri Shewale proposed openstack/nova master: WIP: Virt driver: Build guest xml  https://review.opendev.org/67222208:26
openstackgerritBhagyashri Shewale proposed openstack/nova master: WIP: Add scheduler request filter to alias cpu_policy  https://review.opendev.org/67222308:26
openstackgerritBhagyashri Shewale proposed openstack/nova master: WIP Upgrade patch to handle PCPU resource  https://review.opendev.org/67222408:26
*** tssurya has joined #openstack-nova08:28
*** panda has quit IRC08:38
*** panda has joined #openstack-nova08:38
bhagyashrisstephenfin, : Hi, I have uploaded patches to implement Standardize CPU resource tracking spec ^ . I would like you insights on it.08:41
bhagyashrisyour*08:41
*** cervigni has quit IRC08:42
openstackgerritsahid proposed openstack/nova master: cellv2: make update_cell to support cell0  https://review.opendev.org/67204508:46
*** ileixe has quit IRC08:49
*** sapd1_x has joined #openstack-nova08:55
*** priteau has quit IRC09:00
*** jangutter has quit IRC09:01
*** priteau has joined #openstack-nova09:02
*** betherly has quit IRC09:11
*** _hemna has joined #openstack-nova09:12
stephenfinbhagyashris: https://review.opendev.org/#/c/672106/109:14
stephenfinI can take a look but I do have a good chunk of that done now09:15
*** _hemna has quit IRC09:16
stephenfinShould probably look to combine them09:17
bhagyashrisstephenfin: Sorry for the late but I was covering maximum points that's why its took time to upload the patches09:18
stephenfinYup, np. Will be interesting compare the two approaches09:19
*** psachin has quit IRC09:20
bhagyashrisstephenfin: ok thank you :)09:22
stephenfinbhagyashris: Probably worth looking through mine while I do the same for yours09:23
stephenfinI see you've done the reshape stuff, which I was still working on, though I managed to avoid doing InstanceNUMATopology changes which might be something you could copy09:23
stephenfinI imagine we'll end up taking bits from one and adding it to the other, fwiw :)09:23
*** jangutter has joined #openstack-nova09:26
*** ociuhandu has joined #openstack-nova09:31
bhagyashrisstephenfin: ok. Yeah and the patches I have uploaded are full working now including the upgrade09:32
bhagyashrisstephenfin: I haven't gone through your patches I will take look on it09:32
*** cdent has joined #openstack-nova09:33
*** psachin has joined #openstack-nova09:35
*** georgeakahiron has quit IRC09:40
*** kodama_ has quit IRC09:43
*** jojoda has quit IRC09:45
openstackgerrit**** proposed openstack/nova master: Nova: node should be deleted when last service is deleted  https://review.opendev.org/67173109:46
*** betherly has joined #openstack-nova09:46
*** ociuhandu has quit IRC09:48
*** ociuhandu has joined #openstack-nova09:50
*** jaosorior has joined #openstack-nova09:52
*** bhagyashris has quit IRC09:54
openstackgerritStephen Finucane proposed openstack/nova master: Remove deprecated Core/Ram/DiskFilter  https://review.opendev.org/67206510:00
openstackgerritStephen Finucane proposed openstack/nova master: Remove deprecated CPU, RAM, disk claiming in resource tracker  https://review.opendev.org/55102610:00
*** dpawlik has quit IRC10:02
*** dpawlik has joined #openstack-nova10:03
*** ttsiouts has quit IRC10:11
*** ttsiouts has joined #openstack-nova10:12
*** traskat has quit IRC10:13
*** kashyap has joined #openstack-nova10:13
*** ttsiouts has quit IRC10:16
openstackgerrit**** proposed openstack/nova master: Nova: node should be deleted when last service is deleted  https://review.opendev.org/67173110:20
*** lpetrut has joined #openstack-nova10:21
*** brinzhang_ has joined #openstack-nova10:26
*** brinzhang has quit IRC10:30
*** ricolin_ has joined #openstack-nova10:34
*** bbowen has quit IRC10:37
*** ricolin has quit IRC10:37
openstackgerritStephen Finucane proposed openstack/nova master: Remove 'nova.virt.driver.ComputeDriver.estimate_instance_overhead'  https://review.opendev.org/67210610:44
*** mkrai_ has quit IRC10:45
*** tbachman has joined #openstack-nova10:46
*** luksky11 has joined #openstack-nova10:47
*** luksky123 has joined #openstack-nova10:48
*** luksky11 has quit IRC10:52
*** tbachman has quit IRC11:06
*** zhouyao has joined #openstack-nova11:10
openstackgerrit**** proposed openstack/nova master: Nova: node should be deleted when last service is deleted  https://review.opendev.org/67173111:14
*** jaypipes has joined #openstack-nova11:14
zhouyao@Chris Friesen May i ask you if you still focusing on this patch? https://review.opendev.org/#/c/62164611:15
*** sean-k-mooney has joined #openstack-nova11:20
*** spatel has joined #openstack-nova11:20
*** zhouyao has quit IRC11:21
*** spatel has quit IRC11:25
*** ttsiouts has joined #openstack-nova11:30
*** b3nt_pin has joined #openstack-nova11:35
*** shilpasd has joined #openstack-nova11:54
*** bbowen has joined #openstack-nova11:55
*** markvoelker has quit IRC11:58
*** eharney has joined #openstack-nova12:01
*** udesale has quit IRC12:04
*** udesale has joined #openstack-nova12:04
*** ricolin_ is now known as ricolin12:05
*** etp has quit IRC12:11
*** markvoelker has joined #openstack-nova12:16
*** ttsiouts has quit IRC12:17
*** ttsiouts has joined #openstack-nova12:17
*** sean-k-mooney1 has joined #openstack-nova12:22
*** ttsiouts has quit IRC12:22
*** ccamacho has joined #openstack-nova12:22
*** sean-k-mooney has quit IRC12:25
*** francoisp has joined #openstack-nova12:29
openstackgerritdzogchen proposed openstack/nova master: Nova: node should be deleted when last service is deleted  https://review.opendev.org/67173112:35
openstackgerritJosephine Seifert proposed openstack/nova-specs master: Spec for the Nova part of Image Encryption  https://review.opendev.org/60869612:37
*** mriedem has joined #openstack-nova12:38
*** luksky123 has quit IRC12:39
*** ratailor has quit IRC12:46
*** efried_pto is now known as efried12:49
openstackgerritMerged openstack/python-novaclient master: Update api-ref location  https://review.opendev.org/67213512:55
efriedsean-k-mooney1: alex_xu: Care to re-ack https://review.opendev.org/#/c/651681/ please?12:56
*** zhouyao has joined #openstack-nova12:57
efriedalex_xu: Please don't +W -- we need a non-Intel core to do that. (mriedem, bauzas, and johnthetubaguy have all had hands on this previously)12:57
efriedmriedem: Since gibi_off is _off for 2w, I'm going to propose the change to consts for https://review.opendev.org/#/c/668925/ as a fup so we can merge it, cool?12:59
efriedUnless you think it's okay to make the change there and fast approve?12:59
mriedemefried: wfm13:01
mriedemthe fup i mean13:01
bauzasefried: I can look13:03
bauzaslike I said, I already reviewed it13:03
cdentI can never remember this: what, if anything, is the special magic to force a migration to a specific host/az?13:04
openstackgerritEric Fried proposed openstack/nova master: Consts for need_healing  https://review.opendev.org/67228413:05
efriedmriedem: ^13:05
efriedcdent: the old way or the new way?13:05
efriedAPI or CLI?13:06
jrollwhen adding a new compute host, is there a way to bring it on disabled for scheduling, until we can go set up aggregates and such?13:06
cdentefried: CLI, ocata-ish13:06
bauzascdent: live-migrate --host ?13:06
efriedjroll: for new code or old?13:06
jrollefried: ocata and rocky :|13:07
bauzascdent: for a specific AZ, you need to first asking for an AZ when creating the instance13:07
bauzas(or using the default_az option)13:07
cdentbauzas: yeah, in this case the issue is that by some unknown series of events the instance is in an AZ that no longer exists, so forcing it out of that one is desired13:07
cdents/in/started in/13:07
mriedemhttps://docs.openstack.org/nova/latest/user/aggregates.html#implications-for-moving-servers13:08
mriedemhttps://docs.openstack.org/python-openstackclient/latest/cli/command-objects/server.html#server-migrate13:09
mriedemopenstack server migrate --live13:09
mriedem*openstack server migrate --live <host> will by default forcefully live migrate the server to the specified host and bypass the scheduler13:10
efriedjroll: mriedem was just in this code. I suspect with his new feature you could create the provider and tagg it with COMPUTE_STATUS_DISABLED before adding it to the service. But prior to that... I'm not sure.13:10
cdentmriedem: thanks, i was in the first link (been there many times, it seems)13:10
mriedemcdent: what i'm not sure about is if, on ocata, the forced live migration will update the az in the request spec (probably not) and it might not update the az on the instance record either13:10
mriedemcdent: i wrote it for you :)13:10
* cdent feels blessed13:10
mriedemif the az is gone you're kind of in manual db surgery area, at least on ocata13:11
cdentyeah, I figured that and already passed that along13:11
mriedemthere was a newer bug fix to not allow deleting an az that had instances in it, but that's not on ocata13:11
mriedemthere is also a blueprint in train to allow changing the az on unshelve13:11
mriedembut that won't help you in ocata either13:12
jrollefried: cool, thanks13:12
cdentmriedem: and what about queens?13:13
cdentany diff?13:13
* cdent is in a sea of many different version numbers and names13:13
efriedbauzas: Thanks. If it's acceptable, could you please +A?13:16
stephenfindansmith: You're going to hate this, but can we do this? http://paste.openstack.org/show/754754/13:16
stephenfinAnd I mean just that13:17
tssuryajroll: for the old code if you have the ComputeFilter enabled it will automatically filter out disabled computes13:17
openstackgerritsahid proposed openstack/nova master: cellv2: fix update_cell to support cell0  https://review.opendev.org/67204513:17
tssuryaas long as you don't have the "max_placement_results" set13:17
*** ttsiouts has joined #openstack-nova13:17
jrolltssurya: right, but I want the computes to join the cluster disabled, to remove a race condition where they could get a VM scheduled before we can disable them or configure them properly13:18
tssuryajroll: ah ok understood13:18
jroll:)13:19
stephenfindansmith: I _think_ that with that change, we'll still be storing the same JSON-ified representation of the object in any database fields, only now we get the automatic conversion back to the object instead of having to remember to do it manually13:19
mriedemcdent: the bug fix to prevent deleting an az with servers in it might have been backported to queens, i can check13:21
mriedembut the unshelve to a new az thing is a new feature so wouldn't be backported (and isn't merged yet anyway)13:21
*** openstackstatus has joined #openstack-nova13:21
*** ChanServ sets mode: +v openstackstatus13:21
cdentmriedem: thanks. the deleting the az bug isn't an immediate concern13:22
efriedbauzas: If you're in a spec approving mood, would you mind hitting https://review.opendev.org/#/c/608696/ (nova part of image encryption) as well please?13:22
*** shilpasd has quit IRC13:22
mriedemcdent: ok, looks like it only went back to rocky anyway https://review.opendev.org/#/q/Ic27195e46502067c87ee9c71a811a3ca3f610b7313:23
bauzasefried: opening another tab13:25
efriedmelwitt, lyarwood, mdbooth_: Could we get a comeback on https://review.opendev.org/#/c/658903/ (RBD image up/download spec) please?13:26
openstackgerritMerged openstack/nova master: Update AZ admin doc to mention the new way to specify hosts  https://review.opendev.org/66676713:28
*** davidsha has joined #openstack-nova13:28
efriedstephenfin: gibi is +2 on https://review.opendev.org/#/c/641670/ (unaddressed port spec) -- looks like you're the man to send it?13:29
efriedjangutter: sean-k-mooney1: are you happy with ^ at this point?13:30
jangutterefried: no objections from me. I'm pretty sure any security concerns can be sorted during implementation.13:31
stephenfinefried: Yup, I'll get to that before EOD13:31
efrieddonkey jangutter13:31
efriedthanks stephenfin13:31
jangutterbuy a donkey you too efried13:32
mriedemcdent: just fyi https://review.opendev.org/#/q/I9f73c237923fdcbf4096edc5aedd2c968d4b893e was backported which updates the instance az during live migration but that still doesn't update the request spec az, which is the key thing since that's what will be used when you run the server through the scheduler to move it later (if not forced)13:35
mriedemand if the request spec az is referencing something that's gone, and the az filter is enabled, the scheduler will novalidhost the move13:36
cdentthanks mriedem13:36
openstackgerritStephen Finucane proposed openstack/nova master: Remove 'nova.virt.driver.ComputeDriver.estimate_instance_overhead'  https://review.opendev.org/67210613:36
mriedemso, recovery is likely: (1) force live migrate the server to some new host in a new az and then (2) manuall update the request spec az for the instance in the api db13:36
mriedemnote the request spec is a json blob in the db as well...so that's fun13:36
mriedemi've got to run to an appointment, will be back on in a bit13:37
*** mriedem has quit IRC13:38
*** mkrai_ has joined #openstack-nova13:43
openstackgerritMerged openstack/nova-specs master: Add spec for expose-auto-converge-post-copy  https://review.opendev.org/65168113:45
openstackgerritMerged openstack/nova-specs master: Boot a VM with an unaddressed port  https://review.opendev.org/64167013:46
*** zhouyao has quit IRC13:47
efriedstephenfin: If you agree https://review.opendev.org/#/c/672077/3/README.rst needs to be changed, I can fix it real quick and we can tag-team it?13:48
efrieduh, actually, I'm not sure what that should be changed to tbh13:48
stephenfinefried: Drop it13:48
stephenfinand yes13:48
dansmithstephenfin: yeah you can't do that because it'll break rpc13:48
dansmithstephenfin: but no, compute node won't auto serialize that to json, you have to make it do that13:49
stephenfinOh yeah. Duh13:50
stephenfinProxy field it is13:50
stephenfinAlso, what's horrible about bumping a major version again?13:50
stephenfin*major object version13:50
stephenfinI recall we bumped the Instance object and said never again, but I don't know why never again13:50
dansmithstephenfin: it's not too terrible, but it is a little complicated. instance was the most complicated object, but I don't think we said never again,13:51
dansmithit's just that it needs to be worth it13:51
*** Luzi has quit IRC13:51
efried(stephenfin nm, there's no replacement for the landing page yet, I +Wed)13:51
dansmithstephenfin: compute node would probably be much less annoying because of how limited its use is.. i.e. we don't send compute node objects all around to every node like we do instance,13:52
dansmithit's mostly just the compute and conductor that have to touch them13:52
stephenfinYeah, that's the one I'm most interested in13:52
stephenfinI think I'll wait til os-hypervisors is talking to placement instead of consuming the xxx_usage fields from ComputeNode first though13:53
stephenfinSo we can remove those while we're at it13:53
stephenfin(Assuming that ends up being possible)13:53
dansmiththe point being to objectify that field, right? why is that a thing now vs. before? Because you're adding stuff to that field or something?13:53
*** ttsiouts has quit IRC13:53
dansmithstephenfin: that sounds like a good idea13:53
dansmithan object change for one field type is less good, but deprecating unused fields with that change is more meaty13:54
*** ttsiouts has joined #openstack-nova13:54
*** yachik1234 has quit IRC13:55
stephenfindansmith: Mostly because it wasn't initially obvious and led to me being bitten by it13:55
stephenfinI am tackling it at in a more piecemeal fashion with https://review.opendev.org/#/c/671799/3 and the two preceding patches though13:55
stephenfinmoving the calls to convert the string to an object (and vice versa) close to where the field is actually read/set13:55
stephenfintl;dr: hardware.py is nasty13:55
*** ttsiouts has quit IRC13:58
*** ttsiouts has joined #openstack-nova13:58
*** lbragstad has joined #openstack-nova14:00
*** rpittau is now known as rpittau|afk14:03
dansmithstephenfin: I don't want to nitpick your reno to death, but I do think it's important to note that the change it is describing happened quite a while ago, instead of implying that as of train, something is different14:05
dansmithalso happy to edit it myself if you want14:05
stephenfinwrt to which patch now?14:05
stephenfinSure, suits me :)14:05
stephenfinAssume you mean https://review.opendev.org/#/c/672065/ ?14:06
dansmithyeah14:06
stephenfinYeah, go for it. Think mriedem made a similar comment when it was part of the claims patch14:06
*** tbachman has joined #openstack-nova14:07
dansmithyeah, that feedback didn't seem to make the jump, but it's hard to tell because I can't diff revs now14:08
stephenfinI changed 'is now' to 'is' and changed the wording of the libvirt section14:08
dansmithheh14:08
stephenfinWas going to state that it's performed natively in placement since X, but I couldn't determine fully when X was. Thought it was Ocata but mriedem referenced Pikle14:09
stephenfin*Pike14:09
dansmithstephenfin: so, matt's comment was that none of the virt specific stuff belongs in that reno, but in admin docs14:13
stephenfinOh, I misread that /o\14:13
*** tssurya has quit IRC14:13
stephenfinI thought he was saying the reno was fine but the admin docs should be additional14:13
*** belmoreira has joined #openstack-nova14:14
dansmithwell I guess maybe14:14
dansmithhere's the thing though:14:14
dansmiththese filters would be conflicting with placement since pike14:14
dansmithmeaning, they should have been disabled since then, and they warn at startup if enabled14:14
dansmith*that* is when this virt overhead change happened, not now14:15
stephenfinFair point14:15
dansmithso putting it in a reno for train makes it sound like that behavior is now changing, but it is not14:15
stephenfinStrip it out so?14:15
dansmithso that's why *I* want it not in a reno :)14:15
stephenfinI have the important bits noted at https://review.opendev.org/#/c/672065/2/api-ref/source/parameters.yaml and https://review.opendev.org/#/c/672065/2/doc/source/admin/configuration/schedulers.rst@1355 I think14:15
stephenfinthe latter being more importnat14:15
stephenfin*important14:15
dansmithyeah, so I'll strip it out and add some more words to this, and then go hunting for a place to maybe explain it in a generalized way or something14:15
dansmithstephenfin: oh, yeah, that second bit is perfect14:16
dansmithso I think we can just strip this out of the reno then14:16
stephenfinSounds good to me14:16
stephenfinHappy to do that or will I?14:16
dansmithI have it open already14:16
stephenfin(y)14:17
stephenfinIn that case, I've two references to config options in that second bit that should probably do with the ':oslo.config:option:' role, but as a nice-to-have14:18
dansmithcan you barf up the rst for me to link to that schedulers section?14:19
*** mkrai_ has quit IRC14:19
*** gyee has joined #openstack-nova14:23
dansmithhmm, maybe i just use the full link? I thought there was a shortcut14:23
stephenfinTo the section I added?14:24
stephenfinYou need to add an anchor before the title and then you can use the :ref: role, assuming it's within the same doc build14:25
stephenfinso add e.g. '.. _hypervisor-specific-considerations:'14:25
stephenfinthen reference wherever you want with ':ref:`hypervisor-specific-considerations`'14:26
stephenfinor https://docs.openstack.org/nova/latest/admin/configuration/schedulers.html#hypervisor-specific-considerations if it's from a reno or something14:27
dansmithack was just piecing that together from mah grepping14:27
dansmithI have to re-learn this every damn time14:27
dansmithstephenfin: er, I don't see any other :ref: usage in the renos.. are renos in the same build as the other docs?14:28
stephenfinYou've to use a URL there14:28
openstackgerritEric Fried proposed openstack/nova master: DNM: experiment with GreenThread passthrough  https://review.opendev.org/67229914:28
stephenfinbecause they're a different build14:29
dansmithright okay, but the anchor makes it #able yeah?14:29
stephenfinYup14:29
dansmithstephenfin: aren't you glad I'm saving you time by doing this myself? :P14:29
stephenfinVery :)14:29
dansmithhaha14:29
stephenfinHere's another example, fwiw https://docs.openstack.org/nova/latest/admin/configuration/schedulers.html#allocation-ratios14:29
stephenfinThat should have an anchor in the rST14:29
dansmiththat's the one I was copying yeah14:30
stephenfinthough interestingly that has no anchor14:30
dansmithit does14:31
dansmithoh no,14:31
dansmiththat one was auto from the heading I think14:31
dansmithI found another one though14:31
dansmithcapabilities-as-traits is what I copied14:31
stephenfinAh yeah, the auto from the heading behavior isn't the default, I thought14:31
stephenfinMight be a thing we do in openstackdocstheme14:31
stephenfinOr not, idk. Doesn't matter. capabilities-as-traits is good14:32
openstackgerritEric Fried proposed openstack/nova master: Use OpenStack SDK for placement  https://review.opendev.org/65602314:34
*** mriedem has joined #openstack-nova14:36
sean-k-mooney1stephenfin: the headings are automaticaly referenceable via the css selector14:37
sean-k-mooney1its thte content list or what ever we use that arnt14:37
*** sean-k-mooney1 is now known as sean-k-mooney14:37
dansmithstephenfin: I'm going to address my other nit I just commented as well14:39
*** mlavalle has joined #openstack-nova14:40
*** lbragstad has quit IRC14:40
*** dosaboy has joined #openstack-nova14:41
dansmithand your comment on the config option14:42
stephenfincoolness14:43
*** lbragstad has joined #openstack-nova14:43
* aspiers is back14:47
*** _hemna has joined #openstack-nova14:47
aspierssean-k-mooney: I'm about to review your https://review.opendev.org/#/c/670189/ - thanks for working on that14:48
openstackgerritDan Smith proposed openstack/nova master: Remove deprecated Core/Ram/DiskFilter  https://review.opendev.org/67206514:49
openstackgerritDan Smith proposed openstack/nova master: Remove deprecated CPU, RAM, disk claiming in resource tracker  https://review.opendev.org/55102614:49
openstackgerritDan Smith proposed openstack/nova master: Remove 'nova.virt.driver.ComputeDriver.estimate_instance_overhead'  https://review.opendev.org/67210614:49
sean-k-mooneyaspiers: nice to see you around again. and i need it for my own stuff too so its not entily un selfish :)14:50
*** _hemna has quit IRC14:52
*** TxGirlGeek has joined #openstack-nova14:52
aspierssean-k-mooney: :)14:56
aspierssean-k-mooney: I am not sure why I thought that defaulting to q35 would be OK :-/14:56
mriedemralonsoh: jangutter: efried: stephenfin: i'm late but have some concerns in https://review.opendev.org/#/c/641670/ that should be addressed15:02
efriedmriedem: should I unapprove the bp?15:03
mriedemefried: probably not right now15:03
efriedk15:03
efriedmriedem: if you're in a spec reviewing mood, this one could use some love https://review.opendev.org/#/c/608696/15:03
ralonsohmriedem, I'll check your comments today15:04
mriedemefried: i'm not really15:05
mriedemi just saw that one was merged and short15:05
*** mkrai_ has joined #openstack-nova15:06
openstackgerritsean mooney proposed openstack/nova master: libvirt: delegate ovs plug to os-vif  https://review.opendev.org/60243215:10
stephenfinefried: It looks like we've gone from zero to two implementations of the cpu-resources spec in less than a week \o/15:14
stephenfinI'm working on comparing and likely merging the two, but I'd like your thoughts on this particular difference of implementation when you can https://review.opendev.org/#/c/672223/ and https://review.opendev.org/#/c/671801/15:15
stephenfinThey're the two patches to convert legacy 'hw:cpu_(thread_)policy' extra specs to PCPU requests and they've taken very different approaches. I can't decide which one I prefer15:16
*** trident has quit IRC15:18
*** belmoreira has quit IRC15:18
*** _hemna has joined #openstack-nova15:18
stephenfinTIL '(x or y) in foo' is a valid Python statement15:20
*** trident has joined #openstack-nova15:20
*** ccamacho has quit IRC15:21
* stephenfin would have expected that to render as result of the 'x or y' (True) in 'foo' (so 'True in foo')15:21
*** dpawlik has quit IRC15:30
stephenfinActually, it does (thank ralonsoh)15:30
stephenfin>>> (0 or None) in [0]15:30
stephenfinFalse15:30
openstackgerritMatt Riedemann proposed openstack/nova master: Convert nova-next to a zuul v3 job  https://review.opendev.org/67019615:33
mriedemis there a follow up needed for surya's spec here https://review.opendev.org/#/c/636132/ ? before digging into the code series i was going to go over the spec again but don't really want to if it's a mess that needs an update.15:38
*** david-lyle is now known as dklyle15:40
*** sean-k-mooney1 has joined #openstack-nova15:44
*** sapd1_x has quit IRC15:44
stephenfinsean-k-mooney: Question: do we want to allow users to request 'resources:VCPU' or 'resources:PCPU' in their flavor extra specs?15:44
stephenfinas opposed to 'hw:cpu_policy=dedicated' and whatever the new mask option to allow instances with both types of CPU ends up being15:44
stephenfinor in addition to, I should say15:44
openstackgerritMerged openstack/nova master: Translatable output strings in heal allocation  https://review.opendev.org/66892515:46
*** sean-k-mooney has quit IRC15:46
*** trident has quit IRC15:52
*** _hemna has quit IRC15:53
*** jaosorior has quit IRC15:53
*** ttsiouts has quit IRC15:54
*** ttsiouts has joined #openstack-nova15:55
*** trident has joined #openstack-nova15:55
*** ttsiouts_ has joined #openstack-nova15:57
*** ttsiouts has quit IRC15:57
efriedstephenfin: you may be expecting too much of me wrt those PCPU impls, but I'll do what I can.15:59
stephenfinThat's all I can ask (y)15:59
*** ttsiouts_ has quit IRC15:59
stephenfinThey both "work", I'm more interested in which approach is preferable16:00
efriedstephenfin: also, to answer "do we want to allow users to request 'resources:VCPU' or 'resources:PCPU' in their flavor extra specs?" -- I think we need to *allow* it, because downstream thingies are going to want to override the meanings of the RCs for things like frequency/priority (per ptg direction) --16:01
efriedbut we should definitely *support* (and encourage as the primary usage) flavor-ese lingo translated by request_filter to placement-ese.16:01
stephenfinAye, so allow it unless the 'hw:cpu_policy' extra spec/image meta prop is present16:02
stephenfinIn which case we spit the dummy out?16:02
*** sean-k-mooney1 has quit IRC16:07
*** tesseract has quit IRC16:07
mriedemefried: dansmith: melwitt: you were all +2 on the spec for https://review.opendev.org/#/c/645611/ so i might be off base on my comments,16:18
mriedemnothing major but i'm not sure why the driver even needs to implement this16:18
dansmithmriedem: what do you mean?16:18
*** lpetrut has quit IRC16:19
dansmithwhy we're plumbing this to the driver instead of just telling the compute about the change?16:19
mriedemall the virt driver does is set the values on the instance and save them to the db,16:20
mriedemwhich is what stop/start_instance in the compute manager does for normal stop/start,16:20
mriedemso why not just do the db updates in the compute manager code rather than muck with driver plumbing16:20
mriedemjust seems weird to me,16:20
mriedemif it's "we don't want non-ironic drivers to do this" then add a driver capability flag16:21
dansmithmriedem: compute start/stop will call the driver and tell it what to do right?16:21
mriedemto actually power on / off a guest yeah16:21
mriedemthis is just db muckery16:21
dansmiththe point of this is to decide what needs to happen when some external change happens to the instance, just like how libvirt gets direct events16:21
dansmiththe point being, ironic needs to know this should be swallowed and the db updated,16:22
mriedemnone of that logic is in the actual driver16:22
dansmithbut that's not necessarily what should happen for vmware16:22
openstackgerritMerged openstack/nova master: Update api-ref location  https://review.opendev.org/67207716:22
mriedemok i guess "it's just a simple abstraction" is the answer then16:22
dansmithremember the first version of this *did* just call start/top,16:22
mriedemi don't expect any other drivers to ever implement this, but i guess it's generic enough that they could16:23
dansmithbut had a "don't actually call the virt driver=True" if we're ironic16:23
dansmithso the change to delgate "what should I do with this external change?" to the driver was to make that cleaner16:23
mriedemyeah i agree that was gross16:23
dansmithdidn't we discuss all this during spec review?16:23
dansmithI thought you were involved with that16:23
mriedemnot really16:23
mriedemthat's why i asked earlier in here if the spec was going to be updated so i could sanely read it before reviewing the code16:24
mriedembut i just dove in anyway16:24
dansmithokay you did review it at one point, but I see not in the later revs16:24
mriedemanyway, that's fine when you explain it that way16:24
dansmithokay16:24
*** davidsha has quit IRC16:32
*** ricolin has quit IRC16:34
*** jamesdenton has quit IRC16:36
*** jamesdenton has joined #openstack-nova16:36
*** mkrai_ has quit IRC16:44
efriedmriedem, dansmith: what's your take on the race condition & lock? Add it to the code, or take it out of the spec?16:45
mriedemlock....16:47
mriedemthe api is validating the vm/task/power state right?16:47
mriedemand the compute manager is making the change16:47
efriedmriedem: The concern I raised top-level, which was apparently also discussed in the spec.16:47
efriedthat we could start the power sync before the event hits16:47
mriedemif the sync task runs it would call api.stop() which would set the task_state and then the event should be ignored,16:48
mriedembut there could be a window where we passed the event from the api to compute before compute calls api.stop16:49
mriedemthe task_state is generally our lock for stuff, i.e. the task state ignores instances with a non-None task_state16:49
mriedemi'm not sure how you're going to impose a lock otherwise, unless you lock on the instance uuid in the compute manager or something16:49
*** betherly has quit IRC16:49
mriedemnote that stop_instance in compute manager already locks on instance uuid16:50
efriedI'm okay accepting the risk, but it should probably be noted in a code comment.16:50
*** jaypipes has quit IRC16:54
openstackgerritdzogchen proposed openstack/nova master: Nova: node should be deleted when nova-compute is removed  https://review.opendev.org/67173116:54
mriedemefried: i left a comment in the code,16:56
mriedemi *think* if we lose a race somewhere, chances are one of the threads is going to fail with UnexpectedTaskStateError16:56
efriedthanks16:56
mriedemwhich is maybe ok - worst case is the node gets powered off when it shouldn't be, which is the original bug she's trying to fix right?16:56
mriedemsome lab monkey powered on the box when nova thinks it's off16:57
mriedemso nova's task shuts it off16:57
mriedemfwiw i think we also have races with the existing sync task and the libvirt lifecycle event callback stuff which is why we have a workaround option to ignore those16:57
mriedemhttps://docs.openstack.org/nova/latest/configuration/config.html#workarounds.handle_virt_lifecycle_events16:58
efriedright, so like, fixing that bug is the whole reason this patch exists. So if we're leaving that bug open -- even if we're drastically reducing the probability -- we need to own that somehow.16:59
*** udesale has quit IRC17:03
openstackgerritMatt Riedemann proposed openstack/nova master: Remove super old unnecessary TODO from API start() method  https://review.opendev.org/67233017:05
*** trident has quit IRC17:07
*** trident has joined #openstack-nova17:10
*** priteau has quit IRC17:11
*** ociuhandu has quit IRC17:13
*** sean-k-mooney has joined #openstack-nova17:21
*** efried has quit IRC17:23
*** _erlon_ has joined #openstack-nova17:25
*** efried has joined #openstack-nova17:27
sean-k-mooneylyarwood: mriedem: can ye add this depercation warning backport to your review queue https://review.opendev.org/#/c/671532/17:32
*** mdbooth_ has quit IRC17:33
*** ralonsoh has quit IRC17:36
mriedemsean-k-mooney: done17:39
mriedemnote that issue is also in cinder17:40
mriedemi'll add cinder to the bug17:40
efriedartom, mriedem: Why is https://review.opendev.org/#/c/668631/ (pass migration to finish_revert_migration) on top of https://review.opendev.org/#/c/670393/ (func test for crash of same)?17:42
efriedAre we making sure the former doesn't change any of the (broken) behavior demonstrated by the latter?17:42
openstackgerritStephen Finucane proposed openstack/nova master: objects: Rename 'nova.objects.instance_numa_topology'  https://review.opendev.org/67178917:42
openstackgerritStephen Finucane proposed openstack/nova master: libvirt: Remove unnecessary try-catch around 'getCPUMap'  https://review.opendev.org/67179017:42
openstackgerritStephen Finucane proposed openstack/nova master: objects: Remove legacy '_from_dict' functions  https://review.opendev.org/53741417:42
openstackgerritStephen Finucane proposed openstack/nova master: claims: Remove useless caching  https://review.opendev.org/67179117:43
openstackgerritStephen Finucane proposed openstack/nova master: Add '[compute] cpu_dedicated_set' option  https://review.opendev.org/67179217:43
openstackgerritStephen Finucane proposed openstack/nova master: libvirt: Start reporting PCPU inventory to placement  https://review.opendev.org/67179317:43
openstackgerritStephen Finucane proposed openstack/nova master: trivial: Rename exception argument  https://review.opendev.org/67179517:43
openstackgerritStephen Finucane proposed openstack/nova master: trivial: Remove unused function parameter  https://review.opendev.org/67179617:43
openstackgerritStephen Finucane proposed openstack/nova master: Remove 'hardware.get_host_numa_usage_from_instance'  https://review.opendev.org/67179717:43
openstackgerritStephen Finucane proposed openstack/nova master: Remove 'hardware.host_topology_and_format_from_host'  https://review.opendev.org/67179817:43
openstackgerritStephen Finucane proposed openstack/nova master: Remove 'hardware.instance_topology_from_instance'  https://review.opendev.org/67179917:43
openstackgerritStephen Finucane proposed openstack/nova master: WIP: hardware: Differentiate between shared and dedicated CPUs  https://review.opendev.org/67180017:43
openstackgerritStephen Finucane proposed openstack/nova master: Add support translating CPU policy extra specs, image meta  https://review.opendev.org/67180117:43
openstackgerritStephen Finucane proposed openstack/nova master: tests: Split NUMA object tests  https://review.opendev.org/67233617:43
mriedemefried: they were written independenty and artom had a bug i pointed out in his change which prompted me to write the functional test since the unit tests were just asserting the broken mock call,17:44
mriedemhe rebased on top of the functional test to assert that it would hit the issue in his patch,17:44
efriedokay17:44
mriedemregardless of his patch, i think it's a useful functional test for that init host restart code since we don't test that stuff in gate runs and unit tests for that kind of code kind of suck....17:44
mriedemas you see from the test we leak allocations and things in the nova db etc17:45
*** panda is now known as panda|off17:45
aspierskashyap: I guess you're not around?17:45
efriedmriedem: Yeah, no doubt it's a useful test, I just wasn't sure if it needed to block artom's patch, which is closer to mergeable.17:46
mriedemi have heard "oh for pete's sakes" from this old woman in a hospital waiting room at least a few times17:46
mriedemand "thank you kindly" from an old man17:46
mriedemthe muzak, it's.....killing me17:46
mriedemefried: it's not needed to block his patch, he rebased it though17:47
mriedemi'm completely innocent17:47
*** _hemna has joined #openstack-nova17:49
jamesdentonhey sean-k-mooney - if you get a chance, can you take a peek at https://bugs.launchpad.net/os-vif/+bug/1837252?17:50
openstackLaunchpad bug 1837252 in neutron "IFLA_BR_AGEING_TIME of 0 causes flooding across bridges" [Undecided,Incomplete]17:50
artomefried, yeah, I don't mind being on top, it keeps me honest17:52
efriedight, np17:52
artomefried, that being said, if we can use that as an excuse to marshal attention to mriedem's patch, I'd be cool with that ;)17:52
efriedthat has more or less happened, viz. this conversation.17:52
artom#winning17:53
sean-k-mooneyjamesdenton: yes ill take a look now just finishing a patch17:59
jamesdentongreat, thank you!17:59
sean-k-mooneyjamesdenton: as far as i am aware the aging behavior is quite old. we recently ported it to use pyroute two  to set it instead of brctl but i dont think we change the behaivor in stien18:00
sean-k-mooneythat said we can always make this configurable.18:01
sean-k-mooneyill take a look at the code and see why we orginially set this18:01
aspiershey sean-k-mooney I think found an issue18:03
jamesdentonconfigurable could be ok. creating a bridge manually with brctl results in a 300 sec aging timer. And looking at some older environments, this appears to be the case as well. thanks for looking18:04
aspierssean-k-mooney: fakelibvirt returns capabilities for other architectures like mips18:05
aspierssean-k-mooney: but your patch doesn't provide a default machine type for those18:05
aspiersso we get a few None keys in dict returned by get_domain_capabilities18:05
sean-k-mooneyjamesdenton: it looks like it was previously commented out https://github.com/openstack/os-vif/blob/stable/ocata/vif_plug_linux_bridge/linux_net.py#L13218:07
sean-k-mooneyaspiers: i know that is not an issue18:07
sean-k-mooneyi have mips installed locally18:08
sean-k-mooneyi didnt add an example for mip to force it t use the dynamic version which is used for x86_6418:08
sean-k-mooneyaspiers: we really should not be provideing default machine types in nova IMO, instead we should leave libvirt choose the defualt18:09
jamesdentonsean-k-mooney even as recently as Rocky, it looks like. undocumented comment. love it.18:10
sean-k-mooneyya so this looks like it was an unitntional change. ill see if there is a commit that warrented it.18:10
sean-k-mooneyjamesdenton: i know that shaid wanted to set it to 0 for a live migration edge cases at one point18:11
sean-k-mooneythat might be valid for ovs hybrid plug18:11
sean-k-mooneybut for linux bridge18:11
sean-k-mooneyi think we should rever back to the default18:11
jamesdentonagreed.18:12
*** factor has joined #openstack-nova18:14
jamesdentonsean-k-mooney Using common code now? See OVS https://github.com/openstack/os-vif/blob/stable/rocky/vif_plug_ovs/linux_net.py#L180 vs LXB https://github.com/openstack/os-vif/blob/stable/rocky/vif_plug_linux_bridge/linux_net.py#L14818:15
sean-k-mooneyjamesdenton: this was the patch that changed it originally https://github.com/openstack/os-vif/commit/fa4ff64b86e6e1b6399f7250eadbee9775c22d32#diff-f55bc78ffb4c10000bbf81b88bf6867318:15
*** ociuhandu has joined #openstack-nova18:16
sean-k-mooneyya we are using common code now and i did ovs first so i guess we ended up with the ovs default18:16
jamesdentonmakes sense18:16
sean-k-mooneyok ill go fix this shortly and we can get this backported18:16
jamesdentonthank you18:16
sean-k-mooneythanks for reporting it. ill update the bug18:17
jamesdentonright on18:17
aspierssean-k-mooney: which bit of libvirt provides defaults? caps or domcaps or something else?18:17
aspierssean-k-mooney: I guess /domainCapabilities/machine ?18:18
aspiersoh no, that's dependent on the API parameter18:18
*** psachin has quit IRC18:19
aspiersalthough I now remember that the CLI supported a default and the API didn't which was a bug they fixed after I reported it18:19
aspiersamazing how much I forgot in a month :-/18:19
*** amodi has quit IRC18:20
sean-k-mooneyaspiers: ya so how i have re written it we now pass none to the libvirt python bindings and libvirt interally select a machine type and we parse it from the result18:22
sean-k-mooneyaspiers: i can add mips and other example if you like18:22
*** _hemna has quit IRC18:22
sean-k-mooneyits just another contstant in the fake data file18:22
sean-k-mooneyaspiers: i personally think however that we might want to allow passing the arch and or machine type to the funtion have it lookup the value form libvirt if its not already cached18:24
sean-k-mooneybut i currently dont have a usecase where that is strictly needed18:24
sean-k-mooneywhich is why i havent changed it18:24
*** rouk has joined #openstack-nova18:26
*** igordc has joined #openstack-nova18:27
mriedemefried: i saw your questions on https://review.opendev.org/#/c/665138/18:28
mriedemi put a bunch of notes on it - i think it's correct for a narrow window, but i'd like to see a functional test as well18:28
mriedemit's basically https://review.opendev.org/#/c/641806/ but revert instead of confirm18:29
*** ociuhandu has quit IRC18:34
efriedmriedem: did you see the func test I tried to write?18:35
efriedhttps://review.opendev.org/#/c/665253/18:36
efriedwhich I suspect was totally stolen from the one you mention18:36
mriedemno i didn't18:38
mriedemmight want to compare your test to what my scenario is in the commit message on the other patch18:39
*** mriedem has quit IRC18:42
*** amodi has joined #openstack-nova18:45
aspierssean-k-mooney: I finally found it https://www.mail-archive.com/libvir-list@redhat.com/msg182746.html18:55
aspiershttps://github.com/libvirt/libvirt-python/commit/5004b4ad532ffa93ed4b62c8021eaa921085520918:55
sean-k-mooneyaspiers: ah ok so we need to libvirt-python version to be bumped to 5.318:58
aspierssean-k-mooney: http://eavesdrop.openstack.org/irclogs/%23openstack-nova/%23openstack-nova.2019-04-26.log.html#t2019-04-26T11:30:1818:58
*** cdent has quit IRC18:59
sean-k-mooneyaspiers: ya that vaguely rings a bell18:59
aspierssean-k-mooney: IIUC the workaround was to explicitly pass None to the API18:59
aspiersWe don't want to introduce a dependency on newer libvirt-python unless we really have to18:59
sean-k-mooneyif explctily passing none works then we dont need too19:00
sean-k-mooneythat is what we are doing in my current patch19:00
aspiersright19:00
aspiersbut still the nested dict gets broken19:00
*** igordc has quit IRC19:00
sean-k-mooneyhow so?19:01
sean-k-mooneyi never allow a key or value to be none in the current code19:02
aspiers'ppc': {'None': <nova.virt.libvirt.config.LibvirtConfigDomainCaps object at 0x7f243d3ec7b8>}19:02
aspiersI see entries like that in the domcaps dict19:02
aspiersusing your patch19:02
sean-k-mooneythat should not happen maybe i missed something19:02
aspiersthere is no guarantee that machine_type is not None19:02
aspierssince you removed the "or 'q35'"19:02
sean-k-mooneyi was depending on qemu not returing none19:03
sean-k-mooneywe cant just default to q35 but we can register default for as many acrhs as we care to support19:03
aspierswhere is it supposed to be getting the default from?19:03
aspiersit's currently None for mips, mipsel, and ppc19:04
*** ociuhandu has joined #openstack-nova19:04
sean-k-mooneyhttps://review.opendev.org/#/c/670189/4/nova/virt/libvirt/host.py@76319:04
sean-k-mooneywe use the value we got back from libvirt as the key19:05
aspiersback from which libvirt call?19:05
sean-k-mooneygetDomainCapabilities19:05
aspiersgetCapabilities or getDomainCapabilities?19:05
aspiersOK I'll try to track it down19:06
sean-k-mooneyso if we dont have a defualt for the arch we call getDomainCapabilities with machine_type=None19:06
aspiersright and then look at the machine type which was returned in the XML19:07
sean-k-mooneythen i added https://review.opendev.org/#/c/670189/4/nova/virt/libvirt/config.py@132 to parse the machine type and store it in the object19:07
*** factor has quit IRC19:07
sean-k-mooneyya so i was assuming that there would aways be a machine type returned in the xml19:08
aspiersI think there is19:08
*** factor has joined #openstack-nova19:08
sean-k-mooneyMaybe we are getting the default from https://review.opendev.org/#/c/670189/4/nova/virt/libvirt/config.py@12119:08
*** ociuhandu_ has joined #openstack-nova19:09
sean-k-mooneythat would cause it to be none if we did not get a machine type in the xml19:09
*** ociuhandu has quit IRC19:09
sean-k-mooneyi could just skip storing it if we get none back19:09
aspiersyeah but I'm not yet convinced that's the issue19:10
*** factor has quit IRC19:10
*** factor has joined #openstack-nova19:11
aspierssean-k-mooney: OK if I tweak your patch with a few extra comments and typo fixes?19:12
*** factor has quit IRC19:13
redkrieglyarwood: I've come across your work on rescue mode and it's exactly what I need to offer ISO based OS installs for my clients.  I see it's Abandoned for Train, but I was wondering if you knew off-hand what else needs to be done.  https://blueprints.launchpad.net/nova/+spec/virt-rescue-stable-disk-devices19:13
*** factor has joined #openstack-nova19:13
aspierssean-k-mooney: the bug is here https://review.opendev.org/#/c/670189/4/nova/tests/unit/virt/libvirt/fakelibvirt.py@136919:19
aspierse.g. for mips we don't have a default machine type, so the x86_64 template gets used with mtype: None19:20
aspiersalso, it shouldn't be using the x86_64 template for mips arch19:20
aspierssean-k-mooney: recommendations welcome on how we should fix this. Ideally I guess we would get fake domcaps for all the architectures returned by the fakelibvirt getCapabilities - currently we are missing mips/mipsel/ppc19:22
aspiersefried: do we have access to mips/mipsel/ppc boxes to grab that XML from?19:22
*** whoami-rajat has quit IRC19:22
* aspiers goes to cook dinner19:22
*** panda|off has quit IRC19:23
sean-k-mooneyaspiers: sure feel free too19:25
efriedaspiers: I sure don't. edleafe, do you know who might be able to spin up kvm on Power (or PowerKVM, or whatever tf it's called) for this purpose?19:25
*** panda has joined #openstack-nova19:25
sean-k-mooneyaspiers: efried i can just generate them locally19:25
sean-k-mooneyaspiers: efried i have the emultators installed for all of them19:26
edleafeefried: sorry, no19:27
sean-k-mooneyyou can just use the virsh cli and specify the arch and it will give you the domain caps for any emulator you have installed19:27
sean-k-mooneyaspiers: here are the xmls for the ppc/mips/mipsel http://paste.openstack.org/show/754771/19:29
*** mdbooth has joined #openstack-nova19:30
sean-k-mooneyaspiers: ah and ya the bug makes sesne gald it was just in the tests19:31
*** bbowen has quit IRC19:35
aspierssean-k-mooney: cool thanks! how did you set up the emulators?19:43
sean-k-mooneyaspiers: if you install qemu, qemu-kvm and libvirt on ubunut 18.04 it pulls in all the qemu emulators that are available by default19:45
sean-k-mooneyon fedora/centos you have to install them one by one19:46
sean-k-mooneyso in my ubunut vm i have all of them on my centos one i only have x86 and x86_6419:46
*** maciejjozefczyk has quit IRC19:52
*** factor has quit IRC19:52
*** factor has joined #openstack-nova19:53
*** factor has quit IRC19:55
*** factor has joined #openstack-nova19:55
*** factor has quit IRC19:55
*** mriedem has joined #openstack-nova20:00
*** lbragstad has quit IRC20:01
aspiersinteresting20:04
*** slaweq has quit IRC20:08
mriedemefried: i'm tickling your ksa/sdk funny bone here https://review.opendev.org/#/c/664842/7/ironic/common/nova.py@1320:19
*** _hemna has joined #openstack-nova20:19
sean-k-mooneyaspiers: looks like we have other issue too. if  manually set virt_type=kvm in the nova.conf it also breaks on archittures where its not supported20:25
sean-k-mooneyaspiers: http://paste.openstack.org/show/754776/20:31
aspierssean-k-mooney: looking20:32
*** ociuhandu_ has quit IRC20:32
aspierssean-k-mooney: BTW I've imported those domain caps you gave me20:32
*** ociuhandu has joined #openstack-nova20:33
sean-k-mooneyim in two minds if we shoudl catch the libvirt excption or not20:35
sean-k-mooneywe could just catch the invalid combination and continue with the rest20:36
mriedemdansmith: stephenfin: question on https://review.opendev.org/#/c/672065/3 but i'm not sure why the libvirt driver overhead stuff is missing from the docs like we have for hyperv and xenapi in there20:48
mriedemthat's my only hangup20:48
dansmithmriedem: because there's nothing to do I thought20:49
dansmiththe reno said "nothing to do" for libvirt I think20:49
mriedemit also said some stuff about PCPU20:49
mriedemwhich is not a thing yet20:49
mriedemi think that was when stephen had that later in the series after the PCPU stuff,20:49
mriedemnow it's moved to the front20:49
dansmith"No change is necessary as this was never accounted for properly using20:49
dansmith      the overhead model"20:49
mriedemwhere do you see that?20:50
dansmiththat was in the reno before I cut out the virt stuff20:50
dansmithwhich is why I thought having it missing from the admin docs made sense20:50
*** pcaruana has quit IRC20:50
dansmithbecause it's not per-instance unless you have dedicated CPUs, but even still, it wasn't accounted for by the overhead calcs anyway20:50
mriedemok this reno https://review.opendev.org/#/c/672065/2..3/releasenotes/notes/remove-core-ram-disk-filters-9510cbe5b4e295b6.yaml@a2120:51
dansmithyeah20:51
mriedemand the overhead isn't used here https://github.com/openstack/nova/blob/383a4cf3710b5da2fe0b580bc25783ec8fefed48/nova/compute/claims.py#L10820:53
mriedemlike for disk and ram above20:53
mriedemwtf, why was it even in the gd driver20:53
mriedemanyway, i see now20:53
*** _hemna has quit IRC20:53
openstackgerritsean mooney proposed openstack/nova master: libvirt: use domain capablites to get supported device models  https://review.opendev.org/66691520:54
openstackgerritsean mooney proposed openstack/nova master: Add transform_image_metadata request filter  https://review.opendev.org/66577520:54
*** slaweq has joined #openstack-nova20:56
*** sean-k-mooney has quit IRC21:01
*** slaweq has quit IRC21:01
*** ociuhandu has quit IRC21:02
*** bbowen has joined #openstack-nova21:03
*** lpetrut has joined #openstack-nova21:22
*** lpetrut has quit IRC21:22
*** lpetrut has joined #openstack-nova21:23
mriedemdansmith: on the claims removal one what am i not understanding here? https://review.opendev.org/#/c/551026/4//COMMIT_MSG@1621:30
*** lpetrut has quit IRC21:30
*** altlogbot_3 has quit IRC21:33
*** irclogbot_3 has quit IRC21:33
*** altlogbot_2 has joined #openstack-nova21:34
*** irclogbot_1 has joined #openstack-nova21:34
openstackgerritAdam Spiers proposed openstack/nova master: libvirt: harden Host.get_domain_capabilities()  https://review.opendev.org/67018921:35
aspiersefried: ^^^ I've beefed up the commit message so it may be slightly less impenetrable now :)21:40
efriednoted21:41
aspiersbut since this is now a joint effort between sean-k-mooney and myself, maybe it's enough to get a +1 from kashyap21:42
mriedemdustinc: efried: a few questions in the bottom sdk patch https://review.opendev.org/#/c/643664/21:45
efriedmriedem: I have just emerged from the ironic-to-novaclient rabbit hole you sent me down.21:46
mriedemhaha21:46
efriedthanks (sincerely, no sarcasm) for that.21:46
mriedemi knew it would happen21:46
efriedsee https://review.opendev.org/#/c/672369/21:47
*** takashin has joined #openstack-nova21:47
*** irclogbot_1 has quit IRC21:59
*** altlogbot_2 has quit IRC22:01
dansmithmriedem: regarding my BFV comment?22:01
mriedemyeah22:02
dansmithyes, that's obviously old from the first WIPpy version of this where I was just taking shots against the caching scheduler22:02
mriedemdustinc: efried: also some questions in the ironic driver + sdk patch https://review.opendev.org/#/c/642899/33 - looks like at least in our ci where nova-compute is started once before ironic, we now fail to start the service that first time unlike before where we'd swallow the VirtDriverNotReady error22:03
efriedmriedem: responded on https://review.opendev.org/#/c/643664/22:03
dustincmriedem: checking them out now, thanks22:03
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (13)  https://review.opendev.org/57602022:05
efriedmriedem: Note that the series forks; if you want an easy +Win, the placement one should be ready (zuul connection borkage notwithstanding) https://review.opendev.org/#/c/656023/22:05
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (14)  https://review.opendev.org/57602722:05
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (15)  https://review.opendev.org/57603122:05
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (16)  https://review.opendev.org/57629922:06
mriedemdansmith: poor caching scheduler22:06
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (17)  https://review.opendev.org/57634422:06
dansmithwe could work up a remix of the office space printer scene with the caching scheduler22:06
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (18)  https://review.opendev.org/57667322:06
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (19)  https://review.opendev.org/57667622:07
dansmithmriedem: https://imgflip.com/i/36cp5t22:07
*** adriant has quit IRC22:11
*** altlogbot_3 has joined #openstack-nova22:22
*** gyee has quit IRC22:23
*** TxGirlGeek has quit IRC22:25
*** altlogbot_3 has quit IRC22:27
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (20)  https://review.opendev.org/57668922:31
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (21)  https://review.opendev.org/57670922:31
mriedemoh dan22:32
mriedemthere are things i've hated in nova more than that22:32
redkriegmriedem: I was looking at your blueprint for improving rescue mode and it's exactly what I need to offer ISO based OS installs for my clients.  I see it's Abandoned for Train, but I was wondering if you knew off-hand what else needs to be done.  https://blueprints.launchpad.net/nova/+spec/virt-rescue-stable-disk-devices22:34
mriedemredkrieg: that's not mine22:34
mriedemit's lyarwood's i think22:34
redkriegmy apoligies, I just saw "Started by22:34
redkrieghad your name22:35
redkriegI pinged him earlier but I think he's away today22:35
mriedemhe's in....UK timezone (can't remember if he's london or dublin, i know that's a grave error if i get it wrong)22:35
mriedemdansmith: is lyarwood out this week? ^22:35
dansmithmriedem: not according to the vacay calendar22:36
mriedemok i saw that he had re-proposed the spec for train https://review.opendev.org/#/c/651151/ but then abandoned it without any comment why, so idk22:36
dansmithlyarwood is in angleand, not eye'r'land22:36
mriedembut spec freeze is thursday22:36
mriedemcan i say he's in the "british isles"?22:36
mriedemhe's in a cold dark land of boiled meats and dark brews22:37
redkriegI pinged him earlier today with a similar message, hopefully he'll see it when he gets in tomorrow.22:38
*** aarents has quit IRC22:41
openstackgerritMerged openstack/nova master: Drop delete_build_requests_with_no_instance_uuid online migration  https://review.opendev.org/65100122:43
openstackgerritMerged openstack/nova master: Handle Invalid exceptions as expected in attach_interface  https://review.opendev.org/65007722:43
openstackgerritEric Fried proposed openstack/nova master: Remove fake_libvirt_utils users in functional testing.  https://review.opendev.org/64479322:46
efriedstephenfin: I put that ^ back to PS10, which was passing tests, thereby resurrecting johnthetubaguy's +2. You were +2 at PS8; would you mind sending it? TIA.22:48
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (22)  https://review.opendev.org/57671222:49
openstackgerritMatt Riedemann proposed openstack/nova stable/stein: Handle Invalid exceptions as expected in attach_interface  https://review.opendev.org/67238422:49
*** _hemna has joined #openstack-nova22:49
*** tkajinam has joined #openstack-nova22:51
*** mriedem has quit IRC22:55
*** avolkov has quit IRC23:07
*** gyee has joined #openstack-nova23:10
*** altlogbot_3 has joined #openstack-nova23:14
*** rcernin has joined #openstack-nova23:16
*** altlogbot_3 has quit IRC23:19
openstackgerritTakashi NATSUME proposed openstack/python-novaclient master: Deprecate the '--config-drive' option  https://review.opendev.org/65368323:23
openstackgerritTakashi NATSUME proposed openstack/nova master: Add database schema upgrade check  https://review.opendev.org/66704723:24
*** _hemna has quit IRC23:24
*** altlogbot_1 has joined #openstack-nova23:28
*** irclogbot_1 has joined #openstack-nova23:32
*** igordc has joined #openstack-nova23:35
openstackgerritMerged openstack/nova master: Remove deprecated Core/Ram/DiskFilter  https://review.opendev.org/67206523:36
*** kodama_ has joined #openstack-nova23:55

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!