Thursday, 2021-03-11

*** k_mouza has quit IRC00:03
*** tosky has quit IRC00:26
*** LinPeiWen has joined #openstack-nova00:50
*** mlavalle has quit IRC01:00
*** LinPeiWen has quit IRC01:09
*** jamesdenton has quit IRC01:26
*** jamesden_ has joined #openstack-nova01:27
*** swp20 has quit IRC01:30
*** ociuhandu has joined #openstack-nova01:45
*** ociuhandu has quit IRC01:50
*** rcernin has quit IRC02:01
*** macz_ has quit IRC02:02
*** spatel_ has joined #openstack-nova02:03
*** rcernin has joined #openstack-nova02:05
*** alex_xu has quit IRC02:36
*** rcernin has quit IRC02:39
*** rcernin has joined #openstack-nova02:42
*** macz_ has joined #openstack-nova02:49
*** rcernin has quit IRC02:51
*** macz_ has quit IRC02:54
*** zzzeek has quit IRC02:55
*** zzzeek has joined #openstack-nova02:56
*** rcernin has joined #openstack-nova03:05
*** rcernin has quit IRC03:12
*** zzzeek has quit IRC03:15
*** zzzeek has joined #openstack-nova03:20
*** rcernin has joined #openstack-nova03:23
*** rcernin has quit IRC03:24
*** rcernin has joined #openstack-nova03:24
*** openstackgerrit has quit IRC03:25
*** zzzeek has quit IRC03:48
*** zzzeek has joined #openstack-nova03:51
*** spatel_ has quit IRC03:53
*** LinPeiWen89 has joined #openstack-nova04:23
*** openstackgerrit has joined #openstack-nova04:31
openstackgerritmelanie witt proposed openstack/nova master: Dynamically archive FK related records in archive_deleted_rows  https://review.opendev.org/c/openstack/nova/+/77383404:31
*** jamesden_ has quit IRC04:36
*** jamesdenton has joined #openstack-nova04:37
*** ociuhandu has joined #openstack-nova05:22
*** ociuhandu has quit IRC05:26
openstackgerritMerged openstack/nova master: libvirt: Deprecate disable_native_luksv1 and rbd_volume_local_attach  https://review.opendev.org/c/openstack/nova/+/77800405:37
*** gyee has quit IRC05:52
openstackgerritMerged openstack/nova master: Follow up for QoS interface attach  https://review.opendev.org/c/openstack/nova/+/77711205:54
*** jamesdenton has quit IRC06:21
*** jamesden_ has joined #openstack-nova06:22
openstackgerritMerged openstack/nova master: setup.cfg: Resolve warning  https://review.opendev.org/c/openstack/nova/+/77944906:42
*** ralonsoh has joined #openstack-nova06:51
openstackgerritMerged openstack/nova master: Make nova-ceph-multistore use policy.yaml  https://review.opendev.org/c/openstack/nova/+/77981506:57
*** ociuhandu has joined #openstack-nova07:02
*** ociuhandu has quit IRC07:06
*** ociuhandu has joined #openstack-nova07:08
*** ociuhandu has quit IRC07:12
*** slaweq has joined #openstack-nova07:13
*** khomesh24 has joined #openstack-nova07:31
*** khomesh24 has quit IRC07:32
*** khomesh24 has joined #openstack-nova07:36
*** rcernin has quit IRC07:40
*** lpetrut has joined #openstack-nova07:41
*** LinPeiWen89 has quit IRC07:43
openstackgerritYongli He proposed openstack/nova master: smartnic support - reject server move and suspend  https://review.opendev.org/c/openstack/nova/+/77991307:46
*** david-lyle has joined #openstack-nova07:47
*** rcernin has joined #openstack-nova07:47
*** dklyle has quit IRC07:49
openstackgerritYongli He proposed openstack/nova master: smartnic support - reject server move and suspend  https://review.opendev.org/c/openstack/nova/+/77991307:50
openstackgerritYongli He proposed openstack/nova master: smartnic support - reject server move and suspend  https://review.opendev.org/c/openstack/nova/+/77991307:52
*** links has joined #openstack-nova07:55
*** belmoreira has joined #openstack-nova08:04
yonglihesean-k-mooney:  alex_xu: could you please remove  that -1 (base on discuss with alex):  https://review.opendev.org/c/openstack/nova/+/77136308:05
*** rcernin has quit IRC08:06
*** aarents has joined #openstack-nova08:07
*** dklyle_ has joined #openstack-nova08:08
*** david-lyle has quit IRC08:10
*** ociuhandu has joined #openstack-nova08:11
*** ociuhandu has quit IRC08:11
*** tesseract has joined #openstack-nova08:12
*** rcernin has joined #openstack-nova08:17
*** alex_xu has joined #openstack-nova08:18
gibiyonglihe: hi, sorry I was not able to get back to the smartnic patches yesterday08:20
*** andrewbonney has joined #openstack-nova08:24
yonglihegibi: got, busy day.08:26
gibiyonglihe: I see -1s on https://review.opendev.org/c/openstack/nova/+/771363/12 does the problem resolved?08:26
yongliheI post another patch to fix alex coments.08:27
yongliheand there are one unit test case will posted soon.08:27
gibiOK08:28
*** tosky has joined #openstack-nova08:33
*** ociuhandu has joined #openstack-nova08:38
*** ociuhandu has quit IRC08:42
*** jamesden_ has quit IRC08:44
openstackgerritYongli He proposed openstack/nova master: smartnic support - new vnic type  https://review.opendev.org/c/openstack/nova/+/77136308:45
openstackgerritYongli He proposed openstack/nova master: smartnic support  https://review.opendev.org/c/openstack/nova/+/75894408:45
openstackgerritYongli He proposed openstack/nova master: smartnic support - reject server move and suspend  https://review.opendev.org/c/openstack/nova/+/77991308:45
*** jamesdenton has joined #openstack-nova08:46
*** xinranwang has joined #openstack-nova08:47
yonglihegibi  alex_xu,  sean-k-mooney,  xinranwang: test cases added.08:48
yonglihegibi: all the problem resolved, https://review.opendev.org/c/openstack/nova/+/771363/1308:51
gibireading it ...08:51
*** tosky_ has joined #openstack-nova08:52
*** tosky is now known as Guest8681408:53
*** tosky_ is now known as tosky08:53
*** Guest86814 has quit IRC08:55
*** ociuhandu has joined #openstack-nova08:57
*** rcernin has quit IRC09:01
*** lucasagomes has joined #openstack-nova09:06
*** derekh has joined #openstack-nova09:15
*** rcernin has joined #openstack-nova09:28
openstackgerritLee Yarwood proposed openstack/nova master: docs: Add note about rescuing bfv instances with the 2.87 microversion  https://review.opendev.org/c/openstack/nova/+/77947909:42
lyarwoodwhops09:43
*** zzzeek has quit IRC09:43
*** zzzeek has joined #openstack-nova09:46
lyarwoodType 'yes' to confirm, other to cancel: yes09:47
lyarwoodAborting.09:47
openstackgerritLee Yarwood proposed openstack/nova master: docs: Add note about rescuing bfv instances with the 2.87 microversion  https://review.opendev.org/c/openstack/nova/+/77947909:47
lyarwood>.< git-review WHY DO YOU HATE ME?!09:47
*** rcernin has quit IRC09:47
bauzasfolks, I'll resume reviewing the uefi secure boot series starting with https://review.opendev.org/c/openstack/nova/+/779302/209:48
bauzasstephenfin: lyarwood: gibi: ^09:48
stephenfinta09:48
gibiack09:49
stephenfinlyarwood: You can probably bump your +1 to +2 on this now? https://review.opendev.org/c/openstack/nova/+/779303/09:50
stephenfinIt failed, but not for related reasons09:50
openstackgerritStephen Finucane proposed openstack/nova master: objects: Add 'VDPA' to 'PciDeviceType'  https://review.opendev.org/c/openstack/nova/+/77748109:51
openstackgerritStephen Finucane proposed openstack/nova master: libvirt: Move PCI host device parsing to 'host'  https://review.opendev.org/c/openstack/nova/+/77985109:51
openstackgerritStephen Finucane proposed openstack/nova master: libvirt: Add vDPA nodedev parsing  https://review.opendev.org/c/openstack/nova/+/77053309:51
openstackgerritStephen Finucane proposed openstack/nova master: libvirt: Add guest generation for vDPA  https://review.opendev.org/c/openstack/nova/+/77053209:51
openstackgerritStephen Finucane proposed openstack/nova master: pci: Add vDPA vnic to PCI request mapping and filtering  https://review.opendev.org/c/openstack/nova/+/77835009:51
openstackgerritStephen Finucane proposed openstack/nova master: add hw:mlock extra spec  https://review.opendev.org/c/openstack/nova/+/77834709:51
lyarwoodstephenfin: ack yeah sorry will do09:51
stephenfinkashyap: Can you revisit https://review.opendev.org/c/openstack/nova/+/776681/6/nova/virt/libvirt/driver.py#5917 and see if you're happy with my response RE: the 'optional' secure boot policy?09:52
kashyapstephenfin: Morning, will do09:52
kashyapstephenfin: Yeah, that response is fair enough.  We expect people to read the docs.  We can't put a guard against every potential foot-gun09:55
stephenfinyup, exactly10:00
kashyapstephenfin: Also, I like the clean test in test_driver.py; thakns!10:00
stephenfinI plan to resolve the nvram issue as a bug after feature freeze10:00
* lyarwood steals foot-gun for future use10:00
kashyapstephenfin: Right; that's fine10:01
stephenfinthe series is already too big to bring that in, IMO10:01
kashyapAgree10:01
*** ociuhandu has quit IRC10:01
*** ociuhandu has joined #openstack-nova10:02
kashyapAnd it's a more time-taking one anyway; we shouldn't block on it for now.10:02
* stephenfin has to go to Limerick for house stuff and will be back after lunch o/10:04
*** rcernin has joined #openstack-nova10:04
kashyapDon't know where you are at this moment :-)10:05
*** zzzeek has quit IRC10:11
*** ociuhandu has quit IRC10:11
*** tesseract has quit IRC10:14
*** zzzeek has joined #openstack-nova10:15
bauzasstephenfin: slight -1 for https://review.opendev.org/c/openstack/nova/+/77930210:16
*** ociuhandu has joined #openstack-nova10:16
bauzasI need to get my daughters from the school but please reply10:16
bauzasand then I'll look later10:16
*** dtantsur|afk is now known as dtantsur10:17
*** tesseract has joined #openstack-nova10:17
*** rcernin has quit IRC10:20
*** ociuhandu has quit IRC10:25
*** k_mouza has joined #openstack-nova10:26
*** LinPeiWen has joined #openstack-nova10:27
*** k_mouza has quit IRC10:31
*** jangutter_ has quit IRC10:41
*** jangutter has joined #openstack-nova10:42
*** ociuhandu has joined #openstack-nova10:46
artomstephenfin, gibi, with sean-k-mooney's port NUMA affinity patch on top of my socket stuff, we found an issue with PCI devices that have parents10:57
lyarwoodbauzas: stephenfin just stepped out but I replied in that change, I'm not sure what you're suggesting tbh.10:58
artomBecause I was setting 'socket' *on* the pool, it b0rked comparison for parent PFs. I've had to fix and push again: https://review.opendev.org/c/openstack/nova/+/77277910:58
sean-k-mooneythe fix artom did was to get teh list of numa node related to the sockets the guest is on and then require the pool be in one of those numa nodes11:00
artomYep - that way, nothing is being set on the pool, no side effect surprises11:01
artomIt's not a radical departure from what was there before :)11:01
*** zzzeek has quit IRC11:03
sean-k-mooneyhehe its litrally https://review.opendev.org/c/openstack/nova/+/772779/17..18/nova/pci/stats.py11:05
sean-k-mooneyso ya +9-14 lines11:05
*** rcernin has joined #openstack-nova11:07
*** jangutter has quit IRC11:07
lyarwoodgibi: https://review.opendev.org/c/openstack/nova/+/735947 - btw I -1'd this earlier, more for my own education and understanding as the code LGTM but the commit wasn't clear on the reasoning for this.11:07
*** jangutter has joined #openstack-nova11:07
*** zzzeek has joined #openstack-nova11:08
gibiartom: ack, looks good to me11:09
gibilyarwood: I have to get back to that11:10
*** k_mouza has joined #openstack-nova11:11
artomgibi, mcuh thanks!11:12
sean-k-mooneyoff the top of my head i dont rememebr all the detail but the highlevle reasoning is that hyperthreading affect the entire host ans sicne cpu are part of the unname greoup these should also be. it would be invalid today to have 2 named groups one that requested HT on and the other HT off for the same host11:12
openstackgerritMerged openstack/nova master: apidb: Compact Rocky database migrations  https://review.opendev.org/c/openstack/nova/+/75940511:12
sean-k-mooneyi rememebr suggesting that we shoudl perhaps only ally HW_CPU_* in general in the unamed group becasue at the time i did not think there was ever a valid usecase for varing them in depently in the named groups11:13
sean-k-mooneylyarwood:^11:13
sean-k-mooneyhttps://review.opendev.org/c/openstack/nova/+/735947/5/nova/api/validation/extra_specs/traits.py#2611:15
*** jawad_axd has joined #openstack-nova11:17
*** k_mouza has quit IRC11:18
*** k_mouza has joined #openstack-nova11:18
*** k-s-dean has joined #openstack-nova11:19
gibiI think I agree with sean-k-mooney here11:21
sean-k-mooneylyarwood: actully i remember more of the context now filling it in to the patch11:21
lyarwoodk thanks I also need to drop in a min to pick up some new glasses, I'll get back to the review this afternoon11:25
sean-k-mooneylyarwood: https://review.opendev.org/c/openstack/nova/+/735947/5//COMMIT_MSG#1311:26
*** sapd1 has joined #openstack-nova11:41
*** jangutter has quit IRC11:42
*** jangutter has joined #openstack-nova11:42
*** ociuhandu has quit IRC11:51
*** rcernin has quit IRC11:58
*** jangutter_ has joined #openstack-nova11:59
*** jangutter has quit IRC12:02
*** macz_ has joined #openstack-nova12:06
*** macz_ has quit IRC12:11
*** jamesdenton has quit IRC12:13
*** jamesdenton has joined #openstack-nova12:14
*** rcernin has joined #openstack-nova12:23
*** emmadavis has joined #openstack-nova12:25
*** emmadavis has quit IRC12:28
*** emmadavis has joined #openstack-nova12:28
*** rcernin has quit IRC12:29
*** rcernin has joined #openstack-nova12:41
*** rcernin has quit IRC12:46
*** rcernin has joined #openstack-nova12:52
*** mdbooth has joined #openstack-nova12:53
*** rcernin has quit IRC12:57
*** rcernin has joined #openstack-nova12:58
*** openstack has joined #openstack-nova13:17
*** ChanServ sets mode: +o openstack13:17
*** bbowen has joined #openstack-nova13:31
*** __ministry1 has joined #openstack-nova13:41
*** dklyle_ has quit IRC13:43
*** ociuhandu has joined #openstack-nova13:44
*** jangutter has joined #openstack-nova13:45
*** jangutter_ has quit IRC13:48
*** mjturek has joined #openstack-nova13:54
*** sapd1 has joined #openstack-nova14:00
gibiyonglihe: finshed reading the main smartnic patch I still have issues. Also I think you missed my earlier request to add a set of functional tests14:01
gibialex_xu: ^^ fyi14:09
gibiis there any patch that needs my immediate attention?14:20
stephenfinsean-k-mooney: question: is this change necessary? https://review.opendev.org/c/openstack/nova/+/770533/10/nova/virt/libvirt/host.py#126214:22
stephenfinI can't figure out what uses it? I don't think we ever finished the NIC capability feature and that's the only thing that code was used for previously14:23
sean-k-mooneythe elif?14:23
sean-k-mooneyyes the elif is14:23
stephenfinadding the 'vdpa' field to the 'capabilities'14:23
stephenfindic14:23
stephenfin*dict14:23
sean-k-mooneyits used to get the path to add to the xml14:24
stephenfinwhich will be saved in the 'extra_info' field of the 'PciDevice' table14:24
stephenfinI don't think it is14:25
stephenfinhttps://review.opendev.org/c/openstack/nova/+/770532/10/nova/virt/libvirt/vif.py#50114:25
sean-k-mooneywhen generating the xml for the interface we add the vdpa path not the pci addres or the parent14:25
stephenfinthat's calling the 'get_vdpa_device_path'14:25
stephenfinwhich is pretty self-contained and inspect the XML from libvirt directly https://review.opendev.org/c/openstack/nova/+/770533/10/nova/virt/libvirt/host.py#133314:25
sean-k-mooneyach right14:26
stephenfinso is that something you forgot to cleanup?14:26
sean-k-mooneyboth will work14:26
stephenfinpersonally, I'd rather we didn't have to pass through an instance of 'Host'14:26
stephenfinif that's an option14:26
sean-k-mooneywe do not have the pci request here14:27
sean-k-mooneyso we cant get if form the db like i planned orginally14:27
sean-k-mooneythats why im looking it up i think14:27
sean-k-mooneyi will need to look at this in context again sorry14:28
stephenfinokay14:28
stephenfinI'll play around with it a little more, see if I can make sense of it :)14:28
*** jangutter_ has joined #openstack-nova14:29
sean-k-mooneyso we dont have the pci devices form the db in the virt driver14:30
sean-k-mooneyand at present we do not have the mapping form the neutorn port to the pci request ourside of the network_request object14:30
sean-k-mooneyso to remove passing in host we would have to pass in the network requiest to lookup the requite id then do a db lookup14:31
sean-k-mooneythat would be much more expensive14:31
stephenfincan we pass information through as part of the binding profile, like we do for SR-IOV?14:31
sean-k-mooneyi personally have been using the vdpa path in the pci_devices table to debug this and ensure the xml is useing the correct path for the device tha was saved14:31
sean-k-mooneystephenfin: i really dont want to do that14:32
sean-k-mooneybecause i want to stop using the binding procile for the xml generation entirely soon14:32
gibisomebody opened ~80 new bugs to nova based on fault injection. e.g. https://bugs.launchpad.net/nova/+bug/191834014:32
openstackLaunchpad bug 1918340 in OpenStack Compute (nova) "Fault Injection #1 - improve unit test effectiveness" [Undecided,New]14:32
stephenfine.g. https://github.com/openstack/nova/blob/master/nova/virt/libvirt/vif.py#L242-L24614:32
*** jangutter has quit IRC14:32
sean-k-mooneyclose them all with we do not consider bugs cause by falut injectoin to be valid?14:32
sean-k-mooneystephenfin: ya i want to remove that use of the profile14:33
stephenfinsean-k-mooney: could we do that wholesale though?14:33
sean-k-mooneywe never should have done that in the first place it was a hack14:33
stephenfinI'm sure there's a good reason not to do it, but it's a bit weird having two different ways to do things now14:33
sean-k-mooneyright now im using that14:34
sean-k-mooneyto get the pci addres of the parent vf14:34
sean-k-mooneybut in the futre i want to store this info in our own data stucure in nova db somewhere14:34
sean-k-mooneyand pass it in to build/attach ectra14:35
yonglihegibi,  then i got work to do. -:)14:35
sean-k-mooneystephenfin: by the way im currently writing two patches. one to block booting vms with ports of type vdpa until its supproted and a second to block unsupported operations in general14:47
sean-k-mooneysimilar to how we block api calls with cyborg if they are not supported yet with a 403.14:47
stephenfinmakes sense14:49
*** k_mouza_ has joined #openstack-nova14:50
*** k_mouza has quit IRC14:54
kashyapstephenfin: For later, you might also find this useful to know about: https://github.com/rhuefi/qemu-ovmf-secureboot14:59
*** rcernin has joined #openstack-nova14:59
kashyap(Fedora and other distros already ship a variant of this tool we wrote in the past.)14:59
*** derekh has quit IRC15:01
*** derekh has joined #openstack-nova15:01
*** derekh has quit IRC15:02
*** rcernin has quit IRC15:04
*** efried has quit IRC15:07
*** derekh has joined #openstack-nova15:08
*** efried has joined #openstack-nova15:08
*** spotz has joined #openstack-nova15:10
*** k_mouza_ has quit IRC15:15
*** k_mouza has joined #openstack-nova15:15
openstackgerritStephen Finucane proposed openstack/nova master: tests: Add functional tests for UEFI, secure boot  https://review.opendev.org/c/openstack/nova/+/77668215:16
openstackgerritStephen Finucane proposed openstack/nova master: tests: Remove duplicated 'start_compute' helper  https://review.opendev.org/c/openstack/nova/+/77668315:16
openstackgerritStephen Finucane proposed openstack/nova master: docs: Document UEFI secure boot feature  https://review.opendev.org/c/openstack/nova/+/77668415:16
stephenfinlyarwood: removed that unnecessary ADMIN_API from the functional test ^15:16
*** ociuhandu has quit IRC15:16
*** ociuhandu has joined #openstack-nova15:17
openstackgerritLee Yarwood proposed openstack/nova stable/train: compute: Lock by instance.uuid lock during swap_volume  https://review.opendev.org/c/openstack/nova/+/75873315:17
openstackgerritLee Yarwood proposed openstack/nova stable/train: [stable-only] gate: Skip ceph tests after plugin moved to Octopus release  https://review.opendev.org/c/openstack/nova/+/78001415:17
lyarwoodelod / melwitt ; ^ fun times with ceph on stable/train btw15:17
lyarwoodstephenfin: ack thanks15:17
sean-k-mooneylyarwood: you could pin the plugin to an older commit no?15:21
*** ociuhandu has quit IRC15:22
sean-k-mooneylyarwood: you just do https://github.com/SeanMooney/ci-sean-mooney/blob/main/zuul.d/jobs.yaml#L3615:22
sean-k-mooney    required-projects:15:22
sean-k-mooney      - name: openstack/devstack15:22
sean-k-mooney        override-checkout: master15:22
sean-k-mooneybut in this case override the ceph plugin15:22
sean-k-mooneyso you can continue to deploy what ever it had before15:23
*** tobias-urdin has joined #openstack-nova15:23
elodlyarwood: yikes. thanks for looking it and fixing! is this blocking train and older branches?15:23
lyarwoodyeah the issue is these jobs aren't zuul native on stable/train and manually check out the plugin15:23
lyarwoodelod: I assume <=stable/train with the nova-live-migration failures15:24
lyarwoodelod: given grenade isn't running prior to stable/train right?15:24
lyarwoodsean-k-mooney: that's a neat hack btw, I wansn't aware of it.15:25
lyarwoodsean-k-mooney: we could limit the checkout in the hook script to a known good commit to keep ceph coverage I guess15:25
sean-k-mooneywe use it in a number of places for stable branches15:25
sean-k-mooneylyarwood: tempest is one case sicne it branchless15:25
* lyarwood adds a note15:26
sean-k-mooneylyarwood: but yes pinning to a know good commit or actully taging it and pinnging to that tag would proably be the way to go15:26
sean-k-mooneyif it was zuul native i think that can be anything that is vaild for a git checkout command15:27
sean-k-mooneyso commit tag or branch15:27
lyarwoodright, let me do it that way actually so we don't drop coverage15:27
*** ociuhandu has joined #openstack-nova15:28
sean-k-mooneywhere is the job defiend15:28
sean-k-mooneythe enable plugin line optionally takes a git ref15:28
sean-k-mooneywhich is the branch/tag/commit to use15:28
*** lpetrut has quit IRC15:29
sean-k-mooneyyou can do it trivally in the lcoal.conf if you can change the enable_plugin line15:29
*** spatel_ has joined #openstack-nova15:29
*** jmlowe has quit IRC15:30
sean-k-mooneyoh ... https://github.com/openstack/nova/blob/stable/train/gate/live_migration/hooks/ceph.sh#L1315:30
lyarwoodyeah there15:30
sean-k-mooneywhy were we ever doing that15:30
lyarwoodlike I said, tis fun15:30
lyarwoodnot my code ./me runs15:30
lyarwoodand it's pre-zuul15:30
sean-k-mooneyright but even pre-zuul this was wrong15:30
lyarwoodI'm being an idiot, I can just export CEPH_RELEASE15:33
sean-k-mooneyah the plugin supprot that as a configurable15:33
sean-k-mooneyyou could add --branch to the git clone too15:33
*** jmlowe has joined #openstack-nova15:34
*** ociuhandu has quit IRC15:34
lyarwoodsean-k-mooney: the plugin is branchless15:35
sean-k-mooneyya but i tought that worked with commit too15:35
sean-k-mooneyit does not15:36
sean-k-mooneyi was expecting use to be using it like this15:39
openstackgerritLee Yarwood proposed openstack/nova stable/train: [stable-only] gate: Pin CEPH_RELEASE to nautilus in LM hook  https://review.opendev.org/c/openstack/nova/+/78001415:40
openstackgerritLee Yarwood proposed openstack/nova stable/train: compute: Lock by instance.uuid lock during swap_volume  https://review.opendev.org/c/openstack/nova/+/75873315:40
sean-k-mooneyexport DEVSTACK_LOCAL_CONFIG="enable_plugin devstack-plugin-ceph https://opendev.org/openstack/devstack-plugin-ceph <git commit>"15:40
sean-k-mooneylike this https://docs.openstack.org/devstack/latest/plugins.html#legacy-project-config-jobs15:41
kashyapstephenfin: What is "rubric" in rST lingo?  (I know the English word itself, but first time I see in rST)15:41
kashyapstephenfin: My guess is: "Heading"15:41
stephenfinYeah, it's a heading that doesn't affect the structure of the document15:41
kashyap"Under the rubric of Y"15:41
kashyapRight; thx15:42
stephenfinSo it won't appear in a table of contents15:42
kashyapstephenfin: Nice; I bow to your rST wisdom15:42
sean-k-mooneyist that what cascade list use internally15:42
sean-k-mooneyi always  hade when heading are not linkable in our docs15:42
sean-k-mooney*hate15:42
stephenfincascade list?15:43
gibinova meeting will start in 16 minutes on #openstack-meeting-315:43
sean-k-mooneystephenfin: what we sue here https://raw.githubusercontent.com/openstack/nova/master/doc/source/user/flavors.rst15:44
sean-k-mooneyfor the titles15:44
stephenfinoh, definition lists15:44
sean-k-mooneyyep those15:44
stephenfinno, similar but different15:44
stephenfinrubric is it's own thing15:45
sean-k-mooneyah ok15:45
stephenfinsimilar to an aside (warning, tip, information, ...)15:45
sean-k-mooneycan we make definiton lists linkable by the way15:46
sean-k-mooneye.g. with a css selector15:46
kashyapstephenfin: Thx also for cleaning up the Hyper-V docs, and as is your wont, general "docs excellency".  Added my +1, FWIW.15:46
sean-k-mooneythe curent issue is while the definitoin list title elemnt is sepreate it does not have an id15:47
*** dklyle has joined #openstack-nova15:47
sean-k-mooneyso you cant do http://.../#id-of-list-item-title15:47
bauzasgibi: I'll have to bail out from the nova meeting after 10 mins #curfew15:47
bauzasgibi: no stories to tell from the libvirt subteam15:48
*** ociuhandu has joined #openstack-nova15:48
stephenfinsean-k-mooney: I'm not sure off the top of my head, tbh15:48
sean-k-mooneyi think i asked you before and you said no15:49
stephenfinI don't see any href on any of the definitions in the policy doc so I don't think Sphinx does it natively15:49
stephenfinhttps://docs.openstack.org/nova/latest/configuration/policy.html15:49
sean-k-mooneystephenfin: they should not be hrefs15:49
stephenfinsorry, ids15:49
sean-k-mooneyright so nova has one https://docs.openstack.org/nova/latest/configuration/policy.html#nova15:50
sean-k-mooneybut none of the other items15:50
stephenfinwhereas we do have them for the config doc https://docs.openstack.org/nova/latest/configuration/config.html15:50
sean-k-mooneyyep we dont use definition list there i think15:50
stephenfinthat's because 'oslo_policy.sphinxext' uses a custom domain, which means you can index them15:50
sean-k-mooneywe generate that form code15:50
stephenfinsorry, 'oslo_config.sphinxext'15:50
sean-k-mooneyyep15:50
stephenfinwhereas 'oslo_policy.sphinxext' is just using definition lits15:51
stephenfinlists15:51
stephenfinwe could improve that, of course15:51
stephenfinI just haven't gotten to do it yet15:51
gibibauzas: ack15:51
gibibauzas: thanks15:51
sean-k-mooneystephenfin: ya its more of a minor annowyance but it also affect ones we write by hand15:51
*** jangutter has joined #openstack-nova15:52
sean-k-mooneyalthoguh when writing them by hand we can just add anchors to fix it15:52
sean-k-mooneywhich we do in thing like the schduler doc if i remeber correctly15:52
sean-k-mooneyoh we dont15:53
sean-k-mooneyit has the same issue15:53
stephenfinI have a huge doc rework to fix that15:54
sean-k-mooneyanyway not importnat right now just annoying ux15:54
stephenfinI'll get people to take a look after feature freeze15:54
bauzasstephenfin: the os secure boot eventually got my approval till the func test15:54
bauzasstephenfin: waiting for gerrit to tell me about the func test15:54
bauzasstephenfin: but I guess you got no issues locally, right?15:54
*** jangutter_ has quit IRC15:54
stephenfinI tested before I pushed. Works as expected, if that helps15:55
stephenfinand it won't merge if the CI isn't happy even with +W15:55
stephenfinas we're seeing :'(15:55
*** ociuhandu has quit IRC15:57
*** ociuhandu has joined #openstack-nova15:57
*** __ministry1 has quit IRC15:58
artomstephenfin, hey, so turns out with sean-k-mooney's port affinity patch on top of mine, we discovered an issue with devices that have parents15:59
artomI was setting pool['socket'], and that cause bad side effects when doing pool comparisons later on15:59
artomSo I had to respin and kick it out of the gate16:00
*** macz_ has joined #openstack-nova16:00
*** macz_ has quit IRC16:01
gibiand I'm already +2 :)16:01
*** macz_ has joined #openstack-nova16:01
bauzasdansmith: I haven't forgotten the rpc changes but reviews day hell here16:25
bauzastomorrow, that's better.16:25
* bauzas jumps off before the shops close in 30 mins16:25
*** prometheanfire has joined #openstack-nova16:34
*** jangutter_ has joined #openstack-nova16:37
*** jangutter has quit IRC16:40
dansmithbauzas:ack16:40
dansmithsean-k-mooney: you just too good for the nova meeting these days?16:41
sean-k-mooneysorry forgot it was time for it joining16:41
dansmithsean-k-mooney: so I asked a question there expecting maybe a response from you and realized you weren't around16:42
sean-k-mooneydansmith: ah its just over16:42
dansmithsean-k-mooney: related to the glance metadef api,16:42
dansmithyou probably saw the OSSN and query about getting ops feedback16:42
dansmithbut I (and stephenfin) thought you might be  aware of how this is used16:42
sean-k-mooneythe metadef api16:43
dansmithI think horizon uses it to present templates of nova metadata you can apply to things in some way16:43
sean-k-mooneyits use by heat i belive and yest its used by horizon16:43
dansmithbut it's not clear to me if that's like really useful, widely-used, etc16:43
sean-k-mooneyto generate the view that is ues to add flaovr extra specs and image poeprtyes16:43
dansmithokay, does it allow you to create those things or just use it to show?16:44
sean-k-mooneyyou can create them too16:44
sean-k-mooneyi belive that is admin only16:44
dansmithit's not16:44
dansmithat least on the glance side16:44
sean-k-mooneyreally16:44
dansmithit's also not properly isolated,16:44
sean-k-mooneywell its not ment ot be per tenant16:45
sean-k-mooneyits ment to be a global registry16:45
dansmithwhich means you can use (apparently horizon) to poke and see if other tenants have things defined16:45
sean-k-mooneyright but this was not ment to be per tenant16:45
dansmithsean-k-mooney: it's completely wide open by default16:45
sean-k-mooneyok so the issue there is that writing to it is allowd16:46
sean-k-mooneyreading form it by default is fien for everyone16:46
dansmithsean-k-mooney: also, it is clearly tenantified a little bit, just not well16:46
sean-k-mooneyis see i was not aware of that16:46
dansmithsean-k-mooney: so tenants can create things that aren't shown to other tenants, but if you know the name, you can see it16:46
sean-k-mooneyah i see16:46
sean-k-mooneyi did not see the OSSN for this by the way16:47
sean-k-mooneyso didnt know that context16:47
dansmithit seems to be that namespace is the thing that is tied to the tenant,16:47
dansmithand you create things tied to that namespace that are private to you, but if someone knows the name (or happens to pick the same one you did) then ... oopsie, here's their data16:47
dansmithexposure seems limited to just names, which may be harmless, but may have customer names or infrastructure details of course16:48
dansmithand the other issue is that open by default, with no creation controls, you can fill the database for fun and profit :)16:48
sean-k-mooneyya so what the api was intended for was to provide a central regeistry for all falovr extra specs, image proertes, host aggreate and volumen metadata key and the allows values16:49
dansmithseems odd to put that in glance, but I understand now that's the goal, at least16:50
sean-k-mooneybasically it was created as a programatic way to document and encode the value values for all the tunables user and operations might use when creating image/flavor/aggreates and volumnes16:50
sean-k-mooneywell it was adding very early on16:51
dansmithyeah, so there have been contributions to the metadefs since the original thing, presumably because someone wants something to show up in horizon16:51
sean-k-mooneywell before we added stephenfin  flavor validation stuff i was pushing for use to keep it in sysnc to defien the falvor extra specs16:51
*** belmoreira has quit IRC16:53
*** khomesh24 has quit IRC16:54
gibistephenfin: will you look at the two artom's and sean-k-mooney's numa policy patches as second core?16:59
stephenfinyup, on it16:59
*** rcernin has joined #openstack-nova17:00
gibithanks17:00
*** lucasagomes has quit IRC17:00
*** mlavalle has joined #openstack-nova17:02
*** belmoreira has joined #openstack-nova17:06
*** bbowen has quit IRC17:07
*** tesseract has quit IRC17:07
*** fnordahl has joined #openstack-nova17:11
*** jamesdenton has quit IRC17:16
*** jamesdenton has joined #openstack-nova17:16
*** rcernin has quit IRC17:16
stephenfingibi: done on both17:24
gibistephenfin: any issue?17:24
stephenfinNope. Good catch on the socket policy though17:24
gibireno fix can land after FF so I'm not worrying about it17:25
stephenfinyup, agreed17:25
gibilyarwood, bauzas, dansmith: we need a second core for an easy refactor patch https://review.opendev.org/c/openstack/nova/+/779851 the rest of the series is reviewd by stephen but his patch is stephen's so we need somebody else to get vdpa to land17:26
gibistephenfin: thanks17:26
lyarwoodlooking17:26
*** jangutter has joined #openstack-nova17:26
gibilyarwood: thanks17:27
*** jangutter_ has quit IRC17:30
lyarwoodgibi: done17:31
gibilyarwood: thanks17:33
*** gyee has joined #openstack-nova17:35
* lyarwood calls it a day \o17:40
gibilyarwood: o/17:48
*** jangutter_ has joined #openstack-nova17:53
*** jangutter has quit IRC17:57
*** derekh has quit IRC18:01
*** andrewbonney has quit IRC18:12
*** mlavalle has quit IRC18:23
*** mlavalle has joined #openstack-nova18:24
*** ociuhandu has quit IRC18:32
*** k_mouza has quit IRC18:33
*** k_mouza has joined #openstack-nova18:37
*** mlavalle has quit IRC18:38
*** dtantsur is now known as dtantsur|afk18:39
*** sapd1 has quit IRC18:43
*** ralonsoh has quit IRC18:48
*** k_mouza has quit IRC18:53
openstackgerritsean mooney proposed openstack/nova master: block vm boot with vdpa ports  https://review.opendev.org/c/openstack/nova/+/78006519:00
*** hamalq has joined #openstack-nova19:01
*** _gryf has joined #openstack-nova19:01
sean-k-mooneyFYI that is only needed if we dont merge the VDPA inital boot support to ensure that even though neutron support the vdpa type we do not try to boot with it until we do19:03
gibisean-k-mooney: I'm reading vdpa right now19:04
gibisean-k-mooney: I have a question19:04
sean-k-mooneyask away19:05
gibisean-k-mooney: do we need to make the VDPA devs unavaible when the related PF is become allocated?19:05
gibis/is become/becomes19:05
sean-k-mooneyyes we should19:05
sean-k-mooneyi know wehere we do that let me check if it will do that19:05
gibiI'm looking at https://review.opendev.org/c/openstack/nova/+/778350/7/nova/pci/stats.py#21519:06
gibi_handle_device_dependents19:06
sean-k-mooneyyep19:06
sean-k-mooneyso that will mark the parent as unavaiable if we use a vf19:06
gibiand I see that we make the PF unavailable when we allocate a VF or a VDPA19:06
sean-k-mooney*vdpa dev19:06
gibiyepp19:06
gibibut what about the other direction19:06
sean-k-mooneyso you are saying we shoudl do the reverse too19:07
gibiwondering19:07
gibiif I allocated the PF19:07
gibithen all the devs under the PF should not be used any more19:07
sean-k-mooneyya i did not think of that edgecase because i only whitelisted the VF in the pci whitelist not the PF19:07
*** ociuhandu has joined #openstack-nova19:07
sean-k-mooneygibi: correct19:07
gibiI guess there is also the case when both the VF and the related VDPA is whitelsited and I allocate the VF19:08
sean-k-mooneyit might just work however depending on how remove_device works19:08
sean-k-mooneygibi: no we will only ever get either the VF or VDPA divce listed19:08
sean-k-mooneyim basically taking the VF recored and changing its type19:09
gibisean-k-mooney: so when the admin creates the VDPA dev that consumes the VF already from the host?19:09
sean-k-mooneywhen an admin create a vdpa device on the host it will be reported as vdpa instead of a VF19:10
gibiOK19:10
gibiso we wont see both the VF and the VDPA at the same time19:10
sean-k-mooneynot for the same VF no19:10
gibicool19:10
sean-k-mooneyyou could have a mix of VF and VDPA devices19:10
gibithen only the PF edge case remains19:10
gibiwhen the PF is allocated we have the code somewhere that makes the VFs unavailable19:11
sean-k-mooneyif each VDPA device is from a VF not listed as a VF19:11
sean-k-mooneyyes its here https://review.opendev.org/c/openstack/nova/+/778350/7/nova/pci/stats.py#22319:11
gibiahh yes19:11
gibiso that removes the list of vfs19:11
sean-k-mooneythe VDPA devices are listed with the VF address in the tracker19:12
gibiso pci_dev.child_devices does have the VDPAs listed?19:12
sean-k-mooneyi need to check if that will remove the VDPA device too or not19:12
gibiOK19:12
sean-k-mooneyim not sure ill whitelist the PF on my test system and check19:12
gibicool19:12
gibiI continue reading in the meantime19:12
sean-k-mooneyi plan to write some func test for this too but i need to extend our fixture support19:13
*** ociuhandu has quit IRC19:15
gibiDo I understand correclty that not having the mlock extra spec in W is OK if we document to use VDPA always with huge pages?19:17
stephenfinthat's the thinking, yes19:17
stephenfinhuge pages or real-time19:18
sean-k-mooneyunfortunetly no. you would have to use hw:realtime or have a libvirt that does it for you19:18
*** ociuhandu has joined #openstack-nova19:18
sean-k-mooneystephenfin: hugepages is not enough unfortunetly19:18
*** jawad_axd has quit IRC19:18
stephenfinsean-k-mooney: oh, are they not locked by default?19:18
sean-k-mooneythey are unswapable but not locked19:18
sean-k-mooneytechnially they can be moved if you configure your kernel to allow that19:19
stephenfinsean-k-mooney: I've forgotten - have you a release note?19:19
sean-k-mooneyin practic they basially are but i still got the dma issue becuase qemu was not allowed lock the memory19:19
sean-k-mooneystephenfin: not yet that was going to be in the patch that block the unsupported ops19:20
stephenfinIf not, that should be called out. I suspect libvirt will start doing this shortly since it's an obvious oversight but just in case they don't19:20
sean-k-mooneyim working on that now19:20
stephenfinOkay, cool19:20
stephenfinI've got a functional test almost done, btw19:20
stephenfinlots of mocking19:20
stephenfinartom is right - we're eventually going to reinvent libvirt :)19:20
sean-k-mooneydid you implement vdpa in the pci fixture?19:20
stephenfinyeah19:20
gibiyeah I wanted to ask for a reno and blockin of the unsupported ops19:20
stephenfinI copied bauzas' pattern for mdevs19:21
stephenfinthere's cleanup needed, but I want to rework all this next cycle19:21
stephenfinstart using template files with a proper language like jinja219:21
stephenfininstead of hacking them together like we're doing /o\19:21
sean-k-mooneygibi: so here is the testing i did yesterday https://review.opendev.org/c/openstack/nova/+/778350/7#message-0bb79aad698ad4acacfec150e80d58d7abc1d09b19:21
sean-k-mooneyim going to block all the ops that did not work with the 403 and same exception i have in that other patch19:22
sean-k-mooneyhttps://review.opendev.org/c/openstack/nova/+/780065/1/nova/exception.py19:22
sean-k-mooneythat i was also goign to add a user dock liek we have for port resouce requests19:23
sean-k-mooneyhttps://docs.openstack.org/api-guide/compute/port_with_resource_request.html19:23
gibisean-k-mooney: nice19:24
gibisean-k-mooney: I finished reading the vdpa patches (I ignored mlock for now) I have nothing major blocking this. But I will not be around to review the incoming reno and ops blocking patch today19:25
*** ociuhandu has quit IRC19:25
sean-k-mooneyya its getting late for you thanks for staying with it so far19:26
gibistephenfin, sean-k-mooney: is it OK for you if we treat this now as a possible FFE19:26
gibi?19:26
*** tbachman has quit IRC19:26
gibiI can do the remaining reviews tomorrow morning19:26
sean-k-mooneyi was not sure if we were going to have any but if you would be ok with that then yes19:26
stephenfinsure, wfm. It'd be nice to be able to get dinner :)19:26
* stephenfin is official sick of playing with fixtures19:27
gibiOK, then I will check where we are tomorrow morning19:27
sean-k-mooneyi can email the list and formally request one if you like19:27
gibisean-k-mooney: yes please19:27
sean-k-mooneyok will do19:27
gibiyou can refer to me and stephenfin as supporters for the FFE19:27
gibithis is really close and it is useful19:27
gibiso I'm willing to spend timeon this tomorrow and early next week19:28
sean-k-mooneyok ill wait for the irc logs to catch up and ill also link to this conversation19:28
gibito get it approvaed19:28
gibisean-k-mooney: sure19:28
sean-k-mooneygibi++19:28
gibiOK, I'm leaving now19:28
sean-k-mooneyo/19:28
gibio/19:28
stephenfinciao19:28
*** tbachman has joined #openstack-nova19:30
*** belmoreira has quit IRC19:31
*** belmoreira has joined #openstack-nova19:31
*** ociuhandu has joined #openstack-nova19:40
*** k-s-dean has quit IRC19:40
*** links has quit IRC19:44
*** ociuhandu has quit IRC19:51
*** rcernin has joined #openstack-nova20:00
sean-k-mooneyok so i have a small bug here https://review.opendev.org/c/openstack/nova/+/770533/10/nova/virt/libvirt/host.py#1237 so ill respin that patch and add testing to make sure claiming the PF handels the VDPA devices correctly20:03
openstackgerritmelanie witt proposed openstack/nova master: Dynamically archive FK related records in archive_deleted_rows  https://review.opendev.org/c/openstack/nova/+/77383420:06
*** martinkennelly has joined #openstack-nova20:09
*** xinranwang has quit IRC20:11
*** k-s-dean has joined #openstack-nova20:27
*** k_mouza has joined #openstack-nova20:28
*** kd has joined #openstack-nova20:30
*** bbowen has joined #openstack-nova20:32
*** k-s-dean has quit IRC20:33
*** k_mouza has quit IRC20:33
*** tobiash_ is now known as tobiash20:36
*** jamesdenton has quit IRC20:53
*** jamesdenton has joined #openstack-nova20:53
*** k_mouza has joined #openstack-nova20:54
*** slaweq has quit IRC20:56
*** ociuhandu has joined #openstack-nova20:56
*** zul has joined #openstack-nova20:56
*** k_mouza has quit IRC20:59
*** rcernin has quit IRC21:04
*** ociuhandu has quit IRC21:04
openstackgerritStephen Finucane proposed openstack/nova master: WIP: tests: Add functional test for vDPA device  https://review.opendev.org/c/openstack/nova/+/78011221:09
stephenfinsean-k-mooney: so that's not done, but you should be able to see where it's going. I'll finish it in the morning ^21:09
*** spatel_ has quit IRC21:10
sean-k-mooneythanks21:10
*** spatel has joined #openstack-nova21:10
stephenfinsean-k-mooney: nw. Don't forget to file the FFE email :)21:10
* stephenfin knocks off for the evening21:10
sean-k-mooneyi fixed the bug i had and now im testing the PF issue that gibi asked about21:11
sean-k-mooneyill send the email yeas21:11
*** belmoreira has quit IRC21:23
*** hamalq has quit IRC21:30
*** hamalq has joined #openstack-nova21:31
*** rcernin has joined #openstack-nova21:35
*** tobias-urdin has quit IRC21:47
*** rcernin has quit IRC21:51
*** rcernin has joined #openstack-nova21:54
*** rcernin has quit IRC22:00
*** rcernin has joined #openstack-nova22:00
*** hamalq has quit IRC22:38
*** spatel has quit IRC22:44
*** ociuhandu has joined #openstack-nova22:45
*** ociuhandu has quit IRC22:51
*** smcginnis has quit IRC23:04
*** smcginnis has joined #openstack-nova23:15
*** jamesdenton has quit IRC23:23
*** jamesdenton has joined #openstack-nova23:24
*** smcginnis has quit IRC23:28
*** mlavalle has joined #openstack-nova23:59

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!