Friday, 2021-07-30

opendevreviewSimon Li proposed openstack/nova-specs master: support ironic instance change host while it's host not up  https://review.opendev.org/c/openstack/nova-specs/+/80299107:04
opendevreviewSimon Li proposed openstack/nova-specs master: support ironic instance change host while it's host not up  https://review.opendev.org/c/openstack/nova-specs/+/80299107:08
*** rpittau|afk is now known as rpittau07:21
bauzasstephenfin: sean-k-mooney[m]: lovely reviews for my generic mdevs implementation, thanks !:09:01
artom_bauzas, have time to hit https://review.opendev.org/c/openstack/nova/+/802697?09:03
*** artom_ is now known as artom09:03
artombauzas, thanks for the review - so, I did consider doing a functional test, but given that this is 1. niche and 2. straightforward, any functional test I'd write would be either 1. a lot of groundwork to use the Ironic virt driver in the test or 2. have so much stuff mocked out, it'd be functionally (heh) identical to the existing unit test09:21
bauzasartom: you don't need to use the ironic driver09:29
bauzasartom: just use the standard fake driver and mock out (in the func test) the return you want09:29
artombauzas, that's what the unit test is doing :P09:30
artomI mean OK, it's not using any virt driver09:30
bauzasartom: I know but you wouldn't verify the output of a method call, right?09:30
bauzasfor the functest09:30
bauzasyou would verify the expected behaviour 09:30
stephenfinbauzas: sometimes "good enough" is okay :)09:30
bauzasstephenfin: i know and that's why I asked whether there was urgency09:31
bauzasthe bug itself isn't about Ironic09:32
artombauzas, err, yes it is?09:32
artomHow else would you hit this besides Ironic?09:32
bauzasthe problem is that we raise up to the API an exception when we don't find compute nodes for a service deletion09:32
artom... which can only happen with Ironic :)09:32
bauzassure09:32
bauzasbut the regression should verify that we get an API exception09:33
bauzaswhen calling the API service delete09:33
artom        self.assertRaises(09:33
bauzaswhile the fix should just modify the api return 09:33
artom            webob.exc.HTTPInternalServerError09:33
bauzasI saw09:35
bauzasanyway09:35
bauzasI'm just asking to use a design framework09:36
bauzasbecause we're an opensource community and we try to use the same frameworks in general as we want contributors to know about them09:36
bauzaswe can do this other way09:36
bauzasand for sure this will work09:37
artombauzas, I mean, I could just squash the patches and avoid the reproducer alltogether :P09:37
artomI wanted to highlight the broken behaviour first09:37
artomBut the fix itself doens't need a func test, methinks09:37
bauzashonestly, I don't know what to say, I wasn't thinking my comment would be a concern09:38
bauzasso, meh09:38
bauzas+Wd09:38
bauzasI just don't wanna take time discussing09:38
bauzasartom: about the log level i'm asking 09:48
bauzaswell, in theory, unless ironic, a service *has* a compute node, right?09:48
bauzasand even with ironic, that's a normal situation09:48
artomNot really, IIUC, but I'm not an expert09:48
artomA service without nodes can be a part of normal operation09:49
artomFor instance, adding a service before adding any nodes to it, replacing all nodes associated with a service, that kind of stuff09:49
artomIn my understanding, anyways09:49
artomSo to quote pawnstars, "debug is the best I can do"09:50
artomActually, would you be offended if I did it in a follow-up? I need to fix the dat base typo as well09:50
artom'dat base: https://i.kym-cdn.com/entries/icons/original/000/000/228/DATASS.jpg09:51
artomErr, sorry about the URL :(09:52
bauzasartom: no, a service without a node isn't "normal"09:55
bauzaswe create the CN entry when we create the service09:55
bauzasor CNs09:55
bauzasartom: it's just if you rebalance ironic nodes that you end up with trampling nova09:56
bauzasbecause ironic didn't manage the service/node relationship we have09:56
bauzasso, unless you rebalance your ironic nodes, you shouldn't expect such things09:56
bauzashence an INFO at least 09:56
artomFair enough, I can do INFO09:58
artomDo you accept my FUP bargain? :)09:58
bauzasif so09:59
artomHol'up though - for my own education, Ironic managed actualy physical nodes09:59
artom*manages09:59
artomSo... how does "we create CN entry when we create the service" work if there are not physical nodes existing?10:00
jkulika started ironic compute driver will just write over and over again "No compute node record for host nova-compute-ironic" if there are no physical nodes existing. at least on rocky.10:02
opendevreviewMerged openstack/nova master: Reproducer unit test for bug 1860312  https://review.opendev.org/c/openstack/nova/+/80269710:03
bauzasartom: the compute manager gets the list of cns from the virt driver in https://github.com/openstack/nova/blob/97e1a6bece29e383f55bb969c69983153df9ffc7/nova/compute/manager.py#L143310:04
artomjkulik, cheers! Confirms how I understood things10:04
artombauzas, I feel like that could be None/empty list though10:05
bauzasartom: https://github.com/openstack/nova/blob/97e1a6bece29e383f55bb969c69983153df9ffc7/nova/compute/manager.py#L58310:06
artomEmpty list, based on https://github.com/openstack/nova/blob/97e1a6bece29e383f55bb969c69983153df9ffc7/nova/virt/ironic/driver.py#L82310:06
bauzashere we instantiate a RT per compute node10:06
bauzasand here we create the CN entry https://github.com/openstack/nova/blob/97e1a6bece29e383f55bb969c69983153df9ffc7/nova/compute/resource_tracker.py#L91810:07
bauzasevery 60 secs10:08
artombauzas, that's called from the periodic through, not at host init10:11
bauzasyup, my bad10:13
bauzasbut10:13
bauzaswe eventually call u_r_p at the end of the init, IIRC10:13
bauzasit's just a post hook call and not straighlty from init_host (or something like that, can't exactly remember)10:13
opendevreviewArtom Lifshitz proposed openstack/nova master: I2f9ad3df25306e070c8c3538bfed1212d6d8682f fup: add log  https://review.opendev.org/c/openstack/nova/+/80300110:39
opendevreviewSylvain Bauza proposed openstack/nova master: Rename vgpu options to mdev  https://review.opendev.org/c/openstack/nova/+/80160711:13
opendevreviewSylvain Bauza proposed openstack/nova master: DNM (yet) : Expose the mdev class  https://review.opendev.org/c/openstack/nova/+/80174311:13
opendevreviewSylvain Bauza proposed openstack/nova master: WIP Provide the mdev class for every PCI device  https://review.opendev.org/c/openstack/nova/+/80291811:13
opendevreviewSylvain Bauza proposed openstack/nova master: WIP Provide the mdev class for every PCI device  https://review.opendev.org/c/openstack/nova/+/80291811:16
opendevreviewSylvain Bauza proposed openstack/nova master: DNM (yet) : Expose the mdev class  https://review.opendev.org/c/openstack/nova/+/80174311:16
songwenping__bauzas, now we cannot batch create vgpu vms, right?11:23
bauzasI need to go out for lunch but wdym for "batch create" ?11:23
bauzasmulti-create ?11:23
songwenping__yes multi-create11:23
bauzasif so, https://bugs.launchpad.net/nova/+bug/187466411:24
sean-k-mooney[m]we do not support multi create with any request that uses nested resource providers today11:25
bauzasyup, but this doesn't impact virtual GPUs 11:26
songwenping__there is a different exception with the bug11:26
songwenping__yes, the scheduler is ok11:27
songwenping__compute raise exception11:27
sean-k-mooney[m]well that bug does affect vgpu11:28
bauzassongwenping__: look at the two different tests we have for vgpus https://review.opendev.org/c/openstack/nova/+/723858/3/nova/tests/functional/libvirt/test_vgpu.py#23711:28
bauzassean-k-mooney[m]: depending on your cloud capacity11:28
songwenping__tbe exception in my env is: mediated device /sys/bus/mdev/devices/58c9a61a-874f-414c-a8e8-91892a9fc6dd is in use by driver QEMU, domain instance-00000008\n'11:28
sean-k-mooney[m]in any case we don’t officially support multi create with vgpu today11:29
sean-k-mooney[m]that looks like there is a uuid collision on the host or similar reuse of the same mdev11:30
bauzassongwenping__: oh, that's another nvidia issue https://bugs.launchpad.net/nova/+bug/175808611:30
bauzasbecause of IOMMU11:30
bauzasyou can't bind 2 vGPUs of the same pGPU on the same guest11:31
bauzas2 or more vGPUs tbc11:31
sean-k-mooney[m]oh right ya. that is noted in our docs11:31
bauzasyou can bind 2 or more vGPUs to the same guest if and only if each of those vGPU is actually provided by a different pGPU11:32
bauzassongwenping__: oh, this exception11:32
bauzassorry, I misread11:32
sean-k-mooney[m]i’m not sure that limitation applies to intel guys by the way.11:32
bauzasthat means we tried to allocate a mdev which was already assigned to another instance11:33
bauzassean-k-mooney[m]: nope11:33
bauzasanyway, I'm starving11:33
sean-k-mooney[m]right that is what i meant by collision11:33
sean-k-mooney[m]hehe and i’m off today but i get notification on my ipad. was looking a coffee machine reviews :)11:34
sean-k-mooney[m]ill be back on tuesday11:34
stephenfinartom: what's going on with the commit message here? https://review.opendev.org/c/openstack/nova/+/80300112:21
artomstephenfin, no idea13:10
* artom fix13:10
opendevreviewArtom Lifshitz proposed openstack/nova master: I2f9ad3df25306e070c8c3538bfed1212d6d8682f fup: add log  https://review.opendev.org/c/openstack/nova/+/80300113:11
opendevreviewMerged openstack/nova master: Fix request path to query a resource provider by uuid  https://review.opendev.org/c/openstack/nova/+/80085513:25
*** rpittau is now known as rpittau|afk14:07
-opendevstatus- NOTICE: There will be a brief outage of the Gerrit service on review.opendev.org starting at 15:00 UTC today as part of a routine project rename maintenance: http://lists.opendev.org/pipermail/service-announce/2021-July/000023.html14:12
bauzasargh, forgot this ^14:48
bauzasa Friday 5pm outage ? man, does it mean I should stop then ? :)14:49
bauzasmelwitt: sorry I had no time reviewing your series but I haven't forgotten, will do it hopefully on Monday morning so you'd get feedback when you're back from time off14:50
bauzasI'll tho try to start now unti Gerrit shutdowns14:50
bauzasstephenfin: around ? how can I verify the revisions uuids for https://review.opendev.org/c/openstack/placement/+/669170/19/placement/db/sqlalchemy/alembic/versions/422ece571366_add_consumer_types_table.py#1 ?14:52
bauzasL25-2614:52
stephenfinlooking14:52
stephenfinbauzas: the revision UUID should be unique14:53
stephenfinso if you grep for that in the migrations directory, it shouldn't find anything14:53
bauzasok14:53
bauzasdo we have a test running it ?14:53
stephenfinthe down_revision on the other hand should be the most recent migration14:53
stephenfinI suspect there are migrations tests14:53
bauzasok14:53
stephenfinprobably in placement.tests.db.test_migrations or similar 14:54
bauzaslemme look14:54
bauzasstephenfin: do we need to run some command in some venv for creating a new alembic migration ?14:55
bauzaslike reno, I mean14:55
stephenfinyes, 'alembic revision'14:55
stephenfinI've documented it for nova https://review.opendev.org/c/openstack/nova/+/800078/314:56
-opendevstatus- NOTICE: There will be a brief outage of the Gerrit service on review.opendev.org in the next few minutes as part of a routine project rename maintenance: http://lists.opendev.org/pipermail/service-announce/2021-July/000023.html15:01
bauzasstephenfin: I see, thanks !15:13
opendevreviewTakashi Kajinami proposed openstack/nova stable/wallaby: Fix request path to query a resource provider by uuid  https://review.opendev.org/c/openstack/nova/+/80307016:40
opendevreviewSylvain Bauza proposed openstack/nova master: Rename vgpu options to mdev  https://review.opendev.org/c/openstack/nova/+/80160716:40
opendevreviewSylvain Bauza proposed openstack/nova master: Provide the mdev class for every PCI device  https://review.opendev.org/c/openstack/nova/+/80291816:40
opendevreviewSylvain Bauza proposed openstack/nova master: DNM (yet) : Expose the mdev class  https://review.opendev.org/c/openstack/nova/+/80174316:40
opendevreviewStephen Finucane proposed openstack/nova master: Move nova-manage db purge to nova-audit  https://review.opendev.org/c/openstack/nova/+/70878316:54
opendevreviewStephen Finucane proposed openstack/nova master: Move nova-manage db archive_deleted_rows to nova-audit  https://review.opendev.org/c/openstack/nova/+/70878416:54
opendevreviewStephen Finucane proposed openstack/nova master: Move nova-manage cell_v2 discover_hosts to nova-manage  https://review.opendev.org/c/openstack/nova/+/70878516:54
opendevreviewStephen Finucane proposed openstack/nova master: Move nova-manage cell_v2 map_instances to nova-audit  https://review.opendev.org/c/openstack/nova/+/70878616:54
opendevreviewStephen Finucane proposed openstack/nova master: Move nova-manage placement sync_aggregates to nova-audit  https://review.opendev.org/c/openstack/nova/+/70878716:54
opendevreviewStephen Finucane proposed openstack/nova master: Move nova-manage placement heal_allocations to nova-audit  https://review.opendev.org/c/openstack/nova/+/70878816:54
opendevreviewStephen Finucane proposed openstack/nova master: WIP: nova-audit: Use cliff instead of homegrown argparse bleh  https://review.opendev.org/c/openstack/nova/+/80305916:54
opendevreviewStephen Finucane proposed openstack/placement master: placement-status: check only consumers in allocation table  https://review.opendev.org/c/openstack/placement/+/76298717:04
melwittbauzas: ok no worry, thanks!17:11
*** melwitt is now known as jgwentworth17:55
opendevreviewMerged openstack/nova master: db: Use module-level imports for sqlalchemy (for real)  https://review.opendev.org/c/openstack/nova/+/79651917:57
opendevreviewMerged openstack/nova master: db: Move db.sqalchemy.migration to db.migration  https://review.opendev.org/c/openstack/nova/+/79951817:57
opendevreviewMerged openstack/placement master: Remove unused test helper  https://review.opendev.org/c/openstack/placement/+/76395819:05
opendevreviewSamuel proposed openstack/nova-specs master: Migrate Instance Between Projects  https://review.opendev.org/c/openstack/nova-specs/+/80203419:30
opendevreviewMerged openstack/placement master: placement-status: check only consumers in allocation table  https://review.opendev.org/c/openstack/placement/+/76298719:48
opendevreviewmelanie witt proposed openstack/nova stable/stein: Reject open redirection in the console proxy  https://review.opendev.org/c/openstack/nova/+/80293520:33
opendevreviewElod Illes proposed openstack/nova stable/rocky: [stable-only] Fix lower-constraints job  https://review.opendev.org/c/openstack/nova/+/76991021:15

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!