| ctay | Hello, I'd like to ask if anyone of you had to deal with something similiar as me. For the OS cluster we use, we wrote our custom weigher for nova scheduler and we would like to simulate/test how it would effect the placement of new virtual machines in time from the current state of the cluster before we deploy the change...The main objective of this weigher is to reduce the amount of wasted resources. | 06:29 |
|---|---|---|
| ctay | Is there any framework for this kind of testing? Or anything else? I've checked the testing tools mentioned in the docs, but none of them seems to do the thing. | 06:30 |
| ctay | It would be good if we could determine the impact of the new weighter on the scheduling before we deploy it, so we can be sure it'll actualy waste less resources. | 06:30 |
| *** iurygregory_ is now known as iurygregory | 06:42 | |
| *** rpittau|afk is now known as rpittau | 07:22 | |
| lyarwood | https://review.opendev.org/c/openstack/nova/+/804230 - if any cores have time today reviews on this bugfix series and trivial fup's would be appreciated | 08:07 |
| lyarwood | ctay: so rally might be able to help with this and/or our functional test framework could also assert the behaviour for you | 08:08 |
| * lyarwood looks for examples as he doesn't do much on the n-schd side | 08:09 | |
| lyarwood | https://github.com/openstack/nova/blob/370830e9445c9825d1e34e60cca01fdfe88d5d82/nova/tests/functional/test_scheduler.py but it's pretty limited | 08:10 |
| *** mgoddard- is now known as mgoddard | 08:20 | |
| ctay | lyarwood: from the quick look at the functional test framework for scheduler, it just checks whether it does what it should...that doesn't help us, as we'd like to "predict" how the changes in scheduling will affect the distribution of VM's in the cloud from the current state. | 08:45 |
| gibi | ctay: If I were you I would try to build someting top of the existing functional test env as lyarwood suggested. That env allows you to simulate a huge amount of computes and schedule huge amount of VMs on them without having to provide the real hardware for it. | 08:45 |
| gibi | ctay: you can simply build up a many compute many VM scenario in the func test env and see how the scheduler distribute the VMs with and without your weigher | 08:46 |
| lyarwood | ctay: yeah as gibi said, you can assert the behaviour of the weigher in a similar sized env to your own, we don't have anything that could simulate things on an existing env | 08:48 |
| lyarwood | ctay: using our func framework that is | 08:49 |
| opendevreview | Fabian Wiesel proposed openstack/nova master: VMWare: Use WithRetrieval to get all results https://review.opendev.org/c/openstack/nova/+/804968 | 08:54 |
| ctay | okay, thanks for the advices ... it seems like building upon the existing func framework is a way to go then | 08:56 |
| gibi | lyarwood: I have a question in https://review.opendev.org/c/openstack/nova/+/804230/3/nova/compute/manager.py#8215 | 09:19 |
| lyarwood | gibi: https://review.opendev.org/c/openstack/nova/+/804299/2/nova/tests/functional/compute/test_live_migration.py - ack yeah I added this later in the series after artom asked, it's also covered elsewhere in a regression test iirc | 09:23 |
| gibi | lyarwood: ohh cool | 09:25 |
| lyarwood | https://review.opendev.org/q/topic:bug/1899835 was the regression test but the fix isn't complete yet | 09:26 |
| gibi | lyarwood: there is a bugfix that needs a second set of eyes https://review.opendev.org/c/openstack/nova/+/803603 | 09:42 |
| lyarwood | ack looking | 09:42 |
| gibi | thanks | 09:42 |
| gibi | and if you are on fire then there is a second one here https://review.opendev.org/q/topic:bug/1939193 | 09:45 |
| *** tbachman is now known as Guest4719 | 09:53 | |
| *** tbachman_ is now known as tbachman | 09:53 | |
| gibi | lyarwood: as per https://review.opendev.org/c/openstack/nova/+/804275 regarding the 2.88 support in novaclient I think that was landed here https://github.com/openstack/python-novaclient/commit/54d4da112a6e84db5bda497364a49b9debfc2904 | 09:55 |
| lyarwood | weird, the tree I was working on only had 2.87 | 09:55 |
| gibi | lyarwood: the patch that is open in novaclient for 2.88 is acutally for a feature that havent landed yet in nova | 09:55 |
| lyarwood | ack I did wonder | 09:55 |
| lyarwood | okay let me try to rebase/pull things again | 09:56 |
| lyarwood | and I'll push what I have for 2.89 shortly | 09:56 |
| gibi | OK cool | 09:56 |
| *** brinzhang0 is now known as brinzhang | 11:05 | |
| opendevreview | Vadym Markov proposed openstack/nova master: Fix for concurrent DB update issue https://review.opendev.org/c/openstack/nova/+/804985 | 11:07 |
| opendevreview | Vadym Markov proposed openstack/nova master: Fix for concurrent DB update issue https://review.opendev.org/c/openstack/nova/+/804985 | 11:08 |
| *** songwenping__ is now known as songwenping | 12:03 | |
| gibi | \o/ alembic integration is on the gate | 12:47 |
| lyarwood | oh is that what the burning smell is | 12:48 |
| lyarwood | stephenfin++ | 12:48 |
| sean-k-mooney | :) | 12:48 |
| opendevreview | Rodrigo Barbieri proposed openstack/nova master: Fix 1vcpu error with multiqueue and vif_type=tap https://review.opendev.org/c/openstack/nova/+/804303 | 12:51 |
| opendevreview | Merged openstack/nova master: db: Unify 'nova.db.api', 'nova.db.sqlalchemy.api' https://review.opendev.org/c/openstack/nova/+/799524 | 12:54 |
| opendevreview | Merged openstack/nova master: db: Exclude the 'use_db_reconnect' option https://review.opendev.org/c/openstack/nova/+/803778 | 12:55 |
| opendevreview | Merged openstack/nova master: db: Move remaining 'nova.db.sqlalchemy' modules https://review.opendev.org/c/openstack/nova/+/799525 | 12:55 |
| opendevreview | Merged openstack/nova master: db: Post reshuffle cleanup https://review.opendev.org/c/openstack/nova/+/799526 | 12:55 |
| opendevreview | Fabian Wiesel proposed openstack/nova master: VMWare: Use get_hardware_devices throughout https://review.opendev.org/c/openstack/nova/+/805017 | 13:01 |
| yonglihe | hello, nova | 13:14 |
| yonglihe | gibi, thanks your review, and the first one still be in +1, https://review.opendev.org/c/openstack/nova/+/771362/38 | 13:18 |
| gibi | yonglihe: hi! fixed it | 13:18 |
| yonglihe | cool! | 13:19 |
| mgariepy | hello, is there a way to add a quota on pci devices or vgpus with nova? | 13:23 |
| sean-k-mooney | not yet | 13:25 |
| sean-k-mooney | it will be supported with unified limits | 13:25 |
| sean-k-mooney | in the future | 13:25 |
| mgariepy | is there a BP ? | 13:25 |
| sean-k-mooney | https://review.opendev.org/q/topic:%22bp%252Funified-limits-nova%22+(status:open%20OR%20status:merged) | 13:26 |
| mgariepy | awesome :D thanks | 13:27 |
| sean-k-mooney | this is the spec https://review.opendev.org/c/openstack/nova-specs/+/789585 ^ is the full set of patches | 13:27 |
| lyarwood | sean-k-mooney: forgot to say that I have that all open for review at somepoint today or tomorrow btw | 13:27 |
| * lyarwood needs to go over the spec again | 13:28 | |
| mgariepy | Target release is X or Z i guess ? | 13:28 |
| lyarwood | sean-k-mooney: apologies for not replying last night, got stuck in traffic on the way back from nursery | 13:28 |
| sean-k-mooney | no worries | 13:29 |
| opendevreview | Lee Yarwood proposed openstack/python-novaclient master: Microversion 2.89 - Add attachment ids to os-volume_attachments GETs https://review.opendev.org/c/openstack/python-novaclient/+/805022 | 13:31 |
| opendevreview | Fabian Wiesel proposed openstack/nova master: VmWare: Fix deprecation warning in unit tests https://review.opendev.org/c/openstack/nova/+/805024 | 13:47 |
| opendevreview | Merged openstack/nova master: db: Avoid use of ALTER in initial migration https://review.opendev.org/c/openstack/nova/+/800076 | 14:07 |
| opendevreview | Takashi Kajinami proposed openstack/nova stable/victoria: Fix request path to query a resource provider by uuid https://review.opendev.org/c/openstack/nova/+/803550 | 14:09 |
| opendevreview | Takashi Kajinami proposed openstack/nova stable/ussuri: Fix request path to query a resource provider by uuid https://review.opendev.org/c/openstack/nova/+/805004 | 14:10 |
| opendevreview | Merged openstack/nova master: db: Add initial alembic migration for main DB https://review.opendev.org/c/openstack/nova/+/799527 | 14:27 |
| opendevreview | Merged openstack/nova master: db: Add initial alembic migration for API DB https://review.opendev.org/c/openstack/nova/+/799528 | 14:28 |
| opendevreview | Merged openstack/nova master: db: Trivial style changes https://review.opendev.org/c/openstack/nova/+/799529 | 14:28 |
| opendevreview | Merged openstack/nova master: db: Normalize migrations tests https://review.opendev.org/c/openstack/nova/+/799684 | 14:29 |
| opendevreview | Merged openstack/nova master: db: Integrate alembic https://review.opendev.org/c/openstack/nova/+/799530 | 14:29 |
| opendevreview | Merged openstack/nova master: db: Enable auto-generation of migrations https://review.opendev.org/c/openstack/nova/+/800077 | 14:30 |
| opendevreview | Merged openstack/nova master: docs: Add documentation on database migrations https://review.opendev.org/c/openstack/nova/+/800078 | 14:30 |
| opendevreview | Merged openstack/nova master: db: Final cleanups https://review.opendev.org/c/openstack/nova/+/800484 | 14:31 |
| opendevreview | Merged openstack/nova master: tests: Enable SADeprecationWarning warnings https://review.opendev.org/c/openstack/nova/+/804708 | 14:31 |
| gibi | hm, that landed easily | 14:34 |
| * gibi goes an marks that bp ready | 14:35 | |
| * artom chooses to read that as Sad Eprecation Warning | 14:38 | |
| gibi | :D | 14:42 |
| opendevreview | Merged openstack/nova master: Block servers with vGPU and device profile in heal_allocations https://review.opendev.org/c/openstack/nova/+/803603 | 14:43 |
| opendevreview | Merged openstack/nova master: Smartnic support - cyborg drive https://review.opendev.org/c/openstack/nova/+/771362 | 14:48 |
| stephenfin | gibi++ lyarwood++ Thank you both \o/ | 15:09 |
| gibi | stephenfin: thank you for making it happen | 15:09 |
| lyarwood | and fixing any bugs that come up before ga | 15:09 |
| lyarwood | and for fixing* | 15:10 |
| stephenfin | probably not a great time to talk about my forthcoming two month PTO | 15:10 |
| stephenfin | if the French can do it... | 15:10 |
| lyarwood | that isn't PTO that's desertion | 15:10 |
| lyarwood | get planning finally? | 15:11 |
| stephenfin | Ah, no, I'm kidding. Just two weeks of vacation in September | 15:12 |
| stephenfin | No word on planning permission either :'( | 15:12 |
| lyarwood | ah that sucks | 15:15 |
| stephenfin | Out of curiosity, is there any value in me addressing the remaining SQLAlchemy 2.x issues or is bandwidth too limited? https://review.opendev.org/c/openstack/nova/+/804878/ They'll have to be fixed eventually but not necessarily right now | 15:16 |
| stephenfin | The pro being I have the context on this right now that I'm likely to lose and the con being it'll be another 10 patches (or fewer more complex patches, obv) | 15:17 |
| lyarwood | I'm happy to review them if you have the time and context still | 15:17 |
| stephenfin | okay, cool, I'll try whip them together Friday once I've reviewed the few series on my todo list | 15:18 |
| opendevreview | Balazs Gibizer proposed openstack/nova master: [nova-manage]support extended resource request https://review.opendev.org/c/openstack/nova/+/802060 | 15:36 |
| opendevreview | Balazs Gibizer proposed openstack/nova master: Reno for qos-minimum-guaranteed-packet-rate https://review.opendev.org/c/openstack/nova/+/805046 | 15:37 |
| NobodyCam | Good Morning Nova folks, would anyone have a recommendation for a efficient way to provide kilobytes of metadata... to instances, the Compute meta data is working perfectly but not with larger amounts of data. looking at a requirement to provide 8 to 16 Kb of dynamic metadata over the life of a lease. | 16:00 |
| lyarwood | melwitt: https://review.opendev.org/q/topic:bug/1939545 - would you mind taking a look at this bugfix series this week if you have time? | 16:00 |
| lyarwood | https://review.opendev.org/c/openstack/nova/+/802317 also if you have time | 16:00 |
| *** rpittau is now known as rpittau|afk | 16:06 | |
| melwitt | lyarwood: sure, will do | 16:28 |
| opendevreview | Merged openstack/nova master: libvirt: Abort live-migration job when monitoring fails https://review.opendev.org/c/openstack/nova/+/764435 | 18:01 |
| melwitt | bauzas: sorry to bother you, I wasn't sure if you saw there are two more patches in the placement consumer types series starting here https://review.opendev.org/c/openstack/placement/+/679441 if you might be able to get to them before FF | 19:07 |
| lyarwood | https://bugs.launchpad.net/nova/+bug/1939108/comments/1 \o/ found the source of our weird volume detach issues, a kernel panic during boot... | 20:01 |
| melwitt | lyarwood: nice find!! | 20:18 |
| lyarwood | https://review.opendev.org/c/openstack/nova/+/96090 All this has happened before, and all this will happen again.... | 20:25 |
| melwitt | :( | 20:29 |
| * lyarwood calls it after sending a ML email about fixing our images in CI | 21:08 | |
| gmann | lyarwood: gibi can we remove 'id' field also in this which was very confused with attachment_id https://review.opendev.org/c/openstack/nova/+/804275/5/nova/api/openstack/compute/volumes.py#256 | 23:29 |
| artom | gmann, heh, I was saying something similar on the spec review | 23:32 |
| artom | https://review.opendev.org/c/openstack/nova-specs/+/794799 | 23:33 |
| gmann | artom: ah, yeah that is same concern from me too | 23:36 |
| artom | gmann, maybe you can come up with something better that folks are happy with | 23:38 |
| artom | I couldn't think of anything that Lee was willing to accept | 23:38 |
| gmann | artom: i agree with your concern, replied in spec. | 23:48 |
| gmann | and 'id' filed is return as volume_id not id of BlockDeviceMapping https://github.com/openstack/nova/blob/a6690e8a3e6e4b009fb821257170cf1bd06fab7d/nova/api/openstack/compute/volumes.py#L231 | 23:48 |
| artom | gmann, huh, yeah, it is the volume ID | 23:57 |
| artom | I trusted Lee implicitly on that and didn't double check | 23:57 |
| artom | gmann, hrmm, so looking at interfaceAttachments for inspiration, there's no 'id' there at all, it's all <foo>_id for port and net | 23:59 |
| artom | And the deprecated virtualInterfaces API has an `id`, but it's a UUID for the virtual interface itself and doesn't map to anything | 23:59 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!