| opendevreview | sean mooney proposed openstack/nova master: Add functional repoducer for ephemeral disks https://review.opendev.org/c/openstack/nova/+/928310 | 00:54 |
|---|---|---|
| opendevreview | sean mooney proposed openstack/nova master: only saftey check bootable files created form glance https://review.opendev.org/c/openstack/nova/+/928829 | 00:54 |
| opendevreview | sean mooney proposed openstack/nova master: adapt to vfat support in oslo.utils https://review.opendev.org/c/openstack/nova/+/928462 | 00:55 |
| *** bauzas_ is now known as bauzas | 01:13 | |
| *** __ministry is now known as Guest3113 | 01:25 | |
| opendevreview | sean mooney proposed openstack/nova master: only saftey check bootable files created form glance https://review.opendev.org/c/openstack/nova/+/928829 | 01:27 |
| opendevreview | sean mooney proposed openstack/nova master: adapt to vfat support in oslo.utils https://review.opendev.org/c/openstack/nova/+/928462 | 01:27 |
| *** bauzas_ is now known as bauzas | 05:24 | |
| sahid | o/ | 07:58 |
| sahid | quick question guys, when we have a host ins maintenance, is there a way tp schedule VM on it? | 07:59 |
| sahid | I mean as admin | 07:59 |
| sahid | that to valid the behavior of the host | 07:59 |
| *** bauzas_ is now known as bauzas | 08:09 | |
| tobias-urdin | we usually create a instance then live migrate it to the host to test it out without enabling it for scheduling | 08:34 |
| sahid | tobias-urdin: interesting workaround thank you | 10:03 |
| sahid | btw it may be useful for an admin to have this priviledge | 10:03 |
| tis_at_teuto | Hi, not shure if this is the right place to ask but currently we have a problem mit oom-kill pcpu-instances. They got oom-killed with `oom-kill:constraint=CONSTRAINT_MEMORY_POLICY`. We use pinned cpus and nova-compute sets the the libvirt numatune.memory and numatune.memnode statically to `mode=strict` https://github.com/openstack/nova/blob/master/nova/virt/libvirt/config.py#L2812 . Is it possible to get this configurable or | 10:06 |
| tis_at_teuto | use preferred instead like mentioned in https://docs.redhat.com/en/documentation/red_hat_enterprise_linux/6/html/virtualization_tuning_and_optimization_guide/sect-virtualization_tuning_optimization_guide-numa-allocation_policy#sect-Virtualization_Tuning_Optimization_Guide-NUMA-Allocation_Policy | 10:06 |
| *** __ministry is now known as Guest3156 | 10:06 | |
| opendevreview | Merged openstack/osc-placement stable/2024.2: Update .gitreview for stable/2024.2 https://review.opendev.org/c/openstack/osc-placement/+/928358 | 11:40 |
| sean-k-mooney | tobias-urdin: sahid if you have disabeld the compute you cannot live migrate to it by defualt. to do so you have to use the old microversin and force the migration | 11:45 |
| sean-k-mooney | sahid: we intentionally do now allow this to work by defualt | 11:45 |
| sean-k-mooney | when a comptue service is disabeld you shuld be able to move instance away form it but not to it | 11:45 |
| opendevreview | Merged openstack/osc-placement stable/2024.2: Update TOX_CONSTRAINTS_FILE for stable/2024.2 https://review.opendev.org/c/openstack/osc-placement/+/928359 | 11:46 |
| sean-k-mooney | tis_at_teuto: my initall gues is that you have not defied hw:mem_page_size in your pinned instance | 11:46 |
| sean-k-mooney | tis_at_teuto: when using cpu pinnign either you need to request numa aware memory usign hw:mem_page_size or you need to configure the host for file backed memroy | 11:47 |
| sean-k-mooney | if you dont do one of those two then we expect OOM issue for the vms, its an unsupproted configuraiton. | 11:47 |
| sean-k-mooney | tis_at_teuto: we do not supprot settign the memroy policy to prefered or memory overcommit when using pinned cpus | 11:48 |
| sean-k-mooney | there was a proposal for that many many years ago but it was never implemented | 11:49 |
| *** bauzas_ is now known as bauzas | 12:12 | |
| *** bauzas_ is now known as bauzas | 12:21 | |
| opendevreview | Lajos Katona proposed openstack/nova master: docs: update libvirt support matrix for C and D https://review.opendev.org/c/openstack/nova/+/928903 | 12:29 |
| opendevreview | Lajos Katona proposed openstack/nova master: docs: update libvirt support matrix for C and D https://review.opendev.org/c/openstack/nova/+/928903 | 12:30 |
| tis_at_teuto | sean-k-mooney: Ok, thank you. I will have a look into `hw:mem_page_size`. In the meantime we mitigate the problem by configuring a swap-file. I think that is what you second approach is. | 12:30 |
| sean-k-mooney | swapfiles will only help if you have multiple of them and also mark them as related to a given numa node | 12:31 |
| sean-k-mooney | the OOM reaper runs on a per numa basis | 12:31 |
| sean-k-mooney | so even if you have lots of free swap you can still have OOM issues | 12:31 |
| sean-k-mooney | or free ram on the wrong numa node | 12:32 |
| lajoskatona | bauzas: https://review.opendev.org/c/openstack/nova/+/928903 , pushed an update for qemu/libvirt support matrix, as I see no change in it in C and D, just to be clear for end-users | 12:33 |
| sahid | sean-k-mooney: sean-k-mooney: do you remeber the microversion to use, even when i try to live-migrate on the specified host, I receive the error nova valid host was found | 12:34 |
| sean-k-mooney | force was added in 2.30 and removed in 2.68 so 2.30-2.67 | 12:35 |
| sean-k-mooney | sahid: note that force skips schdluer filters | 12:36 |
| sean-k-mooney | it just checks the host exists, placement should still confirm that there is enouch suport for basic resouces | 12:36 |
| sean-k-mooney | note that the compute status filter has been mandaory for many releases | 12:38 |
| sean-k-mooney | https://github.com/openstack/nova/blob/master/nova/scheduler/request_filter.py#L242-L255 | 12:38 |
| sean-k-mooney | so where that is not configurabel there is no way to schdule to a disabeld host by design | 12:38 |
| sean-k-mooney | ah i miss rememeberd we intoduced this as a mandatoy prefilter 5 years ago | 12:40 |
| sean-k-mooney | https://github.com/openstack/nova/commit/168d34c8d1161dc4d62493e194819297e079bb51 | 12:40 |
| sean-k-mooney | so since placment because mandatory there is not way by design to schduler to disabled computes | 12:40 |
| *** bauzas- is now known as bauzas | 13:03 | |
| bauzas | sean-k-mooney: thanks for your work on the "vfat is non-bootable so we can skip it" series, just +2d saying this is fine given oslo will support vfat checks shortly | 13:38 |
| bauzas | if not, I'd be afraid of another attack vector | 13:38 |
| sean-k-mooney | there is an oslo patch for it reference form the 3rd patch | 13:38 |
| bauzas | yes I know, hence my +2 | 13:38 |
| sean-k-mooney | im also considerign doing a quick poc of both makeing epmeral disk unformated and removing the backing files form them | 13:39 |
| sean-k-mooney | with that said i dont really have much time to look at either but since im already looking at that code i was going to spend an hour or two and see if they would be easy to do for epoxy | 13:39 |
| sean-k-mooney | the reason i choose bootable as the new flag is i think tis reasonabel to say in the qemu driver that non-bootable disk should not have backing files ever. | 13:40 |
| sean-k-mooney | but i have not really tought about all the implications yet so i didnt want to include that in this inital work | 13:41 |
| bauzas | no worries, given by 2025.1 we will be able to look at vfat, we could remove the skip for non-bootable disks | 13:43 |
| sean-k-mooney | we could thats definetly a diesign disucsison we shoudl have early in 2025.1 | 13:43 |
| sean-k-mooney | in my head im kind fo grouping this with the geneal "state of the image backends" topic | 13:44 |
| sean-k-mooney | i think this is just one of the many workitems that go into improving that going forward | 13:44 |
| *** whoami-rajat_ is now known as whoami-rajat | 14:04 | |
| opendevreview | Dmitriy Rabotyagov proposed openstack/nova master: Respect supplied arguments in novncproxy_base_url https://review.opendev.org/c/openstack/nova/+/928839 | 14:18 |
| opendevreview | Kaloyan Kotlarski proposed openstack/nova master: libvirt: Fetch the available vCPUs from the respective cgroup https://review.opendev.org/c/openstack/nova/+/927474 | 14:32 |
| sahid | alian | 15:02 |
| sahid | alianz | 15:02 |
| dansmith | sean-k-mooney: safe sounds okay to me | 15:23 |
| sean-k-mooney | ok i can go change that how would you feel about using that for skiping the backing file too? | 15:24 |
| sean-k-mooney | in a seperate patch obviously | 15:24 |
| sean-k-mooney | i.e. not haveing swap an ephmeral have backing files with qcow backend | 15:24 |
| sean-k-mooney | dansmith: ill fix the typoes ectra but were there any other concerns | 15:25 |
| sean-k-mooney | ill repin the patch after the our internal calls end | 15:25 |
| dansmith | sean-k-mooney: I have concerns about how many places you had to make that change :P | 15:27 |
| dansmith | but that's imagebackend's fault not yours | 15:27 |
| sean-k-mooney | ya at least 1 of those i was really not expecting | 15:33 |
| sean-k-mooney | we have a lot of duplication | 15:33 |
| *** bauzas_ is now known as bauzas | 15:35 | |
| opendevreview | Rajesh Tailor proposed openstack/nova master: Add support for showing finish_time https://review.opendev.org/c/openstack/nova/+/928933 | 15:55 |
| opendevreview | Dan Smith proposed openstack/nova stable/2023.1: [stable-only]: Port qcow2v2 support from oslo https://review.opendev.org/c/openstack/nova/+/928937 | 16:06 |
| bauzas | we need a second core for https://review.opendev.org/c/openstack/nova/+/928662 please :) | 16:57 |
| sean-k-mooney | that looks correct to me | 16:59 |
| bauzas | thanks | 17:01 |
| opendevreview | sean mooney proposed openstack/nova master: [DNM] testing rdo experimental jobs https://review.opendev.org/c/openstack/nova/+/927762 | 19:03 |
| opendevreview | sean mooney proposed openstack/nova master: Add functional repoducer for ephemeral disks https://review.opendev.org/c/openstack/nova/+/928310 | 19:05 |
| opendevreview | sean mooney proposed openstack/nova master: only safety check bootable files created from glance https://review.opendev.org/c/openstack/nova/+/928829 | 19:05 |
| opendevreview | sean mooney proposed openstack/nova master: adapt to vfat support in oslo.utils https://review.opendev.org/c/openstack/nova/+/928462 | 19:05 |
| opendevreview | Matthew Heler proposed openstack/nova master: Fix regression with live migration on shared storage https://review.opendev.org/c/openstack/nova/+/928970 | 21:12 |
| supamatt | Can I get reviews on this? https://review.opendev.org/c/openstack/nova/+/928970 It's a regression fix to how live migration should function on shared storage. | 21:18 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!