EugenMayer | Today it happened the second time. A VM has been shutdown - by the audit logs by the user '-' - and i do not understand what that is and what that is causing this. Are there any ways to find out. is '-' a systemic users, or what could this stand for? | 06:26 |
---|---|---|
EugenMayer | Found this https://serverfault.com/questions/783053/openstack-instances-power-off-by-itself - not sure that is related in some way | 06:28 |
SharathCk_ | Hi, I am trying to enable Keystone audit middleware in our openstack services, But I can see placement does not contain api paste init conf or any other configuration where middleware can be added. Hence wanted to confirm whether keystone audit middleware is supported in Placement service. | 07:08 |
bauzas | good morning Nova | 07:58 |
Uggla | bauzas, I was looking at "new" upstream bugs. Is it normal that https://bugs.launchpad.net/nova/+bug/1787846 was opened 2018-08-19 ? | 08:50 |
bauzas | Uggla: yes, if the bug was previously not "New" | 08:50 |
bauzas | https://bugs.launchpad.net/nova/+bug/1787846/+activity | 08:51 |
Uggla | yep but latest update 2020-09-18 is it still relevent ? | 08:51 |
gibi | Uggla: we then to go from the newest bugs backwards in time | 08:55 |
Uggla | bauzas, gibi, should we ask to close it ? As I guess no ones would like to dig into that one and that's probably not relevent anymore ? | 08:56 |
gibi | Uggla: one way to treat it is that pike is already EOL upstream. So ask the reported to reproduce the problem on newer branch | 08:59 |
gibi | and set the bug back to Incomplete | 09:00 |
gibi | you can order the bugs from newer to older with https://bugs.launchpad.net/nova/+bugs?search=Search&field.status=New&orderby=-date_last_updated&start=0 | 09:01 |
Uggla | gibi, ok sounds good, otherwise we will keep this bug until the end of time. :) | 09:01 |
Uggla | gibi, in fact I treated several recent yesterday. But I looked at that one and was surprised by the open date and the "new" state. :) | 09:02 |
gibi | ahh OK | 09:02 |
gibi | cool then | 09:02 |
Uggla | bauzas, did you had a chance to look at https://review.opendev.org/c/openstack/nova-specs/+/831506/4/specs/zed/approved/unshelve-to-host.rst just to know if it looks ok for you ? | 09:06 |
bauzas | Uggla: not yet, will do today | 09:12 |
* bauzas has to work on a downstream bug | 09:12 | |
Uggla | bauzas, no hurries so far. | 09:15 |
bauzas | gibi: sean-k-mooney: do you remember if we verify the usage about an inventory if we create a new allocation directly by calling the Placement API ? | 10:03 |
bauzas | or do we verify it by Nova ? | 10:04 |
sean-k-mooney | you mean prevent over allocation | 10:05 |
sean-k-mooney | we prevent over allocation in placment i belive | 10:05 |
sean-k-mooney | so if two boot requests both recive an allocation_candiate for the same host in parallel and then both try to allocate that candiate only one will succeed and that is enforce by placment if im not mistaken | 10:06 |
sean-k-mooney | gibi: ^ that is correct right? or have i been fundementaly misunderstanding placment for years | 10:07 |
bauzas | sean-k-mooney: gibi: let's discuss this on downstream IRC, I have a BZ | 10:07 |
sean-k-mooney | ok just getting coffee | 10:08 |
sean-k-mooney | we can have a call if it helps | 10:08 |
sean-k-mooney | you can get into over allocation situations if the allocation ratio is change by the way | 10:08 |
sean-k-mooney | brb | 10:08 |
bauzas | I need to prepare lunch for my kid, but let's discuss this when I'm back | 10:18 |
gibi | sorry I was having lunch | 11:12 |
gibi | but overall yes, placement prevent overallocation via allocation creation, placement does not prevent overallocation via inventory modification (i.e changing allocation ratio, reserved, or total field) | 11:13 |
sean-k-mooney | right and when you go into an overallocated situation via inventory modifcaiotn placemnt allows you to free allocaitons agaisnt that inventory but wont allow you to crate new ones until you have enough capsity | 11:14 |
sean-k-mooney | so we have seen that were people have updated the cpu_pin_set or altered the allocation raitos and over commited it can prevent things like evacuate form working | 11:15 |
sean-k-mooney | since evacuate currently uses one allcoation isntead of two | 11:16 |
gibi | yes | 11:22 |
gibi | for all tree | 11:23 |
gibi | three | 11:23 |
gibi | in an overallocation situation inventory can change but allocation cannot | 11:23 |
gibi | except removal | 11:23 |
gibi | so you can delete allocations | 11:23 |
gibi | and yes evac is special as it needs to modify the single allocation of the VM | 11:25 |
gibi | hm but non evacuation also needs to move the VM allocation from the VM uuid to the migration uuid so that would fail too in an overallocation | 11:27 |
gibi | this is suboptimal as it prevents cleaning up an overallocated host by moving VMs out | 11:27 |
gibi | so I would temporary remove the overallocation by bumping allocation ratio high up, move the VMs out, and then restore the allocation ratio | 11:28 |
sean-k-mooney | ya that is the workaround for now | 11:28 |
sean-k-mooney | ideally we woudl mvoe to useing the migration object to track either the source or dest allcoations | 11:29 |
sean-k-mooney | im not sure bauzas case was related to evac | 11:29 |
sean-k-mooney | we can see when they are back | 11:29 |
gibi | and we would also need to special case the allocation update that only change consumer uuid, in placement to be allowed even in overallocated situation | 11:30 |
gibi | yepp, I checked decreasing allocation is rejected, but deleting allocation is accepted in overallocation case | 11:39 |
opendevreview | Pavlo Shchelokovskyy proposed openstack/nova master: Sort PCI devices by their address https://review.opendev.org/c/openstack/nova/+/830136 | 12:37 |
*** dasm|off is now known as dasm | 13:15 | |
opendevreview | Alexey Stupnikov proposed openstack/nova stable/wallaby: Test aborting queued live migration https://review.opendev.org/c/openstack/nova/+/841483 | 14:09 |
opendevreview | Hervé Beraud proposed openstack/nova-specs master: Fix typo https://review.opendev.org/c/openstack/nova-specs/+/841600 | 14:15 |
opendevreview | Hervé Beraud proposed openstack/nova-specs master: Fix typo https://review.opendev.org/c/openstack/nova-specs/+/841600 | 14:17 |
opendevreview | Merged openstack/nova-specs master: Fix typo https://review.opendev.org/c/openstack/nova-specs/+/841600 | 16:09 |
opendevreview | Gorka Eguileor proposed openstack/nova master: Fix extending non LUKSv1 encrypted volumes https://review.opendev.org/c/openstack/nova/+/836064 | 16:54 |
geguileo | stephenfin: I had to change the commit message, could you +2 it again, please: https://review.opendev.org/c/openstack/nova/+/836064 | 16:58 |
geguileo | sean-k-mooney: ^ | 16:58 |
stephenfin | done | 16:58 |
geguileo | stephenfin: wow, that was quick, thanks :-) | 16:58 |
sean-k-mooney | geguileo: ill take a look again shortly too | 17:22 |
sean-k-mooney | ah stephen put it back in the gate | 17:22 |
sean-k-mooney | cool | 17:22 |
mnaser | sean-k-mooney: do you think the `hw:mlock` thing deserves a full-on spec as well if we want to do that as well? | 17:32 |
mnaser | (i.e. https://review.opendev.org/c/openstack/nova/+/778347) | 17:33 |
mnaser | if so, i can try and ask ricolin to work on that as well | 17:33 |
sean-k-mooney | technically its a seperate feature which could be a seperate spec but im ok to combine the to unless others want it split out | 17:34 |
sean-k-mooney | i can unabandone that if you like if ricolin wants to take over the patch | 17:35 |
sean-k-mooney | my inital patch technically does not enfoce that you ahve a mem_page_size | 17:36 |
sean-k-mooney | so it can lead to OOM issues | 17:36 |
sean-k-mooney | but it was functional | 17:36 |
sean-k-mooney | it looks like artom and stephenfin had a prference for hw:locked_memory instead of hw:mlock | 17:37 |
sean-k-mooney | so it proably makes sense to at least make that change | 17:37 |
sean-k-mooney | i was ment ot re review the viommu spec today too sorry ricolin | 17:37 |
sean-k-mooney | ill try and get back to it tomorrow but likely wont get to it today | 17:38 |
opendevreview | Artom Lifshitz proposed openstack/nova stable/wallaby: DNM: Testing stuff https://review.opendev.org/c/openstack/nova/+/841626 | 18:15 |
*** dasm is now known as dasm|off | 21:11 | |
*** prometheanfire is now known as Guest0 | 22:26 | |
ricolin | sean-k-mooney: yeah, I can help with the mlock patch, and thanks for your review:) | 23:29 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!