| *** bhagyashris_ is now known as bhagyashris|rover | 07:08 | |
| bauzas | good wet morning Nova | 07:36 |
|---|---|---|
| elodilles | good morning. wet? :-o | 07:46 |
| elodilles | here we have the last(?) shiny days of indian summer | 07:48 |
| elodilles | bauzas: btw, nova rc2 is out but I forgot about wallaby, victoria and ussuri stable releases. is it OK if I create the missing release patches? (victoria and ussuri) | 07:56 |
| elodilles | are we ready to release from stable? | 07:56 |
| elodilles | what do you think? | 07:56 |
| bauzas | elodilles: this is raining since yesterday, and I had to do the usual dogwalk, brrrrr... | 08:00 |
| bauzas | elodilles: I think we can release all but xena, that's it | 08:01 |
| elodilles | bauzas: sounds good. (not like the rain :S) | 08:01 |
| elodilles | then I'll prepare the release patches soon | 08:01 |
| bauzas | ++ | 08:01 |
| bauzas | elodilles: can't wait for your pings :) | 08:02 |
| elodilles | :] | 08:03 |
| gibi | o/ | 08:46 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/nova master: Ensure MAC addresses characters are in the same case https://review.opendev.org/c/openstack/nova/+/811947 | 08:47 |
| opendevreview | Lee Yarwood proposed openstack/nova master: WIP zuul: Remove trunk live migration testing https://review.opendev.org/c/openstack/nova/+/812266 | 08:54 |
| lyarwood | \o | 08:54 |
| elodilles | bauzas: https://review.opendev.org/q/project:openstack/releases+is:open+intopic:nova | 08:54 |
| bauzas | ack | 08:55 |
| lyarwood | ^ turns out our live migration issues are being caused by timeouts killing instances with trunk ports in previous tests, I'll write up a fresh bug for that shortly once I've been able to prove it with the above change | 08:55 |
| elodilles | wanted to wait for zuul to finish but it seems the ussuri patch will timeout :P hope it's some temporary thing... | 08:55 |
| bauzas | gibi, lyarwood: fyk, elodilles wants to release stable branches, I'm OK with it | 08:55 |
| bauzas | (not xena of course) | 08:55 |
| lyarwood | ack sounds good | 08:55 |
| bauzas | lyarwood: ack, will look at your WIP patch | 08:56 |
| elodilles | yepp: wallaby, victoria and ussrui | 08:56 |
| elodilles | * ussuri | 08:56 |
| gibi | lyarwood: nice catch, I will check that patch too | 08:56 |
| gibi | elodilles: thanks! | 08:56 |
| lyarwood | all credit goes to danpb downstream tbh | 08:56 |
| gibi | please pass it along :) | 08:57 |
| lyarwood | bauzas: https://review.opendev.org/c/openstack/nova/+/811716 & https://review.opendev.org/c/openstack/nova/+/811713 - sorry to pester you about this but if you have time early this week I'd appreciate reviews on these | 09:15 |
| lyarwood | FWIW I'm (hopefully) offline for a few weeks from Friday | 09:16 |
| bauzas | lyarwood: no worries at all, I'll label them with r-p | 09:16 |
| lyarwood | assuming I don't eat anymore sushi | 09:16 |
| bauzas | lyarwood: oh, glad to hear this if I get this correctly | 09:17 |
| lyarwood | yup it's my rescheduled op thanks :) | 09:17 |
| bauzas | :crossing_fingers_fake_emoji: | 09:18 |
| gibi | lyarwood, gmann did we just enabled trunk testing in grenade too? | 09:23 |
| lyarwood | We did yeah | 09:23 |
| gibi | then we need to revert that due to https://launchpad.net/bugs/1912310 | 09:23 |
| gibi | as well | 09:24 |
| lyarwood | yeah it's in the .zuul change | 09:24 |
| gibi | ohh, then I missed that... | 09:24 |
| lyarwood | just working on something else first but I'll write up a new bug for the trunk delete thing shortly | 09:24 |
| gibi | lyarwood: thanksd | 09:24 |
| lyarwood | just to make it easier for folks | 09:24 |
| gibi | I see the grenade part now | 09:24 |
| gibi | I guess we need to backport this zuul change to stable too | 09:25 |
| lyarwood | Yeah I would think so | 09:38 |
| lyarwood | until the underlying issue is resolved | 09:38 |
| * bauzas goes cooking | 09:45 | |
| sean-k-mooney | well fedora has a unique way of dealing with a weeks worth of eamil while im on vaction. | 10:04 |
| sean-k-mooney | evolation apparenly no longer has any of my email account set up | 10:05 |
| lyarwood | A new welcome back to work feature | 10:09 |
| kashyap | LOL | 10:10 |
| gibi | :) | 10:10 |
| kashyap | My personal happiness with email [if you can call it that] has shot up since I embraced Mutt some 6 years ago | 10:10 |
| kashyap | It's a joy to use; and I can mark a mail thread with 70 emails as "read" in one keystroke. | 10:11 |
| * kashyap stops singing its praises... | 10:11 | |
| sean-k-mooney | this might be a google porblem | 10:18 |
| sean-k-mooney | if i use minetime as a alternitive calandar app it als no longer has access to my calandar | 10:18 |
| sean-k-mooney | ok that just started working | 10:19 |
| lyarwood | did you not get the HR email? | 10:25 |
| lyarwood | /s | 10:25 |
| gibi | :D | 10:26 |
| lyarwood | reminds me of when I joined RH and they managed to email my flight details for new hire to my redhat email address, the issue being that my first day was literally the first day of new hire in Munich. | 10:26 |
| sean-k-mooney | that i abuse my eamial so badly the agree to mediate the dispute with google and terminate all my gmail account including my work and personal one | 10:27 |
| sean-k-mooney | must have missed that | 10:27 |
| gibi | this could be a global conspiracy | 10:29 |
| gibi | sean-k-mooney: probably you know something too important | 10:29 |
| sean-k-mooney | ya like dbus sucks org.freedesktop.DBus.Error.ServiceUnknown | 10:31 |
| gibi | ohh they infected your dbus too, they are really after you :] | 10:33 |
| sean-k-mooney | Process 6662 (evolution.bin) of user 1000 dumped core. maybe i should just reboot that will totally fix it right | 10:35 |
| sean-k-mooney | althouhg secretly i think that also likely tthe problem i rebooted my laptop for the first time in 4+ months | 10:36 |
| sean-k-mooney | im going to update evertyting installed via flatpack im guessing the gnome runtime is outdated and i am only now seeing that after the reboot | 10:37 |
| gibi | I always imagine dumping core like https://www.youtube.com/watch?v=xIuUEwat6aM | 10:39 |
| sean-k-mooney | nice | 10:40 |
| lyarwood | risky click of the day | 10:45 |
| gibi | I promise it is safe | 10:45 |
| sean-k-mooney | and reboot did not work so backup and reinstall the os it is just not today | 10:48 |
| sean-k-mooney | im pretty sure the flatpack version of evolution is not impoatiable with the dbus form fedora 32 | 10:49 |
| sean-k-mooney | given fedora 32 is also now unsupported its as good a time to change as any | 10:49 |
| *** jamesdenton_alt is now known as jamesdenton | 11:42 | |
| opendevreview | Lee Yarwood proposed openstack/nova master: zuul: Remove trunk live migration testing https://review.opendev.org/c/openstack/nova/+/812266 | 12:17 |
| opendevreview | Lee Yarwood proposed openstack/nova master: DNM: Test libvirtd with increased keepalive_interval https://review.opendev.org/c/openstack/nova/+/798069 | 13:00 |
| opendevreview | Lee Yarwood proposed openstack/nova master: DNM: Test nova-live-migration with openstack-two-node-centos-8-stream https://review.opendev.org/c/openstack/nova/+/812351 | 13:08 |
| opendevreview | Lee Yarwood proposed openstack/nova master: DNM: Test nova-live-migration with openstack-two-node-centos-8-stream https://review.opendev.org/c/openstack/nova/+/812351 | 13:11 |
| opendevreview | Lee Yarwood proposed openstack/nova master: DNM: Test nova-live-migration with openstack-two-node-centos-8-stream https://review.opendev.org/c/openstack/nova/+/812351 | 13:17 |
| *** haleyb|out is now known as haleyb | 13:25 | |
| opendevreview | Lee Yarwood proposed openstack/nova master: zuul: Remove trunk live migration testing https://review.opendev.org/c/openstack/nova/+/812266 | 13:30 |
| opendevreview | Lee Yarwood proposed openstack/nova master: zuul: Remove trunk live migration testing https://review.opendev.org/c/openstack/nova/+/812266 | 13:35 |
| *** TheJulia is now known as needsleep | 13:49 | |
| *** needsleep is now known as TheJulia | 13:49 | |
| gmann | lyarwood: gibi : I did not get backport things. you mean these one? enabling trunk on stable to unhide the bug ? https://review.opendev.org/q/topic:%22bug%252F1945346%22+(status:open%20OR%20status:merged) | 14:15 |
| gmann | and once bug is resolved we keep enabling it from nova side | 14:16 |
| lyarwood | yeah don't enable it on stable within the grenade jobs for now | 14:16 |
| gibi | yepp | 14:16 |
| gmann | lyarwood: ok, let me put them in WIP | 14:16 |
| gibi | lyarwood: just proposed disabling trunk testing on mater | 14:17 |
| gibi | lyarwood just proposed disabling trunk testing on master | 14:17 |
| lyarwood | yeah alongside live migration tests while we work out why it's causing instance removal to take so long | 14:17 |
| lyarwood | we've got some workarounds of removing the heartbeat timeout (-1) between libvirtd's and/or updating libvirt to >= 6.2.0 but I'd still like to address the underlying issue | 14:18 |
| lyarwood | that looking at the tempest test I think might actually be there and not within Nova | 14:18 |
| gmann | +1, done | 14:18 |
| gibi | needing 240 sec to destroy a VM is definitely interesting | 14:19 |
| tridde | So, traits... Consider a instance spun up from an image and flavor that at the time has no traits set. Later on a new CUSTOM trait is implemented, for example for compute nodes with local fast storage. That trait is set as required on some new flavors and as forbidden on all "normal" flavors including the flavor the mentioned instance was spun up from. | 14:36 |
| tridde | Later the compute node where the instance is located breaks and is evacuated. Due to the fact (if I read the code correctly) that the forbidden trait was not set in the original request_spec as it was not in the flavor at the time, it doesn't provide placement with the forbidden trait when it's to be evacuated and it might very well end up on one of those local fast storage nodes. | 14:38 |
| tridde | Would you consider this a bug, or rather the expected behaviour? | 14:39 |
| sean-k-mooney | tridde: that is expected behavior | 14:40 |
| sean-k-mooney | tridde: we make a copy of the image properties and flavor extra specs including the traits when teh instance is used | 14:40 |
| sean-k-mooney | *created | 14:41 |
| sean-k-mooney | and intentionally do not allow change made to flavors and images to affect exising instnaces | 14:41 |
| *** akekane__ is now known as abhishekk | 14:42 | |
| sean-k-mooney | tridde: this general topic has come up before but basically image properties and flavor extra specs shoudl operationally be treaded as read only | 14:42 |
| sean-k-mooney | once a vm has been created that uses the flavor or image | 14:42 |
| sean-k-mooney | the intended way to deal with this is to create a v2 version fo the flaovr and phase out the use of the old flavor | 14:43 |
| tridde | sean-k-mooney: Yeah, that's what I figured. It kind of makes sense, but at the same time makes traits somewhat less useful for steering workloads to the correct nodes. | 14:43 |
| sean-k-mooney | tridde: i have proght up the idea of allowing resize to same falvor to just update the extra specs and move the vm | 14:44 |
| sean-k-mooney | tridde: yes and no | 14:44 |
| sean-k-mooney | you are using them correctly however you need to do more forward lookign planing when usign them | 14:44 |
| tridde | Yeah, I guess the issue is when you have a long running openstack setup, with very different workloads, some instances that are very long running and some that are not. When the setup was originally done with (Liberty or Kilo IIRC), traits didn't even exist and now it's on Victoria. And I am sure there are instances still left from Liberty/Kilo time... | 14:48 |
| sean-k-mooney | tridde: can i assume you would like to see the ablity to update exising instnace with new flavor/image definition and or get a list of instnace that do not match | 14:48 |
| tridde | sean-k-mooney: Yeah, that would make sense and sounds like a good balance between the current design while still adding some more flexibility. | 14:49 |
| sean-k-mooney | in generally ^ has not been accpeted in the past but its a common pain point so it is something we are thinking about but have not a solution for yet | 14:49 |
| sean-k-mooney | tridde: link 613 is the most recent conversation on this topic https://etherpad.opendev.org/p/nova-wallaby-ptg | 14:50 |
| sean-k-mooney | tridde: i did not have time to work on any of the itmes in the agreed section since then | 14:51 |
| tridde | sean-k-mooney: Do I read correctly that recreate --flavor would not require a restart of the instance, rather just a live migration? | 14:52 |
| sean-k-mooney | no it would recreate would be a resize in that case | 14:53 |
| sean-k-mooney | i could see an enhancement later that if it was just a traits change perhaps it could live migrate | 14:54 |
| sean-k-mooney | but in general that woudl not work for arbiatry extra specs | 14:54 |
| sean-k-mooney | this is not currently resouce downstream for me or other in redhat to work on but it is something i would liek to do eventually | 14:55 |
| tridde | Ok. In our case it's a pain with lots of customer contact any time we are to reboot a customer instance in a planned fashion, so it would be very desireable not to have to do that every time we implement a new trait... | 15:03 |
| *** akekane_ is now known as abhishekk | 16:28 | |
| lyarwood | https://bugs.launchpad.net/nova/+bug/1945983/comments/2 - lyarwood-- hopefully this is easy to resolve | 16:57 |
| opendevreview | Lee Yarwood proposed openstack/nova master: DNM - Test devstack fix for bug #1945983 https://review.opendev.org/c/openstack/nova/+/812392 | 17:12 |
| * gibi has heavy feelings about how tempest testing handles microversion schemas | 17:40 | |
| _jralbert | We recently upgraded from Train to Ussuri; since then, our compute nodes which rely on libvirt and vfio mdev to provide access to vGPU slices of physical GPUs can no longer start nova-compute after a reboot. The nova-compute code around recreating assigned mdevs appears to have changed fairly significantly between these releases, and I'm wondering if anyone here knows the details to chat about them before I get into creating a bug repor | 21:23 |
| *** tbachman is now known as Guest1821 | 22:26 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!