| *** mhen_ is now known as mhen | 01:51 | |
| *** elodilles_pto is now known as elodilles | 05:53 | |
| gibi | FYI Finally I got my ceph bug tracker account approved so I filed https://tracker.ceph.com/issues/72203 about the stack allocation error issue we saw in nova-ceph-multistore last week with v19.2.1 | 07:11 |
|---|---|---|
| *** bauzas0 is now known as bauzas | 09:45 | |
| opendevreview | Balazs Gibizer proposed openstack/nova master: [pci]Keep used dev in Placement regardless of dev_spec https://review.opendev.org/c/openstack/nova/+/954149 | 11:09 |
| opendevreview | Kamil Sambor proposed openstack/nova master: Replace eventlet.event.Event with threading.Event https://review.opendev.org/c/openstack/nova/+/949754 | 12:01 |
| *** ykarel_ is now known as ykarel | 12:40 | |
| opendevreview | Balazs Gibizer proposed openstack/nova master: [pci]Keep used dev in Placement regardless of dev_spec https://review.opendev.org/c/openstack/nova/+/954149 | 14:21 |
| gibi | if somebody has an inclination to review bugfixes in our PCI tracker / PCI in Placement codepath then there are two bugfix series ready for review | 14:28 |
| gibi | * https://review.opendev.org/q/topic:%22bug/2115729%22 - this fixes an ugly but simple device removal inefficency | 14:28 |
| gibi | * https://review.opendev.org/q/topic:%22bug/2115905%22 - this is a more complicated fix about allocated but removed devices | 14:28 |
| aravindh4murugesan | sean-k-mooney: I created a GPU alias for our L40s Passthrough. The flavors are created with proper metadata and the VM is assigned to the correct GPU host. However, the VM boot logs in horizon shows nothing and console says "Guest has not initalized display yet". I can not ssh to this VM either. Our goal is to run headless GPU workloads in the VM, kinda confused where this is stuck? | 17:16 |
| aravindh4murugesan | For this usecase, I'm using host-passthrough as the CPU model | 17:16 |
| sean-k-mooney | aravindh4murugesan: gpu passthohg and vnc are seperate things. in general we recommend setting hw_video_model=none when using gpu passhtough | 17:17 |
| aravindh4murugesan | sean-k-mooney: But if I set to none, will I be able to control the VM over console? | 17:18 |
| sean-k-mooney | having both an emulated gpu and a pasthough gpu can somethime prevent the guest form booting | 17:18 |
| sean-k-mooney | in genral no, while that is technially possibel to do at the libvirt level its not supported in openstack | 17:18 |
| sean-k-mooney | you can via the serial console but not via vnc | 17:19 |
| sean-k-mooney | you likely dont have the serial console deployed and configured | 17:19 |
| aravindh4murugesan | Oh I see, so I will have to set it to hw_video_model=none on image, (is this a valid meta on flavor?) and ssh from other vms those should be fine right? | 17:19 |
| sean-k-mooney | i dont think so the *_model options are normaly only valid on the image | 17:20 |
| sean-k-mooney | we may have added supprot for the video model but i would have to check | 17:20 |
| sean-k-mooney | no we supprot hw_video:ram_max_mb in the falvor but not hw:video_model | 17:22 |
| aravindh4murugesan | sean-k-mooney: Allow me a minute, I'm adding this to my image and see if that works. | 17:22 |
| sean-k-mooney | you will need to create a new vm | 17:22 |
| sean-k-mooney | for the upstad image properies to take effect | 17:22 |
| aravindh4murugesan | Okay if its not available on flavor, I will maintain a separate images for GPU hosts. | 17:23 |
| aravindh4murugesan | Yes new vm in progress | 17:23 |
| aravindh4murugesan | sean-k-mooney: I created the VM now. It shows VM has no display configured as expected. I'm waiting for a while and checking if the Ping works from the nearby vm on the same subnet | 17:25 |
| sean-k-mooney | you can use "openstack server console log show <uuid>" to view the console log of the boot process | 17:25 |
| sean-k-mooney | assumign the image's kernel is configured to log kernel logs to the serial port | 17:26 |
| sean-k-mooney | thats aviable in horizon too | 17:26 |
| aravindh4murugesan | That command is showing empty logs. the console subcommand was not found in server, but openstack console log show worked, but returned zero logs | 17:28 |
| aravindh4murugesan | I can get logs for CPU only VM this way fine | 17:28 |
| aravindh4murugesan | Same image was used. We use Ubuntu 24 Cloud img from canonical to test our changes | 17:28 |
| aravindh4murugesan | sean-k-mooney: I apologize for bugging you often, but this GPU stuff are pretty new to me, so trying to make sense of it. | 17:30 |
| sean-k-mooney | hum its hard to say without logs from the vm about what is happeing. in theory it shoudl work but it sound like there is something happingn with the boot process. | 17:30 |
| aravindh4murugesan | sean-k-mooney: is there anything from virsh that can help understand whats going on? | 17:31 |
| sean-k-mooney | the reason i mentioned the boot issue is because on windows 11 and the ubuntu installer i have to have at most 1 gpus for it to work properly in my libvirt vms. once installed i have got ubuntu server to boot with both a passthough gpu and virtio gpu but i have seen it be quite picky | 17:32 |
| sean-k-mooney | what you kind fo need to do is change the kernel boot args. you could try using a cirror rescuse image. that wont have supprot fo the gpu but it might be able to boot enouch for you to ssh in and update grub config on the ubunut boot partion to enable early cosole kernel looging | 17:33 |
| sean-k-mooney | you could also enabel the qemu boot menu instead | 17:34 |
| sean-k-mooney | i.e. if you dont disable the video model and can see can bios output you coudl edit the grub commandlien that way | 17:34 |
| sean-k-mooney | if you have virsh adcess then yes you could use virsh console and also virsh reset? to reboot the vm and try and edit grub directly | 17:35 |
| aravindh4murugesan | I'm booting this from a volume, not sure if I can rescue it with cirros image. But let me give it a shot | 17:35 |
| aravindh4murugesan | I have virsh access | 17:35 |
| sean-k-mooney | you can but you might need to set some image properties. BFV needs the stable rescue feature to support rescue | 17:36 |
| aravindh4murugesan | Is there anything I can do with virsh now? | 17:37 |
| aravindh4murugesan | When I do virsh console, its says connected, but I cannot type anything to it | 17:37 |
| aravindh4murugesan | I will also test your suggestion on rescue image and see if I can get something out of it | 17:39 |
| opendevreview | Merged openstack/nova stable/2025.1: Fix neutron client dict grabbing https://review.opendev.org/c/openstack/nova/+/953737 | 19:05 |
| opendevreview | Wesley Hershberger proposed openstack/nova stable/2024.2: Use dict object for request_specs_dict in the _list_view https://review.opendev.org/c/openstack/nova/+/955310 | 20:26 |
| opendevreview | Wesley Hershberger proposed openstack/nova stable/2024.1: Use dict object for request_specs_dict in the _list_view https://review.opendev.org/c/openstack/nova/+/955305 | 20:26 |
| *** EugenMayer4401803 is now known as EugenMayer440180 | 21:28 | |
| opendevreview | Merged openstack/nova master: api: Add response body schemas for server external events API https://review.opendev.org/c/openstack/nova/+/940508 | 21:43 |
Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!