| DoDo | Hey Guys, I'm currently trying to figure out what's the best way to deploy my homelab workload across multiple servers. I was recommended OpenStack which does seem great to create your own private cloud. However, I was intending to use Intel GPUs for my transcoding workload but since they don't really support vGPU yet I wanted to use containers instead of VMs and just pass through said GPUs. | 00:26 |
|---|---|---|
| DoDo | I know that Openstack has Zun but ultimately I'd like to run Kubernetes and the preferred way to do that is to run VMs in openstack that form a cluster. (at least that's what I was told) | 00:26 |
| DoDo | The problem with that setup is that it would require the GPUs to support vGPU. | 00:26 |
| DoDo | Is there anyway I can have my cake and eat it too? Aka: running a container cluster on Openstack with Kubernetes? | 00:26 |
| DoDo | Please mind that I'm very new to Openstack and I'm just trying to understand what's the best option for me. | 00:26 |
| *** mhen_ is now known as mhen | 01:32 | |
| DHE | DoDo: passing through entire GPUs to virtual machines should be possible. you just have to make sure an alternative graphics card is available to the host, and do the right vfio stuff. the card goes over to the VM in its entirety. | 01:41 |
| DHE | is that doable? | 01:41 |
| DoDo | The problem is that I would like to have multiple instances access my GPUs | 01:42 |
| *** __ministry is now known as Guest2936 | 01:43 | |
| DoDo | so I can't do: 1 GPU -> 1 VM | 01:43 |
| DoDo | it would either be 1 GPU (using vGPU) -> multiple VMs | 01:43 |
| DoDo | or 1 GPU -> exposed to multiple containers | 01:43 |
| DHE | okay.. yeah, that would require an SR-IOV graphics card (they exist, but also cost stupid amounts of money) or probably the container route... | 01:44 |
| DoDo | Well, any idea what's the best way to host kubernetes on Openstack? | 01:44 |
| DoDo | without running it in a VM* | 01:44 |
| DoDo | You can use Zun to run containers but this isn't kubernetes as far as I can tell | 01:45 |
| DHE | that's beyond my level of knowledge... most people run openstack under kubernetes (ie. the control plane as k8s containers)... I don't THINK there is a means of running containers under openstack | 01:46 |
| DoDo | hmmm, so it's bare metal with Kubernetes running the openstack control plane? | 01:47 |
| DHE | that's usually how openstack interacts with k8s... I don't think openstack really does "containers", or at least I've never seen it. but I could be very wrong. | 02:03 |
| DHE | I mean, kubernetes does pretty much everything openstack does as well.. scheduled, resource management, making volumes, all that... | 02:04 |
| *** __ministry is now known as Guest2944 | 04:14 | |
| *** noonedeadpunk_ is now known as noonedeadpunk | 07:29 | |
| tafkamax | <stan> "I think you should use cloud..." <- yep this was the way to go with cloud-init | 08:34 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!