*** nsegkos has joined #openstack | 00:00 | |
*** nksegos has quit IRC | 00:01 | |
*** nsegkos is now known as nksegos | 00:01 | |
*** cyberworm54 has quit IRC | 00:15 | |
*** cyberworm54 has joined #openstack | 00:16 | |
*** nksegos has quit IRC | 00:32 | |
*** macz_ has quit IRC | 00:40 | |
*** jv has joined #openstack | 01:01 | |
*** Yarboa has quit IRC | 01:03 | |
*** Yarboa has joined #openstack | 01:05 | |
*** Goneri has quit IRC | 01:30 | |
*** Yarboa has quit IRC | 02:03 | |
*** Yarboa has joined #openstack | 02:04 | |
*** gavlee has quit IRC | 02:40 | |
*** gavlee has joined #openstack | 02:44 | |
*** Yarboa has quit IRC | 03:03 | |
*** Yarboa has joined #openstack | 03:03 | |
*** rcernin has quit IRC | 03:04 | |
*** rcernin has joined #openstack | 03:18 | |
*** rcernin has quit IRC | 03:21 | |
*** rcernin has joined #openstack | 03:22 | |
*** gudrutis has quit IRC | 03:31 | |
*** gudrutis has joined #openstack | 03:31 | |
*** Yarboa has quit IRC | 03:54 | |
*** Yarboa has joined #openstack | 03:54 | |
*** manuvakery_ has joined #openstack | 05:05 | |
*** rockie has joined #openstack | 05:05 | |
*** rvd has quit IRC | 05:08 | |
*** rcernin has quit IRC | 05:22 | |
*** zbsarashki has quit IRC | 05:29 | |
*** rcernin has joined #openstack | 05:32 | |
*** kmarc has quit IRC | 05:53 | |
*** gyee has quit IRC | 05:55 | |
oasiz | Just an update, but I got the devstack fully installed after the pip downgrade. Since IRC is the best documentation platform, what I did to get this to run on 18.04: You can still find a readily available installer as python3-pip_18.1-5_all.deb - extracting with ar -x , the structure is /usr/lib/python3 instead of /usr/lib/python3.6 that's with normal apt version -- manually replacing the files and as an extra step I commented the call in i | 06:01 |
---|---|---|
oasiz | There are more elegant solution available but at least this did the trick and script.sh ran well. I assume there will be more questions about this now that stack.sh won't work out of the box with the current guide. | 06:02 |
*** Yarboa has quit IRC | 06:03 | |
*** Yarboa has joined #openstack | 06:03 | |
*** rcernin has quit IRC | 06:12 | |
*** tips has quit IRC | 06:18 | |
*** matt_kosut has joined #openstack | 06:19 | |
*** hamalq has quit IRC | 06:21 | |
*** hamalq has joined #openstack | 06:22 | |
*** pppingme has quit IRC | 06:32 | |
*** klamath_atx has quit IRC | 06:47 | |
*** abdysn has joined #openstack | 06:52 | |
*** gmoro has joined #openstack | 06:55 | |
*** ladrua has quit IRC | 06:55 | |
*** ladrua has joined #openstack | 06:55 | |
*** ladrua has quit IRC | 06:55 | |
*** ladrua has joined #openstack | 06:56 | |
*** ladrua has quit IRC | 06:56 | |
*** ladrua has joined #openstack | 06:56 | |
*** ladrua has quit IRC | 06:57 | |
*** ladrua has joined #openstack | 06:57 | |
*** ladrua has quit IRC | 06:58 | |
*** ladrua has joined #openstack | 06:58 | |
*** ladrua has quit IRC | 06:59 | |
*** ladrua has joined #openstack | 06:59 | |
*** ladrua has quit IRC | 06:59 | |
*** ladrua has joined #openstack | 07:00 | |
*** ladrua has quit IRC | 07:00 | |
*** ladrua has joined #openstack | 07:01 | |
*** ladrua has quit IRC | 07:01 | |
*** ladrua has joined #openstack | 07:01 | |
*** ladrua has quit IRC | 07:02 | |
*** ladrua has joined #openstack | 07:02 | |
*** ladrua has quit IRC | 07:03 | |
*** ladrua has joined #openstack | 07:03 | |
*** ladrua has quit IRC | 07:03 | |
*** ueha has joined #openstack | 07:18 | |
*** belmoreira has joined #openstack | 07:21 | |
*** pcaruana has joined #openstack | 07:46 | |
*** def_jam is now known as eblip | 07:51 | |
*** slaweq has joined #openstack | 07:52 | |
*** luksky has joined #openstack | 07:56 | |
*** pppingme has joined #openstack | 07:56 | |
*** tesseract has joined #openstack | 07:56 | |
*** rpittau|afk is now known as rpittau | 07:59 | |
*** jcapitao has joined #openstack | 08:00 | |
*** andrewbonney has joined #openstack | 08:03 | |
*** ChosSimbaOne has left #openstack | 08:10 | |
*** takamatsu has quit IRC | 08:13 | |
*** takamatsu has joined #openstack | 08:15 | |
*** bengates has joined #openstack | 08:18 | |
*** avisiedo has quit IRC | 08:46 | |
*** mulbc has quit IRC | 08:51 | |
*** mulbc has joined #openstack | 08:53 | |
*** takamatsu has quit IRC | 08:53 | |
*** takamatsu has joined #openstack | 08:54 | |
*** avisiedo has joined #openstack | 08:59 | |
*** Yarboa has quit IRC | 09:03 | |
*** shyamb has joined #openstack | 09:07 | |
*** adeberg has quit IRC | 09:09 | |
*** adeberg has joined #openstack | 09:12 | |
*** rockie has quit IRC | 09:15 | |
*** Yarboa has joined #openstack | 09:15 | |
*** rockie has joined #openstack | 09:16 | |
*** PabloMartinez has joined #openstack | 09:48 | |
*** imega has joined #openstack | 10:06 | |
*** sergiuw has joined #openstack | 10:12 | |
*** jv has quit IRC | 10:17 | |
*** jonaspaulo has joined #openstack | 10:24 | |
*** bengates has quit IRC | 10:40 | |
*** shyamb has quit IRC | 10:41 | |
*** bengates has joined #openstack | 10:41 | |
*** bengates_ has joined #openstack | 10:42 | |
*** bengates has quit IRC | 10:46 | |
*** bengates_ has quit IRC | 10:57 | |
*** bengates has joined #openstack | 10:57 | |
*** shyamb has joined #openstack | 10:57 | |
*** waverider has joined #openstack | 11:09 | |
*** RickDeckard has joined #openstack | 11:09 | |
*** Dantalion has quit IRC | 11:10 | |
*** bengates has quit IRC | 11:13 | |
*** bengates has joined #openstack | 11:14 | |
*** jonaspaulo has quit IRC | 11:29 | |
*** Dantalion has joined #openstack | 11:32 | |
*** nksegos has joined #openstack | 11:35 | |
*** adrianc has quit IRC | 11:39 | |
*** jcapitao is now known as jcapitao_lunch | 11:39 | |
*** bengates_ has joined #openstack | 11:41 | |
*** bengates_ has quit IRC | 11:42 | |
*** bengates_ has joined #openstack | 11:42 | |
*** adrianc has joined #openstack | 11:44 | |
*** bengates has quit IRC | 11:45 | |
*** TeamDevOps has joined #openstack | 11:45 | |
*** adrianc has quit IRC | 11:46 | |
*** bengates_ has quit IRC | 11:50 | |
*** TeamDevOps has quit IRC | 11:50 | |
*** bengates has joined #openstack | 11:51 | |
*** shyam89 has joined #openstack | 11:54 | |
*** adrianc has joined #openstack | 11:55 | |
*** shyam89 has quit IRC | 11:56 | |
*** shyamb has quit IRC | 11:58 | |
*** adrianc has quit IRC | 12:00 | |
*** adrianc has joined #openstack | 12:04 | |
*** bbowen has quit IRC | 12:05 | |
*** bbowen has joined #openstack | 12:08 | |
*** mrtadis has quit IRC | 12:15 | |
*** manuvakery_ has quit IRC | 12:22 | |
*** Diplomat has joined #openstack | 12:33 | |
Diplomat | Hey! Can anyone help me with networking please. I created a VM with a private network (10.100.0.0/16) and 2 VMs can connect to each other without any issues + both can ping the gateway IP 10.100.0.1, but unfortunately they don't have external internet connection. I created a public network with a public subnet and set up router and assigned floating IPs to both VMs but yeah. No sure what to do. | 12:38 |
Diplomat | When I'm pinging 8.8.8.8 for example then I can see packets in tap, bridge and vxlan, but those packets don't want to go to the public interface for some reason. | 12:39 |
Diplomat | This is my linuxbridge config in controller: https://dpaste.org/Gtec and this is in my controller https://dpaste.org/fKgN | 12:41 |
Diplomat | compute* | 12:43 |
Diplomat | Also, floating IP addresses are pingable | 12:44 |
*** jcapitao_lunch is now known as jcapitao | 12:52 | |
*** bengates has quit IRC | 13:06 | |
*** damien_r has quit IRC | 13:06 | |
*** bengates has joined #openstack | 13:08 | |
*** abdysn has quit IRC | 13:12 | |
*** Dantalion has quit IRC | 13:18 | |
*** damien_r has joined #openstack | 13:19 | |
*** jv has joined #openstack | 13:20 | |
*** Dantalion has joined #openstack | 13:21 | |
admin0 | Diplomat, how does it look inside the router namespace ? | 13:23 |
Diplomat | admin0: It was the same in the router namespace | 13:24 |
admin0 | you need to login inside the router namespace and then check if the ips are correect, gw is correct | 13:24 |
admin0 | and then from the namespace find out the bridge | 13:25 |
admin0 | and from the bridge to the outgoing interface | 13:25 |
*** ueha has quit IRC | 13:29 | |
Diplomat | admin0: When I do route -n in router namespace then the gateway is correct, yes | 13:31 |
Diplomat | 10.100.0.0 -> 0.0.0.0 -> my public subnet gateway | 13:32 |
Diplomat | I'm not super sure how to find the bridge and outgoing interface from there | 13:32 |
*** slaweq has quit IRC | 13:34 | |
Diplomat | Ah interesting.. The gateway interface is qg-6a3e54ca-63 but when I do ifconfig it shows a wrong IP address there. The gateway is A.B.C.97 but qg-6a3e54ca-63's IP is A.B.C.100 | 13:34 |
Diplomat | Yeah, A.B.C.100 is set as "External Gateway" in the router | 13:36 |
*** slaweq has joined #openstack | 13:36 | |
*** sshnaidm has quit IRC | 13:38 | |
*** cmorey has joined #openstack | 13:41 | |
*** Goneri has joined #openstack | 13:43 | |
*** sshnaidm has joined #openstack | 13:46 | |
*** sshnaidm has quit IRC | 13:48 | |
*** damien_r has quit IRC | 13:49 | |
*** rockie has quit IRC | 13:57 | |
*** zbsarashki has joined #openstack | 13:59 | |
*** pcaruana has quit IRC | 14:03 | |
*** admin0 has quit IRC | 14:03 | |
*** chrome0 has quit IRC | 14:04 | |
*** chrome0 has joined #openstack | 14:06 | |
*** pcaruana has joined #openstack | 14:14 | |
*** damien_r has joined #openstack | 14:27 | |
*** morazi has quit IRC | 14:29 | |
*** tips has joined #openstack | 14:32 | |
*** sergiuw has quit IRC | 14:40 | |
*** morazi has joined #openstack | 14:42 | |
*** admin0 has joined #openstack | 14:48 | |
*** sergiuw has joined #openstack | 14:49 | |
*** pcaruana has quit IRC | 15:01 | |
*** pcaruana has joined #openstack | 15:02 | |
*** nurdie has joined #openstack | 15:15 | |
*** waverider has quit IRC | 15:16 | |
LarsErikP | Has anyone tried to nova with vgpu on the A100 yet? I'm experiencing some weird bugs.. | 15:17 |
*** mrtadis has joined #openstack | 15:33 | |
*** RickDeckard has quit IRC | 15:35 | |
*** pcaruana has quit IRC | 15:36 | |
*** arnoldoree has quit IRC | 15:43 | |
*** pcaruana has joined #openstack | 15:49 | |
*** jmcvaughn has quit IRC | 15:49 | |
*** jmcvaughn has joined #openstack | 15:51 | |
*** irclogbot_0 has quit IRC | 15:53 | |
jrosser | LarsErikP: what are you seeing? | 15:56 |
*** irclogbot_3 has joined #openstack | 15:58 | |
*** sshnaidm has joined #openstack | 16:05 | |
*** irclogbot_3 has quit IRC | 16:11 | |
*** irclogbot_0 has joined #openstack | 16:13 | |
*** RickDeckard has joined #openstack | 16:13 | |
*** macz_ has joined #openstack | 16:15 | |
*** macz_ has quit IRC | 16:17 | |
*** noogie has quit IRC | 16:26 | |
*** bengates has quit IRC | 16:40 | |
*** bengates has joined #openstack | 16:42 | |
*** noogie has joined #openstack | 16:49 | |
*** bengates_ has joined #openstack | 16:50 | |
*** bengates has quit IRC | 16:52 | |
*** jcapitao has quit IRC | 16:57 | |
*** bengates_ has quit IRC | 16:59 | |
*** bengates has joined #openstack | 17:00 | |
*** rpittau is now known as rpittau|afk | 17:01 | |
*** ladrua has joined #openstack | 17:06 | |
*** nksegos has quit IRC | 17:09 | |
*** gyee has joined #openstack | 17:23 | |
*** tesseract has quit IRC | 17:30 | |
*** samuelb has quit IRC | 17:40 | |
*** samuelbernardo has joined #openstack | 17:41 | |
*** bengates has quit IRC | 17:43 | |
*** jangutter_ has joined #openstack | 18:00 | |
*** jangutter has quit IRC | 18:02 | |
*** jangutter_ has quit IRC | 18:21 | |
*** jangutter has joined #openstack | 18:22 | |
*** jangutter has quit IRC | 18:39 | |
*** jangutter has joined #openstack | 18:39 | |
*** andrewbonney has quit IRC | 18:40 | |
*** jangutter has quit IRC | 18:40 | |
*** jangutter has joined #openstack | 18:41 | |
*** pppingme has quit IRC | 18:49 | |
Diplomat | Alrighty, I got my gateway IP correct, but yeah.. it didn't help. It seems like bridge is not sending traffic to the public Nic for some reason | 18:55 |
Diplomat | I can't find any errors too to see what's wrong | 18:55 |
Diplomat | Here's tcpdump from my bridge in compute node https://dpaste.org/XELC | 18:58 |
Diplomat | Here's route -n from my router https://dpaste.org/vFMC | 19:04 |
Diplomat | Also, it's possible to ping the private subnet's gateway and public subnet's gateway from the router: https://dpaste.org/T1HJ | 19:08 |
LarsErikP | jrosser: it's using SR-IOV, and thus exposes 16 VFs as resource providers to placement. When a physical card is filled up with vGPUs, nova-compute from some reason tries to update a (seemingly random) resource provider, and throws a python stacktrace.. I can post the stacktrace tomorrow | 19:08 |
jrosser | LarsErikP: I’ve done vgpu prototype on T4 (I don’t have my A100 yet) and done it with vgpu/mdev | 19:10 |
LarsErikP | jrosser: is the T4 using for SR-IOV as well? | 19:10 |
jrosser | you can only divide into a maximum of 7 parts afaik and it’s very different to sriov on a nic | 19:11 |
jrosser | you’ve got the nvidia grid driver? | 19:11 |
LarsErikP | yeah. vgpu 11.2 | 19:11 |
LarsErikP | it ships a tool to enable sr-iov on the card, which is needed to utilize vGPU (not running MIG), and that tool creates 16 VFs.. | 19:12 |
jrosser | with the t4 out of the box and no enabling of sriov I was able to follow this https://docs.openstack.org/nova/latest/admin/virtual-gpu.html and get it working relatively easily, like 1 day of fiddling | 19:14 |
jrosser | mostly spent forcing the grid driver to install on Ubuntu when it demands RHEL | 19:15 |
*** sshnaidm has quit IRC | 19:15 | |
LarsErikP | right. I've also had success with the V100 - but that card don't need sr-iov | 19:15 |
LarsErikP | wow. you actually found a stable way to run that driver on ubuntu? | 19:16 |
LarsErikP | I just didn't bother, and we ended up with running CentOS on the GPU nodes | 19:16 |
jrosser | unpack the driver .run file and symlink up some lib64 dirs to be in the same place as centos/rhel and it seems ok | 19:17 |
LarsErikP | interesting.. | 19:17 |
jrosser | there’s a -x or something which unpacks it rather than installs | 19:17 |
*** sshnaidm has joined #openstack | 19:18 | |
jrosser | tbh I think with the t4 I would have been using mig though | 19:18 |
*** ladrua has quit IRC | 19:19 | |
LarsErikP | but does the T4 support sr-iov? | 19:19 |
*** ladrua has joined #openstack | 19:19 | |
*** takamatsu has quit IRC | 19:19 | |
jrosser | well I’m not sure, and as I say I don’t yet have an a100 but was expecting to do mig on them both | 19:21 |
*** nksegos has joined #openstack | 19:35 | |
LarsErikP | i don't think MIG will make a difference here.. | 19:35 |
LarsErikP | you would still need nova to create a mdev for the vGPU | 19:36 |
*** nksegos has quit IRC | 19:36 | |
LarsErikP | but you managed to use the T4 with vgpu, without enabling sr-iov? That's interesing. I could try on the A100 as well, but I don't think it will work at all. Because without enablig sriov, there is no mdev_bus in sysfs.. | 19:37 |
*** luksky has quit IRC | 19:43 | |
*** cmorey has quit IRC | 19:43 | |
*** luksky has joined #openstack | 19:43 | |
jrosser | LarsErikP: I can take a closer look tomorrow | 19:46 |
LarsErikP | thanks! | 19:48 |
*** klamath_atx has joined #openstack | 19:54 | |
*** nksegos has joined #openstack | 20:07 | |
*** Zoup has joined #openstack | 20:12 | |
*** pcaruana has quit IRC | 20:27 | |
*** imega has quit IRC | 20:28 | |
*** damien_r has quit IRC | 20:47 | |
*** belmoreira has quit IRC | 20:53 | |
*** ladrua has quit IRC | 21:20 | |
*** rcernin has joined #openstack | 21:24 | |
*** matt_kosut has quit IRC | 21:36 | |
*** RickDeckard has quit IRC | 21:37 | |
*** jmcvaughn has quit IRC | 21:42 | |
*** slaweq has quit IRC | 21:47 | |
*** matt_kosut has joined #openstack | 21:48 | |
*** slaweq has joined #openstack | 21:49 | |
*** matt_kosut has quit IRC | 21:49 | |
*** jmcvaughn has joined #openstack | 21:50 | |
*** matt_kosut has joined #openstack | 21:53 | |
*** matt_kosut has quit IRC | 21:57 | |
*** gyee has quit IRC | 22:04 | |
*** gyee has joined #openstack | 22:05 | |
*** Goneri has quit IRC | 22:07 | |
*** ddstreet has quit IRC | 22:10 | |
*** ddstreet has joined #openstack | 22:10 | |
*** Goneri has joined #openstack | 22:27 | |
*** muhaha has joined #openstack | 22:39 | |
*** luksky has quit IRC | 22:42 | |
*** luksky has joined #openstack | 22:56 | |
*** slaweq has quit IRC | 22:56 | |
*** nurdie has quit IRC | 23:05 | |
*** Zoup has quit IRC | 23:10 | |
*** sergiuw has quit IRC | 23:17 | |
*** nurdie has joined #openstack | 23:21 | |
*** nurdie has quit IRC | 23:25 | |
*** luksky has quit IRC | 23:26 | |
*** aluria has quit IRC | 23:33 | |
*** aluria has joined #openstack | 23:34 | |
*** wallacer has quit IRC | 23:34 | |
*** muhaha has quit IRC | 23:37 | |
*** klamath_atx has quit IRC | 23:39 | |
*** wallacer has joined #openstack | 23:40 | |
*** klamath_atx has joined #openstack | 23:47 | |
*** sergiuw has joined #openstack | 23:52 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!