| opendevreview | Qihui Zhao proposed openstack/project-config master: to create a new repo under cfn for a new-initiated sub-group heteregeneous distributed training framework https://review.opendev.org/c/openstack/project-config/+/949549 | 01:39 |
|---|---|---|
| opendevreview | Qihui Zhao proposed openstack/project-config master: [200~to create a new repo under cfn for a new-initiated sub-group heteregeneous distributed training framework https://review.opendev.org/c/openstack/project-config/+/949552 | 01:57 |
| opendevreview | Qihui Zhao proposed openstack/project-config master: to create a new repo for a cfn new launched sub-group heterogeneous distributed training framework https://review.opendev.org/c/openstack/project-config/+/949555 | 03:31 |
| opendevreview | Qihui Zhao proposed openstack/project-config master: to create a new repo for a cfn new launched sub-group heterogeneous distributed training framework https://review.opendev.org/c/openstack/project-config/+/949555 | 03:33 |
| opendevreview | Qihui Zhao proposed openstack/project-config master: to create a new repo for a cfn new launched sub-group heterogeneous distributed training framework https://review.opendev.org/c/openstack/project-config/+/949555 | 03:42 |
| ralonsoh | hi folks, I've opened a bug for cloud-images: https://bugs.launchpad.net/cloud-images/+bug/2110520 | 08:32 |
| ralonsoh | the only difference I see is the /proc/sys/net/ipv4/igmp_qrv value, that is not set in Jammy | 08:32 |
| frickler | ralonsoh: might be helpful to add information about the kernel versions that get used both in focal and jammy. you might also want to check whether the newer kernel is available on focal as hwe kernel, so that you could test both with the same kernel version | 08:58 |
| ralonsoh | frickler, sure, I'll add this info | 09:05 |
| ykarel | @ralonsoh, setting that sysctl value manually helps in this issue? | 10:44 |
| ralonsoh | ykarel, no, I can't set it | 10:44 |
| ralonsoh | I think this is a kernel issue, this is not happening in Noble (we have another problems with 24.04) | 10:45 |
| ykarel | ralonsoh, ohhhk | 10:45 |
| *** tosky_ is now known as tosky | 12:27 | |
| ykarel | ralonsoh, can you try non minimal generic image to see if that works https://cloud-images.ubuntu.com/jammy/current/jammy-server-cloudimg-amd64.img ? | 14:05 |
| ykarel | checked locally, atleast it have that sysctl option set | 14:06 |
| fungi | ykarel: as frickler suggested, there may be newer kernel packages available for jammy https://askubuntu.com/questions/248914/what-is-hardware-enablement-hwe | 14:09 |
| ralonsoh | ykarel, I'll try this after the meeting, sure | 14:10 |
| ykarel | fungi, with above test ruling out issue only with linux-kvm kernel, linux-generic all good | 14:13 |
| fungi | oh, even better | 14:14 |
| ykarel | i.e jammy generic kernel should already be good, issue only with jammy-kvm kernel | 14:14 |
| fungi | so not a kernel version issue, just a kernel config issue | 14:14 |
| ykarel | yeap | 14:14 |
| fungi | "neat" | 14:15 |
| ykarel | feels like that only, test will confirm | 14:15 |
| fungi | love those | 14:15 |
| ralonsoh | focal and noble allow these igmp messages, it seems that is only incorrectly set in jammy | 14:20 |
| ralonsoh | and yes, this is only for linux-kvm image | 14:21 |
| ralonsoh | (testing now with jammy-server) | 14:21 |
| ralonsoh | ykarel, 14:29:32.902883 IP 10.0.10.42 > 224.0.0.22: igmp v3 report, 1 group record(s) | 14:29 |
| ralonsoh | yes, I see the IGMP packet in the TAP interface | 14:29 |
| ralonsoh | I'm going to propose the patch with this image instead | 14:30 |
| fungi | yay! | 14:31 |
| clarkb | ralonsoh: which image has the unhappy kernel in it? | 14:34 |
| ralonsoh | clarkb, https://cloud-images.ubuntu.com/minimal/releases/jammy/release/ubuntu-22.04-minimal-cloudimg-amd64.img | 14:34 |
| clarkb | I wonder if they just overdid the kernel trimming in the minimal image | 14:35 |
| clarkb | that is too bad as the image is 1/3 the size of the working image | 14:35 |
| ralonsoh | well, focal minimal was 250MB, this one is closer to 300MB | 14:37 |
| ralonsoh | noble minimal is 1.1GB! | 14:37 |
| fungi | yeesh... gives new meaning to "minimal" | 14:38 |
| fungi | sad thing is, turning on that igmp protocol support probably would have "wasted" a few kb | 14:38 |
| ykarel | ralonsoh, okk that's good | 15:52 |
| *** ralonsoh is now known as ralonsoh_out | 16:03 | |
Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!