| *** ykatabam has quit IRC | 00:00 | |
| *** Lucas_Gray has quit IRC | 00:12 | |
| *** ykatabam has joined #openstack-meeting | 00:16 | |
| *** donghao has joined #openstack-meeting | 00:16 | |
| *** nicolasbock has quit IRC | 00:17 | |
| *** brinzhang has joined #openstack-meeting | 00:19 | |
| *** ykatabam has quit IRC | 00:20 | |
| *** donghao has quit IRC | 00:21 | |
| *** ijw has quit IRC | 00:28 | |
| *** brinzhang_ has joined #openstack-meeting | 00:32 | |
| *** brinzhang has quit IRC | 00:36 | |
| *** ijw has joined #openstack-meeting | 00:41 | |
| *** ijw has quit IRC | 00:43 | |
| *** igordc has quit IRC | 00:59 | |
| *** hongbin has joined #openstack-meeting | 01:03 | |
| *** ykatabam has joined #openstack-meeting | 01:03 | |
| *** bobh has joined #openstack-meeting | 01:07 | |
| *** armax has quit IRC | 01:09 | |
| *** bobh has quit IRC | 01:12 | |
| *** JangwonLee_ has joined #openstack-meeting | 01:27 | |
| *** ianychoi_ has joined #openstack-meeting | 01:27 | |
| *** yamahata__ has joined #openstack-meeting | 01:29 | |
| *** bauzas_ has joined #openstack-meeting | 01:29 | |
| *** ianychoi has quit IRC | 01:30 | |
| *** JangwonLee has quit IRC | 01:30 | |
| *** artom has quit IRC | 01:30 | |
| *** isq_ has quit IRC | 01:30 | |
| *** altlogbot_1 has quit IRC | 01:30 | |
| *** bauzas has quit IRC | 01:30 | |
| *** mahatic has quit IRC | 01:30 | |
| *** bauzas_ is now known as bauzas | 01:30 | |
| *** diablo_rojo has quit IRC | 01:31 | |
| *** altlogbot_0 has joined #openstack-meeting | 01:32 | |
| *** hemna_ has quit IRC | 01:34 | |
| *** hemna_ has joined #openstack-meeting | 01:38 | |
| *** _alastor_ has joined #openstack-meeting | 01:43 | |
| *** diablo_rojo has joined #openstack-meeting | 01:45 | |
| *** ykatabam has quit IRC | 01:52 | |
| *** hongbin has quit IRC | 01:57 | |
| *** jamesmcarthur has quit IRC | 02:00 | |
| *** baojg has joined #openstack-meeting | 02:02 | |
| *** yamamoto has joined #openstack-meeting | 02:03 | |
| *** bobh has joined #openstack-meeting | 02:09 | |
| *** diablo_rojo has quit IRC | 02:22 | |
| *** tetsuro has joined #openstack-meeting | 02:23 | |
| *** ijw has joined #openstack-meeting | 02:30 | |
| *** ijw has quit IRC | 02:31 | |
| *** yaawang has joined #openstack-meeting | 02:55 | |
| *** tetsuro has quit IRC | 02:56 | |
| *** mahatic has joined #openstack-meeting | 02:57 | |
| *** hongbin has joined #openstack-meeting | 02:57 | |
| *** lbragstad has quit IRC | 02:57 | |
| *** yamamoto has quit IRC | 03:03 | |
| *** ykatabam has joined #openstack-meeting | 03:05 | |
| *** whoami-rajat has joined #openstack-meeting | 03:12 | |
| *** baojg has quit IRC | 03:14 | |
| *** baojg has joined #openstack-meeting | 03:14 | |
| *** rfolco has quit IRC | 03:19 | |
| *** jamesmcarthur has joined #openstack-meeting | 03:20 | |
| *** donghao has joined #openstack-meeting | 03:22 | |
| *** baojg has quit IRC | 03:26 | |
| *** baojg has joined #openstack-meeting | 03:27 | |
| *** baojg has quit IRC | 03:27 | |
| *** donghao has quit IRC | 03:28 | |
| *** baojg has joined #openstack-meeting | 03:28 | |
| *** bobh has quit IRC | 03:28 | |
| *** jamesmcarthur has quit IRC | 03:33 | |
| *** ykatabam has quit IRC | 03:55 | |
| *** ykatabam has joined #openstack-meeting | 04:00 | |
| *** jamesmcarthur has joined #openstack-meeting | 04:01 | |
| *** imsurit has joined #openstack-meeting | 04:02 | |
| *** hongbin has quit IRC | 04:04 | |
| *** jamesmcarthur has quit IRC | 04:05 | |
| *** ijw has joined #openstack-meeting | 04:06 | |
| *** ijw has quit IRC | 04:13 | |
| *** jamesmcarthur has joined #openstack-meeting | 04:19 | |
| *** ykatabam has quit IRC | 04:22 | |
| *** ykatabam has joined #openstack-meeting | 04:24 | |
| *** _alastor_ has quit IRC | 04:25 | |
| *** jamesmcarthur has quit IRC | 04:29 | |
| *** rcernin has quit IRC | 04:30 | |
| *** yamahata has quit IRC | 04:30 | |
| *** rcernin has joined #openstack-meeting | 04:31 | |
| *** jamesmcarthur has joined #openstack-meeting | 04:32 | |
| *** pcaruana has joined #openstack-meeting | 04:35 | |
| *** pcaruana has quit IRC | 04:38 | |
| *** ijw has joined #openstack-meeting | 04:41 | |
| *** ijw has quit IRC | 04:47 | |
| *** tetsuro has joined #openstack-meeting | 04:49 | |
| *** baojg has quit IRC | 04:57 | |
| *** baojg has joined #openstack-meeting | 04:58 | |
| *** gyee has quit IRC | 04:59 | |
| *** ricolin has joined #openstack-meeting | 05:03 | |
| *** jamesmcarthur has quit IRC | 05:05 | |
| *** ijw has joined #openstack-meeting | 05:16 | |
| *** ijw has quit IRC | 05:23 | |
| *** baojg has quit IRC | 05:34 | |
| *** Luzi has joined #openstack-meeting | 05:37 | |
| *** baojg has joined #openstack-meeting | 05:38 | |
| *** baojg has quit IRC | 05:43 | |
| *** baojg has joined #openstack-meeting | 05:44 | |
| *** jamesmcarthur has joined #openstack-meeting | 05:44 | |
| *** imsurit_ofc has joined #openstack-meeting | 05:46 | |
| *** yamahata has joined #openstack-meeting | 05:46 | |
| *** imsurit has quit IRC | 05:48 | |
| *** imsurit_ofc is now known as imsurit | 05:48 | |
| *** ijw has joined #openstack-meeting | 05:49 | |
| *** jamesmcarthur has quit IRC | 05:51 | |
| *** ykatabam has quit IRC | 05:54 | |
| *** ijw has quit IRC | 05:54 | |
| *** ijw has joined #openstack-meeting | 05:57 | |
| *** rcernin has quit IRC | 05:57 | |
| *** tetsuro has quit IRC | 05:58 | |
| *** vishalmanchanda has joined #openstack-meeting | 06:05 | |
| *** tetsuro has joined #openstack-meeting | 06:06 | |
| *** ijw has quit IRC | 06:06 | |
| *** donghao has joined #openstack-meeting | 06:12 | |
| *** donghao has quit IRC | 06:16 | |
| *** yamahata has quit IRC | 06:19 | |
| *** yamahata has joined #openstack-meeting | 06:20 | |
| *** baojg has quit IRC | 06:22 | |
| *** baojg has joined #openstack-meeting | 06:23 | |
| *** jamesmcarthur has joined #openstack-meeting | 06:24 | |
| *** jamesmcarthur has quit IRC | 06:28 | |
| *** ijw has joined #openstack-meeting | 06:34 | |
| *** ijw has quit IRC | 06:40 | |
| *** ociuhandu has joined #openstack-meeting | 06:46 | |
| *** mattia has quit IRC | 06:50 | |
| *** ociuhandu has quit IRC | 06:52 | |
| *** jamesmcarthur has joined #openstack-meeting | 06:59 | |
| *** slaweq has joined #openstack-meeting | 07:02 | |
| *** pcaruana has joined #openstack-meeting | 07:03 | |
| *** ircuser-1 has joined #openstack-meeting | 07:05 | |
| *** jamesmcarthur has quit IRC | 07:05 | |
| *** joxyuki has joined #openstack-meeting | 07:05 | |
| *** tssurya has joined #openstack-meeting | 07:09 | |
| *** ianw is now known as ianw_pto | 07:16 | |
| *** ttsiouts has joined #openstack-meeting | 07:23 | |
| *** ralonsoh has joined #openstack-meeting | 07:30 | |
| *** Liang__ has joined #openstack-meeting | 07:34 | |
| *** Liang__ is now known as LiangFang | 07:35 | |
| *** ttsiouts has quit IRC | 07:38 | |
| *** hochanlee has joined #openstack-meeting | 07:40 | |
| *** brinzhang_ has quit IRC | 07:41 | |
| *** brinzhang_ has joined #openstack-meeting | 07:42 | |
| *** ykatabam has joined #openstack-meeting | 07:42 | |
| *** imsurit_ofc has joined #openstack-meeting | 07:42 | |
| *** brinzhang_ has quit IRC | 07:44 | |
| *** imsurit has quit IRC | 07:44 | |
| *** imsurit_ofc is now known as imsurit | 07:44 | |
| *** brinzhang_ has joined #openstack-meeting | 07:44 | |
| *** priteau has joined #openstack-meeting | 07:44 | |
| *** baojg has quit IRC | 07:46 | |
| *** bhagyashris has joined #openstack-meeting | 07:48 | |
| *** mattia has joined #openstack-meeting | 07:49 | |
| *** tpatil has joined #openstack-meeting | 07:49 | |
| *** belmoreira has joined #openstack-meeting | 07:51 | |
| *** ttsiouts has joined #openstack-meeting | 07:57 | |
| *** ijw has joined #openstack-meeting | 07:58 | |
| *** yaawang has quit IRC | 08:01 | |
| *** nitinuikey has joined #openstack-meeting | 08:01 | |
| *** rcernin has joined #openstack-meeting | 08:03 | |
| *** ijw has quit IRC | 08:03 | |
| *** takahashi-tsc has joined #openstack-meeting | 08:08 | |
| *** rcernin has quit IRC | 08:11 | |
| *** ttsiouts has quit IRC | 08:11 | |
| *** ttsiouts has joined #openstack-meeting | 08:12 | |
| *** ttsiouts_ has joined #openstack-meeting | 08:13 | |
| *** ociuhandu has joined #openstack-meeting | 08:17 | |
| *** ttsiouts has quit IRC | 08:17 | |
| *** tpatil has quit IRC | 08:18 | |
| *** imsurit_ofc has joined #openstack-meeting | 08:22 | |
| *** panda has quit IRC | 08:22 | |
| *** imsurit has quit IRC | 08:23 | |
| *** imsurit_ofc is now known as imsurit | 08:23 | |
| *** tpatil has joined #openstack-meeting | 08:24 | |
| *** panda has joined #openstack-meeting | 08:24 | |
| *** brinzhang_ has quit IRC | 08:24 | |
| *** brinzhang has joined #openstack-meeting | 08:25 | |
| *** rcernin has joined #openstack-meeting | 08:28 | |
| *** nitinuikey has left #openstack-meeting | 08:35 | |
| *** iyamahat has quit IRC | 08:38 | |
| *** ijw has joined #openstack-meeting | 08:38 | |
| *** yaawang has joined #openstack-meeting | 08:42 | |
| *** ijw has quit IRC | 08:44 | |
| *** takahashi-tsc has quit IRC | 08:44 | |
| *** priteau has quit IRC | 08:47 | |
| *** priteau has joined #openstack-meeting | 08:48 | |
| *** ygbo has joined #openstack-meeting | 08:51 | |
| *** jamesmcarthur has joined #openstack-meeting | 09:01 | |
| *** belmoreira has quit IRC | 09:05 | |
| *** jamesmcarthur has quit IRC | 09:05 | |
| *** belmoreira has joined #openstack-meeting | 09:13 | |
| *** belmoreira has quit IRC | 09:13 | |
| *** yaawang has quit IRC | 09:18 | |
| *** yaawang has joined #openstack-meeting | 09:23 | |
| *** jamesmcarthur has joined #openstack-meeting | 09:32 | |
| *** jamesmcarthur has quit IRC | 09:37 | |
| *** tpatil has quit IRC | 09:38 | |
| *** iyamahat has joined #openstack-meeting | 09:40 | |
| *** LiangFang has quit IRC | 09:42 | |
| *** bhagyashris has quit IRC | 09:43 | |
| *** pcaruana has quit IRC | 09:48 | |
| *** donghao has joined #openstack-meeting | 09:48 | |
| *** donghao has quit IRC | 09:53 | |
| *** priteau has quit IRC | 10:03 | |
| *** tetsuro has quit IRC | 10:04 | |
| *** imsurit_ofc has joined #openstack-meeting | 10:07 | |
| *** imsurit has quit IRC | 10:08 | |
| *** imsurit_ofc is now known as imsurit | 10:08 | |
| *** nicolasbock has joined #openstack-meeting | 10:10 | |
| *** ricolin has quit IRC | 10:14 | |
| *** ttsiouts_ has quit IRC | 10:16 | |
| *** ttsiouts has joined #openstack-meeting | 10:17 | |
| *** tetsuro has joined #openstack-meeting | 10:21 | |
| *** ttsiouts has quit IRC | 10:21 | |
| *** ricolin has joined #openstack-meeting | 10:22 | |
| *** ricolin has quit IRC | 10:23 | |
| *** iyamahat has quit IRC | 10:29 | |
| *** ijw has joined #openstack-meeting | 10:30 | |
| *** joxyuki has quit IRC | 10:32 | |
| *** ykatabam has quit IRC | 10:38 | |
| *** tetsuro has quit IRC | 10:53 | |
| *** belmoreira has joined #openstack-meeting | 11:01 | |
| *** yamamoto has joined #openstack-meeting | 11:03 | |
| *** ykatabam has joined #openstack-meeting | 11:03 | |
| *** ttsiouts has joined #openstack-meeting | 11:04 | |
| *** dosaboy has quit IRC | 11:05 | |
| *** nicolasbock has quit IRC | 11:06 | |
| *** yamamoto has quit IRC | 11:08 | |
| *** dosaboy has joined #openstack-meeting | 11:09 | |
| *** tesseract has joined #openstack-meeting | 11:11 | |
| *** tesseract has quit IRC | 11:13 | |
| *** tesseract has joined #openstack-meeting | 11:15 | |
| *** altlogbot_0 has quit IRC | 11:19 | |
| *** tssurya has quit IRC | 11:19 | |
| *** irclogbot_1 has quit IRC | 11:19 | |
| *** altlogbot_0 has joined #openstack-meeting | 11:20 | |
| *** zbr is now known as zbr|lunch | 11:22 | |
| *** tesseract has quit IRC | 11:23 | |
| *** apetrich has joined #openstack-meeting | 11:25 | |
| *** altlogbot_0 has quit IRC | 11:25 | |
| *** jamesmcarthur has joined #openstack-meeting | 11:34 | |
| *** ijw has quit IRC | 11:34 | |
| *** ykatabam has quit IRC | 11:36 | |
| *** jamesmcarthur has quit IRC | 11:39 | |
| *** belmoreira has quit IRC | 11:39 | |
| *** belmoreira has joined #openstack-meeting | 11:43 | |
| *** ricolin has joined #openstack-meeting | 11:44 | |
| *** tetsuro has joined #openstack-meeting | 11:44 | |
| *** ttsiouts has quit IRC | 11:44 | |
| *** imsurit has quit IRC | 11:44 | |
| *** ttsiouts has joined #openstack-meeting | 11:45 | |
| *** artom has joined #openstack-meeting | 11:48 | |
| *** ttsiouts has quit IRC | 11:49 | |
| *** baojg has joined #openstack-meeting | 11:50 | |
| *** hyunsikyang__ has joined #openstack-meeting | 11:51 | |
| *** niceplace_ has joined #openstack-meeting | 11:52 | |
| *** belmoreira has quit IRC | 11:52 | |
| *** ttsiouts has joined #openstack-meeting | 11:53 | |
| *** kinrui has joined #openstack-meeting | 11:53 | |
| *** hyunsikyang has quit IRC | 11:54 | |
| *** electrofelix has joined #openstack-meeting | 11:54 | |
| *** markmcclain has quit IRC | 11:55 | |
| *** aprice has quit IRC | 11:55 | |
| *** datasundae has quit IRC | 11:55 | |
| *** niceplace has quit IRC | 11:55 | |
| *** patrickeast has quit IRC | 11:55 | |
| *** hogepodge has quit IRC | 11:55 | |
| *** mordred has quit IRC | 11:55 | |
| *** dougwig has quit IRC | 11:55 | |
| *** mnasiadka has quit IRC | 11:55 | |
| *** jamespage has quit IRC | 11:55 | |
| *** kmalloc has quit IRC | 11:55 | |
| *** TheJulia has quit IRC | 11:55 | |
| *** clayg has quit IRC | 11:55 | |
| *** dustinc has quit IRC | 11:55 | |
| *** fungi has quit IRC | 11:55 | |
| *** melwitt has quit IRC | 11:56 | |
| *** belmoreira has joined #openstack-meeting | 11:57 | |
| *** baojg has quit IRC | 11:58 | |
| *** baojg has joined #openstack-meeting | 11:58 | |
| *** zbr|lunch is now known as zbr | 11:59 | |
| *** baojg has quit IRC | 11:59 | |
| *** baojg has joined #openstack-meeting | 11:59 | |
| *** rcernin has quit IRC | 11:59 | |
| *** baojg has quit IRC | 11:59 | |
| *** baojg has joined #openstack-meeting | 12:00 | |
| *** mbuil has joined #openstack-meeting | 12:00 | |
| *** irclogbot_1 has joined #openstack-meeting | 12:00 | |
| *** baojg has quit IRC | 12:00 | |
| *** baojg has joined #openstack-meeting | 12:01 | |
| *** aprice has joined #openstack-meeting | 12:01 | |
| *** datasundae has joined #openstack-meeting | 12:01 | |
| *** patrickeast has joined #openstack-meeting | 12:01 | |
| *** hogepodge has joined #openstack-meeting | 12:01 | |
| *** mordred has joined #openstack-meeting | 12:01 | |
| *** dustinc has joined #openstack-meeting | 12:01 | |
| *** dougwig has joined #openstack-meeting | 12:01 | |
| *** mnasiadka has joined #openstack-meeting | 12:01 | |
| *** jamespage has joined #openstack-meeting | 12:01 | |
| *** kmalloc has joined #openstack-meeting | 12:01 | |
| *** TheJulia has joined #openstack-meeting | 12:01 | |
| *** clayg has joined #openstack-meeting | 12:01 | |
| *** baojg has quit IRC | 12:01 | |
| *** baojg has joined #openstack-meeting | 12:01 | |
| *** baojg has quit IRC | 12:02 | |
| *** altlogbot_2 has joined #openstack-meeting | 12:02 | |
| *** baojg has joined #openstack-meeting | 12:02 | |
| *** baojg has quit IRC | 12:03 | |
| *** tetsuro has quit IRC | 12:03 | |
| *** raildo has joined #openstack-meeting | 12:03 | |
| *** ykatabam has joined #openstack-meeting | 12:03 | |
| *** baojg has joined #openstack-meeting | 12:03 | |
| *** baojg has quit IRC | 12:03 | |
| *** baojg has joined #openstack-meeting | 12:04 | |
| *** baojg has quit IRC | 12:04 | |
| *** baojg has joined #openstack-meeting | 12:05 | |
| *** irclogbot_1 has quit IRC | 12:05 | |
| *** altlogbot_2 has quit IRC | 12:05 | |
| *** cheng1 has quit IRC | 12:05 | |
| *** baojg has quit IRC | 12:05 | |
| *** baojg has joined #openstack-meeting | 12:05 | |
| *** hyunsikyang__ has quit IRC | 12:05 | |
| *** baojg has quit IRC | 12:06 | |
| *** baojg has joined #openstack-meeting | 12:06 | |
| *** baojg has quit IRC | 12:07 | |
| *** cheng1 has joined #openstack-meeting | 12:07 | |
| *** jamesmcarthur has joined #openstack-meeting | 12:07 | |
| *** baojg has joined #openstack-meeting | 12:07 | |
| *** baojg has quit IRC | 12:07 | |
| *** baojg has joined #openstack-meeting | 12:08 | |
| *** altlogbot_2 has joined #openstack-meeting | 12:08 | |
| *** baojg has quit IRC | 12:08 | |
| *** baojg has joined #openstack-meeting | 12:09 | |
| *** baojg has quit IRC | 12:09 | |
| *** baojg has joined #openstack-meeting | 12:09 | |
| *** baojg has quit IRC | 12:10 | |
| *** pcaruana has joined #openstack-meeting | 12:10 | |
| *** baojg has joined #openstack-meeting | 12:10 | |
| *** baojg has quit IRC | 12:11 | |
| *** altlogbot_2 has quit IRC | 12:11 | |
| *** baojg has joined #openstack-meeting | 12:11 | |
| *** jamesmcarthur has quit IRC | 12:11 | |
| *** baojg has quit IRC | 12:11 | |
| *** baojg has joined #openstack-meeting | 12:12 | |
| *** njohnston has quit IRC | 12:12 | |
| *** baojg has quit IRC | 12:12 | |
| *** baojg has joined #openstack-meeting | 12:13 | |
| *** baojg has quit IRC | 12:13 | |
| *** baojg has joined #openstack-meeting | 12:13 | |
| *** baojg has quit IRC | 12:14 | |
| *** baojg has joined #openstack-meeting | 12:14 | |
| *** njohnston has joined #openstack-meeting | 12:14 | |
| *** strigazi has quit IRC | 12:14 | |
| *** baojg has quit IRC | 12:15 | |
| *** baojg has joined #openstack-meeting | 12:15 | |
| *** strigazi has joined #openstack-meeting | 12:15 | |
| *** baojg has quit IRC | 12:15 | |
| *** baojg has joined #openstack-meeting | 12:16 | |
| *** baojg has quit IRC | 12:16 | |
| *** baojg has joined #openstack-meeting | 12:16 | |
| *** baojg has quit IRC | 12:17 | |
| *** kinrui is now known as fungi | 12:21 | |
| *** tssurya has joined #openstack-meeting | 12:27 | |
| *** baojg has joined #openstack-meeting | 12:34 | |
| *** donghao has joined #openstack-meeting | 12:37 | |
| *** baojg has quit IRC | 12:39 | |
| *** belmoreira has quit IRC | 12:42 | |
| *** donghao has quit IRC | 12:43 | |
| *** jamesmcarthur has joined #openstack-meeting | 12:45 | |
| *** rbudden has joined #openstack-meeting | 12:45 | |
| *** belmoreira has joined #openstack-meeting | 12:46 | |
| *** belmoreira has quit IRC | 12:51 | |
| *** belmoreira has joined #openstack-meeting | 12:52 | |
| *** altlogbot_2 has joined #openstack-meeting | 12:54 | |
| *** altlogbot_2 has quit IRC | 12:57 | |
| *** ykatabam has quit IRC | 13:09 | |
| *** mriedem has joined #openstack-meeting | 13:13 | |
| *** priteau has joined #openstack-meeting | 13:14 | |
| *** lbragstad has joined #openstack-meeting | 13:15 | |
| *** donghao has joined #openstack-meeting | 13:24 | |
| *** donghao has quit IRC | 13:24 | |
| *** brinzhang has quit IRC | 13:39 | |
| *** brinzhang has joined #openstack-meeting | 13:40 | |
| *** slaweq has quit IRC | 13:43 | |
| *** ttsiouts has quit IRC | 13:47 | |
| *** ttsiouts has joined #openstack-meeting | 13:47 | |
| *** slaweq has joined #openstack-meeting | 13:48 | |
| *** jamesmcarthur has quit IRC | 13:49 | |
| *** belmoreira has quit IRC | 13:49 | |
| *** ttsiouts has quit IRC | 13:52 | |
| *** belmoreira has joined #openstack-meeting | 13:54 | |
| *** lajoskatona has joined #openstack-meeting | 13:56 | |
| *** Luzi has quit IRC | 13:57 | |
| *** ttsiouts has joined #openstack-meeting | 13:58 | |
| *** mlavalle has joined #openstack-meeting | 13:59 | |
| *** ijw has joined #openstack-meeting | 14:00 | |
| haleyb | #startmeeting networking-ovn | 14:01 |
|---|---|---|
| openstack | Meeting started Tue Jul 9 14:01:13 2019 UTC and is due to finish in 60 minutes. The chair is haleyb. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:01 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:01 |
| *** openstack changes topic to " (Meeting topic: networking-ovn)" | 14:01 | |
| openstack | The meeting name has been set to 'networking_ovn' | 14:01 |
| mlavalle | o/ | 14:01 |
| haleyb | #chair tidwellr | 14:01 |
| lajoskatona | o/ | 14:01 |
| openstack | Current chairs: haleyb tidwellr | 14:01 |
| tidwellr | o/ | 14:01 |
| haleyb | #chair lucasgomes | 14:01 |
| openstack | Warning: Nick not in channel: lucasgomes | 14:01 |
| openstack | Current chairs: haleyb lucasgomes tidwellr | 14:01 |
| haleyb | hi everyone | 14:02 |
| haleyb | #topic Announcements | 14:02 |
| *** openstack changes topic to "Announcements (Meeting topic: networking-ovn)" | 14:02 | |
| bcafarel | hey | 14:02 |
| *** jrbalderrama has joined #openstack-meeting | 14:02 | |
| *** ayoung has joined #openstack-meeting | 14:02 | |
| haleyb | first i'd like to thank everyone for coming and having an interest in ML2-OVS-DVR/OVN convergence! | 14:03 |
| njohnston | o/ | 14:03 |
| tidwellr | say that 3 times fast ;) | 14:03 |
| haleyb | second, i need to make this a short meeting today as we have a company meeting in :27, need to meet the new owners :) | 14:04 |
| mlavalle | the new owners are important | 14:04 |
| *** ijw has quit IRC | 14:05 | |
| mlavalle | is the merger finalized now? | 14:05 |
| haleyb | So logistically this meeting will just be once a month, i'll verify the .ics is correct later, but if we need to make it more often it should be easy enough | 14:05 |
| haleyb | mlavalle: yes, closed this morning | 14:06 |
| mlavalle | ahhh, congrats | 14:06 |
| haleyb | thanks | 14:06 |
| mlavalle | https://www.wsj.com/articles/ibms-biggest-purchase-ever-has-high-stakes-for-rometty-11562676754?mod=hp_lista_pos3 | 14:07 |
| haleyb | #topic ML2-OVS-DVR/OVN convergence | 14:08 |
| *** openstack changes topic to "ML2-OVS-DVR/OVN convergence (Meeting topic: networking-ovn)" | 14:08 | |
| haleyb | i'm assuming everyone has read the draft, https://review.opendev.org/#/c/658414/ | 14:08 |
| haleyb | IMO, the goal of these meetings should be to discuss a few things | 14:10 |
| haleyb | #1 - the gaps | 14:10 |
| haleyb | in addition to the ones in the doc, there will continue to be more as Neutron moves forward | 14:11 |
| *** heikkine has joined #openstack-meeting | 14:11 | |
| haleyb | for example, the ethertypes support Nate is adding | 14:11 |
| mlavalle | yeah, it's a moving target | 14:12 |
| tidwellr | agreed | 14:12 |
| haleyb | I was going to nominate myself to keep track of such things, and try to work in parallel to keep OVN "in sync" | 14:12 |
| haleyb | i will add them to the etherpad | 14:13 |
| mlavalle | I need to learn OVN but as I become more proficient, I'll be more than happy to help on the OVN side | 14:13 |
| haleyb | https://etherpad.openstack.org/p/networking-ovn | 14:13 |
| tidwellr | is there a way for the networking-ovn-tempest-dsvm-ovs-release to flag things ie skipped tests | 14:14 |
| tidwellr | ? | 14:14 |
| slaweq | hi, sorry for being late | 14:14 |
| *** njohnston_ has joined #openstack-meeting | 14:14 | |
| tidwellr | just thinking out loud, I wonder if we could piggyback on automation somehow to be able to get a picture of where things stand | 14:15 |
| haleyb | tidwellr: that's a good question, i believe there is would just need to make a note on how to do it | 14:15 |
| mlavalle | great suggestion | 14:16 |
| haleyb | tidwellr: or are you asking about CI status for OVN in general? | 14:16 |
| *** jamesmcarthur has joined #openstack-meeting | 14:17 | |
| mlavalle | couldn't this be done by running some of the aghents based implementation jobs in OVN? | 14:17 |
| slaweq | tidwellr: most of tempest tests have got some extensions required so if there is no extension in the tempest config, test will be skipped | 14:17 |
| mlavalle | against OVN, I meant | 14:17 |
| *** _pewp_ has quit IRC | 14:17 | |
| slaweq | tidwellr: but we can send DNM patch with same extensions list as we are using in neutron_tempest_plugin dvr multinode job | 14:17 |
| slaweq | and then check what tests are failing there | 14:18 |
| tidwellr | because "parity" is a moving target, I was just suggesting that neutron/networking-ovn CI results could probably gives us some feedback on status | 14:18 |
| tidwellr | slaweq: that's what I was thinking | 14:18 |
| slaweq | when we will rebase this patch we can see progress and what gaps we still have | 14:18 |
| *** whoami-rajat has quit IRC | 14:18 | |
| slaweq | I can proposed such patch if You want | 14:18 |
| slaweq | *I can propose | 14:18 |
| haleyb | slaweq: thanks, it makes sense now, since we are skipping the things we don't support in OVN | 14:19 |
| *** _pewp_ has joined #openstack-meeting | 14:19 | |
| slaweq | ok, I will propose such DNM patch in networking-ovn repo | 14:19 |
| mlavalle | yeap | 14:19 |
| mlavalle | it has to be done in the ovn repo | 14:20 |
| slaweq | #action slaweq to send DNM patch with CI job to check feature gaps between ovn and ml2/ovs-dvr | 14:21 |
| haleyb | great, we can work off that and have owners assign themselves | 14:22 |
| mlavalle | yes | 14:22 |
| tidwellr | +1 | 14:23 |
| haleyb | in addition to that, i'd like to look into the future, there's a few things on my list... | 14:24 |
| haleyb | first is to create a job in the devstack repo for OVN | 14:25 |
| haleyb | it would both serve to see when it gets broken, and hopefully lead to easier stacking with it | 14:26 |
| * haleyb is at his time deadline | 14:26 | |
| *** njohnston_ has quit IRC | 14:27 | |
| haleyb | tidwellr: if you want to continue i had added you as chair | 14:27 |
| * bcafarel suspects a few attendees have similar deadline | 14:27 | |
| haleyb | #action haleyb to update etherpad with notes discussed here | 14:28 |
| tidwellr | this is a good start | 14:28 |
| tidwellr | my next topic would be performance and scalability, but it's a little early for that | 14:28 |
| haleyb | if we have to we can meet again in 2 weeks as we should decide if the review is enough to get started and merge it, or if there's something missing | 14:29 |
| tidwellr | after today I'm thinking every 2 weeks makes sense | 14:30 |
| tidwellr | a lot is going to get lost over the next 4 weeks, my $0.02 | 14:30 |
| mlavalle | ++ | 14:32 |
| haleyb | the other thing i wanted to discuss was to make sure by the end of the Train cycle we are in a place where we potentially could change the default - more akin to make sure there's not some small change we can make now in that regards, something that isn't back-portable | 14:33 |
| haleyb | we can discuss that in two weeks... | 14:34 |
| *** jamesmcarthur has quit IRC | 14:34 | |
| *** ijw has joined #openstack-meeting | 14:34 | |
| *** jamesmcarthur has joined #openstack-meeting | 14:35 | |
| haleyb | i have to go, meeting has started... | 14:35 |
| tidwellr | thanks haleyb | 14:35 |
| haleyb | thanks for attending, i'll update the invite to be every two weeks since this was so short | 14:35 |
| haleyb | #endmeeting | 14:35 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 14:35 | |
| openstack | Meeting ended Tue Jul 9 14:35:43 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:35 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/networking_ovn/2019/networking_ovn.2019-07-09-14.01.html | 14:35 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/networking_ovn/2019/networking_ovn.2019-07-09-14.01.txt | 14:35 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/networking_ovn/2019/networking_ovn.2019-07-09-14.01.log.html | 14:35 |
| *** lajoskatona has left #openstack-meeting | 14:36 | |
| mlavalle | o/ | 14:36 |
| *** belmoreira has quit IRC | 14:42 | |
| *** mmethot has quit IRC | 14:44 | |
| *** belmoreira has joined #openstack-meeting | 14:45 | |
| *** mmethot has joined #openstack-meeting | 14:47 | |
| *** ijw has quit IRC | 14:47 | |
| *** armax has joined #openstack-meeting | 14:49 | |
| *** belmoreira has quit IRC | 14:51 | |
| *** belmoreira has joined #openstack-meeting | 14:54 | |
| *** ijw has joined #openstack-meeting | 15:03 | |
| *** belmoreira has quit IRC | 15:05 | |
| *** ijw has quit IRC | 15:08 | |
| *** belmoreira has joined #openstack-meeting | 15:08 | |
| *** jrbalderrama has quit IRC | 15:09 | |
| *** altlogbot_0 has joined #openstack-meeting | 15:12 | |
| *** bobh has joined #openstack-meeting | 15:15 | |
| *** altlogbot_0 has quit IRC | 15:17 | |
| *** rubasov has quit IRC | 15:20 | |
| *** ygbo has quit IRC | 15:20 | |
| *** _alastor_ has joined #openstack-meeting | 15:22 | |
| *** bobh has quit IRC | 15:27 | |
| *** altlogbot_3 has joined #openstack-meeting | 15:42 | |
| *** ijw has joined #openstack-meeting | 15:43 | |
| *** rubasov has joined #openstack-meeting | 15:46 | |
| *** altlogbot_3 has quit IRC | 15:47 | |
| *** ijw has quit IRC | 15:48 | |
| *** diablo_rojo has joined #openstack-meeting | 15:48 | |
| *** iyamahat has joined #openstack-meeting | 15:50 | |
| *** priteau has quit IRC | 15:52 | |
| *** igordc has joined #openstack-meeting | 15:56 | |
| slaweq | #startmeeting neutron_ci | 16:00 |
| openstack | Meeting started Tue Jul 9 16:00:07 2019 UTC and is due to finish in 60 minutes. The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:00 |
| *** openstack changes topic to " (Meeting topic: neutron_ci)" | 16:00 | |
| openstack | The meeting name has been set to 'neutron_ci' | 16:00 |
| mlavalle | o/ | 16:00 |
| njohnston | o/ | 16:00 |
| slaweq | lets wait few more minutes for others | 16:01 |
| ralonsoh | hi | 16:02 |
| slaweq | ok, so lets start | 16:02 |
| slaweq | Grafana dashboard: http://grafana.openstack.org/dashboard/db/neutron-failure-rate | 16:02 |
| slaweq | please open now so it will be ready later | 16:03 |
| slaweq | #topic Actions from previous meetings | 16:03 |
| *** openstack changes topic to "Actions from previous meetings (Meeting topic: neutron_ci)" | 16:03 | |
| * mlavalle triggered Grafana | 16:03 | |
| slaweq | mlavalle to continue debugging neutron-tempest-plugin-dvr-multinode-scenario issues | 16:03 |
| mlavalle | I did continue looking at that | 16:03 |
| mlavalle | I am still finding the metadata proxy issue | 16:03 |
| mlavalle | Left detailed comment here: https://bugs.launchpad.net/neutron/+bug/1830763/comments/3 | 16:04 |
| openstack | Launchpad bug 1830763 in neutron "Debug neutron-tempest-plugin-dvr-multinode-scenario failures" [High,Confirmed] - Assigned to Miguel Lavalle (minsel) | 16:04 |
| *** bobh has joined #openstack-meeting | 16:04 | |
| mlavalle | The summary is that the instance is ready before haproxy-metadata-proxy is created | 16:04 |
| mlavalle | in one of the nodes | 16:04 |
| mlavalle | and therefore fails to get its metadata | 16:05 |
| njohnston | just FYI, the failure rate for that job has been dropping the past few days and is down to 32% | 16:05 |
| mlavalle | this analysis was done with http://logs.openstack.org/14/668914/1/check/neutron-tempest-plugin-dvr-multinode-scenario/f2ce738/ | 16:05 |
| mlavalle | this patch was created by ralonsoh late last week | 16:06 |
| mlavalle | I think | 16:06 |
| slaweq | mlavalle: so there is some error on neutron-server side which slows down creation of router on compute node, right? | 16:06 |
| *** bobh has quit IRC | 16:06 | |
| mlavalle | yes, that's my theory | 16:07 |
| slaweq | do You know what is this "8831ed85-9ccf-48a2-92eb-ab39d3d30e89-ubuntu-bionic-rax-ord-0008" which is reported as duplicate in error message? | 16:08 |
| mlavalle | no, I haven't gotten to that yet | 16:08 |
| *** altlogbot_2 has joined #openstack-meeting | 16:08 | |
| slaweq | is it agent_id-hostname pair? | 16:08 |
| slaweq | or what? | 16:08 |
| slaweq | ok | 16:08 |
| slaweq | so You will continue this investigation, right? | 16:09 |
| mlavalle | yes | 16:09 |
| mlavalle | indeed | 16:09 |
| mlavalle | I'll dig in this case as deeply as possible | 16:09 |
| slaweq | thx mlavalle, great progress on this :) | 16:09 |
| slaweq | #action mlavalle to continue debugging neutron-tempest-plugin-dvr-multinode-scenario issues | 16:09 |
| mlavalle | the good thing is that this patch is very recent, so the logs will be there | 16:09 |
| slaweq | ok, next action was | 16:09 |
| slaweq | slaweq to send patch to switch functional tests job in fwaas repo to py3 | 16:09 |
| slaweq | Patches: https://review.opendev.org/668917 and https://review.opendev.org/668918 are send | 16:10 |
| slaweq | also https://review.opendev.org/#/c/669757/ is needed | 16:10 |
| slaweq | please take a look if You will have some time | 16:10 |
| * njohnston will take a look | 16:10 | |
| slaweq | njohnston: thx | 16:10 |
| slaweq | next one: | 16:10 |
| slaweq | ralonsoh to continue debugging TestNeutronServer: start function (bug/1833279) with new logs | 16:10 |
| ralonsoh | I didn't see any other error in the CI related to thjis bug | 16:11 |
| ralonsoh | http://logstash.openstack.org/#/dashboard/file/logstash.json?query=build_name:neutron-functional%20AND%20message:%5C%22Timed%20out%20waiting%20for%20file%5C%22 | 16:11 |
| *** altlogbot_2 has quit IRC | 16:12 | |
| slaweq | ok, so maybe we can simply close this bug for now | 16:13 |
| slaweq | what do You think? | 16:13 |
| slaweq | I also didn't saw it during last week | 16:13 |
| ralonsoh | I'll keep an eye on this during the next week | 16:13 |
| slaweq | ok, thx ralonsoh | 16:14 |
| ralonsoh | and if I don't see anythiong, I'll close it | 16:14 |
| ralonsoh | np! | 16:14 |
| slaweq | ++ | 16:14 |
| slaweq | ok, next one | 16:14 |
| mlavalle | can I say something about fwaas | 16:14 |
| slaweq | slaweq to mark test_ha_router_restart_agents_no_packet_lost as unstable again | 16:14 |
| slaweq | Done: https://review.opendev.org/668914 | 16:14 |
| slaweq | mlavalle: sure, go on | 16:14 |
| mlavalle | I pinged Sridar yesterday. He responded back that he is still trying to help | 16:15 |
| mlavalle | so I will organize a meeting with him | 16:15 |
| mlavalle | This coming Thursday | 16:15 |
| mlavalle | I'll invite njohnston | 16:15 |
| njohnston | yes please | 16:15 |
| bcafarel | late o/ sorry the local Q&A session took some time | 16:15 |
| mlavalle | that's it | 16:15 |
| slaweq | mlavalle: can You invite me to this meeting as well? | 16:16 |
| mlavalle | slaweq: yes | 16:16 |
| slaweq | thx | 16:16 |
| *** mattw4 has joined #openstack-meeting | 16:16 | |
| slaweq | ok, lets move on then | 16:17 |
| slaweq | #topic Stadium projects | 16:17 |
| *** openstack changes topic to "Stadium projects (Meeting topic: neutron_ci)" | 16:17 | |
| slaweq | first Python 3 migration | 16:17 |
| slaweq | etherpad: https://etherpad.openstack.org/p/neutron_stadium_python3_status | 16:17 |
| slaweq | I moved finished projects to the bottom of the document as bcafarel suggested last week | 16:17 |
| njohnston | I'm currently working on the bagpipe tempest jobs | 16:18 |
| slaweq | we have only 6 projects on the "not finished" list | 16:18 |
| slaweq | but for most of the things we have volunteers already | 16:18 |
| slaweq | I think we should ask yamamoto about networking-midonet | 16:19 |
| slaweq | or is there anyone else involved in this project who we can ping? mlavalle do You know? | 16:19 |
| slaweq | and thx njohnston for taking care of bagpipe :) | 16:19 |
| mlavalle | let's ask yamamoto | 16:19 |
| slaweq | ok, I will send him an email this week | 16:20 |
| slaweq | good for You? | 16:20 |
| mlavalle | yes | 16:20 |
| slaweq | #action slaweq to contact yamamoto about networking-midonet py3 status | 16:20 |
| *** altlogbot_1 has joined #openstack-meeting | 16:20 | |
| *** whoami-rajat has joined #openstack-meeting | 16:20 | |
| slaweq | any other updates on it? | 16:20 |
| slaweq | ok, lets move on then | 16:22 |
| slaweq | tempest-plugins migration | 16:22 |
| slaweq | Etherpad: https://etherpad.openstack.org/p/neutron_stadium_move_to_tempest_plugin_repo | 16:22 |
| slaweq | any updates? | 16:22 |
| njohnston | I got back to the fwaas first change and made some progress with it | 16:22 |
| slaweq | njohnston: yeah, I saw it today and I commented on one of Your patches already | 16:23 |
| *** altlogbot_1 has quit IRC | 16:23 | |
| njohnston | it has 2 +2s but no +W https://review.opendev.org/#/c/643662/ | 16:23 |
| njohnston | I'll fix up that issue, it's in the second stage change | 16:23 |
| slaweq | +W'ed now | 16:23 |
| njohnston | thanks! | 16:24 |
| slaweq | thanks for working on this | 16:24 |
| slaweq | so we will have still not finished vpnaas and neutron-dynamic-routing | 16:24 |
| *** irclogbot_1 has joined #openstack-meeting | 16:24 | |
| slaweq | and we should be good on this finally so gmann will be happy :) | 16:25 |
| slaweq | mlavalle: tidwellr do You need any help with patches for vpnaas and neutron-dynamic-routing ? I can help with them if needed | 16:25 |
| mlavalle | slaweq: if I am slowing down anybody. go ahead. but I would still like to give it a try | 16:26 |
| slaweq | mlavalle: no, it's not urgent of course | 16:26 |
| slaweq | I just wanted to ask :) | 16:26 |
| mlavalle | thanks | 16:27 |
| *** belmoreira has quit IRC | 16:27 | |
| *** irclogbot_1 has quit IRC | 16:27 | |
| slaweq | ok, any other questions/updates about stadium projects? | 16:27 |
| *** njohnston_ has joined #openstack-meeting | 16:28 | |
| slaweq | ok, so lets move on then | 16:28 |
| slaweq | #topic Grafana | 16:28 |
| *** openstack changes topic to "Grafana (Meeting topic: neutron_ci)" | 16:28 | |
| slaweq | http://grafana.openstack.org/dashboard/db/neutron-failure-rate | 16:28 |
| slaweq | I don't see anything urgent or "special" this week | 16:29 |
| njohnston | So hey, how's about that neutron-tempest-plugin-dvr-multinode-scenario failure rate? Looking good! | 16:29 |
| slaweq | exactly, it's better | 16:29 |
| mlavalle | agree | 16:29 |
| slaweq | I think that changing order of connecting router interfaces and spawning instance minimized possibility of this race with metadata proxy | 16:30 |
| slaweq | so it is failing less now | 16:30 |
| slaweq | but issue is still there :/ | 16:30 |
| mlavalle | you mean after your patch? | 16:31 |
| slaweq | still neutron-tempest-with-uwsgi is failing 100% but there is patch https://review.opendev.org/#/c/668311/ for that | 16:31 |
| slaweq | mlavalle: yes | 16:31 |
| slaweq | anything else related to grafana? | 16:32 |
| mlavalle | nope | 16:32 |
| slaweq | ok, lets move on then | 16:33 |
| slaweq | #topic fullstack/functional | 16:33 |
| *** openstack changes topic to "fullstack/functional (Meeting topic: neutron_ci)" | 16:33 | |
| slaweq | I found 3 different test failures in functional tests recently: | 16:33 |
| slaweq | neutron.tests.functional.agent.linux.test_keepalived.KeepalivedManagerTestCase - http://logs.openstack.org/35/521035/8/check/neutron-functional/65a4ecf/testr_results.html.gz | 16:33 |
| slaweq | ^^ I think ralonsoh was looking into something similar some time ago, right? | 16:34 |
| ralonsoh | yes, I almost have a patch for this | 16:34 |
| slaweq | it's this one which removes locks on netns privileged functions? | 16:34 |
| ralonsoh | actually what I'm doing is replacing the ip_monitor in keepalived | 16:34 |
| ralonsoh | which is the source of some problems | 16:34 |
| ralonsoh | ooooh sorry | 16:35 |
| slaweq | but in this case error was "Cannot open network namespace "qrouter-599a3366-e0ea-4a35-9497-4263b8409b00": No such file or directory" | 16:35 |
| ralonsoh | one sec | 16:35 |
| ralonsoh | yes, one sec (I write without reading first) | 16:35 |
| ralonsoh | https://review.opendev.org/#/c/668682/ | 16:35 |
| ralonsoh | one line, big discussion in the patch | 16:36 |
| slaweq | personally I'm fine with merging Your patch | 16:36 |
| ralonsoh | (me too) | 16:37 |
| slaweq | the config removal proposed by liuyulong should be IMO discussed on neutron team meeting or drivers meeting maybe | 16:37 |
| *** bobh has joined #openstack-meeting | 16:38 | |
| *** bobh has quit IRC | 16:38 | |
| slaweq | mlavalle: njohnston: please add this patch to Your list of reviews and say what is Your opinion about it | 16:39 |
| mlavalle | ok | 16:39 |
| slaweq | thx a lot | 16:39 |
| njohnston_ | I think it’s a good topic for the drivers meeting, I don’t think we need to use the time of the entire neutron community to talk about it | 16:39 |
| njohnston_ | will do | 16:39 |
| slaweq | njohnston_: I agree | 16:40 |
| slaweq | ok, next one was: | 16:40 |
| slaweq | neutron.tests.functional.agent.linux.test_linuxbridge_arp_protect.LinuxBridgeARPSpoofTestCase - http://logs.openstack.org/70/650270/19/check/neutron-functional-python27/6c9c017/testr_results.html.gz | 16:40 |
| slaweq | which I don't remember to see in the past | 16:41 |
| slaweq | did You saw it before? | 16:41 |
| ralonsoh | IMO, this is similar to other privsep errors | 16:41 |
| *** eharney has joined #openstack-meeting | 16:41 | |
| ralonsoh | the privsep thread pool is limited | 16:41 |
| ralonsoh | and sometimes many ops are executed at the same time | 16:42 |
| slaweq | in logs there is almost nothing: http://logs.openstack.org/70/650270/19/check/neutron-functional-python27/6c9c017/controller/logs/dsvm-functional-logs/neutron.tests.functional.agent.linux.test_linuxbridge_arp_protect.LinuxBridgeARPSpoofTestCase.test_arp_protection_update.txt.gz | 16:42 |
| ralonsoh | eventually will have an operation without time to be executed | 16:42 |
| slaweq | ralonsoh: so do You think that maybe limiting number of workers can improve this? | 16:43 |
| ralonsoh | slaweq, how many workers do we have? | 16:43 |
| ralonsoh | one per core/thread? | 16:43 |
| slaweq | ralonsoh: I don't know exactly | 16:44 |
| ralonsoh | slaweq, that should be the limit | 16:44 |
| slaweq | ralonsoh: from log in this failed job it looks that it's not specified | 16:44 |
| slaweq | and it runs 8 workers IMO | 16:44 |
| ralonsoh | slaweq, no, this is infra config | 16:44 |
| slaweq | http://logs.openstack.org/70/650270/19/check/neutron-functional-python27/6c9c017/job-output.txt.gz#_2019-07-08_18_54_37_453034 | 16:44 |
| slaweq | it simply runs "tox -edsvm-functional-python27" and nothing else | 16:46 |
| slaweq | http://logs.openstack.org/70/650270/19/check/neutron-functional-python27/6c9c017/job-output.txt.gz#_2019-07-08_18_53_34_474097 | 16:46 |
| slaweq | so if we want to limit number of test workers we should specify it there IMO | 16:46 |
| ralonsoh | slaweq, so by default one worker per thread | 16:46 |
| ralonsoh | let me check how to increase, in FT, the privsep pool | 16:46 |
| slaweq | ralonsoh: ok, thx a lot | 16:47 |
| slaweq | #action ralonsoh to check how to increase, in FT, the privsep pool | 16:47 |
| slaweq | last one which I found is | 16:47 |
| slaweq | neutron.tests.functional.agent.l3.test_ha_router.L3HATestCase - http://logs.openstack.org/69/668569/3/check/neutron-functional-python27/9d345e8/testr_results.html.gz | 16:47 |
| *** _alastor_ has quit IRC | 16:48 | |
| *** ttsiouts has quit IRC | 16:48 | |
| slaweq | and I see error like: http://logs.openstack.org/69/668569/3/check/neutron-functional-python27/9d345e8/controller/logs/dsvm-functional-logs/neutron.tests.functional.agent.l3.test_ha_router.L3HATestCase.test_keepalived_state_change_notification.txt.gz#_2019-07-05_10_15_10_728 | 16:48 |
| *** ttsiouts has joined #openstack-meeting | 16:48 | |
| slaweq | in logs from this test | 16:48 |
| slaweq | but I'm not sure if that is related or not | 16:49 |
| slaweq | I can investigate this one during this week | 16:49 |
| *** Shrews has joined #openstack-meeting | 16:49 | |
| slaweq | #action slaweq to check neutron.tests.functional.agent.l3.test_ha_router.L3HATestCase issue | 16:49 |
| njohnston | did we merge a check to validate gateway is inside the subnet? Because this looks like it would fail such a check: ['ip', 'netns', 'exec', 'qrouter-eb89b020-c3b0-410f-82ec-639b197dc05b', 'ip', 'route', 'replace', 'to', '8.8.8.0/24', 'via', '19.4.4.4'] | 16:50 |
| njohnston | oh, sorry, I misread that it was a default gateway, that just looks like an additional route | 16:50 |
| slaweq | but it's not gateway | 16:50 |
| slaweq | only extra route IIRC: http://logs.openstack.org/69/668569/3/check/neutron-functional-python27/9d345e8/controller/logs/dsvm-functional-logs/neutron.tests.functional.agent.l3.test_ha_router.L3HATestCase.test_keepalived_state_change_notification.txt.gz#_2019-07-05_10_15_10_662 | 16:50 |
| njohnston | yeah | 16:51 |
| slaweq | so I will look deeper into it this week | 16:51 |
| *** tssurya has quit IRC | 16:51 | |
| slaweq | and I will report a bug or send a patch, whatever will be needed :) | 16:51 |
| slaweq | that's all from my side according to functional (and fullstack) tests | 16:52 |
| slaweq | do You have anything else on that topic? | 16:52 |
| *** ijw has joined #openstack-meeting | 16:52 | |
| *** ttsiouts has quit IRC | 16:53 | |
| slaweq | ok, lets move forward than | 16:53 |
| slaweq | #topic Tempest/Scenario | 16:53 |
| *** openstack changes topic to "Tempest/Scenario (Meeting topic: neutron_ci)" | 16:53 | |
| slaweq | first of all, good news | 16:53 |
| slaweq | gmann proposed new integrated-gate templates, one for networking is merged: https://review.opendev.org/#/c/668930/ | 16:53 |
| slaweq | and I proposed to use it in neutron: https://review.opendev.org/#/c/669815/ | 16:53 |
| slaweq | I will also later try to change our exising neutron-tempest jobs to be inherit from this new jobs dedicated for networking | 16:54 |
| slaweq | that should improve our gates as we will not run e.g. cinder or glance related tests in our gate | 16:54 |
| slaweq | :) | 16:54 |
| mlavalle | cool | 16:54 |
| slaweq | and now lets get back to the reality :P | 16:55 |
| slaweq | I opened new bug https://bugs.launchpad.net/neutron/+bug/1835914 | 16:55 |
| openstack | Launchpad bug 1835914 in neutron "Test test_show_network_segment_range failing" [Medium,Confirmed] | 16:55 |
| *** _alastor_ has joined #openstack-meeting | 16:55 | |
| slaweq | I found it at least 2 times during last week | 16:55 |
| slaweq | and it is strange for me that network_segment_range object don't have project_id sometimes :/ | 16:56 |
| slaweq | if there is any volunteer who wants to take a look into this, feel free :) | 16:56 |
| njohnston | I noticed weirdnesses like that with bulk port - sometimes the requests that get created in testing aren't complete | 16:56 |
| mlavalle | I might give it a try later this week | 16:56 |
| slaweq | njohnston: good to know | 16:56 |
| haleyb | i'm always confused by the tenant_id/project_id transition, are we supposed to be using both still? shouldn't one have gone away? | 16:57 |
| slaweq | haleyb: but in this case tenant_id wasn't there also | 16:57 |
| njohnston | haleyb: either/or | 16:57 |
| haleyb | oh, that's strange | 16:58 |
| haleyb | both missing that is | 16:58 |
| slaweq | haleyb: exactly | 16:58 |
| njohnston | I'll try to take a look as well | 16:58 |
| slaweq | I set it as medium priority as it don't happens often but it happens from time to time so there is definitely something to check :) | 16:58 |
| slaweq | thx njohnston and mlavalle for taking care of it | 16:58 |
| slaweq | ok, we are running out of time now | 16:59 |
| slaweq | thx for attending | 16:59 |
| mlavalle | o/ | 16:59 |
| njohnston | o/ | 16:59 |
| slaweq | have a great week and see You online :) | 16:59 |
| slaweq | o/ | 16:59 |
| slaweq | #endmeeting | 16:59 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 16:59 | |
| openstack | Meeting ended Tue Jul 9 16:59:36 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:59 |
| ralonsoh | bye | 16:59 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/neutron_ci/2019/neutron_ci.2019-07-09-16.00.html | 16:59 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/neutron_ci/2019/neutron_ci.2019-07-09-16.00.txt | 16:59 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/neutron_ci/2019/neutron_ci.2019-07-09-16.00.log.html | 16:59 |
| *** mlavalle has left #openstack-meeting | 16:59 | |
| *** armax has quit IRC | 17:00 | |
| *** altlogbot_1 has joined #openstack-meeting | 17:00 | |
| *** njohnston_ has quit IRC | 17:05 | |
| *** altlogbot_1 has quit IRC | 17:05 | |
| *** irclogbot_3 has joined #openstack-meeting | 17:10 | |
| *** Lucas_Gray has joined #openstack-meeting | 17:11 | |
| *** irclogbot_3 has quit IRC | 17:13 | |
| *** Lucas_Gray has quit IRC | 17:24 | |
| *** igordc has quit IRC | 17:29 | |
| *** ralonsoh has quit IRC | 17:36 | |
| *** gyee has joined #openstack-meeting | 17:39 | |
| *** tesseract has joined #openstack-meeting | 17:40 | |
| *** yamahata has quit IRC | 17:41 | |
| *** dtrainor__ has joined #openstack-meeting | 17:41 | |
| *** iyamahat has quit IRC | 17:42 | |
| *** dtrainor_ has quit IRC | 17:43 | |
| *** iyamahat has joined #openstack-meeting | 17:55 | |
| *** electrofelix has quit IRC | 18:08 | |
| *** yamahata has joined #openstack-meeting | 18:13 | |
| *** eharney has quit IRC | 18:17 | |
| *** armax has joined #openstack-meeting | 18:20 | |
| *** jamesmcarthur has quit IRC | 18:21 | |
| *** eharney has joined #openstack-meeting | 18:30 | |
| *** whoami-rajat has quit IRC | 18:30 | |
| *** jamesmcarthur has joined #openstack-meeting | 18:34 | |
| *** melwitt has joined #openstack-meeting | 18:35 | |
| *** bobh has joined #openstack-meeting | 18:35 | |
| *** bobh has quit IRC | 18:36 | |
| *** irclogbot_0 has joined #openstack-meeting | 18:36 | |
| *** hongbin has joined #openstack-meeting | 18:37 | |
| *** tesseract has quit IRC | 18:39 | |
| *** irclogbot_0 has quit IRC | 18:39 | |
| *** alchemy_ has joined #openstack-meeting | 18:39 | |
| *** panda has quit IRC | 18:43 | |
| *** eharney has quit IRC | 18:44 | |
| *** eharney has joined #openstack-meeting | 18:46 | |
| *** dtrainor__ has quit IRC | 18:52 | |
| *** igordc has joined #openstack-meeting | 18:55 | |
| clarkb | anyone else here for the infra meeting? as mentioned in the infra channel I expect this one to be quick as many of us have only had a few workingdays since the last meeting | 18:59 |
| corvus | why not? :) | 19:01 |
| clarkb | #startmeeting infra | 19:01 |
| openstack | Meeting started Tue Jul 9 19:01:05 2019 UTC and is due to finish in 60 minutes. The chair is clarkb. Information about MeetBot at http://wiki.debian.org/MeetBot. | 19:01 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 19:01 |
| *** openstack changes topic to " (Meeting topic: infra)" | 19:01 | |
| openstack | The meeting name has been set to 'infra' | 19:01 |
| mordred | o/ | 19:01 |
| clarkb | #link http://lists.openstack.org/pipermail/openstack-infra/2019-July/006410.html Meeting Agenda | 19:01 |
| clarkb | #topic Actions from last meeting | 19:01 |
| *** openstack changes topic to "Actions from last meeting (Meeting topic: infra)" | 19:01 | |
| clarkb | #link http://eavesdrop.openstack.org/meetings/infra/2019/infra.2019-07-02-19.01.txt minutes from last meeting | 19:01 |
| clarkb | mordred: any progress with the github account creation and -infra org cleanup? | 19:02 |
| mordred | nope | 19:02 |
| *** ociuhandu has quit IRC | 19:02 | |
| fungi | jroll sent a followup agreeing with ttx's suggestion about repository descriptions | 19:02 |
| fungi | (on the openstack-discuss ml thread) | 19:02 |
| * mordred missed that - goes to look | 19:02 | |
| jroll | apologies for that dragging, am just looking for volunteers to help at this point | 19:03 |
| clarkb | #action mordred create opendevadmin github account | 19:03 |
| *** AJaeger has joined #openstack-meeting | 19:03 | |
| clarkb | #action mordred clean up openstack-infra github org | 19:03 |
| fungi | #link http://lists.openstack.org/pipermail/openstack-discuss/2019-July/007607.html Assuming control of GitHub organizations | 19:03 |
| fungi | jroll: yes, volunteers! (and if there are none, maybe that opens the door for alternative choices about whether mirroring there is even important?) | 19:04 |
| jroll | indeed | 19:04 |
| AJaeger | seeing how often people link to github on #openstack-infra: Many are used to it - but seems it might not be important enough to take action | 19:05 |
| fungi | they can always get used to linking something else ;) | 19:05 |
| AJaeger | exactly | 19:06 |
| clarkb | seems like we usually get volunteers when we put it in those terms | 19:07 |
| clarkb | I guess if no one shows up in the near future we can always bring that up as the alternative | 19:08 |
| clarkb | (as a non github user I'm not terribly interested myself :) ) | 19:08 |
| clarkb | #topic Priority Efforts | 19:08 |
| *** openstack changes topic to "Priority Efforts (Meeting topic: infra)" | 19:08 | |
| clarkb | #topic OpenDev | 19:08 |
| *** openstack changes topic to "OpenDev (Meeting topic: infra)" | 19:08 | |
| clarkb | I'm not aware of anything new on the opendev side of things since last week. Anyone else have something to share here? | 19:09 |
| fungi | the mirror stuff but that's got its own topic | 19:10 |
| clarkb | #topic Update Config Management | 19:11 |
| *** openstack changes topic to "Update Config Management (Meeting topic: infra)" | 19:11 | |
| clarkb | corvus: has been improving our job setups and has a change into zuul which will allow us to avoid testing everythign in system-config when zuul.yaml updates | 19:11 |
| clarkb | #link https://review.opendev.org/669752 Test job updates without explicit file matcher | 19:12 |
| clarkb | This should help us move more quickly on our ansible changes as we won't end up testing the world (I think it will help with some of the other efforst we have to add jobs as well) | 19:12 |
| corvus | yeah, with that we can really scale up the number of system-config jobs | 19:12 |
| mordred | ++ | 19:13 |
| clarkb | will reduce the number of test nodes we need for system-config changes too which should make everyone happy | 19:15 |
| clarkb | Any other config management improvement updates? | 19:16 |
| corvus | mordred: let's you and i sync up after the meeting and figure out next steps for the gitea project creation change? | 19:17 |
| corvus | i think we said we'd revisit that this week | 19:17 |
| corvus | one of us should start on that soon :) | 19:17 |
| mordred | corvus: kk | 19:18 |
| clarkb | #topic Storyboard | 19:19 |
| *** openstack changes topic to "Storyboard (Meeting topic: infra)" | 19:19 | |
| clarkb | fungi: diablo_rojo any udpates to share? | 19:19 |
| *** panda has joined #openstack-meeting | 19:19 | |
| diablo_rojo | clarkb, got some of our migration tracking stuff up to day | 19:19 |
| diablo_rojo | date | 19:19 |
| diablo_rojo | poked at a few more teams to see if they want to migrate, havent gotten responses yet | 19:19 |
| fungi | i took a vacation ;) | 19:19 |
| diablo_rojo | Would be great if we can get some help from mordred on the database indexing and whatnot to speed search up | 19:20 |
| diablo_rojo | Since our intern got a job and left us :'( | 19:20 |
| AJaeger | diablo_rojo: might want to followup on https://review.opendev.org/651942 as well | 19:21 |
| diablo_rojo | AJaeger, thanks for the heads up. Will do! | 19:22 |
| *** ijw has quit IRC | 19:22 | |
| diablo_rojo | clarkb, thats all I have really | 19:22 |
| mordred | diablo_rojo: oh no! (although awesome for the intern) | 19:22 |
| diablo_rojo | mordred, yes, happy for her also, selfishly, very sad for StoryBoard and the amount of effort I put in to get an intern | 19:23 |
| mordred | yeah | 19:24 |
| clarkb | #topic General Topics | 19:24 |
| *** openstack changes topic to "General Topics (Meeting topic: infra)" | 19:24 | |
| clarkb | First up checking in on our trusty life support situation | 19:24 |
| clarkb | fungi: were you able to get your change to pass tests after we switch to the legacy base jobs? | 19:24 |
| clarkb | and if so has that change been merge yet? | 19:25 |
| fungi | yeah, it worked and has merged | 19:25 |
| fungi | and just a bit ago i cleaned out the weirdly miscloned files where vcsrepo wants to put its repos | 19:26 |
| clarkb | cool I guess its rerun and see what the next errors are? | 19:26 |
| fungi | so waiting to see if puppet will dtrt now | 19:26 |
| clarkb | Ok next on the agenda was an update on the afs and mirrors situation. Sounds like dhowells is one vacation for a bit as is ianw so we've stopped using the kafs mirror. | 19:27 |
| fungi | looks like the redirect was not the problem for those though | 19:27 |
| clarkb | :( | 19:27 |
| fungi | so still hunting for an explanation | 19:27 |
| clarkb | could be submodule related? | 19:27 |
| clarkb | I did want to ask if we think we should go ahead and replace all the mirrors with bionic + 1.8.3 at this point. That setup seems stable and will get us LE certs and tls | 19:28 |
| AJaeger | nit: ianw mentioned 1.8.4 AFAIR in his email | 19:28 |
| clarkb | ah well whatever is in the infra PPA :) | 19:28 |
| fungi | seems fine to me | 19:29 |
| clarkb | I'm not sure this is urgent but does potentially open the door to more interesting job activities | 19:29 |
| AJaeger | 1.8.3 - link is http://lists.openstack.org/pipermail/openstack-infra/2019-July/006411.html | 19:29 |
| clarkb | (they can more strongly trust our mirrors if so) | 19:29 |
| AJaeger | so, I misremembered | 19:29 |
| corvus | it might be worth figuring out how to build these packages institutionally, rather than the ianw pushes to ppa approach? i get the feeling we may be dependening on these for a while, and we may need to update them. | 19:30 |
| fungi | most of my memories are misrememberies | 19:30 |
| fungi | i think the goal was to convince ubuntu package maintainers to either update the prerelease they shipped in bionic, or get it added to bionic-backports? | 19:31 |
| corvus | we never have come up with a good way to do that though. maybe we could have a zuul post job push the config to the ppa? i've forgotten how ppas work though. | 19:31 |
| fungi | afs folks seem a bit unnerved by ubuntu deciding to distribute a prerelease in their lts distro | 19:31 |
| clarkb | fungi: ya I think the two ideas ianw had were to either use kafs or have ubuntu update their clearly broken package(s) | 19:32 |
| corvus | it's not ideal | 19:32 |
| clarkb | we've found kafs needs more work (which we are helping with but still needs time) and I'm never sure how possible updates to ubuntu packaging is | 19:32 |
| fungi | i think the only real benefit to the ppa is that we can have it build arm64 packages | 19:33 |
| corvus | working on a way to maintain the packages as a team rather than an individual effort gives us a backup plan in case ubuntu doesn't jump when we say, and gives us options if we need to update versions. | 19:33 |
| clarkb | corvus: ++ | 19:34 |
| corvus | maybe a topic for next week's meeting, assuming ianw is back? | 19:34 |
| fungi | running debuild on a test node, running apt-ftparchive over that, generating a detached release file on the executor and pushing that somewhere wouldn't be complicated, and we do have arm64 nodes too | 19:34 |
| clarkb | thinking out loud here we should probably do both things then? ubuntu should ideally have working openafs and we can also manage the ppa more programatically | 19:34 |
| clarkb | corvus: and ya maybe we let ianw chime in when back and then go from there | 19:35 |
| corvus | yeah, ubuntu having working afs is definitely the ideal | 19:35 |
| corvus | i just don't want to be caught without a backup plan | 19:35 |
| fungi | makes sense, for sure | 19:36 |
| clarkb | sounds like a plan we'll bring it up with ianw and work towards sustainable bionic openafs | 19:37 |
| clarkb | The last thing I had on the agenda was an update of the fortnebula cloud addition | 19:37 |
| clarkb | I had hoped we'd be "done" at this point but have run into glean + centos/fedora + network manager + ipv6 only cloud problems | 19:37 |
| clarkb | gentoo images also don't work but for different reasons | 19:37 |
| corvus | (what's the gentoo problem in 6 words or less?) | 19:38 |
| clarkb | Where I am at in the debugging is I have nodepool's test centos image with new glean unit file and old unit file ready to upload into fortnebula to boot test nodes there. And have also held a nodepool test job so I can figure out why our supposed fix doesn't work in testing | 19:38 |
| clarkb | the gentoo problem is similar to the centos problem. basically no ipv6 addr configured on the interface | 19:38 |
| corvus | okay, just different tooling | 19:39 |
| clarkb | but gentoo uses systemd-networkd and not networkmanager so the mechanism of failure should be different | 19:39 |
| clarkb | yup | 19:39 |
| fungi | that's more than six words ;) | 19:39 |
| clarkb | :P | 19:39 |
| mordred | fungi: you're more than six words | 19:39 |
| fungi | yup yup yup yup yup yup yup | 19:39 |
| clarkb | what I'd like to do with the images I'm uploading to fn is confirm the fix works there so I can turn my focus to the test jobs | 19:39 |
| clarkb | and I guess I'll find what I find | 19:39 |
| clarkb | I did test all of the other images one by one and they all seemed to work (ubuntu, opensuse, debian) | 19:40 |
| fungi | and the fix which isn't working in testing did work when booting the nodes there directly (outside of our nodepool test job), right? | 19:41 |
| clarkb | fungi: yes, but that was on modified images in place (i updated the unit file, reloaded the systemd daemon config, deleted the /etc/sysconfig/network-scripts/ifcfg-eth0 file then rebooted) | 19:41 |
| clarkb | its possible that something else related to booting a second time is causing it to work which is why I'm now going to double check with fresh images directly from the test job (I copied the image out of the test job) | 19:42 |
| fungi | sure | 19:43 |
| clarkb | so ya I'll be poking at that today and into the near future probably | 19:43 |
| clarkb | And that takes us to the end of our agenda | 19:43 |
| clarkb | #topic Open Discussion | 19:43 |
| *** openstack changes topic to "Open Discussion (Meeting topic: infra)" | 19:43 | |
| *** ttsiouts has joined #openstack-meeting | 19:43 | |
| clarkb | Anything else? | 19:43 |
| *** belmoreira has joined #openstack-meeting | 19:44 | |
| AJaeger | FYI: fungi has a change up to switch to ansible-lint 4 in zuul-jobs, see https://review.opendev.org/667695. I plan to +2A by end of week if there are no objections. | 19:45 |
| clarkb | thank you for the heads up | 19:45 |
| fungi | pay attention to the child changes of that one, since they do give us some indication of where ansible-lint devs are headed and whether it will be an increasingly steep treadmill over time | 19:46 |
| clarkb | fungi: maybe we are in a position to give feedback to those devs? | 19:47 |
| clarkb | "hey here is a bunch of real world ansible and it doesn't beneift from x or y but could really use a check for z" type of feedback maybe | 19:47 |
| AJaeger | one of those child changes needs a fix in ansible-lint, others might have a -1 | 19:47 |
| fungi | sure, or to decide whether ansible-lint is (or even wants to be) an effective tool for this particular use case | 19:48 |
| corvus | yeah, i'm unconvinced that linting for code style is a useful thing. we've wasted hundreds of person-hours on it. but i've tried to give those changes a fair evaluation in the spirit of compromise. | 19:49 |
| *** ttx has quit IRC | 19:49 | |
| fungi | i split the "fixes" for each new rule into separate changes so each can be evaluated on their own merits and included or abandoned as we choose | 19:49 |
| corvus | if someone wanted to remove it entirely, i would happily +2 those patches. | 19:49 |
| corvus | and i think we should all be aware that it may come to that depending on the direction that ansible-lint takes. | 19:49 |
| clarkb | ya what I'd really like are linter checks for deprecated behavior in ansible | 19:50 |
| clarkb | but we've got a plan for finding and addressing those by running ansible instead | 19:50 |
| mordred | yeah. and things that are actually catching gotcha behavior | 19:50 |
| corvus | yes. love that. | 19:50 |
| mordred | "I don't think that means what you think it means" | 19:50 |
| mordred | helpful | 19:51 |
| *** ttx has joined #openstack-meeting | 19:51 | |
| mordred | "I don't like the color of your shirt" | 19:51 |
| mordred | not helpful | 19:51 |
| corvus | ++ | 19:51 |
| fungi | inconceivable | 19:51 |
| * corvus is wearing a *black* shirt, so i assume that's okay ;) | 19:51 | |
| * mordred is not wearing a shirt - given it's the carribean and there is no A/C where he's sitting | 19:51 | |
| corvus | this is why we irc | 19:52 |
| mordred | corvus: ++ | 19:52 |
| clarkb | its actually cool and rainy here | 19:53 |
| corvus | clarkb: you said something about a short meeting? :) | 19:53 |
| *** mahatic has quit IRC | 19:53 | |
| clarkb | corvus: ya we better stop now to keep to that :) | 19:53 |
| clarkb | thanks everyone! | 19:53 |
| * fungi wore shorts to the meeting | 19:53 | |
| * AJaeger too | 19:53 | |
| corvus | haha | 19:53 |
| clarkb | find us in #openstack-infra or at openstack-infra@lists.openstack.org | 19:53 |
| clarkb | #endmeeting | 19:53 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 19:53 | |
| openstack | Meeting ended Tue Jul 9 19:53:32 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 19:53 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/infra/2019/infra.2019-07-09-19.01.html | 19:53 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/infra/2019/infra.2019-07-09-19.01.txt | 19:53 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/infra/2019/infra.2019-07-09-19.01.log.html | 19:53 |
| *** ijw has joined #openstack-meeting | 19:55 | |
| *** ijw has quit IRC | 19:55 | |
| *** ijw has joined #openstack-meeting | 19:56 | |
| *** lbragstad has quit IRC | 20:02 | |
| *** Shrews has left #openstack-meeting | 20:05 | |
| *** ttsiouts has quit IRC | 20:09 | |
| *** ttsiouts has joined #openstack-meeting | 20:09 | |
| *** ttsiouts has quit IRC | 20:14 | |
| *** Lucas_Gray has joined #openstack-meeting | 20:24 | |
| *** irclogbot_1 has joined #openstack-meeting | 20:24 | |
| *** irclogbot_1 has quit IRC | 20:27 | |
| *** _alastor_ has quit IRC | 20:37 | |
| *** eharney has quit IRC | 20:37 | |
| *** _alastor_ has joined #openstack-meeting | 20:37 | |
| *** jamesmcarthur has quit IRC | 20:40 | |
| *** dtrainor has joined #openstack-meeting | 20:40 | |
| *** jamesmcarthur has joined #openstack-meeting | 20:41 | |
| *** strigazi has quit IRC | 20:42 | |
| *** _alastor1 has joined #openstack-meeting | 20:42 | |
| *** strigazi has joined #openstack-meeting | 20:43 | |
| *** _alastor_ has quit IRC | 20:44 | |
| *** jamesmcarthur has quit IRC | 20:48 | |
| *** ttsiouts has joined #openstack-meeting | 20:53 | |
| *** oneswig has joined #openstack-meeting | 20:53 | |
| *** bobh has joined #openstack-meeting | 20:54 | |
| *** lbragstad has joined #openstack-meeting | 20:56 | |
| oneswig | #startmeeting scientific-sig | 21:00 |
| openstack | Meeting started Tue Jul 9 21:00:21 2019 UTC and is due to finish in 60 minutes. The chair is oneswig. Information about MeetBot at http://wiki.debian.org/MeetBot. | 21:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 21:00 |
| *** openstack changes topic to " (Meeting topic: scientific-sig)" | 21:00 | |
| openstack | The meeting name has been set to 'scientific_sig' | 21:00 |
| oneswig | hello world? | 21:00 |
| oneswig | #link agenda for today https://wiki.openstack.org/wiki/Scientific_SIG#IRC_Meeting_July_9th_2019 | 21:00 |
| rbudden | hello | 21:00 |
| oneswig | Hey Bob, how's the Cinder work going? | 21:01 |
| *** bobh has quit IRC | 21:01 | |
| rbudden | Going good | 21:02 |
| oneswig | As this meeting is running, I'm paring back OSDs from a Ceph cluster, one by one... | 21:02 |
| rbudden | Migrated everything off GPFS onto our new NetApp filers | 21:02 |
| rbudden | :) | 21:02 |
| oneswig | NetApp, fancy... | 21:02 |
| rbudden | I’ll be very happy to get off the broken GPFS drivers for Cinder | 21:02 |
| oneswig | How are they breaking for you? | 21:03 |
| oneswig | Showing signs of age? | 21:03 |
| rbudden | bugs that haven’t been patched for quite some time | 21:03 |
| rbudden | cinder retype is has been broken since Liberty | 21:03 |
| rbudden | so we couldn’t live migrate out backend storage | 21:03 |
| *** ttsiouts has quit IRC | 21:04 | |
| oneswig | That somewhat negates the advantage of network filesystems... | 21:04 |
| *** ttsiouts has joined #openstack-meeting | 21:04 | |
| rbudden | the GPFS driver doesn’t properly update all the UUIDs so you get orphaned and broken UUID entries in you database (among other problems) | 21:04 |
| oneswig | That sounds unfortunate. Is there nobody outside of IBM maintaining it (and nobody inside IBM either)? | 21:05 |
| rbudden | not sure | 21:05 |
| rbudden | i’ve been patching things myself as needed | 21:05 |
| rbudden | Live migration was broken for awhile as well | 21:06 |
| oneswig | So today's a good day overall... | 21:06 |
| rbudden | oh yes | 21:06 |
| rbudden | manually patched Nova for that until patched in libvirt 5.1 (which isn’t out for CentOS yet) | 21:06 |
| rbudden | it’ll be nice to have things work smoothly :) | 21:07 |
| rbudden | already seeing the benefits of dedup as we speak | 21:07 |
| rbudden | is it just us today? | 21:07 |
| oneswig | so far... trandles sent his apologies | 21:08 |
| oneswig | martial also | 21:08 |
| rbudden | gotcha | 21:08 |
| rbudden | i have to jet about halfway to pick up my son | 21:08 |
| oneswig | No problem | 21:09 |
| oneswig | I've been working on an interesting problem with CephFS which might amuse you | 21:09 |
| *** ttsiouts has quit IRC | 21:09 | |
| oneswig | I've got a Slurm deployment with compute partitions in Cambridge, Oxfordshire and Edinburgh with Manchester coming up. | 21:09 |
| rbudden | nice | 21:10 |
| *** jmlowe has joined #openstack-meeting | 21:10 | |
| rbudden | how are you liking CephFS? | 21:10 |
| oneswig | I don't have a filer in any of those places so I made a scalable home dir using CephFS converged on the compute nodes | 21:10 |
| oneswig | CephFS has potential. | 21:10 |
| oneswig | It's deficient in some ways but does some remarkable things occasionally | 21:11 |
| jmlowe | did you guys start playing with ceph on that surplus hardware? | 21:11 |
| oneswig | For this system, I can make directories with local IO, eg /cambridge, /edinburgh etc. | 21:11 |
| oneswig | a copy from one to the other sees the data jetting off up the country... | 21:11 |
| oneswig | Hi jmlowe | 21:11 |
| jmlowe | hi | 21:12 |
| oneswig | surplus hardware? | 21:12 |
| oneswig | Was that to rbudden? | 21:12 |
| jmlowe | I think Goddard had some extra hardware rbudden was going to try some ceph experiments on | 21:12 |
| oneswig | This project was more about making do with a shortage of hardware... | 21:12 |
| rbudden | jmlowe: we haven’t yet, but it’s on the radar for possibly our TDS | 21:13 |
| rbudden | jmlowe: today was Cinder backend from GPFS -> NetApp (mentioned earlier, before you joined) | 21:13 |
| jmlowe | right, I figured | 21:13 |
| *** irclogbot_0 has joined #openstack-meeting | 21:14 | |
| oneswig | Are you involved in OSC's OpenOnDemand? I've heard some good things about it. | 21:15 |
| rbudden | I know PSC helped test OOD while they were developing it | 21:17 |
| rbudden | we have some potential interest at Goddard | 21:17 |
| rbudden | for Jupyter notebooks if I recall | 21:17 |
| rbudden | i don’t have much hands on with it personally | 21:17 |
| *** irclogbot_0 has quit IRC | 21:19 | |
| *** pcaruana has quit IRC | 21:19 | |
| oneswig | Be interesting to hear if there's a broader pulse in the project. | 21:19 |
| *** jgriffith has quit IRC | 21:20 | |
| oneswig | jmlowe: rbudden: I forget, is either of you planning to go to Shanghai? | 21:20 |
| *** _alastor1 has quit IRC | 21:21 | |
| jmlowe | no way I can swing that | 21:21 |
| *** jgriffith has joined #openstack-meeting | 21:21 | |
| rbudden | no | 21:21 |
| oneswig | Ah, too bad. | 21:21 |
| jmlowe | any word on the 2020 North American Summit? | 21:22 |
| rbudden | eh, i wouldn’t want to deal with the paperwork | 21:22 |
| rbudden | ;) | 21:22 |
| rbudden | yeah, any news? i was curious if it was announced | 21:22 |
| *** Lucas_Gray has quit IRC | 21:22 | |
| oneswig | The rate things are going, not sure if Brits will be allowed in the States by then :-) | 21:23 |
| oneswig | I haven't heard anything, to answer your question | 21:23 |
| rbudden | lol | 21:24 |
| rbudden | China is just off limits completely… | 21:24 |
| rbudden | other internation is possible, just more involved | 21:24 |
| rbudden | hoping for somewhere nice for 2020! | 21:24 |
| jmlowe | I can't use NSF funds to travel internationally so I have to use IU funds, comes with a different set of strings attached | 21:25 |
| *** belmoreira has quit IRC | 21:25 | |
| *** belmoreira has joined #openstack-meeting | 21:26 | |
| *** b1airo has joined #openstack-meeting | 21:26 | |
| oneswig | The freedom of the private company is a double-edged sword :-) | 21:26 |
| b1airo | hi gang | 21:26 |
| b1airo | apologies for being tardy - school holiday head-f*&kery here :-/ | 21:26 |
| b1airo | and i' | 21:26 |
| oneswig | Morning b1airo, glad you made it | 21:26 |
| oneswig | #chair b1airo | 21:27 |
| openstack | Current chairs: b1airo oneswig | 21:27 |
| b1airo | i'm about to join a face to face, so will follow along from sidelines | 21:27 |
| *** raildo has quit IRC | 21:27 | |
| oneswig | Actually we didn't have much to cover - rbudden was talking Cinder migration and I was talking CephFS | 21:27 |
| oneswig | How's your Bright system? | 21:27 |
| b1airo | how'd you go with that CephFS metadata conundrum? | 21:27 |
| b1airo | urgh | 21:28 |
| oneswig | Aha, CephFS MDS - had a breakthrough from Dan van der Ster today. | 21:28 |
| oneswig | So, it turns out you can pin metadata service to specific directories and MDS instances | 21:28 |
| b1airo | nice. i assume you were already sharding the dirs? | 21:28 |
| oneswig | It's not documented anywhere apart from a blog post | 21:29 |
| b1airo | yes, was going to ask whether you'd tried that last week, but was too slow before you left | 21:29 |
| oneswig | directories have affinity to local OSDs in the same region. | 21:29 |
| oneswig | metadata was really painful but Dan's given me some good ideas on that. | 21:30 |
| b1airo | oh, so you've got multiple data pools under this too? | 21:30 |
| oneswig | yup, it's across multiple sites | 21:30 |
| oneswig | #link CephFS subtree pinning https://ceph.com/community/new-luminous-cephfs-subtree-pinning/ | 21:31 |
| b1airo | yeah i'd say pinning is a good start, i think Dan found the auto-balancing is still a bit iffy | 21:31 |
| oneswig | Are you using Ceph at nesi? | 21:32 |
| b1airo | no not at the moment | 21:32 |
| rbudden | sorry to interrupt, gotta jet to pick up my son. have a good day/evening everyone! | 21:32 |
| b1airo | a couple of people keen on trying it though | 21:32 |
| oneswig | same to you rbudden | 21:32 |
| oneswig | b1airo: so what's the OpenStack takeover looking like now? | 21:33 |
| oneswig | BTW did you see the news on the Zoom vulnerability? | 21:35 |
| b1airo | a slow burn i'm afraid. we're taking some slow steps, but won't have much latitude to make major changes/inroads until we setup NeSI.3, which has been pushed out two years by the Gov | 21:35 |
| b1airo | yes, only impacts people using Apple Mail client though i believe? | 21:36 |
| *** belmoreira has quit IRC | 21:36 | |
| oneswig | I believe so. Which is unfortunate for me... | 21:36 |
| b1airo | i figured you'd be using an emacs plugin... ;-) | 21:37 |
| oneswig | ha - emacs... great OS, shame about the editor | 21:37 |
| b1airo | careful with that trash talk around here o_0 | 21:38 |
| oneswig | M-x undo! | 21:38 |
| b1airo | dad joke! | 21:38 |
| *** irclogbot_0 has joined #openstack-meeting | 21:38 | |
| *** _alastor1 has joined #openstack-meeting | 21:39 | |
| *** zbitter has joined #openstack-meeting | 21:40 | |
| *** zbitter is now known as zaneb | 21:41 | |
| oneswig | anyway - we are pretty quiet on content today. I'm thinking of other OS-related things that have happened here this week. I've been down the rabbithole with some weird fluentd behaviour. Not very exciting | 21:41 |
| *** belmoreira has joined #openstack-meeting | 21:42 | |
| *** irclogbot_0 has quit IRC | 21:43 | |
| *** donnyd is now known as donnyd_pto | 21:43 | |
| oneswig | Any other business? | 21:44 |
| oneswig | OK, let's close for the day - thanks guys | 21:46 |
| oneswig | #endmeeting | 21:46 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 21:46 | |
| openstack | Meeting ended Tue Jul 9 21:46:07 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 21:46 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/scientific_sig/2019/scientific_sig.2019-07-09-21.00.html | 21:46 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/scientific_sig/2019/scientific_sig.2019-07-09-21.00.txt | 21:46 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/scientific_sig/2019/scientific_sig.2019-07-09-21.00.log.html | 21:46 |
| b1airo | thanks oneswig | 21:51 |
| oneswig | no worries, catch you later | 21:51 |
| b1airo | sorry, got distracted by Zoom... :-| | 21:51 |
| *** jmlowe has quit IRC | 21:51 | |
| *** irclogbot_0 has joined #openstack-meeting | 21:54 | |
| *** irclogbot_0 has quit IRC | 21:59 | |
| *** oneswig has quit IRC | 21:59 | |
| *** igordc has quit IRC | 22:00 | |
| *** belmoreira has quit IRC | 22:02 | |
| *** rcernin has joined #openstack-meeting | 22:10 | |
| *** jamesmcarthur has joined #openstack-meeting | 22:21 | |
| *** rbudden has quit IRC | 22:22 | |
| *** armax has quit IRC | 22:40 | |
| *** altlogbot_3 has joined #openstack-meeting | 22:44 | |
| *** altlogbot_3 has quit IRC | 22:49 | |
| *** bobh has joined #openstack-meeting | 22:52 | |
| *** slaweq has quit IRC | 22:54 | |
| *** bobh has quit IRC | 22:57 | |
| *** baojg has joined #openstack-meeting | 22:59 | |
| *** hongbin has quit IRC | 22:59 | |
| *** baojg has quit IRC | 23:00 | |
| *** jamesmcarthur has quit IRC | 23:21 | |
| *** armax has joined #openstack-meeting | 23:39 | |
| *** jamesmcarthur has joined #openstack-meeting | 23:42 | |
| *** jamesmcarthur has quit IRC | 23:46 | |
| *** mattw4 has quit IRC | 23:55 | |
| *** bobh has joined #openstack-meeting | 23:56 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!