| *** slaweq has joined #openstack-meeting | 00:11 | |
| *** ianychoi has quit IRC | 00:12 | |
| *** ianychoi has joined #openstack-meeting | 00:14 | |
| *** slaweq has quit IRC | 00:15 | |
| *** ianychoi has quit IRC | 00:20 | |
| *** ianychoi has joined #openstack-meeting | 00:21 | |
| *** lbragstad has quit IRC | 00:23 | |
| *** ianychoi has quit IRC | 00:30 | |
| *** ianychoi has joined #openstack-meeting | 00:31 | |
| *** brinzhang has joined #openstack-meeting | 00:32 | |
| *** brinzhang has quit IRC | 00:55 | |
| *** ianychoi has quit IRC | 01:03 | |
| *** ianychoi has joined #openstack-meeting | 01:05 | |
| *** _alastor_ has quit IRC | 01:12 | |
| *** brinzhang has joined #openstack-meeting | 01:18 | |
| *** ykatabam has joined #openstack-meeting | 01:21 | |
| *** ayoung has joined #openstack-meeting | 01:32 | |
| *** baojg has joined #openstack-meeting | 01:49 | |
| *** apetrich has quit IRC | 01:57 | |
| *** diablo_rojo has quit IRC | 01:57 | |
| *** igordc has quit IRC | 01:58 | |
| *** rbudden has quit IRC | 02:05 | |
| *** ykatabam has quit IRC | 02:09 | |
| *** slaweq has joined #openstack-meeting | 02:11 | |
| *** ianychoi has quit IRC | 02:14 | |
| *** ianychoi has joined #openstack-meeting | 02:16 | |
| *** slaweq has quit IRC | 02:16 | |
| *** ianychoi has quit IRC | 02:38 | |
| *** ianychoi has joined #openstack-meeting | 02:40 | |
| *** hongbin has joined #openstack-meeting | 02:44 | |
| *** ayoung has quit IRC | 02:48 | |
| *** ricolin has joined #openstack-meeting | 03:01 | |
| *** deardooley has quit IRC | 03:04 | |
| *** whoami-rajat has joined #openstack-meeting | 03:04 | |
| *** hongbin has quit IRC | 03:18 | |
| *** ykatabam has joined #openstack-meeting | 03:21 | |
| *** psachin has joined #openstack-meeting | 03:35 | |
| *** imsurit has joined #openstack-meeting | 03:52 | |
| *** hongbin has joined #openstack-meeting | 03:54 | |
| *** slaweq has joined #openstack-meeting | 04:11 | |
| *** browny_ has quit IRC | 04:12 | |
| *** hongbin has quit IRC | 04:12 | |
| *** slaweq has quit IRC | 04:16 | |
| *** jhesketh has quit IRC | 04:19 | |
| *** jhesketh has joined #openstack-meeting | 04:19 | |
| *** dkushwaha has joined #openstack-meeting | 04:21 | |
| *** dkushwaha has left #openstack-meeting | 04:21 | |
| *** shilpasd has joined #openstack-meeting | 04:29 | |
| *** e0ne has joined #openstack-meeting | 05:19 | |
| *** e0ne has quit IRC | 05:23 | |
| *** cheng1 has quit IRC | 05:36 | |
| *** cheng1 has joined #openstack-meeting | 05:41 | |
| *** mmethot has quit IRC | 05:46 | |
| *** shilpasd has quit IRC | 05:56 | |
| *** lpetrut has joined #openstack-meeting | 05:56 | |
| *** lpetrut has quit IRC | 05:57 | |
| *** lpetrut has joined #openstack-meeting | 05:57 | |
| *** tetsuro has joined #openstack-meeting | 05:59 | |
| *** slaweq has joined #openstack-meeting | 06:11 | |
| *** slaweq has quit IRC | 06:16 | |
| *** artom has joined #openstack-meeting | 06:16 | |
| *** artom is now known as artom|gmtplus3 | 06:16 | |
| *** Adri2000 has quit IRC | 06:17 | |
| *** pcaruana has joined #openstack-meeting | 06:26 | |
| *** apetrich has joined #openstack-meeting | 06:31 | |
| *** belmoreira has joined #openstack-meeting | 06:33 | |
| *** ianychoi has quit IRC | 06:34 | |
| *** ianychoi has joined #openstack-meeting | 06:41 | |
| *** kopecmartin has joined #openstack-meeting | 06:43 | |
| *** slaweq has joined #openstack-meeting | 06:44 | |
| *** belmoreira has quit IRC | 06:45 | |
| *** belmoreira has joined #openstack-meeting | 06:47 | |
| *** rcernin has quit IRC | 07:06 | |
| *** ykatabam has quit IRC | 07:06 | |
| *** belmoreira has quit IRC | 07:13 | |
| *** belmoreira has joined #openstack-meeting | 07:14 | |
| *** tesseract has joined #openstack-meeting | 07:16 | |
| *** belmoreira has quit IRC | 07:34 | |
| *** tetsuro has quit IRC | 07:40 | |
| *** rajinir has quit IRC | 07:45 | |
| *** e0ne has joined #openstack-meeting | 07:47 | |
| *** belmoreira has joined #openstack-meeting | 07:48 | |
| *** ttsiouts has joined #openstack-meeting | 07:48 | |
| *** ralonsoh has joined #openstack-meeting | 07:49 | |
| *** psachin has quit IRC | 07:55 | |
| *** tetsuro has joined #openstack-meeting | 07:58 | |
| *** ianychoi has quit IRC | 07:59 | |
| *** tssurya has joined #openstack-meeting | 08:00 | |
| *** ttsiouts has quit IRC | 08:00 | |
| *** ianychoi has joined #openstack-meeting | 08:01 | |
| *** ttsiouts has joined #openstack-meeting | 08:01 | |
| *** ttsiouts has quit IRC | 08:05 | |
| *** ttsiouts has joined #openstack-meeting | 08:06 | |
| *** tetsuro has quit IRC | 08:28 | |
| *** Luzi has joined #openstack-meeting | 08:31 | |
| *** tesseract has quit IRC | 08:38 | |
| *** tesseract has joined #openstack-meeting | 08:40 | |
| *** ociuhandu has joined #openstack-meeting | 08:47 | |
| *** rcernin has joined #openstack-meeting | 08:47 | |
| *** ociuhandu has quit IRC | 09:04 | |
| *** ianychoi has quit IRC | 09:07 | |
| *** rcernin has quit IRC | 09:07 | |
| *** ianychoi has joined #openstack-meeting | 09:10 | |
| *** Lucas_Gray has joined #openstack-meeting | 09:35 | |
| *** psachin has joined #openstack-meeting | 09:39 | |
| *** Lucas_Gray has quit IRC | 09:48 | |
| *** Lucas_Gray has joined #openstack-meeting | 09:49 | |
| *** ociuhandu has joined #openstack-meeting | 10:06 | |
| *** artom|gmtplus3 has quit IRC | 10:06 | |
| *** ttsiouts has quit IRC | 10:10 | |
| *** ttsiouts has joined #openstack-meeting | 10:10 | |
| *** artom has joined #openstack-meeting | 10:10 | |
| *** liuyulong has joined #openstack-meeting | 10:14 | |
| *** ttsiouts has quit IRC | 10:15 | |
| *** brinzhang has quit IRC | 10:18 | |
| *** heikkine has quit IRC | 10:33 | |
| *** davidsha has joined #openstack-meeting | 10:40 | |
| *** brinzhang has joined #openstack-meeting | 10:41 | |
| *** imsurit has quit IRC | 10:42 | |
| *** liuyulong has quit IRC | 10:47 | |
| *** carloss has joined #openstack-meeting | 11:00 | |
| *** baojg has quit IRC | 11:12 | |
| *** ttsiouts has joined #openstack-meeting | 11:13 | |
| *** ociuhandu has quit IRC | 11:23 | |
| *** ociuhandu has joined #openstack-meeting | 11:23 | |
| *** shilpasd has joined #openstack-meeting | 11:31 | |
| *** ianychoi has quit IRC | 11:40 | |
| *** raildo has joined #openstack-meeting | 11:43 | |
| *** ianychoi has joined #openstack-meeting | 11:45 | |
| *** baojg has joined #openstack-meeting | 11:47 | |
| *** eharney has quit IRC | 11:55 | |
| *** _erlon_ has joined #openstack-meeting | 11:59 | |
| *** _alastor_ has joined #openstack-meeting | 12:00 | |
| *** _alastor_ has quit IRC | 12:04 | |
| *** ttsiouts has quit IRC | 12:13 | |
| *** ttsiouts has joined #openstack-meeting | 12:13 | |
| *** ianychoi has quit IRC | 12:14 | |
| *** lbragstad has joined #openstack-meeting | 12:17 | |
| *** ttsiouts has quit IRC | 12:18 | |
| *** ttsiouts has joined #openstack-meeting | 12:20 | |
| *** ianychoi has joined #openstack-meeting | 12:22 | |
| *** mriedem has joined #openstack-meeting | 12:25 | |
| *** Luzi has quit IRC | 12:35 | |
| *** baojg has quit IRC | 12:38 | |
| *** brinzhang has quit IRC | 12:38 | |
| *** njohnston_ has joined #openstack-meeting | 12:39 | |
| *** brinzhang has joined #openstack-meeting | 12:39 | |
| *** njohnston has quit IRC | 12:40 | |
| *** mmethot has joined #openstack-meeting | 12:57 | |
| *** rbudden has joined #openstack-meeting | 13:03 | |
| *** mmethot is now known as mmethot|brb | 13:10 | |
| *** yamamoto has joined #openstack-meeting | 13:11 | |
| *** eharney has joined #openstack-meeting | 13:15 | |
| *** rajinir has joined #openstack-meeting | 13:18 | |
| *** rf0lc0 has joined #openstack-meeting | 13:18 | |
| *** rfolco has quit IRC | 13:21 | |
| *** raildo has quit IRC | 13:27 | |
| *** njohnston has joined #openstack-meeting | 13:28 | |
| *** liuyulong has joined #openstack-meeting | 13:28 | |
| *** njohnston_ has quit IRC | 13:29 | |
| *** eharney has quit IRC | 13:29 | |
| *** mmethot|brb is now known as mmethot | 13:29 | |
| *** yamamoto has quit IRC | 13:32 | |
| *** lseki has joined #openstack-meeting | 13:32 | |
| *** raildo has joined #openstack-meeting | 13:39 | |
| *** rf0lc0 has quit IRC | 13:42 | |
| *** rf0lc0 has joined #openstack-meeting | 13:42 | |
| *** raildo has quit IRC | 13:44 | |
| *** raildo has joined #openstack-meeting | 13:46 | |
| *** eharney has joined #openstack-meeting | 13:48 | |
| *** eharney has quit IRC | 13:48 | |
| *** eharney has joined #openstack-meeting | 13:49 | |
| *** raildo has quit IRC | 13:52 | |
| *** wwriverrat has joined #openstack-meeting | 13:54 | |
| *** mlavalle has joined #openstack-meeting | 13:54 | |
| *** belmoreira has quit IRC | 13:55 | |
| liuyulong | hi | 13:59 |
|---|---|---|
| liuyulong | #startmeeting neutron_l3 | 13:59 |
| openstack | Meeting started Wed Jun 26 13:59:32 2019 UTC and is due to finish in 60 minutes. The chair is liuyulong. Information about MeetBot at http://wiki.debian.org/MeetBot. | 13:59 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 13:59 |
| *** openstack changes topic to " (Meeting topic: neutron_l3)" | 13:59 | |
| openstack | The meeting name has been set to 'neutron_l3' | 13:59 |
| mlavalle | o/ | 13:59 |
| liuyulong | #chair mlavalle | 14:00 |
| openstack | Current chairs: liuyulong mlavalle | 14:00 |
| ralonsoh | hi | 14:00 |
| liuyulong | Let's wait a minute for more attendees. We are going to start the topics after 60 seconds officially. : ) | 14:00 |
| liuyulong | hi | 14:00 |
| mlavalle | nice! | 14:01 |
| wwriverrat | o/ | 14:01 |
| liuyulong | #topic Announcements | 14:01 |
| *** openstack changes topic to "Announcements (Meeting topic: neutron_l3)" | 14:01 | |
| liuyulong | Important things were highlighted in neutron team meeting yesterday, so I will not repeat them again. | 14:02 |
| *** belmoreira has joined #openstack-meeting | 14:02 | |
| liuyulong | So no announcements from me now, anyone has any other? | 14:02 |
| *** brinzhang has quit IRC | 14:03 | |
| slaweq | hi | 14:03 |
| mlavalle | none from me | 14:03 |
| liuyulong | slaweq, hi | 14:03 |
| *** brinzhang has joined #openstack-meeting | 14:03 | |
| liuyulong | OK, let's move on. | 14:03 |
| liuyulong | #topic Bugs | 14:04 |
| *** openstack changes topic to "Bugs (Meeting topic: neutron_l3)" | 14:04 | |
| liuyulong | yamamoto was our bug deputy last week. | 14:04 |
| liuyulong | #link http://lists.openstack.org/pipermail/openstack-discuss/2019-June/007290.html | 14:04 |
| liuyulong | Looks like a busy week, : ) | 14:04 |
| njohnston | o/ | 14:04 |
| mlavalle | yeah, it ws kind of busy | 14:04 |
| liuyulong | #link https://bugs.launchpad.net/neutron/+bug/1833717 | 14:05 |
| openstack | Launchpad bug 1833717 in neutron "Functional tests: error during namespace creation" [High,In progress] - Assigned to Rodolfo Alonso (rodolfo-alonso-hernandez) | 14:05 |
| liuyulong | The fix: https://review.opendev.org/#/c/666845/. It's done now. | 14:05 |
| mlavalle | thanks ralonsoh | 14:05 |
| ralonsoh | no problem | 14:05 |
| liuyulong | #link https://bugs.launchpad.net/neutron/+bug/1834257 | 14:06 |
| openstack | Launchpad bug 1834257 in neutron "dhcp-agent can overwhelm neutron server with dhcp_ready_on_ports RPC calls" [High,In progress] - Assigned to Sebastian Lohff (sebageek) | 14:06 |
| liuyulong | A WIP fix is here: https://review.opendev.org/#/c/667472/. And it's based on this: https://review.opendev.org/#/c/659274/. | 14:07 |
| liuyulong | Code basically looks good to me, it makes sense, but I have a concern is that how will this influence the port DHCP provisioning block during instance boot procedure. | 14:07 |
| mlavalle | are referring to the first or second patch? | 14:08 |
| liuyulong | If I have some port list like this [0, 63] [64, 127] ... [...]. That dhcp_ready_on_ports is a PRC `call` (wait and block until return) method, the following sets of DHCP ready ports will wait until the the formers completed. | 14:08 |
| liuyulong | So the later the port stays in the waiting queue, the easier it fails to start the VM due to the provisioning block timeout. | 14:09 |
| liuyulong | mlavalle, the base https://review.opendev.org/#/c/659274/. | 14:09 |
| liuyulong | any comments in such perspective? | 14:11 |
| mlavalle | I see your concern but I also see that others have other opinions | 14:11 |
| mlavalle | like slaweq | 14:11 |
| liuyulong | Or I'm just over-thinking? | 14:11 |
| mlavalle | I'll go over the comments later today and add my 2 cents | 14:12 |
| *** ayoung has joined #openstack-meeting | 14:12 | |
| liuyulong | mlavalle, cool | 14:12 |
| slaweq | liuyulong: basically You're right IMO | 14:12 |
| slaweq | but | 14:12 |
| slaweq | in current approach if You have e.g. 127 ports it will be send in one rpc message and then new port will wait long time until it will be send | 14:13 |
| mlavalle | processed, you menat, right? | 14:13 |
| slaweq | and IMHO if You will send those messages in smaller chunks, it will be spread between many rpc workers on server side, so in overall it shouldn't be big problem | 14:14 |
| slaweq | mlavalle: right | 14:14 |
| slaweq | and also, the issue here is mostly during full sync (e.g. after restart agent) | 14:14 |
| ralonsoh | also we should not forget the main problem addressed in the patch: to solve the RPC timeouts when sending big sets of ports | 14:15 |
| mlavalle | in normal processing it shouldn't be a big issue | 14:15 |
| slaweq | in such case IMHO it's better to process everything without timeouts and repeats and then start "normal" work | 14:15 |
| ralonsoh | and this problem is solved there | 14:15 |
| *** _alastor_ has joined #openstack-meeting | 14:15 | |
| liuyulong | such _dhcp_ready_ports_loop is in a single thread, not? | 14:15 |
| slaweq | during agent's normal work, this shouldn't be problem as usually there is no so many ports to send at once | 14:15 |
| slaweq | liuyulong: yes, it's single eventlet worker now | 14:16 |
| liuyulong | so, the neutron-server will always process these ports in one worker for one such RPC call of one DHCP agent. | 14:17 |
| *** enriquetaso has joined #openstack-meeting | 14:18 | |
| liuyulong | no matter the trunk size | 14:18 |
| liuyulong | So why, it is slow in neutron-server side? | 14:18 |
| liuyulong | This should be the root cause IMO. I will raise a L3 DB slow query bug later. | 14:19 |
| liuyulong | maybe something similar | 14:19 |
| slaweq | liuyulong: it is slow because it iterates over all those ports and try to remove provisioning block for each port | 14:20 |
| slaweq | and yes, it is slow | 14:20 |
| slaweq | we should think about optimizing it later but IMHO patch for dhcp agent is good | 14:20 |
| liuyulong | Yes, code is fine to me. Actually I do not think nova or neutron will handle a 64**+ VM concurrent booting in one single node too many times. | 14:23 |
| *** raildo has joined #openstack-meeting | 14:23 | |
| *** _erlon_ has quit IRC | 14:23 | |
| mlavalle | so, let's move on then and let it go forward | 14:23 |
| liuyulong | Next | 14:23 |
| liuyulong | #link https://bugs.launchpad.net/neutron/+bug/1833653 | 14:23 |
| openstack | Launchpad bug 1833653 in neutron "We should cleanup ipv4 address if keepalived is dead" [Medium,In progress] - Assigned to Yang Li (yang-li) | 14:23 |
| liuyulong | I'm not quite sure if this is a system spontaneous problem. | 14:23 |
| liuyulong | But according to the comments in the fix: https://review.opendev.org/#/c/667071/. Yang Li says `restart the l3-agent too many time`, so looks like a artificial extreme scenario. | 14:24 |
| *** heikkine has joined #openstack-meeting | 14:24 | |
| liuyulong | IMO, maybe we should add a FLAG for agent restart succeed, and then remind the user in the DOC not to trigger restart many times when no such flag raised, or wait some times then restart again. But I still not quite sure why, restart again and again? | 14:26 |
| liuyulong | But as he/she said in the gerrit, https://bugs.launchpad.net/neutron/+bug/1602320 | 14:27 |
| openstack | Launchpad bug 1602320 in neutron "ha + distributed router: keepalived process kill vrrp child process" [Medium,Fix released] - Assigned to He Qing (tsinghe-7) | 14:27 |
| liuyulong | maybe we should take a look at this bug again. | 14:27 |
| liuyulong | Next | 14:27 |
| liuyulong | #link https://bugs.launchpad.net/neutron/+bug/1732067 | 14:27 |
| openstack | Launchpad bug 1732067 in neutron "openvswitch firewall flows cause flooding on integration bridge" [High,In progress] - Assigned to LIU Yulong (dragon889) | 14:27 |
| liuyulong | This is a L2 bug IMO | 14:27 |
| liuyulong | We already have a patch here: https://review.opendev.org/#/c/639009/, but it breaks the dvr east-west traffic. | 14:28 |
| liuyulong | So, I raised it to here again. | 14:28 |
| liuyulong | The fix may also face the same issue I mentioned last week. | 14:28 |
| liuyulong | Every L3 scenario traffic will be affected, we can not test all the scenarios in upstream neutron CI, or manually test. | 14:29 |
| * haleyb wanders in late | 14:29 | |
| liuyulong | So a minimum change is required. | 14:30 |
| liuyulong | As a consequence, based on the openflow firewall design, I have an alternative fix: https://review.opendev.org/#/c/666991/. When the bridge tries to flood the packets, we use the dest MAC to direct the traffic to the right OF port, since neutron has the full acknowledge of every ports. | 14:30 |
| ralonsoh | we should use the MAC and the VLAN tag | 14:31 |
| ralonsoh | we can have the same mac in multiple VLANs | 14:32 |
| liuyulong | ralonsoh, good to know, I will refactor the patch for this point. | 14:32 |
| mlavalle | thanks for proposing it | 14:33 |
| mlavalle | let's review it | 14:33 |
| liuyulong | So, in such perspective, we do not touch too many tables of the OF firewall. | 14:33 |
| liuyulong | Only one table now, and only for accepted egress traffic. | 14:34 |
| *** mattw4 has joined #openstack-meeting | 14:35 | |
| liuyulong | I tested the DVR, legacy, dvr+ha, dvr_no_external, east-west, floating IPs, all works fine now, no flood in the bridge. | 14:35 |
| liuyulong | OK, last one from me. | 14:36 |
| liuyulong | #link https://bugs.launchpad.net/neutron/+bug/1834308 | 14:36 |
| openstack | Launchpad bug 1834308 in neutron "[DVR][DB] too many slow query during agent restart" [Medium,Confirmed] | 14:36 |
| liuyulong | Recently, during our local testing we meet such issue. | 14:36 |
| liuyulong | The restart time is too long. With large concurrency number, the situation is even worse. | 14:36 |
| liuyulong | The database CPU utilization is almost 100% for every used core. | 14:37 |
| liuyulong | And We counted the slow query logs, some of them will be triggered 200K+ times. | 14:38 |
| ralonsoh | did you tried to profile those DB queries? | 14:38 |
| liuyulong | Have you guys meet such issue locally? | 14:39 |
| liuyulong | ralonsoh, yes, I have a fix locally, it basically works. | 14:39 |
| ralonsoh | ok | 14:39 |
| haleyb | the bug is very generic, it seems as if there might be more than one issue here to fix? | 14:39 |
| ralonsoh | btw, I have one more bug | 14:40 |
| liuyulong | We tested restart the dhcp, metadata, l3 agent in 80 nodes concurrently. | 14:40 |
| liuyulong | No 0.5s+ slow DB query during such restart. | 14:41 |
| liuyulong | OK | 14:41 |
| liuyulong | ralonsoh, please, go ahead | 14:41 |
| ralonsoh | thanks | 14:41 |
| ralonsoh | #link https://bugs.launchpad.net/neutron/+bug/1732458 | 14:41 |
| openstack | Launchpad bug 1732458 in neutron "deleted_ports memory leak in dhcp agent" [Medium,In progress] - Assigned to Rodolfo Alonso (rodolfo-alonso-hernandez) | 14:41 |
| ralonsoh | patch: #link https://review.opendev.org/#/c/521035/ | 14:41 |
| ralonsoh | a bit old | 14:42 |
| *** yamamoto has joined #openstack-meeting | 14:42 | |
| *** yamamoto has quit IRC | 14:42 | |
| ralonsoh | I talked to the submitter and he agreed to have another strategy | 14:42 |
| ralonsoh | so I submitted PS6 | 14:42 |
| ralonsoh | I'm using FixedIntervalLoopingCall to cleanup the deleted_ports variable | 14:43 |
| *** yamamoto has joined #openstack-meeting | 14:43 | |
| ralonsoh | that's all! | 14:43 |
| mlavalle | seems to be a description too broad. Are you planning to add finer detail to the bug? I know we have slow DB queries.... | 14:44 |
| mlavalle | or how do you propose to move forward with it? | 14:44 |
| liuyulong | ralonsoh, thanks for bring this up. | 14:44 |
| liuyulong | mlavalle, as I add [DVR] in the bug title. | 14:44 |
| mlavalle | ok | 14:45 |
| liuyulong | mlavalle, most of them basically related to DVR DB query. | 14:45 |
| liuyulong | When restart L2 agent (ovs-agent) concurrently in 50-80 nodes, the openvswitch_dvr_agent will also do some DVR related DB query. | 14:46 |
| mlavalle | let's add these details to the bug filing. it will be easier to understand and also to review the fix when it is proposed | 14:47 |
| liuyulong | Some of them is really time consuming, and some of the will scan the ports table entirely. | 14:47 |
| liuyulong | That's all bugs from me. So, are there any other bugs that need the team to pay attention? | 14:48 |
| haleyb | mlavalle: +1 to that, i'd rather have more bugs that are specific than just one | 14:48 |
| liuyulong | Let's move on. | 14:49 |
| *** yamamoto has quit IRC | 14:49 | |
| liuyulong | #topic Routed Networks | 14:49 |
| *** openstack changes topic to "Routed Networks (Meeting topic: neutron_l3)" | 14:49 | |
| liuyulong | mlavalle, tidwellr, wwriverrat: your turn now. | 14:49 |
| *** cheng1 has quit IRC | 14:49 | |
| mlavalle | on my part I have patch deployed in my set up | 14:49 |
| mlavalle | I have to conduct testing | 14:50 |
| *** yamamoto has joined #openstack-meeting | 14:50 | |
| mlavalle | this is OVS centered | 14:50 |
| mlavalle | I got a bit sidetracked over the past few days | 14:50 |
| *** cheng1 has joined #openstack-meeting | 14:50 | |
| mlavalle | but I am coming back to it | 14:50 |
| mlavalle | I am talking about multiple segments per host | 14:50 |
| wwriverrat | As for multi-segment work, I've also been sidetracked with my evil job ;-). | 14:51 |
| *** yamamoto has quit IRC | 14:51 | |
| mlavalle | wwriverrat: oh, you have one of those too? | 14:51 |
| wwriverrat | I have been digesting all of the comments in both the spec as well as the WIP | 14:51 |
| *** yamamoto has joined #openstack-meeting | 14:51 | |
| *** lpetrut has quit IRC | 14:52 | |
| wwriverrat | It looks like there may be new code that also raises exception for a network with more than one segment | 14:52 |
| wwriverrat | trying to figure out how to get around that | 14:52 |
| wwriverrat | https://review.opendev.org/#/c/633165/20/neutron/plugins/ml2/plugin.py | 14:52 |
| wwriverrat | Not sure if routed network will pass through that code or not | 14:53 |
| wwriverrat | Longer story shortened: I've been freed up a little to get more work done here. | 14:54 |
| mlavalle | I'll test that part | 14:54 |
| mlavalle | in my setup | 14:54 |
| wwriverrat | I'm hoping to have something around the WIP updated ideally by Monday. An update to the spec hopefully before end of today. | 14:55 |
| mlavalle | thanks! | 14:56 |
| liuyulong | Routed Networks is a little new to me. And we haven't used it in our environment locally. But it's worth a try if needed. : ) | 14:56 |
| liuyulong | We are running out of time. | 14:57 |
| liuyulong | #topic On demand agenda | 14:58 |
| *** openstack changes topic to "On demand agenda (Meeting topic: neutron_l3)" | 14:58 | |
| liuyulong | Anything else to discuss today? | 14:58 |
| *** yamamoto has quit IRC | 14:58 | |
| liuyulong | OK, happy coding, see you guys online. | 14:58 |
| mlavalle | not from me | 14:58 |
| liuyulong | #endmeeting | 14:58 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 14:58 | |
| openstack | Meeting ended Wed Jun 26 14:58:53 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:58 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/neutron_l3/2019/neutron_l3.2019-06-26-13.59.html | 14:58 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/neutron_l3/2019/neutron_l3.2019-06-26-13.59.txt | 14:58 |
| ralonsoh | bye | 14:58 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/neutron_l3/2019/neutron_l3.2019-06-26-13.59.log.html | 14:58 |
| mlavalle | o/ | 14:59 |
| mlavalle | liuyulong: I don't know what you did for your connection today, but it was flawless :-) | 14:59 |
| slaweq | o/ | 14:59 |
| *** liuyulong has left #openstack-meeting | 14:59 | |
| *** yamamoto has joined #openstack-meeting | 14:59 | |
| *** mlavalle has left #openstack-meeting | 15:00 | |
| *** Lucas_Gray has quit IRC | 15:02 | |
| *** mattw4 has quit IRC | 15:05 | |
| *** njohnston has quit IRC | 15:09 | |
| *** Lucas_Gray has joined #openstack-meeting | 15:12 | |
| *** brinzhang has quit IRC | 15:13 | |
| *** brinzhang has joined #openstack-meeting | 15:14 | |
| *** njohnston has joined #openstack-meeting | 15:16 | |
| *** psachin has quit IRC | 15:19 | |
| *** whoami-rajat has quit IRC | 15:22 | |
| *** brinzhang has quit IRC | 15:27 | |
| *** diablo_rojo has joined #openstack-meeting | 15:31 | |
| *** whoami-rajat has joined #openstack-meeting | 15:38 | |
| *** armstrong has joined #openstack-meeting | 15:41 | |
| *** ttsiouts has quit IRC | 15:51 | |
| *** ttsiouts has joined #openstack-meeting | 15:51 | |
| *** tssurya has quit IRC | 15:55 | |
| *** ttsiouts has quit IRC | 15:56 | |
| *** mattw4 has joined #openstack-meeting | 15:57 | |
| *** igordc has joined #openstack-meeting | 15:59 | |
| *** woojay has joined #openstack-meeting | 16:00 | |
| jungleboyj | #startmeeting Cinder | 16:00 |
| openstack | Meeting started Wed Jun 26 16:00:19 2019 UTC and is due to finish in 60 minutes. The chair is jungleboyj. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:00 |
| *** openstack changes topic to " (Meeting topic: Cinder)" | 16:00 | |
| openstack | The meeting name has been set to 'cinder' | 16:00 |
| whoami-rajat | Hi | 16:00 |
| enriquetaso | o/ | 16:00 |
| jungleboyj | courtesy ping: jungleboyj whoami-rajat rajinir lseki carloss pots woojay erlon geguileo eharney rosmaita enriquetaso e0ne smcginnis davidsha walshh_ xyang hemna _hemna | 16:00 |
| davidsha | o/ | 16:01 |
| lseki | o/ | 16:01 |
| geguileo | hi! o/ | 16:01 |
| smcginnis | o/ | 16:01 |
| woojay | hi | 16:01 |
| e0ne | hi | 16:01 |
| walshh_ | hi | 16:01 |
| jungleboyj | @! | 16:01 |
| _pewp_ | jungleboyj ć¾(-_-;) | 16:01 |
| *** _erlon_ has joined #openstack-meeting | 16:02 | |
| jungleboyj | Ok. Looks like we have a decent crowd | 16:02 |
| jungleboyj | Lets get started. | 16:02 |
| _erlon_ | Hey | 16:02 |
| jungleboyj | #topic announcements | 16:03 |
| *** openstack changes topic to "announcements (Meeting topic: Cinder)" | 16:03 | |
| jungleboyj | Don't realy have anything major here other than the usual reminder that we are heading toward MileStone2 | 16:03 |
| whoami-rajat | jungleboyj: spec freeze? | 16:03 |
| jungleboyj | Also the friendly reminder to start thinking about the Train Mid-Cycle: | 16:04 |
| jungleboyj | #link https://etherpad.openstack.org/p/cinder-train-mid-cycle-planning | 16:04 |
| jungleboyj | whoami-rajat: Yes. | 16:04 |
| jungleboyj | I still need to follow up on trying to get a discounted hotel rate. | 16:04 |
| jungleboyj | I need to go hide somewhere and do spec/driver reviews. | 16:05 |
| jungleboyj | That was all I had for announcements. Anyone have anything else to mention there? | 16:06 |
| jungleboyj | Ok. Moving on then. | 16:07 |
| jungleboyj | #topic replication | 16:07 |
| *** openstack changes topic to "replication (Meeting topic: Cinder)" | 16:07 | |
| jungleboyj | walshh_: You here? | 16:07 |
| walshh_ | yes | 16:07 |
| jungleboyj | The floor is yours. | 16:07 |
| walshh_ | just an enquiry on replication_device | 16:07 |
| walshh_ | right now there is a 1:1 relationship between backend and replication | 16:08 |
| _erlon_ | walshh_: not necessarily | 16:08 |
| walshh_ | just wondering is there a reason why it could not be an extra spec on the volume type instead | 16:08 |
| _erlon_ | it depends on how you implement it | 16:08 |
| walshh_ | ok, so it is possible to have multiple replication types per backend right now? | 16:09 |
| _erlon_ | walshh_: you choose how many replication_devices you wanna have | 16:09 |
| _erlon_ | walshh_: yes | 16:09 |
| _erlon_ | lets say you configure [b1] | 16:10 |
| *** artom has quit IRC | 16:10 | |
| _erlon_ | [b1] | 16:10 |
| _erlon_ | replication_device=repdev1 | 16:10 |
| _erlon_ | replication_device=repdev1 | 16:10 |
| _erlon_ | replication_device=repdev2 | 16:10 |
| walshh_ | but if I have 2 replication types won't both be used for each volume? | 16:10 |
| walshh_ | I would like to be able to pick which type I use on a per volume type basis | 16:11 |
| _erlon_ | Im not sure exactly what are you trying to achieve | 16:11 |
| _erlon_ | so, each volume would be casted to a different device? | 16:12 |
| walshh_ | we support 3 different types of replication | 16:12 |
| walshh_ | synchronous, asynchronous and metro | 16:12 |
| jungleboyj | So, I would think that you could set up your driver to do that based on an extra spec. | 16:13 |
| _erlon_ | walshh_: yes, so at volume creation you ant to choose one of them | 16:13 |
| jungleboyj | Then have different volume types for each type. | 16:13 |
| walshh_ | correct | 16:13 |
| _erlon_ | jungleboyj: +1, yes, your driver needs to understand/parse that extra-spec and choose | 16:14 |
| walshh_ | volume_type_1 = 'async' | 16:14 |
| walshh_ | volume_type_2 = 'sync' etc | 16:14 |
| walshh_ | I don't think this is possible right now. | 16:14 |
| _erlon_ | yes, dont forget to report that in your backend | 16:15 |
| walshh_ | but please correct me if I am wrong | 16:15 |
| _erlon_ | it woud be something like: | 16:15 |
| _erlon_ | cinder type-key rep1 set rep_sync_type=async | 16:16 |
| _erlon_ | cinder type-key rep2 set rep_sync_type=sync | 16:16 |
| _erlon_ | the backend/pool must report both, rep_sync_type, so the scheduler will not filter it out | 16:17 |
| walshh_ | thanks Erlon, perhaps we could take this to openstack-cinder rather than me highjacking the meeting. | 16:18 |
| jungleboyj | walshh_: ++ Sounds good. | 16:18 |
| jungleboyj | Sounds like just a matter of designing and coding. | 16:18 |
| _erlon_ | walshh_: sure, Ill be happy to help | 16:18 |
| jungleboyj | :-) | 16:18 |
| walshh_ | great, thanks guys | 16:18 |
| _erlon_ | Im doing the same implementation for our driver :) | 16:19 |
| walshh_ | better again! | 16:19 |
| jungleboyj | _erlon_: Oh, that is good. Have similar implementations would be good then. | 16:19 |
| jungleboyj | walshh_: Next topic is yours as well. | 16:19 |
| walshh_ | yes, we had offered to test the FC portion of this blueprint | 16:20 |
| jungleboyj | #topic Validate Volume WWN Upon Connect | 16:20 |
| *** openstack changes topic to "Validate Volume WWN Upon Connect (Meeting topic: Cinder)" | 16:20 | |
| jungleboyj | #link https://blueprints.launchpad.net/cinder/+spec/validate-volume-wwn-upon-connect | 16:20 |
| *** belmoreira has quit IRC | 16:21 | |
| walshh_ | We can still help out with this if still required | 16:21 |
| jungleboyj | Hmmm, Good question. | 16:21 |
| jungleboyj | avishay worked on that a bit and then disappeared. | 16:21 |
| walshh_ | I'm not sure if anything was done in os-brick for FC yet | 16:22 |
| jungleboyj | geguileo: You know anything about this? | 16:22 |
| geguileo | the WWN validation on connection? | 16:22 |
| jungleboyj | Yes for FC. | 16:23 |
| geguileo | I remember the general idea | 16:23 |
| geguileo | but I don't remember the status | 16:23 |
| jungleboyj | We got changes in place for iSCSI but don't think that any follow up happened for FC. | 16:23 |
| geguileo | we probably didn't add the feature there :-( | 16:24 |
| walshh_ | anyway, offer still holds, if required. Just thought I would follow up | 16:24 |
| jungleboyj | Ok. Could ping Avishay and see if there was any plan to do so. | 16:25 |
| jungleboyj | I can send him a note and see if we get any response. | 16:27 |
| walshh_ | thanks, that is all I had | 16:27 |
| jungleboyj | #action jungleboyj to follow-up with Avishay. | 16:27 |
| hemna | would it help to have os-brick report the wwn of the volume in the connector? | 16:27 |
| jungleboyj | I don't remember the details there. | 16:28 |
| jungleboyj | So, the change was to check the WWN if it was provided in the connector. | 16:30 |
| jungleboyj | #link https://review.opendev.org/#/c/633676 | 16:31 |
| jungleboyj | Anyway. | 16:32 |
| jungleboyj | #topic open discussion | 16:32 |
| *** openstack changes topic to "open discussion (Meeting topic: Cinder)" | 16:32 | |
| whoami-rajat | i guess this was reverted here https://review.opendev.org/#/c/642648/ | 16:33 |
| jungleboyj | Does anyone have other topics for today? | 16:33 |
| whoami-rajat | jungleboyj: ^ | 16:33 |
| jungleboyj | whoami-rajat: Oh yeah. I forgot that. | 16:33 |
| jungleboyj | That would explain why there hasn't been any follow-up. | 16:33 |
| hemna | yah seems this needs some more investigation/work | 16:34 |
| jungleboyj | hemna: ++ | 16:34 |
| *** tesseract has quit IRC | 16:35 | |
| hemna | ceph-iscsi update? | 16:35 |
| jungleboyj | hemna: Sure! | 16:36 |
| hemna | https://review.opendev.org/#/c/667232/ | 16:36 |
| hemna | so I've been working on that a few days now | 16:36 |
| hemna | that's the devstack-plugin-ceph patch to do all the work to install all the requirements | 16:36 |
| hemna | for getting ceph-iscsi installed and configured in devstack | 16:36 |
| hemna | been running into various things | 16:37 |
| hemna | like, even though ubuntu's 4.15 kernel says it has the modules needed to run tcmu-runner, it doesn't work | 16:37 |
| hemna | I think the ceph-iscsi team had patches against the required modules that only landed in the kernel in 4.16 | 16:37 |
| hemna | so I'm just ignoring that for now | 16:38 |
| hemna | and assuming that we'll get a way to work in CI | 16:38 |
| hemna | so in the mean time I've gotten most of the devstack plugin working | 16:38 |
| hemna | but just ran into an ipv6 issue | 16:38 |
| hemna | evidently the rbd-target-gw and rbd-target-api only work on systems that have ipv6 enabled. | 16:39 |
| hemna | which my vm doesn't | 16:39 |
| hemna | does anyone know if our CI images have ipv6 ? | 16:39 |
| smcginnis | I believe so. | 16:39 |
| hemna | I couldn't get neutron to start in a vm where ipv6 was enabled on the host os and guest os | 16:39 |
| hemna | ran into a known bug with setting some socket permissions | 16:40 |
| clarkb | you have to enable RAs | 16:40 |
| hemna | RAs ? | 16:40 |
| clarkb | router advertisements at least for the nodes zuul uses the default with linux if it sends RAs is to not accept RAs | 16:41 |
| clarkb | and neutron sends RAs so you hvae to ask the linux kernel nicely to accept RAs as well via sysctl | 16:41 |
| clarkb | (I don't remember which sysctl it is though) | 16:41 |
| hemna | ok, I have no clue what any of that is | 16:41 |
| * hemna is not a networking guy | 16:41 | |
| clarkb | router advertisements are how nodes discover their IPv6 address | 16:41 |
| hemna | neutron is a black whole to me | 16:41 |
| clarkb | so your test VM likely needs to accept them to learn its address then separately neutron sends them for the networks it manages | 16:42 |
| hemna | I worked around it by disabling ipv6 | 16:42 |
| clarkb | but ya ipv6 should work fine on the zuul jobs | 16:42 |
| clarkb | we run many ipv6 tests | 16:42 |
| hemna | as ipv6 seems like a pain anyway | 16:42 |
| hemna | ok, so I'll just hope/pray that the ipv6 requirements for the ceph-iscsi daemons will work there | 16:43 |
| hemna | :) | 16:43 |
| hemna | we'll find out when CI runs I suppose | 16:43 |
| hemna | ok, so I'll try and wrap up the devstack plugin work today or tomorrow | 16:43 |
| hemna | and then figure out how to get CI firing that up to see if it works | 16:44 |
| hemna | then we can CI the driver patch too | 16:44 |
| hemna | that's the plan at least. | 16:44 |
| hemna | jungleboyj: that's it from me. | 16:45 |
| whoami-rajat | geguileo: quick ques (since i couldn't find you in #openstack-cinder), cinderlib tests run in cinder-tempest-dsvm-lvm-lio-barbican job right? | 16:45 |
| jungleboyj | Sounds good. Thank you for continuing to work on that. | 16:45 |
| geguileo | whoami-rajat: sorry, I had problems with the bouncer and it didn't rejoin the cinder channel :-( | 16:46 |
| geguileo | whoami-rajat: that is correct | 16:47 |
| whoami-rajat | geguileo: oh no problem | 16:47 |
| geguileo | whoami-rajat: it is running on LVM and Ceph CI jobs | 16:47 |
| jungleboyj | Ok. Anything else we need to cover today? | 16:49 |
| whoami-rajat | geguileo: i figured out some of the cinderlib tests failed since i constrained the volume_type_id field to NOT NULL in db, so the cinderlib tests doesn't call c-api to create_volume but rather use cinderlib's defined method in gate jobs right? | 16:50 |
| geguileo | whoami-rajat: yes, that is correct | 16:50 |
| geguileo | whoami-rajat: that would require a change to cinderlib as well | 16:51 |
| geguileo | whoami-rajat: what's the review? | 16:51 |
| whoami-rajat | geguileo: https://review.opendev.org/#/c/639180/ | 16:51 |
| whoami-rajat | geguileo: ok, that's what i thought. Thanks for the help. | 16:52 |
| whoami-rajat | geguileo: tests failing http://logs.openstack.org/80/639180/22/check/cinder-tempest-dsvm-lvm-lio-barbican/dcc733e/job-output.txt.gz#_2019-06-26_13_31_35_595974 | 16:52 |
| jungleboyj | Anything else? | 16:54 |
| jungleboyj | :-) | 16:54 |
| geguileo | whoami-rajat: yeah, the issue is like you said, because you've restricted it to be non-null | 16:54 |
| whoami-rajat | jungleboyj: sorry for holding the meeting, that's all from my side :) | 16:54 |
| jungleboyj | whoami-rajat: No worries. It is Open Discussion | 16:54 |
| whoami-rajat | geguileo: thanks :) | 16:54 |
| jungleboyj | In not one else has topics I will wrap up the meeting. | 16:55 |
| jungleboyj | Thanks everyone for joining. | 16:55 |
| jungleboyj | Go forth and review. | 16:55 |
| jungleboyj | #endmeeting | 16:55 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 16:55 | |
| openstack | Meeting ended Wed Jun 26 16:55:54 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:55 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/cinder/2019/cinder.2019-06-26-16.00.html | 16:55 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/cinder/2019/cinder.2019-06-26-16.00.txt | 16:55 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/cinder/2019/cinder.2019-06-26-16.00.log.html | 16:55 |
| *** woojay has left #openstack-meeting | 16:56 | |
| *** davidsha has quit IRC | 16:56 | |
| *** e0ne has quit IRC | 16:58 | |
| *** ricolin has quit IRC | 17:02 | |
| *** yamamoto_ has joined #openstack-meeting | 17:04 | |
| *** Lucas_Gray has quit IRC | 17:04 | |
| *** yamamoto_ has quit IRC | 17:05 | |
| *** yamamoto_ has joined #openstack-meeting | 17:06 | |
| *** yamamoto has quit IRC | 17:06 | |
| *** zbr|ruck is now known as zbr | 17:18 | |
| *** kopecmartin is now known as kopecmartin|off | 17:24 | |
| *** rf0lc0 is now known as rfolco | 17:30 | |
| *** panda has quit IRC | 17:31 | |
| *** panda has joined #openstack-meeting | 17:35 | |
| *** pleia2_ has joined #openstack-meeting | 17:49 | |
| *** zerick_ has joined #openstack-meeting | 17:50 | |
| *** e0ne has joined #openstack-meeting | 17:51 | |
| *** klindgren_ has joined #openstack-meeting | 17:52 | |
| *** pleia2 has quit IRC | 17:53 | |
| *** zerick has quit IRC | 17:53 | |
| *** klindgren has quit IRC | 17:53 | |
| *** yamamoto_ has quit IRC | 17:53 | |
| *** yamamoto has joined #openstack-meeting | 17:54 | |
| *** altlogbot_2 has quit IRC | 17:55 | |
| *** altlogbot_1 has joined #openstack-meeting | 17:59 | |
| *** altlogbot_1 has quit IRC | 18:01 | |
| *** altlogbot_2 has joined #openstack-meeting | 18:02 | |
| *** e0ne has quit IRC | 18:29 | |
| *** hongbin has joined #openstack-meeting | 18:33 | |
| *** ociuhandu has quit IRC | 18:36 | |
| *** e0ne has joined #openstack-meeting | 18:44 | |
| diablo_rojo | Storyboard won't be having a regular meeting this week so if you have questions/comments/concerns, please join us in #storyboard! | 19:08 |
| *** e0ne has quit IRC | 19:08 | |
| *** dklyle has quit IRC | 19:09 | |
| *** wwriverrat has left #openstack-meeting | 19:15 | |
| *** ralonsoh has quit IRC | 19:17 | |
| *** phughk has quit IRC | 19:18 | |
| *** whoami-rajat has quit IRC | 19:22 | |
| *** dklyle has joined #openstack-meeting | 19:36 | |
| *** panda has quit IRC | 19:39 | |
| *** panda has joined #openstack-meeting | 19:40 | |
| *** altlogbot_2 has quit IRC | 19:45 | |
| *** altlogbot_3 has joined #openstack-meeting | 19:47 | |
| *** mriedem has quit IRC | 20:04 | |
| *** mriedem has joined #openstack-meeting | 20:07 | |
| *** diablo_rojo has quit IRC | 20:09 | |
| *** enriquetaso has quit IRC | 20:14 | |
| *** altlogbot_3 has quit IRC | 20:15 | |
| *** eharney has quit IRC | 20:16 | |
| *** altlogbot_1 has joined #openstack-meeting | 20:19 | |
| *** altlogbot_1 has quit IRC | 20:42 | |
| *** altlogbot_1 has joined #openstack-meeting | 20:45 | |
| *** alecuyer has joined #openstack-meeting | 20:59 | |
| *** efried has left #openstack-meeting | 21:00 | |
| timburke | #startmeeting swift | 21:00 |
| openstack | Meeting started Wed Jun 26 21:00:17 2019 UTC and is due to finish in 60 minutes. The chair is timburke. Information about MeetBot at http://wiki.debian.org/MeetBot. | 21:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 21:00 |
| *** openstack changes topic to " (Meeting topic: swift)" | 21:00 | |
| openstack | The meeting name has been set to 'swift' | 21:00 |
| timburke | who's here for the swift meeting? | 21:00 |
| *** altlogbot_1 has quit IRC | 21:00 | |
| clayg | o/ | 21:00 |
| mattoliverau | o/ | 21:00 |
| alecuyer | hello | 21:00 |
| timburke | not too much on the agenda | 21:01 |
| timburke | #link https://wiki.openstack.org/wiki/Meetings/Swift | 21:01 |
| timburke | #topic Shanghai CFP | 21:02 |
| *** openstack changes topic to "Shanghai CFP (Meeting topic: swift)" | 21:02 | |
| timburke | first, just a heads-up | 21:02 |
| timburke | the call for proposals for summit talks ends in about a week | 21:02 |
| timburke | that and other details were on the mailing list | 21:03 |
| timburke | #link http://lists.openstack.org/pipermail/openstack-discuss/2019-June/007373.html | 21:03 |
| timburke | there isn't a dedicated "Storage" track or anything, but i feel like we could tell some interesting stories under "Private & Hybrid Cloud" or "Public Cloud" (which are awfully broad topics) | 21:03 |
| timburke | or maybe even "Open Development", "AI, Machine Learning & HPC", or "Container Infrastructure" | 21:03 |
| timburke | so, if you've got something you might like to present on, you've got until July 2 to submit it! | 21:04 |
| timburke | any questions on the summit? | 21:05 |
| mattoliverau | Yeah, I assume it'll be asia heavy, specicially china (obviously), usually that community is quiet, so I wonder if we'll see any interesting swift talks from them | 21:05 |
| *** altlogbot_1 has joined #openstack-meeting | 21:05 | |
| mattoliverau | well quiet though the usual channels we use | 21:05 |
| *** pcaruana has quit IRC | 21:05 | |
| timburke | me too. and apparently "Sessions will be presented in both Mandarin and English, so you may submit your presentation in either language." which is also interesting | 21:06 |
| *** tdasilva has joined #openstack-meeting | 21:06 | |
| tdasilva | heelo, sorry i'm late | 21:06 |
| mattoliverau | tdasilva: o/ | 21:06 |
| timburke | next up, updates! | 21:07 |
| timburke | #topic py3 | 21:07 |
| *** openstack changes topic to "py3 (Meeting topic: swift)" | 21:07 | |
| timburke | we finished porting the unit tests! | 21:07 |
| mattoliverau | \o/ | 21:07 |
| timburke | there are still a handful of patches to get py2 func tests passing against py3 services though | 21:07 |
| alecuyer | bravo :) | 21:07 |
| timburke | i updated the set of patches on the priority reviews wiki | 21:08 |
| timburke | #link https://wiki.openstack.org/wiki/Swift/PriorityReviews | 21:08 |
| timburke | there *is* a patch to actually have py2 tests against py3 running in the gate though! | 21:08 |
| mattoliverau | Sorry it's hack week this week at SUSE, we're not suppose to do normal work and instead on what ever we want instead. So haven't really gone and reviewed much py3. Had a few distractions with the girls and flu shots but otherwise have been focusing on auto sharding because HACKWEEK | 21:10 |
| timburke | so -- how are people feeling regarding a release? should i continue waiting for py2 func tests passing, or should i known-issues the last few things? | 21:10 |
| timburke | yay autosharding! i saw those patches go by, i'm excited :-) | 21:10 |
| timburke | (fwiw i'm already planning on known-issuing the ECAppIter bug) | 21:11 |
| mattoliverau | Well it would be nice to have a way of func testing. | 21:12 |
| mattoliverau | is the first py3 release going to be marked as experimental? | 21:13 |
| timburke | yeah. and i kinda want to push people to try it out in devstack around the same time as i announce the experimental support... | 21:13 |
| timburke | yeah, that's my plan | 21:13 |
| mattoliverau | ok if it's experimental that func tests are only good to have. | 21:14 |
| mattoliverau | is it just the 4 patches to get py2 - py3 func working? | 21:15 |
| timburke | idk -- like, there's a workaround for https://bugs.launchpad.net/swift/+bug/1691075 but it'd be nicer if it just *worked*... | 21:16 |
| openstack | Launchpad bug 1691075 in OpenStack Object Storage (swift) "swift-object-server fails to start in python 3.5 environment with devstack" [Undecided,Confirmed] | 21:16 |
| timburke | yeah. https://review.opendev.org/#/c/665494/ to address ^^^ | 21:16 |
| timburke | https://review.opendev.org/#/c/653548/ to clean up some lingering memcache issues (that i think relate to how keystonemiddleware/keystoneauth use it?) | 21:17 |
| timburke | https://review.opendev.org/#/c/662546/ to work around a cpython bug related to non-ascii headers | 21:17 |
| timburke | and https://review.opendev.org/#/c/666942/ to actually have the full suite running in the gate | 21:18 |
| timburke | i think those are roughly in order of importance -- if i could get the first two, i'm more willing to known-issues the third (which is hairier anyway) | 21:19 |
| timburke | can anyone commit to reviewing one or both of those top two? | 21:19 |
| mattoliverau | well I t hink having some kinda of func tests happening in py3 would be awesome, especially as we add new Swift code. So how about we focus on the py2 func tests testing py3 swift, at least give it until the end this week/early next week. And then cut a release? | 21:19 |
| mattoliverau | I'll take a look at them, I do have more time (HACKWEEK!) | 21:20 |
| timburke | thanks mattoliverau! | 21:20 |
| timburke | sounds like a plan: release early next week | 21:20 |
| timburke | then we can move on to getting func tests ported ;-) | 21:21 |
| mattoliverau | +1 | 21:21 |
| timburke | #topic lots of small files | 21:21 |
| *** openstack changes topic to "lots of small files (Meeting topic: swift)" | 21:21 | |
| timburke | alecuyer, how's it going? | 21:21 |
| alecuyer | I wrote more tests, | 21:22 |
| alecuyer | found some issues (heh!), things like, if fsck removes the "wrong" file, you're not able to write to a partition until the operator fixes it | 21:22 |
| *** ianychoi has quit IRC | 21:23 | |
| timburke | eep! good thing we're finding them :-) | 21:23 |
| alecuyer | So, some fixes, and had to refactor some things for testing. I'd like to stop adding new tests for that patch because it's getting large, so 'ill try to clean it and "finish" it before I write tests for more things | 21:23 |
| *** Lucas_Gray has joined #openstack-meeting | 21:24 | |
| alecuyer | timburke: Yes :) it's not something that I expect would happen often but we do know if it can happen, it will ;) so, that's it | 21:24 |
| timburke | that sounds like a plan | 21:25 |
| timburke | anything the rest of us can do to help you? | 21:25 |
| mattoliverau | nice find, capturing all edge cases is hard/impossible. great to find and know about these kind of issues :) | 21:25 |
| alecuyer | I think for this review it's best to wait a little because I know it's not ready | 21:26 |
| *** rsimai_away has quit IRC | 21:26 | |
| alecuyer | maye if anyone wants to think about grpc / eventlet and find something i couldn't | 21:26 |
| timburke | i can try to do that. i've been digging around in eventlet a bit lately anyway | 21:27 |
| timburke | i'll also plan on merging from master sometime this week (hopefully today) | 21:27 |
| alecuyer | great, thanks! | 21:27 |
| timburke | be warned, now you'll *have* to make things pass on py3 ;-) | 21:27 |
| mattoliverau | lol | 21:28 |
| alecuyer | heh yes I know I'll have some work thereā¦ :-) | 21:28 |
| timburke | #topic open discussion | 21:28 |
| *** openstack changes topic to "open discussion (Meeting topic: swift)" | 21:28 | |
| timburke | that's it for the agenda; does anyone have anything else to bring up? | 21:28 |
| mattoliverau | As mentioned earlier I've working on autosharding. | 21:28 |
| *** ianychoi has joined #openstack-meeting | 21:28 | |
| mattoliverau | #link https://review.opendev.org/#/c/667030 | 21:28 |
| mattoliverau | and | 21:28 |
| mattoliverau | #link https://review.opendev.org/#/c/667579 | 21:29 |
| mattoliverau | so far. | 21:29 |
| *** zaitcev_ has joined #openstack-meeting | 21:29 | |
| mattoliverau | it's still very rough and a WIP | 21:29 |
| mattoliverau | working on a bit of patch chain to get something up | 21:29 |
| timburke | oh! and speaking of sharding, i started thinking about caching shard ranges | 21:30 |
| mattoliverau | the latter one is just something I pushed up to get it off my machine late last night. | 21:30 |
| timburke | #link https://review.opendev.org/#/c/667203/ | 21:30 |
| mattoliverau | timburke: yeah I saw that and plan to look more closely at it, great work | 21:30 |
| *** raildo has quit IRC | 21:30 | |
| mattoliverau | 667579 has a large commit message ramble that might be interesting | 21:31 |
| timburke | i started with just the updating set -- listings were left for future work -- i mainly wanted to get the container GET out of the object write path | 21:31 |
| mattoliverau | ie. currently we use the OP tool to scan all ranges and the push all of them in to start sharding, whereas the existing auto sharding (we only use in tests) has been designed to scan X at a time per round | 21:31 |
| timburke | cool | 21:33 |
| mattoliverau | I wonder if to simplify and to decrease the potential known edge cases, is if we do something similar. Ie the leader scans for ALL ranges. That was we can bail on inserting them (on the second election, ie am I still the leader) if any of the other primaries are in the SHARDING or SHARDED state | 21:33 |
| mattoliverau | ie, the OP has adding the ranges or there was a weird election issue etc. | 21:34 |
| mattoliverau | Anyway. We have other larger priorities, so just wanted to bring it to peoples attention | 21:35 |
| mattoliverau | I'll push along and get something to play with up | 21:36 |
| timburke | i know that we (SwiftStack) always do all ranges at once -- i'd be ok going either way, i think. the one nice thing about just doing a few at a time is that you're less likely to do a bunch of work and then discard the result | 21:36 |
| mattoliverau | yeah | 21:36 |
| *** ykatabam has joined #openstack-meeting | 21:36 | |
| timburke | oh -- swiftclient's gate is currently busted! https://review.opendev.org/#/c/667477/ is a step in the right direction, but needs more work :-/ | 21:36 |
| mattoliverau | anyway, that's all I got atm. | 21:38 |
| timburke | anyone have anything else to bring up? | 21:38 |
| alecuyer | Unrelated to swift dev but I'll have to help our ML team at OVH with working with swift (with the "JOSS" java library). If there are nice use cases there I'll let you know :) | 21:38 |
| zaitcev_ | 2019-06-26 10:21:50.802482 | ubuntu-bionic | Requirement(package='sphinx', location='', specifiers='!=1.6.6,!=1.6.7,!=2.1.0', markers="python_version>='3.4'", comment='# BSD', extras=frozenset()) | 21:38 |
| zaitcev_ | 2019-06-26 10:21:50.802588 | ubuntu-bionic | WARNING: possible mismatch found for package "sphinx" | 21:38 |
| zaitcev_ | step in the right direction indeed | 21:38 |
| timburke | alecuyer, cool! sounds like the sort of thing that could turn into a summit talk ;-) | 21:39 |
| timburke | thanks zaitcev_ | 21:39 |
| timburke | i think there's also something that needs to happen related to https://review.opendev.org/#/c/588103/ :-/ | 21:40 |
| timburke | (wherein we switched to using auth_uri in the test config) | 21:40 |
| *** diablo_rojo has joined #openstack-meeting | 21:40 | |
| timburke | any other topics? | 21:42 |
| *** panda has quit IRC | 21:42 | |
| timburke | then i think we'll break a bit early | 21:43 |
| clayg | noice | 21:43 |
| timburke | thank you all for coming, and thank you for working on swift! | 21:43 |
| timburke | #endmeeting | 21:43 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 21:43 | |
| openstack | Meeting ended Wed Jun 26 21:43:37 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 21:43 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/swift/2019/swift.2019-06-26-21.00.html | 21:43 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/swift/2019/swift.2019-06-26-21.00.txt | 21:43 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/swift/2019/swift.2019-06-26-21.00.log.html | 21:43 |
| *** zaitcev_ has left #openstack-meeting | 21:43 | |
| *** alecuyer has left #openstack-meeting | 21:43 | |
| mattoliverau | nice thanks timburke | 21:44 |
| *** panda has joined #openstack-meeting | 21:45 | |
| *** tdasilva_ has joined #openstack-meeting | 21:52 | |
| *** tdasilva has quit IRC | 21:54 | |
| *** rcernin has joined #openstack-meeting | 22:01 | |
| *** Lucas_Gray has quit IRC | 22:05 | |
| *** shilpasd has quit IRC | 22:11 | |
| *** eharney has joined #openstack-meeting | 22:12 | |
| *** rcernin has quit IRC | 22:19 | |
| *** rcernin has joined #openstack-meeting | 22:20 | |
| *** heikkine has quit IRC | 22:26 | |
| *** mattw4 has quit IRC | 22:37 | |
| *** diablo_rojo has quit IRC | 22:44 | |
| *** armstrong has quit IRC | 22:51 | |
| *** diablo_rojo has joined #openstack-meeting | 23:07 | |
| *** ykatabam is now known as yuko|brb | 23:18 | |
| *** carloss has quit IRC | 23:23 | |
| *** igordc has quit IRC | 23:25 | |
| *** mriedem has quit IRC | 23:42 | |
| *** hongbin has quit IRC | 23:43 | |
| *** slaweq has quit IRC | 23:50 | |
| *** yuko|brb is now known as ykatabam | 23:51 | |
| *** bobh has joined #openstack-meeting | 23:54 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!