*** rbudden has quit IRC | 00:08 | |
*** ttsiouts has joined #openstack-meeting | 00:52 | |
*** jmasud has quit IRC | 00:55 | |
*** jmasud has joined #openstack-meeting | 00:56 | |
*** gyee has quit IRC | 01:07 | |
*** Liang__ has joined #openstack-meeting | 01:13 | |
*** ysandeep|away is now known as ysandeep|rover | 01:17 | |
*** ttsiouts has quit IRC | 01:25 | |
*** ricolin has joined #openstack-meeting | 01:58 | |
*** ysandeep|rover is now known as ysandeep|brb | 02:10 | |
*** apetrich has quit IRC | 02:11 | |
*** yamamoto has joined #openstack-meeting | 02:14 | |
*** moguimar has quit IRC | 02:14 | |
*** ykatabam has quit IRC | 02:51 | |
*** ykatabam has joined #openstack-meeting | 02:57 | |
*** brinzhang_ has quit IRC | 02:59 | |
*** brinzhang_ has joined #openstack-meeting | 02:59 | |
*** rh-jelabarre has quit IRC | 03:00 | |
*** ttsiouts has joined #openstack-meeting | 03:22 | |
*** psachin has joined #openstack-meeting | 03:28 | |
*** ysandeep|brb is now known as ysandeep|rover | 03:42 | |
*** yamamoto has quit IRC | 03:42 | |
*** yamamoto has joined #openstack-meeting | 03:44 | |
*** yaawang__ has quit IRC | 03:53 | |
*** vishalmanchanda has joined #openstack-meeting | 03:53 | |
*** ttsiouts has quit IRC | 03:56 | |
*** andrebeltrami has quit IRC | 04:26 | |
*** yamamoto has quit IRC | 04:42 | |
*** yamamoto has joined #openstack-meeting | 04:47 | |
*** ociuhandu has joined #openstack-meeting | 04:47 | |
*** zaneb has quit IRC | 04:48 | |
*** zaneb has joined #openstack-meeting | 04:49 | |
*** ociuhandu has quit IRC | 04:51 | |
*** jmasud has quit IRC | 04:53 | |
*** jmasud has joined #openstack-meeting | 04:56 | |
*** brinzhang has joined #openstack-meeting | 05:08 | |
*** brinzhang_ has quit IRC | 05:11 | |
*** armax has quit IRC | 05:27 | |
*** armax has joined #openstack-meeting | 05:28 | |
*** igordc has quit IRC | 05:32 | |
*** armax has quit IRC | 05:33 | |
*** ttsiouts has joined #openstack-meeting | 05:53 | |
*** yaawang has joined #openstack-meeting | 05:58 | |
*** masahito has joined #openstack-meeting | 06:05 | |
*** armax has joined #openstack-meeting | 06:13 | |
*** armax has quit IRC | 06:18 | |
*** links has joined #openstack-meeting | 06:20 | |
*** ttsiouts has quit IRC | 06:27 | |
*** gtema has joined #openstack-meeting | 06:30 | |
*** gtema has quit IRC | 06:38 | |
*** gtema has joined #openstack-meeting | 06:40 | |
*** gtema has quit IRC | 06:45 | |
*** ttsiouts has joined #openstack-meeting | 06:45 | |
*** gtema has joined #openstack-meeting | 06:45 | |
*** dklyle has quit IRC | 06:48 | |
*** yamamoto has quit IRC | 06:52 | |
*** slaweq_ has joined #openstack-meeting | 06:57 | |
*** maciejjozefczyk has joined #openstack-meeting | 07:00 | |
*** yaawang has quit IRC | 07:04 | |
*** yaawang has joined #openstack-meeting | 07:05 | |
*** yamamoto has joined #openstack-meeting | 07:05 | |
*** lpetrut has joined #openstack-meeting | 07:09 | |
*** belmoreira has joined #openstack-meeting | 07:16 | |
*** rpittau|afk is now known as rpittau | 07:17 | |
*** ysandeep|rover is now known as ysandeep|lunch | 07:24 | |
*** ralonsoh has joined #openstack-meeting | 07:33 | |
*** e0ne has joined #openstack-meeting | 07:38 | |
*** ociuhandu has joined #openstack-meeting | 07:44 | |
*** gtema has quit IRC | 07:44 | |
*** brinzhang_ has joined #openstack-meeting | 07:48 | |
*** brinzhang has quit IRC | 07:51 | |
*** gtema has joined #openstack-meeting | 07:58 | |
ttx | NB: large scale SIG meeting in #openstack-meeting-3 now | 08:01 |
---|---|---|
*** dmellado has quit IRC | 08:01 | |
ttx | masahito: belmoreira ^ | 08:01 |
masahito | hi | 08:02 |
masahito | I completely forgot we changed the time slot :-) | 08:02 |
*** ociuhandu has quit IRC | 08:02 | |
ttx | Sorry we had to change the channel too | 08:02 |
ttx | so -> #openstack-meeting-3 | 08:03 |
masahito | got it. | 08:03 |
*** ociuhandu has joined #openstack-meeting | 08:03 | |
ttx | jiaopengju1: ^ | 08:03 |
*** gtema has quit IRC | 08:04 | |
*** dmellado has joined #openstack-meeting | 08:05 | |
ttx | etp: ^ | 08:05 |
*** gtema has joined #openstack-meeting | 08:07 | |
*** ociuhandu has quit IRC | 08:08 | |
*** brinzhang has joined #openstack-meeting | 08:10 | |
*** witek has joined #openstack-meeting | 08:11 | |
*** brinzhang_ has quit IRC | 08:13 | |
*** brinzhang_ has joined #openstack-meeting | 08:14 | |
*** brinzhang has quit IRC | 08:15 | |
*** rcernin has quit IRC | 08:27 | |
*** ysandeep|lunch is now known as ysandeep|rover | 08:29 | |
*** dmacpher has quit IRC | 08:32 | |
*** dmacpher has joined #openstack-meeting | 08:33 | |
*** witek has quit IRC | 08:33 | |
*** slaweq_ is now known as slaweq | 08:36 | |
*** ociuhandu has joined #openstack-meeting | 08:45 | |
*** yaawang has quit IRC | 08:48 | |
*** yaawang has joined #openstack-meeting | 08:50 | |
*** ociuhandu has quit IRC | 08:50 | |
*** ociuhandu has joined #openstack-meeting | 08:52 | |
*** jmasud has quit IRC | 08:54 | |
*** jmasud has joined #openstack-meeting | 08:56 | |
*** ociuhandu has quit IRC | 09:04 | |
*** ociuhandu has joined #openstack-meeting | 09:04 | |
*** brinzhang has joined #openstack-meeting | 09:06 | |
*** brinzhang_ has quit IRC | 09:09 | |
*** ociuhandu has quit IRC | 09:09 | |
*** nitinuikey has joined #openstack-meeting | 09:11 | |
*** yaawang has quit IRC | 09:14 | |
*** yaawang has joined #openstack-meeting | 09:16 | |
*** dmacpher has quit IRC | 09:20 | |
*** dmacpher has joined #openstack-meeting | 09:23 | |
*** ricolin_ has quit IRC | 09:29 | |
*** nitinuikey has quit IRC | 09:30 | |
*** ricolin_ has joined #openstack-meeting | 09:30 | |
*** ricolin has quit IRC | 09:30 | |
*** yaawang has quit IRC | 09:35 | |
*** yaawang has joined #openstack-meeting | 09:36 | |
*** Liang__ has quit IRC | 09:38 | |
*** ociuhandu has joined #openstack-meeting | 09:40 | |
*** ykatabam has quit IRC | 09:45 | |
*** brinzhang_ has joined #openstack-meeting | 09:52 | |
*** brinzhang has quit IRC | 09:55 | |
*** ricolin_ has quit IRC | 09:57 | |
*** ricolin_ has joined #openstack-meeting | 09:57 | |
*** ricolin has joined #openstack-meeting | 10:00 | |
*** ricolin_ has quit IRC | 10:02 | |
*** masahito has quit IRC | 10:04 | |
*** links has quit IRC | 10:08 | |
*** yamamoto has quit IRC | 10:13 | |
*** slaweq has quit IRC | 10:23 | |
*** rpittau is now known as rpittau|bbl | 10:24 | |
*** slaweq has joined #openstack-meeting | 10:25 | |
*** ysandeep|rover is now known as ysandeep|afk | 10:30 | |
*** links has joined #openstack-meeting | 10:31 | |
*** yamamoto has joined #openstack-meeting | 10:33 | |
*** yamamoto has quit IRC | 10:34 | |
*** masahito has joined #openstack-meeting | 10:37 | |
*** brinzhang has joined #openstack-meeting | 10:37 | |
*** ricolin has quit IRC | 10:39 | |
*** oneswig has joined #openstack-meeting | 10:39 | |
*** brinzhang_ has quit IRC | 10:40 | |
*** masahito has quit IRC | 10:41 | |
*** yamamoto has joined #openstack-meeting | 10:53 | |
*** ykatabam has joined #openstack-meeting | 10:55 | |
*** brinzhang_ has joined #openstack-meeting | 10:57 | |
*** e0ne has quit IRC | 10:58 | |
*** e0ne has joined #openstack-meeting | 10:58 | |
*** janders has joined #openstack-meeting | 11:00 | |
oneswig | #startmeeting scientific-sig | 11:00 |
openstack | Meeting started Wed Apr 8 11:00:12 2020 UTC and is due to finish in 60 minutes. The chair is oneswig. Information about MeetBot at http://wiki.debian.org/MeetBot. | 11:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 11:00 |
*** openstack changes topic to " (Meeting topic: scientific-sig)" | 11:00 | |
openstack | The meeting name has been set to 'scientific_sig' | 11:00 |
*** dh3 has joined #openstack-meeting | 11:00 | |
oneswig | #topic greetings | 11:00 |
*** openstack changes topic to "greetings (Meeting topic: scientific-sig)" | 11:00 | |
janders | g'day | 11:00 |
oneswig | hi janders | 11:00 |
*** brinzhang has quit IRC | 11:00 | |
oneswig | What's new with you? | 11:00 |
dh3 | hi | 11:01 |
janders | interesting cx6-eth breakages for AOB :) | 11:01 |
oneswig | Hi dh3 | 11:01 |
oneswig | already looking forward to it... | 11:01 |
verdurin | Hello. | 11:01 |
oneswig | greetings verdurin | 11:02 |
oneswig | Let's get the show on the road | 11:02 |
oneswig | #topic Kolla user group | 11:02 |
*** openstack changes topic to "Kolla user group (Meeting topic: scientific-sig)" | 11:02 | |
oneswig | OK, only new item on this week's agenda | 11:02 |
oneswig | For Kolla users there's a new effort to get users and operators talking with developers | 11:03 |
oneswig | #link Kolla user group thread http://lists.openstack.org/pipermail/openstack-discuss/2020-April/013787.html | 11:03 |
*** gtema has left #openstack-meeting | 11:03 | |
oneswig | If you're using Kolla, hopefully it will be a worthwhile discussion | 11:04 |
verdurin | Yes, hoping to attend. | 11:06 |
oneswig | Is there something similar for TripleO - I know there are feedback sessions at the summits | 11:06 |
janders | I call it tripleno :P | 11:07 |
janders | (can be made work though :) ) | 11:07 |
oneswig | OK, good to know. | 11:08 |
oneswig | I've been to quite a few operator feedback sessions in different forms, hopefully this will be productive. | 11:09 |
oneswig | Move on? | 11:09 |
oneswig | #topic AOB | 11:09 |
*** openstack changes topic to "AOB (Meeting topic: scientific-sig)" | 11:09 | |
janders | ok... i promised some cx6-eth stories | 11:10 |
janders | we used to have an issue getting VPI to work. All IB config *just worked* but eth-ib less so | 11:10 |
janders | a FW version came out some time back that was supposed to fix it, we started testing this a couple weeks back | 11:10 |
janders | catch: it seems for VPI to work, eth needs to be on port1 and ib on port2 | 11:10 |
janders | and we're wired the other way round and have limited DC access due to lockdown so it's tricky to swap it over | 11:11 |
verdurin | janders: ??? | 11:11 |
janders | in any case - it does malfunction in an interesting way | 11:11 |
janders | eth link comes up no worries | 11:11 |
janders | till... you try to use it with LB or ovs | 11:11 |
janders | when it just drops any traffic with MAC address not matching physical point | 11:11 |
janders | our friends at Mellanox are looking at it but that's where things are at | 11:12 |
janders | ive seen a few issues with VPI but not this one :) | 11:12 |
janders | have you guys seen anything like that? | 11:12 |
oneswig | I have... kind of... | 11:12 |
janders | what card was that on? | 11:13 |
janders | also a cx6? | 11:13 |
janders | or something different? | 11:13 |
oneswig | ConnectX-5, probably different issue. | 11:13 |
oneswig | This is SRIOV over a bonded LAG | 11:13 |
*** janders has quit IRC | 11:13 | |
*** janders has joined #openstack-meeting | 11:14 | |
janders | sorry got dropped out | 11:14 |
janders | (not VPIs fault :) ) | 11:14 |
janders | oneswig: what was the problem on cx5? | 11:14 |
oneswig | Aha, well it was related to VF-LAG and OVS | 11:14 |
belmoreira | hi, just joined | 11:15 |
oneswig | I got into a situation where I can receive broadcast traffic but not unicast | 11:15 |
oneswig | Hi belmoreira | 11:15 |
janders | right! | 11:15 |
oneswig | Are you using OVS 2.12? | 11:15 |
janders | was that only specific to VFs, or would it impact traffic across the board? | 11:15 |
janders | (checking) | 11:15 |
oneswig | Saw it first in VFs. When I installed OVS 2.12 it affected both | 11:16 |
*** apetrich has joined #openstack-meeting | 11:16 | |
oneswig | Haven't investigated in sufficient detail yet but it might not be related | 11:16 |
janders | 2.9.0 is the version | 11:17 |
oneswig | BTW The RDO build of OVS 2.12 apparently is quite old compared to recent code on that branch | 11:17 |
janders | right! | 11:19 |
janders | this is OSP13/Queens based project | 11:19 |
janders | so it may be worth re-testing with latest ovs | 11:19 |
janders | has upgrading ovs helped in your case? | 11:19 |
oneswig | OVS troubleshooting tools are a dark art all to their own | 11:19 |
janders | yeah we may need to sacrifice a packet or two to the ovs gods... | 11:20 |
oneswig | janders: not yet, 2.11->2.12 caused many problems on first attempt | 11:20 |
oneswig | Need to go back and do it again, with better preparation | 11:20 |
oneswig | belmoreira: was talking with someone recently about external hardware inventories and Ironic. I was thinking about Arne's work on that. Did CERN settle on a hardware inventory management system? | 11:22 |
belmoreira | not yet | 11:22 |
oneswig | belmoreira: so what's new at CERN? | 11:24 |
belmoreira | :) related with ironic, we are now moving into conductor groups | 11:24 |
*** janders has quit IRC | 11:25 | |
belmoreira | this allows us to split the ironic infrastructure more or less like cells | 11:25 |
oneswig | how many nodes are you managing now? | 11:25 |
belmoreira | ~5100 | 11:27 |
*** janders has joined #openstack-meeting | 11:27 | |
oneswig | nice work :-) | 11:28 |
oneswig | How do you size the number of nodes managed by a conductor group? | 11:29 |
*** ykatabam has quit IRC | 11:30 | |
belmoreira | We introduced the first conductor group with ~600 nodes | 11:30 |
belmoreira | the metric that we use is the time that the resource tracker takes to run | 11:30 |
*** ysandeep|afk is now known as ysandeep|rover | 11:31 | |
janders | clever! | 11:31 |
oneswig | Have you reduced how often it runs? I think I remember you changed it to run every few hours? | 11:32 |
belmoreira | yes, but with the latest versions it impacts node state updates | 11:33 |
belmoreira | with 600 nodes it takes around ~15 minutes to run | 11:33 |
*** ociuhandu has quit IRC | 11:34 | |
oneswig | On a related subject, someone in our team mentioned the software-raid deployment has improved flexibility now. | 11:34 |
belmoreira | we are discussing in having conductor groups with 500 nodes | 11:34 |
*** ociuhandu has joined #openstack-meeting | 11:35 | |
belmoreira | I think the raid work is already merged upstream. For details Arne is the best person to contact | 11:36 |
oneswig | great, thanks. | 11:37 |
*** ociuhandu has quit IRC | 11:39 | |
oneswig | On a different subject - dh3: has there been any further development on your work integrating Lustre with OpenStack clients? | 11:40 |
dh3 | oneswig: "a bit" - it is fighting for our attention with other projects, and we were hitting some weird Lustre errors which made upgrading the client version more urgent (we are settling on 2.12.4 now) but the users still want it | 11:42 |
dh3 | the general approach of building an image with Lustre already in it is working though, we have several groups using it as poc | 11:44 |
dh3 | (can't escape posix :) ) | 11:44 |
oneswig | dh3: I saw you guys are now famous - some familiar faces here https://www.youtube.com/watch?v=WAWJxVYH9QM&feature=youtu.be | 11:44 |
*** links has quit IRC | 11:44 | |
*** links has joined #openstack-meeting | 11:45 | |
*** rh-jelabarre has joined #openstack-meeting | 11:45 | |
dh3 | haha, I knew there was something in the works but I hadn't seen that. we are in contract (re)negotiation land now, different kind of fun | 11:45 |
oneswig | good luck with that! :-) | 11:46 |
*** brinzhang has joined #openstack-meeting | 11:47 | |
dh3 | thanks :) | 11:47 |
oneswig | dh3: there has been some work recently with Cambridge Uni on improved Ansible automation for Lustre. Might be worth sharing notes with you on that. | 11:49 |
dh3 | oneswig: we'd be interested. We don't let our main site Ansible touch Lustre servers much at the moment, trying to keep them as "black box" - only to install stats scripts and (soon) to control iptables | 11:50 |
*** brinzhang_ has quit IRC | 11:50 | |
*** ociuhandu has joined #openstack-meeting | 11:51 | |
oneswig | dh3: ok sounds good. | 11:51 |
oneswig | I didn't have more for today - anyone else? | 11:52 |
*** raildo has joined #openstack-meeting | 11:53 | |
oneswig | OK y'all, good to see everyone, thanks for joining :-) | 11:54 |
oneswig | #endmeeting | 11:54 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 11:54 | |
dh3 | take care | 11:54 |
openstack | Meeting ended Wed Apr 8 11:54:41 2020 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 11:54 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/scientific_sig/2020/scientific_sig.2020-04-08-11.00.html | 11:54 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/scientific_sig/2020/scientific_sig.2020-04-08-11.00.txt | 11:54 |
openstack | Log: http://eavesdrop.openstack.org/meetings/scientific_sig/2020/scientific_sig.2020-04-08-11.00.log.html | 11:54 |
oneswig | same to you! | 11:54 |
dh3 | bye for now | 11:55 |
*** janders has quit IRC | 11:57 | |
*** dh3 has quit IRC | 12:01 | |
*** ociuhandu has quit IRC | 12:10 | |
*** ociuhandu has joined #openstack-meeting | 12:11 | |
*** ociuhandu has quit IRC | 12:16 | |
*** brinzhang has quit IRC | 12:19 | |
*** JangwonLee_ has joined #openstack-meeting | 12:21 | |
*** rpittau|bbl is now known as rpittau | 12:23 | |
*** brinzhang has joined #openstack-meeting | 12:23 | |
*** brinzhang has quit IRC | 12:23 | |
*** JangwonLee__ has quit IRC | 12:25 | |
*** andrebeltrami has joined #openstack-meeting | 12:40 | |
*** ttsiouts has quit IRC | 12:53 | |
*** jmasud has quit IRC | 12:54 | |
*** jmasud has joined #openstack-meeting | 12:56 | |
*** ttsiouts has joined #openstack-meeting | 12:57 | |
*** ricolin has joined #openstack-meeting | 12:57 | |
*** oneswig has quit IRC | 13:00 | |
*** JangwonLee__ has joined #openstack-meeting | 13:02 | |
*** JangwonLee_ has quit IRC | 13:05 | |
*** ysandeep|rover is now known as ysandeep|away | 13:25 | |
*** eharney has joined #openstack-meeting | 13:28 | |
*** ociuhandu has joined #openstack-meeting | 13:33 | |
*** yamamoto has quit IRC | 13:50 | |
*** jraju__ has joined #openstack-meeting | 13:50 | |
*** Liang__ has joined #openstack-meeting | 13:50 | |
*** links has quit IRC | 13:52 | |
*** liuyulong has joined #openstack-meeting | 13:59 | |
liuyulong | #startmeeting neutron_l3 | 14:00 |
openstack | Meeting started Wed Apr 8 14:00:50 2020 UTC and is due to finish in 60 minutes. The chair is liuyulong. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
*** openstack changes topic to " (Meeting topic: neutron_l3)" | 14:00 | |
*** Liang__ is now known as LiangFang | 14:00 | |
openstack | The meeting name has been set to 'neutron_l3' | 14:00 |
slaweq | hi | 14:01 |
ralonsoh | hi | 14:01 |
liuyulong | hi | 14:01 |
* slaweq will be lurking here due to some internal meeting running in parallel | 14:01 | |
*** belmoreira has quit IRC | 14:02 | |
* haleyb in similar situation | 14:02 | |
liuyulong | OK, let's start | 14:02 |
liuyulong | Alright | 14:02 |
liuyulong | #topic Announcements | 14:03 |
*** openstack changes topic to "Announcements (Meeting topic: neutron_l3)" | 14:03 | |
maciejjozefczyk | hey! | 14:04 |
liuyulong | Actually no announcement from me today. | 14:04 |
liuyulong | #link http://eavesdrop.openstack.org/meetings/networking/2020/networking.2020-04-07-14.00.log.html#l-11 | 14:04 |
liuyulong | the team announcement yesterday. | 14:05 |
liuyulong | OK, then let | 14:05 |
liuyulong | skip this section. | 14:05 |
liuyulong | #topic Bugs | 14:05 |
*** openstack changes topic to "Bugs (Meeting topic: neutron_l3)" | 14:05 | |
liuyulong | #link http://lists.openstack.org/pipermail/openstack-discuss/2020-April/013891.html | 14:06 |
liuyulong | ^ the bug list from our deputy | 14:06 |
*** ttsiouts has quit IRC | 14:06 | |
*** ttsiouts has joined #openstack-meeting | 14:06 | |
liuyulong | Most of them have been discussed last week, so the first one is | 14:07 |
liuyulong | #link https://bugs.launchpad.net/neutron/+bug/1870313 | 14:07 |
openstack | Launchpad bug 1870313 in neutron ""send_ip_addr_adv_notif" can't use eventlet when called from "keepalived_state_change"" [High,Fix released] - Assigned to Rodolfo Alonso (rodolfo-alonso-hernandez) | 14:07 |
liuyulong | Good news, it is also fixed. | 14:07 |
ralonsoh | cool! | 14:08 |
*** ykatabam has joined #openstack-meeting | 14:08 | |
liuyulong | It's a really quick one, 5 days between the bug reporting and fix. : ) | 14:09 |
liuyulong | #link https://bugs.launchpad.net/neutron/+bug/1869887 | 14:09 |
openstack | Launchpad bug 1869887 in neutron "L3 DVR ARP population gets incorrect MAC address in some cases" [High,Fix released] - Assigned to Slawek Kaplonski (slaweq) | 14:09 |
liuyulong | This one is also fixed, and stable backports are also on the way now. | 14:10 |
liuyulong | Next one: | 14:11 |
liuyulong | #link https://bugs.launchpad.net/neutron/+bug/1869808 | 14:11 |
openstack | Launchpad bug 1869808 in neutron "reboot neutron-ovs-agent introduces a short interrupt of vlan traffic" [Low,New] | 14:11 |
liuyulong | It is something related to floating IP network. | 14:11 |
liuyulong | We meet some packet drops/lose during ovs agent restart. | 14:13 |
liuyulong | But from our test result, it is acceptable。 | 14:13 |
slaweq | liuyulong: but in bug report there is nothing about FIPs | 14:14 |
slaweq | it seems for me like it is problem with fixed ips | 14:14 |
liuyulong | "ovs-ofctl dump-flows br-floating" | 14:14 |
liuyulong | It has a bridge name br-floating. | 14:14 |
slaweq | liuyulong: sure, name of bridge is like that | 14:15 |
slaweq | but look above, ping to fixed ip is shown there | 14:15 |
liuyulong | TCP has retransmission mechanism and UDP is unreliable. So I may say one or two packets lose is not too much bad. | 14:16 |
liuyulong | slaweq, maybe it is just a fake floating address. | 14:16 |
slaweq | liuyulong: | 14:16 |
slaweq | 22d55077-b1b5-452e-8eba-cbcd2d1514a8 | test-1-1 | ACTIVE | vlan105=172.31.10.4 | Cirros 0.4.0 64-bit | m1.tiny | | 14:16 |
liuyulong | The testing is icmp | 14:17 |
slaweq | it's from this bug report | 14:17 |
slaweq | this is fixed ip in vlan network | 14:17 |
*** yamamoto has joined #openstack-meeting | 14:17 | |
slaweq | there is nothing related to L3 and floating IPs there IMO | 14:17 |
liuyulong | alright... | 14:17 |
haleyb | i didn't think 1-2 packets lost was an issue either... | 14:18 |
liuyulong | One min, let me check another fix. Maybe it is related. | 14:19 |
liuyulong | #link https://review.opendev.org/#/c/681462/ | 14:21 |
liuyulong | Maybe their local deployment miss this fix. | 14:22 |
liuyulong | I will leave this link to the LP bug. | 14:23 |
haleyb | liuyulong: that's a good find :) | 14:23 |
slaweq | ++ | 14:24 |
liuyulong | #link https://bugs.launchpad.net/neutron/+bug/1870114 | 14:26 |
openstack | Launchpad bug 1870114 in neutron "Trunk subports aren't treated as dvr serviced ports" [Medium,Fix released] - Assigned to Slawek Kaplonski (slaweq) | 14:26 |
liuyulong | This one is also fixed, and all stable backports are started now. | 14:26 |
liuyulong | It's also a quick one. | 14:27 |
liuyulong | OK, no more bugs from deputy bug list. | 14:30 |
liuyulong | Let's have a quick look of the LP list. | 14:30 |
liuyulong | Alright, looks like a quiet week, all bugs are mentioned here. | 14:32 |
liuyulong | Anyone has some other bugs? | 14:33 |
liuyulong | OK, let's move on. | 14:34 |
liuyulong | #topic OVN_L3 | 14:34 |
*** openstack changes topic to "OVN_L3 (Meeting topic: neutron_l3)" | 14:34 | |
liuyulong | Allow me to continue the topic last week | 14:34 |
liuyulong | For one OVN DB node, aka just run ovn-northd, the devstack local conf is not working. | 14:35 |
maciejjozefczyk | liuyulong, can you point us the devstack local.conf that you're using? | 14:36 |
liuyulong | Just set "enable_service ovn-northd" to the devstack local.conf could not start a node with ovn-northd only. | 14:36 |
liuyulong | I have 5 nodes, my plan is to run "one node with ovn-northd only, two chassises for compute, two for gateway". | 14:38 |
maciejjozefczyk | hmm, I *think* that also 'Q_AGENT=ovn' needs to be set in order to start using OVN | 14:38 |
liuyulong | http://paste.openstack.org/show/791811/ | 14:40 |
liuyulong | maciejjozefczyk, ^ the local.conf | 14:40 |
ralonsoh | liuyulong, this is the one I use | 14:40 |
ralonsoh | http://paste.openstack.org/show/791812/ | 14:40 |
ralonsoh | (there are many lines commented, just for testing) | 14:40 |
maciejjozefczyk | liuyulong, hmm, that strange. I use https://github.com/openstack/neutron/blob/master/devstack/ovn-compute-local.conf.sample#L40 as reference for nodes that don't have NBDB installed | 14:41 |
liuyulong | Yes, that's my question, I do not need to run ovn-controller in a DB only node. | 14:41 |
maciejjozefczyk | liuyulong, can you please fill a bug for it? I think that we can easly find it | 14:41 |
maciejjozefczyk | liuyulong, in your configuration you need to specify also: OVN_SB_REMOTE=tcp:$SERVICE_HOST:6642 | 14:42 |
liuyulong | But the I guess something in the ovs installation scripts may have some miss condition. | 14:42 |
maciejjozefczyk | where SERVICE_HOST is the NBDB host | 14:42 |
liuyulong | maciejjozefczyk, the error is not that, it's something like "could not find the ovsdb service". | 14:43 |
liuyulong | Something like that, ralated to ovsdb, maybe this file "/opt/stack/neutron/devstack/lib/ovs" | 14:44 |
liuyulong | Or this file "/opt/stack/neutron/devstack/lib/ovn_agent", it has a start ovs function. | 14:45 |
maciejjozefczyk | liuyulong, what service shows the 'could not find the ovsdb service' error? | 14:45 |
*** igordc has joined #openstack-meeting | 14:45 | |
liuyulong | I have not deeply looked into it. But just add "ovn-controller" to the local.conf, then everything works fine. | 14:45 |
*** liuyulong has left #openstack-meeting | 14:45 | |
*** liuyulong has joined #openstack-meeting | 14:46 | |
maciejjozefczyk | liuyulong, hmm, please fill a bug and I'll check it okey? | 14:46 |
liuyulong | maciejjozefczyk, just run "stack.sh", it will be failed, and error logs in that. | 14:46 |
maciejjozefczyk | with the example you showed | 14:46 |
maciejjozefczyk | liuyulong, ok | 14:46 |
liuyulong | maciejjozefczyk, sure | 14:46 |
*** lpetrut has quit IRC | 14:46 | |
liuyulong | #link https://review.opendev.org/#/c/705660/ | 14:47 |
liuyulong | ^ yes, I run devstack to test this. : ) | 14:47 |
maciejjozefczyk | Terry has some potential improvements for this, but it will be proposed in next patches, to limit the number of additional calculations | 14:48 |
maciejjozefczyk | But for now its broken... so we decided to merge what we have now | 14:48 |
liuyulong | OK... | 14:50 |
maciejjozefczyk | It is also connected to ongoing improvements in Core OVN, that are under investigation, so thats why | 14:51 |
liuyulong | Use "ovn-nbctl list Logical_Router_Port" to check the reschedule, right? | 14:51 |
maciejjozefczyk | or ovn-nbctl lrp-get-gateway-chassis <LRP> | 14:53 |
maciejjozefczyk | that will list candidates and priorities for the gateway | 14:53 |
*** ykatabam has quit IRC | 14:55 | |
liuyulong | Cool, this command has a more clear outputs. Otherwise I need to list chassis to compare the "gateway_chassis" column. | 14:56 |
liuyulong | OK, thank you, no more ovn related stuff from me | 14:57 |
liuyulong | Any updates? | 14:58 |
maciejjozefczyk | In related to L3 - no | 14:58 |
*** moguimar has joined #openstack-meeting | 14:59 | |
liuyulong | ok, let's move on | 14:59 |
liuyulong | #topic On demand agenda | 14:59 |
*** openstack changes topic to "On demand agenda (Meeting topic: neutron_l3)" | 14:59 | |
liuyulong | One minute left... | 14:59 |
*** dklyle has joined #openstack-meeting | 15:00 | |
liuyulong | Let's just have a cup of tea now... | 15:00 |
liuyulong | OK, thank you guys for attending. | 15:00 |
liuyulong | #endmeeting | 15:00 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 15:00 | |
ralonsoh | bye | 15:00 |
openstack | Meeting ended Wed Apr 8 15:00:36 2020 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:00 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/neutron_l3/2020/neutron_l3.2020-04-08-14.00.html | 15:00 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/neutron_l3/2020/neutron_l3.2020-04-08-14.00.txt | 15:00 |
openstack | Log: http://eavesdrop.openstack.org/meetings/neutron_l3/2020/neutron_l3.2020-04-08-14.00.log.html | 15:00 |
liuyulong | bye | 15:00 |
maciejjozefczyk | bb! | 15:00 |
slaweq | o/ | 15:00 |
*** armax has joined #openstack-meeting | 15:01 | |
*** LiangFang has quit IRC | 15:01 | |
*** TrevorV has joined #openstack-meeting | 15:02 | |
*** priteau has joined #openstack-meeting | 15:06 | |
*** yamamoto has quit IRC | 15:06 | |
*** gyee has joined #openstack-meeting | 15:13 | |
*** ykatabam has joined #openstack-meeting | 15:14 | |
*** yamamoto has joined #openstack-meeting | 15:15 | |
*** yamamoto has quit IRC | 15:15 | |
*** yamamoto has joined #openstack-meeting | 15:55 | |
*** ttsiouts has quit IRC | 16:00 | |
*** yamamoto has quit IRC | 16:09 | |
*** ociuhandu has quit IRC | 16:16 | |
*** ociuhandu has joined #openstack-meeting | 16:17 | |
*** ociuhandu has quit IRC | 16:22 | |
*** rpittau is now known as rpittau|afk | 16:23 | |
*** psachin has quit IRC | 16:24 | |
*** ykatabam has quit IRC | 16:50 | |
*** jmasud has quit IRC | 16:54 | |
*** jmasud has joined #openstack-meeting | 16:55 | |
*** bbowen has quit IRC | 16:56 | |
*** bbowen has joined #openstack-meeting | 16:56 | |
*** ociuhandu has joined #openstack-meeting | 17:10 | |
*** priteau has quit IRC | 17:15 | |
*** ociuhandu has quit IRC | 17:16 | |
*** hagridaaron has joined #openstack-meeting | 17:34 | |
*** ralonsoh has quit IRC | 18:01 | |
*** diablo_rojo has quit IRC | 18:02 | |
*** diablo_rojo has joined #openstack-meeting | 18:06 | |
*** e0ne has quit IRC | 18:21 | |
*** ociuhandu has joined #openstack-meeting | 18:26 | |
*** diablo_rojo has quit IRC | 18:53 | |
*** slaweq_ has joined #openstack-meeting | 18:59 | |
*** slaweq has quit IRC | 19:00 | |
*** hagridaaron has quit IRC | 19:17 | |
*** maciejjozefczyk has quit IRC | 19:24 | |
*** vishalmanchanda has quit IRC | 19:32 | |
*** Trevor_V has joined #openstack-meeting | 19:48 | |
*** Lucas_Gray has joined #openstack-meeting | 19:50 | |
*** TrevorV has quit IRC | 19:51 | |
*** yamamoto has joined #openstack-meeting | 20:07 | |
*** yamamoto has quit IRC | 20:13 | |
*** igordc has quit IRC | 20:17 | |
*** Lucas_Gray has quit IRC | 20:18 | |
*** igordc has joined #openstack-meeting | 20:18 | |
*** Lucas_Gray has joined #openstack-meeting | 20:19 | |
*** hagridaaron has joined #openstack-meeting | 20:23 | |
*** Lucas_Gray has quit IRC | 20:33 | |
*** moguimar has quit IRC | 20:39 | |
*** jmasud has quit IRC | 20:54 | |
*** jmasud has joined #openstack-meeting | 20:56 | |
timburke | #startmeeting swift | 21:00 |
openstack | Meeting started Wed Apr 8 21:00:03 2020 UTC and is due to finish in 60 minutes. The chair is timburke. Information about MeetBot at http://wiki.debian.org/MeetBot. | 21:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 21:00 |
*** openstack changes topic to " (Meeting topic: swift)" | 21:00 | |
openstack | The meeting name has been set to 'swift' | 21:00 |
timburke | who's here for the swift meeting? | 21:00 |
seongsoocho | o/ | 21:00 |
*** patchbot has joined #openstack-meeting | 21:00 | |
kota_ | hi | 21:00 |
rledisez | o/ | 21:00 |
tdasilva | o/ | 21:01 |
*** Lucas_Gray has joined #openstack-meeting | 21:01 | |
clayg | ohai | 21:01 |
clayg | i may have to duck out early | 21:01 |
timburke | as usual, the agenda's at https://wiki.openstack.org/wiki/Meetings/Swift | 21:01 |
clayg | lucky I'm only here for the lawlz | 21:01 |
timburke | no worries | 21:01 |
timburke | yeah, "updates" may be short ;-) | 21:02 |
timburke | i know *i'm* having a hard time getting much accomplished | 21:02 |
timburke | so, some announcements! | 21:02 |
timburke | #topic virtual PTG | 21:02 |
*** openstack changes topic to "virtual PTG (Meeting topic: swift)" | 21:02 | |
timburke | #link https://etherpad.openstack.org/p/swift-ptg-victoria | 21:02 |
timburke | i set up an etherpad to collect topics | 21:02 |
timburke | that's the extent of what planning i've done, though -- i'm having a hard enough time thinking two days into the future, much less two months | 21:03 |
timburke | i know there are mailing list threads and etherpads going around trying to aggregate openstack's collective wisdom around doing virtual hackathons, though | 21:04 |
timburke | #topic TC election | 21:04 |
*** openstack changes topic to "TC election (Meeting topic: swift)" | 21:04 | |
timburke | there's more candidates than open seats this time! | 21:04 |
timburke | so please go read people's stances and vote | 21:05 |
mattoliverau | Oh sorry I'm late, daylight savings changed in Oz which threw me, things are now an hour earlier. o/ | 21:05 |
timburke | not to worry! | 21:06 |
mattoliverau | I voted yesterday. Get in early so I don't forget :) | 21:06 |
clayg | timburke: I'm scared and confused by the TC vote - I have enough hard time just figuring out my texas rail road commissioner - can you just tell us who to vote for? | 21:06 |
clayg | mattoliverau: scratch that - can YOU tell me who to vote for? | 21:06 |
mattoliverau | Lol | 21:06 |
timburke | mattoliverau, smart -- i still need to get step one done (read candidacy emails) | 21:06 |
*** jraju__ has quit IRC | 21:07 | |
timburke | i'll keep you posted clayg ;-) | 21:07 |
mattoliverau | Yeah, there is a link to those. IE in hit which made it easier | 21:07 |
mattoliverau | If I was fully awake and near a computer I'd find the links | 21:07 |
timburke | #link https://governance.openstack.org/election/ | 21:08 |
mattoliverau | *in git | 21:08 |
timburke | the top section after timetables has links to candidates' announcements | 21:08 |
timburke | (speaking of elections, there was a snafu so my candidacy isn't acutally listed there, but i will be continuing as ptl) | 21:09 |
timburke | thanks for the reminders kota_ and notmyname, but i didn't quite get everything sorted in time ;-) | 21:10 |
timburke | #topic ironic as a top-level opendev project | 21:10 |
*** openstack changes topic to "ironic as a top-level opendev project (Meeting topic: swift)" | 21:10 | |
kota_ | :) | 21:10 |
timburke | #link http://lists.openstack.org/pipermail/openstack-discuss/2020-April/013757.html | 21:11 |
mattoliverau | Oh I was going to mention this | 21:11 |
timburke | there's an interesting thread about ironic considering moving toward being more independent from openstack | 21:11 |
timburke | soemthing worth following, for sure | 21:11 |
mattoliverau | +1 | 21:12 |
clayg | timburke: thanks! | 21:12 |
kota_ | interesting | 21:12 |
timburke | ok, on to a couple more swift-specific things | 21:13 |
timburke | #topic python-swiftclient gate | 21:13 |
*** openstack changes topic to "python-swiftclient gate (Meeting topic: swift)" | 21:13 | |
timburke | it's broken! | 21:13 |
kota_ | :/ | 21:13 |
timburke | we haven't noticed, because we so rarely propose changes there ;-) | 21:13 |
timburke | i *think* https://review.opendev.org/#/c/718309/ should fix it, though | 21:14 |
patchbot | patch 718309 - python-swiftclient - Blacklist stestr 3.0.0 - 2 patch sets | 21:14 |
timburke | in general, the further along the py3-only path everything else goes, the more breakage we'll likely see | 21:14 |
timburke | though afaict, *swift's* current gate woes aren't actually related to that | 21:15 |
timburke | i feel like i've been typing "recheck" a lot lately, though :-( | 21:15 |
rledisez | timburke: how long do you think it's gonna be sustainable to maintain a py2 code? is there any risk we have to drop py2 before the date we decided? | 21:16 |
timburke | biggest risk is in py3-only bugs | 21:17 |
timburke | things like https://review.opendev.org/#/c/707312/ kinda scare the bejesus out of me | 21:17 |
patchbot | patch 707312 - swift - py3: stop barfing on message/rfc822 Content-Types (MERGED) - 2 patch sets | 21:17 |
clayg | rledisez: getting rid of py2 support is the only interesting thing about supporting py3 - I only want to support both while we're working on switching our prod over to py3 | 21:19 |
timburke | well, no -- *really*, https://review.opendev.org/#/c/682173/ scares me. the stupid rfc822 thing was mostly annoying | 21:19 |
patchbot | patch 682173 - swift - proxy: Don't trust Content-Length for chunked tran... (MERGED) - 4 patch sets | 21:19 |
clayg | the DAY after we finally get py3 working I want to remove py2 🤣 | 21:19 |
clayg | maybe we *should* draw a line in the sand and say "swift can't support py2 anymore because py2 is dead; support will be removed soon" | 21:19 |
clayg | even if we know we can't remove it until at least WE manage to get off it | 21:19 |
clayg | it's not optional anymore - we waited as long as we could | 21:20 |
timburke | i should make sure we have a question related to py2 vs py3 in the user survey... | 21:20 |
clayg | but py3 is going to be amazing - we'll always have bugs to fix - the sooner we're running in prod the sooner we find them 💪 | 21:20 |
rledisez | clayg: totally agree. i'm planning on deplying some py3 on prod in the next few months. but it's gonna be a very slow process… | 21:20 |
timburke | i look forward to the bug reports ;-) | 21:20 |
clayg | rledisez: same, very slow - it's not the upgrade - it's the eco-system of code that goes along with it 😢 | 21:20 |
timburke | unwinding the stack a little, speaking of how difficult it's been lately to get patches through... | 21:21 |
timburke | #topic ussuri releases (both client and server) | 21:21 |
*** openstack changes topic to "ussuri releases (both client and server) (Meeting topic: swift)" | 21:21 | |
timburke | i should start getting releases together *now*, so there's some hope of having them actually happen by their deadlines :P | 21:22 |
clayg | 😬 | 21:23 |
timburke | if there's anything you feel should be included, let me know! or just review and merge it ;-) | 21:23 |
timburke | i'm going to try to get the versioning support at least into swiftclient, then probably cut its release not long after that | 21:24 |
kota_ | sounds good | 21:24 |
timburke | i think that about does it for announcements... any other comments or questions? | 21:24 |
timburke | all right, on to updates! | 21:25 |
timburke | #topic waterfall EC | 21:25 |
*** openstack changes topic to "waterfall EC (Meeting topic: swift)" | 21:25 | |
timburke | clayg, any chance to make progress on this, or are you still busy with other stuff for the most part? | 21:25 |
timburke | i'll take that as a no, too busy ;-) thanks for doing some reviews lately! | 21:28 |
timburke | maybe i should drop the topic for now, and clayg can add it back when he's ready... | 21:28 |
timburke | #topic lots of small files | 21:29 |
*** openstack changes topic to "lots of small files (Meeting topic: swift)" | 21:29 | |
clayg | no problem - i'd be happy to squeeze in some reviews | 21:29 |
clayg | I did add waterfall to the list of topics | 21:29 |
rledisez | so alecuyer is not here, but he gave me some informations | 21:29 |
*** TrevorV has joined #openstack-meeting | 21:29 | |
timburke | rledisez, yeah, you guys have been busy lately :D | 21:29 |
rledisez | he posted today a patch that is meant to cleanup some things in LOSF and get back to normal (hashes.pkl) | 21:30 |
rledisez | #link https://review.opendev.org/#/c/718445/ | 21:30 |
patchbot | patch 718445 - swift (feature/losf) - Use hashes.pkl files for LOSF and remove list_part... - 1 patch set | 21:30 |
rledisez | he should post tomorrow an other cleanup patch about protobuf arguments | 21:30 |
rledisez | after that, he will start to send the new features (new key format, new volume selection algorithm and metadata stored in the KV) | 21:31 |
*** Trevor__V has joined #openstack-meeting | 21:31 | |
rledisez | that's it for losf | 21:31 |
timburke | 👍 | 21:31 |
timburke | thanks! | 21:31 |
timburke | #topic cors | 21:31 |
*** openstack changes topic to "cors (Meeting topic: swift)" | 21:31 | |
timburke | so i've got a dirty tree locally that's partway through re-writing the js tests... i should finish that rewrite, but haven't found time | 21:32 |
*** Trevor_V has quit IRC | 21:32 | |
timburke | i suppose i should mark it WIP for now | 21:33 |
timburke | that's about it, though | 21:33 |
timburke | #topic open discussion | 21:33 |
*** openstack changes topic to "open discussion (Meeting topic: swift)" | 21:33 | |
timburke | anything else we ought to talk about? | 21:33 |
rledisez | just a note about that random failure I've been hitting on https://review.opendev.org/#/c/704892/ | 21:34 |
patchbot | patch 704892 - swift - proxy: stop sending frags to PyECLib with a Queue - 2 patch sets | 21:34 |
rledisez | i found the bad test. I don't understand why, but if I disable it, no more random failure | 21:34 |
*** TrevorV has quit IRC | 21:34 | |
rledisez | if anybody have a clue, i'm taking it :) | 21:34 |
timburke | right! that weird eventlet issue! | 21:34 |
clayg | is it the GET with swapped frags test? | 21:35 |
rledisez | it's this one: https://review.opendev.org/#/c/704892/2/test/unit/proxy/controllers/test_obj.py | 21:35 |
patchbot | patch 704892 - swift - proxy: stop sending frags to PyECLib with a Queue - 2 patch sets | 21:35 |
rledisez | yes | 21:35 |
clayg | rledisez: I'll take a look tomorrow! 💪 | 21:35 |
rledisez | clayg: thx a lot, you're awesome! | 21:35 |
rledisez | (you all are!) | 21:36 |
rledisez | I'll add a comment to show how to reproduce the issue | 21:36 |
rledisez | otherwise, I'm still doing some profiling. I'll start looking at out use of len() (it counts, for real :D) and also i'll try to play with buffer protocol to see if we can save some memory copy | 21:37 |
*** slaweq_ has quit IRC | 21:38 | |
timburke | nice | 21:38 |
*** slaweq_ has joined #openstack-meeting | 21:40 | |
timburke | anybody have strong opinions on metric naming? or experience with fallout from trying to split one metric into several? i'm looking at https://review.opendev.org/#/c/716016/1/swift/common/middleware/s3api/s3api.py in particular... | 21:40 |
patchbot | patch 716016 - swift - s3api: Add stats for s3api requests - 1 patch set | 21:40 |
timburke | i'm trying to judge how important it is for us to get it right the first time, vs needing to do a split by bucket vs key later | 21:41 |
mattoliverau | Was it the object replicator in recon where we wanted to rename some metrics, we're now been doubling up on metrics there for a while. | 21:42 |
mattoliverau | I make them the same a the db replicator. | 21:42 |
rledisez | so, the patch comes from us. we were originally interested in seeing the adoption of s3. but I like the idea of object vs bucket requests | 21:43 |
timburke | rledisez, yeah, the adoption metrics make a lot of sense | 21:43 |
timburke | i can wait for another patchset then | 21:44 |
*** slaweq_ has quit IRC | 21:45 | |
timburke | all right, i think i'm'a call it | 21:46 |
timburke | thank you all for coming, and thank you for working on swift! | 21:46 |
timburke | #endmeeting | 21:46 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 21:46 | |
openstack | Meeting ended Wed Apr 8 21:46:17 2020 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 21:46 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/swift/2020/swift.2020-04-08-21.00.html | 21:46 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/swift/2020/swift.2020-04-08-21.00.txt | 21:46 |
openstack | Log: http://eavesdrop.openstack.org/meetings/swift/2020/swift.2020-04-08-21.00.log.html | 21:46 |
*** patchbot has left #openstack-meeting | 21:46 | |
*** ykatabam has joined #openstack-meeting | 21:50 | |
*** Lucas_Gray has quit IRC | 22:01 | |
*** slaweq_ has joined #openstack-meeting | 22:13 | |
*** Trevor__V has quit IRC | 22:16 | |
*** TrevorV has joined #openstack-meeting | 22:17 | |
*** rcernin has joined #openstack-meeting | 22:32 | |
*** gyee has quit IRC | 22:49 | |
*** TrevorV has quit IRC | 22:50 | |
*** hagridaaron has quit IRC | 23:08 | |
*** gary_perkins has quit IRC | 23:26 | |
*** gary_perkins has joined #openstack-meeting | 23:32 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!