15:00:48 #startmeeting large_scale_sig 15:00:49 Meeting started Wed May 5 15:00:48 2021 UTC and is due to finish in 60 minutes. The chair is ttx. Information about MeetBot at http://wiki.debian.org/MeetBot. 15:00:50 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 15:00:52 The meeting name has been set to 'large_scale_sig' 15:00:55 #topic Rollcall 15:00:59 Who is here for the Large Scale SIG meeting ? 15:01:16 o/ 15:01:27 Hi! 15:01:39 amorin: ping 15:01:47 pong! 15:01:53 I am 15:01:56 (thanks) 15:02:02 imtiazc: hi! 15:02:10 I don't see Gene around 15:02:46 priteau: in case you want to join us 15:02:58 Our agenda for today is at: 15:03:02 #link https://etherpad.openstack.org/p/large-scale-sig-meeting 15:03:02 Good afternoon 15:03:14 #topic OpenInfra Live show on May 20 15:03:24 So... in two weeks we'll produce an OpenInfra.Live show 15:03:32 Basically running our traditional video meeting but streaming it on YouTube Live, using Streamyard 15:03:43 The title for the episode is: Upgrades in a Large Scale OpenStack infrastructure 15:03:55 The format we discussed during PTG was to kick it off with a number of 3-5min presentations 15:04:14 detailing how each of the guest speakers do upgrades on their large scale infrastructure, the challenges they run into, etc 15:04:26 and then have an open discussion about those, asking questions to each other and taking questions from the YouTube chat 15:04:38 We currently have belmoreira, amorin, mnaser signed up 15:04:48 I reached out to Blizzard, Verizon and Box, unsuccessfully so far 15:04:57 Also reached out to Stig, who said he could fill a seat but was not sure his deployments had a good story 15:05:05 Anyone here interested in sharing how they do it? 15:05:40 If not, any suggestion who else I should be reaching out to? 15:06:21 maybe Bloomberg? Try contacting Chris 15:06:32 +1 will do 15:06:46 We sadly don't have a good in-place upgrade story. We brought up a separate deployment then migrated the workload. We did certain things to make the workload migration easy. 15:06:57 If anyone is interested, I can talk about that. 15:07:10 sad stories are good too! 15:07:19 Sure :) 15:07:26 imtiazc that's a good upgrade history! 15:07:37 you know, our story is not amazing neither :) 15:07:42 history/story :) 15:07:49 imtiazc: I kinda like it, shows the low-tech approach / story 15:08:13 amorin just don't talk about fire? :( 15:08:28 that's another story unfortunately :( 15:08:39 Our choice of SDN provider complicated the process. So may be there are few lessons others can learn 15:08:44 fire while upgrading would have been super extra fun 15:08:56 how to upgrade a data centre? 15:08:58 :) 15:09:03 from external point of view maybe :) 15:09:20 imtiazc: alright you're in! 15:09:38 I'll try to get a couple more, between those I already reached to and Bloomberg / Stig 15:10:02 5-6 stories and guests sounds like a good number 15:10:13 +1 15:10:28 So start preparing a few slides to support your story, nothing fancy or long, just a visual aid 15:10:55 Goal being to fit into 5-min, we can get into details with questions 15:11:00 Did you say 3-5 mins per presenter? 15:11:04 yeah 15:11:27 like give the overall picture, and then we'll do questions, panel style 15:11:46 ack 15:11:52 Once I see ths lides I may be able to deduce a number of canned questions 15:11:57 slides 15:12:16 which I'll send in advance, but we'll also have live questions from the audience 15:12:26 hopefully enough to fill the hour! 15:12:56 (the goal is to do a full hour of show, so if we run dry I'll need your help in asking new questions 15:12:57 you want us to bring the slides to you in advance? 15:13:11 yes ideally I would combine them all in a single deck 15:13:23 is a google slide ok for you? 15:14:03 sure, Google slides is perfect. Worst case scenario I'll convert everything to PDF if we have a mix of formats 15:14:18 so whatever works for you 15:14:23 ack 15:14:32 More generally, I think it would be good to committing to filling OpenInfra.Live schedule with future episodes of this show 15:14:46 I call it the "Large Scale OpenStack" show, but if you have a better name suggestion, let me know 15:15:06 I talked to the organizers and we can secure the July 1st slot (6 weeks after the May 20 episode). 15:15:21 do y'all think we can make it? 15:15:32 sounds good 15:15:40 after that we might do a break over summer as a lot of us are Europeans with vacation plans 15:15:49 that would replace our 2-weeks videos stream, right? 15:16:03 yes the idea is to replace our video meeting with that 15:16:42 and benefit from the high-value production and advertising the IOpenInfra Foundation does around openinfra.live 15:17:00 which should be more apparent in tow weeks (we are just getting started) 15:17:13 perfect 15:17:14 We can also start thinking into the topic for the next one 15:17:21 #link https://etherpad.opendev.org/p/large-scale-sig-lightning-talks 15:17:35 Inception was a possibility\ 15:18:18 Or we could do Monitoring 15:18:51 If we do Inception that would be main presentation / discussion, if we do Monitoring that would be more lightning talk style 15:19:11 so maybe we should see first how the first one goes 15:19:31 I can talk about what we have for monitoring or general "observability" of our OpenStack platform. How we measure SLA etc. 15:19:49 that would be great. I know Gene wanted to talk about that too 15:20:49 I talked with Stig about doing one around OpenStack-based supercomputers, which is a very specific facet of "large scale" but interesting 15:20:52 we can talk about monitoring also 15:21:39 ok, let's sleep on it and discuss next week 15:22:05 Anything else on the "Large Scale OpenStack" show topic? 15:23:06 ok moving on 15:23:10 #topic Progress/Blockers 15:23:20 * Stage 1 - Configure (amorin) 15:23:24 #link https://wiki.openstack.org/wiki/Large_Scale_SIG/Configure 15:23:38 nothing new here 15:24:36 Yeah it would be good to make progress on the first questions in there... Like distros and drivers recommended at scale, but i don;t think we have a big enough sample to determine good answers for that 15:24:46 (yet) 15:24:56 * Stage 2 - Monitor (genekuo) 15:24:59 #link https://wiki.openstack.org/wiki/Large_Scale_SIG/Monitor 15:25:27 nothing new there as well 15:25:37 * Stage 3 - Scale Up (ttx) 15:25:42 #link https://wiki.openstack.org/wiki/Large_Scale_SIG/ScaleUp 15:26:16 We ran out of unasnwered questions in there, so it's probably time to post new ones, if you have ideas 15:26:32 # Stage 4/5 - Scale Out, upgrade & maintain (belmoreira) 15:26:36 #link https://wiki.openstack.org/wiki/Large_Scale_SIG/ScaleOut 15:26:38 #link https://wiki.openstack.org/wiki/Large_Scale_SIG/UpgradeAndMaintain 15:27:01 no news. Let me know if you have ideas/topics to improve it 15:27:09 I hope the show on upgrades will help us to write a few things on stage 5 15:27:27 like bringing the different perspectives 15:27:34 +1 15:28:20 ok if no particular blockers let's move on 15:28:26 #info Next meeting 15:28:30 Our next meeting will be on IRC again, May 12. 15:28:55 We'll likely discuss last details of the show, like deadline to send slides and final speaker list 15:29:16 I'll emcee and coordinate between speakers 15:29:35 #topic Open discussion 15:30:04 any last-minute question or discussion topic? 15:30:46 Anyone here using Calico for neutron network provider? 15:31:01 nop 15:31:12 I remember someone talking about that in our last video meeting 15:31:19 but I dont remember who 15:31:56 Bloomberg uses it 15:32:30 Oh, thanks! We are going to use it. I also know that Salesforce does. 15:33:10 also that's a good point. Does anyone know about Salesforce deployment? 15:33:24 I don't recall any public presentation 15:33:33 I could dig in, no idea of the size 15:33:34 I have a contact at Salesforce. I can get some details. 15:33:49 imtiazc: ++ 15:33:58 They could be a great addition to the group /shows 15:34:06 They are quite big as well. Thousand node deployments in multiple data centers. 15:34:28 ideally we'd rotate speakers enough so that it does not look like a closed club 15:34:46 +1 15:35:14 alright.. anything else? 15:35:33 #action imtiaz to try to recruit Salesforce for the SIG 15:35:39 :) 15:35:54 I was reading a report recently which said not many enterprise customers use OpenStack. I think there are but that info is poorly publicized. 15:36:01 I'll try :) 15:36:32 I know there are, but the amount we know about is a fraction of them... and then those willing to talk publicly are a fraction of that 15:36:43 Exactly. 15:36:58 Oh, just though of one other topic: backup and recovery. 15:37:04 Like distribution companies like Red Hat have a lot of customers... But we rarely see them 15:37:39 +1 for backup and recovery 15:37:42 and they are rarely allowed to talk freely about them either 15:38:14 Add it to https://etherpad.opendev.org/p/large-scale-sig-lightning-talks ! 15:38:20 (worst-named etherpad ever) 15:38:46 OK if nothing else we'll close early (I like short meetings) 15:39:24 Reminder exceptionally we;ll do a meeting next week 15:39:38 more for show coordination, so the speakers we have signed up 15:39:58 it's ok if others miss it 15:40:22 I'll send you emails anyway 15:40:26 Have a great week 15:40:36 #endmeeting