15:00:30 <mgoddard> #startmeeting kolla
15:00:31 <openstack> Meeting started Wed Mar 25 15:00:30 2020 UTC and is due to finish in 60 minutes.  The chair is mgoddard. Information about MeetBot at http://wiki.debian.org/MeetBot.
15:00:32 <openstack> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote.
15:00:33 <mgoddard> #topic rollcacll
15:00:34 <openstack> The meeting name has been set to 'kolla'
15:00:36 <mgoddard> #topic rollcall
15:00:45 <mgoddard> \o
15:01:19 <generalfuzz> o/
15:03:57 <mgoddard> yoctozepto, mnasiadka, osmanlicilegi: meeting?
15:04:09 <osmanlicilegi> o/
15:05:02 <yoctozepto> o/
15:05:36 <mgoddard> #topic agenda
15:05:43 <mgoddard> * Roll-call
15:05:45 <mgoddard> * Announcements
15:05:47 <mgoddard> ** TC & PTL election season starting 24th March https://governance.openstack.org/election/
15:05:49 <mgoddard> * Review action items from last meeting
15:05:51 <mgoddard> * CI status
15:05:53 <mgoddard> * Kolla --SIG-- (aka Kolla Klub?) https://etherpad.openstack.org/p/kolla-sig
15:05:55 <mgoddard> * Ussuri release planning (kayobe)
15:05:57 <mgoddard> * Ussuri release planning (kolla & kolla ansible)
15:05:59 <mgoddard> #topic announcements
15:06:02 <mgoddard> #info TC & PTL election season starting 24th March
15:06:10 <mgoddard> #link https://governance.openstack.org/election/
15:06:12 <jovial[m]> \0
15:07:35 <mgoddard> If anyone is considering running for PTL, nominations run until next tuesday
15:07:44 <mgoddard> Any other announcements?
15:07:48 <yoctozepto> why when we have mgoddard
15:08:24 <jovial[m]> praise the goddard
15:08:25 <generalfuzz> mgoddard 4l
15:08:34 <osmanlicilegi> mgoddard: if you are happy with us, please go for the next cycle :]
15:08:37 <mgoddard> always good to mix things up from time to time
15:09:31 <openstackgerrit> Merged openstack/kolla-ansible master: Fix kolla-ansible stop with heterogeneous hosts  https://review.opendev.org/714496
15:09:37 <mgoddard> #info Kolla Klub meeting slot doodle poll https://doodle.com/poll/9g7czxmdngd5zz4t
15:10:01 <mgoddard> Please respond with your availability if you have not yet
15:10:27 <mgoddard> So far Thursday 16:00-17:00 UTC is winning
15:10:44 <mgoddard> hopefully we will not get confused by daylight saving switch this weekend
15:10:55 <mgoddard> #topic Review action items from last meeting
15:11:15 <mgoddard> mgoddard to raise a bug on Ceph job fails
15:11:17 <mgoddard> mnasiadka to look into Ceph job fails
15:11:19 <mgoddard> mgoddard to spam people about kolla SIG
15:11:21 <mgoddard> mgoddard to ask ML about uwsgi etc
15:11:25 <mgoddard> done, done, done, wontfix
15:11:45 <mgoddard> #topic CI status
15:12:05 <mgoddard> Kolla CI says RED but no issues
15:12:12 <mgoddard> (on whiteboard
15:12:18 <mgoddard> https://etherpad.openstack.org/p/KollaWhiteBoard
15:12:24 <yoctozepto> issueless RED
15:12:33 <mgoddard> just assume RED
15:12:38 <mgoddard> I think it's green?
15:13:19 <mgoddard> thanks to mnasiadka for fixing the kolla-ceph issue on stable branches
15:13:55 <mgoddard> #topic Kolla --SIG-- (aka Kolla Klub?) https://etherpad.openstack.org/p/kolla-sig
15:14:09 <mgoddard> We have a good list of people now
15:14:22 <mgoddard> Just need to find a slot, then we're good to go
15:14:28 <mgoddard> I have no more to say on it today...
15:14:31 <mgoddard> Anyone else?
15:15:23 <mgoddard> #topic Ussuri release planning (kayobe)
15:15:30 <mgoddard> jovial[m], dougsz, priteau
15:15:40 <mgoddard> I think priteau is busy
15:15:43 <mgoddard> what's up jovial[m]?
15:16:43 <jovial[m]> I've been slacking on the kayobe front I'm afraid. Still hoping to pick up this work on the custom extension points soon.
15:16:52 <mgoddard> that would be nice
15:17:13 <mgoddard> https://review.opendev.org/#/q/project:openstack/kayobe+status:open
15:17:22 <mgoddard> we made some good progress on reviews recently
15:17:51 <mgoddard> still a few to go
15:18:10 <mgoddard> would be good to get https://review.opendev.org/#/c/712133/ in and backported
15:18:10 <patchbot> patch 712133 - kayobe - CentOS 8: seed VM & bifrost - 3 patch sets
15:19:28 <jovial[m]> Yeah, centos 8 support would be huge. I will try an take a look today.
15:19:46 <mgoddard> Currently working on the CentOS 7 to 8 migration. Making progress
15:20:03 <mgoddard> #topic Ussuri release planning (kolla & kolla ansible)
15:20:25 <mgoddard> On the topic of 7 to 8 migration, I hit an interesting issue today
15:20:44 <mgoddard> if we have mixed 7 & 8 controllers then rabbitmq doesn't work
15:20:55 <mgoddard> 7 has 3.7.10, 8 has 3.7.24
15:21:37 <osmanlicilegi> do they have same erlang version?
15:21:38 <mgoddard> would anyone expect that combination to work?
15:21:55 <mgoddard> do they need to?
15:22:13 <osmanlicilegi> they shouldn't
15:22:54 <osmanlicilegi> but may give a clue to deep dive
15:23:30 <mgoddard> 22.1.8 on c8, 19.3.6.4 on c7
15:23:34 <yoctozepto> oh gosh
15:23:40 <mgoddard> quite a jump
15:23:52 <osmanlicilegi> it's erlang, trust me :)
15:23:57 <mgoddard> :)
15:24:17 <osmanlicilegi> please let me finish my rabbitmq upgrade work this week
15:24:29 <mgoddard> that would be good, but won't help here
15:24:34 <yoctozepto> hereby I allow you to :-)
15:24:35 <mgoddard> this is on train
15:24:51 <yoctozepto> yeah, that's pity
15:25:05 <yoctozepto> nobody upgrades rmq then
15:25:19 <mgoddard> one solution is to first upgrade rmq on c7 to 3.7.24
15:26:02 <osmanlicilegi> then?
15:26:20 <mgoddard> then it will be at the same version on c7 and c8
15:26:31 <mgoddard> we can upgrade erlang to match too
15:27:15 <yoctozepto> mgoddard: still, there is no point in time where rmq works
15:27:18 <osmanlicilegi> makes sense if we won't need to upgrade rmq for train :)
15:27:35 <mgoddard> yoctozepto: why not?
15:27:36 <yoctozepto> if you have to suddenly switch whole cluster to the new version
15:27:44 <mgoddard> oh
15:27:50 <mgoddard> well we can upgrade rmq
15:28:20 <mgoddard> we have an upgrade.yml that stops all but one, then starts up a new cluster
15:28:51 <mgoddard> problem with c7->8 is that there is a long time with mixed versions
15:29:03 <yoctozepto> oh, I see what you mean
15:29:17 <yoctozepto> still, for c7->c7 you need the same magic
15:29:30 <mgoddard> yes, which we have
15:29:41 <mgoddard> as long as you run upgrade not deploy
15:29:42 <yoctozepto> so images are there, just no right logic to handle this dump
15:30:28 <yoctozepto> why oh why rmq
15:31:03 <mgoddard> it would just be something else if not
15:31:09 <mgoddard> it's just the difficult part
15:31:27 <mgoddard> although should be easier
15:31:34 <osmanlicilegi> rmq 3.7.10 can run at most with erlang 21.x and rmq 3.7.24 can run at lest with erlang 21.3. we can try pinning erlang version to 21.3.
15:32:06 <yoctozepto> well, we probably need 22 anyway
15:32:12 <yoctozepto> it's not about preparing images
15:32:31 <yoctozepto> unless we actually need 19->20->21->22 to do it properly
15:33:10 <mgoddard> let's hope not
15:33:31 <yoctozepto> ++
15:33:51 <mgoddard> so next question - can we upgrade rabbitmq on a stable branch?
15:34:14 <mgoddard> or do we need a separate rabbitmq-3-7-24 image?
15:34:34 <osmanlicilegi> major erlang upgrade sounds dangerous to me
15:34:38 <yoctozepto> http://paste.openstack.org/show/791143/
15:35:16 <yoctozepto> it doesn't make sense to me; rmq is hardly rolling this way
15:35:59 <mgoddard> yeah, I thought erlang was supposed to be about reliability & availability
15:36:31 <yoctozepto> yeah, considering its adoption in telco
15:36:43 <mgoddard> anyways, sounds like we have a potential path forward
15:36:43 <yoctozepto> must be why we get bad service from time to time
15:36:45 <mgoddard> thanks
15:36:47 <yoctozepto> dunking erlang
15:37:27 <mgoddard> Do we have any other Ussuri topics to discuss?
15:38:21 <mgoddard> It should probably be noted that we agreed in a call last week with yoctozepto, mnasiadka, generalfuzz & stackedsax to park the uwsgi work for now, and continue using httpd/mod_wsgi for backend TLS
15:38:29 <osmanlicilegi> I was out for some reasons but I'm back to finish my works asap.
15:38:49 <mgoddard> good to hear osmanlicilegi
15:39:20 <generalfuzz> reviews are welcome for backend TLS: https://review.opendev.org/#/c/713986/
15:39:21 <patchbot> patch 713986 - kolla-ansible - Add support for encrypting backend HAProxy traffic... - 5 patch sets
15:39:47 <mgoddard> +1, let's aim to merge that before next meeting
15:39:59 <mgoddard> In terms of timing for Ussuri:
15:40:01 <mgoddard> Kolla feature freeze: Apr 27 - May 01
15:40:03 <mgoddard> Kolla RC1: May 11 - May 15
15:40:05 <mgoddard> Kolla final release: Jun 1 - Jun 5
15:40:14 <mgoddard> https://releases.openstack.org/ussuri/schedule.html
15:41:03 <mgoddard> Feature freeze for most of openstack is Apr 6 - 10
15:41:13 <mgoddard> Getting close
15:42:30 <mgoddard> #topic Open discussion
15:42:55 <mgoddard> Hopefully everyone is coping in these crazy times
15:43:15 <generalfuzz> +1
15:43:42 <yoctozepto> they closed the nearby playground :-(
15:44:21 <mgoddard> you don't have kids do you yoctozepto?
15:44:33 <yoctozepto> mgoddard: no, I don't
15:44:38 <yoctozepto> but it still looks sad :-(
15:44:45 <osmanlicilegi> crazy? I'm worse than crazy :)))
15:45:08 <yoctozepto> I mean, it's a bit dull and depressing nowadays
15:45:45 <mgoddard> we at least have had some sun here
15:46:40 <mgoddard> computers are a good distraction
15:46:51 <mgoddard> as are 8 month old kids
15:47:05 <yoctozepto> aww, how is the little folk doing? :D
15:47:07 <mgoddard> doesn't leave much time for moping around
15:47:07 <generalfuzz> awww
15:47:16 <mgoddard> he's good, mostly
15:47:39 <mgoddard> his mum is going a little loopy
15:47:55 <mgoddard> he likes to shout and grunt a lot
15:48:27 <mgoddard> but you can't be annoyed for long as he's very cute
15:48:32 <yoctozepto> :-)
15:48:54 <mgoddard> the other day I was eating an apple and he laughed every time I took a bite
15:49:10 <yoctozepto> aww
15:49:22 <mgoddard> maybe I'm doing it wrong
15:49:25 <osmanlicilegi> does he have a koala shirt? if not, he should have :)
15:49:29 <yoctozepto> I somehow feel better from these stories
15:49:49 <mgoddard> no koala shirt yet, but that's a nice idea
15:49:59 <yoctozepto> koala costume
15:50:33 <mgoddard> :)
15:50:37 <osmanlicilegi> mgoddard and the koalas
15:50:53 <osmanlicilegi> why dont we have a rock group?
15:51:24 <mgoddard> I can play bass and guitar
15:51:30 <mgoddard> Or at least I could 10 years ago
15:51:36 <yoctozepto> I can play on nerves :D
15:51:46 <generalfuzz> I got keys
15:51:54 <mgoddard> The video latency might kill it though
15:52:04 <osmanlicilegi> I can play drum better than animal from muppets
15:52:19 <yoctozepto> we might borrow that cam/mic from hrw so at least it will be lively
15:52:21 <mgoddard> unless we add a 1 bar delay
15:52:22 <stackedsax> I got horns
15:52:24 <yoctozepto> :D
15:53:33 <stackedsax> osmanlicilegi: nobody can play drums better than Aminal.  What are you talking about?
15:54:30 <mgoddard> ok, let's wrap up
15:54:33 <mgoddard> Thanks all
15:54:36 <mgoddard> #endmeeting