14:00:33 <rosmaita> #startmeeting cinder
14:00:33 <opendevmeet> Meeting started Wed Nov 29 14:00:33 2023 UTC and is due to finish in 60 minutes.  The chair is rosmaita. Information about MeetBot at http://wiki.debian.org/MeetBot.
14:00:33 <opendevmeet> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote.
14:00:33 <opendevmeet> The meeting name has been set to 'cinder'
14:00:40 <rosmaita> #topic roll call
14:01:08 <eharney> howdy
14:01:22 <jayaanand> hi
14:01:30 <akawai> o/
14:01:50 <kgube> o/
14:02:32 <keerthivasansuresh> o/
14:02:37 <gireesh> o/
14:03:11 <rosmaita> ok, let's get started
14:03:19 <rosmaita> #link https://etherpad.opendev.org/p/cinder-caracal-meetings
14:03:23 <rosmaita> meeting agenda ^^
14:03:42 <rosmaita> Rajat is away at the Horizon PTL's wedding today
14:03:46 <happystacker> o/
14:03:57 <happystacker> nice
14:04:02 <rosmaita> so best wishes to Vishal on behalf of the entire cinder team
14:04:17 <happystacker> +1
14:04:19 <rosmaita> #topic announcements
14:04:35 <rosmaita> first, the midcycle is next week
14:04:38 <jayaanand> +1
14:04:40 <jungleboyj> o/
14:04:49 <rosmaita> it's 2 hours and overlaps with the normal meeting time
14:04:56 <msaravan> o/
14:05:10 <rosmaita> so, to be explicit:
14:05:11 <rosmaita> Date: 6th December, 2023
14:05:18 <rosmaita> Time: 1400-1600 UTC
14:05:25 <rosmaita> Meeting link: https://meet.google.com/auq-jiem-zxy
14:05:32 <rosmaita> Etherpad: https://etherpad.opendev.org/p/cinder-caracal-midcycles
14:05:48 <rosmaita> we are light on topics, so please add items you want to discuss or have questions about
14:06:08 <rosmaita> next up is an issue that came up on the mailing list
14:06:17 <rosmaita> #link https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/thread/VL5QIG4JXOPD3V45MALBMKZFXNNBIWIT/
14:06:25 <rosmaita> asyncore is removed in Python 3.12
14:06:48 <rosmaita> it's an issue for us because taskflow uses asyncore, and we use taskflow (a LOT)
14:07:39 <rosmaita> you can read through the thread for details, but the short story is that asyncio is supposed to be the replacement for asyncore
14:07:52 <rosmaita> but, asyncio does not play nicely with eventlet
14:08:01 <rosmaita> and we are pretty big eventlet users
14:08:45 <rosmaita> anyway, short-term it is looking like pyasyncore could be used in py 3.12
14:09:16 <eharney> eventlet also doesn't work yet on py 3.12, so we'll be blocked by that too
14:09:35 <rosmaita> that's right, i think we talked about that last week
14:10:13 <rosmaita> i think someone is working on getting eventlet to work in py 3.12
14:10:24 <rosmaita> but i don't know anything officially about that
14:10:43 <rosmaita> looks like we are having some aging infrastructure issues
14:11:24 <rosmaita> anyway, if you want to dig into eventlet or taskflow, there are opportunities
14:11:34 <rosmaita> i think taskflow is an oslo thing at this point
14:11:59 <rosmaita> final announcement is about cinderlib
14:12:15 <rosmaita> the Bobcat release has to happen on or before Dec 7
14:13:04 <rosmaita> I think the CI is green and there are just a few patches open, nothing that looks critical though
14:13:12 <rosmaita> #link https://review.opendev.org/q/project:openstack/cinderlib+status:open
14:13:48 <rosmaita> and I think we discussed this at the last video meeting, this will be the final cinderlib release
14:13:58 <rosmaita> we won't be continuing development on it
14:14:56 <rosmaita> that's all the official announcements, anyone else have something to announce?
14:16:17 <rosmaita> guess not
14:16:23 <rosmaita> #topic CI Jobs
14:16:38 <rosmaita> two jobs I want to talk about
14:16:52 <rosmaita> 1 - cinder-tempest-plugin-cbak-s3
14:17:05 <rosmaita> #link https://zuul.opendev.org/t/openstack/builds?job_name=cinder-tempest-plugin-cbak-s3&project=openstack/cinder-tempest-plugin
14:17:24 <rosmaita> looks like it's been failing for a month
14:17:44 <rosmaita> and it's blocking the patch to increase the swap space in other jobs
14:17:53 <eharney> this was the one with the issue that looks related to ssl configuration?
14:18:10 <rosmaita> maybe?
14:18:21 <rosmaita> cinder.backup.drivers.s3.S3ClientError: S3 client error: An error occurred (400) when calling the HeadBucket operation: Bad Request
14:19:06 <rosmaita> i guess this is the more relevant one:
14:19:07 <rosmaita> botocore.exceptions.ClientError: An error occurred (400) when calling the HeadBucket operation: Bad Request
14:21:59 <rosmaita> anyway, i will look into it unless there's someone here with an interest in the s3 backup driver?
14:22:14 <happystacker> not really familiar with it
14:22:18 <happystacker> so Can't help
14:23:40 <rosmaita> 2 - grenade
14:23:53 <rosmaita> these aren't failing systematically
14:24:24 <rosmaita> but it looks like when it does fail, it's happening in the grenade setup
14:24:49 <rosmaita> there's a "cinder resource" section where a server gets created and then 3 volumes get created and attached
14:25:11 <rosmaita> sometimes the third volume doesn't get to in-use before the grenade script times out
14:25:40 <rosmaita> other times, the third volume goes to in-use, but then the next step is to ssh into the server, and that fails for some reason
14:26:34 <rosmaita> we need to start tracking these
14:27:03 <jungleboyj> :-(
14:27:54 <rosmaita> #link https://etherpad.opendev.org/p/cinder-caracal-ci-tracking
14:28:32 <rosmaita> so, if you see a grenade failure, please put a link to the logs in ^^
14:28:51 <rosmaita> it would be even better if you could say what the failure is
14:29:32 <rosmaita> i'll look for an example of each of the failures i mentioned earlier and put it on the etherpad so you know what to look for
14:30:24 <happystacker> thks
14:30:32 <rosmaita> ok, that's all from me
14:30:44 <rosmaita> #topic image metadata values
14:31:10 <rosmaita> drencrom: this is the last item, maybe we can end the meeting early and work on the etherpad
14:31:23 <drencrom> sure
14:31:52 <rosmaita> do you have a link handy?
14:32:12 <drencrom> https://etherpad.opendev.org/p/cinder-glance-nova-image-metadata-value-length
14:32:24 <rosmaita> thanks! i have too many windows open
14:32:54 <rosmaita> ok, that's all the official items for today
14:33:27 <rosmaita> i propose that we end the meeting early, and me and drencrom work on the image metadata email, and everyone else take a half-hour to review the requests on the etherpad
14:34:09 <rosmaita> hearing no objections, i declare the meeting over!
14:34:12 <rosmaita> #endmeeting