14:00:03 <whoami-rajat> #startmeeting cinder 14:00:03 <opendevmeet> Meeting started Wed Jan 3 14:00:03 2024 UTC and is due to finish in 60 minutes. The chair is whoami-rajat. Information about MeetBot at http://wiki.debian.org/MeetBot. 14:00:03 <opendevmeet> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 14:00:03 <opendevmeet> The meeting name has been set to 'cinder' 14:00:05 <whoami-rajat> #topic roll call 14:00:34 <jayaanand> hi 14:00:51 <sp-bmilanov> hello 14:02:29 <keerthivasansuresh> o/ 14:02:35 <whoami-rajat> #link https://etherpad.opendev.org/p/cinder-caracal-meetings 14:03:40 <rosmaita> o/ 14:04:01 <whoami-rajat> welcome back everyone 14:04:08 <whoami-rajat> though we only have a handful of people 14:04:32 <whoami-rajat> anyways let's get started 14:04:39 <whoami-rajat> #topic announcements 14:05:00 <whoami-rajat> and first one is, Happy new year! 14:05:22 <sp-bmilanov> woohoo, Happy new year! :) 14:05:34 <whoami-rajat> :) 14:05:44 <whoami-rajat> ok, getting into the main announcements 14:05:49 <whoami-rajat> Midcycle-1 Summary 14:05:55 <whoami-rajat> #link https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/thread/L2F33OEKDCTGO7PDUO2DGP4JYUBYWRCM/ 14:06:00 <whoami-rajat> #link https://wiki.openstack.org/wiki/CinderCaracalMidCycleSummary 14:06:12 <whoami-rajat> the recording and summary are up on the wiki page 14:06:19 <whoami-rajat> make sure to follow up on your action items 14:06:31 <whoami-rajat> next, Posting results from generative "AI" (LLM) queries 14:06:35 <whoami-rajat> this is an interesting one 14:06:54 <whoami-rajat> Jeremy noted that some replies to the ML threads are answers generated by LLMs (like chatgpt) 14:07:00 <whoami-rajat> I agree to the general idea that if a person requires answers generated from an LLM, they would directly do the query and not resort to the ML 14:07:25 <whoami-rajat> also there is no compulsion to reply to the ML so the effort is appreciated but it might not be helpful 14:07:55 <whoami-rajat> anyways i found this interesting so added it 14:07:57 <whoami-rajat> next, Upcoming Deadlines & Dates 14:08:01 <whoami-rajat> Caracal-2 Milestone: January 11th, 2024 14:08:05 <whoami-rajat> If you have any new drivers proposed for the 2024.1 Caracal cycle, add it to the following etherpad 14:08:10 <whoami-rajat> #link https://etherpad.opendev.org/p/cinder-caracal-drivers 14:08:24 <whoami-rajat> this makes the tracking easier 14:08:46 <whoami-rajat> that's all the announcements i had, anyone has anything else? 14:11:08 <whoami-rajat> ok, let's move on to topics 14:11:18 <whoami-rajat> #topic Implementation of the dedicated backup status field for cinder volumes 14:11:52 <whoami-rajat> Jon and happystacker showed interest in this feature 14:12:06 <whoami-rajat> Christian wanted to know if there was any update on it 14:12:36 <whoami-rajat> I didn't see the reproposal of the spec in 2024.1 spec dir (and we are past spec freeze) 14:12:53 <whoami-rajat> so i guess we won't be seeing any progress on it this cycle? 14:14:17 <whoami-rajat> let's get back to it next week if christian has further questions 14:14:22 <whoami-rajat> moving on 14:14:28 <whoami-rajat> #topic Performance issues with cinder-backup and the chunked driver 14:14:59 <whoami-rajat> again it's by Christian and he wants to know if there is any update on the backup work 14:15:02 <whoami-rajat> #link https://bugs.launchpad.net/cinder/+bug/1918119 14:15:57 <whoami-rajat> he mentions zaitcev took this as an action item, any updates on it Pete? 14:17:01 <zaitcev> whoami-rajat: It is still on my plate, sorry. I got into digging through old reviews that your guys listed in vPTG. 14:17:35 <zaitcev> The 1918119 is the main bug about the performance of Cinder backup with S3. 14:17:59 <whoami-rajat> zaitcev, oh no worries, Christian wanted to know if there was an update, I don't think there is a deadline for it anyway 14:18:36 <zaitcev> Well, there was no progress and that is the update. I hate to tell him that. 14:19:22 <whoami-rajat> then i can tell him (on the etherpad) :D 14:20:12 <whoami-rajat> updated 14:20:28 <whoami-rajat> i guess that was it for this topic 14:20:49 <whoami-rajat> next one 14:20:51 <whoami-rajat> #topic What are the correct auth caps for Ceph RBD clients of Cinder / Glance / Nova 14:20:59 <whoami-rajat> #link https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/thread/E3VYY24HUGBNH7626ALOGZMJRVX5VOSZ/ 14:21:07 <whoami-rajat> I added this as a topic since it came up on the ML 14:21:19 <whoami-rajat> and it was related to the recent work we did in glance rbd store 14:21:51 <whoami-rajat> so glance rbd store now requires read access to the cinder rbd pool to check if the image has any childrens (dependents) 14:22:39 <whoami-rajat> but similar change wasn't made in the deployment tools hence one of the operator found this as a regression 14:23:09 <whoami-rajat> all the details are on the ML thread but what i wanted to highlight is regarding the correct rbd auth caps for nova, cinder and glance 14:23:28 <whoami-rajat> which i don't think are mentioned in a central place as a deployment guide 14:24:29 <whoami-rajat> Christian did write some bullets that can be treated as work items for this topic 14:24:30 <whoami-rajat> let's determine the correct caps (least privileges, caps via profiles where possible, ...) 14:24:31 <whoami-rajat> fix the documentation and code devstack as "upstreams" first 14:24:31 <whoami-rajat> write an upgrade bullet point to release notes for Caracal for operators to check and align their caps from what they might have become over the various releases 14:24:31 <whoami-rajat> distribute this as a reference to the deployment tools and also the Ceph docs 14:25:16 <rosmaita> he mentioned somewhere in the thread that he was working on a docs patch (I think) 14:25:34 <whoami-rajat> oh thats great then 14:25:43 <whoami-rajat> and welcome back Brian! 14:25:48 <rosmaita> :D 14:26:22 <whoami-rajat> ok, that's all i had for this topic 14:26:37 <whoami-rajat> last topic 14:26:49 <whoami-rajat> #topic Make the s3 backup job non voting 14:27:05 <whoami-rajat> so i did some digging into it last week 14:27:15 <rosmaita> thank you! 14:27:26 <whoami-rajat> tried deploying a s3+swift setup but couldn't reproduce the issue 14:27:36 <whoami-rajat> checked boto3 docs on our usage of it 14:27:38 <whoami-rajat> looked correct 14:27:51 <whoami-rajat> checked the changelogs -- doesn't mention any breaking change 14:28:06 <whoami-rajat> tried with a lower version of boto3 (that passed in the previous gate runs) -- same error 14:28:18 <whoami-rajat> I've mentioned all the details in the commit message of my patch 14:28:21 <whoami-rajat> #link https://review.opendev.org/c/openstack/cinder-tempest-plugin/+/904475 14:28:36 <whoami-rajat> but overall, I really don't know the actual reason of failure 14:28:59 <whoami-rajat> and i think we're at a point where we need to unblock the gate for other patches to land 14:29:08 <whoami-rajat> so i proposed a patch to make it n-v 14:29:25 <whoami-rajat> the patch is failing on the lvm-multiattach job at this point but hopefully this recheck will pass 14:29:36 <whoami-rajat> (famous last words) 14:30:03 <whoami-rajat> anyways, let me know if anyone has any idea about it but this seems to be our solution atm for unblocking gate 14:30:37 <rosmaita> sounds like a good plan to get things moving 14:33:00 <whoami-rajat> thanks 14:33:04 <whoami-rajat> that's all i had for this topic 14:34:11 <hemna> Happy New Year 14:34:38 <whoami-rajat> welcome back Walt! 14:34:53 <whoami-rajat> that's all the topics we had for today 14:34:58 <whoami-rajat> moving to open discussion 14:35:01 <whoami-rajat> #topic open discussion 14:35:39 <frickler> I'd like to mention https://bugs.launchpad.net/cinder/+bug/2047693, discovered multiple issues with "cinder-manage quota sync" 14:35:56 <whoami-rajat> we have a bunch of review request so good way of getting back is to get some reviews done 14:36:02 <frickler> I put up some patches, but help still wanted with testing 14:37:02 <frickler> (seems this has been broken for at least one year, so some regression testing would be really helpful) 14:40:11 <whoami-rajat> ah, we did a lot of work around DB past couple of cycles, actually Stephen did, need to check which change broke this 14:40:20 <whoami-rajat> thanks for bringing this up frickler 14:44:23 <whoami-rajat> looks like we don't have anything else for open discussion 14:44:26 <whoami-rajat> let's end for today 14:44:32 <whoami-rajat> thanks everyone! 14:44:34 <whoami-rajat> #endmeeting