Wednesday, 2024-10-09

*** mhen_ is now known as mhen01:58
jbernard#startmeeting cinder14:01
opendevmeetMeeting started Wed Oct  9 14:01:47 2024 UTC and is due to finish in 60 minutes.  The chair is jbernard. Information about MeetBot at http://wiki.debian.org/MeetBot.14:01
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.14:01
opendevmeetThe meeting name has been set to 'cinder'14:01
jbernard#topic roll call14:01
Saio/14:02
jbernardo/ 14:02
jbernard#link https://etherpad.opendev.org/p/cinder-epoxy-meetings14:02
eharneyo714:02
jungleboyjo/14:02
jbernard^ new for epoxy14:02
whoami-rajathi14:03
gansoo/14:03
jbernardok14:05
jbernard#topic annoucements14:05
jbernardwelcome everyone14:05
jbernardwe are about to start the epoxy cycle14:06
jbernardthe meeting minutes/outline link has been updated14:06
jbernard#link https://etherpad.opendev.org/p/cinder-epoxy-meetings14:06
jbernardhere is the project schedule for this cycle14:07
jbernard#link https://releases.openstack.org/epoxy/schedule.html14:07
jbernardin 2 weeks we have our virtual PTG14:07
jbernardthe etherpad for this to collect ideas is14:07
whoami-rajatcongratulations jbernard for being re-elected as PTL!14:07
jbernard#link https://etherpad.opendev.org/p/epoxy-ptg-cinder14:07
jbernardwhoami-rajat: thanks!14:07
jbernardit was a tight race :)14:08
whoami-rajat:D 14:08
whoami-rajatsomeone on the ML wanted to discuss a new driver and a new interface for drivers14:08
whoami-rajati redirected them to the epoxy PTG etherpad14:09
jbernardwe have a few cross-project interactions coming up for the ptg14:09
jbernardwhoami-rajat: perfect14:09
jungleboyjjbernard:  Thank you for taking it on again!14:09
whoami-rajati think it would be a good idea to mention the date and time for cinder PTG so people can schedule things accordingly14:09
whoami-rajati mean on the same etherpad14:09
jungleboyj++14:09
jbernardwill do, i need to get the meta information on there14:10
whoami-rajat+114:10
jbernardand also the "room" reservation and bot manipulation stuff14:10
jbernard#action jbernard, update ptg pad, foundation ptg room stuff14:10
jbernardwe've been invited to discuss the horizon feature gap list14:11
jbernardat the ptg14:12
jbernard#link https://etherpad.opendev.org/p/horizon-feature-gap14:12
jbernardwith respect to the ptg schedule, we generally have from tuesday to friday14:13
jbernardlast cycle we met starting at 13:00 UTC14:13
jbernardfor a couple of hours14:13
jbernardand I think friday turned into a bug/code review day14:14
jbernardthis will similar, I do have an appointment tuesday morning, so I'll either shift the start time slightly or jump on a bit late that day14:14
jbernardI'm going to try to have a tentive plan to facilitate a discussion on the removal of eventlet (yes, it's that time)14:15
jbernardand I'm working on trying pick up on Pete's backup encryption work from last cycle, so that doesn't get left behind14:16
jbernardit's worth noting that Gorka has changed groups within redhat recently, so his availability will be very limited (if more than none) going forward14:17
jbernardGorka has made many significant contributions to the project, his work, knowledge, and guidance will be very much missed14:18
whoami-rajat++14:18
whoami-rajatwe all will miss him this time14:18
jbernardand it also means that we need to keep brick in mind as we're allocating time for patch review and maintaince14:19
jbernard(more than usual perhaps) as there is one less pair of eyes there now14:19
tobias-urdinis https://etherpad.opendev.org/p/epoxy-ptg-cinder the official ptg pad? https://etherpad.opendev.org/p/oct2024-ptg-cinder is linked on ptg.opendev.org and has some points already added14:19
jbernardtobias-urdin: ahh, thank you very much for pointing that out14:20
jbernardour working version is https://etherpad.opendev.org/p/epoxy-ptg-cinder (this is the same format as last cycle)14:20
whoami-rajatwow, there are a bunch of topics added there14:20
jbernardill update the opendev link and combine the contents14:20
jbernardgood catch! i was worried we didn't have much to discuss lol14:21
tobias-urdincool, thanks!14:21
* jbernard facepalm14:21
jbernardthat's all for annoucements14:22
jbernard#topic bug discussion14:23
jbernard#link https://bugs.launchpad.net/cinder/+bug/208306114:23
jbernardganso: ^ you're up14:23
gansojbernard: thanks!14:23
gansohello! so we've started discussing that bug in the channel 2 weeks ago14:23
gansoand we decided it was better to discuss in a meeting14:23
gansobasically we need to evaluate whether it is better to patch the stable branches directly with a 1-liner retry, or backport a bigger patch14:24
gansoeharney has more knowledge of the big patch14:24
gansowhich is this one: https://review.opendev.org/c/openstack/cinder/+/83538414:24
gansoit adds a new config option, and someone had mentioned that apparently it has some upgrade impact14:25
gansothe big patch fixes more issues than the one I am discussing though. To be honest, I am more interested in the specific issue. If we conclude that the impact is low is may be a better option to backport the big one and fix more issues in the stable branches, that is good as well. I am just worried about the impact14:26
gansoand risk14:26
jbernardyes, generally we try to avoid backporting things classified as features or containing config changes if possible14:27
eharneyit's not obvious to me why adding a retry on ImageNotFound works14:27
gansoeharney: it is a race condition. When deleting the parent and the child at the same time, the child checks for the parent14:27
gansobut the parent gets renamed upon deletion, so there is a window of opportunity where the code doesn't find the parent14:27
jbernarddo we have a link to the one-liner? is that posted?14:28
eharneyah hah, and we don't have a lock or anything to serialize multiple delete operations that could affect each other14:28
gansoeharney: if the code is retried, then it finds it14:28
gansoeharney: I don't think we can have a good lock for this given it can happen in a HA environment14:28
eharneyyeah, i wasn't proposing we should have one, better to not14:28
gansoeharney: like, 3 cinder-volume services running in parallel processing the deletes at the same time14:28
gansojbernard: no it is not proposed, but it is described in the LP14:29
gansojbernard: it is item (b)14:30
jbernardhow successful was the proper patch (https://review.opendev.org/c/openstack/cinder/+/835384)? have we seen any regressions or need for followup changes?14:30
eharneythere is a follow-up to add an option for those who want to stick w/ the old behavior14:30
eharney(it fell pretty far back into my "review this eventually" queue but seems fine in concept)14:31
gansoeharney: hmmm this complicates things a bit if there are advantages to the old behavior, and a follow-up that we might want to backport as well if we do this one14:32
eharneyi think we don't really want to support the old behavior, the submitter was concerned about expansion of storage usage etc in certain cases14:33
jbernardmy concern with a one-liner is that it wouldn't apply to master, it would be something we only carry for stable branches14:33
gansojbernard: yes, that's the big disadvantage14:33
whoami-rajatthe thing about the one-liner is it only focuses on one of the many issues that eharney has addressed in his patch, even if we go that route, we can have another bug report with another issue that needs patching in stable branches14:34
whoami-rajati feel it is best to address this the right way to avoid future issues in older/stable branches14:34
whoami-rajatmy only concern with the RBD fix patch is the introduction of the config options, if we have checked that the options have safe default values and won't affect upgrade, I'm up for backporting it14:35
jbernardi tend to agree14:36
jbernardeharney: what are your thoughts?14:36
eharneywell the big fix is already in caracal, are we just wanting it in bobcat or also antelope (right before it closes)?14:37
gansojbernard: my understanding from reading the patch is that the config option has a godo default and the upgrade impact is not from the config option. I don't know what the upgrade impact that was raised in the previous discussion is from14:37
gansoeharney: upstream backports yes, but I'm interested in backporting it further downstream to yoga14:38
gansoeharney: I've tested for conflicts cherry-picking it as far back as yoga, and yoga had some conflicts14:38
ganso*only yoga had some conflicts14:39
eharneythe other upgrade impact is that clone v2 image support should be enabled on the cluster (minimum client compat mimic)14:40
eharneyit's not a hard requirement but is what we test and advise using14:40
jbernardganso: pre-antelope releases are unmaintained, they will require a different approach14:41
gansoeharney: ok, mimic is quite old and we could assume it is quite unlikely someone is using mimic with yoga14:42
jbernardganso: assuming the patch can apply cleanly and there are no other techincal issues14:42
jbernardi think we have agreement on backport up to antelope, at the least14:43
gansojbernard: it doesn't apply cleanly to yoga, but we typically don't push all downstream backports to unmaintained branches14:43
jbernardganso: unmaintained is under a different team for review and inclusion14:44
gansojbernard: hmmm maybe I am unfamiliar with the advantages of the unmaintained branches14:45
gansojbernard: AFAIK there isn't CI testing or tags anymore14:45
jbernardganso: that's correct, and the unmaintained group is not the cinder cores - so we cannot review and merge as we do for master and active stable branches14:46
jbernardeharney: are you willing to post those backports?14:47
jbernardeharney: for B and A14:47
whoami-rajatwouldn't it be helpful if a non-core proposed the backport so cores can vote? just a suggestion14:48
jbernardoh, that's clever ;)14:48
gansojbernard: yeah. Based on those facts they haven't provided any meaningful value (as far as I am aware) for delivering bugfixes to people still running old versions, such as yoga, so we backport downstream and test it downstream as much as we can14:48
eharneynot sure, i think we also have to look at devstack-plugin-ceph etc and see if the jobs will test it correctly w/o some changes14:48
jbernardganso: that may be where this one falls as well14:49
gansowhoami-rajat: yea I would propose the backport. I am happy to drive it and make sure whatever we agree can be backported as far back. I would be a shame if I end up finding out that it doesn't work in Yoga though14:49
gansos/I would be a shame/it would be a shame14:49
jbernardok, lets get the backports up so that devstack-plugin-ceph can weigh in14:49
jbernardand then we can circle back with data and make a final call14:49
gansojbernard: sounds good, thanks!14:50
jbernard#action ganso to backport rbd flattening and report back in future meeting14:50
jbernard#topic open discussion14:51
gansothanks everyone14:51
gansoit was a good discussion to assess the risk14:51
whoami-rajatthanks ganso for driving it!14:51
jbernardyes, thanks ganso 14:51
eharneyre: rbd i think we also have a change open somewhere to enable trash purge scheduling in CI which is needed for optimal testing14:55
jbernardthat's a good point14:55
eharneyhttps://review.opendev.org/c/openstack/devstack-plugin-ceph/+/919539   (it needs a re-work)14:55
jbernardill summarize this all in the etherpad14:55
jbernardthanks eharney 14:56
jbernardlast call14:58
jbernardok, thanks everyone!14:59
jbernard#endmeeting14:59
opendevmeetMeeting ended Wed Oct  9 14:59:07 2024 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)14:59
opendevmeetMinutes:        https://meetings.opendev.org/meetings/cinder/2024/cinder.2024-10-09-14.01.html14:59
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/cinder/2024/cinder.2024-10-09-14.01.txt14:59
opendevmeetLog:            https://meetings.opendev.org/meetings/cinder/2024/cinder.2024-10-09-14.01.log.html14:59
jungleboyjThank you!14:59
whoami-rajatthanks everyone!14:59

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!