Wednesday, 2024-04-24

happystackero/13:57
jungleboyjo/14:00
jbernard#startmeeting cinder14:01
opendevmeetMeeting started Wed Apr 24 14:01:00 2024 UTC and is due to finish in 60 minutes.  The chair is jbernard. Information about MeetBot at http://wiki.debian.org/MeetBot.14:01
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.14:01
opendevmeetThe meeting name has been set to 'cinder'14:01
Saio/14:01
jbernardwelcome everyone14:01
toskyo/14:01
whoami-rajathi14:01
happystackero/14:01
simondodsleyo/14:01
eharneyhi14:01
rosmaitao/14:01
Luzio/14:01
jbernard#link https://etherpad.opendev.org/p/cinder-dalmatian-meetings14:02
jbernardok14:04
jbernardwelcome14:04
jbernardive just realized that we usually have video for the last meeting, my appologies14:04
happystackerI missed a few meetings due to overload 14:05
jbernard#topic announcements14:05
happystackersorry for that14:05
jbernardhappystacker: no worries14:05
jbernardPTG summary went out to the list14:05
whoami-rajati think i forgot a lot of things during my first time as PTL so it should be fine14:05
jbernard#link https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/thread/33XWCG7YQHDKGRR5AVUO4RAJ77AOUMRW/14:05
jbernardalso, I captured the summary and the etherpad as a wiki page14:06
jbernard#link https://wiki.openstack.org/wiki/CinderDalmatianPTGSummary14:06
jbernardlet me know if i missed something or something doesn't look right or inaccurate14:06
jbernardI'm working through the release cycle timeline this week14:08
jbernardi need to schedule our midcycle and get that posted14:08
jbernardi will propose some options in the next meeting, if not before14:08
jbernardjungleboyj: if you have the videos posted, i can update our wiki to include those links14:09
jbernardthat's all i have for major annoucements, things are pretty quiet at the moment14:10
jungleboyjjbernard: I need to get that done.  Have been sick the first part of the week.14:10
jungleboyjWill try to get that done ASAP.14:10
jbernardjungleboyj: no worries, there's no rush, i was just thinking about it14:11
jbernardjungleboyj: hope you feel better, we've all been sick a ton this spring14:11
jungleboyjThanks.  :-)  Working on getting better.14:11
jbernard#topic bug on reimaging volume14:12
jbernardwhoami-rajat: ^ all you14:12
whoami-rajatthanks!14:12
whoami-rajatso one of the upstream contributors was testing the rebuild volume backed instance operation14:12
whoami-rajatthat i worked on in the Zed cycle14:12
whoami-rajathe found a case which wasn't handled in the code14:12
whoami-rajatso it's a bug in both nova and cinder implementation14:12
ccokeke[m]Well done jbernard: 14:13
whoami-rajatfor cinder specific discussion, we can consider "reimaging an available volume" scenario14:13
whoami-rajat#link https://bugs.launchpad.net/cinder/+bug/206253914:13
whoami-rajatWhen reimaging the volume, if the image is created from a VM snapshot of a bootable volume, we error out since there is no actual image but a reference to volume snapshot14:13
whoami-rajatWhen we create a volume from such image, we trigger the workflow of create volume from snapshot14:14
whoami-rajatWhen reimaging the volume, that doesn't work since we are using an existing volume14:14
whoami-rajatand not creating a new one14:14
happystackergood catch14:14
whoami-rajatThe solution I came up with is to revert the volume to the snapshot that is backing the image which I have implemented here14:14
whoami-rajat#link https://review.opendev.org/c/openstack/cinder/+/91640814:14
simondodsleywhat happens if the original snapshot has subsequently been deleted? Can it have been deleted given it is still referenced by the glance image?14:14
whoami-rajatif anyone is interested, here is the nova bug and patch14:15
whoami-rajat#link https://bugs.launchpad.net/nova/+bug/206212714:15
whoami-rajat#link https://review.opendev.org/c/openstack/nova/+/91640914:15
whoami-rajatI'm not sure about that, there shouldn't be anything preventing us from deleting that snapshot (unless that's a handled case) but the image would be useless if we delete that snapshot14:15
whoami-rajatso there might be a general recommendation somewhere that "don't delete snapshots backing up the image"14:16
whoami-rajatalthough TBH I haven't tried that scenario14:16
whoami-rajatwhat i wanted to discuss was, is revert to snapshot the right mechanism to handle this case, since we want to put the contents of the snapshot in an existing volume14:17
simondodsleyi think it is quite likely that a anspshot will be deleted after it has been used to create a new image. This woulkd then allow subsequent changes to the base volume to be snapshotted again14:17
whoami-rajatwe are not using snapshot to create image, we are creating a VM snapshot of a bootable volume so glance has an image reference and cinder volume snapshot has the actual image contents14:18
simondodsleyyes, i get that but the reimage will have a problem is the snapshot used to create the volume has been deleted. We need to check that out14:19
simondodsleyisn't that what you are saying?14:19
whoami-rajatthat is not the problem for the reimage operation but for the image in general, if the snapshot is deleted then we cannot do anything with that image, bootable volume/launching instance14:20
whoami-rajatthe case i was discussing is14:20
whoami-rajatwhen we use a snapshot backed image to reimage a volume, it doesn't work14:21
simondodsleyok - understood14:21
whoami-rajatwe cannot download that image, we need to use the snapshot to reimage the volume -- for which i found revert to snapshot (generic) the best mechanism14:22
whoami-rajatbut i wanted to know what the team thinks about it before moving forward with that approach14:22
jbernardwhat is the alternative to reverting to snapshot?14:25
whoami-rajatI've no alternative atm but I'm open to ideas14:25
whoami-rajathttps://review.opendev.org/c/openstack/cinder/+/916408/3/cinder/volume/manager.py14:26
whoami-rajatthis is the approach I'm referring to14:27
whoami-rajatinitially i was planning to do these operations manually but i found revert to snap (generic) already doing it14:27
whoami-rajati.e. create volume from snap and copy data to our existing volume14:27
simondodsleyif only we could revert from any snapshot, rather than only from the latest, that would also help out here.14:28
whoami-rajatbut we can do that in the generic mechanism, we just need to pass the snapshot backing the image and it creates a temp volume out of it14:29
whoami-rajati don't think the snapshot needs to be latest here14:30
whoami-rajatanyways, i don't want to take up all the meeting time, i can bring this back again14:32
whoami-rajatbut if we have no concerns then i can work on completing the patch14:32
simondodsleyif that is the case then the solution seems sound. 14:32
whoami-rajatgreat, thanks simondodsley !14:32
simondodsleyit might be worth looking at the links from an image to a snapshot and alerting that the snapshot backs an image if the snapshot needs to be deleted14:32
whoami-rajatyeah, maybe we can have a field in the snapshot for image_id, which if set, checks if the associated image exists and prevent deletion of that snapshot14:33
whoami-rajati will test that out to see if we have a bug there14:34
whoami-rajator the very least, we can document this behavior14:34
simondodsley+114:34
jbernarddon't we store metadata in the volume if it is created from a snapshot? could we not determine this with what's already there?14:34
whoami-rajati think we have the snapshot_id field set but we need something to differentiate between a normal snapshot from a volume vs a snapshot that is backing an image14:35
jbernardahh14:36
whoami-rajati need to dig more into this whole feature of "VM snapshots of volume backed instance" since i feel there are more potential bugs there which i haven't tested yet14:37
whoami-rajatbut for this topic, that was all from my side14:37
jbernard#action whoami-rajat to look into image-backing shpashots for next meeting14:38
whoami-rajat+114:38
jbernard#topic image encryption14:38
jbernardLuzi: you're up :)14:38
jbernard#link https://review.opendev.org/c/openstack/glance-specs/+/91572614:38
LuziAs discussed at the PTG, I wrote a spec for the new Image Encryption with LUKS-Images in Glance, can you tell if there is also a spec needed for Cinder?14:38
LuziMainly we introduce new metadata-parameters for images - so there might be some work that has to be done in Cinder - but I doubt that there will be API-changes or something like this14:39
jbernardi think it depends on the nature of the changes needed to support it on the cinder side.  do you have a sense of what we will need?14:39
jbernardmy sense is that it wouldn't hurt to have a spec, what do others think?14:40
Luziwell there need to be a check at least when creating a volume that a volume type with an encryption type is chosen (or the default type has an ecnryption type)14:40
jbernarda spec may facilitate on the metadata parameter and how they're used14:41
jbernardfaciliate /discussion/ on14:41
Luziokay - I will write a spec14:42
jbernardwhoami-rajat: curious your thoughts, im new here ;)14:42
whoami-rajatmaybe I'm interpreting our discussion in a wrong way14:43
Luzii think maybe this will also concern one of the two bugs I linked - the 2nd one I think14:43
whoami-rajatbut we decided to implement the metadef API like structure for Cinder14:43
whoami-rajatand not use the one existing in glance right?14:43
whoami-rajatrosmaita, you can correct me if my understanding is wrong here ^14:44
jbernard#link https://etherpad.opendev.org/p/dalmatian-ptg-cinder#L11314:44
rosmaitai think the metadefs was for the other effort, about exposing info for volume types14:44
jbernardyes, that was for user-visible volume types14:44
rosmaitathe metadefs stay in Glance, we would just define some key,value pairs for what we need14:45
Luziyes14:45
jbernardrosmaita: is that spec-necessary for tracking? how do we do this?14:46
rosmaitawell, we should go ahead and un-accept the gpg-based spec14:46
jbernardagree14:47
jbernard#action unaccept the gpg-based spec14:47
whoami-rajatsorry, my bad, i mixed up things here, I will add my comments to the spec and see if we need one for cinder14:47
rosmaitai guess i should read the new glance spec and see what its impact on cinder is14:48
Luzithat would be nice rosmaita 14:48
rosmaitaif we don't need a full spec, we can use an LP blueprint to at least keep track of the work14:48
jbernard#action review glance spec on image encryption, do we need a spec on our side?14:49
rosmaitaLuzi: please ping me on monday if i haven't left comments on the glance spec by then14:49
Luziokay14:49
rosmaitathanks!14:49
jbernardok14:49
jbernard#topic review requests14:49
jbernardsimondodsley has one14:50
jbernard#link https://review.opendev.org/90309514:50
simondodsleyyes - this is an upgrade of our core API version14:51
simondodsleyneeds a change in the underlying SDK.14:51
simondodsleyLots of changes to the tests and core code, but nothing new added really.14:51
simondodsleyWe added one piece to cater for something called safemode in Pure, which if not covered can cause volume deletions to fail as far as cinder is concerned14:51
simondodsleywe don't have a Pure CI currently so we have to rely on Zull and our inhouse testing.14:52
simondodsleyThe CI system is on-route to a new datacenter14:52
simondodsleynot sure when it will be back up and running14:52
jbernardsimondodsley: how confident are you with zuul and in-house results?14:53
simondodsleyvery- i spent about 3 months trying to test every scenario14:53
jbernardnice14:53
whoami-rajatwhen you say in-house, is it manual testing or a tempest suite or a combination of both?14:53
simondodsleymanula testing of every function14:54
whoami-rajatok, if possible, can we also have a confirmation from a tempest run since they have some good scenario testing there?14:55
simondodsleyi can try and set that up.14:55
whoami-rajatgreat, thanks!14:55
jbernard#action simondodsley will report tempest results for pure upgrade patch14:56
jbernardLuzi has a spec for user-visible volume types14:57
jbernard#link https://review.opendev.org/c/openstack/cinder-specs/+/909195/714:57
Luziyeah we discussed this at the PTG and I adjusted the spec accordingly14:57
jbernardawesome, thanks14:57
jbernardand eharney is upgrading hacking14:58
jbernard#link https://review.opendev.org/c/openstack/cinder/+/89190614:58
whoami-rajatso we are going with the approach of a metadata field in volume type and later leveraging the metadef APIs?14:58
Luzias far as I did understand it: yes15:00
whoami-rajatseems like I'm very confused about this feature but i will go through the spec, thanks!15:01
jbernardalright, that's time, thank you everyone!15:01
jbernard#endmeeting15:01
opendevmeetMeeting ended Wed Apr 24 15:01:49 2024 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:01
opendevmeetMinutes:        https://meetings.opendev.org/meetings/cinder/2024/cinder.2024-04-24-14.01.html15:01
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/cinder/2024/cinder.2024-04-24-14.01.txt15:01
opendevmeetLog:            https://meetings.opendev.org/meetings/cinder/2024/cinder.2024-04-24-14.01.log.html15:01
jungleboyjThank you!15:02
ccokeke[m]Thank you 15:03
whoami-rajatthanks jbernard !15:06
*** tobias-urdin4 is now known as tobias-urdin15:57

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!