| *** mhen_ is now known as mhen | 02:36 | |
| opendevreview | Fernando Ferraz proposed openstack/devstack-plugin-nfs master: [DNM] Test Glance over Cinder/NFS with NFS driver fixes https://review.opendev.org/c/openstack/devstack-plugin-nfs/+/965409 | 03:39 |
|---|---|---|
| opendevreview | Fernando Ferraz proposed openstack/devstack-plugin-nfs master: [WIP] zuul: add job for testing Glance with Cinder as backend https://review.opendev.org/c/openstack/devstack-plugin-nfs/+/940482 | 03:42 |
| opendevreview | Fernando Ferraz proposed openstack/devstack-plugin-nfs master: [DNM] Test Glance over Cinder/NFS with NFS driver fixes https://review.opendev.org/c/openstack/devstack-plugin-nfs/+/965409 | 03:42 |
| *** bauzas9 is now known as bauzas | 04:20 | |
| opendevreview | Raghavendra Tilay proposed openstack/cinder stable/2024.2: Dalmatian - check zuul https://review.opendev.org/c/openstack/cinder/+/967653 | 07:02 |
| opendevreview | Silvan Kaiser proposed openstack/cinder master: Revert "Mark Quobyte Driver Unsupported" https://review.opendev.org/c/openstack/cinder/+/967672 | 10:21 |
| *** agalica_ is now known as agalica | 13:44 | |
| cardoe | Meeting today? | 14:01 |
| jbernard | yep, one sec | 14:02 |
| jbernard | #startmeeting cinder | 14:03 |
| opendevmeet | Meeting started Wed Nov 19 14:03:26 2025 UTC and is due to finish in 60 minutes. The chair is jbernard. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:03 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:03 |
| opendevmeet | The meeting name has been set to 'cinder' | 14:03 |
| jbernard | courtesy reminder: jungleboyj rosmaita smcginnis tosky whoami-rajat m5z e0ne geguileo eharney jbernard hemna fabiooliveira yuval tobias-urdin adiare happystacker dosaboy hillpd msaravan sp-bmilanov Luzi sfernand simondodsley zaubea nileshthathagar flelain wizardbit agalica | 14:03 |
| jbernard | #topic roll call | 14:03 |
| raghavendrat | hi | 14:03 |
| erlon | \o | 14:03 |
| jbernard | o/ | 14:03 |
| agalica | o/ | 14:04 |
| seunghunlee | hi | 14:04 |
| agalica | (finally made it at 6am :D) | 14:04 |
| jbernard | ouch :/ | 14:04 |
| cardoe | o/ | 14:04 |
| rosmaita | o/ | 14:04 |
| sfernand | hi | 14:04 |
| whoami-rajat | hi | 14:06 |
| jbernard | #link https://etherpad.opendev.org/p/cinder-gazpacho-meetings | 14:07 |
| jbernard | etherpad for this meeting^ | 14:07 |
| jbernard | it looks like this will be a quick meeting today | 14:08 |
| jbernard | #topic annoucments | 14:08 |
| jbernard | not much :) | 14:08 |
| rosmaita | i got one | 14:08 |
| jbernard | we're here: | 14:08 |
| jbernard | #link https://releases.openstack.org/gazpacho/schedule.html | 14:09 |
| jbernard | in R-19 | 14:09 |
| jbernard | rosmaita: fire away | 14:09 |
| rosmaita | Festival of Reviews on Friday, 1400-1600 UTC | 14:09 |
| rosmaita | #link https://meetings.opendev.org/#Cinder_Festival_of_Reviews | 14:09 |
| agalica | I'm attending, so if you wanna be one of the cool kids you can join us | 14:10 |
| rosmaita | we had decent attendance at the last one 2 weeks ago | 14:10 |
| rosmaita | let's try to set a record! | 14:10 |
| rosmaita | agalica will be there, what more do you want? | 14:10 |
| agalica | haha | 14:10 |
| jbernard | i have an appointment that may cause me to miss it, i might try to work on the patch list some either today or tomorrow | 14:11 |
| whoami-rajat | I won't be there since I'm on leave, but feel free to leave some patches that require my sight | 14:11 |
| jbernard | yes, direct all queries to rajat's inbox please ;) | 14:11 |
| lutimura | hey guys! sorry i'm late. i have a couple of changes that i'd love to get some feedbacks on. should i add them to the etherpad above? | 14:12 |
| whoami-rajat | s/all/some :D | 14:12 |
| erlon | is it this friday? | 14:13 |
| agalica | erlon: yes | 14:13 |
| jbernard | lutimura: https://etherpad.opendev.org/p/cinder-gazpacho-reviews | 14:13 |
| agalica | jon, you beat me by like 20ms | 14:13 |
| jbernard | :) | 14:13 |
| erlon | I was counting on the ics from https://meetings.opendev.org/#Cinder_Festival_of_XS_Reviews | 14:14 |
| opendevreview | Eric Harney proposed openstack/cinder master: Replace _add_to_threadpool with native threads https://review.opendev.org/c/openstack/cinder/+/959383 | 14:14 |
| opendevreview | Eric Harney proposed openstack/cinder master: Add Slow Fake volume driver https://review.opendev.org/c/openstack/cinder/+/959384 | 14:14 |
| jbernard | rosmaita: ^ re ics, you updated that, no? | 14:14 |
| rosmaita | erlon: that's the old one, been replaced by https://meetings.opendev.org/#Cinder_Festival_of_Reviews | 14:14 |
| erlon | it shows to my an event on Dec 5 | 14:14 |
| jbernard | the festival has been modified to include a bit more than just XS reviews | 14:15 |
| jbernard | so we changed the name to reflect | 14:15 |
| rosmaita | yeah, there was an issue with the ics file, for some reason i couldn't get it to display the meetings in november | 14:15 |
| opendevreview | Eric Harney proposed openstack/cinder master: RBD changes for eventlet removal https://review.opendev.org/c/openstack/cinder/+/959385 | 14:15 |
| rosmaita | i forgot about that | 14:15 |
| rosmaita | but yeah, if you are showing dec 5, i think you have the new ics , since that's the first friday in december | 14:15 |
| rosmaita | to remind people: the festival is now 2x a month | 14:16 |
| rosmaita | first friday and third friday | 14:16 |
| rosmaita | 1400-1600 UTC | 14:16 |
| erlon | @rosmaita Do you have a guerrit query with the items we will be reviewing? | 14:17 |
| rosmaita | i'll send an email to the mailing list to remind people, because if they're relying on the ics, they won't know about friday's meeting | 14:17 |
| rosmaita | erlon: it's on the etherpad that's linked from https://meetings.opendev.org/#Cinder_Festival_of_Reviews | 14:18 |
| rosmaita | #link https://etherpad.opendev.org/cinder-festival-of-reviews | 14:18 |
| erlon | nice | 14:18 |
| erlon | thanks | 14:18 |
| rosmaita | the "new" dashboard may not show much stuff, since a priority has to be set for a review to show up in there | 14:19 |
| rosmaita | but there's a link to the "old" dashboard if you show up early or something | 14:19 |
| jbernard | ill try to set some priorities prior to friday | 14:21 |
| jbernard | #topic noonedeadpunk 's cinder-backup patches | 14:21 |
| jbernard | noonedeadpunk: ^ do you happen to be around? | 14:22 |
| noonedeadpunk | o/ | 14:22 |
| jbernard | https://review.opendev.org/c/openstack/cinder/+/962909 and https://review.opendev.org/c/openstack/cinder/+/959425 | 14:22 |
| jbernard | we wanted to include these in the PTG sessions, but scheduling was hard | 14:22 |
| noonedeadpunk | (there are also respective specs proposed for them) | 14:22 |
| noonedeadpunk | https://review.opendev.org/c/openstack/cinder-specs/+/958838 and https://review.opendev.org/c/openstack/cinder-specs/+/962306 | 14:23 |
| jbernard | do these simply need reviews, or is there something that requires discussion? | 14:23 |
| noonedeadpunk | not sure if they are needed, but I created them just in case :) | 14:23 |
| noonedeadpunk | Well, it would be nice to validate if these are making sense at all from project prespective | 14:24 |
| noonedeadpunk | but I think mainly reviews from my standpoint | 14:24 |
| noonedeadpunk | as we're approaching spec freeze afaik, and would be nice to have progress this cycle | 14:25 |
| rosmaita | noonedeadpunk: i will try to get comments on those specs in the next day or so ... feel free to ping me on friday if you haven't seen any action | 14:25 |
| jayaanand | need core approval for support matrix update https://review.opendev.org/c/openstack/cinder/+/964479 | 14:25 |
| noonedeadpunk | awesome, thanks! | 14:26 |
| jbernard | #topic cardoe has some things | 14:27 |
| jbernard | cardoe: take it away | 14:27 |
| cardoe | heh I'm noisy. :) | 14:27 |
| jbernard | this looks like followup from our ptg discussion | 14:29 |
| cardoe | Just continuing to work with a NetApp device that I've got. For those that weren't at the PTG, we build KVM and ESXi hypervisors in Ironic and then attaching them to a storage backend. Those KVM and ESXi setups represent a traditional OpenStack and then whatever VMware calls their thing. | 14:29 |
| cardoe | My stuff is all test envs right now but the real setup is actually the Zuul infrastructure in the future. | 14:29 |
| cardoe | Running 2025.1 in one env with a NetApp and there's a handful of issues that I was trying to get backported and chase down. | 14:30 |
| cardoe | We're working exclusively with NVMe | 14:30 |
| cardoe | The ultimate goal will be to make the Nova/Ironic/Cinder flow work nicely with NVMe. | 14:31 |
| cardoe | Outside of the backports the two bugs we're seeing are the slow behavior from https://review.opendev.org/c/openstack/cinder/+/962085 | 14:31 |
| erlon | So I suppose the flow works well with iSCSI and other drivers today | 14:31 |
| cardoe | Nova/Ironic/Cinder works with iSCSI in 1 specific flow today. | 14:32 |
| cardoe | TheJulia and I are working on a spec improvement to provide full network storage device function from Ironic | 14:33 |
| erlon | hmm, right | 14:33 |
| erlon | Are you guys working on a CI job for that? | 14:33 |
| TheJulia | We've had one on ironic for *ages* | 14:34 |
| erlon | NVMe? | 14:34 |
| TheJulia | no, can't do that yet, iscsi only. The issue is the labeling usage pattern as it relates to the data and cinder driver inconsistency in field values | 14:34 |
| cardoe | erlon: it works but you need a pile of patches to hardcoded strings | 14:35 |
| TheJulia | we basically need cleanup to be performed and consistency reached as it relates to nova's interaction and values. | 14:35 |
| cardoe | like netapp wants a string of "NVMe" while other parts of Cinder pass around "nvmeof" | 14:35 |
| cardoe | Nova hardcodes a few dict keys it gets from os-brick which don't necessarily line up. | 14:36 |
| cardoe | Those rough edges I'm working on. | 14:36 |
| cardoe | I'm happy to contribute hardware | 14:36 |
| TheJulia | (a list in os-brick of expected keys would sort of be ideal to iterate through, realistically) | 14:36 |
| jbernard | cardoe: yes please | 14:36 |
| erlon | Right, I'm thinking on the target scenario for a running Nova/Ironic/Cinder job i | 14:37 |
| rosmaita | https://opendev.org/openstack/cinder/src/branch/master/cinder/common/constants.py#L58 | 14:37 |
| cardoe | Out of all software I deal with Zuul is the most confusing beast so I'll need help. | 14:37 |
| TheJulia | Except, other services can't be really expected to import cinder as a library | 14:37 |
| * TheJulia lets cardoe talk and stops interjecting | 14:38 | |
| cardoe | no you're right. | 14:39 |
| TheJulia | I'm just pointing to that sharp annoying bit that threads hang on ;) | 14:39 |
| cardoe | All I'm really trying to ask is on the performance issue and the os_type issue | 14:39 |
| cardoe | So performance wise the patch landed if you've got cinder-volume configured with 1 SVM (which is how the NetApp driver is written) and you've got multiple pools on that SVM. | 14:39 |
| cardoe | But if you then add another backend (which per the Cinder docs should be another SVM), performance tanks. | 14:40 |
| whoami-rajat | rosmaita, isn't that the storage_protocol and not the driver_volume_type returned to os-brick? | 14:40 |
| cardoe | You add a 3rd backend to the same NetApp cluster? You cannot do a get_volume_stats() without getting Cinder throwing a warning that it took too long. | 14:40 |
| cardoe | So really wanting to understand the best way to work at improving this. Cause I can harass NetApp through a support channel since they want us to buy their gear. | 14:41 |
| cardoe | Or if I should be trying to engage via bugs against Cinder. | 14:42 |
| whoami-rajat | cardoe, netapp improved that to some extent with this https://review.opendev.org/c/openstack/cinder/+/964191 | 14:42 |
| cardoe | Yeah that works fine with 1 SVM and multiple pools. | 14:42 |
| whoami-rajat | looks like some of the performance and dedup stats weren't useful for scheduling to they're cached now until a long configurable value | 14:42 |
| cardoe | It doesn't do much as soon as you define 2 backends. | 14:42 |
| cardoe | I've already got that patch pulled in. | 14:43 |
| whoami-rajat | ack | 14:43 |
| cardoe | The other issue I've run into is the os_type. https://bugs.launchpad.net/cinder/+bug/2131104 | 14:43 |
| cardoe | volume attachment create takes an "os-type" field but the NetApp driver doesn't respect that. | 14:44 |
| cardoe | It actually only utilizes config flags that aren't documented. | 14:44 |
| cardoe | But the issue is that os-type needs to be passed to the NetApp on the volume creation AND on the attachment | 14:44 |
| cardoe | I don't see a way in Cinder to pass along os-type on the volume create. Should that be something that's part of the volume type? | 14:45 |
| cardoe | If so I'm happy to work on that patch to make it do that. | 14:45 |
| cardoe | As far as the volume_stats performance issue, I'm just looking for some docs or details on WHAT cinder really wants from the volume_stats. It seems each driver provides some different details. | 14:45 |
| cardoe | Sorry I provided a lot of context. I'm not looking to throw a bunch of "here's issues Cinder Community! Go fix it." | 14:46 |
| cardoe | What I'm looking for is some direction on the path we should take and I'll task developer resources to contribute the changes. | 14:46 |
| cardoe | Unless the better approach is to raise this via a NetApp support channel. | 14:47 |
| cardoe | That's what I'm asking. | 14:47 |
| cardoe | </end> | 14:47 |
| rosmaita | cardoe: https://opendev.org/openstack/cinder/src/branch/master/cinder/interface/volume_driver.py#L68-L172 | 14:47 |
| rosmaita | (about volume_stats) | 14:47 |
| jbernard | i need to (am willing to) look into the volume type logic to offer some direction on os-type | 14:49 |
| cardoe | rosmaita: that is helpful thank you. I was trying to find it in the docs. | 14:49 |
| rosmaita | yeah, we've been trying to consolidate the info in one place, but no one knows which is the one place | 14:50 |
| agalica | sounds like a standard consolidation to me | 14:51 |
| jbernard | #action jbernard os-type on volume create | 14:52 |
| jbernard | ok to move on? | 14:52 |
| cardoe | yes thank you. | 14:52 |
| cardoe | Oh. the backports... what's the best way to add things to a queue that should get an eyeball for consideration? | 14:53 |
| jbernard | cardoe: same etherpad, that seems reasonable to me | 14:53 |
| jbernard | https://etherpad.opendev.org/p/cinder-gazpacho-reviews | 14:54 |
| cardoe | will do. thank you. sorry for the long windedness. | 14:54 |
| jbernard | #topic erlon / https://review.opendev.org/c/openstack/os-brick/+/955379 | 14:55 |
| erlon | hey | 14:55 |
| erlon | We discussed this one on the ptg as well. I just wanted to bring some attention to it, since we don't want to miss the release this time. | 14:56 |
| erlon | its in the etherpad already | 14:56 |
| erlon | @whoami-rajat if you can add it to your personal list as well, Id appreciated | 14:57 |
| erlon | but other eyes are also welcomed | 14:57 |
| jbernard | ok, will do | 14:59 |
| jbernard | lutimura has added some review requests too, ill move those to the other pad too | 14:59 |
| jbernard | we're at time, last call for things | 15:00 |
| raghavendrat | In Dalmatian zuul is failing. Mainly the test cinder-grenade-mn-sub-volbak (voting) is failing. | 15:00 |
| raghavendrat | Brian had a look & suggested that, it could be setuptools problem. | 15:00 |
| raghavendrat | It would be great if i can get any additional pointers to resolve this. Thanks | 15:00 |
| agalica | Zuul has been having issues for 2 weeks now - lots of timeouts and stuff | 15:00 |
| raghavendrat | backport: https://review.opendev.org/c/openstack/cinder/+/964558 | 15:01 |
| raghavendrat | Error traceback: | 15:01 |
| raghavendrat | AttributeError: module 'setuptools.build_meta' has no attribute 'get_requires_for_build_editable'. Did you mean: 'get_requires_for_build_sdist'? | 15:01 |
| rosmaita | i think that was happening in master for a while a few weeks back, but i can't remember if we fixed it or if it was a ubuntu package issue | 15:03 |
| rosmaita | i think it was a packaging thing | 15:03 |
| rosmaita | which makes it perplexing why it is happening in 2024.2 now | 15:03 |
| raghavendrat | ok | 15:04 |
| rosmaita | raghavendrat: it's only on that cinder-grenade-mn-sub-volbak job, is that right? | 15:04 |
| rosmaita | https://zuul.opendev.org/t/openstack/build/45c3350dc5114d2bb0ac32d1a70f1eb5 | 15:04 |
| raghavendrat | other two jobs are failing. but those are non voting | 15:05 |
| raghavendrat | s/jobs/tests/ | 15:05 |
| rosmaita | ok, that reminds me ... Sean put up a patch to remove non-voting jobs from the stable branches, i think we should do that | 15:05 |
| rosmaita | here's the job history: https://zuul.opendev.org/t/openstack/builds?job_name=cinder-grenade-mn-sub-volbak&project=openstack%2Fcinder&branch=stable%2F*&skip=0 | 15:05 |
| rosmaita | (on the stable branches) | 15:06 |
| rosmaita | looks like only stable/2024.2 is having the issue | 15:06 |
| raghavendrat | hhmm | 15:07 |
| rosmaita | the job definition doesn't look different between branches: https://zuul.opendev.org/t/openstack/job/cinder-grenade-mn-sub-volbak | 15:08 |
| jbernard | ok, i think we can wrap, is that cool? | 15:10 |
| rosmaita | the regular grenade job looks OK in stable/2024.2: https://zuul.opendev.org/t/openstack/builds?job_name=grenade&project=openstack%2Fcinder&branch=stable%2F2024.2&skip=0 | 15:10 |
| rosmaita | yeah, i am just thinking out loud here | 15:11 |
| rosmaita | (i thought the meeting was over) | 15:11 |
| opendevreview | Zachary Mark Raines proposed openstack/cinder master: Add 512e/4k disk geometry configuration https://review.opendev.org/c/openstack/cinder/+/658283 | 15:12 |
| raghavendrat | thank you Brian | 15:12 |
| rosmaita | ok, maybe here's something to try: the "regular" job runs on ubuntu jammy | 15:13 |
| rosmaita | https://zuul.opendev.org/t/openstack/job/grenade | 15:13 |
| rosmaita | bummer, looks like the failing job is also running on jammy: https://zuul.opendev.org/t/openstack/build/8aaf5ab45a61491ab1dd74d9d7f571ae/log/job-output.txt#52 | 15:16 |
| jbernard | o, | 15:16 |
| jbernard | #endmeeting | 15:16 |
| opendevmeet | Meeting ended Wed Nov 19 15:16:46 2025 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:16 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/cinder/2025/cinder.2025-11-19-14.03.html | 15:16 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/cinder/2025/cinder.2025-11-19-14.03.txt | 15:16 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/cinder/2025/cinder.2025-11-19-14.03.log.html | 15:16 |
| raghavendrat | ok | 15:17 |
| rosmaita | this is interesting: https://bugs.launchpad.net/tacker/+bug/2118586 | 15:19 |
| Anoop_Shukla | @cardoe: happy to connect on the performance issues you are facing with NVMe.. | 15:20 |
| Anoop_Shukla | Please do ping me, we can discuss. Joined Cinder meeting late so missed the conversation | 15:21 |
| cardoe | Will do had to join another meeting so I'll follow up shortly. | 15:21 |
| raghavendrat | the launchpad link is helpful. can the same be implemented in Dalmatian zuul ? | 15:22 |
| rosmaita | raghavendrat: i will look into that ... what's weird is that it's only happening in that one job, i wonder whether it's a unconstrained pbr issue or something | 15:24 |
| raghavendrat | ok, thanks a lot. appreciate your help | 15:25 |
| hemna | anyone thought about an idea of the ability to deprecate specific volume types and aliasing volume types | 15:41 |
| hemna | we are about to launch a new deployment and create a new volume type for it. the problem is we have lots of customers that have hard coded the existing volume type. | 15:42 |
| hemna | I'd like to be able to deprecate the existing type and add an aliasing from the existing to the new type | 15:42 |
| opendevreview | Merged openstack/cinder master: NetApp ASA r2: Update ASA r2 support matrix https://review.opendev.org/c/openstack/cinder/+/964479 | 15:45 |
| opendevreview | Fernando Ferraz proposed openstack/devstack-plugin-nfs master: [DNM] Test Glance over Cinder/NFS with NFS driver fixes https://review.opendev.org/c/openstack/devstack-plugin-nfs/+/965409 | 16:43 |
| opendevreview | Fernando Ferraz proposed openstack/devstack-plugin-nfs master: [DNM] Test Glance over Cinder/NFS with NFS driver fixes https://review.opendev.org/c/openstack/devstack-plugin-nfs/+/965409 | 16:54 |
| opendevreview | Eric Harney proposed openstack/cinder master: Fix issue with workers = None https://review.opendev.org/c/openstack/cinder/+/959386 | 17:02 |
| opendevreview | Eric Harney proposed openstack/cinder master: Add thread info logging to volume manager for debug purposes https://review.opendev.org/c/openstack/cinder/+/959387 | 17:02 |
| opendevreview | Eric Harney proposed openstack/cinder master: WIP cinder-scheduler threading prototyping https://review.opendev.org/c/openstack/cinder/+/959388 | 17:02 |
| opendevreview | Eric Harney proposed openstack/cinder master: Tests: Add extend_volume to fake driver https://review.opendev.org/c/openstack/cinder/+/963618 | 17:02 |
| opendevreview | Merged openstack/cinder master: Hitachi: support extending volume has snapshot(s) https://review.opendev.org/c/openstack/cinder/+/850830 | 17:50 |
| opendevreview | Hao Wang proposed openstack/cinder master: _process_stack in wsgi disables admin API policy https://review.opendev.org/c/openstack/cinder/+/939154 | 18:02 |
| opendevreview | Max proposed openstack/cinder master: fix: netapp file copy between volumes https://review.opendev.org/c/openstack/cinder/+/967734 | 19:04 |
| opendevreview | Max proposed openstack/cinder master: fix: netapp file copy between volumes https://review.opendev.org/c/openstack/cinder/+/967734 | 19:17 |
| opendevreview | Francesco Pantano proposed openstack/devstack-plugin-ceph master: Separate replicated and erasure coded pool handling in cephadm https://review.opendev.org/c/openstack/devstack-plugin-ceph/+/966014 | 20:19 |
| opendevreview | Zachary Mark Raines proposed openstack/cinder master: Add 512e/4k disk geometry configuration https://review.opendev.org/c/openstack/cinder/+/658283 | 20:20 |
Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!