16:00:44 #startmeeting cinder 16:00:45 Meeting started Wed Feb 27 16:00:44 2019 UTC and is due to finish in 60 minutes. The chair is jungleboyj. Information about MeetBot at http://wiki.debian.org/MeetBot. 16:00:46 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 16:00:48 The meeting name has been set to 'cinder' 16:01:02 Hi 16:01:06 hi 16:01:13 hi 16:01:15 courtesy ping: jungleboyj diablo_rojo, diablo_rojo_phon, rajinir tbarron xyang xyang1 e0ne gouthamr thingee erlon tpsilva ganso patrickeast tommylikehu eharney geguileo smcginnis lhx_ lhx__ aspiers jgriffith moshele hwalsh felipemonteiro lpetrut lseki _alastor_ whoami-rajat yikun rosmaita enriquetaso hemna _hemna 16:01:19 hi! o/ 16:01:23 @! 16:01:23 <_pewp_> jungleboyj \(-_- ) 16:01:24 o/ 16:01:27 hi 16:01:33 o/ 16:01:36 hola! 16:01:37 hi 16:01:46 hi 16:02:13 Agenda: 16:02:17 #link https://etherpad.openstack.org/p/cinder-stein-meetings 16:02:18 o/ 16:02:52 Looks like we have a quorum. So, lets get started 16:03:02 #topic Announcements 16:03:24 So, reminder that Milestone 3 is coming up next week. 16:03:35 #link https://releases.openstack.org/stein/schedule.html 16:04:11 Non-Client Libraries will be released next week. 16:04:24 #link https://review.openstack.org/#/q/project:openstack/os-brick+status:open 16:04:36 Is there anything critical in there that needs review? 16:05:17 Do we want to try to get Avishay's change in? 16:05:36 It seems a little risky this late in the cycle, but wanted to see what others thought. 16:05:42 Need geguileo and hemna to weigh in there. 16:05:47 smcginnis: ++ 16:05:54 o/ 16:05:54 Also wasn't sure about sahid's patch. 16:06:24 smcginnis: I am also cautious of the risks 16:06:38 smcginnis: Yeah, that one isn't clear to me. 16:07:31 Avishay's might be a good one, but it would probably be safer to wait until Train opens so we have the whole cycle to watch for unintended side effects and have time to revert or fix if needed. 16:07:50 smcginnis: ++ That is my feeling as well. 16:07:53 one silly question, which CI jobs are testing os-brick master? 16:08:02 smcginnis, +1 16:08:11 The fix could be backported if necessary. Right? 16:08:12 because if most of them aren't, then we might as well review and merge it 16:08:39 geguileo, so we can react at the time the change breaks? 16:08:47 geguileo: There are jobs on the os-brick repo that run tempest with the latest os-brick from source. Is that what you mean? 16:09:05 smcginnis: no, I meant what Cinder CI jobs run with os-brick master 16:09:12 we have had situations in the past that our CI broke after os-brick landed on pip 16:09:31 because if we don't have many, then the only chance of detecting if things break with os-brick is to merge the patch and release os-brick 16:09:51 We don't have a "*-tips" job like some other projects have been doing. But we do have Cinder tests running against os-brick patches. 16:10:32 geguileo: Yeah, that is a concern. But kind of why I would like to wait for train so there's not a last minute firedrill getting Stein out. 16:10:48 smcginnis: ++ 16:10:52 smcginnis, those tips jobs suppose to run on os-brick/master? 16:11:31 smcginnis: but even if we merge it at the begining of train, it won't get tested in Cinder until we release os-brick in Train, right? 16:11:39 erlon: From the ones I've seen, on other repos they run tempest or some subset of tests, but pull certain dependencies from source rather than latest releases. 16:12:19 geguileo: Right, but we can do that at any point in Train. And even if we wait until Train-1, that gives us ~4 months to identify problems versus ~4 weeks. 16:12:28 smcginnis, hmm, that's what we are doing for os-brick. I think that Cinder should have a few jobs doing that too 16:12:31 smcginnis: that's true 16:12:40 LIBS_FROM_GIT=os-brick 16:12:56 erlon: Oh right. I think we've had this discussion before. :) 16:13:04 erlon: that's not the only change necessary 16:13:27 because CI's are running with a flag to prevent cloning 16:13:28 And as mentioned, we can always backport this once we are comfortable that it doesn't cause issues. 16:13:30 geguileo, why not? 16:13:35 because CI's are running with a flag to prevent cloning 16:13:47 you'll need it to be added to PROJECTS 16:13:59 at least that's what I'm having to do for cinderlib 16:14:19 That matches what whoami-rajat and I saw with an osc -tips job. 16:14:24 oh, wait... maybe for os-brick is different and that's enough 16:14:40 So, I am going to make the safe call that we don't merge this right now and then we can backport after it has had greater runtime. 16:14:45 anyway, I think we should change it so that Cinder jobs always run with os-brick master 16:14:54 geguileo, hmm, I think it works for us becouse we are on zuulv2 16:14:56 http://13.56.179.158/logs/35/639635/1/upstream-solidfire-check/cinder-solidfire-iSCSI/8174736/logs/local.conf.txt.gz 16:14:56 jungleboyj: +1 16:15:09 Given that avishay isn't here arguing for it. :-) 16:15:46 jungleboyj: +1 16:16:00 geguileo, +1 16:16:07 Anything else on os-brick? 16:16:24 geguileo, hemna: You're eyes on https://review.openstack.org/#/c/638639/ might be good, but I don't think that's a release critical thing either. 16:16:33 *your 16:16:47 erlon: I think I was mistaken, iirc the code adds LIBS_FROM_GIT to PROJECTS at some point 16:17:19 Yeah, that one needs to be looked at too. Also, not totally clear exactly what the problem being fixed is. 16:17:30 smcginnis: I'll have a look 16:17:42 Thanks! 16:17:42 smcginnis: but I don't like the idea of using iscsi_id again 16:17:46 Yeah 16:17:56 that broke like crazy in my fault injection tets 16:17:58 tests 16:18:10 :-( 16:19:18 Also want to note that python-cinderclient release is coming up the week after next. 16:19:39 I didn't see much that needed attention there, but wanted to make everyone aware. 16:20:25 Ok. Finally, just a note that I have requested space for a Project Update and an On-Boarding session at the Summit. 16:20:32 So, the usual requests there. 16:20:52 That is all I had for announcements. 16:21:30 #topic Need Topics for the Denver Forum 16:21:41 #link https://etherpad.openstack.org/p/cinder-denver-forum-brainstorming 16:21:56 Forum session selection is coming up soon I think, right? 16:22:32 Yes. I believe I need to submit the topics in the next week. 16:22:39 Let me see if I can find that note. 16:23:04 Yeah, need to submit them by 3/8 16:24:26 I just added the Driver Capability Reporting topic. 16:25:06 Does anyone have other ideas that could use User/Operator input? 16:26:00 Ok. Will make one more call next week and then submit what we have. 16:26:49 Next topic 16:26:59 #New Patches with CGs Support 16:27:06 #topic New Patches with CGs Support 16:27:18 #link https://review.openstack.org/#/c/574119/ 16:27:22 e0ne: 16:27:35 I don't remember what was our decision on this topic 16:28:06 but I don't understand why do we need implement new feature for deprecated API 16:28:19 the question is CGs vs generic groups? 16:28:54 eharney: that patch add CGs support without generic groups support 16:29:02 e0ne, they might be trying to implement that in a old old OS version 16:29:52 it should be easy to add generic groups support on that 16:30:08 what does a driver have to actually do to support generic groups? 16:30:15 Yeah, we said CGs are dead and only work on generic volume groups with consistency should be done. 16:30:15 have to actually do* 16:30:20 but we're going to remove CGs at all 16:30:43 Right. We need to go forward 16:30:48 I thought we had rerouted CG APIs to call the volume group code. 16:30:55 smcginnis: i think this is CGs via generic groups if i'm reading the code right.. 16:30:59 smcginnis: That sounds familiar. 16:30:59 https://review.openstack.org/#/c/574119/10/cinder/volume/drivers/dell_emc/unity/driver.py - line #59 16:31:07 eharney: OK, haven't really looked. 16:31:24 I wonder if xyang is around and remembers. :) 16:31:36 e0ne: so aren't generic groups just a manager operation anyway? 16:32:00 eharney: it has a bit different API 16:32:03 eharney, usually just wrap the CG functions: https://github.com/openstack/cinder/blob/master/cinder/volume/drivers/solidfire.py#L1732 16:32:13 the manager catches NotImplementError and calls _create_group_generic.. 16:33:44 jgriffith, always making reading code fun :) 16:34:08 i'm not a cg expert, but it looks at a glance like the driver is doing the right thing 16:34:41 it just confused me that driver adds CGs support 16:34:53 Oh, I miss reading jgriffith s code. 16:34:53 it adds support for create_group() 16:35:03 Delightfully passive agressive. 16:35:05 not create_consistencygroup() 16:35:11 eharney, yes, it its 16:35:55 eharney: also, it uses 'skip_if_not_cg' decorator 16:35:58 Yeah, so it looks like it is doing the right thing. 16:36:10 e0ne: right, because if it's not a CG, the driver doesn't have anything to do... 16:36:19 They have the driver history explaining it that way too. 16:36:23 though they should handle cases where the group being created is not 'consistent' 16:36:37 erlon: they are handled 16:37:00 eharney, ow, in the decorator, missed that 16:37:06 ok, looks like the patch is valid 16:37:25 :-) 16:38:05 e0ne: Good to move on then? 16:38:10 jungleboyj: yes, thanks 16:38:20 e0ne: Welcome. 16:38:38 #topic release from stable/pike-> make it 11.2.0 ? 16:38:43 rosmaita: 16:38:47 hello 16:38:52 @! 16:38:53 <_pewp_> jungleboyj \( ・_・) 16:39:05 we are about 65 or so commits behind on stable/pike cinder release 16:39:25 some stuff has crept in, tony wants to make it 11.2.0 instead of 11.1.x 16:39:39 Yikes. That was a lot of commits. 16:39:52 looks like all the questionable changes (new config opts, mainly) have release notes already 16:39:56 * jungleboyj is glad that rosmaita it helping us keep up with that. 16:40:22 so, need some stable cores to take a quick look and let me know whether we want to revert some stuff, or jsut release as 11.2.0 16:40:34 rosmaita: Why do those require a version bump like that if they aren't braking existing functionality? 16:41:00 * rosmaita thinking 16:41:02 We are adding config options that sometime change behavior. Plus there were some requirements changes that maybe shouldn't have been allowed. 16:41:17 i also think maybe 2 opts changed default values? 16:41:27 Yeah 16:41:51 #link https://review.openstack.org/#/c/636401/ 16:41:58 see tony's comment at the bottom 16:42:00 one driver started requiring "fallocate" which is sort of a requirements change 16:42:13 Yeah, I just read that. 16:42:31 Ok. 16:42:45 Well, I think it would be a bigger mess to try and revert things. 16:42:51 i agree! 16:42:55 I am ok with bumping to 11.2.0 16:42:58 there's no reason to revert any of this that i see, just ship it as 11.2.0 16:43:20 ok, i will update the release patch 16:43:35 eharney: +1 16:44:00 rosmaita: Thank you. 16:44:31 We bump the major release with each development cycle so it doesn't really impact anything. 16:45:05 So, lets move on. 16:45:08 And that will better communicate to downstream consumers that there are more than just simple bugfixes included so they should pay attention to release notes. 16:45:19 #topic Cinderlib status update 16:45:21 geguileo: 16:45:25 rosmaita: Commit message 16:45:32 quick update on cinderlib 16:45:33 :) 16:45:41 ;) 16:45:45 we now have the cinderlib project as openstack/cinderlib 16:45:52 We are back to regular updates from geguileo :-) 16:45:54 and governance added it under the Cinder team 16:46:06 there is a patch ready for review to add CI jobs 16:46:18 https://review.openstack.org/#/c/638442/ 16:46:40 ananother to add it to devstack 16:46:41 https://review.openstack.org/#/c/638392/ 16:46:53 the patchsets show a lot of struggle. 16:47:11 whoami-rajat: yeah, the ceph job was a pita 16:47:24 because it required the ceph-common library 16:47:30 that install pythong-six from rpm 16:47:47 but the gate installs tox from pypi, which bring six from pypi 16:47:55 * smcginnis is happy not to be the only one that typos pythong 16:48:05 rofl 16:48:15 pythong is my favorite version of python 16:48:16 :) 16:48:25 and the system python site-package got into a weird state 16:48:48 there's also the patch for devstack-gate, but that one won't pass for the time being 16:48:52 https://review.openstack.org/#/c/639614/ 16:49:12 and we have the first real patch for cinderlib, by courtesy of hemna !!!! 16:49:31 :P 16:49:33 so the struggle was real. glad it finally passed. 16:49:35 Yay! Good to have hemna back! 16:49:51 :) it's good to be back 16:49:55 once the devstack code merges I'll add cinderlib functional tests to Cinder LVM and Ceph jobs as well 16:49:57 * jungleboyj waves goodbye to the struggle bus 16:50:05 that's the update 16:50:41 oh, and once the CI jobs are merged 16:50:42 geguileo: Sounds good. Thank you for being patient and working to move this to its own project. 16:51:22 So, the final topic. 16:51:28 jungleboyj: thank you all for steering this into the right direction 16:51:38 #topic Feature Freeze Doubts 16:51:45 whoami-rajat: 16:52:11 So, untyped volume spec should go into Train. 16:52:21 Too late for that to go into Stein. 16:52:52 We should also take a look and see if there are other Specs that merged but don't have associated code merged. 16:53:23 As for the api-ref automation .... 16:53:25 jungleboyj: ok. The code also won't be ready by the freeze time so good for me :D Thanks 16:53:26 Hmmm, 16:53:58 I think those are still ok to merge until RC unless anyone disagrees. 16:54:15 ++ 16:54:25 +1 16:54:51 yikun: Staying up late again I see. :) 16:55:01 :) 16:55:09 :-) 16:55:22 😴 16:55:32 jungleboyj: so can still work on the api-ref responses after freeze ? right? 16:55:52 Correct. Have a few more weeks until we hit the RC point. 16:56:24 jungleboyj: ok. Thanks for the clarifying my doubts. :) 16:56:32 whoami-rajat: No problem. 16:56:52 whoami-rajat: Happy to help new people learn the process. 16:57:02 It is a good thing. 16:57:10 #topic Open Discussion 16:57:23 Anything else we need to talk about or can we end on time for once? :-) 16:58:01 i found that a bunch of CI jobs are running too many tempest scenarios, trying to get those nice and cleaned up 16:58:13 should improve failure rate for ceph and lio-barbican 16:58:15 just an fyi 16:58:32 eharney: Nice. Would like to see those failing less often! 16:59:10 Lets wrap up then. 16:59:23 One last reminder to please give input to the Forum planning. 16:59:37 Thank you for taking time to attend the meeting and to work on Cinder 16:59:44 Have a great week everyone. 16:59:50 jungleboyj: Thanks! 16:59:52 #endmeeting