16:00:03 #startmeeting cinder 16:00:03 Meeting started Wed Mar 20 16:00:03 2019 UTC and is due to finish in 60 minutes. The chair is smcginnis. Information about MeetBot at http://wiki.debian.org/MeetBot. 16:00:05 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 16:00:07 The meeting name has been set to 'cinder' 16:00:09 Hi 16:00:24 Courtesy ping: diablo_rojo, diablo_rojo_phon, rajinir tbarron xyang xyang1 e0ne gouthamr thingee erlon tpsilva ganso patrickeast tommylikehu eharney geguileo smcginnis lhx_ lhx__ aspiers jgriffith moshele hwalsh felipemonteiro lpetrut lseki _alastor_ whoami-rajat yikun rosmaita enriquetaso hemna _hemna 16:00:32 hi! o/ 16:00:34 hi 16:00:35 hi 16:00:37 o/ 16:00:42 o/ 16:00:47 Hi 16:00:48 hi 16:00:57 Jay has some personal business to attend to today, so I'm your guest moderator for today. :) 16:01:09 #link https://etherpad.openstack.org/p/cinder-stein-meetings Agenda 16:01:14 smcginnis: thanks 16:01:22 :( :) 16:02:07 Guess we have a pretty good turnout, so I'll get going. 16:02:11 #topic Announcements 16:02:27 Wanted to make sure folks were aware tomorrow is the RC1 deadline. 16:02:29 #link https://releases.openstack.org/stein/schedule.html 16:02:35 We are getting really close to the end of stein now. 16:02:53 there is also Hard String Freeze deadline 16:03:05 e0ne: Oh, good point. 16:03:14 There are multiple things that come with this deadline. 16:03:35 smcginnis: so my api-ref patches won't merging after it? right? 16:03:59 whoami-rajat: Probably not for stein. 16:04:15 after RC1 master branch will be opened for Train, so any fixes to Stain should be backported to stable/stien 16:04:17 But technically, as soon as we cut RC1 and a stable/stein branch, that makes master Train. 16:04:29 Also if cinder has cycle highlights.. getting those in ASAP. 16:04:48 But we should still be focusing on stein work until the cycle is done. 16:04:55 diablo_rojo_phon: Thanks! 16:05:02 smcginnis: +1 16:05:10 With Jay tied up, I guess I'll try to put together some highlights. 16:05:20 Could use input from others on that though. 16:05:34 smcginnis: thank you for the convenient segue :) 16:05:51 And in advance for the highlights. 16:05:55 smcginnis: I have that on my list. 16:06:06 jungleboyj: Oh, awesome 16:06:11 I will get them done. 16:06:30 diablo_rojo_phon: thanks for thr reminder. 16:06:38 All cores, please mark patches as review-priority +1 or +2 if you think there is anything critical to get in for stein yet. 16:07:15 The Train schedule has also been published. 16:07:18 #link https://releases.openstack.org/train/schedule.html 16:07:32 jungleboyj: if you have any questions myself or other release folks can help. I have a meeting Thursday to start processing all the info so by EOD today would be preferable if possible? 16:08:18 diablo_rojo_phon: ok. Will do. Have done those before. Just need to figure out what to say. 16:08:44 diablo_rojo_phon: I'm thinking those kinds of meetings either need to be held later, or we should move the highlights deadline up to be earlier in train. 16:09:08 smcginnis: I think both :) 16:09:33 smcginnis: ++ 16:09:34 jungleboyj: happy to help if you need me. 16:10:01 diablo_rojo_phon: cool thanks. 16:10:02 I would have pushed the meeting later if I could. It was slated to happen last week. 16:10:12 One more announcement - PTL election for Train is over. Long live the king (of the jungle). 16:10:28 Ha ha. 16:11:01 #topic Generalized filtering fixes 16:11:04 #link https://review.openstack.org/#/c/641717/ 16:11:09 o/ 16:11:24 I wanted to bring this one up because I think we want to get this in stein. 16:11:31 But I've also not been following things as closely. 16:11:37 yeah, we should get it in if we can 16:11:38 So hoping for input from whoami-rajat and eharney 16:12:02 eharney did mark it review-priority +1, so assuming so. So we also need some eyes on it. 16:12:43 eharney: I think there was some question at some point about the correct approach to fix things. Is this where we want it now? 16:12:58 eharney: You didn't +2 it, so wasn't sure if there were still questions. 16:13:19 I've been finding different cases and the ones i tested i've added so far, if anyone faces problems in any command as a non-admin user, they can notify me so i can append into the patch. 16:13:27 smcginnis: it's the right approach -- the tricky part was to review it thoroughly enough to make sure there weren't any unexpected side effects, mostly around knowing that all of the correct checking exists around "all_tenants" for each resource etc 16:13:28 whoami-rajat: I see eharney pointed out a bug it should be linked to. Can we get that updated quick? 16:14:15 smcginnis: sure will do. 16:15:18 OK, I'll try to review later today, but call for help from other cores to check that out. 16:15:42 smcginnis: done 16:15:45 #topic RSD driver follow up 16:15:47 whoami-rajat: THanks 16:15:57 tejdeep: All yours. 16:16:13 I see this was on the agenda last week. Was there some follow up to cover? 16:16:32 #link https://review.openstack.org/621465 16:17:00 tejdeep: You around? 16:17:35 Well, I'll move on since I'm not sure why we're covering new drivers in the meeting at this point anyway. 16:17:42 #topic cinderlib followup 16:18:00 geguileo: You have the floor. 16:18:02 thanks 16:18:09 so this is a follow up of last week patches 16:18:26 there's been some reviews and iterations, but they are still pending 16:18:38 but the most important one is the one that fixes the package 16:18:46 which is currently broken (my bad) 16:19:02 so now I've split the publish to pypi patch in 2 16:19:08 the fix of the package in cinderlib 16:19:18 #link https://review.openstack.org/643542 16:19:36 sorry, that's the pypi job that's now in project-config 16:19:47 this is the one that fixes cinderlib: https://review.openstack.org/643013 16:19:58 it's important to get ^ merged 16:20:15 without it we cannot built tarballs 16:20:18 Added to my review queue. 16:20:23 smcginnis: thanks!!! 16:20:32 hi sorry i lost connection while giving update 16:20:40 and the distros need the tarballs to test their packages for Stein release 16:21:20 Yeah, we've merged most of it, so we should follow through and get it in good shape for stein. 16:21:36 that would be awesome 16:22:17 that's all I had to say 16:22:24 OK, thanks geguileo 16:22:28 #topic RSD driver 16:22:37 tejdeep_: Was there some follow up from last week? 16:23:19 nothing, CI status looks good, just following up on merge status 16:24:21 We're still wrapping up stein for a few more weeks yet. We will be looking at new drivers once we switch focus to train. 16:25:09 #topic Stable release update 16:25:14 rosmaita: OK, on to you. 16:25:19 the last stable releases were mid-February 16:25:27 there hasn't been a lot of activity (except for cinder) 16:25:35 #link https://etherpad.openstack.org/p/cinder-releases-tracking 16:25:45 my idea is to put up release patches next week when things should be kind of quiet after RC-1 and before final RCs 16:25:55 #link https://releases.openstack.org/stein/schedule.html 16:26:05 one thing to keep in mind is that stable/pike is scheduled to go to 'extended maintenance' mode when stein is released 16:26:12 rosmaita: That seems like a good point to do it. 16:26:17 ok, cool 16:26:20 that means we can continue to patch it, but no more releases 16:26:31 there's only 1 change in os-brick stable/pike, and 1 patch with a -2 16:26:41 there are 2 changes in cinder stable/pike, and 1 patch having trouble getting through the gate 16:26:45 I've been meaning to send something out about extended maintenance to make sure teams are ready for that. 16:26:59 someone sent something out 16:27:07 rosmaita: are these the latest stats, i think many rocky backports merged recently. 16:27:39 yes, just looked, there are 10 backports unreleased in rocky 16:27:44 There are several rocky patches queued up if they can get past job failure issues. 16:27:57 for pike, i could hold off on releasing those until just before stein release (week of apr 8) 16:28:07 or could just release next week with the rest, and then do one more if anything new is backported 16:28:09 smcginnis: oh yes, they didn't merge due to the tempest issue 16:28:30 I think a few made it through, but a bunch still pending. 16:28:58 well, i could hold off on cinder stable/rocky, or just do another one after all that stuff merges 16:29:16 rosmaita: smcginnis can we wait until the rocky backports make their way until pike? i saw few important ones. 16:29:37 Probably no reason to hold off. They can always be picked up on the next stable release. 16:29:46 whoami-rajat: so we will have to move fast on stuff going into pike 16:29:49 whoami-rajat: That would be good to backport as far as we can. 16:30:12 We haven't always been good about that unless someone had a specific fix they wanted to get backported. 16:30:22 It would be nice to have a better process around that. 16:30:57 the other thing to keep in mind, is that pike is still "open" ... just won't be able to release from it after stein release april 10 or thereabouts 16:30:58 smcginnis: i can start cherrrypicking for previous stable branches if its ok? 16:31:17 whoami-rajat: Definitely for anything that has merged in a later branch. 16:31:37 smcginnis: ok thanks... 16:31:47 rosmaita: It's not a hard and fast rule on the transition. I think if we need a few extra days to finalize things we can get it. 16:31:49 smcginnis: this was the email about pike extended maintenance: http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003745.html 16:32:11 ok 16:32:29 rosmaita: Oh yeah, I was part of the conversation that led to him sending that. :) 16:33:09 ok, so sounds like stable releases next week ... what about pike? release next week and then again if necessary? 16:33:44 That sounds good. Let's get out what we have, then see if there's anything else we can get backported in time to get a good final release out before EM. 16:34:02 ok, great. that's all from me 16:34:13 Thanks for tracking that rosmaita 16:34:19 np 16:34:29 #topic Issue deploying cinder with gunicorn 16:34:39 whoami-rajat: What? :) 16:34:53 oh 16:35:12 Where is gunicorn used and why do we care are my first thoughts. :] 16:35:35 you are reading my mind 16:35:43 adriant tried deploying cinder with gunicorn but faced an issue, 16:36:17 smcginnis: +1 16:36:34 https://github.com/openstack/cinder/blob/master/cinder/wsgi/wsgi.py#L40 16:36:40 why do we need gunicorn for api? 16:36:46 whoami-rajat: Is there more context to that? Why do we care? 16:37:04 the gunicorn application func required 2 mandatory fields which wasn't present here, 16:37:27 oh just wanted to ask if anyone tried that way, it should be possible to use other servers to deploy cinder right? 16:38:13 Officially we just support running behind a web server like apache or nginx I think. 16:38:43 I would like to say that we support only wsgi servers for API 16:39:41 Looks like gunicorn is a wsgi server 16:39:49 #link https://gunicorn.org/ 16:39:55 yes it is 16:40:24 we currently run on uWSGI IMO 16:40:33 I guess if there's a non-intrusive way that we can make it not blow up with it, but doesn't have an impact on anything else, I'd be fine merging any fix for it. 16:40:51 presumably there would be similar changes in other openstack projects? 16:41:02 But I don't think we should put much time into caring about it unless there's some overall effort to make gunicorn a "standard" deployment method. 16:41:48 eharney: adriant said he would be trying deploying keystone next and check if he face the same error, will follow up with him on that 16:42:06 is gunicorn considered a production server? 16:42:20 smcginnis: agreed, just felt like deployers should have flexibility. 16:42:48 rosmaita: yes. 16:42:50 whoami-rajat: Would be good it it was a cross-project effort. 16:43:46 smcginnis: yes it would be, i will follow up with him regarding other projects too. 16:43:54 smcginnis: I agree. if only cinder supports gunicorn, it makes less sense to me even for stand alone mode 16:44:18 oh keystone is using flask, he said he would be trying glance. my bad. 16:44:23 if we decide to add gunicorn support, we need to have it on CI or it will be broken 16:44:32 We have so many things that need attention right now, so I'd rather we don't put much effort into something like this until it becomes more of a priority for the community. 16:44:43 smcginnis: +1 16:44:47 agree 16:44:49 e0ne: smcginnis ++ 16:45:05 #topic Open floor 16:45:27 Along those lines, another plea for folks to take a look at what we have out there and identify the things that are important to get in for stein. 16:45:31 Time is running out. 16:46:40 https://review.openstack.org/#/c/644818/ i would like to request reviews on this since this maybe the last one of api-ref samples to go in stein. 16:47:25 After the RC tomorrow, we really should only get bugfixes in for any further RCs. Anything that is not a straight bug fix should get attention over the next 24 hours or so if we want it in stein. 16:47:35 what does that patch do exactly? says it adds "tests"? 16:49:08 i guess i don't know how functional tests related to api-ref samples, which i thought were for documentation 16:49:09 I'm wondering now if we should have written up a spec to at least document what that is all doing. 16:49:26 whoami-rajat: Do you have a quick overview of how this all ties in? 16:49:29 how functional tests are related to* 16:50:03 My understanding is, the functional tests capture the API request/response that can then be used for the examples in the api-ref. 16:50:09 if it's only tests, why don't hold on it until Train? 16:50:16 But I'm not sure what the whole process looks like. 16:50:33 Yeah, also not sure it's that big of a priority that we can't just wait until train. 16:50:41 is it only tests? i thought api-ref was used for doc 16:50:43 eharney: smcginnis with new features being added, our api-ref isn't always updated, running these tests will auto generate the responses that are examples in the api-ref guide. 16:51:10 whoami-rajat: Is it a manual process to then have someone take the output from the functional tests and update the api-ref? 16:51:35 eharney: these are tests as it fails the gate when someone tries to manually interfere with the natural responses of api 16:51:40 smcginnis: these are autogenerated 16:52:13 How is the api-ref updated automatically? That's a separate job that's run in gate. 16:52:38 on second thoughts we can hold it since bug fixes are more critical than this one. e0ne 16:53:16 It is trivial enough, since it's just tests and documentation, that we could maybe still backport it later if we decide to. 16:53:24 does stein currently have incorrect api-ref materials? or just that some are missing? 16:53:28 smcginnis: since i'm implementing the base responses currently its not an issue, but for every MV update there will be a separate response, 16:54:16 whoami-rajat: I'm wondering if it might be useful to post something to the ML explaining what the overall process of this is so we at least have something to refer to if someone needs to understand how this is supposed to work. 16:54:17 eharney: there were several mistakes and people were manually updating it with several patches, so gmann proposed to implement it just like nova did to not have human errors in it. 16:54:30 Or maybe better, add something to the cinder contributor docs explaining it. 16:54:54 Oh right, this is following something that Nova already did, right? 16:55:07 smcginnis: sure, i can put up a doc for it. 16:55:19 smcginnis: yes but they haven't clearly documented it. :( 16:55:31 Thanks, I think that would help having something written down. 16:55:52 4 minutes left. Anything else important to cover in the meeting? 16:56:19 is cinderclient done for stein now? 16:56:23 One final plea for folks to look for things that we should make sure we get into stein. 16:56:33 eharney: Yeah, client lib freeze was a couple weeks ago. 16:56:42 did we release it? 16:56:51 4.1.0 16:57:07 4.1.0 was in october..? 16:57:30 *gulp* 16:57:32 well, maybe not, then 16:58:12 pewp - https://github.com/openstack/python-cinderclient/compare/4.1.0...master 16:58:55 Nothing super critical at least. No new features. 16:59:13 We can get what we really need backported and a stable release done once freeze is over. 16:59:15 yeah, nothing huge in there at least, but should we look for a 4.1.1 soonish, or what? 16:59:45 yeah 16:59:59 OK, out of time. 17:00:01 Thanks everyone. 17:00:12 #endmeeting