15:00:02 #startmeeting puppet-openstack 15:00:03 Meeting started Tue Apr 28 15:00:02 2015 UTC and is due to finish in 60 minutes. The chair is EmilienM. Information about MeetBot at http://wiki.debian.org/MeetBot. 15:00:04 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 15:00:06 The meeting name has been set to 'puppet_openstack' 15:00:10 #link https://etherpad.openstack.org/p/puppet-openstack-weekly-meeting-20150428 15:00:23 #topic Review past action items 15:00:38 gchamoul: o/ 15:00:45 hello 15:00:48 o/ 15:00:48 so you send a patch in https://review.openstack.org/106144 about Neutron/Linuxbridge 15:01:00 EmilienM: yes! 15:01:00 o/ 15:01:03 thanks for that; I'll let people to have a look :-) 15:01:23 not finished, I got some remarks from Lukas ... 15:01:30 gchamoul: ok 15:01:32 about deprecation/backport policy, I created https://etherpad.openstack.org/p/puppet-openstack-master-policy 15:01:49 and last action so far, we fixed https://bugs.launchpad.net/puppet-ceilometer/+bug/1446375 15:01:49 Launchpad bug 1446375 in puppet-designate "Default MySQL collate parameter is not the one from db_sync" [Critical,New] 15:01:58 #topic CI 15:02:08 sbadia: o/ can we have Puppet 4.0 status? 15:02:15 #link https://docs.google.com/spreadsheets/d/1i2z5QyvukHCWU_JjkWrTpn-PexPBnt3bWPlQfiDGsj8/edit#gid=0 15:02:46 EmilienM: as said in my email, it remain only nova, neutron and swift 15:02:56 the big part :) 15:02:58 sbadia: w00t, awesome ! Thanks for this work 15:03:03 but it's in progress 15:03:05 sbadia: do you have blockers, need some help ? 15:03:12 np :-) 15:03:18 for the moment it's ok 15:03:23 Hunner: can you make sure to have a look at the patches and -1/+1 them ? 15:03:28 +1 on this spreadsheet 15:03:45 mfisch: I thought it would help :) 15:03:56 Sure 15:04:05 Hunner, sbadia: thx guys 15:04:10 Beaker status: 15:04:18 I'm moving forward to support all modules 15:04:19 Hunner: thx! 15:04:24 preparing centos support: https://review.openstack.org/175434 15:04:29 #link https://review.openstack.org/175434 15:04:53 mmagr is proposing https://review.openstack.org/#/c/178134 - I'll let crinkle and nibalizer dropping a quick general comment/review on this one, to make sure we agree with that 15:05:24 TripleO/Puppet CI status 15:05:34 we are gating more modules now (ceilometer, glance, keystone, nova, neutron, swift, openstacklib, heat, cinder) 15:06:00 jobs are non-voting, but I would ask reviewers to consider the job important 15:06:16 if it's red, it really means something (except if TripleO CI is broken) 15:06:49 same thing for beaker. crinkle proposed we don't put the jobs as voting for now, but I still ask for people to keep an eye at the job status 15:07:24 also, we are facing too much rubygems downtime issues so I proposed to create a mirror in OpenStack infra 15:07:35 #link https://review.openstack.org/#/c/178026/ 15:07:47 anything else on CI? Someone? 15:07:59 EmilienM: I'm looking forward for ideas regarding that rubygems mirror 15:08:08 EmilienM: existing solutions aren't great 15:08:30 Don't the tripleo infra guys already have a ruby mirror? 15:08:32 EmilienM: they often require to mirror the whole damn site 15:08:34 mgagne: my solution you mean? 15:08:41 EmilienM: any 15:08:58 mgagne: well, if our mirror is more stable that public server, isn't it our solution? 15:09:06 vinsh: not AFIK 15:09:10 EmilienM: I guess you didn't read my comment 15:09:15 mgagne: not yet, sorry 15:09:57 mgagne: which one? 15:10:03 EmilienM: mirroring often require to mirror ALL gems and all their versions which consumes a LOT of space 15:10:31 clayton: what are we doing for mirrors here? 15:10:40 mgagne: what would you suggest? 15:10:41 BTW, what does the tripleo-ci do for puppet anyway? 15:10:53 we should mirror rubygems, but we don't. I've looked into it, but the tools suck, and for our use, we'd need to version them also 15:10:58 EmilienM: I suggest nothing except that I'm curious how we will find a solution to this challenge 15:11:07 vinsh: https://wiki.openstack.org/wiki/TripleOPuppetCI 15:11:11 EmilienM: what clayton said 15:11:20 Yeah, I don't know of an automated way to mirror only some of rubygems :/. We have a tool that can push bundles of gems up to our mirror at PL, but it's manual 15:11:28 clayton, mgagne: I'm working on this, feel free to bring your thoughts on Gerrit patch 15:11:30 It might be easier to build a limited rubygems mirror that only has the gems we'd need 15:11:39 clayton: yep 15:11:47 clayton: why not using squid instead 15:11:51 Hunner: you could probably build them locally using bundler then shove them into a local index 15:11:53 mgagne: +1 15:12:04 Using https://github.com/copiousfreetime/stickler 15:12:21 squid might work, you'd have to be careful about how to handle refreshing the cache 15:12:34 clayton: True, though it would be hard to track specific versions 15:12:45 (for the bundler ideo) 15:12:52 I don't think rubygems has nearly as big of a problem as pypi does with gems disappearing 15:12:54 unless we always need the latest and greatest version of gems, I don't see it as a problem 15:13:43 anyway, lets move on. my point was: I'm curious 15:14:14 mgagne: this is a good discussion, let's continue offline with Hunner & clayton (ML or whatever) 15:14:23 one last thing, last time I looked, rubygems mirror size on disk space I believe was a lot smaller than pypi 15:14:40 but that's just my recollection, not an authoritative statement 15:14:53 clayton: omg 15:14:57 clayton: this is what I've seen last night too. 15:15:02 I created a mirror on my laptop 15:15:19 ok, let's move on and keep the topic on track 15:15:19 alright, if rubygems < pypi, forget what I said :D 15:15:30 mgagne: istr like 10-20GB vs >100G 15:15:40 mgagne, clayton : are we done? 15:15:52 yeap, sorry :) 15:15:56 go 15:15:57 np :) 15:15:58 #topic Master policy 15:16:05 #link https://etherpad.openstack.org/p/puppet-openstack-master-policy 15:16:20 mgagne, mfisch, clayton o/ 15:16:32 EmilienM: what is the status on the tool for doing backports? 15:16:44 spredzy_ knows 15:16:52 the patch is under review and making progress 15:17:07 good progress then 15:17:11 #link https://review.openstack.org/175849 15:17:41 mgagne, mfisch, clayton: I would like a consensus (maybe we can discuss it during the summit) about what we do *now* with ongoing work/patches 15:17:45 need to ping openstack-infra guy to find out how to test in in close-to-real conditions 15:17:46 here is my statement: master is targeted to next release and always has been. blocking development (and reverting stuff) because someone thought it was targeted at previous stable version is wrong. 15:17:52 As I mentioned before, I don't think we're going to completely solve this before kilo release. I'd like to avoid making config changes solely to avoid deprecations for the time being, but it seems like it makes sense to make breaking changes for kilo when needd 15:17:54 the question is: are we breaking juno support in master ? 15:18:13 EmilienM: I still don't understand how we ended up with this situation 15:18:18 yes what clayton said 15:18:28 (sorry /me is also doing prod system recabling this morning) 15:18:33 I'd like to discuss this in person at the summit and explore the options more, and then we can summarize back to the list what options are brought up 15:18:35 mgagne: which situation? 15:18:44 EmilienM: reverting stuff in master to support juno 15:18:59 what I propose is: we break master for Juno, but we work during Liberty on our provider to offer more flexibility for Kilo/Liberty 15:19:07 mgagne: well... 15:19:21 mgagne: we will Revert: Revert: XX :( 15:19:46 clayton, mgagne, mfisch: what do you think about that solution? 15:19:52 I believe the only revert was to specifically remove a change that broke juno for a deprecation. I think that's a grey area 15:20:29 clayton: it's not. it creates a precedent 15:20:40 not sure how to translate that in englih 15:20:43 english* 15:20:54 it sets a precedent, there 15:20:55 precedent is right 15:21:27 I still dont like the change that went in, its not like if you didnt have it you cant run Kilo 15:21:29 I'd prefer to avoid making changes to the master branch that break juno solely to avoid deprecation warnings, at least for this release. If that sets a precdent, then I'm fine with it. 15:21:45 we're all speaking about theory here but that change could have waited, thats the reality of that change, not a good trade-off 15:21:52 if other people disagree and I lose that argument, then I'll live with that also 15:22:28 There are technical solutions that people can use to still support juno with master branch. 15:23:25 mgagne: like? backports? 15:23:28 mgagne: yeap, and we've done that also. I'd like to discuss at some point whether or not that's something we should integrate. My primary concern here isn't about whether or not we stay on master or not, but if there is anything we can to do make upgrades go more smoothly. 15:23:51 EmilienM: https://github.com/michaeltchapman/puppet-openstacklib/blob/master/manifests/compat/nova.pp 15:23:56 mgagne: +1 15:24:07 clayton: are you doing the same thing for OpenStack code (nova, etc) ? 15:24:20 clayton: sure but lets not influence evolution of master because someone is using it to run/install juno 15:24:39 That's the sort of thing that we'd be very comfortable contributing to, if there was interest 15:25:00 clayton: if not, why doing that for Puppet ? 15:25:29 EmilienM: we're actually exploring doing that for core services also, that's why we're looking to move away from packages entirely. 15:25:48 we'd like to be able to have juno and kilo services installed on the same node, and switch between them easily to make upgrades faster. 15:25:48 clayton: if we wish to support previous stable and next in master, so be it. But I'm against reverting stuff until a clear solution is found. master was never (officially) meant to be used that way 15:26:12 clayton: I wish that too and I'm looking forward to it 15:26:29 mgagne: personaly that's what I'd like in an ideal world, but I'm not seriously suggesting it at this point. I'd like to talk through what would actually be needed to even do that. 15:27:21 mgagne: fair enough, your statement is true but it seems we don't have it written somewhere. That's why I proposed to write a blueprint and find a consensus 15:27:53 we are not really making progress here 15:28:17 EmilienM: I'm fine with sticking with the existing (undocumented?) policy for the master branch. 15:28:30 mfisch, clayton: for what I'm seeing now, is that you are the only ones using master for kilo right now 15:28:36 I can be pedantic in my times and setting a precedent like that one irritates me. Because it looks like we implicitly changed on unwritten policy regarding master 15:28:37 Godaddy is also 15:28:55 in fact, we were following their lead when we did that 15:28:56 our* 15:29:12 godaddy is on vacation still I think 15:29:18 EmilienM: I plan on using master to mean openstack master (or at least kilo) ASAP 15:29:33 EmilienM: that is actually what I'm working on this week 15:29:45 mgagne: I'll write an official blueprint that contains these statements 15:29:50 and people will just vote 15:29:54 I don't have any interest in holding up kilo work on master 15:30:00 me either 15:30:05 if its truly needed 15:30:30 I don't think it's practical to make a decision on what we want master or any other branch to be long term before the summit, but I think the summit would be a good time to talk through some of the possibilities 15:30:56 mgagne: do you have enough bandwidth to initiate the blueprint? 15:31:13 clayton: "initiate", so we can come up with better thoughts 15:31:21 breaking changes to master won't break us, we just won't pull them in until we're working on kilo upgrade 15:31:25 we won't take the decision *before* the summit. 15:31:41 it's happening soon, so we can wait a bit. 15:31:49 are we ok with that ? 15:32:06 +1 15:32:19 mgagne: ? 15:32:35 as long as we don't revert *new* stuff until we have that policy written down 15:32:37 I'm fine 15:32:39 EmilienM: does it mean that any update for Kilo that may break Juno will need to be on hold until the summit? 15:32:51 jpena: the opposite I believe 15:32:53 mgagne: and to initiate the BP ? 15:32:55 jpena: I'm more or less concerned about those use cases 15:33:09 EmilienM: I would be dishonest if I said I had the bandwidth 15:33:17 mgagne: I'll do it then. 15:33:25 i don't think we should avoid reverting things in master 15:33:36 i think it's fine to revert something until we've had more discussion on it 15:33:41 i think tripleo does it all the time 15:33:43 EmilienM: pre-summit month is always the busiest 15:33:49 crinkle: +1 15:34:21 to clarify, master is not intened to be kilo then? 15:34:33 bodepd: hehe 15:34:40 for now, master stays Juno + Kilo 15:34:45 or its just that you want to avoid backwards breaking changes 15:34:52 great. thanks for the clarification 15:35:05 #action EmilienM to initiate a blueprint about Master policy 15:35:19 so, until the summit, we keep Juno working on master 15:35:27 what was wrong with the old policy? 15:35:36 we continue to groom on etherpad/gerrit (when i'll write the blueprint) 15:35:47 (sorry, I know I've been away, but it's hard not to comment on everything :) ) 15:35:50 lol 15:36:19 bodepd: TL;DR, we used to break master for stable releases while people deploying stable with master 15:36:37 bodepd: https://etherpad.openstack.org/p/puppet-openstack-master-policy 15:36:44 oh, maybe I mean the old-old policy then :) 15:37:00 bodepd: we didn't change anything yet 15:37:24 bodepd: this change triggered the discussion: https://review.openstack.org/#/c/173495/ 15:37:42 can we go ahead in the agenda? mgagne, clayton, mfisch, bodepd, are we done for this one? 15:37:48 wfm 15:37:59 yes, sorry Im not able to focus very well atm 15:38:14 #topic project naming 15:38:21 I'd like to make one more comment 15:38:29 bodepd: go ahead. 15:38:52 I rememer a long time ago, we tried not to have any backwards incompat changes in master, and deprecated things across 2 releases 15:39:04 I guess that policy went away, and the question is it things should go back to it? 15:39:06 bodepd: this was for OUR public interface (class parameters) 15:39:16 bodepd: and we are still doing it 15:39:32 bodepd: it's not backwards incompatible changes we're worried about, it's changes that specifically affect how we deploy juno versus kilo, e.g. config parameter names or package names 15:39:33 mgagne: thanks for the clarification 15:39:37 bodepd: true. But in the meantime (you were away), we had new contributors having new use-cases, so we may re-think our way to backport things 15:39:58 thanks 15:39:58 bodepd: we keep this policy for now, don't worry :) 15:40:34 bodepd: do you want to add some thoughts? 15:41:15 seems like not :) 15:41:25 so about naming... 15:41:25 Legal agreement between Puppet and the OpenStack foundation still pending for name "Puppet Modules". There is already consensus agreement, just working out final details. Will update when have more information. (Richard Raseley) 15:41:42 I dont quite parse that 15:41:43 EmilienM: oh great, so we may just keep the name? 15:41:47 does that mean we can use the name? 15:41:48 sorry for people who found crazy names :-P 15:42:05 for now, yes, I'm waiting for final decision (it's not in my hand) 15:42:13 OpenStack foundation <-> Puppetlabs 15:42:32 wow! thanks for both orgs then for being completely reasonable ;) 15:42:44 mfisch: I think "Puppet Modules" will be our project name 15:42:46 (or at least trying) 15:42:50 ok 15:42:59 as long as its not Puppies I'm happy :0 15:43:03 #topic keystone v3 15:43:08 richm: o/ 15:43:22 can we have a status and an idea of your blockers right now ? 15:43:48 Not much progress - working with gildub on getting the base code for the keystone providers 15:44:12 is there anyone in our community willing to help in that work? 15:44:15 I've started on puppet-glance to see what changes are needed - I posted a review for puppet-glance 15:44:22 i can 15:44:32 imcsk8: you're already with richm ;-) 15:44:38 imcsk8 has been working on deploying the patches with packstack 15:44:49 why would that require changes to the core providers? I though it woudl just work with openstackclient? 15:44:52 richm: do you have specific patches that need our attention ? 15:44:55 gildub and I need to nail down the puppet-keystone provider code 15:46:02 bodepd: 1) need to provide the correct --os-identity-api-version and auth url suffix "/v3" 2) the command line arguments and order has changed going from v2 to v3 e.g. service create $name in v2 vs. service create $type --name $name in v3 3) the output is different with v2 vs v3 15:46:33 richm: thanks, that makes sense 15:46:37 EmilienM: no patches need attention yet - I need to work with gildub to produce final "reviewable" patches 15:46:52 richm: did you amend the blueprint? do you need some reviews ? 15:47:12 gildub imcsk8 and I have been meeting every night - we will have a meeting tonight to finalize plans, one way or another 15:47:22 EmilienM: The blueprint is far from complete 15:47:37 The blueprint still needs to have all of the changes required to all of the puppet modules 15:48:20 1) Convert each module to use openstackclient + v3 in the providers 2) convert each module to be able to do server to server keystone auth using the keystone_authconfig configuration for keystonemiddleware 15:48:39 Then there's modules like heat which already use some v3 features 15:49:05 so we are still quite a way from having a reviewable blueprint 15:49:07 right, but in the wrong way (without provider) 15:49:28 EmilienM: right, so heat will need to be converted to use openstackclient 15:49:49 ok 15:49:51 richm: thanks ! 15:49:55 richm: anything else? 15:49:58 not to mention other v3 features such as groups and trusts which so far have been ignored 15:50:28 richm: it's a big work. I'll see what can I do to help 15:50:42 ok - I should know more after our meeting tonight 15:51:06 richm: I'll participate too, thx 15:51:13 richm: can we go ahead ? 15:51:26 yes, please proceed 15:51:36 #topic moving from stackforge to openstack 15:51:39 #link https://review.openstack.org/176326 15:51:56 I'm wondering about the 'when' 15:52:17 any thoughts? 15:52:26 after the summit 15:52:34 EmilienM: is there anything an operator should know/do about this move? 15:52:44 I think so 15:52:54 stackforge will be synced I think 15:52:57 for some time? 15:53:05 stackforge? 15:53:17 stackforge repo will remain a while maybe 15:53:20 the repository is moved, not copied AFAIK 15:53:26 mgagne: not forked? 15:53:30 EmilienM: no 15:53:34 well, os-infra told me all is possible 15:53:46 EmilienM: github redirects on rename 15:53:48 so I agree with crinkle and we should discuss about tha during our summit day 15:54:16 EmilienM: unless people are cloning from git.o.o, there shouldn't be any problem. github will redirect for you 15:54:39 mgagne: yes, but we don't know who pull from git.o.o 15:54:47 EmilienM: or we ask infra to create a symlink from stackforge to openstack on the server 15:54:57 EmilienM: git.o.o that is 15:55:05 https://wiki.openstack.org/wiki/Meetings/InfraTeamMeeting#Upcoming_Project_Renames 15:55:43 mistral is moving right now 15:55:59 but we will wait Vancouver, anyone against this idea? 15:56:23 seems like not 15:56:23 no opinion, we can wait 15:56:32 okay with waiting 15:56:35 #topic Open Discussion, Bug and Review triage 15:56:45 #link https://review.openstack.org/#/c/177037/ 15:56:46 I think we're out of time for triage 15:56:50 from vinsh 15:56:53 I have something quick for open discussion 15:57:00 crinkle: shoot 15:57:12 Yeah, Id just like eyes on that puppet-swift change.. its a big one. But adds a lot of value IMO 15:57:32 today is my last day at puppet labs, i just want to make sure you guys know that Hunner and _morgan are modules people who are around to help out, and RichardRaseley is another point of contact for puppet labs if needed 15:57:53 that is all 15:57:55 crinkle: it's good to know, thanks 15:58:18 thanks crinkle 15:58:36 oh, also i've passed on the puppet forge password to EmilienM and Hunner 15:58:36 anyone else? anything else? 1 minute left :-) 15:58:46 crinkle: thank you very much for the work you have done. It was greatly appreciated! 15:58:52 mgagne: :) 15:59:04 mgagne: well, she's staying on Puppet OpenStack (I hope) :-P 15:59:15 thanks everyone! 15:59:24 i will still be around, i just can't merge things on puppetlabs-rabbitmq anymore :) 15:59:30 lol 15:59:33 spredzy_|afk: sorry ^ 15:59:39 lol, we need those fixes though 16:00:03 if nothing else, I close the meeting. Thanks for your reviews & participations ! 16:00:06 #endmeeting