16:02:18 #startmeeting kolla 16:02:19 Meeting started Wed Nov 23 16:02:18 2016 UTC and is due to finish in 60 minutes. The chair is inc0. Information about MeetBot at http://wiki.debian.org/MeetBot. 16:02:20 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 16:02:22 The meeting name has been set to 'kolla' 16:02:37 #topic woot for kolla - rollcall 16:02:44 w00t everyone!;) 16:02:44 woot 16:02:53 woot 16:03:01 woot 16:03:03 woot 16:03:06 woot 16:03:10 woot 16:03:12 woot and such 16:03:13 nice to see you guys 16:03:13 o/ 16:03:19 woot 16:03:21 o/ 16:03:28 * berendt is only reading, walking to the hotel at the moment, reading on my mobile phone 16:03:32 sdake_: being a rebel with the o/ 16:03:55 hi all 16:03:59 woot :) 16:04:11 #topic announcements 16:04:12 sean-k-mooney o/ is standard openstack greeting 16:04:25 I don't have anything:) 16:04:34 oh, we do have voting gates now 16:04:49 cool 16:04:50 for source builds 16:04:50 and gate is green ;) 16:05:00 Jeffrey4l ++ 16:05:12 any announcements from community? 16:05:21 ya i got something 16:05:25 go ahead 16:05:34 ryan stepping away from kolla project for awhile 16:05:37 who knows how long 16:05:49 :( 16:05:51 in the meantime i'll be handling kolla-kubernetes 16:06:00 ;( 16:06:05 this project is too big to handle solo 16:06:17 i failed at handling kolla-kubernetes in newton - so busy with ansible 16:06:32 lets make it a winner 16:06:40 ;) 16:06:51 woot! 16:06:58 roger 16:06:59 Bad news... :-( 16:07:02 k, let's start with actual meeting:) 16:07:11 we'll talk about k8s later 16:07:16 ya he may come back who knows 16:07:19 #topic gates - state of union 16:07:38 so, thanks to Jeffrey4l and others we have green gates after repo splut 16:07:53 we also have some voting gates, so now we can move forward to make improvements 16:08:19 1 thing is effort to setup docker registry in infra 16:08:45 inc0, what's the progress on that? 16:08:49 https://review.openstack.org/#/c/401003/ https://review.openstack.org/#/c/399221/ 16:09:02 these reviews + some discussions I keep having on infra 16:09:12 cool 16:09:16 I know how to install registry outside docker, but I could use puppet help 16:09:35 so if anyone knows puppet and would like to assist me with this, I'd appreciate it 16:09:49 having registry will allow us to have voting deploy gates 16:10:14 also few other nice things like proper upgrade gates 16:10:28 next item that could be done would be multinode gating 16:10:42 inc0: is there a reason you are installing the registry with puppet and not using the docker container? 16:10:43 kfox1111 already prototyped multinode gate in kolla-k8s, we could do it in kolla too 16:10:47 kolla-ansible* 16:11:00 sean-k-mooney, they don't have running docker 16:11:07 so we'd need to install docker;) arguably harder 16:11:18 inc0: ah ok makes sense 16:11:51 so if someone would like to tackle multinode gating, this is open for volunteers too 16:12:22 next in line would be more scenerios, but that's going to grow 16:12:46 inc0 i did you a favor and cleaned up launchpad for kolla itself 16:12:47 gates are one of biggest painpoints Kolla has today, and one of priorities for release 16:12:57 sdake_, thank you 16:12:58 inc0 recommend blueprints to track that work 16:13:08 inc0: is tempest run in the gates currently? 16:13:08 then people can sign themselves up 16:13:14 sean-k-mooney, nope 16:13:30 sean-k-mooney, i am trying to set tempest up. 16:13:33 np 16:13:46 Jeffrey4l: cool useing the tempest contaienr in kolla? 16:13:51 sean-k-mooney, yep. 16:13:53 rather kolla-ansible 16:13:57 which is where we want the gates 16:14:06 sdake_, we want gates everywhere;0 16:14:18 but build gates are straightforward and not much more we can do there 16:14:23 right 16:14:31 (well, we could use customizations for example) 16:14:43 but ansible needs more immediate gate help 16:14:43 Jeffrey4l: its mising ping which make the scenairo tests fail so that will need to be fixed to make the gates pass when tempest is added 16:16:16 we also need something like puppet scenario 1/2/3, to test more service. 16:16:30 anyway, I'd like to get registry up first, so if anyone would be willing to help me, please speak up now or after meeting 16:17:15 anything else about gates? 16:18:09 need volunteer ;) 16:18:19 need a blueprint 16:18:34 work items in blueprint 16:18:40 need more guy to notice the gate failure and fix it ;) 16:18:41 volunteers sign up for work items 16:18:45 thats how we have always rolled 16:18:51 sdake_, yep. 16:19:29 kk, I'll subit my blueprints after meeting, Jeffrey4l please do it too if you have anything in mind 16:19:37 (also everyone else;)) 16:19:40 moving on 16:19:49 #topic post-repo split cleanups status 16:19:54 #link https://etherpad.openstack.org/p/kolla-repo-split 16:20:06 roger. 16:20:19 let's go from top 16:20:25 1. removal of ansible code -> done 16:20:50 let's mark what is done and what's not 16:20:58 2. fixing gates 16:21:08 can we call it done or still work to be done? 16:21:22 the ansible code is removed but we still need to remove the non ansible code form kolla-ansible correct? 16:21:46 fixing gate is done. 16:21:58 sdake_: yes we will 16:22:05 but we need more gate ;), it is another thing. 16:22:12 sp__ huh? 16:22:13 3. doc split 16:22:13 sean-k-mooney, it seems we already merged docker removal from ansible 16:22:28 docs are very outdated and totally not changed 16:22:32 sdake_: sign up for work 16:22:41 I'd put this as #1 priority 16:22:44 oh right 16:23:04 inc0, we can not maintain two copy of doc. 16:23:16 Jeffrey4l, I'd keep all docs in kolla for now 16:23:27 no reason to add to confusion 16:23:34 so all doc in kolla-ansible should be removed? 16:23:38 inc0: so going forward all docs reside in kolla. for kolla-ansibel and k8s 16:24:00 Jeffrey4l, maybe, that's good discussion to be had, I'll put it into dedicated topic in this meeting 16:24:11 i would leave there and link from kolla to kolla-ansible repo, the same for k8s docs 16:24:26 egonzalez90, agree, and doc root in Kolla 16:24:30 sean-k-mooney, kolla-ansible has its own doc right now. if we keep all docs in kolla, including k8s, we need move that doc 16:24:43 kolla-ansibe/kolla-k8s 16:24:52 but for now we need to change quick start guide to work with repo split 16:25:17 QSG should be single doc tho 16:25:24 it's meant to be simple and easy to follow 16:25:50 anyway, docs -> still to be done and #1 priority 16:26:02 7. bugs and blueprints moved out of kolla 16:26:12 sdake_, you mentioned you took on that right? what's the status? 16:26:38 actually jeffrey4l moved the bugs and coolsvap moved the blueprints 16:26:44 i got them into an orderly state 16:26:52 ok, thank you all then 16:26:53 the blueprints part 16:26:58 so can we mark it as done? 16:27:00 didnt' touch the bugs, done triaging for awhile :) 16:27:04 so bugs...will be harder 16:27:19 as people will keep adding bugs to kolla, and that's ok 16:27:47 another thing is: how we handle the bp after split. is there any better solution expect for register on each project? 16:27:50 as part of triaging we might need to add "moving bugs to appropriate project" part 16:28:09 inc0: sorry to go back to the split but what about the tools directory and kolla python module. im not sure the build code shoudl be duplicated in kolla-ansible 16:28:15 inc0, yep. 16:28:18 project^deliverable :) 16:28:20 Jeffrey4l, well, blueptints for kolla-ansible will mostly be different than kolla 16:28:44 sean-k-mooney, there are tools for kolla and tools for kolla-ansible 16:28:56 blueprints could be decomposed into parts. one for the container to kolla and then one for each deployment type 16:28:58 inc0, yep. just wanna to check whether there is a better solution. it is different, but related. 16:28:59 I can't think of any overlap 16:29:01 liek tools for both 16:29:16 like `implement nova service` 16:29:21 inc0: yes but the tools for anible still have the image build code 16:29:50 Jeffrey4l, that can be "implement nova container" -> kolla "implement nova ansible role" ->k-ansible "implement nova k8s chart" -> k-k8s 16:30:01 sean-k-mooney, why? 16:30:07 I mean 16:30:08 now for gates 16:30:13 but normally, not really 16:30:20 build is totally separate 16:30:33 inc0: well thats my point the repos has that code currently 16:30:45 ahh, so add this to cleanup right? 16:30:48 good catch 16:30:55 I'll make it separate point in etherpad 16:30:56 inc0: i think we should remove it from kolla ansible and just use the code in kolla 16:30:57 kolla-k8s also currently relys on code that is in kolla-ansible for config gen afaik - gut agai i think this is just transitionary. 16:31:05 inc0: cool 16:31:07 *but again 16:31:14 inc0 re bp yep. that works. 16:31:24 portdirect yup transitory 16:31:39 well 16:31:45 not exactly 16:31:49 I mean we want it changed 16:31:54 portdirect, any idea on improving this? 16:31:54 but we don't know how to change it really 16:32:17 #link https://review.openstack.org/#/c/399147/ 16:32:24 Jeffrey4l, ^ 16:32:44 * Jeffrey4l is checking 16:32:56 inc0 you were going to write a spec for seperating the default configs? 16:32:59 not really - I'm open to suggestions - but inc0's just pointed to somthing i'd missed 16:33:09 sdake_, click da lin 16:33:10 k 16:33:29 cool thanks 16:33:32 it's still sceleton, but I'll need more people to chime in 16:33:48 it's important 16:33:52 to be done right 16:34:16 as it will affect upgrades/ansible (which *has to work*) and stable releases 16:34:35 which means if we want to roll with it, it has to be bulletproof 16:34:59 I'd rather keep duplicated configs that break upgrades 16:35:13 yup clearly 16:35:21 ok, bottom line, take a look at spec later and let's kick off this discussion 16:35:24 moving on 16:35:32 #topic documentation after split 16:35:34 inc0: that spec looks logical, I'll look later 16:35:59 So Jeffrey4l moved good topic, we need to decide which docs sits where 16:36:25 my suggestion: root doc, arch docs and stuff like that (also QSG) in kolla and links to kolla-k8s and kolla-ansible from there 16:36:27 fyi, kolla-ansible has doc site right now http://docs.openstack.org/developer/kolla-ansible/ 16:36:55 i tend to think we should hash that out on the mailing list 16:37:01 the docs are a fragile thing 16:37:11 because we dont have a doc writer writing docs 16:37:18 yeah, agree, let's kick off discussion please tho 16:37:41 i think we are going to find more things that are common between k8s and ansible in the future not just docs and configs. 16:37:49 for one, we *need* QSG fixes asap 16:38:04 (especially that it still shows that stable branch needs ansible 1.9) 16:38:09 QSQ? means? 16:38:10 (which is not true for newton) 16:38:17 QSG - quick start guide 16:38:22 roger. 16:38:30 nah qsg has two sets of requirements 16:38:33 if you read the docs :) 16:38:51 we added more thing in QSG, imo. 16:38:54 ansible 2.0 and ansible1.9 16:39:13 https://github.com/openstack/kolla/blob/master/doc/quickstart.rst#install-dependencies 16:39:23 yes, and 1.9 is dependency *for stable branch* 16:39:28 which is no longer true 16:39:37 i see what you mean 16:39:49 iirc there is a ps in review queue fixing this 16:39:50 yup that needs changing 16:39:57 also QSG should use bootstrap-servers 16:40:19 as it's much easier to handle than manual labor 16:40:23 we have this line, should mention stable branch thing in master doc http://docs.openstack.org/developer/kolla/newton 16:40:28 need fix it in stable branch doc. 16:40:58 that's also true, we can just link old docs and keep single versions in master 16:41:13 bottom line, QSG needs love, lots of it, we should rewrite it tbh now 16:41:49 v1k0d3n, also mentioned need to add "hacks to deploy with single interface" 16:41:57 also useful 16:42:00 docs are #1 complaint, #2 complaint, and #3 compliant from operators 16:42:12 inc0: on that i need to extend the kolla-host script to be also able to bootrasp the build host. 16:42:16 sdake_, lol that's true 16:42:18 ah, yes. been playing with this. 16:42:22 inc0: 16:42:36 sean-k-mooney, not really 16:42:39 it's all working 16:42:53 started asking questions about some api strangeness (most likely a config error on my end) with sdake_yesterday, but there were too many convo's going on at that time. 16:43:01 I mean it can download kolla, but that's a bit over the top imho 16:43:14 if someone can help me understand a little better, i can get this firmed up fairly quickly. over teh weekend perhaps 16:43:15 ? 16:43:27 v1k0d3n, sure, after meeting 16:43:33 the kolla-k8s docs are esp bad at the moment; though I think we should discuss that when we get to that part of the meeting? 16:43:40 inc0: well ill submit a blueprint with what i was thinking and we cans discuss 16:43:50 sean-k-mooney, please, thanks 16:44:15 portdirect: sean-k-mooney sdake_ inc0 we are working on adding the pvc to halcyon...which is a big deal. 16:44:29 pvc? 16:44:30 i have two questions about elk 16:44:37 as in volume claim? 16:44:46 if that helps? there is a workaround that kolla-k8s should be aware of...we needed a custom kubernetes-controller to make this work. 16:44:49 ^^ 16:44:50 yes inc0 16:45:09 btw: https://github.com/att-comdev/dockerfiles/tree/master/kube-controller-manager 16:45:12 ok, I think we naturally moved to 16:45:19 #topic kolla-kubernetes topics 16:45:22 not sure if in the future workarounds should be kolla provided? 16:45:29 i think this may actually be a good idea... 16:45:41 to prevent broken items in the future. 16:45:50 (reliance on upstream) 16:46:01 #1 complaint I get from all the folks that want to do kolla-kubernetes dev is "how do I develop the thing" 16:46:10 developer env: we need a common one 16:46:19 and the docs to go with it 16:46:22 halcyon is promising in this space 16:46:27 +1 16:46:30 source of truth halycon and we can doc? 16:46:36 or if someone wants to help...that's fine too 16:46:44 portdirect: you've done a lot to help as well. 16:46:49 v1k0d3n: I'd be up for helping there 16:46:58 let's start with doc 16:47:00 https://launchpad.net/kolla/ocata 16:47:06 woops wrong link :) 16:47:06 and as i've said before...it doesn't have to stay in this repo. if the source of truth is better in kolla-k8s...by all means! 16:47:11 I'd like to have it in gerrit one way or another at some point 16:47:38 https://launchpad.net/kolla-kubernetes/ocata 16:47:43 v1k0d3n, or dedicated "satelite" project in openstack 16:47:50 have a look at ocata 2 (the milestone we are in at present) 16:47:54 logistics can be dealt with 16:47:57 how can we make this happen? 16:48:13 or should say...what can we do to help? 16:48:14 Ok - leading on from sdake's comment - has anyone got a working deve env from kolla-k8s that they have propped up in the last few weeks? 16:48:15 its easy, just follow the openstack workflow 16:48:16 v1k0d3n, 1hr of work really;) creating kolla-halcyon deliverable 16:48:45 the doc is blueprint already. 16:48:47 i think it makes more sense to just link then add a deliverable 16:48:52 v1k0d3n agree 16:48:58 you want halcyon to end up in a dev folder for kolla-k8s? 16:49:04 we want o move fast making a deliverable takes forever 16:49:05 we can make that happen if you want. 16:49:27 that woud be great from my point of view 16:49:33 halcyon is limited to os's that support kube-adm though, right? 16:49:39 v1k0d3n what I'd like is docs in kolla-kubernetes itself that shows how to use halcyon 16:49:43 ok, propose a patch then v1k0d3n please 16:49:44 Fine for dev, but might be a problem longer term for us 16:49:53 to kolla-k8s with halcyon in it, and docs 16:49:54 currently yes, but i was going to submit an update for some of the CoreOS happening currently. 16:49:59 mgiles: ^^^ 16:50:01 my comment 16:50:09 I'm also working on Fedora Atomic support 16:50:19 i think we treat halcyon a an upstream dev environment 16:50:25 rather then somethign we maintain 16:50:38 i think thats a better approach 16:50:40 well, it's going to be critical for our effort 16:50:43 exactly - it just takes the strain of setting up a k8s cluster 16:50:53 portdirect precisely 16:50:58 then people can develop 16:51:02 that unblocks that 16:51:05 ok, I'll shut up now;) I need docs at least 16:51:15 where code lives - we can discuss later 16:51:21 ya 16:51:22 so GOAL 16:51:23 inc0: sounds good 16:51:35 1.0.0 = compute kit based upon spec ryan wrote 16:51:51 its only going to happen with community support 16:51:57 take a look at the blueprints 16:52:01 they are well laid out 16:52:14 sign up for what interests you 16:52:16 it would be nice if the bootstrap-servers command could bootrap for the k8s enviorment too. even if that is just use halcon after installing docker. 16:52:27 sean-k-mooney oen thing at a time bro :) 16:52:33 lets get it working in a dev env first 16:52:46 I'm thinking I should give kubeadm another chance 16:52:46 sdake_: sure thing 16:53:03 duonghq whatever works for you 16:53:16 kube-deploy is much better for me than kubeadm 16:53:37 i'd like to thank jascott1 for helping get the blueprints into a state that make sense 16:53:38 I'm not sure if halcyon does something better 16:53:50 they lead to a logical outcome of 1.0.0 16:53:57 sure 16:54:04 and duonghq helped a bit too :) 16:54:47 duonghq: let's take offline or PM me so we can make it work. 16:54:48 ? 16:55:11 unless we want to talk this now here... 16:55:18 v1k0d3n, sure, it is already working but eat much IOPS 16:55:21 kube-deply meaning? 16:55:25 for folks that are new to openstack 16:55:50 i'll be happy to assist on workflow issues you have 16:55:51 its key to learn the workflow if your a new contrib 16:55:59 v1k0d3n, https://github.com/kubernetes/kube-deploy <- that is, Ryan recommended it for me 16:56:02 that is item #2 of importance 16:56:04 sdake_, there is good doc for that in fact 16:56:12 agree there are good docs 16:56:27 these discussions are exactly why I think we should avoid setting up the k8s cluster becoming part of the kolla-k8s scope (at least at this stage) - as there are so many options with pro's and cons to each of them 16:56:35 if you want help, ask for it 16:56:41 so the issue duonghq is with pvc...which you're going to run into. 16:56:44 portdirect, agree, minus dev env 16:56:52 we want docs for dev env setup 16:56:54 portdirect agree 16:57:03 prod - I wouldn't touch it with 1m pole 16:57:03 right we need a dev env 6 months ago 16:57:04 v1k0d3n, I'll pm you after the meeting 16:57:10 inc0: exactly :) 16:57:11 ok 16:57:20 just one thing to note team... 16:57:22 or 3ft, if SI is hard 16:57:32 im in europe... 16:57:34 that out of the box there are issues with some of the rdb pvcs 16:57:39 #3, sign up for work that interests you 16:57:50 had to go with 1.5.0beta1 16:57:59 we have a solid core team and need to grow it 16:58:04 #4. need reviews 16:58:22 v1k0d3n: I think targetting 1.5 makes sense at this stage, esp with the changes it brings in 16:58:33 so there are some clear dependancies required. just so devs are aware. however you get there...that's fine. we're planning on making this easier for our kolla dev team internal. 16:58:47 oh my... portdirect absolutely. 16:58:57 for instance, dont put any stock in petsets. 16:58:59 so - those are 4 guidelines i'd provide 16:59:09 and we are out of time :) 16:59:09 that would be tragic without a watchful eye. 16:59:15 allright guys, we're out of time 16:59:18 things like that..will burn us 16:59:19 later 16:59:27 thank you all for coming! 16:59:32 thank you 16:59:39 let's move to #openstack-kolla 16:59:43 #endmeeting kolla