16:00:18 #startmeeting kolla 16:00:19 Meeting started Wed Aug 3 16:00:18 2016 UTC and is due to finish in 60 minutes. The chair is sdake. Information about MeetBot at http://wiki.debian.org/MeetBot. 16:00:21 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 16:00:23 The meeting name has been set to 'kolla' 16:00:29 #topic rollcall 16:00:31 0/ 16:00:31 o/ 16:00:33 o/ 16:00:33 hello 16:00:40 ( ˘▽˘)っ♨ 16:00:43 hey 16:00:48 wirehead_ ftw :) 16:00:50 ha wirehead_ 16:00:53 o/ 16:00:56 lets make it harder ;) 16:01:14 No, you are not going to make it harder by taking away my tea. 16:01:16 Hi 16:01:27 o/ 16:01:37 gatoraid is thirst aid 16:02:40 Daviey you here? 16:02:46 #topic announcements 16:02:56 I have one 16:03:00 shoot 16:03:12 We just got access to 132 hardware nodes in osic cluster 16:03:17 literally 10min ago 16:03:18 hot 16:03:28 thats cool 16:03:31 i did see the credentails notification but haven't yet read the email 16:03:33 w00t! 16:03:36 I've sent credentials to sdake and rhallisey, we'll waterfall them from there 16:04:13 because of all the schedule change, we got 4 weeks instead of 3 16:04:14 when waterfalling please use secure email rather then irc - tia :) 16:04:15 which is cool 16:05:00 cool 4 weeks is great 16:05:12 i dont have any specific announcements 16:05:14 let's talk some more about plan later in the meeting 16:05:23 anyone else from community have any? 16:06:07 #topic osic cluster planning 16:06:10 ok 16:06:20 at midcycle we defined a whole slew of test scenarios 16:06:23 inc0_ mind linking those? 16:06:24 so, for anyone not familiar with topic 16:06:29 my bookmarks are busted 16:06:31 sure, 1min 16:06:52 we got 132 hardware nodes, strong ones, 10gig networking everywhere and 12 intel ssds each 16:06:56 256 gig of RAM 16:07:05 so nice plaything 16:07:14 we need to make use of them and test whatever we can test 16:07:31 and then come back to osic board with results and "publications" 16:07:53 publication might be a whitepaper, blog, video, bugs on launchpad 16:08:09 anything that will prove that we used cluster for the betterment of community 16:08:26 publications as in plural? 16:08:35 I thought we agreed on one whitepaper with analysis 16:09:01 sdake, it doesn't have to be anything really 16:09:07 just some public outcome 16:09:17 even blueprints and bugs will be ok 16:09:42 cool - well I think a whitepaper would have the biggest impact in terms of communicating that kolla can actually run at scale 16:09:57 (unless it can't, in which case bugs and blueprints would work:) 16:10:17 yeah 16:10:37 * coolsvap echo 16:10:40 #link https://etherpad.openstack.org/p/kolla-N-midcycle-osic 16:10:46 sup coolsvap 16:10:56 echo the same :) 16:11:01 oh duh on my part 16:11:05 sorry - early here :) 16:11:19 and had a drinking contest lsat night with my wife 16:11:20 she won 16:11:28 so first thing we need is to deploy bare metal 16:11:50 shame sean isn't around 16:12:11 i have been following the work on bifrost and it looks close 16:12:13 I thought OSIC had their own baremetal 16:12:13 any volunteers to lead this topic? 16:12:16 I am not sure if its ready to go or not 16:12:31 britthouser, what I mean is to install base operating system 16:12:35 we have IPMI access 16:12:37 britthouser osic uses bifrost from what i've seen 16:13:07 Ok I'm with you now 16:13:10 pbourke since your fresh off PTO - up for the job? 16:13:37 sure 16:13:41 i can help 16:13:42 we have several options on this front 16:13:47 OSIC uses cobbler it looks like 16:13:51 https://github.com/osic/ref-impl/blob/master/documents/bare_metal_provisioning.md 16:14:01 well, it's not osic per se 16:14:02 britthouser cool - didn't know that 16:14:10 we can use whatever 16:14:21 inc0_ lets hear the options? 16:14:25 this guide is good, I tested it over and over again 16:14:33 we can try our experimental bifrost 16:14:44 Lets keep experiment with bifrost for the last week 16:14:54 fair enough 16:15:05 so we can just follow this guide 16:15:06 use what is known to wok so we can get to the big stuff first. 16:15:13 my personal request 16:15:16 ya britthouser good point 16:15:29 sdake: sean-k-mooney may want to drive it seen as he's done the bifrost work but happy to work with him on it. same timezones also 16:15:32 britthouser as much as Id' like to see bifrost worked out - I think your proposal makes good sense 16:15:37 for anyone who follows this guide, record times and stuff and let me know if guide is lacking in any place 16:15:56 this guide was prepared specifically for hardware we're dealing with 16:16:05 nice 16:16:24 I can help with baremetal stuff between now and Friday. I'm travleing for work next week and probbly wouldn't be available much 16:16:43 ^^ britthouser knows a whole bunch about bare metal deployment 16:16:45 so once we deploy it once, we don't need to repave ideally 16:16:54 all glory to kolla! and her containers 16:17:16 :) 16:17:18 ya we repave the last week to sort out bifrost at scale 16:17:30 sounds good 16:17:32 and give sean the reins (if he is willing) at that point 16:17:51 So me and you pbourke? 16:17:56 britthouser: lets do it 16:18:01 I'll send you creds in a minute 16:18:04 thx 16:18:07 pm with emails plz 16:18:15 ya - i'd like to see sean's work on bifrost not interrupted with setup of osic if possible 16:18:23 unless he wants to be involved 16:19:12 ok, that's it 16:19:14 Jeffrey4l you need creds as well - i'll send those along 16:19:14 from me 16:19:18 I'm here to help 16:19:25 inc0_ I think we a ren't qiet done with this topic 16:19:27 I dealt with this hardware so ping me 16:19:30 who else needs or wants creds? 16:19:32 thanks. 16:19:55 I'll send them over to whole core team 16:20:08 inc0_ sounds good 16:20:14 anyone outside of core team want access? 16:20:24 o/ 16:20:32 we already established you britthouser :) 16:20:37 britthouser, obviously;) pm me with email plz 16:21:10 inc0_ can ou link our etherpad discussion from midcycle? 16:21:30 already did 16:21:37 oh 16:22:02 can you link again - i don't see it in scrollback 16:22:16 i keep short scrollback logs by default 16:22:28 https://etherpad.openstack.org/p/kolla-N-midcycle-osic 16:22:32 thanks Jeffrey4l 16:22:39 can folks open that up 16:23:28 inc0_ line 22 is wrong 16:23:30 I'm guessing the dates have changed? 16:23:41 and lin 1 16:23:59 yes 16:24:05 4 weeks from today 16:24:05 is rally testing useful to kolla? 16:24:18 pbourke i think that could be helpful yes 16:24:27 as a validation after deployment, I'd say yes 16:24:39 and results can be published later 16:24:41 pbourke yes for tests after deployments 16:24:41 so what I'd like to see is usae of cluster as much as possible 16:24:44 all the pretty htmls 16:24:56 guess can also show performance impact of containers(if any) 16:25:10 pbourke that would be hard to show - we would have to compare it to something 16:25:17 and features 16:25:20 and comparisons just end in a shit show 16:25:21 like live migration and stuff 16:25:53 who is doing #3 16:26:05 if your interested, please register yourself ;) 16:26:09 we need test with tempest and rally to generate a full report. 16:26:28 Jeffrey4l there is a tempest integration inside rally 16:26:42 berendt, yep. 16:27:14 I can take 4, if no one take it. :) 16:27:24 berendt you interested in credentials for osic cluster to assist with scale testing 16:28:00 inc0_ what are the proepr dates for line 23 16:28:07 sdake assisting would be fine, but I think I do not have the time to take over whole tests 16:28:37 berendt roger - its up to you - not sure if there was something you would like to validate or not in our 3 week window 16:28:51 sdake, I'll confirm and correct dates 16:29:07 who is taking on line 5? 16:29:09 rather item 5 16:29:22 ceph caching layer 16:29:22 I added "HA tests" to postinstall testing, that is something that is important for my own environment and I am doing a lot of tests there at the moment 16:29:47 berendt if you can help there - that would be fantastic 16:30:00 I can work on 5 or 6 if I'm back from travel by then...just not sure what dates those will fall 16:30:07 berendt people always question our HA - and a definitive answer noe way or another would help us either rprove it works or fix what is busted 16:30:26 britthouser roger - schedule is fluid as are who will be doing the work 16:30:39 berendt, maybe team up with a deployment and test HA as one of the tests after a deplo 16:30:50 britthouser: add your name :) 16:30:53 Jeffrey4l can you take #8 (reconfigure liberty) 16:30:56 and I'll take #9 16:31:09 sdake, np 16:31:09 (after you fixed any bugs found :) 16:31:17 so I propose standing tmux session 16:31:17 on first node 16:31:22 so we don't really need to do this separately 16:31:23 see what i di dthere - you got the hard part :) 16:31:31 rhallisey yes makes sense, but we have to make all services HA ready first. At lease MongoDB is missing at the moment and I think Elasicsearch is also not HA ready at the moment. 16:31:36 tmux + hangouts permanently would be great coop tool 16:31:57 tmux is good 16:31:58 berendt, known gaps can be ommited 16:32:07 inc0_ agree re gaps 16:32:17 so let's figure out deployment node 16:32:27 and use it as a gateway for everyone 16:32:37 berendt if you can take #10 that would rock 16:32:40 also use tmux at all times so we won't step on each other toes 16:32:45 4 and 5 almost the same. may be we can work together rhallisey :D 16:32:51 Jeffrey4l, sure 16:32:56 inc0_ ok, than I volunteer to write down some basic HA tests that should be tested 16:32:59 can any one post the link where task number define 16:33:04 i think Jeffrey4l and I can work together more 16:33:09 this should be #10 16:33:10 berendt, much appreciated 16:33:14 coolsvap, that's cool 16:33:24 let's make use of our global distribution:) 16:33:26 mdnadeem_home: https://etherpad.openstack.org/p/kolla-N-midcycle-osic 16:33:27 and work around the clock 16:33:40 britthouser, thanks 16:33:48 we also need to set the timezone overlap so that we are using it at most 16:33:48 berendt writing down the test cases would be good so they are documented, but can you execute them too, or not enough time? 16:34:07 coolsvap: I'll help you out with 7) if that's cool 16:34:11 I suggest we make leaders based on geo;) 16:34:16 pbourke: sure 16:34:24 sdake I think I can do parts of the tests, but always plan a backup for me 16:34:25 no need to have leaders per geo 16:34:31 we all work well together 16:34:39 inc0_: also need somewhere good to take notes 16:34:42 no leaders just we need to be aware 16:34:44 inc0_: etherpadd too messy? 16:34:51 sdake, by "leaders" I mean someone who will know what's happening and will be person to talk to 16:35:00 And I think my location is perfect for postinstall tests, I am from Europe 16:35:10 berendt, same as pbourke 16:35:37 inc0_ ok that makes sense then 16:35:52 I'll make this section in ehterpad 16:36:01 suggestion: 1. kolla deployment is fast. I think kolla deploy the 100 nodes in 1 hours. so deployment is not a big deal. 16:36:06 inc0_ we have US, EMEA, and APAC 16:36:37 Jeffrey4l one thing we need to do soon is record a list of information we want to capture in each of the test scenarios 16:36:46 we hae part of that on line 55 16:36:48 yes. 16:36:53 but we need more i think 16:37:42 ok I think we have a basic plan in place 16:37:50 lets iterate on the mailing list 16:37:54 inc0_ care to start a thread? 16:37:55 let's use next few days to figure out cooperation model 16:38:03 will do 16:38:36 i'll take on filling out lines 55+ today 16:38:40 with something a little more concrete 16:38:51 ok 16:39:15 britthouser, will you be able to start deployment of stuff today? 16:39:32 I'll help you 16:39:47 mdnadeem_home you will need credentials 16:39:59 I can take part in point 7(upgrade), 16:40:11 Please provide me credential :) 16:40:12 mdnadeem_home can you send your email in a pm inc0_ so he can send you the info? 16:40:29 sdake, sure I will 16:41:31 isn't the US guys has the timezone UTC-x? why u have UTC+x? 16:42:09 I was just trying to figure out that myself @Jeffery4l 16:42:26 ya britthouser was right 16:42:27 ok 16:42:28 cool 16:42:39 well that was fantastic planning - now the tough part - following through :) 16:42:57 given myself and britthouser are on step #1 when exactly can we kick off 16:43:07 pbourke asap 16:43:12 inc0_, sound the horn 16:43:16 pbourke the machines are ready to rock 16:43:23 Do we have any backlog for planing and working? 16:43:40 duonghq you mean for milestone #3? 16:43:49 ok core team should get mail soon on gerrit email addr;) 16:43:58 sdake: I mean this osic 16:44:07 duonghq its in the etherpad 16:44:18 duonghq i've really got to move the agenda along, we are running short on time 16:44:19 duonghq, https://etherpad.openstack.org/p/kolla-N-midcycle-osic 16:44:27 can we discuss further during overflow in #openstack-kolla? 16:44:37 #topic openstack-kolla 16:44:45 #undo 16:44:46 Removing item from minutes: 16:44:47 too many things :) 16:44:47 ha 16:44:56 #topic kolla-kubernetes 16:45:04 ok so 16:45:09 focus is on neutron + nova 16:45:21 https://blueprints.launchpad.net/kolla-kubernetes/+spec/nova-kubernetes 16:45:25 https://blueprints.launchpad.net/kolla-kubernetes/+spec/neutron-kubernetes 16:45:42 sdake, inc0_ I know this etherpad but I need something more details, but I will ask you later 16:45:44 there are work items filled out in the neutron bp 16:45:54 if we have any new contributors that want in pretty much on ground floor development, kolla-kubernetes is the place to contribute 16:46:10 duonghq lets discuss in overflow - that is also logged 16:46:20 I also added bps for other services 16:46:32 I'll start filling out some more of the BP's with concrete places to get started. 16:46:34 for example heat, cinder, ect... 16:46:49 as a new contributor, i think those opportunities would be awesome 16:46:56 srwilkers_ welcome to the party! 16:47:03 and our organization is looking to proof out some concepts with kolla-kubernetes 16:47:05 thanks :D 16:47:17 srwilkers_, https://blueprints.launchpad.net/kolla-kubernetes/+spec/heat-kubernetes 16:47:18 Is there a template to follow when working on these rhallisey? or is it breaking new ground? 16:47:20 that's a goo dplace to start 16:47:30 thanks rhallisey 16:47:38 srwilkers_ rhallisey is unofficially leading the kolla-kubernetes effort 16:47:39 britthouser, you can follow the existing work in place 16:47:57 so mariadb, glance, keystone, ect... 16:48:01 rhallisey you can either ping him for ideas for getting ramped up or any of the other kolla-kubernetes devs 16:48:02 ok thx rhallisey 16:48:04 srwilkers_, we'll be preparing demos during next couple of days if you're interested 16:48:09 rather srwilkers_ ^^ 16:48:18 the only piece that's not in place is the ansible orchestration on the front end 16:48:23 but don't worry about that yet 16:48:25 absolutely :D 16:48:26 Oh, so we closed the general openstack-services blueprint. Because things are mostly there and behaving. 16:48:48 wirehead_ ya its typical to close a blueprint once its finished 16:48:57 wirehead_ if something needs fine tuning another blueprint can be opened 16:49:13 Okay, that's how it should work. I was going to say that maybe we should do exactly that. :) 16:49:24 to reiterate, new contributors I'd recommend picking a service in here: https://blueprints.launchpad.net/kolla-kubernetes 16:49:33 and ask questions in #openstack-kolla 16:49:46 great, thanks 16:50:14 ok all set sdake 16:50:22 cool 16:50:25 srwilkers_, welcome :) 16:50:47 in terms of work items, i see we are in need of some neutron work - but some work there has merged 16:50:55 rhallisey, Can you please assign this bp to me https://blueprints.launchpad.net/kolla-kubernetes/+spec/rabbitmq-kubernetes 16:51:12 mdnadeem_home, sure 16:51:21 rhallisey, Thanks 16:51:37 mdnadeem_home one quick note - i think it makes sense tot set a short deadline on the basic services to unblock others 16:51:41 is 1 week doable for you? 16:52:00 sdake, yup, I ll try 16:52:14 obligatory yoda quote inserted here :) 16:52:38 sdake: :) 16:52:40 ok anything else from kolla-kubernetes cats? 16:52:41 Do we have any deadline on *-kubernetes? 16:52:58 duonghq compute kit in 1-4 weeks 16:53:02 no so much a deadline, but that we'd like to have a demo son 16:53:04 soon* 16:53:16 thank sdake, rhallisey 16:53:17 like within ~2 weeks ideally 16:53:45 Yeah. And a lot of those services are at least mostly there. Just things like making sure that all of the details of operation are taken care of. 16:54:10 lets move like I type - fast with lots of mistakes 16:54:24 and clean up the mess after we get a working compute kit 16:54:39 cool idea ^^ 16:54:56 wirehead_ thoughts on that approach? 16:55:14 Well, that's mostly how we've been going. 16:55:14 :) 16:55:20 good 16:55:28 sounds good 16:55:38 the code base isn't stable and we don't claim it as such 16:55:59 while its an official deliverable in the governance repo, its on an independent release model 16:56:25 we are expected to release on milestones and whatnot 16:56:57 but not follow the freeze policies we have in place for kolla-ansible 16:57:17 any questions? 16:57:48 #topic open discussion 16:57:52 3 minutes 16:58:07 - apologies planning for osic cluster took so long leaving little time for open discussion 16:58:16 if there is significant discussion needed, we can overflow into #openstack-kolla 16:58:38 +1 16:58:44 o/ 16:59:37 ok then i'll close meeting 16:59:38 thanks everyone for coming 16:59:43 We run out of time, thanks 16:59:46 bye 16:59:46 and contributing to the osic work especially :) 16:59:49 thanks 16:59:57 and a big thank you to osic for loaning us gear 17:00:02 Thank you all 17:00:18 inc0_ if you can send me contact info for who organized that, I'd like to send them a personal thank you 17:00:20 thanks :) 17:00:22 #endmeeting