Wednesday, 2015-06-17

*** sdake has quit IRC00:24
*** erkules has quit IRC00:41
*** sdake has joined #kolla00:48
*** sdake_ has joined #kolla00:58
sdake_samyaple arisen yet?01:01
*** sdake has quit IRC01:01
*** tobe has joined #kolla01:05
*** diogogmt has quit IRC01:07
*** jasonsb has joined #kolla01:13
*** bradjones has quit IRC01:21
*** bradjones has joined #kolla01:29
*** bradjones has joined #kolla01:29
*** jasonsb has quit IRC01:29
*** loth has quit IRC01:43
*** diogogmt has joined #kolla01:49
*** jtriley has joined #kolla01:52
*** jtriley has quit IRC01:57
*** dims has quit IRC02:04
*** dims has joined #kolla02:08
*** bmace has quit IRC02:08
*** dims has quit IRC02:19
*** bmace has joined #kolla02:20
sdake_samyaple did you make it up yet :)02:43
sdake_its almost 8pm and i need to hit the rack early today :)02:43
*** sdake_ is now known as sdake03:00
SamYaplei am here sdake03:13
sdakeyay :)03:13
sdakedid you see spec suggestions03:14
sdakelooks like we are in the home stretch03:14
SamYaplejust got to work03:14
sdakei see03:14
sdakethat pesky work thing03:14
SamYaplesdake: I dont think CONFIG_STRATEGY_SOURCE_DIR="/opt/kolla/configs/keystone" needs to exist03:19
sdakeok remove then03:19
sdakewe decided against that iirc03:19
rbergeronpesky eork!03:20
rbergeronwork03:20
sdakemore like pesky sdake03:20
rbergeronmayyybe03:20
sdakewhat wa your thinking on the pool idea03:20
sdakesamyaple ^^03:21
sdakejust to be clear :)03:21
SamYaplemy thinking is http://docs.ansible.com/intro_inventory.html03:21
SamYapleyou want to implement pools, go for it03:21
SamYaplethis doesnt stop you03:21
SamYaplewe arent doing it in the project though03:22
SamYaplethats all ansible stuff03:22
SamYapleThe inventory file can literally be a script.03:22
sdakei thin kthe suggestio nwas to implement pools03:23
SamYapleyea. but thats not a kolla suggestion.03:23
SamYaplepools/rack seperation would be implemented by the inventory03:23
SamYapleyou can do all the inventory stuff you want..... with ansiblew03:23
sdakeso whatever managed that file is what would manage the pools03:24
SamYaplecorrect03:24
SamYaplehttp://docs.ansible.com/intro_dynamic_inventory.html03:24
sdakethink that is a valid responseo n the comment03:24
SamYaplethat would probably be what your looking at, you can tie it into external systems as well03:24
rbergeron anything is possi-bull. so says the @ansibull!03:24
sdakelooks like russian to me03:26
sdakeso in essence what britt suggested was a third layer, on top of ansible03:26
sdakewhere the kolla-ansible script is currently03:26
sdakethat creates the inventory files based upon some master config?03:26
sdakei htink we need to be open to the idea of scope expansio nfor the kolla-ansible script03:27
SamYapleim not sure exactly, but we already have groups (keystone runs on all the hosts in the keystone group) so you just need to setup the keystone group with the hosts you want in that group03:27
sdakepossilby with a rewrite in python if it gets more complex03:27
SamYapleyou can build the rack seperation yourself/dynamically03:27
SamYapleI am, but not at the moment03:28
sdakeya long term i mean03:28
SamYaplei want something clean and functional for Liberty03:28
sdakenot initially03:28
SamYaplepast that i have ideas about it myself03:28
sdakewell 100 nodes = 3-4 racks03:28
sdakeI'd like to get to 3-4 rack deploys03:28
SamYaple100 x 2U == minimum 5 racks, more likely 603:29
SamYaple100 nodes is alot03:29
sdakeok well you get the point03:29
sdakewe need some way of managing the racks03:29
sdakesounds like the inventory file is not that thing03:29
sdakeor is a building block for that thing03:30
sdake100 nodes is what i set in my ptl bencmark announcement :)03:30
sdakenumber randomly picked out of my arse :)03:30
sdakeso the abstraction is above the inventory file then?03:31
sdakejust so I am completely clear on what was proposed03:31
sdakebecause britt seemed to indicate it went between kolla-ansible and the ansible files03:32
SamYapleI like 5 "support/control"x 5 storage x 100 computes benchmark03:32
sdakebut to me it seems to go in kolla-ansible directly03:32
SamYapleit needs to be all ansible03:32
SamYaplehas to be03:32
sdakeso how does one implement what britt proposed03:33
SamYaplethe orchastration is just how it arranges the services on the physical host. if you want keystone to run on controller01,03,07 only put those hosts in the keystone group03:33
sdakeand what britt was talking about was making a group of controller01,03,07 and making that a group?03:34
sdakeand having that group in the keystone group?03:34
SamYaplehe was talking about something like CoreOS fleet/kubernetes level of "pools" it appears03:35
SamYapleyou can do that, but thats at a layer even outside of ansible03:35
SamYaplethats all inventory management03:35
SamYaplethats a whole other project in itself03:35
sdakei see us expanding into inventory management down the road03:35
SamYaplewell we kinda already do that with the inventory file. am im cool to expand that, just not now03:36
sdaketo handle the multi-rack case03:36
sdakeya lets keep it simple for l203:36
sdakecould you respond with some kind words on his request03:36
sdakei'm good with doing one step at a time03:37
sdakei prefer that approach03:37
SamYaplei did respond. i said future03:37
sdakei was curious if this was one step or two :)03:37
sdakethere wer etoher parts of the review that need adjustment to meet harmw's standards I think :)03:38
SamYaplejust one03:38
sdakeso britt's request is two steps03:38
sdakenot one03:38
sdakecorrect or incorrect?03:38
SamYaple?03:39
sdakethe ansi-bull says kolla-poluza in SJC :)03:39
sdakehe was asking for something03:40
SamYaplei have no idea what youre asking03:40
sdakeyou pointed me at a bunch of docs which I read but dont understand03:40
sdakewhat is he asking for precisely03:40
SamYaplethats how you handle the inventory files. He can implement what he wants there03:40
sdakean expansion of how inventory files are managed?03:40
SamYaplebasically03:40
SamYaplebut also another layer of kolla somehow tracking the physical environment03:40
SamYaplesomething we have no basis to do (and i dont honestly think is our business to do)03:41
*** jtriley has joined #kolla03:41
sdakewell if we deploy the physical environment shouldn't we track it?03:42
SamYaplein my opinion, no thats is for the operator to do03:42
SamYaplein the longrun, sure we can do that with scope creep03:43
SamYaplebut its all ansible stuff03:43
sdakeok03:43
sdakei just really would like to get to one config file if possible03:43
sdakerather then many03:43
sdakeinventory and globals are two03:44
SamYapleyea thats all. i think that is fine03:44
SamYaplethey are two vastly different files03:44
SamYapletechnically we can merge them but thats by building out our own thing. lets just stick with that03:44
*** jtriley has quit IRC03:46
sdakethe thing i dont like about the invetory file is it has to magically managed in some way03:49
sdakeas in, manually03:49
sdakei'd much rather define an ip range and have the inventory file generated03:49
sdakewe dont need to tackle that in this spec03:49
SamYaplethat is a bad path03:50
SamYapleyou need to manually specify your hosts or build a dynamic way to do it03:50
sdakewell vi invetory.yaml is a bad path03:50
SamYaplethats all ops03:50
SamYaplewrong03:50
sdakeok well it isn't relevant for this spec03:51
SamYapleagreed03:51
sdakewe can argue about that later :)03:51
SamYapleim sure we will :)03:51
openstackgerritSam Yaple proposed stackforge/kolla: Ansible multi-node specification  https://review.openstack.org/18915703:57
SamYaplealright you animals, go tear that patchset up03:57
sdakeharmw beat at it03:58
SamYapleI kid i kid, we are getting there!03:58
bmacelooks good to me.  one quick question.  we could conceptually allow no CONFIG_STRATEGY and have a default behavior.. but we want to force having that i guess so as to follow the law of least surprise.04:04
SamYaplebmace: yea force having it. this needs to be implicit how we are doing it04:05
SamYapleexplicit*04:05
bmaceyup.  i'm good with it :)  explicit decisions force known behaviors.04:05
bmacegreat work guys04:05
bmaceback in a few04:05
sdakelooks good samyaple04:08
SamYaplesdake: you know.... me and you have to pwer right this second to get this commited04:09
SamYapleim just sayin'04:09
sdakeno exceptions :)04:10
sdakebut if the core team doesn't start voting +2, I am going to crank up the pressure :)04:11
sdakeeither that or the core team needs to vote -2 and stop wasting time on trivial changes04:11
sdakethis is precisely why I dont like a spec process04:12
sdaketakes forever to get anything done04:12
sdakethis damn thing coudl have been written already04:13
sdakealthough I think we get a better result with the spec then our original intent04:13
sdakelots of cores nerd rage about the specs process in mature projects04:14
sdakelike nova for exampe04:15
sdake"typo review after the review has been up for 3 weeks"04:15
sdakebunch of nonsense :)04:15
SamYapleyea -1 for trival is no good04:18
sdakeharmw around04:47
sdakeor have you disappeared for the day04:47
digasdake: have you finalised the mid-cycle meetup date ??04:50
sdakediga deadline is the 17th for voting on date04:50
sdakei need few days turnaround from facilities on room scheduling04:51
sdakethen I'll publish the date04:51
sdakes04:51
digaokay04:51
digacan you arrange some sessions for remote attendees through webex, will that be possible ??04:53
sdakeyes04:58
sdakedon't know how well it will work04:58
sdakeso don't blame me if imperfect :)04:58
digaGreat, NP04:59
SamYapleblame has been assigned04:59
SamYaplewell im going to start submitting WIP patches based on the spec as it is05:00
SamYaplei dont htink it will change much05:01
digano, I understand how much difficult to arrange all this stuff05:01
digaatleast I wont have any problem if certain issues comes up05:02
*** Haomeng|2 has quit IRC05:02
*** jasonsb has joined #kolla05:08
*** nihilifer has joined #kolla05:12
nihilifergood morning05:13
SamYaplemorning nihilifer05:14
*** Haomeng has joined #kolla05:15
*** erkules has joined #kolla05:27
*** jtriley has joined #kolla05:30
*** jtriley has quit IRC05:35
*** tobe has quit IRC05:39
sdakehey nih*06:00
sdakenih* would you be intrestesd in adding your tz to our wiki alon with name and irc nick06:00
sdakehttps://wiki.openstack.org/wiki/Kolla06:00
sdakenihilifer^^06:00
*** dasm|afk is now known as dasm06:01
Haomengsdake: ping06:04
SamYaplewhen do we stop worrying about typos and merge?06:04
sdakehaomeng wound me06:04
sdakesamyaple t omorrow06:05
sdakelook at agenda06:05
Haomengsdake: I am new guys for kolla, one question, is kolla called from tripleo to deploy openstack systems, or we can run it standalone to deoploy ironic into via docker images?06:05
Haomengsdake: not sure how to use it to deploy openstack, is there some guide which I did not find?06:06
sdakehaomeng depends when06:06
sdakehttps://github.com/stackforge/kolla/blob/master/docs/dev-quickstart.md06:07
nihilifersdake: yes, sure, I added myself now06:07
sdakethis is panned for liberty-2 (July 31 deadline) https://review.openstack.org/#/c/189157/06:07
Haomengsdake: should I follow section "Starting Kolla" to run kolla?06:08
sdakeplanned06:08
sdakehaomeng warning kolla is single node at the moment06:08
sdakewe are fixing that with the above link06:08
HaomengHaomeng: ok, is there existing doc patch, let me check latest out06:09
*** inc0 has joined #kolla06:09
sdakefeel free to vote on it06:09
inc0good morning06:09
inc0whats up guys?06:09
sdakeinc0 new rev of the ansible-multi spec availble for your voting pleasure06:09
Haomengsdake: ok06:10
Haomengsdake: thk06:10
sdakeironic is not yet containerized, jpeeler started work on that today06:11
Haomengsdake: yes, thanks for your information06:11
Haomengsdake: ironic depends on neutron dhcp agent, not sure if dhcp agent works in container?06:12
sdakeit does, but our neutron agents are fat atm06:12
sdakewhich means single node06:12
sdakethey are being thinified by samyaple06:13
Haomengsdake: yes, neutron is complex06:13
sdakewhat i mean by fat is 4 agents run in one container06:13
sdakewe are changing to run 4 containers 1 per agent06:13
Haomengsdake: yes, good idea, each container run single service, that is easy to control and update/upgrade06:14
sdakea majority of our containers are thin06:14
sdakethe ony ones thare not are neutron and cinder06:14
sdakefor technical reasons06:14
Haomengsdake: yes06:14
sdakebut fixedwith docker .1706:14
Haomengsdake: :)06:14
sdake1.706:14
SamYapleand dokcer 1.7 has zfs06:15
SamYaplewooo06:15
SamYaple"mounting --device recursively" is listed as a bugfix even. its not even a "feature" nice06:16
SamYaplehttps://github.com/docker/docker/blob/f4176020f325869274676b10d9afe8395e5e8fe3/CHANGELOG.md06:16
Haomengone more question, is this "A Kolla Cluster with Heat" depends on magnum?06:16
Haomengsdake: because magnum can deploy container cluster06:17
SamYaplesdake ---- "Experimental feature: support for out-of-process volume plugins"06:17
SamYaplethat is a 'volumes on thier own' thing06:17
SamYapleno more data contaienr06:17
sdakesounds interesting from a performance perspective06:18
sdakeour performance atm sucks06:18
Haomengsdake: ok, just a question, no idea:)06:18
sdakeno doesn't depend on magnum06:19
sdakemagnum and kolla are orthognoal06:19
sdakethis wasn't my origina thinking06:19
Haomengosdake: k06:19
sdakebut my thinkinghas refined over the last 6 months06:19
Haomengsdake: :)06:19
SamYaplesdake: yea bind mounts are fast for a reason06:20
SamYapleits why i use them06:20
*** tobe has joined #kolla06:20
inc0sdake, you mention in section "CONFIG_INSIDE" that it will also do stuff like dbsync or keystone registration06:21
SamYapleinc0: CONFIG_INSIDE will be what we currently do06:21
sdakemaybe this experimental ffeature will provide immutability06:21
sdakeinc0 yes06:21
inc0do we ditch this logic in CONFIG_OUTSIDE06:21
inc0?06:21
SamYaplebasically we just mv start.sh06:21
sdakeinco 006:21
sdakeinc0 yes06:21
inc0ok, hmm... yeah makes sense06:22
inc0I'm thinking how this part will affect tripleo, and I don't think it will too much06:23
inc0so what will remain in kolla? just package installation?06:23
sdakethe effect is a new enviornment variable CONFIG_STRATEGY will hae to be passed to each container06:24
sdakein a tripleo scenario06:24
sdakepackage installation and ansible deployment06:24
sdakeand container build06:24
sdakethe container build will build very similar containers from a start.sh perspective06:25
inc0ok, I guess that's even better than what I thought before06:26
inc0then from tripleo perspective, instead of decoupling config generation and running just that06:26
inc0we'll have to change package installation to container deployment06:27
inc0and *-manage scripts to run docker exec06:27
inc0but06:28
sdakeno you dont hve to do any of that06:28
sdakejust change the env variable and use slower/rhallisey's designed review06:28
sdakefully compatible with tripleo06:28
sdakealthough I believe slagle thinks mode 2/3 is bteter long term for tripleo06:29
inc0I'm in total agreement with thim06:29
inc0him06:29
inc0I'm thinking about tripleo+mode 2/306:29
sdakebut it requires more r&d at the puppet side of things06:29
inc0what will be required from tripleo side to use it06:29
sdaketo decouple config from everything else the puppet scripts do06:30
sdakerhallisey is your go to guy there06:30
inc0I know06:30
inc0but now I'm thinking06:30
SamYapleoh boy06:30
SamYapleyou got him thinking sdake06:30
sdakedangeorus thing there06:30
inc0since container will run an executable06:30
*** bmace has quit IRC06:30
inc0yeah, it hurts a little, so I'll keep this brief06:30
inc0and thats maybe /ust/bin/keystone-all06:31
inc0how do we inject init scripts? like dbsync?06:31
sdakein the ansible case?06:31
inc0between container runtime and running an executable06:31
inc0in any case06:31
sdakegood question - this is the special case I was talkingabout in the spec ;)06:31
inc0so I guess I should finish my reading before thinking too much06:32
inc0off to review I go06:32
SamYaplein the ansible case you can launch the (for example) keystone container and override the entrypoint with a "bootstrap.sh" script (or pass a BOOTSTRAP variable). the cool that about that is you can wait for the cotnainer to exit before proceeding with ansible. so you can be ASSURED the DB has sync'd before proceeding06:35
SamYapleno need for the container to wait/guess/checkin06:35
SamYapleyou can also catch sync errors and exit early06:35
sdakesamyaple06:35
sdakedaneyon has a wall of text in your review06:36
SamYaplenoooo06:36
sdakecan you fix or respond06:36
sdakei know, nothing like waiting 2 weeks to review a spec06:36
* sdake groans06:36
sdakei cut him some slack because he as been in travel hell06:36
SamYapledaneyon: you get no slack from me!06:36
SamYapleI rule with an iron fist06:37
sdakeit would be handy if people hadn't been telling me they would review the spec tomorrow for the last 15 days06:37
sdakebut it is what it is06:37
sdakecan you resolve please06:38
sdakethere is always tomorrow!06:38
SamYapleyea it just requires having the same conversation I had 5 reviews ago and 1-5 weeks ago06:38
SamYapleagain06:38
sdakeyes specs are evil06:39
sdakei really dislike them highly06:39
sdakelet me enumerate the reasons for you06:39
sdakeoh you already know :)06:39
daneyonSamYaple beat me up06:39
daneyonjust trying to understand a few more details.. don;t hate me too much06:40
SamYaplelol daneyon I am not hating on you :)06:40
SamYapleim responding06:40
SamYapleIve just got ~15 patches waiting on this spec06:40
sdakedo like inc0 does, jam em in anyway :)06:41
inc0:D06:41
inc0yeah, I suspect half of HA implementation will land even before spec will get approved06:41
inc0I even started an ha-guide.md in my review!;)06:42
*** bmace has joined #kolla06:42
sdakecome hell or highwater we are approving or vetoing those specs tomorrow06:42
sdakewell maybe not highwater06:43
sdakein arizona, that is a bad thing06:43
sdakethat means the entire earth is flooded :)06:43
inc0and hell is just another slightly hotter day?06:43
sdakeya 115 f tomorrow06:44
* sdake groans06:44
sdakepeople in arizona become decidely less nice during summertime06:44
inc062 fahrenheit today at midday!06:44
inc0I wonder which one is worse06:44
sdaketrade my summer for your summer06:44
sdakei'll keep my winters :)06:44
inc0let me guess, our summer is like your winter?06:45
inc0or your winter is hotter?06:45
sdakefirst06:45
sdakei'm much more productive during winter06:46
sdakemore cigars = more nicoteen = brain works better06:46
inc0I'm not. I mean, depends on winter, but there are days with 0 fahrenheit here06:46
bmacenite all, see you in a few hours :)06:46
inc0its not THAT uncommon either06:46
sdakebmace going to power nap06:46
sdakesdake on the other hand, going ot PTFO06:47
bmacewell, a few is sort of ambiguous.  up to but almost never to exceed 7.06:48
inc0SamYaple, where do you keep Dockerfiles in yaodu?06:48
sdakefew = 3 in my public education :)06:49
sdakebmace obviously went to better schooling :)06:49
harmwsdake: here now06:49
sdakeharmw review specs plz06:49
sdakeor atleast sam's latest06:50
harmwlooked through, but at $work so can't do anything06:50
harmwone question though06:50
harmwabout the template06:50
SamYapleinc0: i generate them06:50
inc0yeah, but I can't find template06:51
inc0that might be my stupidity tho06:51
harmwthe keystone container comes preloaded with /etc/keystone/keystone.conf, will our template file overwrite that file or will it merge with it? (thus keeping all kinds of valid default config bits in place)06:51
SamYapleinc0: its a secret06:51
SamYaplemagic06:51
SamYaplehttps://github.com/SamYaple/yaodu/tree/master/ansible/roles/docker_build/templates/ubuntu/keystone06:51
SamYapleharmw: overwrite06:52
SamYapleim commenting now06:52
inc0hmf, stupidity it is then, thanks:)06:52
harmwSamYaple: that would mean we loose all kinds of valid config bits, right? or we'd need to specify (and maintain) the whole damn thing in our codebase06:53
sdakedaneyon since your burning the midnight oil can you crank out a new spec addressing sam's concerns06:55
sdakeharmw see work items06:55
sdake#506:55
daneyonsdake working it now06:55
sdakethanks daneyon06:55
daneyonyw06:55
SamYapleharmw: nope. all of those "default" configs are generated anyway (except for neutron, they handwrite those lol)06:55
SamYapleharmw: we just need to maintain the bare bones config to get the environment running06:56
harmwofcourse, but that comes with the rpm06:56
SamYaplewhat?06:56
harmwdefault configs06:56
SamYaplethey do not06:57
inc0brb, gonna eat something and then I'll review this spec06:57
SamYaplethey come with the pregened template. you still have to configure it harmw06:57
harmwtrue, true06:58
harmwwill it be different from what we currently coinfigure with crudini? if not, I'm cool06:58
SamYaplehave yo uread the spec?06:59
sdakeharmw see item #506:59
harmwI've read it, ofcourse but perhaps I'm just not getting 'it' yet :)06:59
sdakeharmw and I uote:07:00
sdake5. Implement our existing crudini defaults in Ansible.30607:00
sdakeunder work items07:00
harmwyep, and we'll do that using the template thing described at L19307:00
sdakei didn't write that for my health :)07:00
sdakeright07:00
sdakeevery word in that spec has meaning07:01
sdaketreat it like a phd thesis :)07:01
sdakefor those familiar with reading phd thesis07:01
sdakeforthose not, every word has meaning ;)07:01
harmwhaha07:01
sdakeleave out one word, and it no worky07:01
harmwyep07:02
sdakei guess the correct word is dissertation07:02
sdakespecs = madness07:02
harmwyea sure, as if augmentation wasn't difficuly enough already07:03
sdakethat is something only kolla has07:03
sdakeno other deployment tool has that07:03
SamYapleyoure welcome07:03
SamYapleim the cause of confusion07:03
harmwI think it's clear now though07:04
sdakesamyaple just dont take out my ipman quote07:04
sdakethen i'll -2 the review!07:04
harmwjust.. we now load up containers with rpm packages, stock configs are placed consisting of defaults and such and we change some specific (!) bits and pieces where ever necessary using crudini07:05
sdakecrudini is not used in ansible model07:06
harmwthat will change and ansible will be doing that, using the templates and perhaps augmentation07:06
harmwsdake: 'now' ;)07:06
sdakeright07:06
harmwbut the template is not replacing anything (file level), it's merging with a specific file and in the process updating/adding certain sections and/or keys07:07
harmwthus leaving the packaged bits we don't want/need to change in place, and effectively achieving what we now do with crudini07:08
SamYapleharmw: no07:09
harmwdamn07:09
openstackgerritDaneyon Hansen proposed stackforge/kolla: Spec to Add Support for High Availability  https://review.openstack.org/18198307:12
sdakeharmw its replacement07:12
harmwso a DEFAULT section with 100 keys gets replaced with the DEFAULT section we've specified which consists of 25 keys, is that it?07:14
harmwor is it just replacing those 25 keys?07:14
SamYaplei dont think any default section has 25 keys harmw07:14
SamYaplethe defaults needed to run all of openstack are like 150 options07:14
harmwit's just an example07:14
harmwI want to understand this, since it's not rocket science at all07:15
harmwand I'm obviously stuck at something quite simple/stupid :)07:15
*** jmccarthy has joined #kolla07:17
*** gfidente has joined #kolla07:18
daneyonsdake and SamYaple the HA spec https://review.openstack.org/181983 has been updated. Feel free to whack at it while i sleep ;-)07:18
sdakei'm going to whack something07:19
SamYapledaneyon: yea im reviewing it now07:19
*** jtriley has joined #kolla07:19
*** daneyon has quit IRC07:20
sdakenight all enjoy the evening07:20
*** sdake has quit IRC07:20
*** jtriley has quit IRC07:24
SamYaplesee ya sdake07:26
SamYapleharmw: would you like to discuss the issue further. I am confident I can explain it to you in a satisfactory manner07:26
harmwplease do!07:26
SamYaplewhat do you need to get explained07:26
harmwperhaps I should explain my concern a bit07:27
harmwI've ran into missing config bits while upgrading between major releases once, which happened because I didn't copy the new default configuration file(s) for nova/neutron/whatever07:28
harmwever since, I'm just inserting the default config (which is kept as .orig or whatever) when running minor updates and applying my own specifics on top of those07:28
harmwso the baselevel is always sane07:28
harmwI only have specific bits in my repo and don't need to keep an eye out on all the new keys and values that got added07:29
harmw(eg. I'll happily learn them from release notes)07:29
harmwso, my concern is will the new ansible template model force us to keep a complete configfile in our codebase or will it suffice to just whats realy realy necessary (as is the current case, with crudini)07:30
harmwa complete config file as in a template with replacable parts, ofcourse07:30
SamYapleharmw: a complete config file is what we want to avoid at al lcosts07:33
SamYaple_that_ is what is unmaintainable07:33
harmwBAM07:33
harmw+2 on making that clear :)07:33
SamYapleit will require that we keep uptodate with the latest changes for our default barebones template07:33
SamYaplethis will only change between major versions07:34
harmw(and it's what I was expecting, hency my personal annoyance on where I'm not getting it)07:34
SamYapleso before libirety they wil lneed to be a config cleanup push07:34
harmwyep07:34
SamYapleI have the default configs for kilo ready07:34
SamYapleit took about 3 hours to convert them from my barebones juno configs07:34
harmwyou've got it in your repo already, right?07:37
harmwso I should've just looked at that in detail, since it most probably will answer to my questions07:37
SamYaplenot the kilo changes, i dont push to yaodu anymore07:37
SamYapleit probably would, but im just using it as a template moving forward07:38
harmwkilo, juno, the concept is the same even for grizzly right :)07:38
SamYapleyea but the options differe07:38
harmwofcourse07:38
harmwbut I just want to look at the implementation, so make sure understand what I'm +2ing :)07:38
harmwSamYaple: what happens when you leave out L13 in https://github.com/SamYaple/yaodu/blob/master/ansible/roles/glance/templates/glance-api.conf.j207:42
SamYapleharmw: what?07:43
harmwnvm, I think it's falling into place now07:45
*** athomas has joined #kolla07:56
*** zhiwei has joined #kolla08:08
*** jmccarthy has quit IRC08:10
*** jmccarthy has joined #kolla08:11
openstackgerritSam Yaple proposed stackforge/kolla: WIP - DO NOT MERGE Add initial config function and keystone support  https://review.openstack.org/19254408:12
openstackgerritSam Yaple proposed stackforge/kolla: WIP - DO NOT MERGE Add initial config function and keystone support  https://review.openstack.org/19254408:13
inc0nice job SamYaple, as I understand we'll need to add bootstrap.sh somewhere as well right?08:14
SamYapleinc0: yea08:14
inc0soo...hmm...let's sum it up SamYaple ok?08:50
inc0we'll have ENTRYPOINTs in containers08:50
SamYaplewait08:50
SamYapleim about to push an update08:51
inc0ok08:51
openstackgerritSam Yaple proposed stackforge/kolla: WIP - DO NOT MERGE Add initial config function and keystone support  https://review.openstack.org/19254408:51
SamYaplei added a BOOTSTRAP thing08:52
SamYapleim going to add the ansible component in a few minutes08:52
SamYaplei figure a rough draft will get this spec done sooner08:52
inc0true08:53
inc0I'm thinking of actual solution08:55
inc0how to make it most flexible08:55
inc0so ENTRYPOINT stages.sh08:55
inc0where stages.sh will have this if bootstrap, then exec bootstrap.sh08:55
inc0and we'll provide bootstap.sh in container, deployer will just set up this env right?08:56
inc0or deployer provides bootstrap.sh?08:56
inc0by deployer I mean Ansible or TripleO/Puppet08:56
inc0by us I mean creators of container for keystone for example08:56
*** tobe has quit IRC08:58
*** tobe has joined #kolla08:59
SamYapleit does that now with the review above08:59
SamYapleconfig-inside.sh is exec'd08:59
inc0yeah, now it does, but do we want it to do it as long term?08:59
SamYaplethe bootstrap still need the configs setup, so if its in its own script it will have dup code which is no good09:00
inc0my point is, different configurations might need different bootstrap scripts09:00
inc0for example, if you use PKI tokens in keystone, you need to setup certs09:01
inc0you don't need that with UUID09:01
*** tobe_ has joined #kolla09:01
*** tobe_ has quit IRC09:01
inc0and we want to be config-agnostic09:01
SamYapleyou are wrong. no different strategies need. just the right files in the right space09:01
inc0for configs or alltogether?09:01
SamYaplethe current config-outside.sh is not representative of the flow09:01
*** Slower has quit IRC09:01
inc0yes, what I mean is09:02
inc0we use config outside09:02
inc0and we specify in our outside-config if we want PKI or UUID09:03
inc0then we go to bootsrap.sh09:03
SamYaplebootstrap.sh doesnt need to change in that scenario09:03
inc0and depending on this one option, we'll either have line to setup certs, or not09:03
*** tobe has quit IRC09:03
inc0soo..I'm thinking if deployer should also provide bootstap.sh09:06
inc0instead of us - container creators09:06
*** daneyon has joined #kolla09:09
openstackgerritSam Yaple proposed stackforge/kolla: Ansible multi-node specification  https://review.openstack.org/18915709:10
SamYapleinc0: no staph09:10
SamYaplenone of that needs to happen09:11
SamYaplethe bootstrap.sh thing is really only for the database09:11
*** jmccarthy has quit IRC09:11
SamYapleinc0: https://review.openstack.org/#/c/192544/2..3/docker/centos/binary/keystone/start.sh09:11
SamYapleits not even a seperate script09:12
SamYaplethe config copies for the ssl and things is handled in the config-bind.sh script09:12
SamYaplewith the files in the right location and the appropriate config file there is no need for a user defined script09:12
SamYapleadditionally, user defined scripts are a bad idea09:13
*** Slower has joined #kolla09:13
inc0hold on -config-bind.sh?09:14
*** daneyon has quit IRC09:14
SamYapleconfig-outside.sh09:14
inc0so...in config-inside we'll have to duplicate this logic?09:15
SamYaplewhich logic?09:15
inc0cert stuff for example09:15
SamYapleconfig-inside.sh is all the crudini/self-configuring stuff. How that handles certs I don't know09:16
SamYaplehow that gets certs into the container, i dont know09:16
SamYapleconfig-inside does not use bind09:16
inc0ok, I guess we'll find out soon enough09:17
inc0I'm just curious if we should provide customizable hooks to containers09:17
SamYapleas in?09:17
inc0so people can inject their own scripts in cetain stages09:17
SamYapleno thats bad09:17
inc0why?09:17
SamYapleuser defined scripts are bad09:17
SamYaplesecurity would be the biggest one09:18
inc0that's why we won't support anything more than just hooks09:18
SamYaplewhy poke holes in the security?09:18
inc0real life use case I've been faced with09:18
inc0Designate09:18
SamYaplewhat is this lacking that you need to poke holes to solve?09:18
inc0on bootstrap, I had to add revdns records to database09:18
SamYapleok. why would that not be possible in this method?09:19
inc0how to do this in this method?09:19
SamYapleusing config-inside, i dont know. Using ansible, with ansible09:19
inc0you'd need to hack around ansible09:20
inc0and we don't want that even more09:20
SamYaplewell ansible is the scripting here, hacking would be a hook in the container09:20
inc0but I'd rather keep containers deployer-agnostic09:20
SamYaplethey are.09:20
inc0and since there will be dbsync scripts in containers09:20
inc0why not provide additional places where people can put their logic09:21
inc0I don't think this is security risk09:21
SamYapleif yo ureally want to go down that path, they dont need to be in the container.09:21
inc0because that will require access to repo, which allows you to do anything anyway09:21
SamYapleinc0 i was under the impression triple-o was using config-inside?09:21
inc0but James pointed out that probably won't be long term solution09:22
inc0and I agree that it shouldn't09:22
inc0and I'm talking about everyone else as well, those who will deploy stuff manually09:22
inc0there will be lots of these people09:22
SamYapleok. then the orchastration peice you use should do the insert of revdns records09:22
SamYaplei am strongly opposed to outside shell scripts injected into the container. that is a huge security risk in my opinion09:23
SamYaplea user modified shell script now runs as root. thats bad09:23
inc0and how about creation of /opt/kolla/keystone/post-bootstap.sh09:23
*** tobe has joined #kolla09:23
inc0and that sort of scripts09:23
inc0which initially will be empty09:23
inc0but people can fill them in with their stuff as they please09:24
SamYapleif you are building the containers youself, you can add anything.09:24
inc0yes, and I just want to expose one-and-only-good-place-to-do-this09:24
SamYaplebecause it wont fit everyones use case09:25
SamYapleand if you are building them yourself, do what you want09:25
SamYaplethats what it comes down too09:25
SamYapleif you review https://review.openstack.org/#/c/192544/ again, youll see there isn't even a bootstrap.sh09:26
SamYaplebut if you think no bootstrap logic should be included, i am ok with that. I can do that from ansible09:26
SamYapleyou can do that from puppet or the like09:26
SamYaplethat sounds like what you want09:26
inc0I know SamYaple, that's not my point, anyway, I'll hone this idea and let you guys figure out everything else, maybe it will be there by design09:26
inc0that's what I want, yeah. I just want to provide only good way to do this09:27
SamYapleit would be from the orchastation tool09:27
inc0not "play with start.sh" because that will lead to lots of different, possibly unmaintainable openstacks there09:27
SamYaplenot typing scripts into containers09:27
inc0yeah, before we even build09:28
inc0or to place them in same folder as config in outside-bind method09:28
inc0and just add "exec if this file is present"09:28
inc0to our containers09:28
*** jmccarthy has joined #kolla09:28
SamYapleno outside script support, "a user modified shell script now runs as root. thats bad"09:28
SamYaplei mean thats not law, but ill fight it tooth and nail09:29
inc0if user has access to this folder09:29
inc0he can put configs there09:29
inc0and that itself I suppose should require root access09:29
SamYapleif the user isnt root, he can elevate09:29
SamYaplenope09:29
SamYaplethat would not be required09:30
SamYaplesince hte docker daemon _is_ root it can mount a users folder09:30
openstackgerritPaul Bourke proposed stackforge/kolla: Symlink all non Dockerfile resources in images  https://review.openstack.org/19011709:31
inc0well, ok I rest my case, I'll wait for you guys to finish09:32
openstackgerritPaul Bourke proposed stackforge/kolla: Add base image for oraclelinux  https://review.openstack.org/19101309:33
openstackgerritPaul Bourke proposed stackforge/kolla: Create keystone user in start.sh if it doesn't exist  https://review.openstack.org/19107109:36
inc0pbourke, soo...sources...09:36
pbourkeinc0: yes :)09:37
pbourkeinc0: did you catch the summary I put on the bp?09:37
inc0yeah09:37
inc0thanks for that09:37
inc0I'm generally slightly inclined to git pull stuff09:37
inc0and then pip install -r requirements.txt09:38
inc0pip install -e .09:38
inc0as this provides lots of flexibility09:38
inc0ofc we can tar.gz this, but I think its kinda redundant09:38
pbourkewell, tars can be a good common demoninator?09:39
pbourkeas some will want to use tarballs.openstack.org for example09:39
inc0uhh..why would anyone use this?09:40
pbourkeits faster than git clone09:40
inc0van you generate tarball from specific ref easily?09:40
inc0also, if someone has "their own patched openstack"...and really lot of people do09:41
pbourkenot sure if there's a python task for it... if not tar -cf09:41
inc0so first pull whatever you want, and then tar it and put it somewhere?09:41
inc0and...where? how do we get tar to container?09:42
inc0also....2s build instead of 10s build...is this really an issue?09:42
pbourkethese are just my current thoughts, I need to double check how SamYaple was doing things in yaodu. but, I imagine we either put it somewhere like /tmp that Dockerfile can pick up, or generate it into the same dir as the dockerfile09:43
inc0its just a build, you can do it offline, nightly09:43
pbourkeso the dockerfile has something like ADD /tmp/keystone.tar09:43
inc0SamYaple, is doing tars as I see09:43
pbourkeinc0: wrt the speed, probably not, but might as well support both if it's not too much overhead09:44
inc0but we don't want people to first pull a repo, then tar it, then put it to Docker folder, and deploy container09:44
inc0we want them to git clone kolla, kolla-deploy keystone09:45
inc0and you have keystone09:45
inc0or kolla-deploy keystone --source --repo-url github/... --branch master --commit abc12309:45
pbourkefrom what I gathered from SamYaple the idea is to have a helper script that build will call09:46
pbourkethat does the download or clone+tar09:46
pbourkefor you09:46
inc0how about having source untared inside container09:46
inc0and have helpers in ./build?09:46
inc0or yeah, have helper to download and tar it09:47
*** athomas has quit IRC09:48
SamYaple.buildconf as it currently exists can git clone/download tarball and set it up to be consumed by the dockerfile09:49
SamYaplethis way you can do ref/changes from a review upstream09:49
SamYapleyou cant straight gitclone those09:49
inc0how about local code?09:50
inc0can you point to local stuff?09:50
SamYaplewhat about it? just drop a tarball in the right location then BAM09:50
SamYapleits a script, point it where you will09:50
SamYaple.buildconf is 100% in the builders control09:50
inc0stupid quesiton vol 2: which .buildconf?09:51
SamYaplethe .buildconf in the folder with the container build09:52
*** athomas has joined #kolla09:52
pbourkeBAM09:53
pbourke:)09:53
inc0looking for "one that already exist";)09:54
inc0I think today I overcomplicate stuff09:54
inc0even more than my ususal09:55
inc0usual*09:55
pbourkeinc0: so wrt how we'll split this up. I think we should get a snippet of an example .buildconf on the whiteboard, along with a consuming dockerfile09:56
pbourkeinc0: then we can each take a basic container to add?09:56
pbourkee.g. rabbitmq and keystone09:56
inc0sure, and we focus on centos right now?09:56
pbourkeyes09:57
inc0I don't thing we'll even make rabbitmq source09:57
pbourkeoh, yeah09:57
inc0not for start anyway09:57
pbourkemy mistake09:57
inc0I'll take on heat then, Ala already started keystone09:57
inc0on centos09:58
SamYaplefor testing purposes we might want to start with the core services09:59
SamYaplekeystone/glance/nova/neutron09:59
pbourkeill go with nova then09:59
inc0so I'll go neutron, witness me! (have you seen new mad max?)10:00
pbourkenot yet :)10:00
inc0cool one10:00
pbourkecool, as glance should be fairly straight forward10:00
SamYapleno but i saw a trailer for the FFVII remake10:00
pbourkeshenmue 3 is where it's at10:00
SamYapleso, guys. we should probably wait for keystone source to land, as that will be the template10:01
SamYaplei image debate will happen for it as well10:01
inc0I'll help Ala to get this through asap10:01
pbourkeawesome10:01
inc0and we'll work on this one together10:01
dasmbtw FFVII an Shenmue3 http://www.nerfnow.com/comic/157710:02
dasmand mstachow is very interested in this10:02
pbourkexD10:02
SamYaplemstachow mentioned FFVII yesterday and i didnt know what he meant10:02
SamYaplei got home to unwind and then turned on the internet10:02
inc0now you know?10:02
SamYapleBAM10:02
SamYapleno unwinding for me10:02
dasmxD10:02
inc0BAM indeed10:03
SamYaplei dont console game, but i will get a PS4 for this10:03
SamYaplei still have the FFVII strategy guide im sure10:03
inc0I just hope they'll keep the atmosphere10:04
SamYaplethe new/old music was spot on10:04
inc0but if they won't that will cause riots10:04
SamYaplegave me chills10:04
inc0and heads may roll...literally10:04
pbourkeim holding on for the steam machine10:05
pbourkeif its no good then ps410:05
dasmpbourke: are you planning to buy steam machine?10:06
mstachowI'm so happy because of this :D10:06
pbourkedasm: if the reviews are good10:06
dasmin general, it seems to be just PC + nice outfit for this.10:06
pbourkethere's also the option of standard gaming pc and just getting this steam link and controller10:07
pbourkedecisions!10:07
mstachow25RnZsY65q#10:07
SamYapleif they make it available through steam i will be esstatic10:07
mstachowthat's not happened :O10:07
pbourkemstachow: woops :)10:07
mstachowwoops10:07
dasmmstachow: thx, give also username and bank account to this password10:07
mstachoweh it's good to have one password for one account10:07
dasmpbourke: i have pc + win8 + steam in Big Picture mode + xbox360 controller10:08
dasmand that's all :)10:08
dasmworks (almost) flawless :)10:08
pbourkenice10:08
SamYaplemstachow: http://www.bash.org/?top10:08
dasmSamYaple: ROTFL10:09
mstachowThat's not my day :D10:10
openstackgerritPaul Bourke proposed stackforge/kolla: Symlink all non Dockerfile resources in images  https://review.openstack.org/19011710:13
dasmi like this one10:17
dasm"<erno> hm. I've lost a machine.. literally _lost_. it responds to ping, it works completely, I just can't figure out where in my apartment it is."10:17
*** dims has joined #kolla10:17
dasmit reminds me, when inc0 told us, pretty the same situation in his previous job,.10:17
inc0well, it might have been corp urban myth10:17
SamYaplecheck the packet latency10:17
*** tobe has quit IRC10:17
*** dims has quit IRC10:17
inc0we went through switch configs, find out macs10:17
inc0bound to given port10:17
*** dims has joined #kolla10:18
inc0I mean they, ops from my previous jopb10:18
inc0and they followed cable from this port10:18
dasminc0: nooo.. urban legend? i don't believe in it. everything what you can read in internet, must be true10:18
inc0it ended in the wall10:18
inc0it turns out there was slight refibrushment of server room, and this was old machine without redundant power sources and so on10:19
inc0you know, one which was on for last 5 years, person who set this up was probably dead by then and everyone was afraid to turn this off10:19
inc0that sort of server10:19
inc0so they just leave it between walls...10:19
inc0left*10:21
mstachowhuh I've got similar with my smartphone in my home - standard ;)10:21
SamYaple"unplug and act clueless"10:25
SamYapleremove if no one complains for a week10:25
*** inc0 has quit IRC10:30
*** akwasnie_ has joined #kolla10:30
*** akwasnie_ is now known as akwasnie10:30
*** inc0 has joined #kolla10:34
*** vbel has quit IRC10:40
*** vbel has joined #kolla10:40
*** inc0 has quit IRC10:41
*** inc0 has joined #kolla10:42
*** inc0 has quit IRC10:46
*** inc0 has joined #kolla10:49
*** inc0 has quit IRC10:57
*** daneyon has joined #kolla10:58
*** daneyon has quit IRC11:02
*** zhiwei has quit IRC11:04
openstackgerritSam Yaple proposed stackforge/kolla: WIP - DO NOT MERGE Add initial config function and keystone support  https://review.openstack.org/19254411:13
SamYaplepbourke: inc0: would you mind looking at the ansible things for https://review.openstack.org/19254411:13
SamYapleas an initial look11:13
pbourkelooking11:13
SamYaplestart with "main.yml"11:13
SamYapleinclude means "source" in bash11:14
SamYapleit will run those playbooks11:14
*** inc0 has joined #kolla11:24
*** inc0 has quit IRC11:28
*** athomas has quit IRC11:32
*** inc0 has joined #kolla11:33
*** sdake has joined #kolla11:41
*** athomas has joined #kolla11:41
inc0good morning sdake11:42
*** prad has quit IRC11:42
SamYaplehey sdake, got a rough draft review of the keystone support for ansible stuffs. asked inc0 and pbourke to have a look at it and leave early feedback11:43
SamYaplehttps://review.openstack.org/19254411:43
*** rhallisey has joined #kolla11:48
rhalliseymorning11:52
SamYaplemorning rhallisey11:53
mstachowhi rhallisey11:56
rhalliseyhey guys11:57
SamYaplerhallisey: ansible-multi is up for review. should have the basis all done for people to (hopefully) agree on11:58
rhalliseySamYaple, ya I've been looking at it11:59
SamYapleits been a time going through the comments to be sure11:59
*** sdake has quit IRC12:04
*** gfidente is now known as gfidente|afk12:05
akwasniehi, SamYample: can you tell me more about .buildconf file you mentioned before? can it clone tarball?12:10
*** dwalsh has joined #kolla12:10
SamYapleakwasnie: it can execute arbitrary code. its just a bash file12:10
SamYapleit is sourced when the container is built12:10
akwasniethanks12:15
*** erkules has quit IRC12:16
*** erkules has joined #kolla12:16
openstackgerritRyan Hallisey proposed stackforge/kolla: Cinder container  https://review.openstack.org/17096512:31
inc0Ryan, sorry for that, I've missed also 2 lines above, these should be moved to INIT_DB block as well12:33
openstackgerritRyan Hallisey proposed stackforge/kolla: Add cinder into the docker compose setup  https://review.openstack.org/17350712:35
*** dims has quit IRC12:36
*** dims has joined #kolla12:36
rhalliseyinc0, init_db vars may need to be added in other places..12:37
rhalliseyI'll do that after12:37
rhalliseyinc0, also, docs and env stuff are in path #212:38
inc0I saw that now, I'll remove these comments, but you might want to create patchset dependency between these12:38
rhalliseyinc0, are you saying the mysql stuff above should use $INIT_DB12:39
rhalliseyand not init_cinder_db12:40
inc0I meant init_cinder_db12:40
rhalliseyok I'll wrap the whole thing in the if block12:40
inc0also I'd rename it to cinder_db_init, to keep name consistency12:40
inc0yeah, that's my point12:40
rhalliseywell technically there is no other name to follow12:41
rhalliseyI was thinking these go into the #database comment12:41
rhalliseyin the env file12:41
*** athomas has quit IRC12:41
rhalliseyI think*12:41
* rhallisey looks12:41
*** athomas has joined #kolla12:41
inc0there are CINDER_DB_USER:)12:41
inc0and CINDER_DB_PASSWORD12:41
rhalliseynevermind... DESIGNATE_INITDB12:42
rhalliseyno I mean for 'init_db' vars12:42
inc0ah, ok, anyway, there is one, but we'll need to check this in every container12:42
rhalliseysince they will be grouped under the 'database' title12:42
rhalliseyya I'll write a patch for that in a moment12:42
inc0I mean if every container has this conditional12:42
rhalliseyit makes sense12:43
inc0I'll look at it tomorrow and file a but for each missing12:43
rhalliseyinc0, what do you want to call these '<service>_init_db' or 'init_<service>_db'12:43
inc0I'd keep <service>_init_db12:43
inc0to keep all vars required for cinder to be up in same place12:44
rhalliseywhat I'm saying is that these db vars will go in the 'database' section12:44
inc0db_init for me is more about create mysql service itself, init servers, datafiles and so forth12:44
rhalliseyin tools/genenv12:44
*** jtriley has joined #kolla12:45
inc0well, we'll need to create standard I guess if there is none so far12:45
rhalliseyya that's what saying I don't care though what would you prefer12:46
rhalliseyI kinda like init_<service>_db because it groups them together12:46
*** daneyon has joined #kolla12:46
inc0groups inits, but it would require to check envs in 2 places for each service12:47
inc0because if someone set ups cinder for a first time, he would need to change it12:47
inc0becase I'd suggest to default it to false12:48
inc0so by default container deploy will fail, but will not break data12:48
inc0unless explicitly said to12:48
rhalliseyinc0, which part is breaking the data?  The cinder db creation?12:49
inc0syncdb12:49
*** jtriley has quit IRC12:50
rhalliseydoesn't the db sync just update with the cinder table though?12:50
rhalliseyis that what you mean by breaking it12:50
inc0well, if we consider code upgrade12:51
inc0we'll build new container and someone will do accidental db migration12:51
*** daneyon has quit IRC12:51
inc0also, dbsync is done once, container deployment is done x times12:52
rhalliseywhen though does a db sync become damaging? If you upgrade?12:53
inc0alter can lock tables, and that can cause downtime of APIs12:54
inc0for example12:54
rhalliseyya but for our purpose of using it I'd say we default it to true and document that it should be run as false12:57
inc0also, have you seen what nova did with flavors one day?:)12:57
rhalliseyno I haven't12:57
rhallisey:)12:57
inc0they droppet table from instance and create new table12:57
inc0and did some magic for lazy loading and migrations12:58
inc0if you'd to that without full prior code upgrade, you'll break stuff;)12:58
rhalliseyI hear ya12:58
rhalliseyI think though for our purposes we should leave it as true since we arn't deploying in production or anything too serious12:59
inc0well, not dropped, but made big alter there12:59
rhalliseyya I understand your point12:59
inc0let's just discuss that with more people12:59
rhalliseysure12:59
inc0and approach this as separate issue12:59
rhalliseydeal12:59
rhalliseylet me update the patch..12:59
inc0thank you12:59
rhallisey:) no problem13:00
inc0I haven't seen any more INIT-only stuff there, but please take one more look13:00
rhalliseysure13:01
inc0maybe some lvm init stuff?13:01
rhalliseywell for one, we are using a backing file and we should support physical backup13:01
rhalliseythat patch will be an addition after this merges13:02
inc0if you say so;)13:04
inc0anyway, I'm off13:04
inc0thanks and see you around13:04
*** inc0 has quit IRC13:05
openstackgerritRyan Hallisey proposed stackforge/kolla: Cinder container  https://review.openstack.org/17096513:05
rhalliseysee ya13:05
*** diogogmt has quit IRC13:07
*** jmccarthy1 has joined #kolla13:11
*** jmccarthy has quit IRC13:11
*** jmccarthy1 has quit IRC13:13
*** jmccarthy has joined #kolla13:14
*** nihilifer has quit IRC13:14
pbourkeSamYaple: can you help me understand, to what degree is re-pulling a docker image not idempotent13:30
pbourke(im looking at the pull task in your review)13:31
*** dwalsh has quit IRC13:32
*** jtriley has joined #kolla13:40
*** fangfenghua has joined #kolla13:40
*** prad has joined #kolla13:40
SamYaplepbourke: the ansible docker module is not idempotent13:41
pbourkeI think Im wondering what your definition of idempotent is (not saying it's wrong just curious)13:42
SamYaplerun repeatedly without change13:42
SamYaplethe ansible docker module will report change (even if there is none)13:42
pbourkeif I run 'docker pull fedora:21' on my machine for example it is not changing anything13:42
SamYaplethe issue is with the ansible module not with docker pbourke13:45
pbourkeok I had a feeling that's what you were getting at13:45
pbourkemakes sense13:45
pbourkei'll put other questions on the review as too much info gets lost on irc i think!13:46
SamYapleagreed13:47
*** fangfenghua has quit IRC13:49
*** dwalsh has joined #kolla13:50
*** jmccarthy has quit IRC14:09
*** jmccarthy has joined #kolla14:10
*** jtriley has quit IRC14:26
*** jtriley has joined #kolla14:28
*** gfidente|afk is now known as gfidente14:28
*** absubram has joined #kolla14:33
*** daneyon has joined #kolla14:35
*** daneyon has quit IRC14:40
*** akwasnie has quit IRC14:41
SamYapleeveeyonr review the ansible spec?14:41
*** dasm is now known as dasm|afk14:42
pbourkeMERGE IT14:46
*** diogogmt has joined #kolla14:50
*** jasonsb has quit IRC14:52
*** sdake_ has joined #kolla14:53
sdake_morning folks14:53
pbourkeafternoon :)14:55
jmccarthyhiya14:56
*** nihilifer has joined #kolla15:00
sdake_greetings in whichever timezone you are in :)15:04
*** openstackgerrit has quit IRC15:05
*** openstackgerrit has joined #kolla15:05
*** jmccarthy has quit IRC15:07
*** jmccarthy has joined #kolla15:07
*** blahRus has joined #kolla15:09
SamYapleharmw: only +1 workflow when another core has already +215:21
*** mstachow has quit IRC15:21
*** absubram has quit IRC15:21
harmwoh sry15:23
SamYaplenot a problem! just fyi15:23
harmwthere:)15:24
pbourkesdake_: to add a new gate are the following steps correct? 1) add script under tests/ to kolla. 2) add entry to https://github.com/openstack-infra/project-config/blob/master/zuul/layout.yaml15:24
pbourkethis would be for building the ol images15:25
sdake_let me wake up pbourke15:25
sdake_then i'll be with you15:25
sdake_in this cae dont workflow at all15:25
sdake_I want to get a rollcall vote15:25
SamYapleyea if we can get a review before the meeting that owuld be great15:26
*** diga has quit IRC15:32
sdake_we are reviewing during the meeting15:34
*** dwalsh has quit IRC15:34
sdake_note to core reviewers:15:34
sdake_I have added "how to review the specification" notes in both specifications under review15:34
sdake_we still only require two +2 votes (plus the implicit vote of the submitter) however, I want to see where the core team stands on both the ha spec and ansible spec15:35
sdake_so do not use +w until a full rollcall vote can be done15:36
sdake_pbourke i'mm all yours15:43
sdake_pbourke which scritp do you want to add under rtests?15:43
sdake_pbourke this is one place: https://github.com/openstack-infra/project-config/blob/master/zuul/layout.yaml#L651015:44
pbourkesdake_: well, the ol base image isn't merged yet, but Id like to tee up a gate to build it while I wait (inc0 and alicja are working on the first iteration of the centos source install after which point I'll jump in)15:44
sdake_this is another place: https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/kolla.yaml15:45
sdake_jpeeler are there other parts to setting up the functional gate?15:46
sdake_please  take care to make your job non-voting to begin15:46
pbourkeyup that's basically my question - are those the only places I need to touch15:46
sdake_ya we probably want somehting more descriptive then kolla-functional-build-f115:47
sdake_like kolla-func-image-build-f2115:47
sdake_or kolla-func-image-build-centos-f2115:47
sdake_and kolla-func-image-builld-ol-f2115:47
sdake_pbourke when you begin yuo dont set up a gate pipeline only a check pipeline15:48
sdake_a check pipeline happens prior to commit - it indicates to core reviewers the patch has passed testing15:48
sdake_a gate pipeline happens prior to commit but after review - it triggers jenkins to merge the patch into the repository15:48
sdake_a non-voting gate doesn't have a gate pipeline job15:48
pbourkeyup understood15:49
sdake_pbourke I'd prefer one script for all types of environments15:49
sdake_and pass in stuff in the environment to the builders shell (line 14)15:49
sdake_or we may need a tox -e images-ol15:49
sdake_and tox -e images-centos15:50
sdake_and leave tox -e images for all images15:50
pbourkeit wont be as visible as to what set of tests are running on the board then though?15:50
sdake_once the test completes you will get a job results output - is that what you mean?15:50
sdake_the tox -e images test case takes about 45 mins atm15:50
sdake_so we need each distro and binary/source as a separate job15:51
sdake_to keep the gate running in parallel15:51
jpeelerthe only 3 files i've touched are: jenkins/jobs/kolla.yaml, jenkins/jobs/projects.yaml, zuul/layout.yaml15:51
sdake_jpeeler thoughts on the tox -e images-centos vs tox -e images-ol15:52
jpeelernot to be exclusive, but where do we draw the line for images built in the gate when each distro will be a +40 minutes15:52
sdake_i'd like to test all distros that are feasible and all deploy methods that are feasible15:52
sdake_the only ones i can think of that are not feasible are rhel because you can[t install packages in the containers wihtout a rhel license15:53
pbourkejpeeler: if they can be done in parallel it probably shouldn't make a huge difference?15:53
sdake_the parallel thing - we may have to change our gate to run on ubuntu15:53
sdake_infra doesn't have many fedora 21 builders15:53
*** bmace has quit IRC15:54
sdake_let me ask15:54
jpeelerall tox -e images does is call build-all-docker-images15:56
jpeeleri mean, we can make a tox target for whatever. but is there a way to toggle which set of images get built with our current tools scripts?15:57
pbourkejpeeler: I think it should be quite easy to add once SamYaple's --prefix patch merges16:00
sdake_there is an unlimited number of fedora builders16:00
sdake_(limited by quotas)16:00
jpeelerpbourke: great, feel free to depend on his patch then16:02
sdake_so we dont have to change to ubuntu builders16:02
*** jtriley has quit IRC16:02
SamYaplemeeting?16:03
SamYapleor is that tomorrow?16:03
jpeelerjust need to add a prefix arg to test_images assuming testr accepts args16:03
pbourkeSamYaple: today, not till 23:00 UTC though16:03
jpeelerSamYaple: in 6 hours16:03
SamYaplejpeeler: currently the scture allows setting the "prefix" in the .buildconf in root16:03
*** daneyon has joined #kolla16:04
SamYaplewow. then i have been awake for nothing16:04
SamYaplei hate time16:04
pbourkethats midnight my time so I may or may not stay up16:04
*** daneyon_ has joined #kolla16:04
jpeelerSamYaple: thanks, might as well build on the future though! assuming --prefix is close16:05
SamYaplei think it can be merged now jpeeler16:05
SamYapleill check16:05
harmwrhallisey: almost done with cinder, one minor issue remains16:05
harmw*you are16:05
rhalliseyharmw, cool thx16:05
harmw(I was ready to +2 it again, but well...)16:06
*** jtriley has joined #kolla16:06
* jpeeler goes to look at patch16:07
*** bmace has joined #kolla16:07
*** mstachow has joined #kolla16:08
*** daneyon has quit IRC16:08
mstachowhave we got meeting today?16:09
*** absubram has joined #kolla16:11
*** dims_ has joined #kolla16:11
jpeelermstachow: in 5 hours 50 minutes16:11
mstachowoh, ok16:12
mstachowthanky jpeeler16:12
mstachow*thanks16:12
jpeelerwould be kind of neat if openstack bot did a one hour warning for that sort of thing...16:12
jpeelernp16:12
*** dims has quit IRC16:13
rhalliseyharmw, I'm thinking of changing the names of 'INIT_DB' stuff16:18
rhalliseyI'll follow up with that patch in a bit16:18
rhalliseysince I know designate has "DESIGNATE_INITDB"16:19
rhalliseybut I'm going to change it and add it to other services16:19
*** sdake_ is now known as sdake16:25
openstackgerritRyan Hallisey proposed stackforge/kolla: Cinder container  https://review.openstack.org/17096516:25
sdakerhallisey sounds good - we should have one varaiable for that i thnk16:26
rhalliseysdake, I'm not sure though.  What if I just introduces cinder into my stack and I don't want to run the db sync for my other services16:27
rhalliseyall the services need something there though16:28
*** vinkman has joined #kolla16:31
openstackgerritPaul Bourke proposed stackforge/kolla: Add base image for oraclelinux  https://review.openstack.org/19101316:33
sdakerhallisey good point16:33
*** openstackgerrit has quit IRC16:33
harmwrhallisey: I can fully agree to chaning it to something else, given a certain logic :)16:34
sdakedo whatevery ou think is best ;)16:34
*** openstackgerrit has joined #kolla16:34
harmwthere are more things in that area that deserve attntion btw16:34
sdakereview process should pinpoint those harmw16:34
sdakeharmw although if you have a pointer on these to avoid rework that would be appreciated :)16:35
mstachowwho want do some review of my code :>?16:37
mstachowit also has got one variable with init_db16:38
mstachowbut It will be great to know about other issues16:38
harmwsdake: I noticed some quircks in old containers16:40
harmwso in general, there is some polishing to do in that area16:40
harmwnothing big though16:41
harmwand yes, the reviewprocess is exactly what brought this to my mind :P16:41
*** gfidente^2nd has joined #kolla16:44
*** gfidente has quit IRC16:45
openstackgerritDaneyon Hansen proposed stackforge/kolla: Spec to Add Support for High Availability  https://review.openstack.org/18198316:47
sdakeharmw yes one big key advantage of reviewing patches is you learn how the code base works :)16:49
sdakethat isn't by accident16:49
sdakethis is why I appreciate any reviews from anyone - even if they are wrong :)16:49
harmwyep :)16:50
harmwnow, time to feed while going over the H-A spec16:51
*** mfalatic has joined #kolla16:54
daneyon_jpeeler ping16:54
jpeelerhey16:54
jpeeleri don't have much expertise with what the max_connections number should be, but i thought it was interesting that devstack uses 200, but that's for postgresql16:56
jpeeleri didn't realize 151 was the default, so i'm fine with keeping it as is and will change my vote based on your comment16:56
SamYaple200 is a goos number for maeiadb+galera too16:56
SamYaplegood*16:56
SamYaplei should get off pgone and sleep16:57
mstachowTry to get some sleep before our meeting SamYaple16:57
jpeelerSamYaple: the link i refenenced used 1024 for that scenario16:58
jpeelerbut i do still wonder if there's any disadvantage to making the number higher than normal16:59
SamYaplejpeeler i shouldnt be comment atm. sorry brain stew.16:59
jpeelerSamYaple: it's too late, you just committed to another hour of IRC17:00
jpeelerj/k get some rest17:00
openstackgerritDaneyon Hansen proposed stackforge/kolla: Fixes MariaDB to Support Heat  https://review.openstack.org/19201117:00
daneyon_jpeeler re: https://review.openstack.org/#/c/192011/ I am open to changing the default if someone else can reproduce the issue. Otherwise, I am unsure whether this is an issue specific to my environment.17:01
harmwbla, blablablabla and bla bla and more bla [..] and your committed as a core reviewer to reviewing the work output of this specification.17:05
harmwcheck!17:05
daneyon_rhallisey jpeeler harmw mandre when you have a moment, do u mind reviewing the HA spec: https://review.openstack.org/181983 As sdake requested, we would like to get feedback from the cores and a +2 if you are cool with the spec.17:05
harmwthough I'm already afraid of it :p17:06
jpeelerdaneyon_: honestly don't feel that strongly about it, just figured a higher number wouldn't hurt. sure i'll look at it soon. lunch first!17:06
harmwdaneyon_: I +2'd it like 30secs ago :)17:07
*** mfalatic has quit IRC17:07
daneyon_jpeeler thx. i think this could be a reason to increase the number but we just need someone else to reproduce. maybe we can just move forward with keeping the default consistent with upstream and adjust in the future if a big is filed similar to mine.17:08
daneyon_harmw thx!!!17:08
*** jmccarthy has quit IRC17:09
*** dwalsh has joined #kolla17:13
*** inc0 has joined #kolla17:15
inc0good evening everyone17:15
*** dims_ has quit IRC17:16
*** dims has joined #kolla17:17
rhalliseydaneyon_, ya I'll have a look17:17
daneyon_rhallisey thx17:17
*** jtriley has quit IRC17:17
*** mfalatic has joined #kolla17:19
*** jasonsb has joined #kolla17:26
sdakeinc0 yo17:26
inc0https://review.openstack.org/#/dashboard/?foreach=project%3Astackforge%2Fkolla+status%3Aopen+NOT+owner%3Aself+NOT+label%3AWorkflow%3C%3D%252D1+label%3AVerified%3E%3D1%252cjenkins+NOT+label%3ACode%252DReview%3E%3D0%252cself&title=Kolla+Review+Inbox&Proposal+Bot+Proposals=owner%3A%22OpenStack+Proposal+Bot+%3Copenstack%252Dinfra%40lists.openstack.org%3E%22&Needs+final+%2B2=label%3ACode%252DReview%3E%3D2+NOT+label%3ACode%252DReview%3C%3D%252D1+limit%3A50&Needs+Feed17:29
inc0back+%28Changes+older+than+5+days+that+have+not+been+reviewed+by+anyone%29=NOT+label%3ACode%252DReview%3C%3D2+age%3A5d&You+are+a+reviewer%252c+but+haven%27t+voted+in+the+current+revision=NOT+label%3ACode%252DReview%3C%3D2%252cself+reviewer%3Aself&Passed+Jenkins%252c+No+Negative+Feedback=NOT+label%3ACode%252DReview%3E%3D2+NOT+label%3ACode%252DReview%3C%3D%252D1+limit%3A50&Wayward+Changes+%28Changes+with+no+code+review+in+the+last+2days%29=NOT+label%3ACode%252DRe17:29
inc0view%3C%3D2+age%3A2d&Negative+Feedback=label%3ACode%252DReview%3C%3D%252D1+limit%3A1017:29
inc0that didn't end well, hold on17:29
inc0http://paste.openstack.org/show/298976/17:30
*** sdake_ has joined #kolla17:30
*** rhallisey has quit IRC17:31
inc0http://tinyurl.com/odoqtcu or this one17:31
*** rhallisey has joined #kolla17:32
*** sdake has quit IRC17:34
*** jtriley has joined #kolla17:42
*** jtriley has quit IRC17:55
*** sdake has joined #kolla17:58
*** sdake_ has quit IRC18:01
*** sdake_ has joined #kolla18:10
*** sdake has quit IRC18:14
*** athomas has quit IRC18:40
*** daneyon_ has quit IRC18:45
*** daneyon has joined #kolla18:46
*** nihilifer has quit IRC18:48
*** daneyon_ has joined #kolla18:49
*** akwasnie has joined #kolla18:51
*** daneyon has quit IRC18:52
*** mstachow has quit IRC18:54
*** jtriley has joined #kolla19:03
*** openstackgerrit has quit IRC19:16
*** openstackgerrit has joined #kolla19:16
*** jtriley has quit IRC19:18
*** nihilifer has joined #kolla19:23
sdake_hey folks just got around to reviewing the ansible-multi spec once again, thanks for your comments19:24
sdake_I have responded inline19:24
*** jtriley has joined #kolla19:26
*** gfidente^2nd is now known as gfidente19:41
*** gfidente has quit IRC19:41
*** gfidente has joined #kolla19:41
*** jtriley has quit IRC19:52
*** nihilifer_ has joined #kolla19:54
*** nihilifer has quit IRC19:56
*** jruano has joined #kolla20:03
*** jtriley has joined #kolla20:04
harmwwhats a big tent20:22
harmwone wonders...20:22
rhalliseyhttps://www.openstack.org/summit/vancouver-2015/summit-videos/presentation/the-big-tent-a-look-at-the-new-openstack-projects-governance20:24
harmwjeez, got an executive summary? :P20:25
bmacea big tent, also known as a circus ;)20:26
harmwah, with clowns20:26
rhalliseyharmw, by the way I added INIT_CINDER_DB into the other patch that has changes to docs/integration-guide20:26
harmwooh, lol20:27
rhalliseyharmw, I understand it to be that openstack will try and accept more projects20:27
harmwI just no got that part20:27
harmwmore?20:27
rhalliseyI requirements and governance rules have been loosened20:28
rhalliseyif I understand correctly20:28
*** vinkman has quit IRC20:29
*** vinkman has joined #kolla20:30
harmwright, well thats about enough reviews for tonight :)20:37
*** inc0_ has joined #kolla20:44
*** absubram has quit IRC20:44
*** inc0 has quit IRC20:47
*** rhallisey has quit IRC20:52
openstackgerritimain proposed stackforge/kolla: Set up glance to use a data container.  https://review.openstack.org/19197520:56
*** jruano has quit IRC21:04
sdake_running late21:05
sdake_wrong channel21:05
*** inc0_ has quit IRC21:08
*** jtriley has quit IRC21:11
sdake_harmw rhallisey this is also worth a read: https://github.com/openstack/governance/blob/master/reference/new-projects-requirements.rst21:12
harmwwill do21:14
harmwgod, todays meeting is way to late...21:14
sdake_or anyone else that wants to see Kolla enter the big tent )21:14
sdake_;) that is :)21:14
harmwI'm not sure if I can say awake for another hour though :P21:16
sdake_red bull21:16
sdake_hit the circle k21:16
harmwall out21:16
sdake_or whatever the equivalent is  in the nl :)21:16
harmwhhe21:17
slaglesdake_: thanks for clarying on the spec. i really don't know where the packaging argument was coming from21:21
slagleit's a totally unrelated technicality21:21
sdake_sorry maybe i read into that too much based upon m years of thinking like a red hatter :)21:21
sdake_slagle been one emergency after another in my household today21:21
sdake_i re-read and think got to the meat of the ask21:22
slagleyea, i understand you're positioning21:23
sdake_i totally want to cooperate with tripleo and think the spec represents that21:23
*** openstackgerrit has quit IRC21:24
sdake_i suspect the community is completely on board with that concept21:24
*** openstackgerrit has joined #kolla21:24
slaglei feel it does as well. i think we've clarified around the only language i was concerned about21:24
sdake_yup and reviews are a permanant record ;)21:25
sdake_so if we don't hold up to our end of the bargain, call us out :)21:25
sdake_bargain such a bad wor21:25
sdake_d21:25
* sdake_ needs to go to sleep21:25
slagle:)21:25
*** sdake_ is now known as sdake21:25
*** nihilifer_ is now known as nihilifer21:26
sdakei think commitment i s a better word there slagle21:26
*** jasonsb has quit IRC21:52
*** rhallisey has joined #kolla21:57
sdakeheads up, kolla meeting starting now in openstack-meeting-422:01
*** dwalsh has quit IRC22:07
*** mfalatic has quit IRC22:07
*** mfalatic has joined #kolla22:08
harmwso.. tired...22:16
*** prad has quit IRC22:23
*** dims has quit IRC22:26
*** mstachow has joined #kolla22:27
*** akwasnie has quit IRC22:31
*** akwasnie has joined #kolla22:31
sdakeok befoe harmw passes out22:40
sdakeare people still reading the comments?22:40
harmwnope, isn't that something to do *before* these meetings :P since, obviously, reading takes time :p22:41
sdakeyes i've ahrassed people to read for the last 15 days22:42
sdakeand everyone keeps saying "i'll read it tomorrow"22:42
harmwand I did! :p22:42
sdakewell tomorrow has come :)22:42
sdakejpeeler rhallisey I think your votes are outstanding22:42
sdakelooks like daneyon changed hsi vote22:42
*** pbourke has quit IRC22:44
*** pbourke has joined #kolla22:44
sdakewrong channel22:45
sdakemy bad22:45
jpeeler(for the record, i did read the spec when i said i would. i just didn't vote or comment)22:46
*** jasonsb has joined #kolla22:46
harmwwhoops, kid fell out of bed :| back now22:49
*** jasonsb has quit IRC22:58
openstackgerritMerged stackforge/kolla: Spec to Add Support for High Availability  https://review.openstack.org/18198322:58
*** nihilifer has quit IRC23:01
*** mstachow has quit IRC23:04
*** mfalatic has quit IRC23:08
*** gfidente has quit IRC23:10
*** dims has joined #kolla23:24
*** rhallisey has quit IRC23:25
*** dims has quit IRC23:28
*** dims has joined #kolla23:28
openstackgerritMerged stackforge/kolla: Ansible multi-node specification  https://review.openstack.org/18915723:31
*** kfox1111 has joined #kolla23:33
*** dims has quit IRC23:33
kfox1111Just swung by to say, congrats! :)23:33
kfox1111That was a hard spec to get through, but I think it was very good. :)23:34
*** blahRus has quit IRC23:37
sdakekfox1111 the harder part is implementing :)23:41
bmacemeh, the implementation is the fun part :)23:41
sdakejpeeler my bad :)23:42
sdake(reading scrollback)23:42
sdakelisten guys, I wanted to clarify something that I forgot to metnion in the meeting23:43
sdakepriority for reviews should be on specs if they are outstanding23:43
sdakegod forbid we have new ones23:43
sdakebut i didn't communicate that early on23:43
sdakeso it was totally my lack of communication and a fialure on my part as a leader to set expectations there23:44
sdakeso if anyone is to blame on the slow review process of the spec its me23:44
sdakein fact, blame me for all the bad things :)23:44
*** diogogmt has quit IRC23:45
sdakejpeeler make sense?23:45
bmacei'm all out of coffee... darn you sdake!!!!23:46
sdakethe reason I cranked up the pressure on the reviews is because they are blocking alot of individuals progress23:46
sdakewhen our whole community is blocked on a decision, that is bad for progress23:47
sdakeits one of the ptl's many jobs to unlock as many things as he/she can23:47
sdakeso sorry for the temporary abuse ;)23:47
kfox1111sdake: can you please be ptl on some other projects for me so you can speed up spec review on other projects? :)23:50
kfox1111its killing me right now. :)23:51
sdakekfox1111 that process we went through causes a bit of discontent23:51
sdake(lifemeeting review of a change)23:51
sdakelive meeting review of a change)23:52
sdakeits nto something i'd use on a daily basis23:52
sdakei'd recommend every project abandon specs process except for critical changes ;)23:52
kfox1111yeah. I'm trying to get specs through for features that cross openstack project silo's. Its really really bad for that. :/23:52
*** Haomeng|2 has joined #kolla23:53
sdakethe spec process is bad for just about eveything23:53
sdakenecessary evil i guess23:53
kfox1111something about software design by comittee.... hmm...23:53
kfox1111:)23:53
*** Haomeng has quit IRC23:55
kfox1111It has some benifits. More eyes to see creative alternatives can be a good thing. More eyes to simply bike shed things that really don't matter its its greatest flaw. :/23:55
sdakeit slows down velocity23:55
kfox1111yeah.23:56
sdakesome projects use it precisely for this purpose ;)23:56
*** sdake_ has joined #kolla23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!