Saturday, 2016-12-10

*** portdirect_ is now known as portdirect_away00:00
kfox1111so, just to be clear.00:01
v1k0d3nsbezverk_ secrets.00:01
kfox1111going through the rules sdake posted.00:01
kfox1111I think the concern is this:00:01
kfox1111"They can of course represent the needs of their project team or their company, but in case of conflicts of interest, they should be ready to put those needs aside and make the best call for OpenStack as a whole."00:01
v1k0d3nhow are secrets used during the injection of configmap data?00:01
kfox1111I believe I've done that. If not, how so.00:01
sbezverk_v1k0d3n: sorry, kubernetes secrets?00:02
v1k0d3nhow does a user bring their own secrets to the helm charts, for importing into the configmap?00:02
sbezverk_v1k0d3n: I must have missed the context, you do not approve how we use them?00:02
v1k0d3nsbezverk_ you said give you an example to srwilkers...i'm giving an example00:03
v1k0d3nsorry00:03
v1k0d3nsbezverk_: i'm not sure why everyone is getting offended.00:03
v1k0d3ni'm bringing up concerns that things are moving quickly and there are some misses.00:03
sdakehow kubernetes secrets are handled is covered in the spec00:03
sdakespecifically they are external, not internal00:03
sbezverk_v1k0d3n: got it.. I do not think we use secrets as a part of config map00:03
v1k0d3nthen i was told that i'm not contributing...fair enough. sbezverk_ you said yourself that i have not talked to cores, but i have.00:04
sbezverk_basically we mount them inside of a template00:04
sdakev1k0d3n pretty sure your contributing00:04
*** sayantan_ has quit IRC00:04
v1k0d3nkfox1111: have i not asked if we're attempting to keep sync?00:04
sdakepretty sure the dev env was a huge huge contribution00:04
v1k0d3nand i get told "you're free to join" which i do...00:04
v1k0d3nsbezverk_: yes...secrets can be imported in. that's a powerful part.00:04
v1k0d3nuser can bring their own, or generate00:04
v1k0d3ni think everyone so busy, that we're not looking at the other projects that are similar.00:05
sbezverk_v1k0d3n: that is what I like :-) you put forward a technical issue which is fun to ger resolve :-)00:05
v1k0d3nand the other projects are asying that the goals don't align. i would like them to have less parity.00:05
kfox1111v1k0d3n: I appologized for misunderstanding your level of contribution.00:05
v1k0d3nsbezverk_: you're one of my favorite people. you take recommendations.00:05
v1k0d3nbut i fear that we're missing what is already done out there.00:06
v1k0d3n:(00:06
v1k0d3noh i haven't contributed code.00:06
v1k0d3n:)00:06
v1k0d3nnot here. it's not that i don't WANT to, or can't00:06
kfox1111v1k0d3n: but you have contributed people, and communication, which is just as important.00:06
v1k0d3nkfox1111: this goes to the point i made earlier....00:06
v1k0d3nmy corp objective...00:06
kfox1111thats a contribution in my book.00:06
v1k0d3nthat's in a PoC00:06
v1k0d3nwe're on the hook for that. not the community.00:06
v1k0d3ni said steal our stuff entirely.00:07
kfox1111v1k0d3n: not to minimize that, but community is far more important then poc.00:07
v1k0d3nsrwilkers: is supposed to merge...i think he's trying, but confused how they all fit00:07
sdakev1k0d3n in openstack we dont steal, copying is a totaly normal thing in openstack00:07
*** portdirect_away is now known as portdirect_00:07
kfox1111v1k0d3n: community first. code second.00:07
sdakein magnum for example, I copied ironic's implementation to rough out the initital code base00:07
v1k0d3nbecause they're so different currently. too much parity.00:07
v1k0d3none think that maybe you guys are using later(?) livenessProbe: and readinessProbe: ?00:08
sdakeok gotta feed my child before she strangles me after being in the road rage incident00:08
*** bachp has quit IRC00:08
kfox1111v1k0d3n: that only gets ironed out, if one party chucks their code, or the devs start talking I think. :/00:08
v1k0d3ni didn't see them currently. that's what flagged me on the differences, then i started digging in ddeeper.00:08
sdakev1k0d3n thats in the spec00:08
v1k0d3nsoryr i have to read back...i'm missing all of your comments and have to read back00:08
kfox1111v1k0d3n: yeah. we need more checks. we havent focused on that.00:09
kfox1111each project has focuesed on different things.00:09
kfox1111so there are some one does better, some that the other does better, some things we both do the same, and some things we do differently.00:09
v1k0d3nsteal i mean take...it's MEANT 100% for kolla-kubernetes00:09
v1k0d3nwe were waiting for direction on operators, entrypoint, init, etc etc etc00:09
v1k0d3nthat took a while00:09
srwilkersill be back shortly.00:10
*** srwilkers is now known as srwilkers_brb00:10
v1k0d3nif you notice, that's when srwilkers paused for a bit and helped elsewhere.00:10
kfox1111v1k0d3n: there hasn't been a good track record in open source communities for copmanies doing code drops and importing them into other projects.00:10
kfox1111it tends to work much better when its being contributed to directly.00:10
sdakeya code dumps always fail00:10
sdakeit results in lack of engagement00:10
v1k0d3nkfox1111: there also has been this level of communication. i have been so extremely clear about everything.00:10
sdakehence nobody to maintain it00:11
kfox1111we need to grow a healthy community.00:11
sdakehence no community00:11
v1k0d3nwe want to drop that repo00:11
v1k0d3nand again...we were asked to do a PoC in the first place00:11
kfox1111so, can we get the folks working on aic-helm to try and take the templates there, convert them to use the microservices and contribute them back?00:11
sdakev1k0d3n by whom?00:11
kfox1111then both parties get what they want?00:11
v1k0d3n(by kolla in barcelona)00:11
v1k0d3nPTL00:11
sdakeok, well ptl doesnt rule the universe00:12
kfox1111v1k0d3n: thats a company request.00:12
v1k0d3nkfox...00:12
v1k0d3nhave you looked at them?!?!?!00:12
kfox1111and the ptl doesn't control what people contribute.00:12
v1k0d3nthey ARE microserviced out00:12
sdakethe ptl works with teh core team to make things happen :)00:12
kfox1111v1k0d3n: yeah. I have. show in: https://github.com/att-comdev/aic-helm/tree/master/glance/templates00:12
kfox1111where glance-api can be launched all by itself as a microservice.00:13
kfox1111I thinik we may be disagreeing on terminology?00:13
v1k0d3nkfox1111: the one you pic is the new one that got added that we didn't get a chance to go over...00:13
v1k0d3nit's being refactored00:13
*** mgiles has quit IRC00:13
v1k0d3nfor this reason00:13
kfox1111v1k0d3n: can you point me at an example then? I can't find one.00:14
kfox1111maybe a different branch?00:14
*** srwilkers_brb is now known as srwilkers00:15
v1k0d3nkfox1111: https://github.com/att-comdev/aic-helm/blob/37afa516ca396981e71e8ebcfa43020788a0779d/glance/values.yaml00:16
v1k0d3nimages????00:16
sdakebb-45mins00:16
kfox1111thats not a microservice. thats a service. you cant do just one of those things, but hae to orchestrate the deployment of the entire set of glance services all at once.00:16
kfox1111v1k0d3n: here's what I'm talking about.00:17
*** sdake has quit IRC00:17
kfox1111say you take:00:17
kfox1111https://github.com/att-comdev/aic-helm/tree/37afa516ca396981e71e8ebcfa43020788a0779d/glance/templates00:17
v1k0d3nwait, so a micoservice is not a container...? separated processes?00:17
sbezverk_v1k0d3n: in the approach you push, is there a way to re-run glance db-manage as an individual task?00:17
v1k0d3na microservice is a small atomic unit of a config file (helm chart)?00:17
portdirect_sbezverk_: yes via the k8s api00:17
v1k0d3nthis is the misunderstanding here....00:17
kfox1111glance registry, glance api tamples, and replace them with a glance-registry subpackage for the kolla-kubernetes microservcie, and the glance-api microservice.00:18
jascott1that bypasses helm release right00:18
v1k0d3nmicroservice in my world...is an individual container for a specified purpose.00:18
kfox1111v1k0d3n: microserviee is a package per k8s object.00:18
v1k0d3nnot a small config unit.00:18
*** jgriffith_AutoAw is now known as jgriffith00:18
v1k0d3nah....00:19
v1k0d3nok...so is a pod a microservice unit?00:19
kfox1111one package per k8s object time. (deployment,daemonset,petset,etc)00:19
sbezverk_portdirect_: it sounds kind of generic, could you be more specific00:19
sbezverk_?00:19
kfox1111basicaly what you 'kubectl create -f <thingy>'00:19
kfox1111you can then thake the microservices and bundle them into service level helm packages for orchestration, like your doing.00:20
v1k0d3nright00:20
v1k0d3nbut in my <thing>00:20
kfox1111its basicallyu just a bit of helm rapping around the embeded templates.00:20
v1k0d3ni have multiple contianers...00:20
kfox1111there are multipole containers per pod.00:21
kfox1111there are multiple pods per daemonset/deployment/etc00:21
kfox1111there are one k8s object per microservie package.00:21
kfox1111multiple microservices per service package.00:21
portdirect_sbezverk_: yeah from my perspective (unless I'm missing somthing about helm) it simple puts the tempates out there - so in the case of the jobs we can once it's deployed then use the k8s api to update it - in the same way you would not install a .deb every time you wanted to initialise a user - but I was answering very much a specific tecnical point you raised - nothing more :/00:21
kfox1111v1k0d3n: does help explain the kolla-kubernetes terminology? I think we've been using different definitions and therefore talking past each other.00:22
v1k0d3nto me, there is only kubernetes terminology.00:23
v1k0d3nand helm00:23
kfox1111v1k0d3n: there is no 'microservice' definition in k8s as far as I know.00:23
kfox1111or helm.00:23
kfox1111if they have a clear defiition you could point me to, I'll adopt it.00:24
kfox1111a lot of problems end up when people define things differently. :/00:25
v1k0d3ni gotta run guys. sorry for causing a stir, unfortunately this isn't really going anywhere for me, and i have too many concerns. it's 7:30 where i'm at on a friday.00:26
sbezverk_portdirect_: I see, I just looked and glance temaplates and they are all in the same template folder, in my mind helm deploys all temapltes it finds in this folder, hence my question how it is done individually00:26
v1k0d3nif anyone needs to reach me, you guys know where to find me.00:26
kfox1111sbezverk_: right. as far as I can understand, it just loads them all.00:27
v1k0d3nsbezverk_: https://github.com/att-comdev/aic-helm/blob/master/ceph/.gitignore#L100:27
v1k0d3nhttps://github.com/att-comdev/aic-helm/blob/6994418899d0309e12904b55d01aea5de03430c8/common/Makefile#L200:27
v1k0d3nhttps://github.com/att-comdev/aic-helm/blob/eb51f5b67efc05e2750ae07f31c060e66118a3ea/ceph/templates/secrets.yaml#L9-L4900:28
v1k0d3nhttps://github.com/att-comdev/aic-helm/blob/eb51f5b67efc05e2750ae07f31c060e66118a3ea/bootstrap/templates/secrets.yaml#L900:28
v1k0d3nfinally: https://github.com/att-comdev/aic-helm/blob/6994418899d0309e12904b55d01aea5de03430c8/common/utils/secret-generator/README.md#generate-raw-fsid-can-be-used-for-other-functions00:29
kfox1111v1k0d3n: if your concern is primarily about being able to start over in helm/charts. thats  fine with me. but you gota get the commuity to vote for it.00:29
*** Pavo has quit IRC00:29
kfox1111and I'll abstain from voting, as I have a conflict of interest timeine wise.00:29
kfox1111timeline00:29
kfox1111that should clear up the issue.00:30
kfox1111same with dropping mariadb microservice in exchange for upstream kubernetes/mariadb.00:30
kfox1111get a vote, and I'll abstain.00:31
v1k0d3ni'll say what i said to you privately. i don't want to disrupt kolla-kubernetes again.00:32
v1k0d3njust fwiw...we talked about helm from the beginning, remember?00:32
v1k0d3nyou said in the future, remember?00:32
v1k0d3nbut you had a goal then.00:32
kfox1111v1k0d3n: I want whats best for the community.00:32
v1k0d3nyou needed something.00:32
v1k0d3nwhat gets coded in usually stays.00:33
kfox1111v1k0d3n: we're working on helm.00:33
v1k0d3nok00:33
portdirect_sbezverk_: np - it would be nice if kubectl provided a command to rerun a job rather than editing the desired number of completeions in the spec as in it's current form it is a bit hacky.00:33
*** cliles has quit IRC00:33
kfox1111when we talked last about helm, I said I didn't have time to work on helm. I can only say what I have time tocontribute.00:33
kfox1111I was planning on looking ot helm more in the future.00:34
*** Pavo has joined #openstack-kolla00:34
v1k0d3nreally need to go. today has been disruptive enough for me. :-/00:34
sbezverk_v1k0d3n: can we look at it from different angle. you want to use helm all the way, right? what we do now with microservices most likely will not prevent helm global orchestration, why you do not consider running global helm orchestration on microserviced chart temapltes?00:36
*** jgriffith is now known as jgriffith_AutoAw00:37
kfox1111sbezverk_: +100:37
*** ntpttr has quit IRC00:37
*** schwicht has joined #openstack-kolla00:37
*** jascott1_ has joined #openstack-kolla00:39
v1k0d3nhey, i don't want to change direction00:39
sbezverk_if there are some issue with current microservices let's discuss it and fix as a technical issues and not Trump/Clinton debate like00:39
v1k0d3nwe're going around in circles00:39
v1k0d3ni want to remove myself from the loop. i've made my case, and others have politely chimed in.00:39
v1k0d3ni'm being the strong one, and it makes me a bit uncomfortable.00:40
v1k0d3nthis is the beauty of open source.00:40
*** jascott1 has quit IRC00:42
*** pece has quit IRC00:43
openstackgerritMerged openstack/kolla-kubernetes: Have gate wait for dns ready  https://review.openstack.org/40890700:43
sbezverk_v1k0d3n: we are all human and do not like waste time, so far I see, I am offered to forget about last two month and switch to something different and new, I am sorry I do not take it with smile00:45
sbezverk_I really really want to make sure that new is really worth such action00:46
v1k0d3nthis is what i've been doing on behalf of kolla sbezverk_ working with other cloud native members to find out what is needed to merge projects00:47
v1k0d3nit would be nice to see openstack have a project dedicated to this mession.00:48
v1k0d3nit is what it needs for clear interop with kubernetes.00:48
v1k0d3nnot just on the tenant-side, but also with kubernetes being first - class.00:49
*** n0isyn0i1e has joined #openstack-kolla00:49
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Add neutron keystone service/endpoint creation jobs  https://review.openstack.org/40826300:49
kfox1111v1k0d3n: I think we're all in agreement on that.00:50
kfox1111v1k0d3n: and I do thank you for continueing to try and bring the teams together. its a great thing.00:51
kfox1111its just hard. and we're trying.00:51
v1k0d3nhow so?00:51
v1k0d3nmeaning, engaging other groups outside of openstack?00:52
kfox1111bringing together different teams.00:52
*** n0isyn0ise has quit IRC00:52
kfox1111with different ideas on how to get to the end goal.00:52
kfox1111both teams agree on end goal I think. just not sure on the road to get there.00:53
v1k0d3nfrom stackanetes, fuel ccp, sap, pulling in these open source projects here?00:53
kfox1111that is hard to work out. but worth trying.00:53
v1k0d3ndims: you still there?00:53
v1k0d3ni know you've been peeking here and there :)00:54
v1k0d3nif i'm the only one who feels this way, i will completely back down.00:55
Pavoanyone might know what this error means? http://paste.openstack.org/show/592000/00:55
v1k0d3nso far this has just been you and me going through this.00:55
*** sdake has joined #openstack-kolla00:56
sdakeback00:56
v1k0d3nkolla needs to do what it needs to do00:56
v1k0d3nthis is why we brought this up in barcelona00:57
v1k0d3ni understand cores couldn't make it. but man, why have those working sessions with the PTL then?00:57
Pavoanyone might what this error means? http://paste.openstack.org/show/592000/00:58
*** tonanhngo has quit IRC00:59
kfox1111v1k0d3n: thats the thing about opensource governence. "One Contributor, One Vote"00:59
jascott1_Pavo I would find the task thats failing and check it out00:59
kfox1111the ptl helps try and lead the cats, but the cats get the final say.00:59
v1k0d3npoint taken kfox111100:59
v1k0d3nnoted. but we had people all in agreement there fwiw.01:00
kfox1111v1k0d3n: https://github.com/openstack/governance/blob/master/reference/principles.rst is whate we all follow.01:00
sdakeya i think of a ptl with my 5 years of experience doing it s a "Project Team Facilitator"01:00
sdakePTL is not a dictator01:00
kfox1111sdake: and a great job of it too. :)01:00
jascott1_cat whisperer01:01
sdakeopenstack doesn't work under a dictator model01:01
sdakekfox1111 atm i'm retired as a ptl ;)01:01
*** v1k0d3n is now known as severion01:01
srwilkersjascott1_, hahaha01:01
*** severion has quit IRC01:01
*** v1k0d3n has joined #openstack-kolla01:01
sdakeno BDFL model in openstack, unlike kernel.org01:02
*** v1k0d3n is now known as severion01:02
Pavojascott1_ I have and found nothing that would indicate why it fails then continues on fine without issues01:02
*** severion has quit IRC01:02
jascott1_Pavo maybe the service is up but check is failing incorrectly?01:03
*** severion has joined #openstack-kolla01:03
Pavoit only does it during a deployment01:03
Pavoand after I check and everything is running fine01:03
Pavoso have no clue why it errors and then works01:04
jascott1_ya you kinda just described ansible ;)01:04
srwilkerscould just be retrying until the mariadb containers up and responds01:04
jascott1_pavo tried debug flag?01:06
Pavook will do01:06
Pavoif I have deployed and I want to add another compute node, do I just redeploy or will reconfigure work?01:08
srwilkersPavo, im assuming thats to be expected with mariadb in kolla-ansible. the task to start mariadb is run with 'wait-for:' with retries, so it's expected to likely need to wait for a response depending on environment, etc01:10
srwilkershttps://github.com/openstack/kolla-ansible/blob/master/ansible/roles/mariadb/tasks/start.yml#L21-L3101:11
Pavoyeah I figured that srwilkers01:15
Pavothanks01:15
kfox1111sdake: yeah. but still, thnaks for all your help as ptl, and guidence afterwards.01:15
srwilkerscheers Pavo :)01:16
srwilkersunfortunately im not sure about reconfigure Pavo :(01:16
Pavook, guess I'll just have to try and findout01:16
sdakedinner time01:17
sbezverk_sdake: que aproveche señor :-)01:20
*** jgriffith_AutoAw is now known as jgriffith01:45
kfox1111sbezverk_: sbezverk_ the    dns test either didn't work, or the issue is unrelated: http://logs.openstack.org/63/408263/12/check/gate-kolla-kubernetes-deploy-centos-binary-ceph-nv/dc431ce/logs/pods/kolla-neutron-create-keystone-endpoint-public-zlgts-main.txt01:50
*** portdirect_ is now known as portdirect_away01:53
*** jgriffith is now known as jgriffith_AutoAw01:56
*** srwilkers_ has quit IRC01:58
openstackgerritcaoyuan proposed openstack/kolla-ansible: Move aodh precheck into its own role  https://review.openstack.org/40438902:00
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Add neutron keystone service/endpoint creation jobs  https://review.openstack.org/40826302:03
*** sayantan_ has joined #openstack-kolla02:11
*** awiddersheim has quit IRC02:16
*** sayantan_ has quit IRC02:21
*** sayantan_ has joined #openstack-kolla02:21
*** tonanhngo has joined #openstack-kolla02:23
*** mdnadeem has joined #openstack-kolla02:25
*** Pavo has quit IRC02:29
*** Pavo has joined #openstack-kolla02:30
sbezverk_kfox1111: this log looks a bit wierd02:32
sbezverk_kfox1111: is there any way to attach to VM when it runs the gate to be able to troubleshoot this condition?02:33
*** mdnadeem has quit IRC02:34
*** unicell1 has joined #openstack-kolla02:35
*** unicell has quit IRC02:35
*** mkoderer has quit IRC02:36
*** jtriley has joined #openstack-kolla02:44
*** tonanhngo has quit IRC02:48
openstackgerritMerged openstack/kolla-ansible: Always check enable_* variables first  https://review.openstack.org/40852903:01
*** HyperJohnGraham has quit IRC03:02
*** sdake has quit IRC03:10
*** rhallisey has quit IRC03:15
*** imcsk8_ has joined #openstack-kolla03:17
*** ayoung has quit IRC03:19
openstackgerritMark Giles proposed openstack/kolla-kubernetes: WIP - Helm nova services  https://review.openstack.org/40882903:25
*** kollabot has quit IRC03:32
*** kollabot4 has joined #openstack-kolla03:32
*** kollabot4 has quit IRC03:33
*** kollabot has joined #openstack-kolla03:35
*** harlowja_ has quit IRC03:36
*** schwicht has quit IRC03:38
*** duonghq has joined #openstack-kolla04:01
duonghqmorning guys04:01
srwilkersmorning duonghq04:01
duonghqanybody got ES cluster crash and lost data?04:05
duonghqsrwilkers, iirc, you live in US?04:06
srwilkersduonghq, yep :) CST04:06
duonghqgot it04:07
*** mdnadeem has joined #openstack-kolla04:20
*** Pavo has quit IRC04:29
*** Pavo has joined #openstack-kolla04:34
*** yatin has quit IRC04:38
*** tonanhngo has joined #openstack-kolla04:49
*** tonanhngo has quit IRC04:50
*** yatin has joined #openstack-kolla04:50
*** zhubingbing has joined #openstack-kolla04:54
*** sdake has joined #openstack-kolla04:56
sdakehey peeps04:56
sdakeportdirect you about04:56
duonghqsup sdake04:56
sdakesup dounghq04:56
sdakeduonghq :)04:56
duonghq:)04:56
srwilkerssup sdake04:56
sdakesup srwilkers04:56
*** lamt has quit IRC04:57
*** portdirect_away is now known as portdirect_04:58
* portdirect_ reboots04:59
portdirect_sup04:59
srwilkers:p05:01
*** hogepodge has quit IRC05:06
*** duonghq has quit IRC05:10
*** severion has quit IRC05:12
*** v1k0d3n has joined #openstack-kolla05:12
v1k0d3nsrwilker-: you still up man?05:13
v1k0d3nlol05:13
*** mdnadeem has quit IRC05:13
srwilkerslol yeah, im here05:13
v1k0d3nwow...you're a machine srwilker-05:13
srwilkerscan always sleep next week05:14
*** jgriffith_AutoAw is now known as jgriffith05:28
sbezverk_duonghq: ping05:31
*** unicell has joined #openstack-kolla05:34
*** unicell1 has quit IRC05:34
*** duonghq has joined #openstack-kolla05:35
*** portdirect_ is now known as portdirect_away05:40
*** jgriffith is now known as jgriffith_AutoAw05:41
*** yatin is now known as yatin_on_leave05:43
*** sdake_ has joined #openstack-kolla05:49
sdake_rbergeron are you around05:51
*** jtriley has quit IRC05:51
sdake_rbergeron snakes on a plane?05:52
*** sdake has quit IRC05:53
sdake_rogue one incoming05:56
sdake_night folks05:56
srwilkerslater sdake_05:56
sdake_night srwilkers05:56
*** sdake_ has quit IRC05:57
*** saneax-_-|AFK is now known as saneax06:20
*** duonghq has quit IRC06:27
*** Pavo has quit IRC06:29
*** zhubingbing has quit IRC06:34
*** yatin_on_leave has quit IRC06:34
*** Pavo has joined #openstack-kolla06:34
*** zhubingbing has joined #openstack-kolla06:34
*** yatin_on_leave has joined #openstack-kolla06:47
*** adrian_otto has joined #openstack-kolla06:48
*** yatin_on_leave has quit IRC06:58
*** saneax is now known as saneax-_-|AFK07:01
*** saneax-_-|AFK is now known as saneax07:02
*** prameswar has joined #openstack-kolla07:04
*** adrian_otto has quit IRC07:07
openstackgerritcaoyuan proposed openstack/kolla-ansible: Move aodh precheck into its own role  https://review.openstack.org/40438907:09
*** adrian_otto has joined #openstack-kolla07:10
*** yatin_on_leave has joined #openstack-kolla07:11
openstackgerritcaoyuan proposed openstack/kolla-ansible: Move manila precheck into its own role  https://review.openstack.org/40433807:15
openstackgerritcaoyuan proposed openstack/kolla-ansible: Move manila precheck into its own role  https://review.openstack.org/40433807:17
*** yatin_on_leave has quit IRC07:18
openstackgerritcaoyuan proposed openstack/kolla-ansible: Move watcher precheck into its own role  https://review.openstack.org/40446807:23
openstackgerritcaoyuan proposed openstack/kolla-ansible: Move barbican precheck into its own role  https://review.openstack.org/40446507:28
*** yatin_on_leave has joined #openstack-kolla07:30
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible: Enable tempest test in gate  https://review.openstack.org/40212207:32
openstackgerritMerged openstack/kolla: Install watcher dashboard into horizon image  https://review.openstack.org/40660707:42
*** sayantan_ has quit IRC07:47
*** sgordon has quit IRC07:51
*** sgordon has joined #openstack-kolla07:54
*** tonanhngo has joined #openstack-kolla08:01
*** tonanhngo has quit IRC08:03
*** adrian_otto has quit IRC08:10
*** prameswar has quit IRC08:16
*** rstarmer has quit IRC08:16
*** yee37911 has joined #openstack-kolla08:19
*** yee379 has quit IRC08:21
*** portdirect_ has joined #openstack-kolla08:21
*** tonyb has quit IRC08:22
*** portdirect_away has quit IRC08:23
*** tonyb has joined #openstack-kolla08:24
*** Pavo has quit IRC08:29
*** Pavo has joined #openstack-kolla08:34
*** msimonin has joined #openstack-kolla08:52
*** saneax is now known as saneax-_-|AFK08:52
*** tonyb has quit IRC08:53
*** tonyb has joined #openstack-kolla08:55
*** msimonin has quit IRC09:05
*** cmceniry has quit IRC09:05
*** cmceniry has joined #openstack-kolla09:10
openstackgerritMerged openstack/kolla: Install mistral dashboard into horizon image  https://review.openstack.org/40672609:19
openstackgerritcaoyuan proposed openstack/kolla: Remove the unnecessary "openstack-zaqar-ui"  https://review.openstack.org/40757609:25
*** msimonin has joined #openstack-kolla09:27
*** msimonin has quit IRC09:31
*** Jeffrey4l has joined #openstack-kolla09:32
*** cmceniry has quit IRC09:32
*** cmceniry has joined #openstack-kolla09:33
*** sean-k-m1 has joined #openstack-kolla09:46
*** sean-k-mooney has quit IRC09:49
*** zhubingbing has quit IRC10:00
*** yee37911 has quit IRC10:22
*** kollabot has quit IRC10:23
*** kollabot has joined #openstack-kolla10:23
*** yee379 has joined #openstack-kolla10:23
*** Pavo has quit IRC10:29
*** Pavo has joined #openstack-kolla10:34
*** klindgren_ has joined #openstack-kolla10:37
*** klindgren__ has quit IRC10:39
*** n0isyn0i1e is now known as n0isyn0ise11:42
*** tonanhngo has joined #openstack-kolla12:02
*** tonanhngo has quit IRC12:04
*** msimonin has joined #openstack-kolla12:06
*** msimonin has quit IRC12:06
*** fragatina has quit IRC12:12
*** fragatina has joined #openstack-kolla12:13
*** zhubingbing has joined #openstack-kolla12:14
*** awiddersheim has joined #openstack-kolla12:16
*** fragatina has quit IRC12:19
*** fragatina has joined #openstack-kolla12:27
*** Pavo has quit IRC12:29
*** Pavo has joined #openstack-kolla12:34
openstackgerritWei Cao proposed openstack/kolla-ansible: Add freezer ansible role  https://review.openstack.org/40222412:36
openstackgerritWei Cao proposed openstack/kolla-ansible: Add freezer ansible role  https://review.openstack.org/40222412:38
*** sgordon has quit IRC12:45
*** sgordon has joined #openstack-kolla12:45
*** cinerama has quit IRC12:51
*** slagle has quit IRC12:51
*** portdirect has quit IRC12:51
*** kklimonda has quit IRC12:51
*** Marx314 has quit IRC12:51
*** wznoinsk has quit IRC12:51
*** esmiurium has quit IRC12:51
*** clayton has quit IRC12:51
*** cinerama has joined #openstack-kolla12:51
*** slagle has joined #openstack-kolla12:51
*** portdirect has joined #openstack-kolla12:51
*** kklimonda has joined #openstack-kolla12:51
*** Marx314 has joined #openstack-kolla12:51
*** wznoinsk has joined #openstack-kolla12:51
*** esmiurium has joined #openstack-kolla12:51
*** clayton has joined #openstack-kolla12:51
*** ipsecguy has quit IRC13:18
*** yatin_on_leave has quit IRC13:35
*** yatin_on_leave has joined #openstack-kolla13:49
openstackgerritzhubingbing proposed openstack/kolla-ansible: add panko role  https://review.openstack.org/40012213:52
kfox1111sbezverk_: unfortunately not.13:57
kfox1111I did find an issue with the blocker patch. it doesn't fail the job when it fails. so thats part of the issue.13:58
*** dave-mccowan has joined #openstack-kolla13:59
kfox1111once that's resolved it should at least fail faster.14:00
kfox1111sdake: you around?14:01
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Add neutron keystone service/endpoint creation jobs  https://review.openstack.org/40826314:09
openstackgerritcaoyuan proposed openstack/kolla-ansible: Enable watcher dashboard when enable_watcher is yes  https://review.openstack.org/40660814:13
openstackgerritcaoyuan proposed openstack/kolla-ansible: Enable mistral dashboard when enable_mistral is yes  https://review.openstack.org/40672814:14
*** jascott1_ has quit IRC14:20
*** Pavo has quit IRC14:29
*** Pavo has joined #openstack-kolla14:34
openstackgerritcaoyuan proposed openstack/kolla: Install solum dashboard into horizon image  https://review.openstack.org/40898114:37
*** sdake has joined #openstack-kolla14:44
kfox1111sdake: morning14:45
sdakemorning kfox111114:45
srwilkersmorning kfox1111 sdake14:57
kfox1111srwilkers: morning15:01
*** jgriffith_AutoAw is now known as jgriffith15:01
*** jgriffith is now known as jgriffith_AutoAw15:02
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Add neutron keystone service/endpoint creation jobs  https://review.openstack.org/40826315:02
*** jgriffith_AutoAw is now known as jgriffith15:02
*** tonanhngo has joined #openstack-kolla15:03
sbezverk_morning gents15:03
*** jtriley has joined #openstack-kolla15:05
*** tonanhngo has quit IRC15:05
*** jascott1 has joined #openstack-kolla15:06
*** fragatina has quit IRC15:12
*** fragatina has joined #openstack-kolla15:13
*** jascott1_ has joined #openstack-kolla15:21
kfox1111sbezverk_: morning. :)15:21
*** adrian_otto has joined #openstack-kolla15:25
*** jascott1_ has quit IRC15:25
*** sp__ has joined #openstack-kolla15:26
kfox1111this is interesting: http://logs.openstack.org/63/408263/15/check/gate-kolla-kubernetes-deploy-ubuntu-binary-ceph-nv/c4db305/logs/pods/kube-system-kube-dns-654381707-dd954-kube-dns.txt15:28
sbezverk_kfox1111: is that from health container that comes with dns?15:29
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Add neutron keystone service/endpoint creation jobs  https://review.openstack.org/40826315:29
*** jtriley has quit IRC15:33
*** ipsecguy has joined #openstack-kolla15:35
*** portdirect_ has quit IRC15:37
*** ipsecguy has quit IRC15:37
*** ipsecguy has joined #openstack-kolla15:37
kfox1111sbezverk_: here's the whole logs: http://logs.openstack.org/63/408263/15/check/gate-kolla-kubernetes-deploy-ubuntu-binary-ceph-nv/c4db305/logs/pods/15:38
kfox1111the dnsmasq and helthz containers have nothing in their logs.15:39
kfox1111sdake: you alive?15:43
*** adrian_otto has quit IRC15:46
*** Jeffrey4l has quit IRC15:48
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Add neutron keystone service/endpoint creation jobs  https://review.openstack.org/40826316:00
*** ipsecguy has quit IRC16:02
*** ipsecguy has joined #openstack-kolla16:03
portdirectafternoon o/ :)16:05
kfox1111portdirect: afternoon. :)16:05
*** Jeffrey4l has joined #openstack-kolla16:07
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: test the parent review minus a few bits.  https://review.openstack.org/40945516:07
portdirecthey man :) - just reseting the mainframe - will be back in 516:08
srwilkershey portdirect o/16:10
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Add neutron keystone service/endpoint creation jobs  https://review.openstack.org/40826316:10
sdakekfox1111 i am alive16:13
sdakeportdirect alive?16:14
*** jgriffith is now known as jgriffith_AutoAw16:14
kfox1111sdake: ran into an issue on the hub.16:15
kfox1111kolla-toolbox 3.0.1 has a bad openstack client in it.16:15
kfox1111is there a 3.0.2 soon, or should we try and update the 3.0.1 one with a fresher version?16:16
sdakekfox1111 no idea i don't maintain the hub16:16
sdakenot sure who does16:16
sdakekfox1111 can you see your pm please ;)16:16
*** Kdecherf has quit IRC16:17
*** Kdecherf has joined #openstack-kolla16:18
*** jgriffith_AutoAw is now known as jgriffith16:21
*** jascott1_ has joined #openstack-kolla16:22
kfox1111sdake: ping16:25
*** jascott1_ has quit IRC16:27
*** Pavo has quit IRC16:29
*** jgriffith is now known as jgriffith_AutoAw16:34
*** Pavo has joined #openstack-kolla16:34
*** ipsecguy has quit IRC16:35
sdakesrwilkers pingola16:35
*** ipsecguy has joined #openstack-kolla16:35
srwilkershey sdake :)16:38
sdakesrwilkers see pm plz16:39
*** Serlex has joined #openstack-kolla16:40
portdirectconfig-map rollout poc: https://github.com/kargakis/configmap-rollout16:44
SamYaplew00t16:44
*** jascott1_ has joined #openstack-kolla16:44
SamYaplegot the ansible docker module converted to salt in a rough manner16:44
portdirect:)16:44
SamYapleit will eventually be mostly a rewrite to take advantage of salt things like __context__16:45
SamYaplebut for now, I am starting kolla containers with salt16:45
SamYapleim pretty excited16:46
SamYapleits looking clean16:46
SamYapleand _quick_16:46
srwilkersthanks for that link portdirect :)16:47
SamYaple2 seconds to run a container "upgrade" (remove/recreate) for memcache container16:47
*** srwilkers is now known as srwilkers_away16:47
SamYaplenot a fan of the output from salt though. but eh16:48
*** jascott1_ has quit IRC16:49
*** Serlex has quit IRC16:51
*** msimonin has joined #openstack-kolla17:05
*** msimonin has quit IRC17:06
*** msimonin has joined #openstack-kolla17:07
kfox1111oh. interesting...17:09
*** msimonin has quit IRC17:09
kfox1111https://review.openstack.org/#/c/409455/ is still running...17:09
kfox1111so, maybe not libvirt/nova-compute related.17:09
kfox1111I would have really guessed those where the issue.17:10
kfox1111hmm.. what else could it be...17:10
*** msimonin has joined #openstack-kolla17:12
*** msimonin has quit IRC17:13
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: test the parent review minus a few bits.  https://review.openstack.org/40945517:15
*** jtriley has joined #openstack-kolla17:18
*** rstarmer has joined #openstack-kolla17:21
*** dave-mccowan has quit IRC17:23
*** rstarmer has quit IRC17:26
*** rstarmer has joined #openstack-kolla17:26
*** rstarmer has quit IRC17:26
*** rstarmer has joined #openstack-kolla17:27
*** rstarmer has quit IRC17:27
*** rstarmer has joined #openstack-kolla17:28
*** rstarmer has quit IRC17:28
*** rstarmer has joined #openstack-kolla17:28
*** rstarmer has quit IRC17:29
*** rstarmer has joined #openstack-kolla17:29
*** rstarmer has quit IRC17:30
*** sdake has quit IRC17:31
*** sdake has joined #openstack-kolla17:33
sdakefolks - here is the repo reorganization for kolla-kubernetes and kolla-ansible's benefit to unify the default config: https://review.openstack.org/#/c/399147/17:38
*** sp__ has quit IRC17:40
*** jgriffith_AutoAw is now known as jgriffith17:41
SamYaplesdake: i review that, that seems like a very bad idea17:50
SamYaplethose configs are very much ansible configs17:50
kfox1111sdake: thanks for the link.17:51
kfox1111SamYaple: I'm less convinced. they use vars defined by ansible, but arn't super ansible specific.17:51
SamYaplekfox1111: lol half of them say ansible17:52
SamYaplehostvars[inventory_hostname]['ansible_'.....17:52
kfox1111I think with just a little bit of reworking, the ansible specific logic can be put in ansible based var defines, and then the templates themselves can be used for whatever.17:52
kfox1111SamYaple: yeah. and if that was replaced with a more generic var name, that should work.17:53
kfox1111and then have foo = hostvars[inventory_hostname]['ansible_'.....17:53
SamYaplei dont know. that seems not very useful. having all kolla-* projects have to work in changes that might be needed for only kolla-ansible or kolla-k8s defeats the point of spliting the repos17:53
kfox1111we've conditionaled around most of them already for kolla-kubernetes anyway.17:53
SamYaplethis also assume jinja2 templating17:54
kfox1111this would make it so that kolla kubernetes wouldn't need to depend on kolla-ansible.17:54
kfox1111yeah. jinja2 templating it a thing. though I don't think too much of jinja2 specific features are in there.17:54
SamYaplewhich is just silly. copy the configs out. don't add in kolla-k8s stuff into kolla-ansible configs17:55
kfox1111it could pretty easily be sed'ed into a helm compatable format too I think.17:55
SamYapletrying to make a generic set of configs that exist in a repo that builds containers is very strange to me17:55
kfox1111s/{$/ {{ ./ etc.17:56
SamYapleshoehorning is a term that might fit17:56
kfox1111well, its called kolla, not kolla-containers.17:56
kfox1111if it was called kolla-containers I'd agree. :)17:56
SamYaplethe whole reason for the split was to remove the deployment stuff from kolla main repo17:56
kfox1111(and it might be nice to have that anyway. but I know folks don't want yet another repo split)17:56
SamYapleconfigs are definetely deployment17:56
kfox1111we disagree there.17:56
kfox1111I see there bing 4 pieces to the puzzle.17:57
kfox1111config generation, orchestration, deployment, and software.17:57
kfox1111ansible is currently doing 3 of the 4.17:57
kfox1111and sofware is the containers in kolla.17:57
SamYapleok. fair enough. i think thats correct then17:58
SamYaplei suppose i dont care so much as long as its not going to be a requirement for other kolla-* projects to use the configs from kolla17:58
kfox1111yeah. there to use if you want to. but not required.17:58
SamYaplebecause that is going to lead to alot of headache for kolla-k8s and kolla-ansible17:58
SamYaplei assure you17:58
kfox1111thats why I like splitting it up into those 4 catagories.17:58
kfox1111so in kolla-kubernetes, you can use the kolla provided genconfig stuff, or not.17:59
kfox1111if you want to say, hand roll your own configs.17:59
SamYapleits going to suck for kolla-k8s when ansible changes a config for something that works for ansible, but not for k8s17:59
kfox1111SamYaple: thats why gating is important.17:59
kfox1111config has to be gated against those things that use it.17:59
SamYaplegating is important, and it is never 100%17:59
kfox1111so ansible won't be able to break kolla-kubernetes without someone knowing.17:59
kfox1111and visa versa.18:00
SamYapleim thinking about for loops over inventories that subtly break that the gate just wont catch18:00
kfox1111but right now, kolla-ansible owns genconfig and it breaks kolla-kubernetes. :/18:00
SamYaplei would bet my salary that is going to happen18:00
SamYapleso move genconfig into kolla-k8s as it should be18:00
SamYaplethis is a very silly change18:00
kfox1111sharing code has advantages and disadvantages.18:01
SamYapleim not convinved this has advantages or is even less work18:01
kfox1111sharing is usuaaly better I think when there aren't a lot of devs to deal with fork maintenence.18:01
kfox1111its more costly in dev time to have 2 seperate copies.18:02
kfox1111dvr support for exampl,e requires two sets of changes then.18:02
SamYaplemaybe. until the first time ansible breaks k8s subtly18:02
kfox1111thats the risk. or the other way around.18:02
SamYapleand then its far more work18:02
kfox1111but thats why tests are so important. anything, not just config stuff can break things.18:03
SamYaplebesides, these were always supposed to be bare-bone configs18:03
SamYaplewhere user supplied any overrides or other thigsn. so it shouldnt take any dev time to enable dvr18:03
*** pbourke has quit IRC18:03
SamYaplethats user config stuff where then need to consult neutron on how dvr works18:03
*** pbourke has joined #openstack-kolla18:03
kfox1111there nees to be logic though that configures certain overrides per host role. so its not quite so easy. :/18:04
kfox1111its not just "enable_dvr=true" :/18:04
SamYaplebut that exists though18:04
kfox1111only because the genconfig was patched to support it.18:05
kfox1111and that code woiuld be nice to share.18:05
SamYapleno no no, this is an ansible specifc thing18:05
SamYapleit looks up a file on the host in question and can merge configs18:05
SamYaplek8s not doing that unless they are deploying with ansible18:05
SamYaplewhich to be honest, i dont know if you are18:05
kfox1111why is merging config's a ansible specific feature?18:05
SamYaplethe way its implemented in kolla-ansible18:06
kfox1111today it was implemented in a way that only works with ansible, which is a pain. :/18:06
kfox1111I'd like the genconfig to a little more generically handle config merging.18:06
SamYaplethis is a change that is going to cause more headaches than solutions in my opinion. no to mention dirty kollas git history with unrelated things.18:07
SamYaplebut if its not a requirement and only going to be used in those projects, i guess its not a big deal18:07
SamYaplemaking this a requirement for future kolla-* projects i am 100% against18:07
kfox1111kollas rhistroy is alrady pretty durty I think due to the repo split. :/18:08
kfox1111I'm with you. its optional to use genconfig.18:08
kfox1111I want it optional in kolla-kubernetes too.18:08
kfox1111you can use genconfig to do your config for kolla-kubernets, or some other way if you want.18:08
SamYapleesh what a mess this is going to be for people18:09
kfox1111heh. yeah. it would be easier if we just stuck to one technology.18:09
SamYapleno forget that, thats what the split was about18:10
kfox1111but for now, supporting both kolla-ansible and kolla-kubernetes makes a lot of sense.18:10
SamYapleso now we can use different technologies that have no dependancies on each other18:10
kfox1111maybe it makes sense to suport it forever. I dont konw.18:10
kfox1111right.18:10
SamYaplebut this is introducing a dependacy18:10
kfox1111optional dependency is ok.18:11
SamYapleits not option for kolla-ansible18:11
kfox1111kolla-ansible already depends on kolla containers.18:11
SamYaplenot the repo though18:11
SamYapleand the containeres a a closed box18:11
SamYaplean api almost18:11
SamYaplethis is certainly not ansible best practice either18:11
SamYapletemplate files belong in the roles18:11
*** jgriffith is now known as jgriffith_AutoAw18:12
* kfox1111 shrugs18:12
kfox1111best practes are guidelines.18:12
kfox1111should be followed most of the time.18:12
kfox1111but sometimes exceptions are good when it actualy benifits a project.18:12
kfox1111the benifits need to outweigh the drawbacks.18:13
SamYaplewe are just disagreeing on benefits here. i see complication and problems18:13
kfox1111yup. difference in opinion. thats ok.18:14
SamYaplejust for my own clarity, what is the issue with kolla-k8s having thier own configs?18:14
kfox1111thats why the community votes on things. to try and get a common direction rather then one opinion driving too much.18:14
kfox1111SamYaple: maintenence.18:15
SamYapleyou think all the work and complication surrounding this will be less dev time than maintaining configs?18:15
kfox1111we have very few devs, and if we have to maintain a whole set of configs, its going to be more work then it solves trying to share in my opinion.18:15
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: test the parent review minus a few bits.  https://review.openstack.org/40945518:15
SamYaplewow. no. i would strongly disagree there. maintaining these configs takes almost no time at all18:16
SamYaplei think the liberty -> mitaka config refresh i did took 2 hours18:16
kfox1111across all projects?18:17
SamYapleyes18:17
kfox1111it will also cause more schism where kolla-kubernetes or kolla-ansible gets a patch to add support for a new project and the other one doesn't.18:17
kfox1111the more work to do, the less likely that it will get done on the other side.18:17
SamYaplei mean thats a strange assumption that ansible and kubernetes projects will always support the same things18:18
SamYapleweve had container images for projects ansible didnt support since the bengingin18:18
kfox1111true. just trying to say, we should maek the bar as low as possible.18:18
kfox1111true. true.18:19
SamYaplei agree there, i think this is devs deving and overcomplicating though. making the bar much higher18:19
SamYapleit certainly makes the complexity of the project higher18:19
kfox1111maybe.18:19
kfox1111I think it may actually clean things up in the end. but thats juts my opinion.18:19
sbezverk_kfox1111: do you recall what rpm name is for hq bits?18:20
kfox1111it will be more clear reading throug hthe templates that dont have hostvars[ansible].... stuff in it.18:20
kfox1111sbezverk_: hq?18:20
SamYaplekfox1111: i agree. we can have different opinions. since we agree on my biggest point (this isn't a *requirement*) im perfectly fine18:20
sbezverk_json tool18:20
kfox1111SamYaple: yup. :)18:20
kfox1111sbezverk_: oh. jq you mean?18:21
kfox1111sbezverk_: the rpm package is 'jq'18:21
kfox1111I think it comes from epel.18:21
sbezverk_kfox1111: that the one, no wonder I could not find it :-)18:21
*** zhubingbing has quit IRC18:27
kfox1111weird...18:28
kfox1111the ubuntu gate job is failing often on the openstackclient fix...18:28
kfox1111while the others arn't.18:28
kfox1111http://logs.openstack.org/63/408263/18/check/gate-kolla-kubernetes-deploy-ubuntu-binary-ceph-nv/4022901/18:29
*** Pavo has quit IRC18:29
sdakeSamYaple inc0 proposed the spec, i was providing it for people that asked for it18:29
kfox1111oh. wierd.18:30
kfox1111socket.gaierror: [Errno -2] Name or service not known18:30
kfox11112016-12-10 16:16:11.950219 | + '[' 0 -eq 0 ']'18:30
kfox1111that should have trhown an error.18:30
*** Jeffrey4l_ has joined #openstack-kolla18:30
*** Jeffrey4l has quit IRC18:32
*** Pavo has joined #openstack-kolla18:34
*** jtriley has quit IRC18:35
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Add neutron keystone service/endpoint creation jobs  https://review.openstack.org/40826318:39
portdirectkfox1111: re, http://logs.openstack.org/63/408263/18/check/gate-kolla-kubernetes-deploy-ubuntu-binary-ceph-nv/4022901/logs/pods/kolla-neutron-create-keystone-endpoint-internal-j2yz2-main.txt18:44
portdirectare we on the wrong track here? pip's freaking out over: "requests.packages.urllib3.connection.VerifiedHTTPSConnection"18:45
portdirectis there a proxy infront of some vm's in zuul?18:45
*** jascott1_ has joined #openstack-kolla18:46
kfox1111portdirect: it looks like my dns test still failed to block on that review...18:50
kfox1111still tryign to fix that part.18:50
kfox1111portdirect: see: http://logs.openstack.org/63/408263/18/check/gate-kolla-kubernetes-deploy-ubuntu-binary-ceph-nv/4022901/console.html#_2016-12-10_16_16_11_95020818:51
kfox1111looks very weird.18:51
*** jascott1_ has quit IRC18:52
portdirectyeah - i think that was a brain squeltch re the proxy18:52
portdirect(ok it WAS a brain squeltch)18:52
portdirectbut wieird to get that far before cropping up again?18:54
*** jgriffith_AutoAw is now known as jgriffith18:55
kfox1111it should have not passed that [ $? -eq 0 ]18:56
kfox1111not sure how it managed to do that.18:56
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: test the parent review minus a few bits.  https://review.openstack.org/40945518:57
*** jascott1_ has joined #openstack-kolla19:13
kfox1111portdirect: we were kind of talking about it before, but lost track of it. if there's not a way to export a docker container with layers intact, think there's a way to build a docker-registry preloaded with containers?19:15
portdirectkfox1111: possibly, never tried but (and bear with me, 'cause this is gonna sound ugly, and just off the top of my head):19:16
portdirect1. registry in container19:17
portdirect2. load images into it19:17
portdirect3 export that19:17
portdirect4. profit?19:17
portdirectmay be worth looking at what fuel used to do, as i think it did somthing like what yur thinking about19:18
kfox1111yeah. thats kind of what I was thinking.19:20
kfox1111k. I'll see what I can dig up. thanks for the tip.19:21
*** jgriffith is now known as jgriffith_AutoAw19:26
kfox1111portdirect: yeah, I'm kind of using the neutron endpoint review to continue to debug the dns issue.19:26
portdirectfigured :)19:27
kfox1111as it seems to tickle it frequently, due to the pip upgrade workaround in it.19:27
kfox1111its really weird how much its hitting ubuntu relative to centos.19:28
portdirectlol, so it turns out that trusting me is a bad move19:28
portdirectdocker save does what you want i think19:28
portdirectjust tested it and it's leaving the layers etc intact19:28
kfox1111can you do multiple saves?19:29
portdirect2 sec and I'll try19:29
*** awiddersheim has quit IRC19:29
kfox1111like, what i'm trying to do is cache the downloads for the gate.19:29
kfox1111but if it ends up blowing up the number of layers, the amount of download might cancel out any benifits from the cache.19:29
kfox1111the man page has IMAGE [IMAGE...]19:31
kfox1111so maybe that would work.19:31
portdirecthttps://paste.fedoraproject.org/503480/81398260/raw/19:31
kfox1111looks good. :)19:32
portdirectsee if you can spot the craig wright like mistake :) but I can assure you it was unintentional :)19:32
kfox1111hmm.. they don't seem to share any layers though?19:33
portdirectthats cause the 2 images i chose dont19:33
portdirectwill check with some that do19:34
kfox1111k. thanks. :)19:34
*** jmccarthy has quit IRC19:36
*** msimonin has joined #openstack-kolla19:36
*** jmccarthy has joined #openstack-kolla19:37
kfox1111hmm.....19:38
kfox1111so the nova pause seems to be db related maybe...19:38
portdirectkfox1111: seems good: https://paste.fedoraproject.org/503498/13987511/raw/19:39
portdirectstill not 100% sold on it - but worth a shot19:40
kfox1111portdirect: yeah. looks good to me. thanks for testing. :)19:40
kfox1111should be able to precache things pretty easily then I think.19:41
kfox1111even with trunk.19:41
kfox1111just gota make a simple job that docker-save's a tarball periodically, and for trunk, does a build and does the export.19:41
*** awiddersheim has joined #openstack-kolla19:43
*** jtriley has joined #openstack-kolla19:46
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: test the parent review minus a few bits.  https://review.openstack.org/40945519:48
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Add neutron keystone service/endpoint creation jobs  https://review.openstack.org/40826319:51
*** jtriley has quit IRC19:55
kfox1111portdirect: kind of lost track of your ps.19:55
kfox1111anything you need help with?19:55
portdirectThink I'm ok on thekeystone side - that just needs a shake up to take into account the suff thats dropped since19:56
portdirectbut if you want ceph, its all yours19:56
portdirectI'm trying to catch up on a few things i should have done last week for work - but was gonna hit em hard tomorrow so that on monday it should be good to merge19:58
kfox1111stil working on neutron. was just looking around to help out inflight reviews if help was needed.19:58
kfox1111ok. cool.19:58
portdirectnp :) cheers dude19:58
kfox1111do you konw if kubeadm supports specifying a repo to pull from?19:58
kfox1111or an existing issue for it?19:58
portdirectnot that I'm aware of19:59
kfox1111k. I might raise one then.19:59
kfox1111without that kind of option, it will be hard for some folks to deply in an enterprise.19:59
kfox1111kind of similar to this though: https://github.com/kubernetes/kubeadm/issues/3420:00
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: test the parent review minus a few bits.  https://review.openstack.org/40945520:10
SamYapleyou know kfox1111, to make my case just a bit more on these configs I was just packaging rabbitmq into the kolla-salt thing im doing20:11
SamYapleand kolla-ansible doesnt use seperate vhosts per service20:11
SamYaplethis means kolla-kubernetes can't either20:11
SamYaplenor could anything else using those configs20:12
kfox1111SamYaple: that may be a good reason though to share? kolla-ansible probably should support vhosts. so would benifit from the effort too?20:12
kfox1111kolla-kubernetes is in the same boat.20:12
kfox1111we probably want to support vhosts too at some point.20:12
SamYapleaha! but thats a problem isnt it? thats not use something that can be easily added20:12
SamYaplemigration and other things must occur20:12
SamYaplebut... only for kolla-ansible20:13
kfox1111it won't break existing things. its an additional feature.20:13
SamYapleyou lose queues20:13
kfox1111so should be able to add without breaking existing things?20:13
SamYapleits not an additional feature20:13
kfox1111just default to the non vhost way?20:13
SamYapleeverything has a vhost20:13
SamYaplealways20:13
SamYaplein this case though its the same vhost accross all services20:13
kfox1111k. just speaking generically.20:13
SamYapleit need not be, and there is some security in not having it that way20:14
SamYaplemy point is, now kolla-k8s is bound to kolla-ansible with whether they should use vhosts or not20:14
SamYapleone can't make the decision without the other20:14
kfox1111right. but if kolla-kubernetes contributed optional support for vhosts, then kolla-ansible's path to support is easier.20:15
kfox1111as they won't have to do all the config bits. just the ansible side?20:15
SamYaplethat makes the configs _way_ more complicated though20:15
SamYaplenow you support vhost and not vhost20:15
kfox1111possibly? you said, its always vhost. we just set the per service thing to the same default for kolla-ansible, and then make it per service overridable?20:16
SamYaplenah its rabbitmq. its never simple20:16
portdirect^^ truth20:16
portdirect:)20:16
SamYaplebut the point is, there is going to be if/else branches in all of that that make the configs nigh unreadable very quickly20:16
* kfox1111 shrugs. kolla-kubernete's will probably solve it yet a different way. by one rabbit per service.20:16
SamYaplejust because you are trying to shoehorn the configs together20:16
kfox1111SamYaple: yeah. aleays a risk.20:17
SamYapleone rabbitmq per service.. hmm20:17
kfox1111just so far, it hasn't taken much to get kolla-kubernetes off the ground using kolla-ansibles genconfig.20:17
SamYaplethatll break openstack in some interesting ways20:17
kfox1111so, so far, little risk of lots of conditionals.20:17
kfox1111its already shared.20:17
portdirectyeah metering will become fun20:17
kfox1111SamYaple: we run mujltiple rabbits all the time at work. it works ok.20:17
kfox1111SamYaple: I know of other sites doing it too.20:18
SamYapleoh im not worried about the not working part20:18
kfox1111SamYaple: cross servids don't need to talk between rabbits except notifications,20:18
SamYapleits the when rabbitmq split brains... but only for glance20:18
SamYaplethat kind of thing20:18
kfox1111and notifications can speak to yet another rabbit.20:18
SamYapleyea20:18
kfox1111we have a dedicated rabbit cluster just for ceilometer.20:18
kfox1111for scaling reasons.20:18
portdirectbut being serious we need to think abou this issue and get all parites on board, Sam's raising some very good points - and as kolla-k8s becomes more developed we will start to place really heavy demands on a shared config20:18
SamYapleyep. certainly has a value add there20:18
kfox1111portdirect: yup. I agree. it may make sense to split it at some point. just so far, it hasn't seemed different enough to justify carying a near identicle copy I think.20:19
kfox1111but as we get further into the helm/servicepackages, maybe that changes.20:20
kfox1111but splitting them seems premature to me.20:20
kfox1111the same could be said of the kolla containers. we could make them kolla-kubernetes specific versions (I'm not advocating this at all)20:20
portdirectyeah - I'm not saying we should split now - but we should not create a complexity minefeild for ourselfs when we hit the wall20:21
kfox1111but sharing has benifit until it becomes too much of a problem.20:21
SamYaplei disagree. yo ucant say that about the contaienrs20:21
kfox1111portdirect: +120:21
SamYaplethe containers have a single point of entry20:21
kfox1111SamYaple: sure you can.20:21
kfox1111the containers were designed for ansible deployment. they could in theory designed differently for k8s deployment.20:21
SamYaplethey were not designed for ansible deployment20:21
SamYapleyou are wrong20:21
kfox1111but, close enough for now. (and hopefully forever)20:21
SamYaplethey were infact designed to be deployment tool agnostic20:22
SamYaplei know, because thats waht i wrote them as20:22
kfox1111sure. but stuff like kubernetes-entrypoint wern't things at the time.20:22
kfox1111not saying you didn't do the right thing. I like the way the containers were built.20:23
*** msimonin has quit IRC20:23
kfox1111just saying. yuou can make the share/not share argument about any part of the system.20:23
SamYapleeh, i dont agree with the kubernetes-entrypoint thing personally since the extend start stuff exists to filel that20:23
SamYapleyou can entrypoint from the deployment tool itself20:23
SamYapleor so was the original design20:23
SamYapleits what kolla-mesos did20:23
kfox1111SamYaple: I agree with you, but just saying. that kind of things will be argued by folks.20:24
kfox1111SamYaple: we happened to find a solution with a beta level k8s feature to make it not need to change the images.20:24
portdirectYeah - i think the containers are fine as they stand, the great thing about k8s it it lets us build round them (eg run ku8s-entrypoint) in an init container20:24
kfox1111but if it weren't for that, the containers would have to be changed in an kubernetes-entrypoint world.20:24
SamYaplekfox1111: that solution exists, you need to have an extend start that you copy into the container to override the default one20:24
SamYaplethat was the original purpose of this20:25
kfox1111I think we're getting off the rails.20:25
SamYaplei agree20:25
kfox1111:)20:25
SamYaplebut my point going back was the containers are 100% meant to be generic without any deployment specific code20:25
kfox1111yeah. and I think the genconfig should do the same.20:26
kfox1111but thats just my opinion.20:26
kfox1111and I admit I could be wrong. :)20:27
SamYaplepersonally, i think genconfig stuff should be its own projects. like as a whole20:27
kfox1111so far, it has worked out prety well.20:27
kfox1111SamYaple: that, I agree with too.20:27
SamYapleim not saying a shared genconfig is wrong, im saying genconfig in kolla main repo is wrong20:27
kfox1111+120:27
kfox1111a kolla-genconfig would be a better fit I think too.20:28
kfox1111but there's been a lot of pushback around extra repos. :/20:28
SamYaplethat could be tailored away from jinja220:28
kfox1111I don't quite understand why.20:28
SamYapleor abstracted rather20:28
kfox1111shoudl we propose a kolla-genconfig repo then in the spec?20:28
SamYapleidk. i think that deserves a new spec20:29
SamYapleit would have to discuss how to do it generically20:29
*** Pavo has quit IRC20:29
SamYapleso the issues like vhost between projects could be solved20:29
kfox1111most of it woudl be the same though, whether it was in kolla repo or kolla-genconfig repo?20:29
*** portdirect is now known as portdirect_away20:30
kfox1111the work's the genericness.20:30
kfox1111not as much, where it lives.20:30
SamYapleidk. a seperate repo seems better, but im still not convinced20:31
SamYaplecertainly worth exploring20:31
SamYapleim much more open to that20:31
kfox1111kk20:31
kfox1111I'm all for doing it in seperate repos. cramming everything into too few repos is something that I think has caused kolla pain over the years.20:32
SamYapleif our build process worked a bit different (less/no layering) i think seperate repos for each service would work well20:32
SamYaplebut our build process is very much integrated20:33
kfox1111true20:33
SamYaplei like the idea of having a user supplied repo that builds an image along side the rest20:33
SamYaplebut thats another subject for another time20:33
kfox1111ah. yeah, that would be cool.20:33
*** Pavo has joined #openstack-kolla20:34
SamYapleive been working on fleshing out some ideas to help the building20:34
SamYapleincluding building a repo_build container that runs pypi server to feed the containers20:34
SamYapleso the containers dont ened build tools20:34
kfox1111wow. is the gate really that empty? or is it just my view somehow?20:35
*** sayantan_ has joined #openstack-kolla20:35
SamYaplewow. its dead it seems20:35
*** portdirect_away is now known as portdirect20:35
kfox1111yeah. I know some others want the thinner containers too.20:35
portdirect+220:35
portdirect:)20:35
kfox1111portdirect: was it you that was working on super thin containers?20:35
SamYaplei actually want non-layered containers20:36
portdirectSamYaple, I was pretty much doing that for a bit20:36
SamYaplei know i pushed for the layers, and thats served us well, but i think we can get rid of them now20:36
SamYapleif we are clever20:36
SamYapleyea portdirect, the issue is build time mostly20:36
SamYaplebut with a repo container, and some other magic we might get away with it20:36
SamYaplei really hate having gcc in the final image20:37
SamYaplealright. sleep time20:37
portdirectyep - was building using alpine as a base and some crazy scripts - but it put build time up a lot20:37
portdirecteg: https://github.com/portdirect/harbor/blob/latest/docker/openstack/openstack-keystone/openstack-keystone-alpine/Dockerfile20:37
SamYapleyea, when i first came to kolla the build time was like an hour20:37
SamYapleand that was with a fraction of the services we have now20:38
SamYapleof course it was also bash script building back in those days20:38
SamYaplewe didnt get parallel until build.py20:38
portdirect(which I'm still using... thanks for your work on that :) )20:38
SamYaplei actually wrote parallelism in a patchset for the bash script20:39
kfox1111hmm... so after 3 minutes, kube-dns still wasn't working.20:39
kfox1111and its happening fairly consistently on ubuntu right now....20:39
kfox1111how very strange.20:39
SamYapleit worked, but it was so awful and full of 'evals' that i said screw it and started the initial build.py script20:39
SamYapleand the community has just run with that thankfully20:39
SamYaplefor real this time. sleep20:40
SamYaplethanks for the level-headed chat kfox1111 and portdirect20:40
SamYaplealways up for those20:40
kfox1111SamYaple: you too. :)20:40
portdirectlaters man :)20:40
kfox1111itsa always good to have conversaions when folks don't agree but can still be civil. :)20:41
kfox1111I really try not to take disagreement personally.20:41
kfox1111so.... why is dns failing... so strange...20:43
kfox1111three minutes should be pleanty of time for things to settle....20:43
portdirectits ubuntu only?20:43
kfox1111at the moment, it seems that way.20:43
kfox1111the last 10 runs or so has consistently landed that way. :/20:43
portdirectcan i run an exact copy of the gate locally? (I have hardware spare)20:44
kfox1111will run it a bunch more times to see if  Ican see any pattern.20:44
kfox1111shoudl be able to. but never tested it.20:45
portdirector just get the image that it uses20:45
kfox1111I don't think setup_gate has anything too gate specific in it,20:45
kfox1111other then assuming a complete fresh install is there on each run.20:45
kfox1111I was going to tweak it to run in minikube at some point, but just havent had time.20:46
kfox1111I know others are starting to play with the gate scripts in the vagrent scripts.20:46
portdirectyeah think think, jascott might be playing with that dicker container I started20:48
portdirect*docker20:49
kfox1111ah. yeah.20:49
portdirectbut wondering if its a CNI issue, perhaps?20:49
kfox1111we should try and get that container merged and get a chart into kubernetes/charts.20:49
kfox1111portdirect: yeah. could be. one of the last things left. as the job now makes it fail really early in the process.20:50
portdirect weird that its erratic - maybe worth trying flannel and seing if that makes a difference?20:51
kfox1111it basically is now deploying canal, then emediately testing that dns eventually becomes responsive.20:51
kfox1111yeah. could try a differentn one. but might be some work. as they embed addresss into the deaemonset that needs tweaking.20:52
portdirectweave would be the easiest one to swtich to - should only require a tiny tweak to those sed'20:53
portdirect(I'm using romana here - but i wouldnt for the gate, too heavy)20:54
*** jgriffith_AutoAw is now known as jgriffith20:55
kfox1111interesting...20:55
kfox1111so the logs do line up:20:55
kfox1111failure to forward request "read udp 127.0.0.1:47510->127.0.0.1:53: i/o timeout"20:55
kfox1111lots of those during the window where dns was tested and failed.20:55
kfox1111but, here, the kicker,20:56
kfox1111that is within a pod.20:56
kfox1111so in theory networking should have any affect on it?20:56
kfox1111seems like dnsmasq is not responding.20:57
*** adrian_otto has joined #openstack-kolla20:57
kfox1111hmm.. the nova one really needs to be broken up. there seems to be muiltiple issues with it.21:03
*** adrian_otto has quit IRC21:04
portdirectyeah - could you make me a happy chap? and either expictly confirm that that rpm command can come out or file a bug so we can get it sorted - it makes me a sad panda :)21:05
*** portdirect has left #openstack-kolla21:06
kfox1111it needs to be in for at least 2.0.2 suport.21:06
*** portdirect has joined #openstack-kolla21:06
kfox1111if they cut a 2.0.3 I'd be happy, but not sure they will ever do that. :/21:06
kfox1111still, wouldn't hurt to file a bug.21:07
kfox1111but they don't really support prebuilt containers on the hub.21:07
portdirectcool - i'll put a comment in for a '|| true' then? I know we are not doing set -e there but having an rpm command kinda exculdes ubuntu21:08
kfox1111https://bugs.launchpad.net/kolla/+bug/164900921:08
openstackLaunchpad bug 1649009 in kolla "centos 2.0.2 hub container qemu wrong." [Undecided,New]21:08
kfox1111portdirect: without the -e, it will just always continue on.21:08
kfox1111ubuntu or not.21:08
kfox1111and this one too https://bugs.launchpad.net/kolla/+bug/164901021:09
openstackLaunchpad bug 1649010 in kolla "kolla-toolbox 3.0.1 broken openstack cli" [Undecided,New]21:09
kfox1111portdirect: but if you want to make the || true explicit, I'm cool with that.21:11
kfox1111or wrap it in an if conditional.21:11
* srwilkers_away reads scrollback21:11
kfox1111srwilkers_away: wb. :)21:11
srwilkers_awaykfox1111, thanks man :)21:12
*** srwilkers_away is now known as srwilkers21:12
portdirectkfox1111: wicked - cheers :) added them to kolla-k8s as well so I can keep an eye on them21:18
kfox1111hmm.. looks like the only thing I havent' switched out yet is the svc's...21:21
kfox1111maybe thats the issue.21:21
*** adrian_otto has joined #openstack-kolla21:22
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: test the parent review minus a few bits.  https://review.openstack.org/40945521:24
kfox1111and another ubuntu only failure.21:26
kfox1111last time was rackspace. this time osic.21:26
*** clayton has quit IRC21:26
kfox1111so, very different networks.21:27
portdirectthinking about slim images - I need to get back on that soon as I get time - the savings are signifigant (eg harbor's glance api is 65mb) would be great to try and get a kolla image close to that size.21:27
kfox1111+121:27
kfox1111between that and a gate cache, we could get the gate to run significantly faster I think.21:28
*** clayton has joined #openstack-kolla21:28
*** Jeffrey4l_ has quit IRC21:31
kfox1111weird....21:33
kfox1111how does minikube do dns....21:33
kfox1111there isn't the kube dns pod on it.21:33
*** msimonin has joined #openstack-kolla21:36
*** Jeffrey4l_ has joined #openstack-kolla21:36
portdirectnever used minikube - apart from that day I barged into a kolla meeting and tried to do a code dump, seemed like the best way to say hello at the time :)21:36
kfox1111just trrying to see if  Ican quickly get a kube-dns log dump from a working one to compare against.21:36
kfox1111hehe. yeah. :)21:37
portdirecti can get you one in 2 sec if thats any good?21:37
kfox1111seems like that's the common way folks say hello in the opensource world. :)21:37
kfox1111that would be awesome. :)21:37
srwilkersall caught up on scrollback. happy saturday21:37
*** dave-mccowan has joined #openstack-kolla21:37
kfox1111srwilkers: yeah. far less discussion today21:38
srwilkerskfox1111, no kidding. no 6 hours worth of discussion to play catch up with21:38
portdirect:)21:38
*** adrian_otto has quit IRC21:39
kfox1111srwilkers: yeah, I know right? yesterday was a very long discussion. :/21:39
portdirectkfox1111: actually scrath my offer of help - ive only got k8s 1.5 atm - whihc i think is different21:40
kfox1111srwilkers: its ok if people are trying hard to understand each other and not just talk past each other. talking to each other, while time consuming sometimes is better then not and just making assumptions.21:41
kfox1111portdirect: ok. thanks anyway.21:41
srwilkerskfox1111, i agree 100% :)21:42
portdirectkfox1111: but dont think its of much use https://paste.fedoraproject.org/503729/14814061/raw/21:42
kfox1111portdirect: can you get me the dump of the other two ones too?21:43
kfox1111dnsmask/health check?21:43
portdirectthere is nothing to show21:43
kfox1111blank?21:43
portdirectyeap21:43
kfox1111ok. thats helpful.21:43
kfox1111they are blank on the broken one too.21:44
kfox1111so that validates that blank doesn't mean broken.21:44
kfox1111thanks. :)21:44
portdirectnp :)21:44
kfox1111nice...21:45
kfox1111this is looking very promicing: https://review.openstack.org/#/c/409455/7/tests/bin/ceph_workflow.sh21:45
kfox1111one of the gates passed so far.21:46
kfox1111second passed.21:48
kfox1111this should be an easy fix. :)21:48
kfox1111one more success. :)21:54
kfox1111one more and its good. :)21:54
*** portdirect is now known as portdirect_away22:00
*** msimonin has quit IRC22:04
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Add neutron keystone service/endpoint creation jobs  https://review.openstack.org/40826322:05
*** fragatina has quit IRC22:06
srwilkershey kfox1111: question. are we just hardcoding replicas in currently, similar to whats done for rabbitmq here: https://github.com/openstack/kolla-kubernetes/blob/master/helm/microservice/rabbitmq-pod/templates/rabbitmq-pod.yaml#L11 ?22:07
*** ipsecguy_ has joined #openstack-kolla22:08
*** msimonin has joined #openstack-kolla22:10
*** msimonin has left #openstack-kolla22:10
*** rstarmer has joined #openstack-kolla22:11
*** ipsecguy has quit IRC22:12
kfox1111srwilkers: we're setting defaults in all_values.22:15
kfox1111rabbit is somewhat unique, as things break badly if replica != 1.22:15
kfox1111same with mariadb and memcached.22:15
kfox1111the rest should be scalable I think.22:15
srwilkerscool. makes sense. thanks22:17
*** mgiles has joined #openstack-kolla22:18
*** bmace has quit IRC22:20
*** bmace has joined #openstack-kolla22:20
openstackgerritMark Giles proposed openstack/kolla-kubernetes: Helm creation of Nova services  https://review.openstack.org/40947322:23
openstackgerritMark Giles proposed openstack/kolla-kubernetes: Helm database creation for Nova  https://review.openstack.org/40947422:24
*** Pavo has quit IRC22:29
openstackgerritMark Giles proposed openstack/kolla-kubernetes: Helm database creation for Nova  https://review.openstack.org/40947422:32
kfox1111hmm... so its not the dns resolving container either... forcing it to centos still fails...22:32
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Add neutron keystone service/endpoint creation jobs  https://review.openstack.org/40826322:33
*** Pavo has joined #openstack-kolla22:34
openstackgerritSteve Wilkerson proposed openstack/kolla-kubernetes: Helm charts for adding Cinder  https://review.openstack.org/40934922:34
openstackgerritSteve Wilkerson proposed openstack/kolla-kubernetes: Helm charts for adding Cinder  https://review.openstack.org/40934922:39
kfox1111srwilkers: once it passes the gate, I think its mergable.22:41
kfox1111wana pull the wip off the commit message?22:41
srwilkersstill need to get the keystone endpoints and such in, unless you want those to move in separately22:41
kfox1111oh. still need the gate test update too.22:42
kfox1111more smaller revies are probably better then one big one.22:42
kfox1111the endpoints are kind of held up on the neutron-endpoints one.22:42
mgilesAre the gates working?  I'm getting errors that appear completely unrelated to my change (see logs for https://review.openstack.org/#/c/409473/)22:42
portdirect_awaymgiles: kolla dir in commit22:43
kfox1111mgiles: that looks very strange.22:43
kfox1111oh. yeah. that dir would break things.22:44
mgilesportdirect_away Hmmm. Not sure how that got there.  thanks for noticing22:44
portdirect_awayif your testing locally it's caught me out a few times22:44
portdirect_awayalso I'm here!22:44
*** portdirect_away is now known as portdirect22:44
openstackgerritSteve Wilkerson proposed openstack/kolla-kubernetes: Helm charts for adding Cinder  https://review.openstack.org/40934922:45
srwilkerswb portdirect o/22:45
portdirecthey dude!22:45
openstackgerritMark Giles proposed openstack/kolla-kubernetes: Helm creation of Nova services  https://review.openstack.org/40947322:46
mgilesportdirect_away  Thanks - fixed22:47
mgilesor just portdirect now22:47
kfox1111oh. very interesting...22:52
kfox1111kubernetes resolves, but google does not.22:52
*** dave-mccowan has quit IRC22:53
kfox1111I wonder if this is an ubuntu resolver issue.22:53
kfox1111anyone have an ubuntu box handy?22:56
mgilesyep22:56
kfox1111can you please cat /etc/resolv.conf?22:56
mgilesbut I can't resolv google anyway because I'm behind a corp firewall22:56
kfox1111I'm wondering if they stuck 127.0.0.1 in there.22:56
mgilesyes22:56
mgilesnameserver 127.0.0.122:57
kfox1111thats probably the issue. :/22:57
mgilesthat's the only entry22:57
kfox1111yeah. that would explain it.22:57
kfox1111how to workaround that though....22:57
kfox1111hmm...22:57
kfox1111seems like this: https://github.com/kubernetes/kubernetes/issues/1907622:59
sbezverk_good evening! anything interesting going on?23:01
srwilkershey sbezverk_ :)23:02
kfox1111hi sbezverk_23:03
portdirectsbezverk_: hey!23:04
sbezverk_wow everybody is working! that's the holiday spirit ;-)23:05
kfox1111:)23:05
sbezverk_kfox1111: qq do we have an image with jq and kube bits in?23:06
kfox1111sbezverk_: the kolla-toolbox:3.0.1 has jq and crudini.23:09
kfox1111I don't think there's a container yet with kubectl/helm in it.23:09
kfox1111though portdirect's been working on a more general client container.23:09
openstackgerritMark Giles proposed openstack/kolla-kubernetes: Helm for nova-api  https://review.openstack.org/40947923:09
kfox1111I don't have a review link handy though. portdirect do you?23:10
portdirectyou mean the kolla-k8s-dev container?23:10
kfox1111yeah.23:10
portdirectthats not really for running in a cluster but:23:10
portdirecthttps://review.openstack.org/#/c/405720/7/Dockerfile23:11
portdirectdont think it's what sbezverk_ needs :(23:11
portdirectalso only has helm23:11
kfox1111it would be good to add kubectl and jq too.23:12
portdirectoh I'm telling lies again23:12
portdirectit does have them23:13
sbezverk_portdirect: it would really like to have kubectl in one of kolla toolboxes23:13
portdirectI could make one for you know if you want? would be in my docker namespace for now but loud put an ps for kolla-kube-toolbox?23:14
portdirectwould just be kolla-toolbox butwith k8s specific things added23:15
kfox1111sbezverk_: I guess  I should ask, what use case do you ahve for it?23:16
kfox1111is it for embedding in a pod, or for using directly?23:16
sbezverk_I am putting together configmap monitor and need to run jq which is already there and kubectl to be able to check kube object revision number23:17
kfox1111oh. for the sidecar thing.23:18
kfox1111then, yeah. a more specific use container might be in order.23:18
sbezverk_as soon as I get it running. I will post it just to get your opinion around it23:18
kfox1111as the devel one might have stuff like a git checkout and other stuff that is heavier weight.23:19
kfox1111sounds good.23:19
portdirectI'll have an image for you to *play* with in 5 mins23:19
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Add neutron keystone service/endpoint creation jobs  https://review.openstack.org/40826323:20
sbezverk_portdirect: thanks!!!23:23
portdirectsbezverk_: docker.io/port/centos-binary-kolla-kube-toolbox:3.0.1  <<--kolla toolbox with kubectl23:23
kfox1111sbezverk_: shoudl that restart feature be added to kubernetes-entrypoint?23:23
kfox1111it has most of the code already to contact kubernetes and do things when things change.23:24
portdirectnot if the toolbox only runs as an init container?23:24
kfox1111there could be a sidecar run with the same container.23:24
kfox1111just thinking it may be easier to add the feature to kubernetes-entrypoint then to write the code from scratch.23:25
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Add neutron keystone service/endpoint creation jobs  https://review.openstack.org/40826323:27
portdirectkfox1111: lets see what sbezverk_ comes up with - the protype I've seen ther people do it is 20 lines of bash including comments - so it could be very lightweight poentially23:27
*** adrian_otto has joined #openstack-kolla23:27
kfox1111portdirect: does it busyloop, or long wait?23:28
kfox1111I can see a busyloop implementation potentially being fairly easy to do.23:28
kfox1111but would be pretty hard on the api on a larger cluster.23:29
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Add neutron keystone service/endpoint creation jobs  https://review.openstack.org/40826323:30
sbezverk_portdirect: no, just init container does not work23:30
sbezverk_portdirect: side car check with an interval revision version23:31
sbezverk_of configmap23:31
portdirectsbezverk_: we are in agreement about the init container not working :)23:31
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Add neutron keystone service/endpoint creation jobs  https://review.openstack.org/40826323:32
sbezverk_cool, let me finish then we can discuss23:32
kfox1111weird... no resolvconf service in the newer ubuntu....23:34
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Add neutron keystone service/endpoint creation jobs  https://review.openstack.org/40826323:35
openstackgerritSteve Wilkerson proposed openstack/kolla-kubernetes: Helm charts for adding Cinder  https://review.openstack.org/40934923:35
*** adrian_otto has quit IRC23:35
portdirectkfox1111: networkmanager afaik?23:36
kfox1111but it is only 127.0.0.1...23:36
sbezverk_kfox1111: I saw that on my 16.0423:36
kfox1111network manager is doing resolving on 16.04?23:36
openstackgerritMark Giles proposed openstack/kolla-kubernetes: Helm for nova-api  https://review.openstack.org/40947923:37
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Add neutron keystone service/endpoint creation jobs  https://review.openstack.org/40826323:39
sbezverk_portdirect: could you send me in pm the location of that image, I need to step out again, but when I get back I will try it..23:41
kfox1111arg... not finding many traces of network manager either.23:43
kfox1111something is odd on this ubuntu box. :/23:43
portdirectoh - it may be  systemd-resolved.service ?23:46
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Add neutron keystone service/endpoint creation jobs  https://review.openstack.org/40826323:47
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Add neutron keystone service/endpoint creation jobs  https://review.openstack.org/40826323:48
kfox1111not seeing that one either.23:49
kfox1111http://logs.openstack.org/63/408263/29/check/gate-kolla-kubernetes-deploy-ubuntu-binary-ceph-nv/286f405/console.html23:50
kfox1111has the service list.23:50
kfox1111I wonder how custom this image is.23:50
kfox1111not much by name resolv either.23:51
kfox1111so weird...23:51
kfox1111this is the fastest gate turnaround I've had in a long long time. :)23:51
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Add neutron keystone service/endpoint creation jobs  https://review.openstack.org/40826323:51
openstackgerritMark Giles proposed openstack/kolla-kubernetes: Helm for nova-libvirt  https://review.openstack.org/40948123:53
kfox1111there we go:23:53
kfox11112016-12-10 23:53:08.942026 | tcp        0      0 127.0.0.1:53            0.0.0.0:*               LISTEN      1011/unbound23:53
kfox1111something called unbound23:53
*** kmadac has joined #openstack-kolla23:55
*** kmadac has quit IRC23:58
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Add neutron keystone service/endpoint creation jobs  https://review.openstack.org/40826323:59
openstackgerritSteve Wilkerson proposed openstack/kolla-kubernetes: Helm charts for adding Cinder  https://review.openstack.org/40934923:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!