Wednesday, 2016-06-22

*** dwalsh has joined #openstack-kolla00:01
*** mdorman has quit IRC00:03
*** zhiwei has joined #openstack-kolla00:06
*** mbound has quit IRC00:07
openstackgerritJoshua Harlow proposed openstack/kolla: Allow for externally managed configuration  https://review.openstack.org/33259000:11
*** zhiwei has quit IRC00:11
*** mdorman has joined #openstack-kolla00:14
*** jtriley has joined #openstack-kolla00:19
*** daneyon has quit IRC00:53
*** phuongnh has joined #openstack-kolla00:56
*** dwalsh has quit IRC01:00
*** fragatina has joined #openstack-kolla01:06
*** mbound has joined #openstack-kolla01:08
*** jpeeler has joined #openstack-kolla01:09
*** v1k0d3n has joined #openstack-kolla01:09
*** mbound has quit IRC01:13
*** huikang has joined #openstack-kolla01:18
*** zhiwei has joined #openstack-kolla01:18
*** v1k0d3n has quit IRC01:23
*** jpeeler has quit IRC01:27
*** sacharya has joined #openstack-kolla01:46
*** sacharya has quit IRC01:50
*** salv-orlando has joined #openstack-kolla02:00
*** salv-orlando has quit IRC02:07
*** jtriley has quit IRC02:11
*** daneyon has joined #openstack-kolla02:12
*** daneyon has quit IRC02:17
*** mewald1 has joined #openstack-kolla02:19
*** coolsvap has joined #openstack-kolla02:20
*** mewald has quit IRC02:21
*** daneyon has joined #openstack-kolla02:31
*** stvnoyes1 has joined #openstack-kolla02:37
*** stvnoyes has quit IRC02:40
*** yuanying has quit IRC02:46
coolsvapsdake, have a look at https://hub.docker.com/u/kolla/02:51
openstackgerritSwapnil Kulkarni (coolsvap) proposed openstack/kolla: Remove deprecated package python-tuskarclient  https://review.openstack.org/33260902:57
*** caowei has joined #openstack-kolla02:57
openstackgerritHui Kang proposed openstack/kolla: Add Kuryr Docker container  https://review.openstack.org/29800002:57
*** daneyon_ has joined #openstack-kolla03:08
*** daneyon has quit IRC03:10
*** salv-orlando has joined #openstack-kolla03:14
*** salv-orlando has quit IRC03:21
coolsvapcentos-binary is busted in master03:23
huikangas well as ubuntu-binary03:34
huikangI meant oraclelinux-binary03:35
coolsvapyes both depend on same packaging source rdo03:36
*** Kennan has quit IRC03:42
*** yuanying has joined #openstack-kolla03:47
*** dave-mcc_ has quit IRC03:48
*** sacharya has joined #openstack-kolla03:59
*** williamcaban has joined #openstack-kolla04:03
*** williamcaban has quit IRC04:14
*** williamcaban has joined #openstack-kolla04:15
*** huikang has quit IRC04:21
*** huikang has joined #openstack-kolla04:21
*** Kennan has joined #openstack-kolla04:22
*** huikang has quit IRC04:26
openstackgerritMd Nadeem proposed openstack/kolla: Add unit test for stop and restart container  https://review.openstack.org/33152404:26
*** salv-orlando has joined #openstack-kolla04:28
*** Kennan2 has joined #openstack-kolla04:30
*** sacharya has quit IRC04:31
*** Kennan has quit IRC04:33
*** salv-orlando has quit IRC04:35
openstackgerritMd Nadeem proposed openstack/kolla: Add unit test for stop and restart container  https://review.openstack.org/33152404:38
*** williamcaban has quit IRC04:39
*** williamcaban has joined #openstack-kolla04:49
*** huikang has joined #openstack-kolla04:50
*** daneyon has joined #openstack-kolla04:55
*** daneyon has quit IRC04:59
*** caowei has quit IRC05:01
*** Jeffrey4l_ has quit IRC05:01
*** daneyon has joined #openstack-kolla05:12
*** daneyon_ has quit IRC05:12
*** huikang has quit IRC05:15
*** huikang has joined #openstack-kolla05:16
*** shardy has joined #openstack-kolla05:20
*** huikang has quit IRC05:21
*** caowei has joined #openstack-kolla05:30
*** tfukushima has joined #openstack-kolla05:32
*** salv-orlando has joined #openstack-kolla05:37
*** shardy has quit IRC05:38
*** daneyon has quit IRC05:40
*** hanchao has joined #openstack-kolla05:41
hanchaohello, is there a clear openstack release matched to kolla ? I tried to find that, but it makes me a bit confused...05:43
coolsvaphanchao, can you explain your question? what exactly are you looking for?05:49
hanchaocoolsvap yes, I'm trying to figure out the relationship of the release of openstack and kolla. E.g kolla release 3.0.0 indicates to the current developing version of openstack. then which release indicates to Liberty or Mitaka?05:52
coolsvapmitaka is 2.x current mitaka release is 2.0.1 released on June 06 201605:54
coolsvapliberty is 1.x current liberty release is 1.1.1 June 06 201605:54
hanchaook, but is there a clear document which mentions about this?05:55
*** caowei has quit IRC05:56
hanchaoI can only find something here [http://docs.openstack.org/releasenotes/kolla/]05:56
hanchaobut it looks liberty and mitaka are quite close to each other.05:56
openstackgerritMd Nadeem proposed openstack/kolla: Add test for remove container, get state and get env  https://review.openstack.org/33155605:58
*** gfidente has joined #openstack-kolla06:00
*** williamcaban has quit IRC06:01
*** Jeffrey4l_ has joined #openstack-kolla06:09
openstackgerritMd Nadeem proposed openstack/kolla: Add test for remove container, get state and get env  https://review.openstack.org/33155606:13
coolsvaphanchao, one of the places i can provide you is https://launchpad.net/kolla06:13
hanchaocoolsvap, thanks, here I can see a clear roadmap. :)06:15
hanchaoThen, will this milestones be updated/synchronized into the docs of the release note?06:18
openstackgerritMd Nadeem proposed openstack/kolla: Add test for remove container, get state and get env  https://review.openstack.org/33155606:20
*** caowei has joined #openstack-kolla06:36
*** salv-orl_ has joined #openstack-kolla06:38
*** salv-orlando has quit IRC06:41
mewald1can someone shed some light on how logging works with Kolla? Are logs stored in the containers for example?06:41
*** jmccarthy has joined #openstack-kolla06:42
*** daneyon has joined #openstack-kolla06:43
*** JeroenBo has joined #openstack-kolla06:45
*** david-lyle_ has joined #openstack-kolla06:46
hanchao@mewald1 good point, I wish to learn that, too.06:46
*** daneyon has quit IRC06:48
*** slagle_ has joined #openstack-kolla06:50
*** janmalax_ has joined #openstack-kolla06:50
hanchao@mewald1 seems a log can be checked inside a running container.06:51
*** athomas has joined #openstack-kolla06:53
*** dasm_ has joined #openstack-kolla06:53
hanchaoThen where can we find the log for kolla? I did not see it in the `/var/log/`. Like the `kolla-ansible deploy` can raise exceptions, however the info of the stdout is too less to indicating the root.06:54
*** dgonzalez_ has joined #openstack-kolla06:55
*** intr1nsic_ has joined #openstack-kolla06:55
*** Serlex has joined #openstack-kolla06:56
*** shardy has joined #openstack-kolla06:56
*** dmsimard1 has joined #openstack-kolla06:57
*** sacharya has joined #openstack-kolla06:59
*** Mr_Broken has joined #openstack-kolla07:00
*** ccesario_ has joined #openstack-kolla07:01
*** david-lyle has quit IRC07:04
*** dgonzalez has quit IRC07:04
*** ccesario has quit IRC07:04
*** janmalax has quit IRC07:04
*** dmsimard has quit IRC07:04
*** intr1nsic has quit IRC07:04
*** slagle has quit IRC07:04
*** dasm has quit IRC07:04
*** dgonzalez_ is now known as dgonzalez07:04
*** dasm_ is now known as dasm07:04
*** intr1nsic_ is now known as intr1nsic07:04
*** Serlex has quit IRC07:06
*** fragatina has quit IRC07:07
*** fragatina has joined #openstack-kolla07:07
*** Kennan2 has quit IRC07:09
*** sacharya has quit IRC07:18
*** salv-orl_ has quit IRC07:20
mewald1hanchao: there is a debug flag in kolla-build.conf07:20
mewald1maybe that helps07:21
hanchaobut still, this is for the stdout, not recorded in a file...07:22
mewald1true07:22
mewald1for the build an can live with that though. The runtime logs of services I want to have somewhere safe :) https://github.com/openstack/kolla/blob/master/specs/logging-with-heka.rst This seems interesting in this context07:23
*** jmccarthy has left #openstack-kolla07:44
Mech422__mewald1: the service logs are available in the 'heka' container on each host07:50
Mech422__mewald1: in /var/log/kolla/X07:50
*** Serlex has joined #openstack-kolla07:52
*** b_bezak has joined #openstack-kolla07:56
mewald1Mech422__: yeah I just figured that out :) I found there is "kolla_log" volume where everything is gathered07:59
mewald1But I haven't found out what the heka_socket volume is there for07:59
Mech422__I tried the 'kibana' thing - created the index, but all I found in it was apache stuff08:00
Mech422__Horizon I think08:00
mewald1What is this heka_socket volume all about?08:07
mewald1does heka throw the logs into that socket? what's the point?08:07
*** salv-orlando has joined #openstack-kolla08:14
*** JianqingJiang has joined #openstack-kolla08:16
JianqingJianghi08:17
mewald1hi08:17
JianqingJiangcan password in /etc/kolla/passwords.yml be empty?08:17
mewald1Mech422__: What did you do to deploy elasticsearch and kibana? How does it work?08:18
mewald1JianqingJiang: Nope, I dont think so08:18
JianqingJiangI run precheck , and error log appears08:18
Mr_BrokenHey Guys08:18
Mr_Brokenare you aware of a simmilar bug opened for glance ? https://launchpad.net/bugs/157121108:18
openstackLaunchpad bug 1571211 in Cinder "In multinode setup VM fails to launch due to cinder not checking with all glance api servers" [Medium,In progress] - Assigned to John Griffith (john-griffith)08:18
JianqingJiangBut I fill the password up and it also show error log08:19
Mr_Brokenthere is same problem with glance-cache-manage, even if you use different glance/cinder backends (and try to cache the images)08:19
JianqingJiangAnd I try to run kolla-genpwd command ,but this command is not found in CentOS708:20
Mech422__JianqingJiang: oh - it might be in like ./.tox/..../bin08:20
JianqingJiangPlease help me figure it out08:20
Mech422__JianqingJiang: ./.tox/genconfig/bin/kolla-genpwd08:23
*** mbound has joined #openstack-kolla08:23
JianqingJiangI only find /root/kolla/kolla/cmd/genpwd.py08:23
*** dmk0202 has joined #openstack-kolla08:23
Mech422__JianqingJiang: Hmm - you ran the kolla-build ?08:24
Mech422__I think thats what fires off the Tox stuff08:24
JianqingJiangI can't08:24
JianqingJiangI can't find ./.tox/genconfig/bin/kolla-genpwd08:25
Mech422__JianqingJiang: I think you have to run the kolla-build stuff first, then the preflight checks, then deploy08:25
Mech422__err.. preflight checks, configure, then deploy08:25
JianqingJiang./root/kolla/.tox/genconfig/bin/kolla-genpwd08:26
JianqingJiangI find it in this path08:26
Mech422__yeah - its in the .tox dir of your kolla git checkout08:27
*** sacharya has joined #openstack-kolla08:28
coolsvapJianqingJiang, you need to use kolla-genpwd command which will update the /etc/kolla/passwords.yml08:29
coolsvapall the steps are documented in quickstart08:30
JianqingJiangOK08:30
JianqingJiangBut I think the quickstart is a lit confusing08:31
*** sacharya has quit IRC08:33
JianqingJiangTASK [common : Starting heka bootstrap container] ******************************08:36
JianqingJiangfatal: [localhost]: FAILED! => {"changed": false, "failed": true, "msg": "Unknown error message: Tag 3.0.0 not found in repository docker.io/kollaglue/centos-source-heka"}08:36
JianqingJiang        to retry, use: --limit @/root/kolla/ansible/site.retry08:36
JianqingJiangPLAY RECAP *********************************************************************08:36
JianqingJianglocalhost                  : ok=11   changed=5    unreachable=0    failed=108:36
JianqingJiangI get this error...08:36
JianqingJiangMy docker image tag is 2.0.208:37
Mech422__JianqingJiang: you have openstack_version 3.0.0 in globals.yml08:38
Mech422__JianqingJiang: set it to 2.0.208:38
JianqingJiangThanks08:40
JianqingJiangUnknown error message: Tag 2.0.2 not found in repository docker.io/kollaglue/centos-source-heka08:43
JianqingJiangIs my path wrong ?08:43
JianqingJiangI run "docker images" is ok08:44
JianqingJiangdocker version 1.11.208:44
Mr_Brokenis there 2.0.2 already released ?08:45
Mr_Brokenyou can set the tag to #latest - it should pick one automagicaly :P08:45
Mech422__Mr_Broken: yeah - but 2.X is for stable/liberty and 3.0 is for stable/mitaka08:55
Mech422__or 2.x is for stable/mitaka and 3.x is for master...cant remember atm08:55
JianqingJiangI git checkout mitaka...08:56
JianqingJiangAnd the image tag is 2.0.208:56
Mech422__ahh - 3.X must be for master then08:56
JianqingJiangMech422__:But I think is the path... I can't find docker.io/kollaglue08:58
Mech422__JianqingJiang: Oh..dunno - I've only deployed from a local repo08:59
JianqingJiangI don't have a docker repo...09:00
Mech422__JianqingJiang: yeah - I stand one up in a container before I run kolla...09:01
Mech422__JianqingJiang: its just a 'regular' docker container, with 1 exposed port09:02
JianqingJiangfind  -iname "*docker.io*"09:06
JianqingJiangI ran this command and nothing shows09:06
JianqingJiangIs it ok ?09:06
Mr_Broken2.0 for mitaka (i am using it atm )09:06
Mr_Brokenand 3.0 for Newton09:06
JianqingJiangBut the error log is not found in repository docker.io/kollaglue/centos-source-heka09:07
Mr_Brokenis there centos from sources build available for Mitaka ?09:07
Mech422__Mr_Broken: makes sense - I'm tracking master which is newton now09:07
JianqingJiangCan I change the path?09:07
Mr_Brokennot if you are using outside registry09:08
Mech422__JianqingJiang: its trying to use the docker.io registry09:08
Mech422__JianqingJiang: which is correct if you don't run local registry09:08
Mech422__JianqingJiang: but I've never used it09:08
Mech422__JianqingJiang: and I think coolsvap said some images were broken on there atm...09:09
JianqingJiangBut the quickstart says it's ok if I don't use local registry09:09
Mech422__[20:23] <coolsvap> centos-binary is busted in master09:10
Mech422__[20:34] <huikang> as well as ubuntu-binary09:10
Mech422__[20:35] <huikang> I meant oraclelinux-binary09:10
Mech422__[20:36] <coolsvap> yes both depend on same packaging source rdo09:10
Mech422__JianqingJiang: yeah - it is OK - they were just working on it today, and I think something is busted atm09:10
*** JeroenBo has quit IRC09:10
Mr_Brokenso you either go with Ubuntu, or make centos-binary (not sources)09:12
Mr_Brokenor even better - try to deploy using local registry09:12
Mech422__Mr_Broken: I think you have to build centos from sources - the binary is busted atm09:12
Mr_Brokenoh, fair play09:12
Mr_Brokenyou are doing master/newton JianqinqJiang ?09:13
Mech422__I always build ubuntu source with a local repo - so I don't know anything about centos or docker.io images09:13
JianqingJiangNo,I am just want to deploy the openstack09:15
JianqingJiangBut I am interested in developing the project09:16
*** JeroenBo has joined #openstack-kolla09:24
*** Jeffrey4l__ has joined #openstack-kolla09:25
*** daneyon has joined #openstack-kolla09:26
*** Jeffrey4l_ has quit IRC09:26
*** daneyon has quit IRC09:30
*** Jeffrey4l__ has quit IRC09:35
mewald1Does creating custom build profiles work? I just created a profile called "custom" and "profile = custom" in kolla-build.conf. I ran kolla-build and now everything from keystone to mesosphere is being built.09:37
*** pbourke has quit IRC09:42
*** pbourke has joined #openstack-kolla09:43
*** fragatina has quit IRC10:01
JianqingJiangCan I use my local images to deploy ? I run "docker images" is ok, but when I deploy, the error log shows that kolla is using a outside docker registry...10:08
*** matrohon has quit IRC10:09
coolsvapJianqingJiang, yes i have seen some issues with centos-bnary earlier10:11
*** fragatina has joined #openstack-kolla10:12
JianqingJiangHow I can do to solve my problem...10:13
Mech422__JianqingJiang: you need to run a local registry or do a source build ..10:18
*** tfukushima has quit IRC10:18
coolsvapmewald1, what do you want in custom images?10:20
*** caowei has quit IRC10:24
Mech422__coolsvap: I have to add the novadocker driver to nova image - would that be best as a customization, build profile', or addition to the existing image?10:24
coolsvapI think it is customization10:27
coolsvapbecause it is not something which can be worked out by changing configurations during deployment10:27
*** Jeffrey4l has joined #openstack-kolla10:27
Mech422__coolsvap: thanks!10:28
*** tfukushima has joined #openstack-kolla10:31
*** fragatina has quit IRC10:31
coolsvapJianqingJiang, i do not see you deployed the local docker registry10:37
coolsvapJianqingJiang, please show me the content of /etc/systemd/system/docker.service.d/kolla.conf and /etc/sysconfig/docker10:38
*** Jeffrey4l has quit IRC10:40
coolsvapJianqingJiang, also share the output of docker ps -a10:41
*** JianqingJiang has quit IRC10:50
*** coolsvap has quit IRC10:56
*** coolsvap has joined #openstack-kolla10:57
mewald1coolsvap: I just want a custom profile, but I think I figured it out.11:06
*** Mr_Broken has quit IRC11:10
*** Mr_Broken has joined #openstack-kolla11:11
*** Mr_Broken has quit IRC11:16
*** caowei has joined #openstack-kolla11:16
mewald1During build I get no error messages and the final output shows only "built" and "unmatched". In "docker images" I see a lot of images with name "<none>". Why?11:16
*** phuongnh has quit IRC11:17
coolsvapmewald1, there was an issue with rdo repos earlier in the day11:29
coolsvapwe had same issue in gates causing build failure11:30
coolsvapthis seem to have resolved11:30
*** mliima has joined #openstack-kolla11:36
openstackgerritMerged openstack/kolla: Updated from global requirements  https://review.openstack.org/33230211:47
*** sdake has quit IRC11:48
*** tfukushima has quit IRC11:51
*** dwalsh has joined #openstack-kolla11:57
*** Mr_Broken has joined #openstack-kolla11:58
*** dmsimard1 has quit IRC12:00
*** dmsimard has joined #openstack-kolla12:00
*** sdake has joined #openstack-kolla12:03
sdakecoolsvap did you push teh 3.0.0 tags?12:04
coolsvapsdake, yes12:07
sdakei had only wanted 1.1.0 1.1.1 and 2.0.0 and 2.0.1 pushed12:07
sdake3.0..0 isn't a thing12:07
coolsvap:(12:07
coolsvapi will delete those tonight12:07
sdakethey are really hard to delete12:08
coolsvapi know but i will do12:08
*** daneyon has joined #openstack-kolla12:08
sdakethere is no api12:08
coolsvapsorry for not checking with you12:08
sdakeits ok - 3.0.0 would lmake sense if we could continuously buil12:08
sdakebut that tag would be more like latest12:08
coolsvapsdake, that can be done12:09
coolsvapatleast once a day like a cron job12:09
*** rhallisey has joined #openstack-kolla12:10
sdakethe problem is i'd like it in ci of openstack12:10
*** ccesario_ is now known as ccesario12:10
sdakeand don't knwo how to get the credentials securely in to the gate12:10
sdakei htikn we would better serve our userbae if we provided our stable images first :)12:10
coolsvapsdake, yes i am waitting for some action on the review :)12:11
sdakei really dont understand why there isn't an image delete python api12:11
coolsvapi can start the job for stable tonight and all the images will be available in the morning12:11
sdakeinside ci/cd?12:12
coolsvapsdake, no12:12
*** daneyon has quit IRC12:12
coolsvapfor ci/cd i dont think we can do it in prescribed limit of a gate job12:13
coolsvapor can we?12:13
coolsvapnot sure12:13
sdakewe could if we could get the credentials in the gate12:13
sdakebut again i ddont want free passwords logged into our ci scripts12:13
sdakegit repo is no place for a credential :)12:14
coolsvapyes12:14
sdakecoolsvap i just asked again on openstack infra, recommend joining in case anyone has ideas12:17
coolsvapjoined12:17
*** dave-mccowan has joined #openstack-kolla12:19
mewald1I created a new deployment with Kolla this morning. Now I made sure that elasticsearch and kibana images are built by adding them to my profile. I cant figure out how to deploy them now. According to multinode inventory file, the roles are assigned to "control" but neither kolla-build deploy nor kolla-build pull show anything that relates to elasticsearch. Why is it not being rolled out?12:23
sbezverkcoolsvap ping12:24
coolsvapsbezverk, pong12:25
sbezverk coolsvap: do you know if kubernetes 1.2.4 rpm exists anywhere?12:25
sbezverkI am rebuilding my multinode cluster and do not want to install 1.2.0 and then update to to 1.2.412:26
*** Jeffrey4l has joined #openstack-kolla12:26
Mr_Brokenmewald1: did you put enable_kibana: yes in globals.yml ?12:27
Mr_Brokenkolla-build - only builds docker images12:28
Mr_Brokenkolla-ansible deploy - will deploy those images on the hosts - jsyk12:28
mewald1Mr_Broken: ha shit, or course not . yeah sorry I meant "kolla-ansible" before :)12:28
Mr_Brokenyeah, edit globals.yml ;]12:28
Mr_Brokenit has some undocumented "features" like that ;]12:28
coolsvapsbezverk, let me check12:29
mewald1Mr_Broken: undocumented features - my favorite ;)12:29
sbezverkcoolsvap: thank you12:31
Mr_Brokenmewald1: yeah was having same issues when tried to customise my topology . you can enable more sevices this way12:36
Mr_BrokenI think in newton docs - its described a little bit more12:37
mewald1Mr_Broken: I managed to get elasticsearch and kibana deployed now, BUT: How should I be able to access them? Should haproxy listen on the VIP? If yes: haproxy should have been redeployed, no?12:37
Mr_Brokenyes it should be listening on the VIP if you setup HAProxy12:37
mewald1So, how do I "change" the haproxy config now?12:38
Mr_Brokenhttp://controler:5601/kibana12:38
mewald1I just found kolly-ansible reconfigure - does that do it?12:38
Mr_Brokenit should be changed during deployment12:38
mewald1hmm, ahh can see the port12:38
mewald1thanks!12:38
Mr_Brokennp ;]12:38
*** salv-orl_ has joined #openstack-kolla12:39
Mr_Brokenwhenever you run kolla-ansible it should go thorugh all of the roles/templates and change whats needed ( and skip whats already done )12:40
mewald1ok, what's the default user for kibana? :D12:40
mewald1the kibana default or some other?12:40
Mr_Brokenthe thing is - when you change your topology a bit (like delete a docker , and install some service outside kolla ) - reconfigure will not work for you :/12:40
Mr_Brokenhmm dont remember now ;]12:40
Mr_Brokeni think you have all you need in passwords.yml ?12:41
mewald1ok, Ill figure it out :)12:41
Mr_Brokenthere is also a prefix you need to configure when you start kibana for the first time12:41
Mr_Brokenyou need to check the docs :>12:41
kfox1111Can you override a template with your own?12:41
*** salv-orlando has quit IRC12:41
kfox1111for example, if I wanted to use my own local_settings for horizon?12:41
Mr_Brokenkfox1111: you can change services configuration12:42
Mr_Brokenlet me find the link describing that12:42
kfox1111thx.12:43
*** sdake has quit IRC12:43
Mr_Brokenhttps://github.com/openstack/kolla/blob/master/doc/advanced-configuration.rst#openstack-service-configuration-in-kolla12:43
Mr_Brokenbasicaly you create /etc/kolla/config/service_name/config.conf - edit this files with lines you want to append12:44
Mr_Brokenand run kolla-ansible reconfigure12:44
kfox1111Ah. perfect. thanks.12:45
*** ppowell has joined #openstack-kolla12:47
coolsvapJeffrey4l, around?12:49
Jeffrey4lcoolsvap, yep12:50
coolsvapJeffrey4l, i pushed the images today, i will push them for mitaka and liberty12:50
Jeffrey4lcoolsvap, cool12:50
coolsvapif you want the access rights ping sdake with your email id for docker hub12:50
coolsvaphe pinged most cores yesterday12:50
Jeffrey4lroger that. thanks for the information.12:51
*** vhosakot has joined #openstack-kolla12:53
*** zhiwei has quit IRC12:53
*** JeroenBo has left #openstack-kolla12:55
openstackgerritMerged openstack/kolla: Notify operators that cinder + LVM doesn't work  https://review.openstack.org/33222812:57
*** dwalsh has quit IRC12:57
*** dwalsh has joined #openstack-kolla12:59
*** salv-orl_ has quit IRC13:03
*** zhiwei has joined #openstack-kolla13:05
*** zhiwei has quit IRC13:09
*** vhosakot has quit IRC13:09
openstackgerritMerged openstack/kolla: Add Kuryr Docker container  https://review.openstack.org/29800013:09
*** Mr_Broken has quit IRC13:09
*** slagle_ is now known as slagle13:10
openstackgerritMerged openstack/kolla: Remove deprecated package python-tuskarclient  https://review.openstack.org/33260913:10
*** Mr_Broken has joined #openstack-kolla13:10
*** Mr_Broke_ has joined #openstack-kolla13:11
*** salv-orlando has joined #openstack-kolla13:12
*** Mr_Broken has quit IRC13:14
dimsrhallisey : the kolla meeting is in another 2 and half hours...right?13:20
rhalliseydims, noon EST13:21
dimsack thanks13:21
rhalliseyno problem13:21
dimsrhallisey : the official records needs to reflect weekly - https://review.openstack.org/#/c/327845/1/meetings/kolla-team-meeting.yaml13:23
patchbotdims: patch 327845 - openstack-infra/irc-meetings - Move kolla meeting to 16:00 UTC (MERGED)13:23
dimsthat shows kolla skipping every week :)13:24
dimsevery other week13:24
rhalliseydims, good point :)13:24
dims"frequency:  biweekly-even"13:24
mewald1Mr_Broke_: You might remember I just deploy ES and Kibana with your help. I believe heka should show a configuration to send logs to ES, correct? If so: where should I find it?13:24
rhalliseyi'll fix that real quick..13:25
dimsthanks rhallisey13:25
openstackgerritMerged openstack/kolla-kubernetes: Fix docs for Ansible 2.1 support, remove some of the notes.  https://review.openstack.org/33080513:25
dimsslukjanov got the date wrong and is on a train at the moment...13:25
Mr_Broke_@mewald1: have you seen this ? http://docs.openstack.org/developer/kolla/kibana-guide.html13:27
openstackgerritMerged openstack/kolla-kubernetes: Adding debugging documentation for Memcached  https://review.openstack.org/33076613:27
Mr_Broke_mewald1: it should be done automagicaly, what you need to do is configure kibana after first login - dscribed in the guide13:28
*** jtriley has joined #openstack-kolla13:30
mewald1Mr_Broke_:  yeah I found it, but Kibana gives me "Pattern matches 0% of existing indices and aliases" so I assume messages are not reaching Elasticsearch properly13:33
Mr_Broke_and you did :Index name or pattern - log-* ? when loggin for the first time ?13:35
Mr_Broke_and created an index with the button ?13:35
mewald1yup, but I have a clue: I ran "kolla-ansible reconfigure" and now in the heka container /etc/heka/heka-elasticsearch.toml appeared13:35
mewald1it wasn't there before13:36
mewald1now I am able to use log-* as pattern in Kibana, too13:36
Mr_Broke_weird, it should be there after first deployment13:36
Mr_Broke_great13:36
*** sdake has joined #openstack-kolla13:37
*** inc0 has joined #openstack-kolla13:38
inc0good morning13:38
dimsrhallisey : we probably need to hold the discussion on the fuel/container-agnostic thing next week :(13:38
dimsinc0 : sdake : ^^13:38
rhalliseykk13:39
inc0dims, sure, any chances one of you could go for midcycle?13:39
inc0so we can have also f2f?13:39
inc0dims, basically the only thing I don't agree with (and community seems to be with me) is repo per container13:39
inc0but I'm sure we can figure something out..13:40
*** Mr_Broke_ has quit IRC13:41
dimsinc0 : where/when is the midcycle13:41
inc011-12 Jul Durham13:41
inc0NC13:41
*** Mr_Broken has joined #openstack-kolla13:42
sdakehttps://wiki.openstack.org/wiki/Sprints/KollaNewtonSprint13:42
sdake12-13 ctually13:42
inc0ehh...datetime is hard13:42
sdakedims at ansible HQ13:42
mewald1Mr_Broken: Have you seen that happening or do we assume I found a bug?13:43
rhalliseydid anyone want to share a room? :)13:44
sdakejust a heads up - team meeting in 2 hours13:45
sdakenormally this would be the afternon (for the us folks) meeting13:45
sdakerhallisey i can if your strapped on budget - but i snore13:46
sdakeand it can't be stopped13:46
*** Mr_Broken has quit IRC13:46
dimsinc0 : sdake : ah thanks. sergey is on his way to get stuff sorted out to travel back to US. will have to check where he will be13:47
rhalliseysdake, ya I may take you up on that offer13:47
dimswe can definitely do a webex/remote during the event inc0 - i will check up on possibilities of me coming, but not sure if i can make too much of a difference organizationally13:48
inc0dims, we'll make sure that it will be accessible13:49
dimsthanks inc013:49
sdakeits a shame we can't do full on vr yet13:54
sbezverkinc0 do you have a minute?13:54
sdakethat would make this midcycle stuf alot cheaper13:54
sdakelike in captain america13:55
* sdake wants that tech13:55
*** daneyon has joined #openstack-kolla13:57
sdakedims webex is already setup13:57
sdakedims it only runs on mac and windows tho13:57
inc0sbezverk, I'm here13:58
dimsy no worries sdake : we are used to webex13:58
sdakei used to hate webex at red hat13:58
sdakemainlly becasue it didn't work13:58
sbezverkinc0 do you know if haproxy con work in "on a stick" mode?13:58
sdakeand people would ninja webex during meetings13:58
sdakewhere i'd have to find smoe alternative mechanism to connect13:58
inc0on a stick?13:59
sdakewhat is on a stick13:59
sbezverkinc0 when the traffic in and out of the same interface13:59
mewald1I noticed that Kolla creates Keystone services and endpoints for me. Does it create stuff like cinder volume types etc, too?14:00
sdakemewald1 no only keystone creds14:00
sbezverkwith routers it is called on the stick I thought the same term used here as well14:00
mewald1sdake: ok thx14:00
sdakesbezverk i think haproxy puts data in and out same interface14:00
sdakewe do not use it as a firewall for example14:01
*** daneyon has quit IRC14:01
inc0sbezverk, I have no idea...I thought it just work;)14:01
sdakemewald1 our demo script also creatoes lavors for us14:01
sdakesbezverk the answer is yes - thta is the only way it operates14:01
sbezverkinc0 sdake basically I see request comes in but it does not get proxied to the backend server and I use haproxy vm IP address14:01
sdakesbezverk examples would help :)14:02
sbezverkI am trying to build loadbalancer vm I could use with multinode k8s cluster14:02
sdakedo you mean vm or container14:03
sbezverkso kubelet would use a single api server ip14:03
sbezverksdake vm14:03
sbezverksdake here is my haproxy config http://paste.openstack.org/show/521176/14:04
kfox1111sdake: fyi, I just had to manually tweak some sql migration code to work around a bug. again. :)14:07
kfox1111so manually being able to go through the upgrade workflow is absolutely nessisary still. :/14:08
mewald1Is it possible to configure separate admin, public and internal URLs with Kolla? The services that kind of needs it would be keystone where port 5000 and 35357 represent the public and the admin endpoint of the service.14:09
*** williamcaban has joined #openstack-kolla14:16
sdakekfox1111 coudl yo ugo into more detail14:22
*** signed8bit has joined #openstack-kolla14:22
sdakekfox1111 are you upgrading a stable branch?14:22
sdakekfox1111 fwiw we dont implement upgrades of master branch14:22
sdakeit sort of works, but the upstreaams damage their sql code all the time14:22
sdakeso its not viable imo14:22
sdakesbezverk i am not a haproxy wizard, but I think liine 33 tells api-server to send and receive off of 10.57.120.25414:23
sdakesbezverk i would recommend a container though, dealing with vm networking would be a pita14:24
sbezverksdake nv, I got it working for api and for etcd :-) so the config could be simplified but redundancy stays the same14:24
Mech422__mewald1: yes, you can configure seperate nets - look at the examples in the inventory file showing how to pass api_interface, ceph_interface, etc14:31
Mech422__sbezverk: Are you sure haproxy is the problem?  Firewalls often dont like stick/hairpin mode ?14:32
*** ppowell has quit IRC14:34
sbezverkMech422__ that is why I was asking for "on the stick" :-) but it seems haproxy works fine..14:35
*** ppowell has joined #openstack-kolla14:36
Mech422__sbezverk: yeah - oh cool - so you routing between like a plain libvirsh VM and the docker bridge?14:36
*** williamcaban has quit IRC14:46
*** david-lyle_ has quit IRC14:47
sbezverkMech422__ no it is not docker env. I brought up 5 VMs which is 5 k8s cluster nodes and I needed "external" loadbalancer14:47
Mech422__sbezverk: oh...I always seem to get caught with weird network stuff, because I use OVS for basic 'host' networking, and only pxe runs over native/untagged - all 'real' traffic goes thru ovs trunks14:50
Mech422__sbezverk: so I usually end up with patches and veths and bridges ! Oh My! :-)14:50
*** vhosakot has joined #openstack-kolla14:54
sbezverkMech422__ I try as much as I can to use pcipassthrough so I do not need to deal with software bridges14:55
Mech422__sbezverk: have you tried the sr-iov stuff for pass thru ?14:56
sbezverkMech422__ yep use it all the time for our virtual router15:01
Mech422__sbezverk: oh nice - you like it then ?15:01
Mech422__sbezverk: I haven't tried it yet - or passthru at all.  Kinda hoping I get a reason to in the future...15:03
*** sacharya has joined #openstack-kolla15:08
sbezverkMech422__ well it has its own issues, but when it works, the performance it much much better than any software switching things..15:10
*** sdake has quit IRC15:10
*** coolsvap has quit IRC15:10
*** robcresswell_ has joined #openstack-kolla15:10
*** robcresswell has quit IRC15:10
*** robcresswell_ is now known as robcresswell15:10
*** coolsvap has joined #openstack-kolla15:11
*** huikang has joined #openstack-kolla15:11
*** sdake_ has joined #openstack-kolla15:11
coolsvapsdake_, sorry i was away when all the discussion took place on infra15:15
*** b_bezak has quit IRC15:16
coolsvapsbezverk, hey the most updated rpm i got is 1.2.015:17
*** sdake has joined #openstack-kolla15:18
*** sdake_ has quit IRC15:19
sdakedims you about15:21
dimspong15:21
sdakedims - dont know if you saw my review comment in the multirepo spec for kolla15:22
sdakedims i think there is some confusion around kolla's mission15:22
Mech422__sbezverk: oh - I wondered how the performance was - so pretty close to native then ?15:22
sdakedims if you haven't had a chance to read it yet, please read it15:22
dimssdake : going to look15:22
dimssdake : looks like you and inc0 have countered the perception sufficiently15:25
sdakedims i think mechnically it would be difficult to manage15:25
sdakerather logistically15:26
sdakedims but before we geet into logistics i'd like to understand the need for serpate repositories - haven't seen that yet15:26
inc0and I'm concerned about dependency management - we put deps between containers15:26
*** williamcaban has joined #openstack-kolla15:26
sdakeinc0 those are those pesky logistics i was tlaking about15:26
inc0so we might end up in cross-repo dependency hell for multi-container changes15:26
*** mbound has quit IRC15:27
inc0yeah, I agree sdake, I asked what problem we're solving15:27
inc0before we jump to conclusions15:27
sdakethe elemental spec answered that pretty welll15:27
sdakethis spec, less so15:27
inc0well, elemental spec was about customizations, and we got this one figured out15:28
sdakeright15:28
inc0if there is more issues, I'd like to know them15:28
sdakei would abbandon but i want to incorporate some of that into docs15:28
*** v1k0d3n has joined #openstack-kolla15:30
dimssdake : inc0 : i think the idea is that just like we put out pypi libs with version #'s and then figure out ranges that work togther, eventually we'll want do to the same with containers.15:30
inc0dims, well, with single repo we don't really need to right?15:30
dimsand if a specific repo changes, then run CI for specific things that are implemented in that repo15:30
inc0there are solutions to this problem, but I'm reluctant in making it a problem at all15:31
sdakedims yes this is per image building - i know exactly what your after15:31
sdakedims this can be done in one repo versus many15:31
inc0dims, so, we'll have mechanism for that15:31
dimssdake : am trying to voice sergey's concern (not speaking for myself)15:31
inc0you'll be able to go all batshit crazy about your custom containers15:31
sdakedims yup i know exactly where he is coming from15:32
*** caowei has quit IRC15:32
inc0including properitary soft inside15:32
sdakeinc0 this is different then that15:32
sdakethis is an optimization to only build continers tht change15:32
inc0sdake, we can try to look at build.py to incorporate that15:32
sdakeif the rationale is to only build containers that change, there are ways that already exist to solve that problem15:32
sdakealthough not hiding out in any pubic repos unfortunately15:32
dimsright, bump version in repo, put out a new image, run tests against specifically things that changed in that repo15:33
inc0well, truth be told, you won't be able to do this in docker like that15:33
sdakedims all this is about ci/cd optimization15:33
sdakeinc0 we do at cisco ;)15:33
inc0if base images change, you'll have problem15:33
dimssdake : precisely15:33
inc0sdake, multiple base images15:33
sdakeinc0 in some cases yes15:34
dimsa stack of base images, possibly ability to inject additional base images based on things needed at say a customer site15:34
dimss/images/layers15:34
*** v1k0d3n has quit IRC15:35
sdakehere is something i wrote: http://paste.openstack.org/show/521194/15:35
dimssdake : so in the end a customer environment, they should be able to mint what they want and pick and choose from things15:35
sdakethat prints out all parent and children containers from a list of changed containers that could be genreated by gerrit15:36
dimsthen run CI on stuff and deploy15:36
dimsseparate repos forces you to think that way15:36
sdakethis input could be fed right back into build.py15:36
* dims still wearing sergey's hat15:37
sdakedims fwiw  Ithink a whole lot of repos for work that is related is an anti-pattern15:37
sdakeroger15:37
inc0dims, to do that well, you can use tags15:38
inc0you should use tags15:38
inc0like centos-source-base:my-own-tag15:38
sdakewhat I am saying is and I'd like you to confirm if you understand, there are ways that what sergey wants (to optimize cic/dd run time) can be done without a bajillion repos15:39
inc0yeah, what sdake said;)15:39
dimssdake : yes, i confirm that i understand :)15:39
sdakewhat sergey is saying I think is he wants to force that way of thinking15:39
dimsyep15:39
sdakewith multiple repos15:39
sdakeI understand that part of things, i think there is more to it15:40
sdakebut to be entirely blunt, I think separating the repos has the potential to kill the project15:40
sdakeand that risk is not worth the gain of forcing dependency modeling in the repos themselves15:40
sdakefwiw, when we did the mission statement, i foguht for universal container idea, but it was rejected15:41
sdakenot for multiple repos15:41
sdakebut or othres to be able to reuse our containers - and explicitly call it out in our mission statement15:41
dimsack. we can always provide feedback that of the things in that spec, that one is not-negotiable15:42
sdakeeverything is negotaiable15:42
sdakebut the multiple repos is dangerous to me personally15:42
wirehead_FWIW, I doubt we’re going to get the ‘universal container’ regardless.  The best we’re going to do is some refactoring of our existing setup to split the kolla-ansible logic from the feeding of the jinja template itself.15:42
sdakeseems dangerously15:43
sdakeseems dangerous that is15:43
dimswirehead_ : there's a fuel spec and they will try to do it themselves15:43
sdakewe already have an abi and well established precedent of not making it ansible specific15:44
sdakewe wnat others to use our containers, so there is one community maintaining them15:44
dimssdake : ++ (speaking for myself)15:45
*** daneyon has joined #openstack-kolla15:45
sdakedims there is another frankly in here too15:46
sdakewe have a whole lot of stuff on our plates that could take onwards of two+ years to sort out15:46
wirehead_I’ve read the spec, dims.15:46
sdakefitting this in as a priority isn't super high in my mind15:46
dimssdake : yep.15:46
sdakethe making the containers universal yes - making them separate repos no15:46
wirehead_That’s less a “I doubt they’ll try it” and more a “I’m not sure you’ll get any farther than some kolla refactoring would get you"15:47
*** daneyon_ has joined #openstack-kolla15:48
sdakewe have the abi we have today mostly because of tripleo integration15:48
dimswirehead_ : i dunno how far they would get or if they will succeed, just that fuel-ccp-* repos will be started and there will be folks working on it there15:48
sdakeif we had no abi, things woudl be simpler - then we would just deploy via ansible15:48
*** daneyon has quit IRC15:49
dimssdake : as long as there are no ansible specific bits in the images was the concern i think15:50
sdakethere are non today15:50
sdakenone15:50
*** harlowja_at_home has joined #openstack-kolla15:50
inc0dims, we were very careful not to put ansible specific stuff15:51
*** huikang has quit IRC15:51
dimsso then it becomes an argument for a repo split15:52
inc0yeah, and I'll argue that any customization or whatever can be done without repo split15:52
inc0in fact, it will be easier as it won't require lots of merging/rebasing of forked contaniers15:52
dims:)15:53
inc0...once we're done implementing it;)15:53
Mech422__fwiw, I think the real value add in kolla is not the containers themselves, but the knowledge of how to wire them all together, bootstrap, and make them happy..15:53
inc0and building only changed containers....well, we can filter out builds in our build.py now15:53
inc0Mech422__, it's both, creating containers took a lot of time too15:53
sdakeMech422__ figuring that stuff out adds value in the containers themselves15:54
inc0all the idiosyncrasies between OSes, user and dir management15:54
Mech422__inc0: I can imagine....but I'd also think it will become more common for various projects to produce containers themselves ?15:54
dimsso it looks like the greatest push back is on "One Repository per OpenStack component" and others are yes, we should do it, we are already trying to and we need help to implement those15:54
*** ppowell has quit IRC15:54
sdakedims i dont know if that is totaally accurate15:55
inc0Mech422__, right now we have well established standards that will make adding new containers easier15:55
sdakedims the problem is my brain sees split repos15:55
dimstaking a temperature sdake15:55
sdakeand i have a hard time procesing the rest of the spec15:55
Mech422__inc0: the 'idiosyncrasies' I think are part of the 'wire them together' - thats 'lore' that gets 'lost' quite often15:55
inc0yeah you can think of it like that15:55
inc0dims, so I had some issues with bootstrap outside container, but that's mostly tech stuff15:56
inc0how we actually do it15:56
sdakeyes i dont like that idea either15:56
sdakebut i dont like our current bootstrapping15:56
dimssdake15:56
dims"Separate containers definitions and deployment tools" << split ansible into separate repo - we have talked about it in the past, we are already not using ansible in images/definitions so do-able.15:56
dims"One Repository per OpenStack component" << Not worth the effort, probably counter productive to health15:56
sdakewhat I would prefer is one container bootstrap the whole damn thing15:56
Mech422__dims: personally, 1 repo makes it a bit easier for me to get started with...but to be honest, learning the 'lore' and how everythign fits together is the bigger issue for me15:56
*** Serlex has quit IRC15:56
inc0I like the idea, I just say we might not be able to without compromising part of security15:57
dims"nified paths and endpoints" << no push back in comments15:57
dims"CI pipeline" << no push back in comments15:57
sdakewe have unified paths15:57
inc0yeah kinda, depends what you mean by that15:57
sdakeevery container is standardized15:57
rhalliseyinc0, I think the split repo argument can change with kube though15:57
inc0kolla-start.sh is pretty standarized15:58
inc0rhallisey, what do you mean?15:58
inc0btw meeting15:58
sdakeinc0 he means shaving off ansible into a separate repo15:58
sdakeya meeting tie15:58
rhalliseywell you talking about multiple deployment tools in a repo15:58
rhalliseyboth consuming the containers15:58
inc0rhallisey, not really, we were taling about multiple repos for containers15:58
dimsi gotta run. will rope sergey to the next meeting and give him logs for this one (too bad he is travelling)15:58
sdakelater dims15:59
inc0so heat dockerfiles will be in separate repo than nova15:59
inc0cya dims15:59
rhalliseydims, bye!15:59
rhalliseyinc0, no I mean kolla-anisble split from kolla-kube15:59
rhalliseynot for splitting containers15:59
inc0yeah, we talked about splitting containers15:59
inc0as for kolla-kube vs kolla-ansible, we agreed to shelve this discussion till we have more concrete evidence;)16:00
inc0we didn't make a call either way, just to say "we'll examine later"16:00
*** britthouser has joined #openstack-kolla16:00
*** number80 has joined #openstack-kolla16:01
number80hello, I'm currently checking global-reqs, and it appeared that kolla is the only project having it in its requirements16:02
*** dmk0202 has quit IRC16:02
number80but it looks like it's not even used, can someone confirm that?16:02
number80ok found it, it's still used16:07
*** harlowja_at_home has quit IRC16:12
*** mbound has joined #openstack-kolla16:27
*** vhosakot_ has joined #openstack-kolla16:28
*** vhosakot has quit IRC16:30
*** JoseMello has joined #openstack-kolla16:31
*** mbound has quit IRC16:32
*** athomas has quit IRC16:38
*** huikang has joined #openstack-kolla16:46
*** sacharya_ has joined #openstack-kolla16:47
*** sacharya has quit IRC16:50
openstackgerritMerged openstack/kolla: Spec: Deploy Kolla images using Kubernetes  https://review.openstack.org/30418216:50
*** ssurana has joined #openstack-kolla16:51
*** shardy has quit IRC16:56
rhalliseywirehead_, so what do you have demo able?16:59
rhalliseykeystone + mariadb + memcached ?17:00
wirehead_So, fired up MariaDB, MemcacheD, Keystone, and Horizon.. all of the services that have net=host removed.17:00
rhalliseyv nice17:00
wirehead_Horizon was able to find Keystone and interact with the API to add users, etc.17:00
wirehead_I can kill Keystone and the RC will restart it and everything’s fine.17:00
rhalliseywirehead_, dude with anisble the deployment experience  will be 10x better17:00
rhalliseycan't wait17:01
wirehead_And kfox1111 was able to just deploy Horizon without the rest of the stack.17:01
inc0wirehead_, did docker networkign stop to suck big time?17:01
rhalliseywirehead_, that's awesome17:01
*** mgoddard has quit IRC17:01
wirehead_inc0: So, correctly configured kube 1.2+ bypasses the docker proxy.17:01
rhalliseywirehead_, hmmm, that's an interesting idea17:01
wirehead_inc0: I haven’t run any bench tests yet.17:01
inc0yay for correctly configured kube17:01
rhalliseywe should decouple our plays enough so you can deploy just one managed by kube17:01
wirehead_Basically, iptables backed by etd.17:01
wirehead_etcd.17:02
* rhallisey gets lunch17:02
wirehead_Especially for compute nodes.  Compute nodes via kolla-ansible with the rest in kolla-kubernetes.17:02
inc0wirehead_, that and networking ndoes17:03
inc0as you don't want l3 agents floating around as well17:04
*** huikang has quit IRC17:06
*** Jeffrey4l has quit IRC17:08
*** sdake_ has joined #openstack-kolla17:09
*** sdake has quit IRC17:10
*** ppowell has joined #openstack-kolla17:23
*** huikang has joined #openstack-kolla17:24
*** sdake_ has quit IRC17:29
*** coolsvap has quit IRC17:30
*** david-lyle has joined #openstack-kolla17:30
*** daneyon has joined #openstack-kolla17:33
openstackgerritDavid Wang proposed openstack/kolla-kubernetes: Simplify DNS docs, removing need for user decisions  https://review.openstack.org/33293717:35
*** daneyon has quit IRC17:38
*** huikang has quit IRC17:42
*** ppowell has quit IRC17:43
*** zhiwei has joined #openstack-kolla17:50
*** ppowell has joined #openstack-kolla17:52
*** bootsha has joined #openstack-kolla17:53
*** zhiwei has quit IRC17:54
*** salv-orlando has quit IRC18:02
*** salv-orlando has joined #openstack-kolla18:03
harlowjawhat'd i miss from meeting :-P18:03
*** ssurana has quit IRC18:05
*** ppowell has quit IRC18:06
*** ppowell has joined #openstack-kolla18:07
*** salv-orlando has quit IRC18:07
*** ssurana has joined #openstack-kolla18:08
*** huikang has joined #openstack-kolla18:09
Mech422__harlowja: apperently - everyone :-P18:12
harlowjalol18:12
Mech422__harlowja: umm - there was talk about single vs multiple repos18:13
Mech422__harlowja: and discussion about tracking gate failures so we can map out what needs to be fixed18:13
Mech422__harlowja: and stuff about refactoring build.py, and converting dockerfiles to the new customization stuff18:14
harlowjaya, i'd like to know if there is any little docs for how the config stuff is working18:14
Mech422__harlowja: I think that was the highlights...18:14
harlowjahttps://review.openstack.org/#/c/332590/ (does this one even make sense)18:14
patchbotharlowja: patch 332590 - kolla - Allow for externally managed configuration18:14
harlowjain that i don't want kolla to do all the config stuff, i'm just gonna bindmount stuff in (that puppet has put in place already)18:14
harlowjabut i don't know the details on all that config magic sauce18:14
Mech422__harlowja: there was a link inc0 sent out on how customization works...but I just realized I closed the meeting tab without copying it18:14
harlowjalol18:15
harlowjainc0 send it again :-P18:15
Mech422__harlowja: here's the etherpad for tracking gate problems: https://etherpad.openstack.org/p/kolla-gate-failures18:15
harlowjaalso the whole config stuff, is anyone thinking of refactoring that whole junk18:17
harlowjathe oslo.config stuff that is18:17
harlowjaits hella confusing18:17
harlowja(unnessasarly confusing imho)18:17
harlowja* unnecessarily18:17
Mech422__harlowja: have you seen http://augeas.net18:18
harlowjaaka, why is it just something like $ kolla-build <config-file> and thats it :-P18:18
harlowjavs u can do some of this via CLI options, u can do some of it via something else ....18:18
harlowjai have seen augeas, i haven't used it much18:18
harlowjai was going to at one time use augeas in cloud-init18:18
harlowjafor doing configuration things18:19
Mech422__harlowja: I'm always surprised there's no pre-existing lenses for openstack for it18:19
openstackgerritKen Wronkiewicz proposed openstack/kolla-kubernetes: Adding debugging documentation for Keystone  https://review.openstack.org/33078818:19
Mech422__harlowja: it makes config file manipulation dead easy, and very consistent18:19
harlowjaya, i forget the reason i never used it in cloud-init18:19
*** sacharya_ has quit IRC18:20
Mech422__harlowja: right now, I 'pre-cook' my globals file with jinja...18:21
*** sacharya has joined #openstack-kolla18:21
Mech422__harlowja: so I have a copy of globals with all the '{{' changed to '!!' and all the "}}" changed to "@@"18:21
harlowjaya, i need to figure out the X different ways kolla has config, lol18:21
Mech422__harlowja: so I can add in my custom jinja, run it thru the template module to 'pre-cook' it...18:22
harlowjaright, that's for container configuration right?18:22
harlowjaor is that for kolla config?18:22
Mech422__harlowja: then sed the '!!' back to "{{", etc and hand it back to kolla to do ITS jinja processing18:22
harlowjaor is it for oslo.config18:22
harlowjaor is it for some other config, lol18:22
Mech422__ah well..time for bed...18:23
harlowjalol18:23
Mech422__harlowja: take care!18:23
harlowjalata18:23
harlowjalet me see what inc0 can find for configs usage in kolla, it'd be real nice to not have 10000 different formats for config into kolla (or into containers or ...)18:26
harlowjain fact i can share how i did this in anvil18:27
harlowjawhere we sorta settled on 3 different types of config (all yaml)18:27
*** daneyon_ has quit IRC18:27
*** daneyon has joined #openstack-kolla18:28
*** bootsha has quit IRC18:31
*** gfidente is now known as gfidente|afk18:34
wirehead_see, to the universal container and architecture of openstack thing, I really wish we could inflict upon the rest of the community a single container-friendly config standard. :)18:36
*** mbound has joined #openstack-kolla18:39
*** matrohon has joined #openstack-kolla18:43
harlowjawirehead_ so that's 1 of the configurations for containers18:44
harlowjathe other one that i'm also confused about is the kolla config itself, lol18:45
harlowja(for kolla)18:45
harlowjait seems ummm, somewhat all over the place18:45
harlowjalike there is globals.yml (which i guess is for ansible?)18:45
harlowjathen there is some CLI options18:45
harlowjathen there is some config file options18:45
harlowjasome of those are dynamic, some aren't18:45
harlowjawhich is hella-confusing18:45
*** sdake has joined #openstack-kolla18:47
wirehead_yeah18:47
harlowjaso ya, idk maybe people just like the pain of that18:47
harlowjabut i sure don't, lol18:47
harlowja<rage pain>18:48
harlowjalol18:48
wirehead_It’s like the config pain of an expression that requires you to have the C operator prescedence table printed out.18:48
harlowjaya18:48
harlowjain all honesty, i'm not even sure why oslo.config is being used in kolla18:48
harlowjaseems sorta useless and just makes shit more confusing18:48
harlowjavs just using the basic configparser and having all things go into that18:49
harlowjathen its just kolla-build <kolla-config>18:49
harlowjaand thats it18:49
harlowjaor damn, don't use cfgparser and just use yaml18:49
harlowjasimple ===== good18:50
*** sdake_ has joined #openstack-kolla18:55
sdake_harlowja i'm not entirely sure why we are using oslo.cfg either18:55
harlowjaya, that whole stuff confuses me, lol18:56
sdake_the reason we re not using yaml is yaml is a dependency18:56
sdake_and the target nodes should be dep free minus docker-py and docker18:56
harlowjanah, i meant for kolla itself, not the containers18:56
sdake_but in this case it would run on the deployment host18:56
harlowjathe config in the containers, slightly different imho, i don't quite yet understand that part so far18:57
harlowja(understand the container configuration stuffs)18:57
sdake_harlowja its a little hard to understand bbecause it was complicated by drop root18:57
harlowjawhose drop root?18:57
sdake_i can wlak you through it if you like18:57
sdake_the drop root we added to containers18:57
harlowjaah18:57
harlowjai thought drop root was a IRC user, ha18:58
harlowjadamn u drop root18:58
harlowjalol18:58
*** sdake has quit IRC18:58
harlowjasdake_  sure at a time, maybe not yet, gotta finish writing up some specs (internally)18:58
*** achanda has joined #openstack-kolla18:58
sdake_unfortunatley i have a meeting in 2 mins18:58
sdake_it would tke 5 minutes to go through it18:58
harlowjak18:58
sdake_maybe 10 or 1518:59
harlowjau should write that stuff down and put it in a 'kolla config and wtf are the X configs doing/for/why' doc :-P18:59
sdake_line numbers change in code18:59
harlowjalol19:00
harlowjathat's ok, we'll fix those line numbers changing soon enough19:00
harlowjano more code19:00
harlowjalol19:00
sdake_there has to bbe code to parse the json19:00
sdake_the json is the abi19:00
sdake_its super obvious once someone explains it to you19:01
harlowjak19:01
sdake_but not from looking at the code base randomly19:01
harlowjaya19:01
harlowjai tried that approach, and am like <what the heck>19:01
harlowjalol19:01
wirehead_Well, might be useful to at least write down the expected protocol for what you would config where.19:01
*** achanda has quit IRC19:02
wirehead_For example: the discussion related to change 32792519:02
inc0wow that's a lot of logs to read through19:03
*** bootsha has joined #openstack-kolla19:04
inc0harlowja, ok ad configs19:05
inc0best idea I have right now is to decouple config generation from deployment19:05
inc0so you generate configs, go to vim, edit whatever the hell you want19:05
inc0and then actual deploy will use it19:05
*** huikang has quit IRC19:12
*** b_bezak has joined #openstack-kolla19:14
*** huikang has joined #openstack-kolla19:25
*** sdake has joined #openstack-kolla19:31
*** sdake_ has quit IRC19:33
harlowjaright, inc0 so thats for the container configs, just want to make sure we talking about which configs, lol19:35
harlowjathe stuff that is a mix of yaml, and json and ???19:35
*** fragatina has joined #openstack-kolla19:41
*** fragatina has quit IRC19:42
*** fragatina has joined #openstack-kolla19:42
*** thumpba has joined #openstack-kolla19:43
*** jogam82 has joined #openstack-kolla19:55
jogam82hi kolla team anyone out there?19:55
inc0out where?19:55
inc0we're here, not sure about "there"19:56
*** bootsha has quit IRC19:58
jogam82haha... just build/deployed the latest Kolla from github on a 4 node env including cinder via loopback blockdevice, now I can create a volume via 'cinder create 1 --display-name testVolume' which results in status eror19:58
inc0jogam82, globals.yml plz19:59
jogam82oh hosts are Ubuntu 16.04 LTS and I build latest19:59
inc0did you enable cinder and select driver for it?20:00
*** sdake_ has joined #openstack-kolla20:01
jogam82@inc0: here you go --> http://paste.openstack.org/show/521274/20:02
inc0so, could you please paste me logs from cinder?20:02
jogam82I assume so, followed the kolla openstack cinder intro, which is missing the small part of adding enable_iscsi: "yes"20:03
inc0you can find all service logs in /var/lib/docker/volumes/log_data20:03
inc0good catch jogam82 ! wanna make a patch for it?:)20:03
inc0you'll be a contributor to kolla!20:03
*** salv-orlando has joined #openstack-kolla20:04
*** sdake has quit IRC20:04
jogam82no such folder on either control or storage node: sudo ls /var/lib/docker/volumes20:05
jogam82returns cinder  heka  heka_socket  iscsi_info  kolla_logs  metadata.db20:05
inc0kolla_logs*20:05
inc0my mistake20:05
jogam82whohooo that would be a great contribution I suppose...20:05
inc0it would be a contribution, and a valuable one20:06
jogam82is there a definite guide to make contributions or just fork/branch/**FIX**/commit and notify someone?20:06
inc0jogam82, http://docs.openstack.org/infra/manual/developers.html20:07
inc0we have proper process for that20:07
inc0I encourage you to try and contribute, good karma;)20:08
inc0but take a look at logs, maybe they will give you some insight of what went wrong20:08
*** vhosakot_ has quit IRC20:11
*** ppowell has quit IRC20:13
*** vhosakot has joined #openstack-kolla20:14
*** daneyon_ has joined #openstack-kolla20:15
jogam82inc0, took a while here is the /var/lib/docker/volumes/kolla_logs/_data/cinder/cinder-volume.log from the storage node: http://paste.openstack.org/show/521276/20:16
*** bootsha has joined #openstack-kolla20:19
inc0hmm20:19
inc0I don't know:S20:19
*** daneyon_ has quit IRC20:20
inc0sbezverk, around?20:20
inc0jogam82, sbezverk was person who wrote iscsi support, so he might help you20:21
inc0if not, please file a bug, we'll try to reproduce20:22
*** salv-orlando has quit IRC20:27
*** vhosakot has quit IRC20:28
*** salv-orlando has joined #openstack-kolla20:28
*** matrohon has quit IRC20:28
*** vhosakot has joined #openstack-kolla20:31
*** sdake_ has quit IRC20:34
*** huikang has quit IRC20:35
*** huikang has joined #openstack-kolla20:35
*** jtriley has quit IRC20:36
jogam82inc0, seems odd I can create a virtual volume on the storage node itself via lvcreate no problem, but from the cinder_volume instance its failing...20:39
*** fragatina has quit IRC20:39
*** huikang has quit IRC20:39
jogam82inc0, I was also wondering why iscsi is required for cinder to use LVM volume group?20:40
inc0jogam82, well, creation of volume is one, but you need to access it somehow right?20:41
*** huikang has joined #openstack-kolla20:44
*** b_bezak has quit IRC20:46
jogam82inc0, true enough but neither swift nor ceph use the iscsi approach - but who am I to say anything, just wondering and it took me a while to figure it out...20:47
inc0ceph is different driver20:47
inc0in fact, I use ceph driver instead of lvm+iscsi20:47
inc0and true, it's different approach, totally different arch20:48
*** matrohon has joined #openstack-kolla20:52
inc0jogam82, btw you are aware that we have ceph in kolla right?20:52
inc0and in fact it's better tested than iscsi..which is counterintuitive, but there are reasons for it20:53
*** thumpba has quit IRC20:55
openstackgerritKen Wronkiewicz proposed openstack/kolla-kubernetes: Glance works without host network  https://review.openstack.org/33302220:57
*** huikang has quit IRC20:58
jogam82inc0, I think the problem is that kolla assumes that build and execution is as root user, is that possible?21:00
inc0it might21:00
inc0as rootwrap will require root priviledges21:00
jogam82inc0, on my storage node I can create volumes via sudo lvcreate ...21:00
inc0but that's cinder issue,21:00
inc0well, in container we dont run sudo21:01
inc0so it will get privs of user who runs docker I guess21:01
inc0not sure tho21:01
jogam82but from the cinder_volume instance it executes the rootwrap with sudo, but the command lvcreate itself does not have the sudo prefix21:01
jogam82I might just 'enhance' the lvm command in the container21:02
*** matrohon has quit IRC21:06
*** rhallisey has quit IRC21:07
vhosakotjoin #docker21:09
vhosakotoops... sorry :)21:09
vhosakottypo :)21:09
openstackgerritKen Wronkiewicz proposed openstack/kolla: Horizon interface address and memcached override  https://review.openstack.org/33082821:09
jogam82inc0, is each container pulling openstack released packages into a venv that I can obviously not edit? is there a 'configuration layer' that can be used to add 'minor' changes?21:10
Davieyayoung: Hey.  I read your blog on using kolla for keystone work recently... I wondered, did you set it up to do LDAP/AD (and bonus points for kerberos)?21:15
ayoungDaviey, I did not.  Are you interested in help along those lines?21:15
Davieyayoung: Yeah. :)21:16
ayoungThere are some interesting things going on with Kerberos and containers, but I need to get smart on them before I can talk about them.  the #freeipa team is a little more current with them due to the need to integrate with openshift21:16
openstackgerritKen Wronkiewicz proposed openstack/kolla: Horizon interface address and memcached override  https://review.openstack.org/33082821:16
openstackgerritKen Wronkiewicz proposed openstack/kolla: Fix interface address for memcached atop kubernetes  https://review.openstack.org/32798721:16
openstackgerritKen Wronkiewicz proposed openstack/kolla: Glance interface address, memcached override, and glance override.  https://review.openstack.org/33248121:16
ayoungDaviey, my guess is that you make each container into its own host/service, so that service tickets will work21:17
Davieyayoung: Yeah.  I guess to start with, just having LDAP/AD integration would be a good start. :)21:18
ayoungDaviey, so that should not be different from any other Keystone LDAP integration21:18
Davieyright21:18
ayoungDaviey, http://adam.younglogic.com/2015/02/adding-an-ldap-backed-domain-to-a-packstack-install/21:19
ayoungDaviey, the only issue is that, since it is a domain specific config, you need to restart the Keystone server21:19
Davieyayoung: I doubt i've missed one of your blog posts. Always a good read.21:20
ayoungThanks21:20
ayoungDaviey, so the guy driving Kerberos Docker integration sits right behind me on the odd day that we both decide to go into the office.21:21
ayoungNalid D21:21
ayoungDahyabhai21:21
* ayoung checks to see if he spelled it right first try21:21
Davieyhah.  Useful to have people like that nearby21:22
ayoungwoot21:22
ayounghe's awesome. Wrote certmonger21:22
ayounghe's on the RH docker team now, but has loads of Crypto based experience21:22
DavieyLooking forward to seeing what comes of that21:23
ayoungDaviey, ask me again in #freeipa21:23
*** sdake has joined #openstack-kolla21:28
*** bootsha has quit IRC21:34
*** sdake_ has joined #openstack-kolla21:38
*** sdake has quit IRC21:39
*** dwalsh has quit IRC21:43
*** huikang has joined #openstack-kolla21:58
*** huikang has quit IRC21:58
*** signed8bit is now known as signed8bit_Zzz22:03
*** daneyon_ has joined #openstack-kolla22:04
*** inc0 has quit IRC22:05
*** daneyon_ has quit IRC22:08
*** JoseMello has quit IRC22:09
*** ssurana has quit IRC22:13
*** ssurana1 has joined #openstack-kolla22:13
*** sdake has joined #openstack-kolla22:21
*** sdake_ has quit IRC22:24
*** achanda_ has joined #openstack-kolla22:29
*** sdake_ has joined #openstack-kolla22:31
*** sdake has quit IRC22:34
*** daneyon has quit IRC22:41
*** daneyon has joined #openstack-kolla22:41
*** sdake_ has quit IRC22:49
*** asalkeld has joined #openstack-kolla22:49
wirehead_kfox1111: OK, I was really wondering about if it was going to be better to separate out the Glance services.22:53
wirehead_kfox1111: except that I couldn’t find any recommendations in the docs either way.22:54
*** vhosakot has quit IRC22:54
*** salv-orl_ has joined #openstack-kolla22:58
*** salv-orlando has quit IRC23:00
*** salv-orl_ has quit IRC23:06
openstackgerritKen Wronkiewicz proposed openstack/kolla-kubernetes: Glance works without host network  https://review.openstack.org/33302223:09
*** williamcaban has quit IRC23:13
*** sdake has joined #openstack-kolla23:24
*** sdake has quit IRC23:42
*** sacharya has quit IRC23:51
*** lmiccini has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!