Tuesday, 2015-09-08

*** dimsum__ has quit IRC00:03
openstackgerritMerged stackforge/kolla: Add missing node types to Vagrantfile  https://review.openstack.org/22095500:06
*** sdake has joined #kolla00:18
sdakecoolsvap ping re ceilometer00:19
*** weiyu has joined #kolla00:22
*** banix has joined #kolla00:23
*** banix has quit IRC00:27
*** jtriley has joined #kolla00:30
*** jtriley has quit IRC00:35
*** weiyu has quit IRC00:37
*** weiyu has joined #kolla00:39
*** akwasnie has quit IRC00:39
*** dimsum__ has joined #kolla00:48
*** weiyu has quit IRC00:59
*** weiyu has joined #kolla01:06
*** weiyu has quit IRC01:15
openstackgerritMerged stackforge/kolla: Add rsyncd image and related Ansible for Swift  https://review.openstack.org/22017201:15
*** alisonh has quit IRC01:21
*** zhiwei has joined #kolla01:25
*** erkules_ has joined #kolla01:30
*** dolpher has joined #kolla01:30
kjellyHi guys, I use `tools/build.py -n 172.22.2.81:5000/kollaglue --base ubuntu --type source --push` to build images. And the deployment failed again when create glance endpoint. The reason why it can't create glance endpoint is that there are no table in keystone database. I try many ways and always get the same error. What's wrong for me?01:31
kjellyI use the command to deploy, "ansible-playbook -i inventory/all-in-one -e @/etc/kolla/globals.yml -e @/etc/kolla/passwords.yml site.yml -vvvv"01:32
kjellyusing root.01:32
*** erkules has quit IRC01:33
*** banix has joined #kolla01:39
*** alisonh has joined #kolla01:39
*** dimsum__ has quit IRC01:40
sdakekjelly what ip are you deployign to?01:40
sdakeif your deploying to 172.22.2.81, that is where keystone is running01:41
sdakeyour also running your registry there01:41
sdakethis will cause the ports to collide01:41
sdakethat would be my best guess as to why keystone dbs are not found01:41
sdakein other words is your registry running on the host your deploying from?01:42
sdakeif the answer is yes, chagne your registry port01:43
*** weiyu has joined #kolla01:46
*** dolpher1 has joined #kolla01:46
*** dolpher has quit IRC01:48
kjellysdake: The ip which is used for deploy openstack is different from docker registry machine.01:50
kjellykjelly: I deploy openstack to virtual machine.01:50
sdakewhat ip do you use for the internal kolla address?01:51
sdakethe one in globals.yml01:51
*** alisonh has quit IRC01:51
sdakeit has to be an unused ip address - it becomes a virtual ip addrss01:52
kjellykolla_internal_address: "10.10.10.254"01:52
sdakefrom your host try telnet 10.10.10.254 330601:52
sdakesee if that connects you to the database01:53
kjellymy virtual machine is 10.0.2.1501:53
sdakeyour internal address i think needs to be in the same subnet as your vm01:53
sdakeset yur internal address to 10.0.2.25401:54
kjellyI connect to 3306 and display   5.5.5-10.0.21-MariaDB-1~trusty-wsrep-logxq3FEh[o?�.b)@H)4e&+BLmysql_native_password01:54
sdakeok that looks good01:54
kjellyHow to make sure the code is executed ? https://github.com/stackforge/kolla/blob/master/docker/keystone/start.sh#L2601:55
kjellyIt seems that the code is not executed.01:55
sdakethat is one explination or another is your database cannot be accessed01:56
*** alisonh has joined #kolla01:56
sdakewhy not just deploy to your bare meatl machine?01:56
sdakei would still try setting your internal address to 10.0.2.25401:56
sdakeand delete everything and start fresh in the vm01:57
kjellyI have no bare meatl machine01:57
sdakeyou can use cleanup-containers -fv in the vm to do the job01:57
kjellyOk.01:58
kjellyTry it again.01:58
sdakenote if your bootstrap failed previosuly kolla isn't smart enough to detect this and run it again01:59
sdakeso if you never cleaned up your vm prior and were running into deployment problems you may experience this problem01:59
kjellyI see.02:00
sdakecleanup-containers is in the tools directory02:00
sdakeplease paste your globals.yaml02:01
*** jtriley has joined #kolla02:01
sdakekjelly ^^02:03
kjellysdake: wait a moment. I close the virtual machine.02:03
kjellysdake: sorry02:04
kjellysdake: here is my gloal.yml  https://gist.github.com/ya790206/873d67ef7decf902e48f02:06
*** jtriley has quit IRC02:06
sdakei think your configisn't correct02:07
sdakelet me past emine02:07
sdakehttp://ur1.ca/npj5n -> http://paste.fedoraproject.org/264629/1441678002:07
sdakealso docker on your vm must be set to use an inseucure registry02:07
sdakehttp://ur1.ca/npj6h -> http://paste.fedoraproject.org/264630/1678138102:09
sdakemy etc/sysconfig/docker file02:09
kjellymy docker config in /etc/default/docker is DOCKER_OPTS="--dns 8.8.8.8 --dns 8.8.4.4  --insecure-registry 172.22.2.81:5000"02:10
sdakethe default for insecure registry is false02:12
sdakeyou need to override it to true iirc02:12
sdakesee line 40 in my globals.yml paste02:12
kjellyOk, I change my settings.02:14
kjellyBy the way, what is  the ip of p1p1, em1 in your machine ?02:17
sdakeem1 is set to 192.168.1.10002:19
sdakeon the bar emetal machines its 192.168.1.101-10302:19
sdakep1p1 is unset - and should be in your vm02:20
kjellyOk.02:23
sdakekjelly did that get you rollilng?02:32
kjellysdake: The problem still exists.02:34
sdakeand you ran cleanup-containers fv on the vm?02:35
sdake-fv ?02:35
kjellyI tried -f. Now I try -fv02:35
sdakethat won't make much difference02:36
sdakewhy not deploy to your machine your deploying from?02:36
sdakeif yur using the allinone did you modify ansible/inventory/allinone?02:36
kjellyNo, I never change the kolla code.02:37
sdakeok well your not deploying to your vm then02:37
sdakeyour deploying to where you are running ansible02:37
sdakeor is that also your vm?02:38
*** klint has joined #kolla02:38
kjellysdake: The machine which is used for deploy openstack is the same machine which is used for openstack02:38
sdakeand that is different from where your running your registry?02:39
kjellysdake: yes.02:40
sdakeis adatabase already running on your vm?02:40
*** dimsum__ has joined #kolla02:40
sdakeor any other server software?02:40
kjellythere are no other service. just ssh, cupsd, dnsmsq02:42
sdakehow much disk space?02:44
kjellysdake: I added ansible deployment message to here https://gist.github.com/ya790206/873d67ef7decf902e48f02:44
kjellydisk:  /dev/sda1       105G  7.7G   92G   8% /02:45
*** dimsum__ has quit IRC02:46
SamYaplehey sdake inc0 is looking for a response on te rsyslog ansible stuff02:48
sdakekjelly run openstack endpoint list02:48
SamYapleim not fighting about it anymore but he seems to think you are ok with bindmounting dev onto the host filesystem02:48
sdakeafter sourcing openrc02:48
sdakesee if that shows anything02:48
SamYaplesdake: if they keystone database is empty that will do nothing02:48
SamYapleif the database is empty its not bootstrapping correctly02:49
sdakeyes sam i know i want to verify the database is actually empty02:49
kjellysdake:  Ok. I try it.02:51
sdakethe openrc can be retrieved from tools directory openrc-example02:51
kjellywait for a moment because I delete all container.02:53
sdakekjelly one problem could be - is a fiewall enabled on the vm?02:57
kjellysudo ufw status02:58
kjellyStatus: inactive02:58
kjelly[+1][root:~/kolla/tools] # keystone endpoint-list02:58
kjellyAuthorization Failed: The resource could not be found. (HTTP 404)02:58
sdakeno, openstack endpoint list02:58
sdakekeystone client doesn't work at all with kolla02:58
kjellyI don't have openstack command, or run it in container ?02:59
sdakesudo pip install ptyhon-openstackclient02:59
kjelly[+1]⌂91% [root:~/kolla/tools] 2 #  openstack endpoint list03:04
kjellyERROR: openstack An unexpected error prevented the server from fulfilling your request. (HTTP 500) (Request-ID: req-bcfb82da-853b-4d9c-95ae-b43acbf872c6)03:04
sdakedocker logs keystone03:04
SamYaplesdake: the keystone logs are in apache in the container03:04
sdakeoh right03:05
sdakesam do you know the file locations for the logs on ubuntu03:05
SamYaple/var/log/apache2/keystone.log03:05
sdakekjelly docker exec keystone cat /var/log/apache2/keysotne.log > log03:05
sdakepaste the log03:06
sdakealso pip show ansible03:06
sdaketell me which version your running03:06
kjellysdake: here https://gist.github.com/ya790206/873d67ef7decf902e48f . the latest one.03:06
kjellyansible --version03:07
kjellyansible 1.9.203:07
kjelly  configured module search path = None03:07
sdakeya keystone database didn't initialize03:08
sdakeright there in the logs03:08
kjellyIt seems that the code is not execued. How to make sure the code is executed?  https://github.com/stackforge/kolla/blob/master/docker/keystone/start.sh#L2603:09
sdakekjelly lets get the logs from the bootstrap container03:10
sdakehttps://github.com/stackforge/kolla/blob/master/ansible/roles/keystone/tasks/bootstrap.yml#L6803:11
sdakedelete lines 68-7303:12
sdakethat should leave the bootstrap container intact03:12
sdakethen after a run do docker logs bootstrap_keystone03:13
SamYapledo not delete lines03:14
SamYaplethats awful03:14
SamYaplerun with --step03:14
SamYapleit will promt you before each task03:14
sdakekjelly do whatevero u like each approach will work - what we are after is the bootstrap logs03:15
kjellystop before deleting bootstrap container?03:16
sdakeyes03:16
SamYaplesdake please dont give advice to modify the playbooks. thats going to render all results past that point suspect03:16
sdake"cleaning up bootstrap container" I think it is03:16
sdakefor keystone03:16
sdakeall results past that point are suspet anyway03:17
sdakebut i was not aware of the --step command03:17
SamYapleyou are because youve used it03:17
sdakenever have03:18
SamYaplei have irc logs that say otherwise03:18
kjelly[+1][root:~/kolla] 130 #  docker logs bootstrap_keystone03:19
kjellysu: System error03:19
sdakecool waste some more time and pull em up then03:19
SamYaplekjelly: you have a bad kernel03:19
SamYaplekjelly: some kernels have trouble with su inside a container03:19
SamYaplekjelly: whats your kernel version?03:19
kjellyDo yo03:20
kjellyuname -a03:20
kjellyLinux user-VirtualBox 3.13.0-24-generic #47-Ubuntu SMP Fri May 2 23:30:00 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux03:20
SamYaplethats a really old kernel03:21
SamYapletry upgrading03:21
SamYaplethe latest is like 54 or something03:21
SamYaplelatest trusty kernel is linux-image-3.13.0-63-generic03:21
kjellyOk, try it .03:21
sdakeis -24 the standard after installing ubuntu?03:22
sdakekjelly if that works, would you mind putting in the docs pls?03:22
kjellysdake: I will. If I deploy successfully, I will update the document.03:23
sdaketx03:23
SamYapleits not the standard, the standard is installing the latest kernel03:24
SamYapleits a really old image thats being used03:24
SamYapleprobably hasnt been rebuilt since trusty initially was released based on that build time03:24
sdakesam is there any way to make the bootstrap failure return in asnible a failure ?03:25
sdakerather then continuing on like nothing went wrong ;)03:25
SamYaplewe set errexit03:26
SamYaplethe problem is this is with the kernel03:26
SamYapleso no03:26
*** dayou has joined #kolla03:27
*** banix has quit IRC03:31
sdakeSamYaple nice job on the network thing03:32
sdakesamyaple deployment works great now :)03:33
SamYapleits a bit annoying to me to have to do that, but this way we dont have to do ansible config changes03:33
SamYaplefact caching solves the issue03:33
SamYaplesdake: is anyone working on the kolla-ansible util?03:34
sdakethere is a guy who contaced me who wnts to work on it03:34
SamYapleit needs to be python'd up in like 18 days03:34
sdakehe is assigned to it03:34
sdakei dont know if he is making any progress with it or not03:34
kjellysdake, SamYaple: The problem is the same.03:34
sdakerun uname -a gain pzl03:35
SamYaplekjelly: whats teh docker version?03:35
kjellydocker  --version03:35
kjellyDocker version 1.8.1, build d12ea7903:35
sdakeuname -a returns what?03:35
kjelly uname -a03:35
kjellyLinux user-VirtualBox 3.13.0-63-generic #103-Ubuntu SMP Fri Aug 14 21:42:59 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux03:35
sdakebummer if trusty kernel is busted out of the box03:36
SamYapleits not, its what i use03:36
SamYaplekjelly: you are hitting this bug fyi https://github.com/docker/docker/issues/589903:36
SamYaplesdake: it happens to centos too03:36
sdakenever seen it on centos 7.1 SamYaple03:37
sdakekjelly ar eyou running with apparmor on?03:37
SamYapleive never seen it on ubuntu and yet here we are03:37
sdakeSamYaple do you run with apparmor on?03:38
SamYapleno, but thats not what this error is03:38
SamYapleapparmor==selinux and cant be used with kolla anyway03:38
sdakeright, so if kjelly  has apparmor on he is boundto run into trubles ;)03:39
SamYaplesure but thats not related to this issue03:39
kjellysudo apparmor_status03:39
kjellyapparmor module is loaded.03:39
kjelly21 profiles are loaded.03:39
kjelly21 profiles are in enforce mode.03:39
sdakewell lets turn that off and try again03:39
kjellyDo I need to disable it ?03:39
sdakesince we know it wont work with it03:40
SamYaplekjelly: yea go ahead and disable it, it will require a reboot03:40
SamYapledocker should be on one of those exlcude filters, but lets disable it an move on03:40
sdakeat one point turning off apparmor wias in the docs ;)03:40
SamYaplei think you removed that doc sdake03:40
sdakewho knows03:41
sdakelooks like there is no resolution int he docker bug report03:42
SamYaplecpuguy83 makes it pretty clear the issue isn't dockers03:43
SamYapleand ill have to agree with him on that03:43
sdakeya pam is busted in ubuntu - this is why i had that pam noaudit hack in centos images03:43
SamYapleif kjelly is running the 63 kernel, it _might_ be apparmor since i can run the 63 with no issue03:43
sdakeit was fixedi n 3.15 kernel version03:44
sdakehope this umcka stuff works03:44
sdakedr recommended it for flu and colds03:44
sdakekjelly which command did you run to build your images03:48
kjellytools/build.py -n 172.22.2.81:5000/kollaglue --base ubuntu --type source --push03:49
sdakeok thanks03:49
sdakedid that apparmor thing fix it up?03:49
kjellyHow to disable it? I run the command `sudo update-rc.d -f apparmor remove`. But it seems active.03:51
sdakeno idea03:51
sdakeperhaps SamYaple  can provide the proper command03:51
sdakei run fedora/centos enitrely03:51
sdakei can help on those distros ;-)03:51
SamYaplehttps://help.ubuntu.com/community/AppArmor03:52
SamYaplethat will disable it03:52
SamYaplesdake: im doing keystone v3 stuff now03:53
SamYaplewhat should the default domain be named03:53
kjellyI remove apparmor package, reboot, and deploy again, then failed.03:58
SamYaplekjelly: yea thats what I expected03:58
SamYaplemy only suggestion would be to run the newer 3.16 or 3.19 kernel03:59
SamYaplethats what I use03:59
SamYaple(3.19)03:59
SamYaplekjelly: the 3.19 kernel package name is 'linux-image-generic-lts-vivid' if you are interested04:00
kjellyI use `docker run -i -t 172.22.2.81:5000/kollaglue/ubuntu-source-keystone  /bin/bash`. And run su command. No error happened.04:01
SamYaple--net=host04:01
kjellyYes, I add the flag "--net=host" and use su command, it display "su: System error"04:02
kjellyNice. After I upgrade kernel to "linux-image-generic-lts-vivid", it works. Thanks, sdake and SamYaple.04:08
SamYaplekjelly: you can also use as low as utopic (3.16) for the kernel and it will work04:08
sdakecool so ubuntu 14.04 kernel is busted with kolla - should go in the docs04:08
SamYaple14.04 kernel is not busted04:08
sdakei think that is what we concluded via this debug sesson right?04:08
SamYapleneither is 3.1304:08
SamYaple3.13 works for me04:08
SamYaplethere is other things going on here04:09
sdakeinteresitng wonder what the delta is between yuor system and kjelly's04:09
SamYaplebesides the docs already say 3.19 for ubuntu kernel because of AUFS bug04:09
SamYaplehe is running a VM04:09
sdakeya that could be it04:10
SamYaplealso not using btrfs04:10
SamYapleboth of those things could do it04:10
SamYapleim just going to name the default domain 'openstack' since you ahvent commented sdake04:11
sdakecommented on which?04:11
SamYaple03:54 < SamYaple> sdake: im doing keystone v3 stuff now04:11
SamYaple03:54 < SamYaple> what should the default domain be named04:11
sdakethat seems perfectly reasonable04:11
sdakei just came in from outside -hadnt read scrollback04:11
SamYapleno problem04:11
sdakeapologie04:11
sdakes04:11
SamYaplejust letting you know04:12
sdakeya wfm04:12
sdakekjelly was it worth the effort? :-)04:12
*** jtriley has joined #kolla04:13
*** jtriley has quit IRC04:19
*** weiyu has quit IRC04:28
*** unicell1 has joined #kolla04:33
*** unicell has quit IRC04:34
SamYaplewe got quite a few sessions for the summit04:36
sdakeyou mean the 3 fishbowl plus 5 regular sessions plus half day contributor meetup?04:37
SamYapleyea04:37
sdakeyup - was plased we almost got as many as asked for04:37
sdakemagnum had twice the ask and received same session count as kolla04:43
*** tfukushima has joined #kolla04:51
*** jtriley has joined #kolla05:14
*** jtriley has quit IRC05:19
*** weiyu has joined #kolla05:34
kjellysdake:  Sorry. I go out for lunch. I am not sure what you said, " kjelly was it worth the effort? :-)"05:36
*** inc0 has joined #kolla05:39
inc0good morning05:39
sdakekjelly what i mean was what you ahd to go thorugh to get kolla to deploy openstack worth it to you ?05:39
sdakeyo inc005:39
*** kjelly has quit IRC05:39
inc0sdake, got a moment? I have questions about https://review.openstack.org/#/c/215062/05:40
sdakeinc0 shoot05:40
inc0you've said that you don't want container to write to disk05:40
inc0my question is - we can't do this without container creating shared log device somewhere05:41
inc0so is it acceptable to add /var/lib/kolla/dev/log?05:41
sdakeok with a shared device05:41
inc0cool, that was my issue, SamYaple understood that you were against it;)05:41
sdakewe have alot of bind mounts that write to the host os05:41
sdakebut i'd rther prefer we dind't do so05:42
inc0that what I thought, like mysql05:42
sdakei don'twant the logs file being written05:42
SamYaplesdake: you caused a big fight about this about a week ago05:42
SamYaplenothing has changed05:42
sdakeabout for example /var/log/mysql.log05:42
SamYaplestop causing problems05:42
inc0SamYaple, respectfully, you tend to generate fights a fair bit youself;)05:42
inc0just as I said - there was misunderstading obviously05:43
*** kjelly has joined #kolla05:43
inc0cool, that's solved05:43
inc0I'll make bindmounting /var/log/kolla optional and we're done05:44
sdakewfm05:44
SamYapleinc0: sure but at least i know what im fighting about05:44
inc0also I'll make new patch with keystone logging to work out per-service05:44
inc0SamYaple, question was whether or not person you fighting with knows that;)05:44
SamYapleinc0: im not merging that patch until we have another one showing how it will work perservice05:44
sdakeSamYaple you gotta calm down dude or your going to have a cornoary05:45
inc0yeah being *too* passionate about project isn't very good as well05:45
sdakekjelly what i meant was are you happy with the result of being able to deploy openstack with kolla - was it worth the effort?05:46
kjellysdake: yes. I success to deploy openstack finally.05:47
kjellysdake, SamYaple: thanks05:47
SamYaplesdake: you could help alot with my calmness by actually listening. mostly its you saying something thats not true and you ignoring me when i say 'thats not true'05:47
sdakekjelly cool thanks ;)05:48
*** weiyu has quit IRC05:48
*** kjelly has quit IRC05:49
inc0guys do we have optional bindmounting anywhere now?05:51
SamYapleno inc0, you can leave out the optional bit now. as i said yesterday we need it in alot of places05:51
SamYapleits just a quick change in the defaults.yml05:52
inc0ok, I'll file a but for it then and jump to implementation of per-service ok?05:52
inc0bug*05:52
SamYaplei think there may already be a bug (old one) but maybe not05:53
sdakeall bugs are either in rc1 or closed as invalid05:53
sdakeso if its not in rc1, its not there05:53
SamYapleold as in age of bug05:54
*** kjelly has joined #kolla05:57
*** kjelly has quit IRC06:01
*** chandankumar has joined #kolla06:02
inc0SamYaple, I can't find it06:04
inc0I'll file a new one and close one as duplicate if needed06:04
SamYapleinc0: yea i dont see one either. a new one is cool06:04
SamYapleyea06:04
inc0https://bugs.launchpad.net/kolla/+bug/149321306:06
openstackLaunchpad bug 1493213 in kolla "bindmounts have to be optional" [Undecided,New]06:06
SamYaplelgtm06:07
sdakewhich bindmounts do we that could be optional inc0?06:08
inc0well I'd say /var/lib/mysql06:08
inc0for on06:08
inc0one06:08
sdakewe don't bindmount that do we?06:08
sdakei was pretty sure that was a data container06:08
inc0data container has volume06:08
sdakeya those are ok06:09
inc0do we consider that a bindmount or not?06:09
SamYaplerabbitmq mariadb nova glance logs all of those are getting optional bindmounts06:09
sdakewhat i am talking abut is host bindmounting06:09
*** smeisner has quit IRC06:09
sdakedata volume bindmounts are fine with me06:09
SamYaplebindmount is refering to the host06:09
inc0well, host will end up with /var/lib/mysql won't it?06:09
sdakeinc0 no it ddoes not06:09
sdakethe data container ends up stroing the data06:10
SamYapleinc0: sdake is confusing terminology06:10
SamYaplebindmount == host06:10
sdakeif the data container ends ups troing the data, its not a security problem06:10
sdakeits when the bindmount connects to hte host os06:10
SamYaplethats why its optional06:11
*** smeisner has joined #kolla06:11
sdakei'm off to bed enjoy06:12
sdakenight all06:12
inc0good night06:13
SamYaplenight06:13
inc0see SamYaple all it took was to ask clear and straight question with no room for doubt;)06:16
inc0I suspected this will be the case06:16
SamYapleinc0: this exact question was asked last time this conversation came up06:16
SamYaplesdake said now06:16
SamYapleno*06:17
SamYaplei wasnt assuming anything06:17
SamYaplei was relaying _what_ _was_ _said_06:17
inc0well, maybe it's just you thenl)06:17
SamYapleim sure it is. he doesnt like to listen to me06:17
*** kjelly has joined #kolla06:18
inc0I'd say "noone does" but that would look rude;)06:18
SamYapleeveryone likes being wrong it seems06:18
inc0just kidding ofcourse06:18
SamYapleall jokes have a grain of truth06:18
inc0ignorance is a bliss06:18
SamYapleit is a bit iratating because I keep thinking of what Yaodu would be right now if i spent my time on that.06:19
SamYapleI had all of this code in Juno working (including ceph)06:19
inc0well, it's quite often that community doesn't really accelerate things06:20
SamYaplei know, and i still know community is better than not06:20
SamYaplewhich is why im here06:20
inc0on the other hand, there is little chance yaodu would land in openstack namespace, got design sessions in tokyo and such06:20
inc0brb06:20
SamYapleKOlla wouldnt ahve either if i wasnt here ;)06:21
SamYapleyoadu may very well have06:21
*** weiyu_ has joined #kolla06:26
inc0back06:28
*** Haomeng has quit IRC06:34
*** Haomeng|2 has joined #kolla06:34
*** diga has joined #kolla06:36
*** jtriley has joined #kolla07:32
*** inc0 has quit IRC07:34
*** inc0 has joined #kolla07:34
*** weiyu_ has quit IRC07:36
*** weiyu has joined #kolla07:39
*** jtriley has quit IRC07:42
*** achanda has joined #kolla07:43
*** shardy has joined #kolla07:44
*** kjelly has quit IRC07:56
*** kjelly has joined #kolla07:59
*** mbound has joined #kolla08:06
*** SourabhP has joined #kolla08:07
*** mbound has quit IRC08:07
*** SourabhP_ has joined #kolla08:09
*** SourabhP has quit IRC08:11
*** SourabhP_ is now known as SourabhP08:11
kjellyIs the file, "ansible-deployment.rst" good place to put some information about disable apparmor or docker bug about su ?08:20
*** athomas has joined #kolla08:20
*** gfidente has joined #kolla08:24
*** achanda has quit IRC08:25
*** achanda has joined #kolla08:28
*** SourabhP has quit IRC08:35
*** jmccarthy has quit IRC08:36
*** jmccarthy has joined #kolla08:37
*** weiyu has quit IRC08:45
*** achanda has quit IRC08:52
*** weiyu has joined #kolla08:55
kjellyI found that I can deploy openstack using kolla if apparmor is enabled.08:56
*** dayou has quit IRC08:59
*** pbourke has quit IRC09:05
*** pbourke has joined #kolla09:06
*** diga has quit IRC09:13
*** [Leeloo] has joined #kolla09:22
[Leeloo]Hello09:22
[Leeloo]I use this guide to deploy Kolla (Fedora 21 Core) --> https://github.com/stackforge/kolla/blob/master/doc/dev-quickstart.rst . Build the images localy (took several hours). Tag/Push the images in a local registry. Then start the deployment, but got this error --> http://picpaste.com/SNAG-7135-PknEA45Z.jpg . Thanks for the help09:23
*** weiyu has quit IRC09:26
kjellyI guess you need to change the value, kolla_internal_address, in /etc/kolla/globals.yml.09:26
*** weiyu has joined #kolla09:27
[Leeloo]kjelly: the address shoud be ? i make the deployement on a physical machine (OVH serveur). i should put the Ip addres of the server ?09:30
inc0[Leeloo], you're doing all-in-one?09:31
[Leeloo]"./tools/kolla-ansible deploy"09:32
[Leeloo]inc0: I would like a all-in-one09:33
*** shardy_ has joined #kolla09:33
kjellyIn all-in-one, If you ip is 10.0.2.15, try to set the value to 10.0.2.254.09:33
inc0in /etc/kolla/globals.yml set up kolla_internal_address to some address in your network but not yet taken09:34
inc0this will be address keepalived will create as floating ip09:34
inc0also make sure that there is no mysql server running on host itself09:34
*** shardy has quit IRC09:34
[Leeloo]The server is at my provider. Got these addresse 5.39.xx.xx. for the server itself + a block of address routed to this server, ie: 204.23.xx.2--> 204.23.xx.20. What adress shout I use for "kolla_internal_address"09:38
*** shardy_ has quit IRC09:38
*** shardy has joined #kolla09:39
inc0[Leeloo], you know what, just add enable_haproxy=False to your /etc/kolla/globals.yml :)09:39
inc0and set up kolla_internal_address to your hosts IP09:40
inc0this will remove HAProxy+Keepalived and you won't need to add new address09:40
inc0haproxy and keepalived really makes sense only in multinode ha setup09:41
[Leeloo]inc0: thanks I try :)09:42
*** sdake has quit IRC09:42
inc0no problem, let us know if that'll help, because otherwise it might be a bug09:42
[Leeloo]I tell you in 2 mins :)09:42
inc0remember to remove running containers09:43
inc0because ansible won't redeploy it09:43
*** dimsum__ has joined #kolla09:46
*** dims_ has joined #kolla09:50
[Leeloo]Same message for "TASK: [mariadb | Creating haproxy mysql user] *********************************" --> "...heck login_user and login_password are correct or ~/.my.cnf has the credentials. E...""09:51
[Leeloo]I put " enable_haproxy: "False" " at the end of "/etc/kolla/globals.yml"09:51
[Leeloo]and the ip of the host for kolla_internal_address09:51
inc0try to login from host to mysql09:53
inc0do mysql -u root -h <<your ip>> -p09:53
inc0and default password is "password"?09:53
inc0you can check up passwords in /etc/kolla/password.yml09:54
*** dimsum__ has quit IRC09:55
[Leeloo]e214f0d414f0        localhost:5000/kollaglue/centos-binary-mariadb:latest         "/start.sh"              4 minutes ago       Up 3 minutes                                 mariadb10:01
[Leeloo]ERROR 1045 (28000): Access denied for user 'root'@'ns2cccc02.ip-5-ccccc.eu' (using password: YES)10:02
inc0hmm...that's strange10:03
*** dolpher1 has quit IRC10:05
*** tfukushima has quit IRC10:05
[Leeloo]i will see this, this afternoon for me... thanks :)10:06
*** jtriley has joined #kolla10:06
inc0sorry I couldn't be more help10:10
*** [Leeloo] has quit IRC10:10
*** zhiwei has quit IRC10:10
*** [Leeloo] has joined #kolla10:10
*** jtriley has quit IRC10:13
*** weiyu has quit IRC10:14
*** weiyu_ has joined #kolla10:18
*** akwasnie has joined #kolla10:22
inc0SamYaple, around?10:35
*** weiyu_ has quit IRC10:42
*** weiyu_ has joined #kolla10:45
openstackgerritMichal Jastrzebski (inc0) proposed stackforge/kolla: Ansible bits to rsyslog  https://review.openstack.org/21506211:02
*** kjelly_ has joined #kolla11:10
*** weiyu_ has quit IRC11:18
*** chandankumar has quit IRC11:46
*** shardy_ has joined #kolla11:49
*** shardy has quit IRC11:50
*** shardy_ has quit IRC11:55
*** shardy has joined #kolla11:55
*** inc0 has quit IRC12:01
[Leeloo]inc0 : I remove in file site.yml the proxy line.... but stil get the TASK: [mariadb | Creating haproxy mysql user] ********************************* and the the error with the mysql password :(12:02
*** inc0 has joined #kolla12:04
*** mbound has joined #kolla12:05
pbourke[Leeloo]: I dont think inc0 meant to remove that line, I think he meant you should append "enable_haproxy: false" to /etc/kolla/globals.yml12:06
*** mbound has quit IRC12:07
[Leeloo]pbourke: I do, with no result, so I try to remove the line to see if any effect12:07
pbourke[Leeloo]: are you attempting a single node setup?12:07
*** mbound has joined #kolla12:07
inc0well, what enable_haproxy: false does is it makes ansible skip deployment of haproxy+keepalived12:08
inc0therefore not messing with IPs12:08
inc0however, in this case it seems it's wrong password or something..12:09
pbourkeyeah I think you should check you can access the mysql server directly12:09
pbourkemysql -uroot -ppassword -h<kolla_internal_ip>12:09
[Leeloo]If I want to use the docker hub to be use during the deployement do I have to change something in the config file ?12:11
[Leeloo]inc0: with an empty password, I can connect to the mariadb12:20
inc0thats strange12:20
[Leeloo]inc0: do you want me to show you files in /etc/kolla/... ?12:22
[Leeloo]inc0: a re-deplys, and now I am at step 'ASK: [rabbitmq | Starting RabbitMQ bootstrap container] ************'...and it continue12:23
*** chandankumar has joined #kolla12:24
[Leeloo]inc0: get this error --> http://pastebin.com/VagMBdjp12:24
inc0[Leeloo], did you removed old containers before deploy?12:29
[Leeloo]yes12:30
[Leeloo]docker stop $(docker ps -a -q | grep -v '0253ca131173'); docker rm $(docker ps -a -q | grep -v '0253ca131173')12:30
[Leeloo]"0253ca131173" is the registry12:30
*** jtriley has joined #kolla12:31
inc0won't that just remove registry?12:33
inc0do docker ps -a and it's empty?12:33
[Leeloo]http://pastebin.com/k5dSCBf112:38
inc0docker logs bootstrap_keystone please12:39
[Leeloo]No handlers could be found for logger "oslo_config.cfg"12:41
*** jtriley has quit IRC12:43
*** diga has joined #kolla12:46
*** klint has quit IRC12:56
*** jpeeler has joined #kolla12:59
inc0that seems like image build error...although afair that was not a critical error13:03
*** slagle_ is now known as slagle13:03
[Leeloo]If I want to use the docker hub to be use during the deployement do I have to change something in the config file ?13:05
*** mbound has quit IRC13:06
inc0well you should remove namespace alltogether from global.yml13:06
inc0(I think, I never used pulled images;))13:07
pbourkedockerhub images wont work13:07
pbourkethey're out of date13:07
pbourkeif maria works with empty pass then there's a config problem13:07
[Leeloo]pbourke: I do the deplyoment on a fresh Fedora 21 Core...13:09
[Leeloo]centos 6.5 / 7  is recommanded ?13:10
inc0that shouldn't matter too much13:10
inc0if you do centos images13:10
inc0try to build your own images tho - tools/build.py13:11
[Leeloo]inc0 : this is waht I do. Build the images localy (took several hours). Tag/Push the images in a local registry. Then start the deployment13:12
inc0hmm, I don't know :/13:13
*** mbound has joined #kolla13:13
[Leeloo]inc0: :( :)13:15
*** mbound has quit IRC13:15
pbourke[Leeloo]: suggest focusing on the mariadb issue first13:15
pbourke[Leeloo]: exec into the container, compare the confs against the ansible template13:15
pbourke[Leeloo]: the fact you can access it with an empty password sounds vaguely familiar but I cant remember the exact cause13:16
pbourke[Leeloo]: but its a definite issue as the other services will try to access it with -ppassword13:16
*** diga has quit IRC13:16
[Leeloo]pbourke: i focus on this :)13:17
pbourke[Leeloo]: stop and rm all containers, then re-run ansible with --tags=mariadb13:17
pbourkeand -vv13:17
pbourketo get extra output on what ansible is doing13:17
*** stvnoyes has joined #kolla13:19
*** [Leeloo] is now known as [Leeloo]-afk13:20
*** kjelly_ has quit IRC13:20
*** mbound has joined #kolla13:23
*** banix has joined #kolla13:25
*** Esai has joined #kolla13:32
*** inc0 has quit IRC13:35
*** Esai has quit IRC13:35
*** Esai has joined #kolla13:35
*** [Leeloo]-afk is now known as [Leeloo13:39
*** [Leeloo is now known as [Leeloo]13:39
[Leeloo]pbourke: what will be the eaxct command for "re-run ansible with --tags=mariadb -vv" ?13:39
*** jtriley has joined #kolla13:40
pbourke[Leeloo]: ansible-playbook -i inventory/all-in-one -e @/etc/kolla/globals.yml -e @/etc/kolla/passwords.yml site.yml --tags mariadb -vv13:40
[Leeloo]http://pastebin.com/VseiRVwN13:46
*** diga has joined #kolla13:47
*** dwalsh has joined #kolla13:48
*** Esai has quit IRC13:49
pbourke[Leeloo]: did you 'docker rm' everything before running the above13:49
pbourke?13:49
[Leeloo]yes :)13:51
[Leeloo]I connect to mysql witout password. It's "database_password: "password"" in /etc/kolla/passwords.yml13:52
pbourkewhat exact command did you use to rm the containers?13:57
[Leeloo]# docker stop $(docker ps -a -q | grep -v '0253ca131173'); docker rm $(docker ps -a -q | grep -v '0253ca131173');13:57
[Leeloo]0253ca131173        registry:2                                                    "/bin/registry /etc/d"   6 hours ago         Up 6 hours          0.0.0.0:5000->5000/tcp   registry13:58
*** dwalsh has quit IRC13:58
*** shardy_ has joined #kolla14:01
*** shardy has quit IRC14:03
*** shardy_ has quit IRC14:07
*** shardy has joined #kolla14:07
pbourke[Leeloo]: ok, try this instead: 'docker stop $(docker ps -q); docker rm -f $(docker ps -aq)'14:08
pbourke[Leeloo]: then rerun ansible14:08
[Leeloo]same :(14:16
[Leeloo]If someone want acces to the server, I give the access ? it will be re-install after14:17
*** jasonsb has quit IRC14:24
*** dims_ has quit IRC14:26
*** dimsum__ has joined #kolla14:27
*** vbel1 has quit IRC14:27
*** inc0 has joined #kolla14:33
*** unicell has joined #kolla14:33
inc0afternoon14:33
*** unicell1 has quit IRC14:33
[Leeloo]I try to rebuild keystone image (tools/build.py keystone), but get this message -> http://pastebin.com/XeExpECQ14:44
*** dwalsh has joined #kolla14:46
*** banix_ has joined #kolla14:58
*** banix has quit IRC14:58
*** banix_ is now known as banix14:58
*** banix has quit IRC15:02
*** banix has joined #kolla15:04
*** chandankumar has quit IRC15:06
*** blahRus has joined #kolla15:07
*** dwalsh has quit IRC15:21
*** dims_ has joined #kolla15:25
*** bradjones has joined #kolla15:28
*** bradjones has quit IRC15:28
*** bradjones has joined #kolla15:28
*** dimsum__ has quit IRC15:29
*** dwalsh has joined #kolla15:39
*** devlaps has joined #kolla15:43
*** chandankumar has joined #kolla15:54
*** jasonsb has joined #kolla15:56
inc0Slower, around?16:01
*** sdake_ has joined #kolla16:06
*** stvnoyes has quit IRC16:08
*** unicell has quit IRC16:12
inc0sdake_, https://review.openstack.org/#/c/215062/ mind taking a look if that's ok with you?16:16
sdake_inc0 i just woe up dude16:18
devlapsmorning kola folks. i'm new to this project and have a question. can anyone tell me that the stubbed out .conf files in /etc/kolla/config are used for?16:18
inc0well, you logged in to irc means you're exposed to reviews;)16:18
inc0no worries16:19
inc0devlaps, when you do ansible deployment, ansible copies configs from there to container16:19
inc0and container uses these configs16:19
devlapsinc0 thanks.. can you point me to where those files get populated?16:20
inc0or actually no, it just bindmounts this directory16:20
inc0yeah, its in ansible/roles/tasks/<< service >>/config.yml16:21
inc0ansible/roles/<<service>>/tasks **16:21
inc0you have templates of configs in << service >>/templates16:22
devlapsthanks.. i saw those, but was confused how those templates interacted with the /etc ones..16:22
devlapsi can see the top level anaislbe config.yml16:23
inc0yeah, this is supposedly only file you need to edit to get barebones openstack running16:24
inc0that and inventory file if you're not doing aio16:24
devlapsok.. i can also see the mege_configs plugin to generate final service config file.. is there an intermediate step that populates the top level etc/kolla/config/*.conf?16:25
inc0soo...I don't think it's used any more, but I'm not 100% sure16:28
devlapsah.. ok.. thanks for the info!16:30
inc0yeah, it seems it's not used, I'll ask around and remove it if so16:30
inc0basically it works like that16:31
*** dims_ has quit IRC16:31
inc0you https://github.com/stackforge/kolla/blob/master/ansible/group_vars/all.yml#L14 here you define where configs lands16:32
*** dimsum__ has joined #kolla16:32
*** ccrouch has joined #kolla16:32
*** achanda has joined #kolla16:32
inc0this is example of source config template https://github.com/stackforge/kolla/blob/master/ansible/roles/keystone/templates/wsgi-keystone.conf.j216:32
inc0https://github.com/stackforge/kolla/blob/master/ansible/roles/keystone/tasks/config.yml#L19 and this is what copies config and fills up template16:33
*** stvnoyes has joined #kolla16:35
*** mbound has quit IRC16:39
*** jmccarthy has quit IRC16:41
*** inc0 has quit IRC16:46
*** dwalsh has quit IRC16:52
*** achanda has quit IRC16:56
*** achanda_ has joined #kolla16:56
*** dwalsh has joined #kolla16:56
*** akwasnie has quit IRC16:59
*** unicell has joined #kolla17:02
*** tfukushima has joined #kolla17:03
devlapsthanks inc0!17:06
*** unicell has quit IRC17:06
*** unicell has joined #kolla17:06
*** achanda_ has quit IRC17:08
*** athomas has quit IRC17:09
*** jtriley_ has joined #kolla17:14
*** jtriley has quit IRC17:17
*** sdake_ has quit IRC17:19
*** achanda has joined #kolla17:21
*** diga has quit IRC17:21
*** vilobhmm_11 has joined #kolla17:33
*** sdake has joined #kolla17:44
*** loth has joined #kolla17:45
*** banix has quit IRC18:00
*** banix has joined #kolla18:02
*** SourabhP has joined #kolla18:03
*** inc0 has joined #kolla18:07
*** inc0 has quit IRC18:12
*** banix has quit IRC18:24
*** banix has joined #kolla18:24
*** sdake_ has joined #kolla18:25
*** sdake has quit IRC18:29
*** openstackgerrit has quit IRC18:31
*** openstackgerrit has joined #kolla18:31
sdake_devlaps if your still around i can answer your questions rethe etc dirfiles18:33
*** chandankumar has quit IRC18:35
*** gfidente has quit IRC18:38
devlapshi sdake_ thanks. i did some more reading, and as far as i can tell, it looks like those configuration files are copied over and merged with the ansible template files to create the final service config file. so, if you want to add in any additional default configuration settings you can do that in etc/kolla/config. is that correct?18:38
sdake_that is correct18:38
sdake_kolla is opinionated unless the operator has opinions18:38
sdake_then it honors those18:38
sdake_one extra detail, it ovrrides any settings as well not just adds18:39
*** sdake_ is now known as sdake18:40
*** achanda has quit IRC18:40
*** achanda has joined #kolla18:41
*** sdake_ has joined #kolla18:46
*** banix has quit IRC18:47
*** sdake has quit IRC18:49
*** jmccarthy has joined #kolla18:51
*** banix has joined #kolla18:55
devlapsthanks sdake_. yes, i saw that happening in the ansible plugin merge_configs.py.18:56
devlapsthe ordering of /etc/kolla/config/ files in service config.yml is definitely important..18:57
sdake_cool if you have further questoins feel free to ask18:57
devlapswill do. thanks!18:57
*** achanda has quit IRC18:57
*** jmccarthy has quit IRC19:09
*** tfukushima has quit IRC19:26
*** achanda has joined #kolla19:38
*** inc0 has joined #kolla19:43
*** achanda has quit IRC19:45
*** sdake_ is now known as sdake19:49
*** banix has quit IRC19:51
*** inc0 has quit IRC19:55
*** ccrouch has quit IRC19:57
*** ccrouch has joined #kolla19:59
*** ccrouch has quit IRC19:59
*** ccrouch has joined #kolla19:59
*** jtriley_ has quit IRC20:01
*** dimsum__ is now known as dims20:03
*** dims is now known as Guest8007120:04
*** ccrouch has quit IRC20:07
*** ccrouch1 has joined #kolla20:07
*** Guest80071 is now known as dims__20:08
*** unicell has quit IRC20:11
*** unicell has joined #kolla20:12
*** jasonsb has quit IRC20:27
*** banix has joined #kolla20:29
*** jasonsb has joined #kolla20:30
*** shardy_ has joined #kolla20:41
*** jmccarthy has joined #kolla20:41
*** achanda has joined #kolla20:41
*** shardy has quit IRC20:42
*** shardy_ has quit IRC20:46
*** shardy has joined #kolla20:47
*** achanda has quit IRC20:51
*** achanda has joined #kolla20:54
*** banix has quit IRC21:02
*** banix has joined #kolla21:07
*** jmccarthy has quit IRC21:12
*** jmccarthy1 has joined #kolla21:12
*** sdake_ has joined #kolla21:16
*** sdake has quit IRC21:20
*** achanda has quit IRC21:35
*** achanda has joined #kolla21:35
*** devlaps has quit IRC21:38
*** banix has quit IRC21:40
*** jmccarthy1 has quit IRC21:40
*** achanda_ has joined #kolla21:44
*** achanda has quit IRC21:44
*** tummy has joined #kolla21:47
sdake_jpeeler is rhallisey on pto?21:55
*** dwalsh has quit IRC21:55
*** sdake_ is now known as sdake21:55
jpeelerdon't know, haven't seen him online today21:56
*** ccrouch1 has quit IRC21:57
*** ccrouch has joined #kolla21:57
*** achanda_ has quit IRC21:58
*** achanda has joined #kolla22:02
*** sdake_ has joined #kolla22:02
*** sdake has quit IRC22:05
*** achanda has quit IRC22:09
*** achanda has joined #kolla22:09
*** achanda_ has joined #kolla22:13
*** achanda has quit IRC22:13
*** jasonsb has quit IRC22:20
*** jasonsb has joined #kolla22:24
*** achanda has joined #kolla22:55
*** achanda_ has quit IRC22:55
*** tummy has quit IRC22:58
*** achanda_ has joined #kolla23:01
*** achanda has quit IRC23:01
*** weiyu has joined #kolla23:10
*** weiyu has quit IRC23:18
*** achanda has joined #kolla23:23
*** achanda_ has quit IRC23:23
*** banix has joined #kolla23:25
*** jasonsb has quit IRC23:41
*** blahRus has quit IRC23:56
*** stvnoyes has quit IRC23:58
*** weiyu has joined #kolla23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!