Wednesday, 2015-09-09

*** SourabhP has quit IRC00:01
*** achanda has quit IRC00:04
*** achanda has joined #kolla00:26
*** Haomeng has joined #kolla00:28
*** Haomeng|2 has quit IRC00:30
*** jasonsb has joined #kolla00:41
*** dims__ has quit IRC00:46
*** dims__ has joined #kolla00:47
*** apmelton_ has quit IRC00:49
*** harmw has quit IRC00:49
*** weiyu has quit IRC00:51
*** apmelton has joined #kolla00:51
*** ccrouch has quit IRC00:51
*** harmw has joined #kolla00:56
*** zhiwei has joined #kolla01:06
sdake_samyaple about?01:07
*** alisonh has quit IRC01:09
*** vilobhmm_11 has quit IRC01:24
*** alisonh has joined #kolla01:28
*** erkules has joined #kolla01:29
*** erkules_ has quit IRC01:31
*** dayou has joined #kolla01:34
*** stvnoyes has joined #kolla01:38
*** weiyu has joined #kolla01:39
*** loth has quit IRC01:45
*** dolpher has joined #kolla01:50
*** Haomeng|2 has joined #kolla01:51
*** Haomeng has quit IRC01:53
*** sdake_ is now known as sdake02:06
openstackgerritSteven Dake proposed stackforge/kolla: Fix rabbitmq from failure during startup  https://review.openstack.org/22157102:18
*** banix has quit IRC02:21
*** unicell has quit IRC02:22
*** sdake_ has joined #kolla02:25
*** weiyu has quit IRC02:26
*** sdake has quit IRC02:29
*** weiyu has joined #kolla02:31
*** sdake has joined #kolla02:32
kjelly I wrote a doucment about how to deploy openstack in ubuntu host. Where is the best place to put? Or I just push to gerrit. Let you decide whether the doucument is put ?02:34
sdakeput in the doc directory02:35
*** sdake_ has quit IRC02:35
sdakelink it from the index.rst file02:35
sdakeit should be in rst format since that is what docs.oo requires for publishing02:36
sdakekjelly and thanks for that :)02:36
kjellysdake: Ok.02:37
*** vilobhmm_11 has joined #kolla02:40
*** dolpher has quit IRC02:41
*** dolpher has joined #kolla02:42
*** stvnoyes has quit IRC02:42
*** dolpher1 has joined #kolla02:49
*** SourabhP has joined #kolla02:51
*** dolpher has quit IRC02:51
*** SourabhP_ has joined #kolla02:53
sdake[Leeloo] around?  if your running on an ubuntu host your kernel is probablydated - try installing 3.1602:55
*** SourabhP has quit IRC02:55
*** SourabhP_ is now known as SourabhP02:55
*** dims_ has joined #kolla02:56
*** banix has joined #kolla02:57
*** dims__ has quit IRC02:58
*** dolpher has joined #kolla03:04
*** SourabhP has quit IRC03:04
*** SourabhP has joined #kolla03:05
*** dolpher1 has quit IRC03:06
*** apmelton has quit IRC03:32
*** sdake_ has joined #kolla03:34
*** apmelton has joined #kolla03:34
*** sdake has quit IRC03:35
*** sdake has joined #kolla03:35
openstackgerritSteven Dake proposed stackforge/kolla: Fix rabbitmq from failure during startup  https://review.openstack.org/22157103:38
*** sdake_ has quit IRC03:39
*** banix has quit IRC03:47
*** banix has joined #kolla03:52
*** banix has quit IRC03:52
*** achanda has quit IRC03:53
openstackgerritKuo-tung Kao proposed stackforge/kolla: Add deploy all in one node document  https://review.openstack.org/22158703:55
*** diga has joined #kolla04:00
*** vilobhmm_11 has quit IRC04:01
*** dims_ has quit IRC04:13
*** dolpher has quit IRC04:22
*** dolpher has joined #kolla04:22
*** weiyu has quit IRC04:27
*** achanda has joined #kolla04:28
*** vilobhmm_11 has joined #kolla04:39
*** diga has quit IRC04:52
*** weiyu has joined #kolla05:18
*** clayton has quit IRC05:21
*** SourabhP has quit IRC05:26
*** clayton has joined #kolla05:26
*** zhiwei has quit IRC05:27
*** zhiwei has joined #kolla05:27
*** tfukushima has joined #kolla05:30
*** weiyu has quit IRC05:34
*** clayton has quit IRC05:45
*** clayton has joined #kolla05:45
*** unicell has joined #kolla05:46
*** unicell has quit IRC05:49
openstackgerritKuo-tung Kao proposed stackforge/kolla: Add deploy all in one node document  https://review.openstack.org/22158705:51
*** unicell has joined #kolla05:55
*** clayton has quit IRC05:55
*** vilobhmm_11 has quit IRC05:57
*** clayton has joined #kolla06:01
*** zhiwei has quit IRC06:03
*** diga has joined #kolla06:08
*** diga_ has joined #kolla06:11
openstackgerritKuo-tung Kao proposed stackforge/kolla: Add AUTHORS, ChangeLog, doc/build/ to gitignore  https://review.openstack.org/22160206:12
*** diga has quit IRC06:12
*** weiyu has joined #kolla06:14
*** unicell1 has joined #kolla06:39
*** unicell has quit IRC06:41
*** jmccarthy has joined #kolla06:41
[Leeloo]sdake: It's on a Fedora 21 Core06:43
sdakeleeloo your deployment target is f21?06:43
sdakeleeloo i am willing  to help you debug your deploy if you want to spend some time on it06:44
sdakeshould take less then 30 minutes06:45
[Leeloo]I could also give you acces to pinpoint the pb :)06:45
sdakekjelly do you have any ffeedback on your experience with kolla?06:46
sdakeany problem areas besides docs06:46
sdakeleeloo i'd like you to be able to do it soyou understand it06:47
sdakefirst quesiton, are you deploying on a vm?06:47
[Leeloo]on a bare metal ( a server host at OVH provider)06:47
sdakenice06:47
sdakeok first step pull a fresh repo06:48
sdakesecond step rm -rf /etc/kolla06:48
sdakethird step cd kolla/etc ; cp -aR kolla /etc06:48
sdakemight have to put some sudos on the last two06:48
[Leeloo]could you be more specific for "ok first step pull a fresh repo" ?06:49
sdakegit clone http://github.com/stackforge/kolla06:49
sdakei want to start fresh06:50
kjellysdake: No, I don't have any feedback now.06:51
openstackgerritMerged stackforge/kolla: Add AUTHORS, ChangeLog, doc/build/ to gitignore  https://review.openstack.org/22160206:51
sdakekjelly have you tried other deployment tools?06:51
sdakeleeloo let me know when your done with those steps ;)06:52
[Leeloo]sdake: done06:53
sdakeok now configure globals.yaml as you would think it should be configured by your having read the docs and the help text in the globals.yml file - please ignore all abvice about turning off haproxy - that was bad advice06:53
*** chandankumar has joined #kolla06:54
sdakethat isn't how we run kolla so its hard for people to deubg that kind of setup06:54
sdakewhen you get done paste your globals.yml06:54
sdakeyou can use fpaste /etc/globals.yml06:55
sdakeafter pasting your globals.yml please delete any containers related to kolla, but not the container containing your docker images06:55
sdakesecond question, which operation did you use to build the images?06:55
*** shardy_ has joined #kolla06:56
sdakehey shardy_ whats hanging06:56
sdakecoolsvap you happen to be around?06:57
coolsvapsdake, yes06:57
coolsvapi am06:57
*** shardy has quit IRC06:57
sdakecool is ceilometer going to make the 25th?06:57
coolsvapyes i will get the patches up by this weekend max06:57
sdakenice06:58
coolsvapsorry for the delay06:58
sdakeits a-ok06:58
coolsvapbit busy with some family work later06:58
sdakeeveyrone has real life stuff to do ;)06:58
coolsvapcurrently06:58
sdakeafter you finish with that maybe you can make cinder work ;-)06:58
coolsvapnow i am on it full time06:58
sdakeon kolla full time?06:58
[Leeloo]sdake : http://paste.fedoraproject.org/265034/1781909106:59
kjellycsdakeļ¼šnot yet.06:59
sdakeleeloo what ip is 5.39.71.21?06:59
kjellysdake: not yet.06:59
[Leeloo]the IP of the host ( givern by my provider + a bloc of 8 others IP, routed to this host)07:00
sdakeleeloo that ip needs to be an unused ip that your machine can access07:00
sdaketry pinging around and stealing someone elses iP address07:00
*** shardy_ has quit IRC07:01
sdakeif it is your machine's ip address, kolla will implode07:01
sdakeit needs to be completely unused07:01
*** shardy has joined #kolla07:02
[Leeloo]sdake: i check07:02
sdakeline 40 needs to be "True"07:04
sdakeyou also cannot havey our registry on port 500007:04
sdakethat is where keystone services its ip addresses07:04
sdakewhich means you will have to likely rebuild all your images07:04
sdakethis is probably why keystone is afu foryou07:04
sdakefedora doesn't put interfaces on eth0 and eth107:05
sdakeit is usually em1 or something wierd liek that07:05
sdakeare ou getting et0 and eh1 if you run ifconfig?07:05
kjellysdake: what's other deployment which is stable enough?07:05
sdakekjelly none that I know of :)07:06
sdakejust was wondering wat your thoughts were relating to comparing07:06
[Leeloo]sdake: only eth007:07
kjellysdake: Now I am interesting in ansible.07:07
sdakeyou only have an eth0?07:07
sdakeleeloo samyaple claims you can create a virtual interface on eth1 and connect it to the bridge or something07:07
sdakeI don't know how to do this, and ts not documented07:07
sdakeso to get a working deploy you will need a 2nd interface07:08
sdakekjelly ya its a pretty good peice of tech07:08
sdakeleeloo when you ahve a new config file - please paste it and we will proceed from there07:10
sdakeleeloo to create a dummy interface so we can move forward:07:12
sdake$ sudo ip link set name eth10 dev dummy007:12
sdakereplace eth10 with eth107:12
sdakethen run $ ip link show eth1007:12
sdakehttp://unix.stackexchange.com/questions/152331/how-can-i-create-a-virtual-ethernet-interface-on-a-machine-without-a-physical-ad07:12
*** coolsvap is now known as coolsvap|brb07:14
[Leeloo]sdake: thanks, I will try07:14
sdakemerge all those suggested changes I just went through and paste a config file - we will proceed after that :)07:15
kjellysdake: Do the machine used for deploy openstack require two interface?07:15
sdakeyup07:16
sdakei think it can be done with 1 with some kind of dummy interface thing but i am not sure07:16
kjellysdake: Are there  other requirement? I want to doucment the requirement to https://review.openstack.org/#/c/221587/07:17
sdakedisk space - atleast 40gb but I think more like 100gb07:18
sdakememory - minimum 8gb to run an AIO without any vm launched07:18
sdakeit would be good if someone sorted out the minimum disk space requirements07:20
sdakewhen i get done with a 3 node deploy each machine has 38gb of disk space used07:20
sdakeleeloo how did you build your images?07:20
sdakeleeloo I would recommend running your registry on port 400007:21
sdakeand then do07:21
sdaketools/build.py -n youripaddress:4000/kollaglue --push07:21
sdakeif you want ubuntu source you have to do something different07:21
kjellysdake: yes. my system only use 13gb including root.07:22
*** sdake_ has joined #kolla07:23
kjellysdake: In Openstack machine, the system only use 13gb including root.07:23
[Leeloo]sdake: I'm re-doing the registry07:24
sdake_unfortunately you will have to rebuild07:24
sdake_before ou finish that, lets have a look at your config file07:24
[Leeloo]"# sudo ip link set name eth1 dev dummy0" --> RTNETLINK answers: File exists07:25
sdake_sounds like you ahve an eth1 in your system already then07:25
sdake_another optoin if you haven't yet deleted your registry is to run keystone on a different port07:26
sdake_i can hlpeyou with that07:26
sdake_i'd prefer we try that - since it wont take an hour to rebuild that way07:26
sdake_what command did you use to build?07:26
*** sdake has quit IRC07:27
[Leeloo]"sudo ./tools/kolla-ansible deploy"07:27
sdake_no that deploys, what command did you use to populate your registry?07:28
sdake_build is step 1, deploy is step 207:28
openstackgerritKuo-tung Kao proposed stackforge/kolla: Add deploy all in one node document  https://review.openstack.org/22158707:28
[Leeloo]for i in `docker images | grep 'kollaglue' | awk '{print $1}'`; do echo $i; docker tag $i localhost:5000/$i; done07:29
[Leeloo]for i in `docker images | grep 'kollaglue' | awk '{print $1}'`; do echo $i; docker push localhost:5000/$i; done07:29
sdake_ok well I have no idea what that does07:29
sdake_but it may or may not work07:29
sdake_i wouldn't use localhost07:29
sdake_use the ip address please07:29
sdake_how did you build your docker images in the first place before tag and push to your registry?07:30
[Leeloo]"tools/build.py"07:31
sdake_ok07:31
sdake_well typically you would to tools/build.py -n 192.168.1.100:4000/kollaglue --push07:31
sdake_to/do07:31
sdake_but maybe you tag push thing will work07:32
sdake_if it does, should go in teh docs ;)07:32
*** achanda has quit IRC07:32
[Leeloo]sdake_: I'ts work cause dure the deply the image is took from the local registry07:33
sdake_leeloo do you have the --insecure-dregistry option passed to docker?07:34
sdake_--insecure-registry that is?07:34
[Leeloo]it's more about the network config. My provider (OVH) give me severals more IP (IP RIPE block). But it seems they can"t be ping or linked to the host.07:35
sdake_leeloo that is fine - we just need an ip we can use07:35
[Leeloo]sdake_ I d'ont think for the "nsecure-regi"07:35
[Leeloo]"docker run -d -p 5000:5000 --restart=always --name registry registry:2"07:36
*** sdake has joined #kolla07:36
*** achanda has joined #kolla07:36
sdakeleeloo http://ur1.ca/nq3sv -> http://paste.fedoraproject.org/265048/4417842207:37
sdakeyou need that in your setup07:37
sdakeif your running fedora07:37
sdakewith docker-engine 1.8.1 from docker inc07:37
sdakethere default systemd file is busted07:37
sdakeso you need to patch it first07:37
sdakei showed the full contents in that paste above07:37
sdakethe other file gets loaded into it07:37
*** sdake_ has quit IRC07:39
[Leeloo]sdake: I now destroy and rebuid the registry container + restart docker daemon ?07:42
*** gfidente has joined #kolla07:45
sdakeif you want to do that, run tools/cleanup-containers -fv07:46
sdakeyou need to setup your docker daemon with  the paste i did above07:47
sdakeleeloo^^07:47
[Leeloo]sdake: I did for the config :)07:47
*** shardy_ has joined #kolla07:47
sdakethe systemd file needs to be reloaded07:47
sdakesystemctl reload07:47
sdakei think07:47
sdakeor something liek that07:47
sdakesystemctl daemon-relaod maybe07:48
sdakei forget the exact command07:48
sdakewhen you stop docker-engine it will tell you which command to run07:48
*** shardy has quit IRC07:49
[Leeloo]sdake: I do the commands07:49
sdakeleeloo you need to modify the systemd file did you do that?07:49
openstackgerritMerged stackforge/kolla: Fix rabbitmq from failure during startup  https://review.openstack.org/22157107:49
[Leeloo]"/usr/lib/systemd/system/docker.service" ? I already done that07:50
sdakecool07:50
sdakeso stop the daemon and restart it07:50
sdakethen run ps -ef | grep docker | fpaste07:50
sdakeand paste the link it gives07:50
*** Haomeng has joined #kolla07:51
[Leeloo]"systemctl daemon-reload" that right07:51
sdakeyup07:51
sdakerun with sudo or as root07:51
[Leeloo]http://paste.fedoraproject.org/265056/41785164/  run in insecure mode07:53
*** shardy_ has quit IRC07:53
*** Haomeng|2 has quit IRC07:53
sdakelooking good07:53
sdakenow cleanup-containers -fv07:53
sdakeand then deploy a new registry07:53
sdakeon port 4000 this time07:53
*** shardy has joined #kolla07:53
sdakeand tag and push your images to it07:54
[Leeloo]"854c2e743ac5        registry:2          "/bin/registry /etc/d"   9 seconds ago       Up 6 seconds        0.0.0.0:4000->5000/tcp   registry"07:54
[Leeloo]i push the tag07:55
[Leeloo]push in progress "tools/build.py -n 5.39.71.21:4000/kollaglue --push"07:56
sdaketaht will do an entire rebuild07:56
sdakebut oh well ;-)07:56
sdakenow paste your config file plz07:57
[Leeloo]sdake : can I stop it ?07:57
sdakefpaste /etc/kolla/globals.yml07:57
sdakeleeloo nope07:57
[Leeloo]http://paste.fedoraproject.org/265058/4417854707:58
[Leeloo]:(07:58
sdakeleeloo your internal address must be in the same subnet I think as your machine your using07:58
sdakelike 5.39.71.25407:59
*** achanda has quit IRC08:00
[Leeloo]sdake : if you want an ideo of the ip bloc thah OVH give to me --> http://dohuyhoang.github.io/openstack/ovh/neutron/2014/07/07/Configure-OpenStack-network-on-OVH.html08:01
sdaketoo complicated, just use any address08:02
sdakethe goal is to get a deploy running08:02
sdakethen fine tune it08:02
sdakebaby steps ;)08:02
*** achanda has joined #kolla08:02
[Leeloo]when you says "just use any address" , it could be an Ip that no belong to me (given by OVH) but that is unused by anybody else ?08:03
*** mbound has joined #kolla08:04
*** achanda has quit IRC08:07
sdakeyes but in your subnet08:07
[Leeloo]so it could be "5.39.71.21" that did not ping08:11
sdakeisn't 5.39.71.21 your machine?08:11
[Leeloo]sorry "5.39.71.25"08:12
sdakeya if it doesn't rspond to ping its probably safe to borrow ;)08:12
sdakehows that build operation going?08:13
sdakemaking progress?08:13
[Leeloo]yes.. but if it build tehe image the process took 4/6 hours the last time08:14
sdakebummer08:14
sdakeshould have retagged08:14
sdakeyou could try retagging and pushing08:15
sdakeby pressing ctrl-c and using the push thing you used before08:15
sdakei dont know if it would work08:15
sdakebut worth a go08:15
[Leeloo]sdake: in progress for the push --> http://paste.fedoraproject.org/265066/14417866/08:18
sdakeleeloo how long does that normally take for you?08:26
[Leeloo]in  minutes --> {"repositories":["kollaglue/centos-binary-base","kollaglue/centos-binary-openstack-base","kollaglue/centos-binary-swift-object-expirer"]}08:27
[Leeloo]in 10 mns08:27
[Leeloo]so maybe 1 hour08:27
sdakewell i guess my 30 minute estimate is shot :(08:28
openstackgerritKuo-tung Kao proposed stackforge/kolla: Add deploy all in one node document  https://review.openstack.org/22158708:29
[Leeloo]sdake: it's on the machine --> https://www.ovh.co.uk/dedicated_servers/infra/2014-EG-32.xml08:30
sdakeleeloo wow thats a smoking good price08:35
openstackgerritMartin AndrĆ© proposed stackforge/kolla: Make kolla-build able to build source images  https://review.openstack.org/22163508:37
*** dayou has quit IRC09:03
*** pbourke has quit IRC09:06
*** pbourke has joined #kolla09:06
*** jmccarthy has quit IRC09:09
*** jmccarthy has joined #kolla09:09
*** Kennan_Vacation2 has quit IRC09:17
*** erkules has quit IRC09:20
*** erkules has joined #kolla09:20
*** Kennan_Vacation has joined #kolla09:25
openstackgerritMerged stackforge/kolla: Make kolla-build able to build source images  https://review.openstack.org/22163509:26
*** akwasnie has joined #kolla09:28
openstackgerritKuo-tung Kao proposed stackforge/kolla: Add deploy all in one node document  https://review.openstack.org/22158709:38
openstackgerritKuo-tung Kao proposed stackforge/kolla: Add deploy all in one node document  https://review.openstack.org/22158709:39
*** inc0 has joined #kolla09:40
inc0hello09:40
*** coolsvap|brb is now known as coolsvap09:42
coolsvaphello inc009:42
inc0SamYaple, https://review.openstack.org/#/c/215062/ check if this approach works for you so I can start implementing loggin to services09:43
inc0please:)09:43
pbourkeanyone notice the default multinode inventory only deploys neutron-server to the network nodes?09:54
pbourkeit should be on the control right?09:54
*** dolpher has quit IRC09:57
[Leeloo]sdake: images push to the repository finished --> http://paste.fedoraproject.org/265092/41792810/10:00
*** dims__ has joined #kolla10:02
*** [Leeloo] is now known as [Leeloo]-afk10:05
*** Windir has quit IRC10:13
*** athomas has joined #kolla10:21
*** diga_ has quit IRC10:26
*** bradjones has quit IRC10:55
openstackgerritPaul Bourke proposed stackforge/kolla: Change default ansible_ssh_user to "kolla"  https://review.openstack.org/22170011:02
*** weiyu has quit IRC11:08
*** rhallisey has joined #kolla11:21
*** diga has joined #kolla11:39
*** [Leeloo]-afk is now known as [Leeloo]11:41
[Leeloo]sdake: images push to the repository finished11:41
*** dwalsh has joined #kolla11:49
*** dayou has joined #kolla11:55
*** dwalsh_ has joined #kolla11:55
*** dayou has quit IRC12:07
[Leeloo]sdake: "sudo ./tools/kolla-ansible deplo" gives me --> http://paste.fedoraproject.org/265128/18006191/12:10
[Leeloo]"fpaste /etc/kolla/globals.yml"--> http://paste.fedoraproject.org/265129/4418006412:11
*** dayou has joined #kolla12:16
rhallisey[Leeloo], uncomment #config_strategy: "COPY_ONCE"12:22
*** athomas has quit IRC12:22
rhalliseyI think your config file is never being moved12:22
rhallisey[Leeloo], I've had this issue before, I think you also need to uncomment #kolla_external_address: "{{ kolla_internal_address }}"12:24
[Leeloo]rhallisey: testing...12:26
*** coolsvap has quit IRC12:27
[Leeloo]stop/rem dockers, same error --> https://paste.fedoraproject.org/265149/44180181/12:30
*** coolsvap has joined #kolla12:30
*** athomas has joined #kolla12:31
rhallisey[Leeloo], did you remove all the containers and start again? Or did you just re run?12:32
[Leeloo]stop/remove the running containers.. then deploy12:33
rhalliseyI see this come up on occasion.  I think it's a race condition since it seems to come and go for me12:36
rhalliseybrb12:43
*** rhallisey has quit IRC12:43
[Leeloo]I can connect to mariadb withou password... "password" from /etc/kolla/password.yml ignored12:44
*** stvnoyes has joined #kolla12:48
*** shardy_ has joined #kolla12:50
*** diga has quit IRC12:50
*** shardy has quit IRC12:51
*** dims__ is now known as dims12:52
*** shardy_ has quit IRC12:55
*** shardy has joined #kolla12:56
*** ccrouch has joined #kolla12:58
pbourke[Leeloo]: so same place as yesterday :/ I just saw your msg about giving access12:58
pbourke[Leeloo]: I can jump on for a bit if you like12:58
pbourkehave a look12:58
*** ccrouch has quit IRC12:58
*** ccrouch1 has joined #kolla12:58
*** stvnoyes1 has joined #kolla13:06
*** stvnoyes has quit IRC13:07
*** stvnoyes has joined #kolla13:08
pbourkebleh the haproxy missing variable bug seems to still happen in AIO13:09
*** stvnoyes1 has quit IRC13:10
*** stvnoyes has quit IRC13:12
*** mbound has quit IRC13:33
*** jtriley has joined #kolla13:36
*** rhallisey has joined #kolla13:36
*** dolpher has joined #kolla14:03
*** jtriley has quit IRC14:11
rhalliseySamYaple, around?14:18
*** jtriley has joined #kolla14:26
*** dayou has quit IRC14:31
rhalliseynevermind figured it out14:32
*** jtriley has quit IRC14:32
inc0rhallisey, did you merge kolla-cn to tripleo after all?14:35
rhalliseyinc0, not yet, still under review14:35
rhalliseyit works, but we want to improve it14:36
inc0any chances it'll land in L?14:36
rhalliseyI think so14:36
inc0when ansible-ironic lands we should be able to have functional underclods as well14:36
rhalliseynice14:36
inc0akwasnie is working on setting up vm and deploying aio on it14:37
rhalliseycool14:37
inc0so with a bit of ansible tinkering we'll have devtest as well14:37
rhalliseythat's awesome14:37
inc0much more robust than our current devtest14:37
*** jtriley has joined #kolla14:38
pbourkeinc0: akwasnie: have you seen any issues around creating the haproxy user in maria in the AIO testing14:39
pbourke?14:39
rhalliseypbourke, yes14:39
pbourkeknown bug?14:39
pbourke[Leeloo] is blocked on this14:39
rhalliseyI haven't rebuilt in a few days, but it shows up occasionally14:39
pbourkeyeah its weird as I logged into his VM and it worked the first time, then tried again and it didnt14:40
pbourkeworked one more time but now seems to happen consistently14:40
rhalliseythink it's a race condition somewhere14:40
rhalliseyya it's very weird14:40
rhalliseyI don't think a bug exists for it currently14:40
pbourke[Leeloo] said he will log one14:40
rhalliseyshould be high priority though14:40
rhalliseyok cool14:40
inc0I've tried to rebuild aio and didn't get this error14:41
inc0although I was doing ubuntu14:41
*** bradjones has joined #kolla14:52
*** bradjones has quit IRC14:52
*** bradjones has joined #kolla14:52
*** tummy has joined #kolla14:54
*** chandankumar has left #kolla14:58
*** dayou has joined #kolla14:59
*** vbel has joined #kolla15:01
*** tummy has quit IRC15:05
*** unicell has joined #kolla15:08
vbelgood morning/evening!  I am getting failures when trying to run neutron - openvswitch_vswitchd exits without any log. When trying to run by hand it just works. One difference is that docker-py container has _volumes_ and by hand - host binds15:09
*** unicell1 has quit IRC15:09
*** banix has joined #kolla15:11
vbelso for some reason (privileged is the only diff compare to others)  ovs container does not do any host binds15:14
*** jruano has joined #kolla15:14
*** dayou has quit IRC15:20
*** mbound has joined #kolla15:25
*** tummy has joined #kolla15:26
*** blahRus has joined #kolla15:26
*** mbound has quit IRC15:27
pbourkevbel: what exact command or sequence causes it to exit?15:34
*** sdake_ has joined #kolla15:36
*** sdake__ has joined #kolla15:39
*** sdake has quit IRC15:40
*** sdake_ has quit IRC15:43
*** sdake has joined #kolla15:47
*** sdake__ has quit IRC15:49
vbelI have to put tracing into the container because it does not happen when I run by hand15:52
*** inc0 has quit IRC15:53
*** diogogmt has joined #kolla15:57
*** sdake has quit IRC15:58
*** rhallisey has quit IRC15:58
*** inc0 has joined #kolla15:59
*** rhallisey has joined #kolla15:59
vbeli do docker inspect on that container (dead) and all host binds are missing. it should have /var/run and /lib/modules16:01
vbele.g. openvswitch_db has host bind /run16:02
pbourkevbel: http://paste.fedoraproject.org/265280/1814714116:05
pbourkedocker inspect on my openvswitch_vswitchd16:05
vbelpbourke: you have them but i don't16:06
vbelI will post my docker inspect16:07
*** dolpher has quit IRC16:07
*** unicell has quit IRC16:08
*** dims has quit IRC16:10
vbelpbourke: http://paste.fedoraproject.org/265283/15015144/16:10
*** dims has joined #kolla16:10
vbelam I with wrong ansible docker module or something ...16:11
vbeldocker-py==1.3.1 on network host, ansible 1.9.2 locally16:12
pbourkeno that matches mine16:13
vbelreally don't get it - I can run things by hand and it does host binds16:14
pbourkeit must be timing based16:15
vbelI will disable restart - this can make things more troublesome :)16:16
pbourkevbel: I notice that task in ansible uses priveleged: true16:17
pbourkevbel: perhaps something security related on the host preventing it?16:18
pbourkevbel: uek, selinux or the like16:18
vbelyes, I did notice too. will dig into sleeping container to see what happens16:19
pbourkemeeting now?16:29
*** sdake has joined #kolla16:30
*** vilobhmm_11 has joined #kolla16:30
vbelpbourke: I inserted couple of echo into start.sh and now it works and binds ....16:30
sdakeirc meeting now16:31
pbourkevbel: weird16:31
vbelpbourke: very16:31
sdakevbel meeting in #openstack-meeting-4 ;)16:31
*** vilobhmm_111 has joined #kolla16:32
*** vilobhmm_11 has quit IRC16:35
*** athomas has quit IRC16:42
*** athomas has joined #kolla16:44
*** unicell has joined #kolla16:49
*** achanda has joined #kolla16:53
*** rhallisey has quit IRC16:56
*** rhallisey has joined #kolla16:56
*** banix has quit IRC17:05
*** jmccarthy has quit IRC17:07
*** jmccarthy has joined #kolla17:07
*** jmccarthy has quit IRC17:08
*** cfarquhar has joined #kolla17:08
*** cfarquhar has quit IRC17:08
*** cfarquhar has joined #kolla17:08
harmwinc0: I believe we already check docker's container startup for details to make decisions on17:08
harmwcould be fine for now, eg. usable17:08
*** jmccarthy has joined #kolla17:08
inc0so, checking stdout might be problematic, because we may have problem with finding "the correct line" for each service17:08
harmwthe real question here is, what exactly is it we want to do/achieve :)17:09
harmwmatching in a generic openstack service's output will be hard, to say the least :p17:09
inc0wait with next steps until service is actually up and running17:09
inc0not to mention non-openstack stuff like haproxy or keepalived17:09
harmwcurl it?17:09
vbelproblem: when I run 2 network nodes openvswitch_vswitchd starts on both. If I add compute node all three fail17:09
inc0https://blueprints.launchpad.net/kolla/+spec/sanity-check-container :)17:10
harmwor use nc to test if there is a listener like with haproxy17:10
inc0I was thinking about creating per-service container which will hand on until tests pass or fails17:10
*** athomas has quit IRC17:12
*** jmccarthy has quit IRC17:12
*** jmccarthy has joined #kolla17:12
*** chandankumar has joined #kolla17:13
sdakejpeeler i am getting an email response for you17:13
sdakefrom jroll17:13
vbelwhen I run one network and one compute openvswitch also starts. Can we run more than 2 ovs?17:13
harmwinc0: I commented on that spec, take a look :)17:14
sdakejpeeler in the meantime, the suggestion is to use a separate rabbitmq queue name, separate nova api, nova scheduler, nova conductor17:14
sdakerunning on that separat erabbitmq queue17:14
sdakeand register the nova endpoint as something like "baremetal"17:14
sdakethen you can override the nova service when communicating with nova17:14
inc0harmw, yeah, well, I don't presume that container is best implementation of it17:15
inc0it can be playbook, it can be mix17:15
inc0my point is, we need something17:15
harmwwith that I agree :)17:15
inc0sounds like good discussion with Kirin (japanese beer)17:16
sdakejpeeler proposed approach: http://eavesdrop.openstack.org/irclogs/%23openstack-ironic/%23openstack-ironic.2015-09-09.log.html#t2015-09-09T17:02:4017:16
jpeelersdake: well, unless i get some good docs on doing all that it may not happen. would you really not accept ironic going in with reconfiguring the services with a follow up splitting it up?17:16
sdakejpeeler well i wouldn't -2 but it seems not all that useful tbh17:17
sdakei thnk to be useful has to provide separate endpoint for bare metal deployment17:17
jpeelerit's useful for the undercloud i believe17:17
sdakein kolla there is no undercloud17:17
jpeelerperhaps not all that useful to kolla as is17:17
jpeelerbut it's a pretty big step!17:18
rhalliseyit's useful if we use a kolla based undercloud for OOO17:19
sdakeperhaps i lack imagination but i dont see how its useful to onl schedule bare metal vms with a kolla deploy17:19
sdakeif something is not needed why hae it?17:20
sdakein other words, if an undercloud isn't necessary why have one ? :)17:20
inc0sdake, tripleo still does a bunch we don't17:20
jpeeleri'm not a tripleo expert, but there are advantages17:21
* rhallisey curses haproxy bug17:21
inc0we have highly opinionated ansible deployment, 3o is much more flexible17:21
inc0and they do deploy bare metal, we dont17:21
sdakewe are not opinionated17:21
inc0and can configure rich networking, we don't17:22
sdakeyou can configure almost every part of kolla17:22
inc0(with our ootb ansible)17:22
rhalliseywell without the refactor I'm adding I'd say it's opinionated17:22
inc0I mean deployment orchiestration, not containers17:22
sdakekolla is the most flexible deployment tool currently available ;)17:23
sdakeyou can configure any openstack value any way you like17:23
sdakeyet kolla works out of the box by configuring 3 varibles17:23
inc0yeah, but it doesn't and will not (probably) configure base system17:24
inc0and that means networking for example17:24
sdakei want to tackle base system config17:24
harmwbase system, like rhel/ubuntu?17:25
sdakeyup17:25
harmwwhy not offer mesos, or something coreos :>17:25
inc0base system like you bought metal from store, put in in rack, plug cables17:25
sdakedeploying kolla is annoying  gotta setup a million things on centos17:25
inc0harmw, no python in coreos17:25
harmwinc0: that can be changed in a jiff17:25
inc0sdake, akwasnie and me were working on ansible to do it;)17:25
harmwansible can play just fine with coreos :)17:25
inc0mesos + kolla...I even proposed talk in Tokyo about it17:26
inc0didn't land :(17:26
rhalliseyinc0, only 1 did :(17:26
inc0yeah17:26
harmwmesos+kolla... that sounds fancy, but I don't think we should move in that direction17:27
harmwfeels like to much layers/overhead17:27
harmwto solve issues that should be solved up the stack17:28
sdakewe tried that with kubernetes17:28
sdakeand failed17:28
inc0sdake, you didn't do very good job in lobbying kolla on containers track...:)17:28
inc0:P17:28
sdakewe got 1 session17:28
rhalliseymaybe community isn't ready for summit talks17:29
sdakelucky to get that17:29
inc0mesos+kolla would be cool in terms of scalling openstack installation up and down dynamically17:29
rhalliseyinc0, doubt it was sdake's fault17:29
inc0I was kidding17:29
vbelhitting this on 3 node openvswitch - https://github.com/ansible/ansible-modules-core/issues/1550 . though I didnot try 1.817:29
rhalliseyinc0, :D17:29
inc0I don't think it's anyones fault really17:29
inc0however, out of curiosity, did kolla get many votes?17:29
rhalliseyinc0, I was equally surprised though17:29
*** chandankumar has quit IRC17:30
sdakekolla was middle of pack in voting17:30
sdakeprobably would have gone better if  there weren't so many submissions17:30
inc0also talks are less and less technical imho17:30
inc0from summit to summit17:30
sdakeits a shame we didn't get our lab spot17:30
rhalliseyinc0, wish we could've done the upgrade demo :(17:31
inc0let's win ruler of the stack tho17:31
rhalliseywoulda been sweet17:31
sdakewhat is ruler of  the stack17:31
inc0I really wanted "you have your old ugly package based openstack...make it kolla with no downtime":(17:31
inc0intel hosts a competition on summits17:32
inc0we bring rack of servers and winner is team who install prod ready, ha openstack in least amount of time17:32
inc0suse got the title 2 times17:32
* rhallisey wtb a db connection for haproxy :(17:32
sdakewho brings the rack of servers?17:32
*** devlaps has joined #kolla17:32
rhalliseyinc0, let's fo it17:33
rhalliseydo it17:33
rhalliseyinc0, let's install and upgrade before anyone else installs17:33
*** jmccarthy has quit IRC17:33
inc0yeah;)17:33
inc0biggest problem - we'll need to install kilo first17:33
inc0and kilo is ancient17:33
sdakewhy install kilo?17:34
*** achanda has quit IRC17:34
inc0to upgrade to L;)17:34
sdakewho provides the hardae, intel?17:34
inc0yeah17:34
sdakehow many nodes?17:34
inc0it's right there usually17:34
inc0I think it was about 2017:34
inc0baremetal with switch etc17:34
inc0there was little rack on summit floor17:35
inc0ok guys, I'm off, I have few more things to do in next few days17:36
inc0(like getting married;))17:36
rhalliseyinc0, woah!17:36
sdakegrats17:36
rhalliseycool dude!17:36
inc0yeah, I'll be a bit less active in following week, will do my best tho17:36
*** pbourke-mobile has joined #kolla17:37
rhalliseyinc0, nah go get married!17:37
pbourke-mobileHi guys anyone see this? https://openstacksummitoctober2015tokyo.sched.org/mobile/#session:0e4416e0cfe3bd3412ca1368533b693517:37
*** sdake_ has joined #kolla17:37
inc0have a drink for me this Saturday please17:37
pbourke-mobileEbay using kolla daily? :o17:37
rhalliseyya17:37
rhalliseyI did see that17:37
inc0wow17:38
sdake_huh?17:38
pbourke-mobileAmazing17:38
inc0cool, I didn't know that17:38
sdake_where was that17:38
pbourke-mobilesdake: https://openstacksummitoctober2015tokyo.sched.org/mobile/#session:0e4416e0cfe3bd3412ca1368533b693517:38
*** shardy_ has joined #kolla17:38
pbourke-mobileTake a look at @OpenStack's Tweet: https://twitter.com/OpenStack/status/641661397684912128?s=0917:38
*** achanda has joined #kolla17:38
inc0whoa....let's get these guys here17:39
inc0so they can provide feedback17:39
*** shardy has quit IRC17:40
inc0allright, see you all17:40
*** inc0 has quit IRC17:40
pbourke-mobileThe lack of feedback makes me somewhat skeptical to the extent theyre using it ;)17:40
pbourke-mobileBut hey maybe17:40
rhalliseypbourke-mobile, ya I'm curious17:40
*** sdake has quit IRC17:41
rhalliseylatest aio seems to be getting haproxy issue everytime now  :(17:43
*** shardy_ has quit IRC17:43
*** shardy has joined #kolla17:44
*** ccrouch1 has quit IRC17:44
sdake_there was one proposal that said kolla was bad and these guys had made a better version of kolla by forking our repo17:45
sdake_some cats from ibm17:45
*** sdake_ is now known as sdake17:45
sdakeno idea who they are :)17:46
rhalliseyuh17:46
rhalliseyinteresting17:46
sdaketing is kolla has undergone alot of change17:46
sdakewe went from single node to multinode ha deploy in this cycle17:46
sdakei'd like to test out 100 node deploy but lack hardware17:47
sdakei can only launch 24 vms on my gear17:47
*** jpeeler has quit IRC18:02
*** dwalsh_ has quit IRC18:03
*** dwalsh has quit IRC18:03
*** pbourke-mobile has quit IRC18:05
*** SourabhP has joined #kolla18:10
*** banix has joined #kolla18:14
*** jpeeler has joined #kolla18:16
*** dwalsh_ has joined #kolla18:18
*** dwalsh has joined #kolla18:18
*** vilobhmm_111 has quit IRC18:32
*** vilobhmm_11 has joined #kolla18:57
*** jasonsb has quit IRC19:04
*** jasonsb has joined #kolla19:05
*** jasonsb has quit IRC19:05
*** jasonsb has joined #kolla19:06
*** SourabhP has quit IRC19:06
*** chandankumar has joined #kolla19:08
*** jasonsb has quit IRC19:10
*** achanda has quit IRC19:13
*** dwalsh has quit IRC19:16
*** dwalsh_ has quit IRC19:16
*** SourabhP has joined #kolla19:20
*** dwalsh has joined #kolla19:30
*** dwalsh_ has joined #kolla19:31
*** SourabhP has quit IRC19:34
*** devlaps has quit IRC19:43
*** tfukushima has quit IRC19:51
*** chandankumar has quit IRC20:02
*** jasonsb has joined #kolla20:05
*** achanda has joined #kolla20:12
*** achanda has quit IRC20:18
*** rhallisey has quit IRC20:23
*** achanda has joined #kolla20:28
*** SourabhP has joined #kolla20:30
*** achanda has quit IRC20:49
*** jasonsb has quit IRC20:51
*** jasonsb has joined #kolla20:52
*** SourabhP has quit IRC20:52
*** SourabhP has joined #kolla20:56
*** akwasnie has quit IRC20:59
*** achanda has joined #kolla20:59
*** sdake has quit IRC21:08
*** dwalsh has quit IRC21:27
*** dwalsh_ has quit IRC21:27
*** jasonsb has quit IRC21:31
*** jtriley has quit IRC21:32
*** jasonsb has joined #kolla21:32
*** banix has quit IRC21:59
*** ccrouch has joined #kolla22:04
*** sdake has joined #kolla22:05
*** bradjones is now known as bradjones|away22:09
openstackgerritJeff Peeler proposed stackforge/kolla: Add Ansible support for Ironic  https://review.openstack.org/21974722:17
*** jruano has quit IRC23:05
*** blakec has joined #kolla23:05
*** achanda has quit IRC23:08
*** achanda has joined #kolla23:20
*** diogogmt has quit IRC23:26
*** jasonsb has quit IRC23:40
*** blahRus has quit IRC23:43
*** jasonsb has joined #kolla23:48
*** jasonsb has quit IRC23:49

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!