Thursday, 2016-01-28

SamYapleRA_: if you are forking it anyway, it would be very easy to modify it to not require docker 1.9+ (one line change i think)00:01
*** weiyu has joined #kolla00:06
*** salv-orl_ has quit IRC00:15
*** diogogmt has quit IRC00:17
*** sdake has joined #kolla00:24
*** weiyu has quit IRC00:27
*** blahRus has quit IRC00:27
*** sdake_ has joined #kolla00:28
*** sdake has quit IRC00:29
*** sdake has joined #kolla00:30
*** sdake_ has quit IRC00:33
*** mbound has quit IRC00:34
*** sdake_ has joined #kolla00:35
*** sdake has quit IRC00:38
*** mbound has joined #kolla00:42
*** RA_ has quit IRC00:42
asalkeldsdake_: if you about, could you knock this in please (fixes unit tests): https://review.openstack.org/#/c/272836/100:43
*** frzn_ has quit IRC00:44
*** mbound has quit IRC00:44
mandreasalkeld, done00:49
openstackgerritMerged openstack/kolla-mesos: Make sure any config overrides are reset  https://review.openstack.org/27283600:50
asalkeldthanks mandre00:50
*** dave-mccowan has quit IRC00:53
mandrehmm, github has been down for more than 20 min now00:54
*** dims_ has quit IRC00:55
openstackgerritAngus Salkeld proposed openstack/kolla-mesos: Fix cinder endpoint registration  https://review.openstack.org/26995900:58
openstackgerritAngus Salkeld proposed openstack/kolla-mesos: Add api_interface and service_name to hostvars  https://review.openstack.org/27277600:58
*** dave-mccowan has joined #kolla00:58
asalkeldmandre: yikes00:59
SamYaplejpeeler: hear that! github is down :P01:08
*** Liuqing has joined #kolla01:09
*** diogogmt has joined #kolla01:14
britthouserNice Unicorn though!01:22
Allen_GaoOops!01:23
*** neilus has quit IRC01:26
openstackgerritMerged openstack/kolla-mesos: Fix cinder endpoint registration  https://review.openstack.org/26995901:29
dmsimardgit.openstack.org for the win01:29
*** jasonsb has joined #kolla01:31
*** ssurana has quit IRC01:32
*** ssurana has joined #kolla01:32
*** ssurana has quit IRC01:37
*** neilus has joined #kolla01:39
*** hr_ has joined #kolla01:39
SamYapledmsimard: that goes down more than github :P but its normally up when github is down01:44
*** weiyu has joined #kolla01:44
*** mbound has joined #kolla01:45
*** frzn_ has joined #kolla01:46
*** salv-orlando has joined #kolla01:47
*** shakamunyi has joined #kolla01:48
*** sdake_ has quit IRC01:49
*** neilus has quit IRC01:49
*** mbound has quit IRC01:50
*** salv-orlando has quit IRC01:57
openstackgerritSam Yaple proposed openstack/kolla: Cleanup mariadb and make compatiable with mesos  https://review.openstack.org/27216002:06
openstackgerritSam Yaple proposed openstack/kolla: Add labels to docker module  https://review.openstack.org/27330902:06
openstackgerritSam Yaple proposed openstack/kolla: Update all bootstraps to use Label  https://review.openstack.org/27331002:06
*** shakamunyi has quit IRC02:10
openstackgerritSam Yaple proposed openstack/kolla: Add labels to docker module  https://review.openstack.org/27330902:10
openstackgerritSam Yaple proposed openstack/kolla: Update all bootstraps to use Label  https://review.openstack.org/27331002:10
*** shakamunyi has joined #kolla02:11
openstackgerritSam Yaple proposed openstack/kolla: Update all bootstraps to use Label  https://review.openstack.org/27331002:12
weiyuwhen I deploy ceph, meet a question02:17
*** RA_ has joined #kolla02:17
weiyudocker/ceph/ceph-mon/extend_start.sh   must use $(hostname -s) replace $(hostname)02:19
weiyu:SamYaple02:21
*** tobe has joined #kolla02:22
*** unicell has quit IRC02:23
*** sdake has joined #kolla02:29
*** sdake has quit IRC02:29
*** neilus has joined #kolla02:33
*** neilus has quit IRC02:37
*** kjelly has quit IRC02:41
*** kjelly has joined #kolla02:42
openstackgerritSam Yaple proposed openstack/kolla: Rework log output if pull fails  https://review.openstack.org/27209902:46
*** rhallisey has quit IRC02:48
*** hr_ has quit IRC02:52
SamYapleweiyu: im confused, what is your question again?02:55
*** sdake has joined #kolla02:55
weiyu$(hostname) return host's fqdn in centos702:58
SamYaplefor the ceph mon, that is desired, no?02:59
SamYapleit does the same on ubuntu02:59
frzn_SamYaple: do you sleep ?02:59
SamYaplefrzn_: yea. sometimes02:59
frzn_gotcha.02:59
weiyubut ansible/roles/ceph/templates/ceph-mon.json.j2  ansible_hostanem = host's short name02:59
*** signed8b_ has quit IRC02:59
*** Jeffrey4l has joined #kolla03:00
weiyuThis make my ceph_mon don't start03:02
frzn_weiyu: you can use ansible_fqdn03:02
frzn_instead of ansible_hostname03:02
frzn_br..03:02
frzn_brb*03:02
weiyuI used ansible_nodename03:03
openstackgerritSam Yaple proposed openstack/kolla: Add labels to docker module  https://review.openstack.org/27330903:05
openstackgerritSam Yaple proposed openstack/kolla: Update all bootstraps to use Label  https://review.openstack.org/27331003:05
*** mdnadeem has joined #kolla03:08
SamYapleweiyu: would your suggested fix be to use the FQDN or to set hostname -s?03:09
*** frzn_ has quit IRC03:09
weiyuI suggest set hostname -s03:09
*** RA_ has quit IRC03:09
SamYapleweiyu: ok lets do that.03:10
SamYaplethats probably best for backwards compatibility03:10
weiyu$(hostname -s) equal to ansible_hostname, but $(hostname) isn't03:12
SamYapleweiyu: yes. i agree03:12
weiyu:SamYaple I will do that03:13
Jeffrey4lAbout this https://bugs.launchpad.net/kolla/+bug/1538136 this issue really exist. Why you mark it Invalid?03:20
openstackLaunchpad bug 1538136 in kolla "mariadb can not start from a host reboot" [Undecided,Invalid] - Assigned to Jeffrey Zhang (jeffrey4l)03:20
Jeffrey4lSamYaple, ^03:20
*** neilus has joined #kolla03:34
*** Marga_ has quit IRC03:38
*** neilus has quit IRC03:39
*** salv-orlando has joined #kolla03:43
*** hr_ has joined #kolla03:43
*** dave-mccowan has quit IRC03:49
*** sdake_ has joined #kolla03:50
*** sdake has quit IRC03:51
*** coolsvap|away is now known as coolsvap03:54
*** salv-orlando has quit IRC03:56
sdake_Jeffrey4l i fixed that bug state up for you03:58
sdake_note you are welcome to do tht yourself i you want03:58
*** ssurana has joined #kolla04:00
*** ssurana has left #kolla04:02
Jeffrey4lthanks sdake_ ,  I know I can change the state. But I just want to know the reason why SamYaple change it.04:03
sdake_it is a valid bug04:03
sdake_he used yoru bug id in his fix04:04
sdake_which looks correct to me04:04
sdake_read hte last comment he made on the gerrit tracker04:04
sdake_he just forgot to change the bug id when he wsa done fixing it :)04:04
sdake_or rather change the bug states04:04
sdake_i think what happened is he nerd raged because popele submit that patch every couple of weeks :)04:05
sdake_using labels is the way to go04:05
*** sdake_ is now known as sdake04:05
sdakebut then again who knows what goes on in sam's head :)04:06
sdakeor mine or yours :)04:06
Jeffrey4lGot it . Thanks a lot.04:06
sdakesure happy to help resolve that conflcit ;)04:06
sdakeno I AM YOUR FATHER04:19
*** Liuqing has quit IRC04:20
*** Liuqing has joined #kolla04:22
*** unicell has joined #kolla04:29
SamYapleJeffrey4l: I don't recall marking that invalid so it was probably a slip of the mouse04:30
openstackgerritSam Yaple proposed openstack/kolla: Rework log output if pull fails  https://review.openstack.org/27209904:33
openstackgerritSam Yaple proposed openstack/kolla: Enable find_disks module to match by filesystem label  https://review.openstack.org/27240904:34
Jeffrey4lSamYaple, roger that. I have found your PS.04:36
openstackgerritMerged openstack/kolla-mesos: Add api_interface and service_name to hostvars  https://review.openstack.org/27277604:40
*** tpot has quit IRC04:46
*** frzn_ has joined #kolla04:47
*** weiyu has quit IRC04:51
*** coolsvap is now known as coolsvap|away04:51
*** Marga_ has joined #kolla04:58
*** coolsvap|away is now known as coolsvap04:59
*** Marga_ has quit IRC05:02
*** unicell has quit IRC05:08
*** RA_ has joined #kolla05:09
*** tpot has joined #kolla05:10
*** weiyu has joined #kolla05:19
sdakesamyaple about?05:24
openstackgerritweiyu proposed openstack/kolla: reset $(hostname) to $(hostname -s) in ceph extend_start.sh  https://review.openstack.org/27334005:24
SamYaplesdake: yea05:29
*** reddy has joined #kolla05:30
*** tpot has quit IRC05:46
weiyuhello,sdake and SamYaple what's mean that "please file a techdebt bug "05:47
*** sdake_ has joined #kolla05:48
*** unicell has joined #kolla05:48
*** sdake has quit IRC05:49
SamYapleweiyu: Don't worry about it. sdake was asking you to file a bug but its not needed since you are preseving existing behaviour05:56
*** tpot has joined #kolla05:57
weiyuOh ,I see05:57
weiyuTanks05:57
*** sdake_ has quit IRC06:00
*** sdake has joined #kolla06:01
*** sdake_ has joined #kolla06:08
*** sdake has quit IRC06:10
*** tpot has quit IRC06:16
*** Marga_ has joined #kolla06:17
*** Marga_ has quit IRC06:17
*** Marga_ has joined #kolla06:18
*** frzn_ has quit IRC06:19
*** tfukushima has joined #kolla06:29
*** stvnoyes has quit IRC06:33
*** stvnoyes has joined #kolla06:34
*** salv-orlando has joined #kolla06:38
sdake_it was a "I dont know if its necessary" request fwiw :)06:44
sdake_weiyu  ^^06:44
*** RA_ has quit IRC06:48
sdake_well time to ptfo06:48
sdake_night folks06:48
*** salv-orlando has quit IRC06:49
weiyusdake_ It is backwards compatibility ^^06:55
sdake_roger06:55
sdake_i just dont want upgrades to turn into a charlie foxtrot of a bunch of incompatible changes so i'd like to track those things which will make upgrades not work06:56
*** unicell has quit IRC06:56
weiyuI see07:01
openstackgerritSam Yaple proposed openstack/kolla: Fix swift build issue  https://review.openstack.org/27286407:07
openstackgerritMerged openstack/kolla: reset $(hostname) to $(hostname -s) in ceph extend_start.sh  https://review.openstack.org/27334007:08
*** unicell has joined #kolla07:09
sdake_SamYaple ping07:10
sdake_how do i pull the registery v2 dev version07:10
sdake_all i see is 2.207:10
sdake_and 2.2107:11
SamYaplesdake_: just build the dockerfile07:16
SamYaplefrom master07:16
*** salv-orlando has joined #kolla07:26
*** unicell has quit IRC07:44
*** coolsvap is now known as coolsvap|away08:00
*** fgimenez has joined #kolla08:03
*** fgimenez has quit IRC08:03
*** fgimenez has joined #kolla08:03
*** alisonh has quit IRC08:08
*** salv-orlando has quit IRC08:10
*** weiyu has quit IRC08:14
*** barra204 has joined #kolla08:17
*** kejlly_ has joined #kolla08:17
*** weiyu has joined #kolla08:17
*** dmsimard1 has joined #kolla08:18
*** akwasnie has joined #kolla08:18
*** athomas_ has joined #kolla08:18
*** bmace_ has joined #kolla08:19
*** kjelly has quit IRC08:19
*** dmsimard has quit IRC08:19
*** shakamunyi has quit IRC08:19
*** athomas has quit IRC08:19
*** mdnadeem has quit IRC08:19
*** bmace has quit IRC08:19
*** sdake_ has quit IRC08:19
*** mdnadeem has joined #kolla08:20
*** sdake has joined #kolla08:21
akwasniemorning guys;)08:21
*** bmace_ has quit IRC08:23
*** alisonh has joined #kolla08:26
nihilifereo/08:30
*** gfidente has joined #kolla08:35
*** sdake has quit IRC08:40
*** kproskurin has joined #kolla08:41
*** diga has joined #kolla08:42
*** sdake has joined #kolla08:47
*** ppetit has joined #kolla08:48
*** rmart04 has joined #kolla08:52
*** mbound has joined #kolla08:54
*** shardy has joined #kolla09:00
*** achanda has quit IRC09:01
*** ppetit_ has joined #kolla09:06
*** ppetit has quit IRC09:07
*** ppetit_ is now known as ppetit09:07
*** tzn has quit IRC09:10
*** salv-orlando has joined #kolla09:11
*** ppetit has quit IRC09:15
*** egonzalez90 has joined #kolla09:16
openstackgerritProskurin Kirill proposed openstack/kolla-mesos: Improve logging in deploy.py  https://review.openstack.org/27299209:20
openstackgerritProskurin Kirill proposed openstack/kolla-mesos: Improve logging in deploy.py  https://review.openstack.org/27299209:22
*** egonzalez90 is now known as egonzalez09:47
*** alisonh has quit IRC10:06
openstackgerritMerged openstack/kolla: Remove the libvirt socket  https://review.openstack.org/27321610:06
*** salv-orl_ has joined #kolla10:06
*** ppetit has joined #kolla10:08
*** salv-orlando has quit IRC10:09
*** alisonh has joined #kolla10:10
*** Liuqing has quit IRC10:13
openstackgerritMerged openstack/kolla: Fix swift build issue  https://review.openstack.org/27286410:14
openstackgerritMerged openstack/kolla: Add the missed stub upgrade.yml  https://review.openstack.org/27289710:15
openstackgerritMichal Rostecki proposed openstack/kolla: Use trusts in heat.conf  https://review.openstack.org/23619810:15
*** weiyu has quit IRC10:29
*** weiyu has joined #kolla10:30
*** akwasnie has quit IRC10:42
*** fgimenez has quit IRC10:48
*** fgimenez has joined #kolla10:48
*** fgimenez has quit IRC10:48
*** fgimenez has joined #kolla10:48
*** weiyu has quit IRC11:01
*** dims has joined #kolla11:07
openstackgerritProskurin Kirill proposed openstack/kolla-mesos: Add heat config  https://review.openstack.org/27197811:14
*** jmccarthy has joined #kolla11:26
openstackgerritProskurin Kirill proposed openstack/kolla-mesos: Improve logging in deploy.py  https://review.openstack.org/27299211:29
*** tzn has joined #kolla11:30
*** salv-orl_ has quit IRC11:34
*** tobe has quit IRC11:41
*** tfukushima has quit IRC11:47
*** athomas_ has quit IRC11:53
*** rhallisey has joined #kolla11:54
*** pbourke has quit IRC12:03
*** pbourke has joined #kolla12:03
*** neilus has joined #kolla12:07
*** neilus has quit IRC12:11
*** egonzalez has quit IRC12:13
*** ppetit has quit IRC12:13
*** iceyao has quit IRC12:14
*** neilus has joined #kolla12:15
*** neilus has quit IRC12:19
*** salv-orlando has joined #kolla12:21
*** weiyu has joined #kolla12:22
Jeffrey4lsdake, I am sure that the qemu process will be killed even when using pid=host mode.12:28
Jeffrey4lwhen restart docker service.12:28
Jeffrey4lwe talked this on last meeting.12:28
*** ppetit has joined #kolla12:37
*** dave-mccowan has joined #kolla12:41
*** tobe has joined #kolla12:41
*** dwalsh has joined #kolla12:41
*** dwalsh has quit IRC12:43
*** hr_ has quit IRC12:43
*** dwalsh has joined #kolla12:44
*** dims has quit IRC12:47
*** diga has quit IRC12:48
openstackgerritJeffrey Zhang proposed openstack/kolla: Remove the machine-id which cause nova-compute raise exception  https://review.openstack.org/27350812:48
*** Allen_Gao has quit IRC12:53
openstackgerritProskurin Kirill proposed openstack/kolla-mesos: Add heat config  https://review.openstack.org/27197812:54
*** fgimenez has quit IRC12:55
*** fgimenez has joined #kolla12:57
*** fgimenez has quit IRC12:57
*** fgimenez has joined #kolla12:57
sdakemorning12:59
sdakeya i didn't try docker restart12:59
sdakejust restart of services under docker control12:59
sdakethe fact that docker kills everyhting it starts, nothing can be dne about that12:59
sdakedocker is meant not to be restarted12:59
Jeffrey4lyep13:02
Jeffrey4lSo when upgrade the services, this should be needed more consideration to the case.13:03
*** tobe has quit IRC13:09
*** Allen_Gao has joined #kolla13:10
*** sdake has quit IRC13:16
*** sdake has joined #kolla13:18
sdakesome cat sent me a job offer for "between 42000 euro and 80000 euro"13:18
sdakei'm thrillled!13:18
sdakeJeffrey4l i dont have a good answer for upgrading docker without blowing up the cluster13:19
sdakei am aware of the problem13:20
sdakebut i am not taking care of it13:20
sdakebecause there is ntohing i can really do aout it13:20
sdakeits a fundamental flaw in docker at this point in time13:20
*** iceyao has joined #kolla13:21
*** signed8b_ has joined #kolla13:21
*** weiyu has quit IRC13:22
Jeffrey4lYep. btw, upgrade the nova-libvirt container(libvirt service) should also encounter this issue, too.13:23
sdakedisagree13:24
sdaketest it and prove it13:24
sdakesdake.io check out my proof in my blog post13:24
sdakegranted that was on docker 1.4.1 ;)13:25
Jeffrey4lI tested. qemu process is start by libvirt in nova-libvirt containers. restart the nova-libvirt container, the qemu process will be killed.13:25
sdakehow are you rstarting the nova-libvirt container?13:25
Jeffrey4l`docker restart nova-libvirt`13:26
sdakei tested at late as 1.8.3 with a redeploy and that works13:26
sdakeok well docker restart is not wht we do in kolla13:26
sdakewe kill the container13:26
sdakethe nwe start it13:26
sdaketest real world redeploy - we need to know if that broke13:27
Jeffrey4lIsn't it the same? Kill the container meanins all the processes in the container being killed.13:27
sdakedeploy once, deploy ag ain13:27
sdakeno docker can't kill processes in qemu space because it doesn't know about them13:27
sdakeit can kill libvirt13:27
sdakebecause it knows about that13:27
sdakeqemu it doens't know about because qemu are not children of libvirt on libirt death, they are inherited by init13:28
Jeffrey4lre-deploy won't hurt. But upgrade will.13:28
sdakelibvirt doen't13:28
Jeffrey4lBut qemu and libvirt are in the same mount namespace.13:28
sdakehow is upgrade different then redeploy13:28
sdakein redeploy we kill and start13:28
sdakein upgrade we kill and start13:28
Jeffrey4lok. let me try the kill and start first. Maybe it is different with my thinking.13:29
sdakenow maybe container rm -f will destroy qemu, i haven't tried that13:29
sdakei was focused in my blog post can libvirt be upgraded without interrupting existing  vms, and the answer was yes13:30
Jeffrey4lsdake, http://paste.openstack.org/show/485266/ see qemu process is killed when the nova-libvirt container is killed.13:31
*** RA_ has joined #kolla13:31
*** Liuqing has joined #kolla13:32
Jeffrey4lsdake, if there is not docker container stuff. stop/upgrade the libvirt is OK and the qemu process will be remain.13:32
sdakewell that is a change in how docker operates13:33
sdakehave you read my blog post?13:33
Jeffrey4lsdake, no. I read it now.13:33
sdakemaybe there is a different command besides kill13:33
sdakejust waking up here, give me a little bit to get brain booted13:33
sdakewhich version of docker are on13:34
sdakeJeffrey4l ^^^13:34
Jeffrey4l1.9.113:34
*** signed8__ has joined #kolla13:41
*** signed8b_ has quit IRC13:42
*** v1k0d3n has quit IRC13:43
*** Liuqing has quit IRC13:44
*** weiyu has joined #kolla13:44
*** Liuqing has joined #kolla13:47
*** v1k0d3n has joined #kolla13:48
*** weiyu has quit IRC13:49
*** RA_ has quit IRC13:52
*** Liuqing has quit IRC13:52
sdakeJeffrey4l is libvirt still running in pid=host mode?13:53
openstackgerritMauricio Lima proposed openstack/kolla: Add ansible support for Manila  https://review.openstack.org/26968813:53
Jeffrey4lsdake, I deploy by using kolla-ansible. And I double checked it just now. It is using pid=host mode.13:54
sdakeJeffrey4l i see kolla docker says so13:54
sdakerather the ansible code13:54
sdakecan you introspect th econtainer and mmake sure13:54
Jeffrey4lyep. I checked it using the `docker inspect`13:55
Jeffrey4l"PidMode": "host",13:55
Jeffrey4lsdake, &13:55
sdakedocker odesn't reap zombie processes or send children kill signals13:55
sdaketherefore qemu shoudl not be affected13:55
sdaketry docker kill -s KILL libvirt13:56
sdakeperhaps the default was changed13:56
* Jeffrey4l trying13:57
*** iceyao has quit IRC13:58
Jeffrey4lsdake, the same. qemu is kill, too.13:58
sdakeok well i'm out of ideas13:59
sdakeperhaps there is a way to start a container with protected attributes13:59
sdakesuch that its children rent killed13:59
sdakethis is a behavior change in docker13:59
sdakei spent 2 weeks making this work in liberty14:00
Jeffrey4lok. I will search more info about this.14:00
sdakewe may need to patch docker in some way to add a f eature to avoid killing processes14:01
sdakedwalsh ping ^^14:01
openstackgerritMauricio Lima proposed openstack/kolla: Update cleanup-containers to remove manila containers  https://review.openstack.org/27355814:02
*** salv-orlando has quit IRC14:09
openstackgerritMauricio Lima proposed openstack/kolla: Add ansible support for Manila  https://review.openstack.org/26968814:11
*** Allen_Gao has quit IRC14:14
Jeffrey4lsdake, event though, I have no much knowledge about the docker. But I still think it should be a bug that the child process remain after killing the container. Docker should avoid this. (just some thoughts)14:14
sdakei agree but that is not how it used to behave14:15
sdakeperhaps we can get it to behave as it used to with a  config option14:15
sdakeJeffrey4l can you tell me what patch had you and sam fixed with the label14:17
*** iceyao has joined #kolla14:17
sdakeeither the review or the bug #14:17
Jeffrey4lsdake, you want this https://launchpad.net/bugs/153813614:18
openstackLaunchpad bug 1538136 in kolla "mariadb can not start from a host reboot" [Critical,In progress] - Assigned to Jeffrey Zhang (jeffrey4l)14:18
openstackgerritSteven Dake proposed openstack/kolla: check out the review in this patch  https://review.openstack.org/27356514:22
nihiliferwat14:23
sdakedamnit14:23
sdakeJeffrey4l or nihilifer i subitted a full review for patch set 3 in manilla and cant' save my comments14:23
sdakeany tips on how to do that?14:24
sdakesince patch set 4 is avaiable14:24
nihilifersdake: do you havew this 3rd patched picked in "diff against"?14:25
nihiliferhave*14:26
sdakenm had to maximize browser for reply butotn to appear14:26
sdakewierd bug14:26
*** salv-orlando has joined #kolla14:26
sdakewhich is maurico lima's nick?14:26
*** reddy has quit IRC14:27
*** neilus has joined #kolla14:27
sdakeif your out there nice work dude14:27
Jeffrey4lsdake, this https://review.openstack.org/#/c/269688/3 ?14:27
sdakeyes14:27
sdakei figured ito ut jefrey4l14:27
Jeffrey4lwhat's mean by "can't save comments"?14:28
sdakethe repely button didn't appaer in my browsser window14:28
Jeffrey4lI saw your comments.14:28
sdakeuntil i maximized my browser14:28
Jeffrey4llol14:28
*** diogogmt has quit IRC14:28
Jeffrey4lyes. I reproduced it..14:29
nihiliferwell, i'll repeat myself again, but gertty is the best solution here ;)14:29
sdakewhat is gertty14:29
nihilifergerrit cli14:29
limamauriciosdake: I saw your rewiers, I'll fix it14:29
limamauricioThanks you14:29
*** salv-orlando has quit IRC14:29
sdakelimamauricio rockin work dude14:29
sdakecan i ask you, how long did you think you spent on that service14:29
dwalshsdake, Use runc.  :^)14:29
nihilifersdake: https://github.com/openstack/gertty14:29
*** salv-orlando has joined #kolla14:29
sdaketrying to get a handle on how long it takes people to come up to speed on implementing  anew service in kolla14:30
sdakedwalsh runc is what14:30
Jeffrey4ldidn't know this tool. thanks nihilifer14:30
limamauricio3 days, but I just updated the mkoderer path.14:30
*** neilus has quit IRC14:31
limamauricio It was hard for me, but I am beginner in this, so I think I did well14:31
*** diogogmt has joined #kolla14:32
sdakedwalsh is runc like,  a legit project14:32
sdakeor are you kidding around14:32
*** dmsimard1 is now known as dmsimard14:34
limamauriciosdake: I'm having lunch now, I'll commit your changes when I come back14:38
*** jtriley has joined #kolla14:43
*** neilus has joined #kolla14:45
dwalshsdake, Depends on what you mean by legit.  It is used heavily in upcoming docker, but it is still libcontainer.  When docker moves to executing runc directly versus using libcontainer, then I guess you could have more confidence.14:47
dwalshProblem with runc, is you don't get COW file system.  But I believe we should not use COW file sytems in production, just start using R/Only traditional chroot OS.14:48
*** inc0 has joined #kolla14:49
*** diogogmt has quit IRC14:49
sdakedwalsh cool well its too late in our cycle to switch to that14:49
sdakebut really my quesiton was more about theprocess handling semantic of kill with pid=host14:49
sdakepreviously qemu processes weere not killed14:49
sdakewith docker 1.9.1 all processes are killed when libvirtd is sent  a sigkill14:50
sdakethis is totally not suitable14:50
sdakei get runc can handle the docker daemon restart problem14:50
sdakethat seems super cool14:50
kproskurinGuys, I trying to deploy mesos infra from kolla master and getting this: http://fpaste.org/315781/53992636/14:51
*** neilus has quit IRC14:55
sdakekproskurin are you using docker 2.0.0?14:56
*** neilus has joined #kolla14:56
*** akwasnie has joined #kolla14:56
*** mdnadeem1 has joined #kolla14:56
kproskurinOh I got 1.9.114:56
sdake1.9.414:56
sdakesorry not docker14:56
sdakei mean ansible14:56
sdakedocker 1.9.1 is confirmed to work14:57
sdakeansible 2.0.0 does not work14:57
sdakeyour bcktrace looks like an ansible 2.0.0 problem to me14:57
kproskurinops, yeah, I have 2.014:57
sdakeuse 1.9.4. please14:57
kproskurinok, ty14:57
sdakewe have not ported to 2.0.0 and will not be doing so for mitaka14:57
dwalshsdake, Then something got broken in docker-1.9. You mean the vms are not reparented else where out of the container?14:57
dwalshIt is using pid=host?14:58
dwalshcorrect?14:58
sdakedwalsh roger14:58
sdakedwalh i tested this ion docker 1.6ish and it worked like a champ14:58
dwalshThen that is a new bug.  Please open a bugzilla at redhat.com and I will have someone look at it.14:58
sdakeand docker 1.8ish14:58
sdakeJeffrey4l can you open a bug please and copy dwalsh on it14:58
Jeffrey4lnp14:59
dwalshI have not seen a bug, so I did not know.  I will ping rhallisey to test it and will see about getting a fix.14:59
sdakedwalsh should we not open a issue in he issue tracker upstream as wel?14:59
dwalshSure.  Do both.14:59
dwalshI get yelled at about bugs, though.  :^)14:59
sdakeJeffrey4l there is your course of action from the one of3 docker experts i know :)14:59
sdakedwalsh 1.9.1 not reparting and rather killing seems to make more sense to me15:00
sdakebut its not what we need for libvirt!15:00
Jeffrey4lcool15:00
*** fgimenez has quit IRC15:00
Jeffrey4lbtw, i will start a docker 1.8 to test this case.15:00
sdakeJeffrey4l use the word "regression" in the title15:01
sdakeJeffrey4l that would rock bu tyou may have to ue liberty for that, i think our anible module is not compatible with docker .18 and our named volumes definately are not15:01
sdakeJeffrey4l please add me to the bugizilla cc as well as the issue tracker list15:02
sdakethis is a critical critical issue to solve15:02
Jeffrey4lI can start a simple test. by using `nohub sleep 3000&` to simulate the qemu. I think it should be the same15:02
sdakeJeffrey4l note runc as dwalsh pointed out solves the docker restart problem15:02
sdakeit uses a separate process to create teh container15:02
sdakeso if docker restarts, runc stays intact15:02
sdakeso, it hink that is future tech15:03
Jeffrey4lroger.15:03
sdakeso there is our answer to that problem15:03
sdake"its coming" :)15:03
Jeffrey4lGood news.15:03
sdakei wish i kenw about runc in july 2015 when it was announced15:03
sdakei got asked that same fn question 20 times at openstack summit15:03
sdakeit was really frustrating that I had to answer with the lame "docker is not supposed to be restarted in our model"15:04
sdakedwalsh is runc and hte docker daemon going to be integrated?15:04
sdakedwalsh atm we are highly reliant on the docker api, which is loosly stable in the current docker series15:05
sdakedwalsh second quesiton, runc is based entirely on libcontainer in the backend, so it has the same functioanl behavior as docker?15:05
*** fgimenez has joined #kolla15:05
*** fgimenez has quit IRC15:05
*** fgimenez has joined #kolla15:05
sdakelimamauricio enjoy lunch, when ou return, you aid it took you 3 days, but how much "code time" did it take you, not including review turnarounds15:06
*** neilus has quit IRC15:07
sdakelimamauricio aid/said15:08
*** dims has joined #kolla15:08
*** fthiagogv has quit IRC15:10
*** diogogmt has joined #kolla15:21
*** diogogmt has quit IRC15:23
*** ppetit has quit IRC15:23
*** iceyao has quit IRC15:25
Jeffrey4lsdake, what docker version are you using in you article?15:28
*** akwasnie has quit IRC15:29
*** daneyon has joined #kolla15:30
*** achanda has joined #kolla15:32
*** daneyon_ has quit IRC15:32
*** blahRus has joined #kolla15:33
dwalshsdake, Supposedly docker daemon will generate a OCI json data and then execute runc to act on it, in docker-1.11 or later.  We shall see.  Their goal is to allow you to specify other backends like clearcontainers, lxc, Windows? Any back end that supports the oci json should be able to run.15:42
dwalshrunc is an OCI back end based on libcontainer.15:43
*** akwasnie has joined #kolla15:43
*** achanda has quit IRC15:43
dwalshsdake, It has the same functionality as the libcontainer execdriver.  Obviously not all of the docker daemon functions. Like graphc/pull/push etc.15:44
*** neilus has joined #kolla15:44
*** neilus has quit IRC15:49
*** Jeffrey4l has quit IRC15:52
*** pbourke has quit IRC15:59
*** daneyon_ has joined #kolla15:59
*** daneyon has quit IRC16:01
*** diogogmt has joined #kolla16:02
*** salv-orl_ has joined #kolla16:06
*** Jeffrey4l has joined #kolla16:06
sdakedamn we need pull16:08
*** salv-orlando has quit IRC16:09
*** akwasnie1 has joined #kolla16:11
*** akwasnie has quit IRC16:14
*** pbourke has joined #kolla16:15
*** akwasnie1 has quit IRC16:15
*** neilus has joined #kolla16:21
openstackgerritProskurin Kirill proposed openstack/kolla-mesos: Add memcached support  https://review.openstack.org/26647716:21
*** rmart04 has left #kolla16:21
*** neilus has quit IRC16:25
*** unicell has joined #kolla16:26
openstackgerritProskurin Kirill proposed openstack/kolla-mesos: Add memcached support  https://review.openstack.org/26647716:27
*** ppetit has joined #kolla16:29
SamYaplemorning16:29
*** Jeffrey4l has quit IRC16:33
*** Jeffrey4l has joined #kolla16:34
nihiliferany european folks are going to fosdem? ;)16:34
pbourkenihilifer: ive been meaning to for about the past 3 years16:41
pbourkenihilifer: keep forgetting about it till its too late16:41
SamYaplemorning pbourke16:41
pbourkeSamYaple: howdy16:41
openstackgerritProskurin Kirill proposed openstack/kolla-mesos: Support deploy without configs  https://review.openstack.org/26647616:43
Jeffrey4lsdake, do not know how to add you to the cc list. But here is the bug url https://bugzilla.redhat.com/show_bug.cgi?id=130280716:46
openstackbugzilla.redhat.com bug 1302807 in docker "regression: Unattached child process should exist when the container is killed in docker container with pid=host" [Unspecified,New] - Assigned to andreas.bierfert16:46
openstackgerritJeffrey Zhang proposed openstack/kolla: Remove the machine-id which cause nova-compute raise exception  https://review.openstack.org/27350816:48
Jeffrey4lsdake, but I tested this with docker 1.6.2 , and the child process is killed the same. :(16:50
sdakedwalsh can you comment on that ^16:51
sdakeaare you sure pid mode is being set?16:52
sdakeas in are you launching from the command line16:52
openstackgerritQiu Yu proposed openstack/kolla: Detect and use physical disks for Swift storage  https://review.openstack.org/27241016:52
Jeffrey4lsdake, docker run -it --privileged --pid=host --net host centos bash16:52
sdakeand the nwhat?16:53
* Jeffrey4l is writing16:53
SamYapleJeffrey4l: i see the same thing you see, but this wasnt always the case16:54
SamYapleJeffrey4l: ill see if i can figure it out16:54
Jeffrey4lSamYaple, you mean the docker?16:54
dwalshsdake, I will have my guys look at this.16:55
SamYapleJeffrey4l: yea16:56
*** neilus has joined #kolla16:57
SamYapleJeffrey4l: does the machine-id bug also affect liberty? (sounds like it should)16:57
kproskurinSamYaple: Sorry I didnt answered for your comment in memcached review. I did it now.16:58
Jeffrey4lSamYaple, yep it should. ( i am thinking it should be introduced from centos:7.2 )16:58
SamYapleJeffrey4l: i updated the bug to target liberty too16:58
*** mdnadeem1 has quit IRC16:58
SamYaplekproskurin: ok thanks!16:59
Jeffrey4lthanks a lot.16:59
Jeffrey4lsdake, dwalsh SamYaple see this small test about the docker issue http://paste.openstack.org/17:00
*** akwasnie has joined #kolla17:02
Jeffrey4lsorry, here is the link http://paste.openstack.org/show/485293/17:02
*** mdnadeem1 has joined #kolla17:02
Jeffrey4lsdake, dwalsh SamYaple ^17:02
sdakedwalsh thanks , fwiw it could bea problem on our end17:03
SamYaplepbourke: Jeffrey4l I believe I have answered your questions about the LABEL mechanism in kolla_docker17:05
*** diogogmt has quit IRC17:06
sdakeJeffrey4l what process is 432017:06
SamYapledwalsh Jeffrey4l It looks like even though the pid is in the host pid namespace the parent process is still under the docker daemon17:08
Jeffrey4lsdake, it is not the process id.17:08
sdakeJeffrey4l sorry wron question, what proess is the parent of 432017:08
sdakesorry not 4320 the sleep process17:08
Jeffrey4lsdake, 4320 should be the VSZ( from ps, I have no idea for this)17:09
SamYaplesdake: don't worry qemu still survives17:10
*** akwasnie1 has joined #kolla17:10
SamYapleim just trying to figure out a test to reproduce qemu launching17:10
SamYapleprobably need to disown17:10
Jeffrey4lSamYaple, tried. not work. (may be i am wrong), pls test it.17:10
SamYapleJeffrey4l: i have17:11
*** neilus has quit IRC17:11
SamYaplekilled the docker daemon entirely, qemu still running17:11
SamYaplebut thats because its parent is pid 117:11
Jeffrey4l:(17:11
sdakewho is the parent id of the sleep jeffrey4l17:11
sdakewith host=pid, sleep shoud lbe reparented to 1 when baah is killed17:12
*** akwasnie has quit IRC17:12
SamYaplesdake: this is not the case17:12
*** akwasnie1 has quit IRC17:12
SamYaplethis is probably a thing libvirt is doing and im trying to figure out what its doing17:13
Jeffrey4lsdake, 117:13
sdakeoh ya could be a libvirt change17:13
sdakejeffrey1 good thats whati t should be17:13
sdakethat means sdocker hansn't mucked wit h the zombie repeaing proess problem17:13
sdakealthoug hthe fact that Jeffrey4l's sleep thing also kills the sleep is worrisome SamYaple17:14
*** neilus has joined #kolla17:15
SamYaplesdake: yea I can produce the same beahviour17:16
SamYaplei wonder if qemu is only sticking around because it ignored the kill17:16
SamYapleI mean the end result is it sticks around17:16
SamYaplebut still17:16
sdakesigkill cannot be ignored17:16
SamYaplei didnt say sigkill17:16
sdakesee man 7 signal17:16
SamYapleand it can kinda be ignore17:17
SamYaplenot by the process but it will zombie of there is certain things waiting (like IO)17:17
limamauriciosdake: I did your changes, I'm thinking of changing the init-runonce to make some necessary settings for the manila work. What do you think?17:17
sdakeSamYaple agree re zombie17:17
limamauricioget if enable_manila = yes17:17
limamauricioand do it17:17
sdakelimamauricio sure get em in and we will review them - but needs to be optional17:17
*** mdnadeem1 has quit IRC17:18
sdakebut if a process is not zombie it cannot ignore sigkill since kernel terminates it with prejudice17:18
SamYapleJeffrey4l: if you launch a container with pid=host and run this command `( sleep infinity & )` then kill -9 the docker daemon the process sticks around17:18
SamYaplestoping the container kills the process though17:19
* Jeffrey4l is trying17:19
limamauricioI'll change the init-runonce and commit for review in the same path17:19
limamauriciook?17:19
sdakewfm17:19
*** fgimenez has quit IRC17:19
SamYaplelimamauricio: init-runonce doesn't read enable_manila=yes17:19
limamauricio:/17:20
*** unicell has quit IRC17:20
SamYaplelimamauricio: we only do basic environment init with that17:20
SamYapleie, neutron glance nova keystone17:20
SamYapleno heat or cinder or anythign else17:20
SamYapleyou would be better off creating an init-manila script17:20
Jeffrey4lSamYaple, yes, you are right. but it should be dangoure to send kill -9 to docker daemon.17:21
SamYapleJeffrey4l: im not suggesting it, im pointing it out as we map behaviour17:22
Jeffrey4lhmm..17:22
SamYapleJeffrey4l: but keep in mind, I have a qemu process running and i stop the nova_libvirt container like normal17:23
SamYapleso libvirt is doing _something_ helpful here17:23
*** neilus has quit IRC17:23
Jeffrey4lsure.17:23
SamYaplewe need to identify how it launches the process17:23
*** diogogmt has joined #kolla17:24
Jeffrey4lsome thoughs17:24
Jeffrey4l1. how about start every one qemu process in a docker container?17:25
SamYapleJeffrey4l: we cant do that17:25
SamYaplewe dont start qemu processes17:25
SamYaplelibvirt does17:25
Jeffrey4l2. we can not exec in a stop container, so what will be happend when the container is killed, but the qemu binary is still used from that container.17:26
SamYapleJeffrey4l: so when the qemu is dangling when the nova_libvirt process starts again it can reattach and remanage that process17:27
SamYaplebut assuming its not coming backup, you can kill it from the host17:27
Jeffrey4lI know that. Just thoughts.(may be some hack method could be used.) Just throw these for brain storm :D17:28
SamYapleyea keep it coming!17:29
SamYaplethis is how problems get solved17:29
Jeffrey4lyep17:29
Jeffrey4lBased on 2: I still think it is impossible to stop the container and start it again with the child process unchanged.17:30
*** akwasnie has joined #kolla17:31
Jeffrey4leven, I think 1 is more easy to 2 :D17:31
SamYapleJeffrey4l: no i mean that is what happens17:31
SamYapleit actually happens that way17:31
sdakewhat is th eprent pid of qemu17:32
sdakeJeffrey4l17:32
sdakelets see if that matches sleep17:32
*** athomas has joined #kolla17:32
sdakeas launched from virsh17:32
Jeffrey4ljust stop the container then start it is meanless. We really need is upgrade, stop the container, start another new container.17:33
* Jeffrey4l starting my test env to check that.17:33
Jeffrey4lIIRC, the ppid of qemu is 1.17:33
sdakesamyaple are you proposing killilng docker -9 on the compute nodes?17:35
*** akwasnie has quit IRC17:35
sdakeduring upgrade process17:35
SamYaplesdake: hell no17:35
SamYapleim just observing17:35
sdakeok17:35
sdakegot it17:36
sdakewell this shit worked17:36
sdakei spent 2 weeks on it at endo f liberty17:36
SamYaplesdake: it still does17:36
sdakefixing like 12 different bugs17:36
SamYaplebut i cant figure out how17:36
SamYaplewhereas before it was easily reproduceable17:36
SamYapleit may be because of qemus ties into the kernel17:36
SamYaplei wonder if it breaks with pure software qemu...17:37
sdakeare you guys runnign on virt?17:37
SamYaplei am, but im running kvm-on-kvm17:37
sdakei never tested virt only baremetal17:37
Jeffrey4lqemu on kvm17:38
sdakewell there re some deltas17:38
sdakemy labis torn apart or i'd try baremetal17:38
sdakeshoud have the tile done next wed or thur in my office17:38
sdake(big office)17:38
Jeffrey4lsdake, the qemu ppid is 1, for sure.17:38
sdakedoing bedroom monday17:38
sdakeok well that is good, that means docker and libvirt haven't done any mucking around with the reparenting17:39
openstackgerritProskurin Kirill proposed openstack/kolla-mesos: Support deploy without configs  https://review.openstack.org/26647617:39
sdakewhich begs the question how the hell does the process get killed17:39
sdakeits parent process is init, init will not send it any signal17:39
Jeffrey4lSamYaple, even the child process dettached. But the pid is not change and the old parent process should still know it. When using graceful stop, the parent will stop the all the children process he know. When stop using `-9`, the parent process has no time to do this.17:41
Jeffrey4lmay be this is the case.17:41
SamYapleJeffrey4l: not when you disown17:41
SamYapleif the parent is pid 1, there is nothing to know17:42
SamYaplebut i think docker made some changes and is now tracking all pids that get launched in the container17:42
*** sdake_ has joined #kolla17:42
sdake_[10:39:38]  <sdake>which begs the question how the hell does the process get killed17:42
sdake_[10:39:55]  <sdake>its parent process is init, init will not send it any signal17:42
sdake_[10:40:51]  <sdake>a debug printk of signal in kernel.org would be extremely helpful now17:42
sdake_[10:41:30]  <sdake>Jeffrey4l add a link to this irc session in that bug at red hat so they can read through our discussion17:42
SamYaplesdake: see above17:43
SamYaple17:42:44 < SamYaple> but i think docker made some changes and is now tracking all pids that get launched in the contain17:43
sdake_i got disconnect sam17:43
Jeffrey4lsdake_, ok.17:43
sdake_SamYaple apparently Jeffrey4l  said this problem exists in 1.6.2 as well17:43
SamYapleif its tracking external to kernel, then the child/parent relationship doesnt matter17:43
SamYaplesdake_: 1.6.2 is when they "fixed" pid stuff ;)17:43
sdake_jeff try 1.6.017:44
Jeffrey4lyes. the paste.openstack.org test is using 1.6.217:44
sdake_1.5.0 pid host mode was busted17:44
*** kproskurin has quit IRC17:44
sdake_i dont know what version i tested docker with liberty but it could have been 1.6.017:44
*** sdake has quit IRC17:45
Jeffrey4li will try 1.6.0 soon.17:45
sdake_liberty docs said 1.7.017:46
sdake_but its possible iteseted with 1.6.017:47
*** salv-orl_ has quit IRC17:48
sdake_i guess we need a docker upgrade playbook for upgrades17:48
openstackgerritSam Yaple proposed openstack/kolla: Update ceph-mon keyrings  https://review.openstack.org/27368717:49
SamYaplesdake_: no the daemon is for the operator to upgrade17:50
SamYaplewe dont touch the host17:50
sdake_i think we can provide a reference implementation17:51
sdake_outside the current playbooks17:51
SamYapleWe can provide documentation out the wazoo for sure17:51
sdake_the problem with docs is i want to do an automated update at summit17:51
SamYapleand you can upgrade teh docker daemon with liberty containers.... you just cant run the playbooks after that17:51
SamYapleliberty playbooks that is17:51
sdake_named volumes makes that impossible17:51
SamYaplehas nothing to do with that17:52
sdake_you mispoke so i mospoke17:52
SamYaplei did not mispeak17:52
SamYapleyou can run dokcer 1.9+ with the liberty containers, you just cant run the liberty playbooks with docker 1.917:52
sdake_ya wfm but curious why17:53
SamYapleansible docker module17:53
sdake_i want a reference implemtnation taht upgrades docker on all nodes i the inventory17:54
*** neilus has joined #kolla17:54
sdake_it can live outside ansible if need be17:54
sdake_possibly contrib17:54
Jeffrey4lI havn't find the docker 1.6.2 binary. May be need build from source.  But I really need to go to bed.17:54
Jeffrey4lI wil test it tomorrow.17:55
sdake_Jeffrey4l thanks foryour hlep on this one17:55
sdake_Jeffrey4l shoot me an email stdake@cisco.com with results please in case i'm not around17:55
SamYaplesdake_: this is 180 from the original goal. there is a reason we ddont have a plybook to install docker on the hosts either17:55
*** ssurana has joined #kolla17:55
Jeffrey4lI will.17:55
SamYaplethat conversation has been had17:55
sdake_did you miss contrib directory17:55
Jeffrey4lBye guys.17:55
SamYaplenope. weve had _that_ conversation17:55
SamYapleby Jeffrey4l!17:55
SamYapleso maybe its time to have it again17:55
sdake_yes its a new conversation i just started  :)17:55
SamYapleits an old coversation we are going to rehash17:56
SamYapleits not new17:56
sdake_contrib is new to hte conversation17:56
SamYapleit is not...17:56
SamYapleunless you mean a new repo17:56
sdake_new directory under tld17:56
*** unicell has joined #kolla17:56
SamYapleits not using the inventory then17:57
sdake_what is the objection just so i understand your position17:57
SamYapleall the ansible stuff goes under ansible/ tld17:57
sdake_contribansible17:57
sdake_contrib/ansible17:57
SamYaplewont work17:57
SamYapleand anyway what you are purposing is going to tie the ansible stuff into the kolla repo and make it much harder to seperate kolla-ansible which is the stated goal of everyone here17:58
sdake_ok first objection noted17:58
sdake_others?17:58
*** neilus has quit IRC17:58
SamYaplethe original agreement from the community was no tasks to touch the host17:59
SamYaplethat was the first object ^17:59
sdake_i think its time to have that discussion again possibly at the mimdcycle17:59
*** dwalsh has quit IRC17:59
SamYapleI agree17:59
sdake_i am getting requests from various sources to touch the host in various ways17:59
sdake_perhaps it shouod lbe a separate repository given your first objection18:00
sdake_kolla shoudl contain docs and containers i think18:00
*** Jeffrey4l has quit IRC18:00
sdake_rather your second objection18:00
sdake_we need it to do one click upgrades18:01
SamYaplehost management was discussed in tokyo (with the talk of bifrost and what not)18:01
sdake_agree total host deployment possibly out of scope18:01
SamYapleits not a one click setup, its not a one click upgrade18:01
sdake_it can be made so18:02
SamYaplewe dont setup docker, we shouldnt manage it18:02
SamYapleif we setup the host (see bifrost) then sure18:02
SamYaplebut thats already goign to be a second playbook18:02
SamYaplein a seperate area18:02
sdake_i could live with two click upgrade18:02
SamYaplewell then yo uhave it18:02
*** mbound has quit IRC18:02
SamYaplethere are many ansible galaxy playbooks for managing packages18:03
SamYapleincluding specifc for docker18:03
SamYapleall code Kolla doesn't need to touch or maintain18:03
sdake_mind pointing me at one that looks sanitary so i can play aorund with it18:04
sdake_i am not a galaxy expert ;)18:04
sdake_SamYaple my wife says there is an ansible-galaxy tool18:05
sdake_do you know anything about it?18:06
sdake_shedoesn't recallt he details of how it works18:06
SamYaplenot at all. cloudnull does for sure18:06
sdake_ok well i'll add to agenda for midcycle, its part of the upgrade problem18:06
sdake_because we require docker 1.10 for mitaka18:06
sdake_and docker 1.7.0 for liberty18:06
sdake_and i dont really want to confuse operators with 'go login to all your nodes and upgrade docker"18:07
SamYaple1.8.2 for liberty18:07
SamYaplewe tell them "go login to all your nodes and install docker" right now...18:07
sdake_the docs say 1.7.0 - i guess they shoudl be updated18:07
SamYaplemaybe 1.7 is lowend, i dont recall18:07
sdake_ya that kind of sucks in my opinion18:08
sdake_we never finished the job on bifrost experimentation18:08
SamYaplewe never started18:09
sdake_i know inc0 has 2-3 people working on bare metal deploy - not ssure if related to bifrost or not18:09
SamYaplethere has been no code or reviews related to this18:09
SamYaplei dont know if there is even a blueprint18:09
sdake_there isn't its a problem i just considered while we were jerking around with this qemu problem18:09
SamYaplebut as an operator who has lots of operator friends I can tell you none of them care about what you are saying18:09
sdake_my brain works in mysterious ways ;)18:09
sdake_saying where18:10
SamYapleinstalling and managing the docker package on the host is perfectly fine18:11
SamYaplemost have there own system for packages and package control as it is18:11
SamYapleits a non-issue18:11
unicellSamYaple: https://review.openstack.org/#/c/272410/ you mentioned that there's a better way for the param variable?18:16
openstackgerritMauricio Lima proposed openstack/kolla: Add ansible support for Manila  https://review.openstack.org/26968818:21
cloudnullo/ all -- if i can help out with ansible + galaxy things let me know18:24
*** sdake_ has quit IRC18:26
*** dwalsh has joined #kolla18:29
*** dwalsh has quit IRC18:29
*** dwalsh has joined #kolla18:30
*** dwalsh has quit IRC18:34
SamYapleunicell: having the params wrapped in a variable like that isnt good. just follow the other tasks and have the params in the actual task18:36
unicellSamYaple: that means there's no way to customize the param if needed to?18:36
SamYaplethanks cloudnull sdake was asking about galaxy. im sure he would benefit from your galaxy knowlege18:37
SamYapleunicell: correct. because there is no need to customize the param name18:37
SamYapleuse a variable for the customizable part18:37
SamYaplei think you did that in PS1 or PS218:37
cloudnullping me whenever if i can help.18:37
*** rhallisey has quit IRC18:38
unicellok, I got what you mean18:39
limamauricioSamYaple, sdake I remove "/dev/:/dev/" and "/run/:/run/"18:43
openstackgerritQiu Yu proposed openstack/kolla: Detect and use physical disks for Swift storage  https://review.openstack.org/27241018:45
*** CheKoLyN has joined #kolla18:49
*** dwalsh has joined #kolla18:50
SamYaplelimamauricio: I saw that, ive done a full review of the config file now and mentioned some changed needed18:54
SamYaplelimamauricio: but its close!18:54
*** ppetit has quit IRC18:55
limamauricioThank you, your reviews are very helpful.18:56
*** tzn has quit IRC19:00
SamYapleunicell: ok im going to do a full fresh review of the swift patch, see what pops up. thank you for working with the review process!19:00
*** dwalsh has quit IRC19:03
*** neilus has joined #kolla19:04
unicellSamYaple: thanks you so much for the helpful comments!19:05
unicell*thank*19:06
SamYapleunicell: i always feel like I come off to opinionated, but im really trying to think for the future19:08
unicellI agree, even the patch works for me doesn't mean it works for everybody else' deployment19:11
openstackgerritMerged openstack/kolla-mesos: Make the start tests cleaner by wrapping the globals  https://review.openstack.org/26988219:12
*** neilus has quit IRC19:19
*** neilus has joined #kolla19:26
limamauricioSamYaple, can I only comment the default lines in manila.conf.j2?19:32
SamYaplelimamauricio: no it should be completely removed19:32
limamauriciook19:32
*** dwalsh has joined #kolla19:33
SamYaplelimamauricio: we have a streamlined approach to configs in Kolla, as stripped down as possible. we set only the variable that must be set to have a proper deployment19:33
limamauricioeven if someone wanted to use later?19:34
limamauricioI'll remove :)19:34
SamYaplelimamauricio: you can still use it19:35
SamYaplelimamauricio: you can use the augment files19:35
SamYapleyou can add any params or variables you want there19:35
limamauricioOk19:35
limamauriciomake sense19:35
openstackgerritMauricio Lima proposed openstack/kolla: Add ansible support for Manila  https://review.openstack.org/26968819:41
limamauricioSamYaple ^19:41
*** salv-orlando has joined #kolla19:42
openstackgerritMauricio Lima proposed openstack/kolla: Update cleanup-containers to remove manila containers  https://review.openstack.org/27355819:48
openstackgerritQiu Yu proposed openstack/kolla: Detect and use physical disks for Swift storage  https://review.openstack.org/27241019:49
*** salv-orlando has quit IRC19:50
*** neilus has quit IRC19:51
*** daneyon_ has quit IRC19:51
*** neilus has joined #kolla19:55
*** neilus has quit IRC19:56
*** neilus has joined #kolla19:57
openstackgerritQiu Yu proposed openstack/kolla: Detect and use physical disks for Swift storage  https://review.openstack.org/27241020:00
*** neilus has quit IRC20:12
*** salv-orlando has joined #kolla20:17
*** neilus has joined #kolla20:18
*** daneyon has joined #kolla20:21
*** Marga_ has quit IRC20:24
openstackgerritSam Yaple proposed openstack/kolla: Add labels to docker module  https://review.openstack.org/27330920:26
openstackgerritSam Yaple proposed openstack/kolla: Update all bootstraps to use Label  https://review.openstack.org/27331020:26
openstackgerritSam Yaple proposed openstack/kolla: Cleanup mariadb and make compatiable with mesos  https://review.openstack.org/27216020:26
*** salv-orlando has quit IRC20:30
*** dwalsh has quit IRC20:49
*** tzn has joined #kolla20:50
*** tzn has quit IRC20:50
*** tzn has joined #kolla20:50
*** dwalsh has joined #kolla20:56
*** dtturner has joined #kolla20:57
*** mbound has joined #kolla21:00
*** dmsimard_ has joined #kolla21:02
*** dmsimard_ has quit IRC21:02
*** tpot has joined #kolla21:07
dtturnerHi folks.  A question I'm sure has been asked countless times but.... are there any resources out there covering the setup/execution of multinode deployments in more detail?21:10
*** salv-orlando has joined #kolla21:11
SamYapledtturner: actually no it doesnt get asked alot or we would add more detailed docs!21:12
SamYapledtturner: what is it you feel is lacking?21:12
SamYaplethe difference between multinode and AIO is only in the inventory file21:12
dtturnerHa!  Well, I've been using Oracle's kollacli for multinode deployments of Kilo up to this point, which performs alot of the heavy lifting.  I'm now wanting to run some tests closer to trunk, so I need to cut the cli cord and run deploys manually for now.21:15
SamYapleive not used oracles fork of Kolla, however pbourke is an Oracle dev21:15
SamYapleif you are saying you want to run vanila kolla there is a kolla-ansible tool that makes that as simple as `kolla-ansible deploy`21:16
*** neilus has quit IRC21:17
dtturnerI'm with Oracle as well and have chatted with Borne.  I'm on a different team that plans to test closer to trunk, and so we are playing around with upstream vanilla kolla now.. working through the differences.21:19
dtturnerOK- thanks.  I'll give that a try.  I wasn't sure if kolla-ansible was for AIO testing only.21:21
*** jasonsb has quit IRC21:21
*** macsz1 has joined #kolla21:26
*** neilus has joined #kolla21:27
openstackgerritEric Lemoine proposed openstack/kolla:  [POC] Heka proof-of-concept tests  https://review.openstack.org/26974521:30
*** neilus has quit IRC21:31
*** athomas has quit IRC21:33
*** neilus has joined #kolla21:34
*** akwasnie has joined #kolla21:35
*** neilus has quit IRC21:38
*** shardy has quit IRC21:38
*** CheKoLyN has quit IRC21:43
*** sdake has joined #kolla21:45
*** sdake has quit IRC21:45
*** sdake has joined #kolla21:48
*** neilus has joined #kolla21:49
*** sdake_ has joined #kolla21:50
*** sdake has quit IRC21:52
*** macsz1 has quit IRC21:52
*** neilus has quit IRC21:55
*** neilus has joined #kolla21:56
*** CheKoLyN has joined #kolla21:56
sdake_SamYaple ping soryr i dropped off earlier contrctor showed up and i've been working like a maniac getting him prepped22:00
*** akwasnie has quit IRC22:00
*** neilus has quit IRC22:00
*** athomas has joined #kolla22:00
*** akwasnie has joined #kolla22:01
*** athomas has quit IRC22:01
*** athomas has joined #kolla22:01
*** neilus has joined #kolla22:02
*** inc0 has quit IRC22:02
*** iNeilus has joined #kolla22:03
*** Marga_ has joined #kolla22:05
*** neilus has quit IRC22:06
*** salv-orl_ has joined #kolla22:06
*** akwasnie has quit IRC22:07
*** iNeilus has quit IRC22:08
openstackgerritEric Lemoine proposed openstack/kolla:  [POC] Heka proof-of-concept tests  https://review.openstack.org/26974522:08
*** salv-orlando has quit IRC22:08
*** neilus has joined #kolla22:10
SamYaplesdake_: i dont know what you are saying22:10
*** iNeilus has joined #kolla22:12
*** neilus has quit IRC22:14
*** iNeilus has quit IRC22:16
*** gfidente has quit IRC22:17
*** akwasnie has joined #kolla22:26
*** jtriley has quit IRC22:28
*** RA_ has joined #kolla22:32
*** athomas has quit IRC22:33
*** akwasnie has quit IRC22:42
*** frzn_ has joined #kolla22:44
*** CheKoLyN has quit IRC22:45
*** frzn_ has quit IRC22:45
*** frzn_ has joined #kolla22:46
*** tzn has quit IRC22:49
*** CheKoLyN has joined #kolla23:01
*** RA__ has joined #kolla23:06
*** RA_ has quit IRC23:06
*** CheKoLyN has quit IRC23:11
*** tzn has joined #kolla23:13
*** RA__ has quit IRC23:13
sdake_samyaple we were talking earlier and i closed my laptop because the contractors were here to do my flooring23:14
sdake_and i had to get them prepped for about 3-4 hours23:14
sdake_my office wont be ready for atleast 8 more days23:15
* sdake_ growls23:15
*** mbound has quit IRC23:15
sdake_then two days to slep all my shit back into it23:15
*** blahRus has quit IRC23:19
*** RA_ has joined #kolla23:20
*** dwalsh has quit IRC23:28
*** frzn_ has quit IRC23:45
*** tzn has quit IRC23:47
*** daneyon has quit IRC23:48
sdake_wow 13 minute push for all containers23:51
sdake_docker v2 is pretty fast23:51
sdake_registry that is23:51

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!