Tuesday, 2016-06-21

*** zhiwei has joined #openstack-kolla00:04
kfox1111wirehead_: those few patches you pointed me at got horizon to a point of being accessable via a browser. :)00:05
wirehead_awesome00:06
kfox1111Thanks. :)00:06
wirehead_Not a prob.  Glad to see that I’m not making something work that nobody wants. :)00:06
kfox1111heh. far from it. :)00:07
kfox1111I think this may go a long way to making openstack much more tractable.00:07
kfox1111I've managed many openstack clouds over the years, and have dozens of upgrades under my belt, and its always been painful. :/00:08
kfox1111This is looking much much less so. :)00:08
kfox1111thanks for working on it. :)00:08
*** zhiwei has quit IRC00:09
kfox1111wirehead_: one other thing I was thinking about... for rolling upgrades across major horizon version, since it dynamically loads content,00:13
kfox1111we may need a way to segment old from new horizons.00:14
wirehead_Hm.00:14
kfox1111maybe a haproxy cookie or something, and maybe seperate token databases for version N and Version n+1.00:14
kfox1111with the seperate token db, they would get a logout when they finally switch.00:15
kfox1111you could maybe use haproxy to tag new connections with a cookie, and then force them to the horizon pool of that version,00:16
kfox1111update it to point to the new one for 24 hours or something, until everyone's off the old pool,00:16
kfox1111then just remove the old rc/deployment.00:17
wirehead_So, you just want to keep the old Horizon around, not whole parallel stacks, right?00:17
kfox1111right.00:17
kfox1111since the horizon kind of sticks around in part in the users browser.00:17
wirehead_Yeah.00:17
kfox1111if you did a rolling upgrade from n -> n+1, users might get multiple versions loaded into the browser at the same time, breaking things.00:18
kfox1111so have a way to when going to n+1, keep n around long enough for logins to expire so they can be drained out.00:18
kfox1111kind of like what we were talking about with the api services, but I think only horizon would have the issue.00:19
wirehead_I think you’d have to do some hacking to create a second service and a proxy.00:19
wirehead_You can create the service with session affinity off of the client’s IP, but that doesn’t really keep track of that part.00:19
wirehead_Oh, and trivia point.  If you want to create a Kube service that maps to a non-kube set of servers, here’s how: http://kubernetes.io/docs/user-guide/services/#services-without-selectors00:20
kfox1111I think something like this would work: https://docs.oracle.com/cd/E37670_01/E41138/html/section_jyh_zhz_4r.html00:20
kfox1111but use the new and old service ip's as the backends?00:20
wirehead_Yeah.00:20
kfox1111interesting.00:21
wirehead_So, the Kube people are working on adding session persistance, probably mirroring what haproxy can do because one of the options for Ingress is using haproxy, in 1.3 and beyond.00:23
kfox1111yeah. but from the look of it, its a ways out yet.00:23
wirehead_yeah00:23
wirehead_Then again 1.3 is almost out.00:23
kfox1111plus on the roadmap for it, I didn't see this sort of persistance, I think.00:23
kfox1111yeah. I'm running something very close to it now. :)00:23
kfox1111has some awesome stuff in it. :)00:24
kfox1111subpath mounts have been invaluable. :)00:24
*** salv-orlando has joined #openstack-kolla00:25
kfox1111I'm still trying to figure out exactly how scaling is going to work without some kind of external load balancer.00:27
wirehead_Well, I’m behind on my blueprint there.00:28
kfox1111for now, I'm just using a single instance of a haproxy labeled to a particular node, and port.hostPort something specific.00:28
kfox1111it then exposes it on the right ip/port. not fully ha, but works ok for now.00:28
wirehead_So, we’ve got ingress resources.00:29
kfox1111yeah, but it seems to fire up an haproxy on one of the nodes at random as far as I can tell.00:29
kfox1111so you gota go update dns if it moves.00:29
kfox1111and for us, that's a painful experience. :/00:29
kfox1111different teams.... one of which has IT in its name.00:30
wirehead_Ew.00:30
kfox1111so being able to stick with an ip as long as possible has huge benifits. :/00:30
wirehead_Yeah.00:30
kfox1111shortish term, I'm thinking, keepalived to have the ip on one of a pair of nodes for ha, and then have the keepalive script relable the nodes with a haproxy lablel, and delete the existing one, or something like that.00:31
kfox1111a little sketchy, but I think it would work.00:31
*** salv-orlando has quit IRC00:32
kfox1111if they get requiredDuringSchedulingRequiredDuringExecution implemented, the last step wouldn't be needed I think.00:32
wirehead_Or just set up a haproxy with a known config on a set of servers running kube-proxy.00:33
kfox1111yeah. that would work too.00:33
kfox1111just trying to containerize all I can at this point. :)00:33
wirehead_Yeah.00:33
kfox1111the other option might be pacemaker. they have a docker run plugin now. works pretty well. so you can have the ip and a haproxy container move together.00:34
kfox1111but I'd prefer to use k8s entirely if I can. multiple systems is a pain too. :/00:34
wirehead_Yeah, or one of the other foofy SDN products for K8s.00:34
kfox1111yeah. I'd like to use kuryr too, but its k8s support is nonexistant right now.00:35
wirehead_Yeah.  Hm.  So that is a good thing to keep in mind - whatever we do about external LB’s, we need to be careful about IT-operated DNS. :)00:36
kfox1111well, gota head out. thanks for the help, and the chat. :)00:36
sdake_hey kfox111100:36
kfox1111yeah. for sure. :/00:36
kfox1111sdake_: hey. :)00:37
wirehead_Not a problem.  Thanks for some victories to point to. :)00:37
*** daneyon has joined #openstack-kolla00:38
sdake_118F today00:41
sdake_119F yesterday00:41
sdake_my ac sensor says 114f00:42
*** sdake_ has quit IRC00:44
*** dwalsh has joined #openstack-kolla00:46
*** huikang has joined #openstack-kolla00:52
*** huikang has quit IRC00:52
Mech422wirehead_: I think 'be careful about IT-operated' basically sums up Kolla/K8S00:56
*** daneyon_ has joined #openstack-kolla00:56
Mech422wirehead_: we can't really assume we 'own' anything..dhcp, vlans, bridges, disks, whateer00:56
Mech422err..whatever00:57
*** daneyon has quit IRC00:57
Mech422wirehead_: as existing infrastructures may have dibs on it00:57
*** huikang has joined #openstack-kolla00:59
*** daneyon has joined #openstack-kolla01:00
*** phuongnh has joined #openstack-kolla01:00
*** daneyon__ has joined #openstack-kolla01:01
*** daneyon_ has quit IRC01:01
*** daneyon has quit IRC01:05
*** jeh has quit IRC01:06
*** jeh has joined #openstack-kolla01:09
*** jeh has joined #openstack-kolla01:09
*** jtriley has quit IRC01:10
*** jtriley has joined #openstack-kolla01:14
*** zhiwei has joined #openstack-kolla01:25
*** daneyon has joined #openstack-kolla01:25
*** dwalsh has quit IRC01:26
*** daneyon_ has joined #openstack-kolla01:26
*** daneyon__ has quit IRC01:27
*** jtriley has quit IRC01:29
*** daneyon has quit IRC01:30
*** jtriley has joined #openstack-kolla01:31
*** asalkeld has joined #openstack-kolla01:34
*** salv-orlando has joined #openstack-kolla01:37
*** dwalsh has joined #openstack-kolla01:41
*** salv-orlando has quit IRC01:44
*** jtriley has quit IRC01:48
*** dwalsh has quit IRC01:49
*** daneyon_ has quit IRC01:53
*** asalkeld has quit IRC01:58
*** sacharya has joined #openstack-kolla01:59
*** sacharya has quit IRC01:59
*** sacharya has joined #openstack-kolla02:00
*** daneyon has joined #openstack-kolla02:06
*** fragatina has quit IRC02:14
*** daneyon_ has joined #openstack-kolla02:15
*** fragatina has joined #openstack-kolla02:15
*** daneyon has quit IRC02:18
*** jianqing has joined #openstack-kolla02:19
*** daneyon_ has quit IRC02:23
*** daneyon has joined #openstack-kolla02:23
*** daneyon_ has joined #openstack-kolla02:24
*** rhallisey has quit IRC02:25
*** daneyon has quit IRC02:28
*** caowei has joined #openstack-kolla02:29
*** daneyon_ has quit IRC02:33
*** jtriley has joined #openstack-kolla02:46
*** klint has joined #openstack-kolla02:47
*** yuanying has quit IRC02:51
*** yuanying has joined #openstack-kolla02:54
*** caowei has quit IRC03:04
*** caowei has joined #openstack-kolla03:04
*** ssurana has quit IRC03:05
*** jianqing has quit IRC03:07
*** jtriley has quit IRC03:08
*** salv-orlando has joined #openstack-kolla03:08
openstackgerritSwapnil Kulkarni (coolsvap) proposed openstack/kolla: Add customizations for apt keys and packages  https://review.openstack.org/32668803:14
*** salv-orlando has quit IRC03:14
*** dave-mccowan has quit IRC03:32
*** dave-mccowan has joined #openstack-kolla03:32
*** dave-mccowan has quit IRC03:36
*** daneyon has joined #openstack-kolla03:38
*** tfukushima has joined #openstack-kolla03:39
*** daneyon has quit IRC03:43
*** huikang has quit IRC03:44
*** caowei has quit IRC03:54
*** yuanying has quit IRC04:02
*** huikang has joined #openstack-kolla04:02
*** yuanying has joined #openstack-kolla04:03
*** salv-orlando has joined #openstack-kolla04:22
openstackgerritMerged openstack/kolla: Add customizations for apt keys and packages  https://review.openstack.org/32668804:22
*** salv-orlando has quit IRC04:29
*** coolsvap has joined #openstack-kolla04:32
*** Jeffrey4l_ has quit IRC04:33
*** fragatina has quit IRC04:47
*** fragatina has joined #openstack-kolla04:48
*** fragatina has quit IRC04:50
*** fragatina has joined #openstack-kolla04:51
*** Jeffrey4l_ has joined #openstack-kolla04:55
openstackgerritSwapnil Kulkarni (coolsvap) proposed openstack/kolla: Use MAC address for looking for DHCP leases for Vagrant  https://review.openstack.org/30628404:58
*** daneyon has joined #openstack-kolla05:01
*** daneyon_ has joined #openstack-kolla05:02
*** jtriley has joined #openstack-kolla05:05
*** daneyon has quit IRC05:06
*** JianqingJiang has joined #openstack-kolla05:11
*** jtriley has quit IRC05:11
*** tfukushima has quit IRC05:14
*** salv-orlando has joined #openstack-kolla05:15
*** daneyon has joined #openstack-kolla05:27
*** daneyon has quit IRC05:31
*** caowei has joined #openstack-kolla05:32
coolsvapnihilifer, around?05:32
nihilifercoolsvap: yes05:32
*** huikang has quit IRC05:33
coolsvapnihilifer, got a min just wanted to understand some confusion related to comment in a patch 32180205:33
patchbotcoolsvap: https://review.openstack.org/#/c/321802/ - kolla - Add a cloud-init RHEL(ish) bootstrap + run kolla s...05:33
coolsvaphttps://review.openstack.org/#/c/321802/4/tools/bootstrap_kolla.sh05:33
patchbotcoolsvap: patch 321802 - kolla - Add a cloud-init RHEL(ish) bootstrap + run kolla s...05:33
coolsvapwhy not curl for installing docker-engine05:34
nihiliferreally? doing "curl something | bash" on production?05:34
nihiliferyou really want me to explain such an obvious think?05:35
nihiliferthing*05:35
nihiliferimagine that server become unavailable05:35
nihiliferand you get some 404 in pipe for bash05:35
nihiliferif the concrete step like adding repo or installing package breaks in your script, then it's much easier to debug05:36
nihiliferand unavailability of some server is much lesser pain05:36
coolsvapnihilifer, got you but i dont wanted to remove the hard-coded addition of repo file05:37
coolsvapas well05:38
coolsvapi think i typed it wrong05:38
coolsvapi want to remove the  hard-coded addition of repo file as well05:38
*** salv-orl_ has joined #openstack-kolla05:39
nihiliferwell, if we can fetch this repo file from somewhere, then i'll be fine with removing that05:39
coolsvapalright let me check that05:39
nihiliferbut if this file isn't available for download anywhere (if i recall correctly, it isn't), then hmm... doing that in script is a lesser evil imo05:40
nihiliferof course we can just create this repo file05:40
nihiliferand copy it in script05:40
nihiliferto get rid of "cat [...] EOF"05:40
*** salv-orlando has quit IRC05:41
nihiliferbrb, will review this patch again today05:42
coolsvapnihilifer, sure thanks05:42
*** huikang has joined #openstack-kolla05:46
openstackgerritMerged openstack/kolla: Add named volume for nova-libvirt  https://review.openstack.org/30547105:50
*** huikang has quit IRC05:50
*** tfukushima has joined #openstack-kolla05:51
*** huikang has joined #openstack-kolla05:56
openstackgerritMerged openstack/kolla: Makes ml2_conf.ini configuration consistent  https://review.openstack.org/32976005:58
openstackgerritMerged openstack/kolla: Use MAC address for looking for DHCP leases for Vagrant  https://review.openstack.org/30628405:58
*** ssurana has joined #openstack-kolla06:06
*** huikang has quit IRC06:11
*** ssurana has quit IRC06:14
*** ssurana has joined #openstack-kolla06:16
*** Jianqing_ has joined #openstack-kolla06:29
*** JianqingJiang has quit IRC06:29
*** JianqingJiang has joined #openstack-kolla06:31
*** Jianqing_ has quit IRC06:31
*** Jianqing_ has joined #openstack-kolla06:35
*** JianqingJiang has quit IRC06:35
*** JianqingJiang has joined #openstack-kolla06:41
*** Jianqing_ has quit IRC06:41
*** jmccarthy has joined #openstack-kolla06:42
*** Jianqing_ has joined #openstack-kolla06:52
*** JianqingJiang has quit IRC06:52
*** ssurana has quit IRC06:54
*** JianqingJiang has joined #openstack-kolla06:55
*** Jianqing_ has quit IRC06:55
*** mewald has joined #openstack-kolla06:56
*** Jianqing_ has joined #openstack-kolla07:00
*** JianqingJiang has quit IRC07:00
*** belmoreira has joined #openstack-kolla07:04
*** Jianqing_ has quit IRC07:05
*** JianqingJiang has joined #openstack-kolla07:06
*** jtriley has joined #openstack-kolla07:07
*** matrohon has joined #openstack-kolla07:09
*** Serlex has joined #openstack-kolla07:10
*** daneyon_ has quit IRC07:10
*** jtriley has quit IRC07:12
*** sacharya has quit IRC07:13
*** gfidente|afk has quit IRC07:15
*** daneyon has joined #openstack-kolla07:15
*** daneyon has quit IRC07:20
*** Jianqing_ has joined #openstack-kolla07:25
*** JianqingJiang has quit IRC07:25
*** athomas has joined #openstack-kolla07:35
*** JianqingJiang has joined #openstack-kolla07:37
*** Jianqing_ has quit IRC07:37
*** Jianqing_ has joined #openstack-kolla07:41
*** JianqingJiang has quit IRC07:41
*** JianqingJiang has joined #openstack-kolla07:41
*** Jianqing_ has quit IRC07:41
*** Jianqing_ has joined #openstack-kolla07:47
*** JianqingJiang has quit IRC07:47
*** JianqingJiang has joined #openstack-kolla07:50
*** Jianqing_ has quit IRC07:51
*** mewald has quit IRC07:51
apuimedokfox1111: we have a prototype07:52
apuimedohttps://github.com/midonet/kuryr/tree/k8s07:52
*** salv-orl_ has quit IRC07:53
*** mewald has joined #openstack-kolla07:57
*** shardy has joined #openstack-kolla08:05
*** matrohon has quit IRC08:12
*** Jianqing_ has joined #openstack-kolla08:13
*** JianqingJiang has quit IRC08:13
*** sacharya has joined #openstack-kolla08:14
*** dmk0202 has joined #openstack-kolla08:18
*** mgoddard has joined #openstack-kolla08:19
*** sacharya has quit IRC08:19
*** salv-orlando has joined #openstack-kolla08:19
*** shardy has quit IRC08:32
*** JianqingJiang has joined #openstack-kolla08:35
*** Jianqing_ has quit IRC08:35
*** dmk0202 has quit IRC08:42
*** williamcaban has joined #openstack-kolla08:49
*** daneyon has joined #openstack-kolla09:03
*** jtriley has joined #openstack-kolla09:08
*** daneyon has quit IRC09:08
*** tfukushima has quit IRC09:08
*** jtriley has quit IRC09:12
*** matrohon has joined #openstack-kolla09:15
*** coolsvap has quit IRC09:15
*** coolsvap has joined #openstack-kolla09:17
*** openstackgerrit has quit IRC09:18
*** openstackgerrit has joined #openstack-kolla09:18
*** dwalsh has joined #openstack-kolla09:21
*** dwalsh has quit IRC09:30
*** caowei has quit IRC09:33
openstackgerritMerged openstack/kolla-kubernetes: Fix Docker version in quickstart  https://review.openstack.org/33133709:35
*** sacharya has joined #openstack-kolla09:37
*** tfukushima has joined #openstack-kolla09:40
*** pbourke_ has quit IRC09:41
*** sacharya has quit IRC09:41
*** pbourke_ has joined #openstack-kolla09:42
*** gfidente has joined #openstack-kolla09:51
*** gfidente has joined #openstack-kolla09:51
*** JianqingJiang has quit IRC10:03
*** JeroenBo has joined #openstack-kolla10:10
JeroenBoGoodday,  anyone available to discuss some multinode glance challenges ?10:19
*** jmccarthy has left #openstack-kolla10:19
*** athomas has quit IRC10:20
*** athomas has joined #openstack-kolla10:21
*** zhiwei has quit IRC10:25
mewaldJeroenBo: I am quite new to Kolla but would be interested to hear what it's about :D I will wait here for the pros to appear ;)10:28
*** phuongnh has quit IRC10:30
JeroenBoWhen you deploy glance on more than one container (with local storage),  they share the same database.. But the image is only stored on one of the api hosts and the metadata is available on all glance api's10:33
JeroenBoif the request is made to the api where only the metadata is available, it will (as expected) result in an error10:34
*** daneyon has joined #openstack-kolla10:52
*** daneyon has quit IRC10:56
mewaldJeroenBo: But that's the case with and without Kolla. Local storage is meant for single instance deployments only. For multiple instances you will always need shared storage, for example NFS oder a Ceph cluster11:01
JeroenBomewald: that’s why I call it a challenge ;-)  We don’t want to use ceph anymore due to major outages we experienced in the past.11:06
*** jtriley has joined #openstack-kolla11:08
*** jtriley has quit IRC11:14
*** tfukushima has quit IRC11:14
*** ppowell has joined #openstack-kolla11:16
*** dwalsh has joined #openstack-kolla11:20
*** Mr_Broken has joined #openstack-kolla11:28
*** mliima has joined #openstack-kolla11:30
*** salv-orl_ has joined #openstack-kolla11:39
*** salv-orlando has quit IRC11:41
*** dwalsh has quit IRC11:44
*** caowei has joined #openstack-kolla11:46
*** salv-orl_ has quit IRC11:54
*** shardy has joined #openstack-kolla12:04
*** dwalsh has joined #openstack-kolla12:07
*** dave-mccowan has joined #openstack-kolla12:11
*** jtriley has joined #openstack-kolla12:14
*** jtriley has quit IRC12:19
*** salv-orlando has joined #openstack-kolla12:20
Mr_BrokenHey Guys12:21
Mr_Brokencan anyone explain how should Glance work with multinode setup and haproxy enabled ?12:21
Mr_Brokeni mean, if you have set files storage12:22
Mr_Brokenand try to image-create, it will RANDOMLY pick one of 3 glances and put it on /var/lib/glance/images (default)12:22
Mr_Brokenthen when you try to deploy - 2/3 deployments fail since they look for image on different glance hosts12:23
Mr_Brokenis that intentional ?12:23
*** b_bezak has joined #openstack-kolla12:23
*** dwalsh has quit IRC12:24
*** caowei has quit IRC12:30
JeroenBoMr_Broken:  I have the same issue at the moment12:38
Mr_Broken@JeroenBo: I've managed to workaround that a bit, by configuring swift backend for Glance (external)12:40
*** daneyon has joined #openstack-kolla12:40
Mr_Brokenbut then I need glance-cache configured and working ... and the same problem ;]12:40
JeroenBoi haven’t got a swift deployment12:40
JeroenBobut it’s by design i think12:40
Mr_Brokenwell me neither on the local openstack12:41
*** sbezverk has quit IRC12:41
Mr_Brokenbut i just connected to some swift backend in the internet12:41
Mr_Brokenthats why the need for glance-cache .;]12:41
Mr_Brokenand circle closes12:41
JeroenBomaybe it’s possible to rsync /var/lib/docker/volumes/glance/_data/images => other docker host (just for testing purposes)12:42
Mr_Brokenits stored inside glance_api docker :/12:43
JeroenBoi know, but thats the path from the docker host12:44
JeroenBo(do not do this in production ;-) )12:44
Mr_Brokentrue12:44
Mr_Brokenyeah ;]12:44
*** daneyon has quit IRC12:45
mewaldJeroenBo: I still don't see how this is a Kolla issue. If you need disk to disk replication, I suggest you take a look at DRBD12:47
JeroenBoit’s not a kolla issue, but it’s possible that you run into this issue when configuring glance on multiple nodes with local storage12:49
Mr_Brokenwell, what kolla could do is change HAproxy configs, to make glance active/passive (like mariadb)12:52
Mr_Brokenbecause glance in active/active on 3 nodes - dont work as intented12:52
Mr_Brokenor I dont know how to make it to work consistently :/12:52
*** rhallisey has joined #openstack-kolla12:52
JeroenBoMr_Broken:  it think the best option, is to give every glance_api host it’s own database (Nova will poll every glance_api for its images)12:53
JeroenBoDownside .. it’s not HA12:54
rhalliseywith Kubernetes it would be12:57
*** klint has quit IRC12:59
Mr_BrokenIs Kolla/Kubernetes ready to deploy ? :P12:59
rhalliseyMr_Broken, nope13:00
rhallisey:)13:00
Mr_Broken:>13:00
Mr_Brokenyeah... cant wait for that one to get my hands dirty .13:00
rhalliseythere also isn't a db per service yet13:00
rhalliseybut it would be possible13:01
Mr_Brokenyeah, so how do we glance in multinode and haproxy till those days ? :]13:01
Mr_Brokenor even if we decide to move to outside glance - how do we manage cache then ? ;]13:03
JeroenBoMr_Broken: Rsync doesn’t work ;-)13:03
*** caowei has joined #openstack-kolla13:03
Mr_BrokenJeroenBo: I imagine ImageID with a pointer to glance server, is stored in DB ?13:04
Mr_Broken(not sure here)13:04
rhalliseyMr_Broken, good questions13:04
JeroenBoEverything is stored in the database13:04
Mr_Brokenimage itself isnt right ? ;]13:05
JeroenBoThe problem is, the glance api has the metadata but not the data in /var/lib/glance13:05
*** salv-orlando has quit IRC13:07
*** zhiwei has joined #openstack-kolla13:10
*** dwalsh has joined #openstack-kolla13:21
*** Mr_Broken has quit IRC13:23
*** sbezverk has joined #openstack-kolla13:23
*** Mr_Broken has joined #openstack-kolla13:24
*** inc0 has joined #openstack-kolla13:24
*** Mr_Broken has quit IRC13:28
*** Mr_Broken has joined #openstack-kolla13:31
*** jtriley has joined #openstack-kolla13:31
*** Mr_Broken has quit IRC13:33
*** Mr_Broken has joined #openstack-kolla13:34
*** sdake has joined #openstack-kolla13:36
*** Mr_Broken has quit IRC13:38
sdakemorning folks13:39
sdakejust a heads up I was out of the office yesterday for a semi-emergency13:39
sdakeso if people were trying to find me or need something, please let me know13:39
*** huikang has joined #openstack-kolla13:40
coolsvapsdake, hi good morning13:41
sdakehey coolsvap13:42
coolsvapsdake, we need to push the oraclelinux images for mitaka to dockerhub the gates are failing due to their unavailability13:42
coolsvapmitaka oraclelinux gates13:42
sdakecoolsvap the gate should not be using the dockerhub13:42
sdakebut that said, i agree we should push images for all distros13:43
coolsvapyeah but its giving the same error13:43
sdakewe now have access to "kolla" namespace13:43
sdakeso I'd like to switch us over to using that13:43
coolsvapsdake, yeah i saw the mail13:43
sdakenobody asked to be added13:43
coolsvapi asked13:44
sdakeunless I somehow mised the emaill13:44
coolsvap:)13:44
sdakeone of my filters is busted and some of my mail gos to who knows where13:44
sdakeok i'll add you moment13:44
coolsvapi actually push images to my own repo very frequently13:44
coolsvapi can push to kolla as well13:44
sdakecoolsvap pbourke_ inc0 rhallisey please provide email so I can add yo uto docker hub registry for "kolla" namespace13:45
sdakeand any other cores that happen to be awake that I missed13:45
sdakecoolsvap beffore pushing the images, can you sort out why the gate thinks it needs the registry13:46
sdakeit should be pulling from the docker cache13:46
*** huikang has quit IRC13:46
coolsvapsdake, yes i will do13:46
sdakeemail is so I dont hae to go hunt for it coolsvap? :)13:46
sdakemandre you may be awake too13:47
sdakeif i didn't list a core reviewer above, its because I think you are aslep - if you see this record pelase ping me and i'll be happy to addd you13:47
*** openstackgerrit has quit IRC13:48
*** openstackgerrit has joined #openstack-kolla13:48
coolsvapsdake, didnt get the above question13:48
sdakecoolsvap give me your email :)13:49
*** wmiller has quit IRC13:49
coolsvapoh sorry13:49
sdakethanks pbourke_ coolsvap13:50
sdakeif you dont want to write in channel private message will do13:50
sdakeremember, new namespace is "kolla"13:50
sdakeso we need to transition the code to use that instead of kollaglue13:50
sdakeI can do that, or someone else can13:50
sdakeany takers13:50
coolsvapi have a patch up for review13:50
sdakei've got a pretty full plate atm :(13:50
coolsvapits marked in progress13:51
sdakethanks rhallisey13:51
coolsvaphttps://review.openstack.org/#/c/329289/13:51
patchbotcoolsvap: patch 329289 - kolla - Update kollaglue repo on docker to kolla13:51
sdakecoolsvap cool eviewing moment13:51
sdakethanks for the bug id :)13:51
*** wmiller has joined #openstack-kolla14:02
sdakecoolsvap patch looks good not sure why its in wip14:02
sdakeyou want ot test I assume?14:02
sdakeot/to14:03
sdakecoolsvap any results on investigation o using the docker build service14:03
coolsvapsdake, in a meeting will check right after it14:03
sdakeroger14:03
coolsvapi removed workflow14:03
coolsvapsdake, its working we can see it from the gate logs14:04
coolsvapits using kolla instead of kollaglue14:05
sdakedeploy isn't working14:05
coolsvapgate failure is not related to the fix14:06
coolsvaphttp://logs.openstack.org/89/329289/1/check/gate-kolla-dsvm-deploy-centos-binary/d316c87/console.html.gz#_2016-06-14_07_32_08_32514:06
*** salv-orlando has joined #openstack-kolla14:08
coolsvapthis is a recurring issue that we are getting in gates recently in around 50% of gate runs14:08
coolsvapsdake, ^14:08
sdakeannoying14:08
* sdake beats the gate14:08
*** thumpba has joined #openstack-kolla14:09
sdakecoolsvap needle meet haystack14:11
*** salv-orlando has quit IRC14:14
*** williamcaban has quit IRC14:19
sdakerhallisey did you fix wirehead_ s last comment on the k8s spec14:20
rhalliseyya14:20
sdakecool so ready for merge?14:20
rhalliseyya14:20
sdakecool i'll ask the core review team to review it and ack it then14:20
sdakethanks!14:20
rhalliseyit's a solid outline of the plan14:20
sdakelink?14:21
rhalliseywill likely change, but it describes the problem well14:21
rhalliseyhttps://review.openstack.org/#/c/304182/14:21
patchbotrhallisey: patch 304182 - kolla - Spec: Deploy Kolla images using Kubernetes14:21
sdakespecs are a point in time plan for us14:21
sdakethanks rhallisey14:21
rhalliseyno problem14:21
mewaldIs there any way to deploy per domain backends with kolla?14:25
sdakepbourke_ mandre inc0 coolsvap please have a look at rhallisey and +2 if there are no glaring errors14:26
sdakeif there are typos or pronouns or stuff like that, recommend just ignoring14:26
*** JeroenBo has left #openstack-kolla14:28
sdakedomain backend?14:28
sdakewould you mind expanding mewald14:28
sdakemy inital answer would be no, becaue I'm not sure what your tlaking about14:29
sdakeif your talking about multi-domain (as in multi-keystone) no that isnt implemented, but is planned14:29
sdakethe idea there is we will have one master keystone but permit multiple regions to be edeployed14:29
mewaldsdake: what you are describing is not "multi-domain". I want to have multiple domains in keystone and each with a different identity backend configuration. This way I can connect to different LDAPs for each keystone domain.14:33
mewaldIt would require to copy several files to /etc/keystone/domains so it's pretty simple to implement14:33
sdakemewald right - ya we don't have that atm14:34
sdakemewald but we are also working on that14:34
sdakevia customizations14:34
sdakemewald some work has hit the rpeo related to customizations already but we have 130 containers so its going to take awhile14:34
sdake4-6 weeks14:34
mewaldsdake: who is working on that? I would like to team up with him/her and help14:34
sdakemewald i plan to involve the whole community14:34
sdakemewald but for the moment its mostly been inc0 prototying14:34
mewaldok14:35
sdakemewald that said, if you could describe exactly how to implement it, it might help guidecustommiations14:36
mewaldActually, all I would need would be in addition to the ini merge function to copy say the contents of /etc/kolla/keystone/domains/* into the container. Thats all. I don't think we need kolla to actually create the domains via API. What's a bit uncomfortable: Whenever a new domains is created, new images would have to be deployed. Dunno if there's a way around that14:39
sdakemoment processing14:39
sdake5 mins to think about that14:40
*** huikang has joined #openstack-kolla14:42
mewaldsdake: In case your to familiar with this part of keystone: http://docs.openstack.org/developer/keystone/configuration.html Take a look at the "Domain-specific Drivers" section14:42
*** Mr_Broken has joined #openstack-kolla14:42
mewald*not14:42
sdakei am not14:42
sdakereading14:42
sdakeso my initial reactoin to redeploy on a config change is "ugh"14:43
mewaldexactly :D14:43
sdakeit almost seems lilke the keystone case requires ssome special magic14:43
sdakeinc0 thoughts on above^^14:43
sdakemewald the problem with getting merge inis to do the copying is ansible specifies which files to copy14:44
*** williamcaban has joined #openstack-kolla14:44
* inc0 reading log14:44
sdakewe could easily just tell it to copy the doains directory14:44
*** zhiwei has quit IRC14:44
sdakeif that is all that is needed are cnofig files14:44
inc0so multi domain'14:45
inc0mewald, we have it14:45
sdakemewald see, shows what I know :)14:45
inc0you can specify per-node config14:45
inc0using merge config and config overrides14:45
sdakeinc0 mewald needs to copy the contents of a subdirectory though14:46
sdakeinc0 the merge code doesn't do that at present14:46
mewaldinc0: from what I understand that only works as long as everything does into the keystone.conf14:46
sdakealll filenames are hardcoded in ansible14:46
inc0https://github.com/openstack/kolla/blob/master/doc/advanced-configuration.rst#openstack-service-configuration-in-kolla14:46
*** huikang has quit IRC14:46
*** daneyon has joined #openstack-kolla14:49
Mr_Brokeninc0: yeah thats a fine functionality, but how do you comment things out from existing configs ? or remove a line ? :]14:49
inc0mewald, yeah we dont add files14:49
mewaldinc0: so you're saying I could create a file "/etc/kolla/config/keystone/domains/keystone.mydomain.conf" and it would copy that to "/etc/keystone/domains/keystone.mydomain.conf" on every keystone node?14:50
inc0Mr_Broken, you can always override it to default from code14:50
inc0mewald, no, you need sth like that? if so, you need to mess with ansible14:50
*** daneyon has quit IRC14:50
inc0not a big mess, but mess nonetheless14:50
mewaldit's not like I need it, but Keystone needs it :D14:50
inc0I didn't know of this use case14:50
sdakeinc0 I was thinking since this is a standard keystone thing, we should implement a copy for it14:51
inc0I don't blame you;)14:51
inc0yeah14:51
inc0I agree14:51
mewaldinc0: take a look at the link I posted for sdake about keystone. They describe how it works :)14:51
*** jeh has quit IRC14:52
inc0kk will take a look14:52
inc0so sdake was right after all;) we don't have it14:52
inc0we could use conf.d'ish mechanism for other stuff too14:53
sdakemewald does anything else need to go in the container filesystem besides config files?14:53
sdakemewald note i have no  had a chance ot read yoru link yet - have 6 conversations going on at once :(14:53
mewaldsdake: no thats it, only the "domains" directory in /etc/keystone and the files that go there14:54
*** mliima has quit IRC14:57
*** Jeffrey4l_ has quit IRC15:00
*** athomas has quit IRC15:01
Mr_Brokeninc0: the problem is , default value is bad for my deployment, need to remove the line totaly, and add other backend ( cinder and glance configs ) - so a way to remove or comment a line would be a great feature ! ;]15:01
Mr_Brokencant show you example now, since someone broke network on the way to my openstack deployment ;]15:02
inc0Mr_Broken, if you remove it, it will be default in code15:02
mewaldMr_Broken: inc0 is right, check the configuration reference for what the default value is and set that explicitly15:02
Mr_BrokenI'll need to demonstrate on example15:03
Mr_Brokenbut in glance config, when you want to change from files to swift backend15:04
Mr_Brokenand then disable the files completely15:04
Mr_Brokenyou actually need to remove 1 line from original default Kolla created configs15:04
sdakeMr_Broken do you have exmple configs15:04
Mr_Brokenyeah in an hour15:04
sdakeor link the config in question15:04
sdakeyou said its a default kolla config15:04
sdakewhich file?15:05
*** b_bezak has quit IRC15:05
Mr_Brokenglance-api.conf if i remember correctly15:05
Mr_Brokenanother thing is - it would be super usefull, to have a config file added during reconiguration15:05
*** b_bezak has joined #openstack-kolla15:05
Mr_Brokenfor example , i would like to create glance-swift.conf on all 3 controllers15:05
inc0Mr_Broken, so I was thinking of this case15:06
sdakeMr_Broken https://github.com/openstack/kolla/blob/master/ansible/roles/glance/templates/glance-api.conf.j215:06
inc0to decouple config generation from actual deployment15:06
sdakeMr_Broken can you tell me which line # is the problem15:06
inc0so you can generate configs and then edit them15:06
Mr_Brokendefault_store = file15:06
Mr_Brokenfilesystem_store_datadir = /var/lib/glance/images/15:06
sdakeinc0 i think we hae neough stuff to deal with atm15:07
sdakeinc0 can we table that for next cycle :)15:07
Mr_Broken@sdake: i want to change default_store (and i can) and i want to remove completely or comment out filesystem_store_datadir15:07
inc0well, this is important15:07
Mr_Brokeninc0:  that would be awsome ! :]15:07
sdakeMr_Broken filesystem_store_datadir has some default value in openstack15:07
inc0so if somebody would like to take on it, I'd love to provide some thoughts I already have on that matter15:07
inc0I'm not sure if I'll have bandwidth to pursue it15:08
sdakeMr_Broken if you find it and set it as mewald suggested15:08
sdakethat should get you going15:08
Mr_Brokensdake: i like my config files tidy, and i want to handover to other teams in future15:08
inc0so...that's a call for help guys, who wants to be a contributor?15:08
Mr_Brokenhaving meaningless lines creates confusion15:08
sdakeMr_Broken i hear what your saying15:08
Mr_Brokenbut thats a secondary feature , can deal with that15:08
sdakewe keep the files super minimal on purpose15:08
Mr_Brokenmy biggest problem right now is :15:08
sdakei know its annoying there is no key/value deletion feataure15:09
Mr_Brokenglance and glance cache in multinode topology behind haproxy !15:09
sdakeMr_Broken that isnt working for you?15:09
Mr_Brokenits RANDOMLY picking up a controller to store images on15:09
sdakeMr_Broken it should round robin15:09
sdakeand then when it reads glance imges it should roundrobin again until it finds the correct image15:09
Mr_Brokenwell, 1st image-create - goes on 1 controller15:09
sdakei know, not ideal15:09
*** b_bezak has quit IRC15:09
Mr_Brokenthen when you deploy from image - it connects to different one15:09
Mr_Brokenans Image Not Found ...15:10
sdakeare you mising cinder in with this?15:10
Mr_Brokenafter 2 retries - it founds image and deploys15:10
sdakeor straight nova+glance15:10
Mr_Brokenyes there is cinder in the mix15:10
*** mliima has joined #openstack-kolla15:10
sdakeMr_Broken yup t hat is how it is designed although cinder is either broken tm or our understanding of it is broken15:10
Mr_BrokenLVM ISCSI + XIV Driver for Spectrum Accelerate (also ISCSI)15:10
inc0ceph is really nice project15:11
inc0it really is15:11
inc0and solves so many issues;)15:11
Mr_Brokenyeah, I am deploying on a with ceph as well15:11
inc0Mr_Broken, then you should use ceph backend for glance15:11
Mr_Brokenso I managed to workaround the issue with glance itself (by using external swift, as backend for glance)15:11
Mr_Brokenbut then glance-cache has the same issues :/15:11
sdakeMr_Broken note https://review.openstack.org/#/c/306662/15:12
patchbotsdake: patch 306662 - kolla - Make Cinder access glance in round robin fashion15:12
inc0Mr_Broken, if you deploy ceph it should use ceph backend...and really you dont use glance cache15:12
Mr_Brokenand list-queued round-robins to the glance controllers15:12
inc0as image is CoW snaphot in ceph15:12
Mr_Brokenwell the glance-cache was a neccesity , since this swift backend for glance is far away ;]15:12
Mr_Brokenover internet15:12
Mr_Brokenand my XIV Cinder driver , timeouts from time to time , when trying to fetch image :/15:12
*** ppowell has quit IRC15:13
Mr_Brokenits madness :D15:13
*** vhosakot has joined #openstack-kolla15:13
inc0yeah, now I get why you picked this irc handle15:13
sdakeinc0 pbourke_ looks like this review has lost some attention, would you midn looking again: https://review.openstack.org/#/c/306662/15:13
patchbotsdake: patch 306662 - kolla - Make Cinder access glance in round robin fashion15:13
Mr_Broken@sdake: so you guys are aware, and there was some work on that already - great news!15:14
sdakeMr_Broken yes although the cinder team may remove the cinder-api_servers key entirely15:14
sdakeMr_Broken because they dont like how we hae used it specifically15:14
sdakeMr_Broken we have fixed this already for nova15:15
sdakenova has the api servers thing15:15
sdakethe root of the problem is glance doesn't replicate, and it shoudl do so15:16
Mr_Brokenthat would solve a lot15:16
Mr_Brokenthere was someone on the channel earlier, that tried to rsync those files between docker volumes on the host15:16
Mr_Brokenbut said it didnt work for him ;]15:16
sdakesbezverk you up15:17
inc0changed my -1 to +@15:17
inc0+@15:17
inc0+2 ffs15:17
sdakeinc0 tia :)15:17
sdakeMr_Broken thats a shame, I think that would be a viable workaround15:18
sdakethen we could get rid of these api server usages in our codebase15:18
*** salv-orlando has joined #openstack-kolla15:18
sdakeby making a synchronization container15:18
Mr_Brokeninc0: hehe, yeah everything i touch in our project gets broken !15:18
sdakefuel does synchronization of glance15:19
sdakeeveryone else uses the api server thing15:19
Mr_Brokensdake: i might try to develop some "hack" around it during the next days , but looking forward for some extra attention on https://review.openstack.org/#/c/306662/ :D15:19
patchbotMr_Broken: patch 306662 - kolla - Make Cinder access glance in round robin fashion15:19
sdakeMr_Broken note a cinder patch is required too15:19
Mr_Brokenyeah, cinder needs some love in Mitaka15:20
Mr_Brokenhow are your kubernetes  thingie going ?15:20
sdakehttps://review.openstack.org/#/c/306756/15:20
patchbotsdake: patch 306756 - cinder - Retry when glance returns None on fetch15:20
inc0Mr_Broken, in mitaka we assumed ceph pretty much15:20
inc0as we didn't really have iscsi support15:21
Mr_Brokenfun fact - my architects were saying hard no to ceph for months - > went to 1 customer meeting -> and now I am to broke mitaka + ceph next week ;]15:22
Mr_Brokenyep, didnt make iscsi work on contenerized cinder15:23
sdakeMr_Broken note cinder cats are not going to fix the bug15:23
Mr_Brokenso i just installed it on separate "storage" node15:23
inc0Mr_Broken, it works in Newton15:23
inc0but only in Newton15:23
Mr_Brokenand no backports?!15:23
inc0no...15:23
Mr_Brokenfml15:23
inc0it's big feature15:23
inc0well you can do manual backport of this stuff15:24
inc0some people did15:24
inc0and it works15:24
inc0we'll even point you the way15:24
inc0however stable is stable...15:24
Mr_Brokenthing is this PoC is scheduled for production few months ahead15:24
inc0cinder iscsi is not nearly tested enough to backport it to stable branch15:24
Mr_Brokencant deliver a service based on workarounds :D15:24
*** shardy has joined #openstack-kolla15:25
inc0well, I strongly advice going with ceph for Mitaka15:25
Mr_Brokenyep15:25
inc0if you have hard requirement on iscsi, that's one of ways15:25
Mr_Brokenthats scheduled for next week ;]15:25
Mr_Brokenwill keep you posted15:25
Mr_Brokenyeah, hardware cost are approved , some devices already bought15:25
Mr_Brokenneed ISCSI support :/15:25
*** The_Ball has quit IRC15:26
inc0well these workaround won't be that horrible15:26
inc0it's just few patches to be cherry picked15:26
Mr_Brokensure for a while, but when i leave project, and handover things15:26
Mr_Brokenhow will they "update" in future15:26
inc0Mr_Broken, if they upgrade kolla15:27
Mr_Brokenehh dont want to leave such a mess behind :/15:27
inc0they will have iscsi in main tree15:27
Mr_Brokentrue, newton incoming to stable soon ?15:27
inc0this is relevant only for transition between mitaka->newton15:27
inc0well, when newton releases, which is ~September if my memory serves15:27
Mr_Brokencool15:27
inc0Oct 3-715:28
inc0that's full newton release15:28
inc0and all will be supported in tree by then15:28
inc0I mean it is now, but we do dev now so master is not super stable15:28
*** b_bezak has joined #openstack-kolla15:29
*** belmoreira has quit IRC15:29
sdakeinc0 that date is wrong15:30
sdakewe have a 2 week lag from the ret o the openstack schedule15:30
inc0ok, forgot about that15:30
sdakeit is rigth in the schedule :)15:31
*** caowei has quit IRC15:31
*** caowei has joined #openstack-kolla15:31
*** ppowell has joined #openstack-kolla15:32
*** salv-orlando has quit IRC15:33
*** Serlex has quit IRC15:36
*** Lyncos has joined #openstack-kolla15:36
LyncosPing inc015:36
sdakeMr_Broken I'm really not sure how to help you - the cinder community doesnt want to cooperate with your use case15:37
sdakeMr_Broken the glance community doesn't think its a problem15:37
inc0Lyncos, wassup?15:37
sdakeMr_Broken everyoen thinks some type of single storage solution should be used (such as ceph or swift)15:37
kfox1111morning15:38
sdakeyo kfox111115:38
inc0yo kfox1111 long time no see;)15:38
kfox1111apuimedo: nice. thanks. :)15:39
*** vdo_ is now known as vdo15:39
*** vdo has joined #openstack-kolla15:39
kfox1111inc0: Yeah. :/15:39
kfox1111been way too busy of late. finally getting some time freed back up.15:39
kfox1111been playing a lot with k8s recently.15:40
kfox1111really good stuff. :)15:40
sdakekfox1111 has alot of potential - has a long way to go ;)15:40
Mr_Brokensdake: well I should be able to use it however i want, wasnt modularity one of the main ideas of openstack ? :]15:41
Mr_Brokenalso having more than 1 solution is supported by documentation15:41
sdakeMr_Broken feel free to chime in on the launchpad tracker where the cinder bug was closed wontfix15:41
sdakeMr_Broken it couldn't hurt15:41
Mr_Brokenwill do!15:41
sdakealso sking on #openstack-glance15:41
sdakeasking15:41
Mr_Brokenwill put some project-managers on this task as well ;]15:41
sdakeMr_Broken also sync up with sbezverk - he did the negotations with the cinder people15:42
sdakeMr_Broken note its the second link that needs attention15:42
kfox1111sdake: yeah. but beats the hell out of doing it manually with docker-compose/heat. :)15:42
sdakeI am happy eough to merge it as is15:42
*** daneyon has joined #openstack-kolla15:42
sdakeMr_Broken https://review.openstack.org/#/c/306756/715:43
patchbotsdake: patch 306756 - cinder - Retry when glance returns None on fetch15:43
sdakehttps://launchpad.net/bugs/157121115:43
openstackLaunchpad bug 1571211 in Cinder "In multinode setup VM fails to launch due to cinder not checking with all glance api servers" [Medium,Won't fix] - Assigned to John Griffith (john-griffith)15:43
Mr_Brokenthanks15:43
openstackgerritDave McCowan proposed openstack/kolla: Fernet Key Implementation [WIP]  https://review.openstack.org/29153915:44
sdakeMr_Broken explain your use case in the launchpad bug above15:48
sdakeMr_Broken if you have evidence it is supported by documentation that helps :)15:49
*** caowei has quit IRC15:50
*** salv-orlando has joined #openstack-kolla15:51
sdakemewald hey apologies for losing track of our conversation15:52
sdakemewald i'd suggest filing a blueprint for multidomain if one doesn't exist15:52
*** v1k0d3n has joined #openstack-kolla15:52
sdakelink it here15:52
sdakeand i'll place it in the corrct state15:52
*** sacharya has joined #openstack-kolla15:53
*** dmk0202 has joined #openstack-kolla15:54
*** v1k0d3n has quit IRC16:00
openstackgerritSteven Dake proposed openstack/kolla: Notify operators that cinder + LVM doesn't work  https://review.openstack.org/33222816:02
sdakeMr_Broken just for you ^^16:02
*** v1k0d3n has joined #openstack-kolla16:03
*** v1k0d3n has quit IRC16:04
-openstackstatus- NOTICE: Gerrit is being restarted now to apply an emergency security-related configuration change16:05
wirehead_It takes magical skills to understand where the boundry between “configurable enough to fit any possible need” and the buffet at a Las Vegas casino lies.16:06
Mr_Broken@sdake: thanks a lot16:10
Mr_Brokenthing is the issue is not only with glance and file backend16:10
Mr_Brokenthere is also a problem with glance-cache having same issues when trying to queue-cached etc16:11
Mr_Brokeneven if the backend for glance is on external swift16:12
Mr_Brokennot sure if its glance or cinder problem ;]16:12
Mr_Brokenseems both should cooperate ...16:13
wirehead_hey, inc0…  About https://review.openstack.org/#/c/327925/ — Is there any reason why it’s in tasks/config.yml instead of groups/all.yml ?16:13
patchbotwirehead_: patch 327925 - kolla - Enable kolla k8s to override bind api bind address...16:13
*** pbourke_ is now known as pbourke16:14
inc0wirehead_, so in all.yml we normally don't put any logic16:15
inc0and this is logic16:15
LyncosHi Inc0 sorry was at lunch16:15
*** daneyon_ has joined #openstack-kolla16:17
jgriffithsdake: oh... good reminder :)16:20
sdakejgriffith ya it has fallen of my radar too16:21
sdakebut now more and more peole ask about ti in channel16:21
jgriffithsdake: I don't recall... does that current version work?16:21
sdakeit works with that small patch i wrote16:21
*** daneyon_ has quit IRC16:21
sdakethat yu reworked - not sure ifyour current patch works16:21
sdakebut the bug has been closed as wontfix16:21
jgriffithsdake: That's what i mean, let's make sure the path in the review works and I"ll work on trying to get it merged16:22
jgriffithsdake: so the bottom line is that none of us are happy that Glance has this flaw, but I'd rather see things *work* than try and push the rope16:22
*** dmk0202 has quit IRC16:22
sdakejgriffith i dont like it either fwiw16:23
jgriffithsdake: yeah16:24
sdakejgriffith I dont know anyone in glance circles, but i'm sure they know this is a problem and has been for years16:24
sdakeand if it hasn't been fixed yet, there is probbly a reason16:24
jgriffithsdake: ok, based on sergui's testing sounds like it needs to be put back to patch 516:24
patchbotjgriffith: https://review.openstack.org/#/c/5/ - openstack-infra/system-config - Fix problem with jenkins known_hosts url. (MERGED)16:24
jgriffithhmmm  well nice to meet you patchbot16:24
sdakejgriffith i'll ask sbezverk to dobule check which patch works correctly16:25
sdakehe seems to be afk atm16:25
jgriffithsdake: ok... I put the data method back in https://review.openstack.org/#/c/306756/16:27
patchbotjgriffith: patch 306756 - cinder - Retry when glance returns None on fetch16:27
sdakecool i'll ping sbezverk to test it16:28
sbezverksdake: jgriffith: as far as I know glance refused to support this model. they even went on records with this..16:36
sdakenot asing for support16:37
sdakeasking for corrct implementation16:37
sdakeimplementation and support are two orthogonal things16:37
*** shardy has quit IRC16:37
sdakeif cinder wants to deprecate those keys, and follow the normal deprecation cycle w e will cope with that16:37
*** david-lyle has quit IRC16:38
sdakeits not permitted to deprecate stuff that already exists in a prevoius cycle in that previous cycle :)16:38
*** david-lyle has joined #openstack-kolla16:38
*** huikang has joined #openstack-kolla16:43
openstackgerritKen Wronkiewicz proposed openstack/kolla-kubernetes: Adding debugging documentation for Memcached  https://review.openstack.org/33076616:46
*** huikang has quit IRC16:48
*** fragatina has quit IRC16:48
*** sacharya has quit IRC16:51
*** huikang has joined #openstack-kolla16:54
*** ssurana has joined #openstack-kolla16:56
*** dmsimard is now known as dmsimard|afk16:59
*** inc0 has quit IRC17:01
*** inc0 has joined #openstack-kolla17:02
*** gfidente has quit IRC17:09
*** Serlex has joined #openstack-kolla17:12
*** Serlex has quit IRC17:17
*** sdake_ has joined #openstack-kolla17:24
*** Mech422 has quit IRC17:26
*** sdake has quit IRC17:27
*** sacharya has joined #openstack-kolla17:29
*** ayoung has quit IRC17:33
*** ppowell has quit IRC17:33
*** salv-orl_ has joined #openstack-kolla17:38
*** sacharya has quit IRC17:41
*** salv-orlando has quit IRC17:41
*** zhiwei has joined #openstack-kolla17:42
*** zhiwei has quit IRC17:46
*** ppowell has joined #openstack-kolla17:48
*** coolsvap has quit IRC17:51
*** daneyon has quit IRC17:54
*** daneyon has joined #openstack-kolla17:54
*** Mr_Broken has quit IRC17:59
*** Mr_Broken has joined #openstack-kolla17:59
*** Mech422 has joined #openstack-kolla18:00
*** Mr_Broken has quit IRC18:03
*** Mech422__ has joined #openstack-kolla18:04
*** Mech422 has quit IRC18:05
*** daneyon_ has joined #openstack-kolla18:05
*** ayoung has joined #openstack-kolla18:05
*** daneyon_ has quit IRC18:10
*** thumpba has quit IRC18:25
*** thumpba has joined #openstack-kolla18:27
*** huikang has quit IRC18:33
Mech422__inc0: for multiple domains in keystone - you might need multiple drivers? Like we use local and LDAP ?18:38
*** sacharya has joined #openstack-kolla18:41
*** sean-k-mooney has joined #openstack-kolla18:43
*** sacharya has quit IRC18:47
Mech422__inc0: just as a datapoint - my 3 ceph node glance/cinder seem to work fine18:47
inc010 node ceph works too;)18:48
*** ayoung has quit IRC18:54
Mech422__inc0: cool - the multiple domain stuff for keystone is interesting... we currently use a native/mysql backend for admin and LDAP for users18:54
*** stvnoyes has quit IRC18:55
*** stvnoyes has joined #openstack-kolla18:55
rhalliseyinc0, ok so I have ansible deploying mariadb18:56
*** sdake has joined #openstack-kolla18:56
rhalliseythis has been a little frustrating :)18:56
inc0how so?18:56
rhalliseythe kube ansible module doesn't deploy jobs. The yaml error checking is non existent18:57
rhalliseycreating configmaps doesn't like multiple files has input18:58
rhalliseydon't know how to get any status from the native kube module even if I could create a job :/18:58
rhalliseyso I have my own getting pod status18:58
rhalliseybut it works18:59
*** ayoung has joined #openstack-kolla18:59
*** sdake_ has quit IRC18:59
rhalliseyI don't think the kube module was meant for heavy application/cluster wide orchestraion19:00
sdakerhallisey they want it to be19:00
*** ayoung has quit IRC19:00
sdakerhallisey they are kicking that into overdrive19:00
rhalliseythe ansible module?19:00
sdakeyup19:00
rhalliseyI'll have to make a bunch of PRs then19:01
rhalliseywe need a bunch of stuff from it19:01
sdakewhatever works19:01
*** erhudy has joined #openstack-kolla19:03
*** daneyon has quit IRC19:04
*** daneyon has joined #openstack-kolla19:04
*** JoseMello has joined #openstack-kolla19:12
sean-k-mooneyever get the feeling that your over thinking things.  im about to try to deploy fuel in a vm ,with vagrent, in a vm, hosted on openstack, provisioned by kolla...19:12
*** dmsimard|afk is now known as dmsimard19:15
wirehead_Maybe you could add Hercules and S/390 Linux, for style points, sean-k-mooney.19:16
*** fragatina has joined #openstack-kolla19:16
sean-k-mooneyhaha well at least i have nested virtualisation turned on so hopefully it wont just die when i booth the vagrent vms19:18
*** b_bezak has quit IRC19:19
*** b_bezak has joined #openstack-kolla19:20
*** b_bezak has quit IRC19:25
*** cu5 has quit IRC19:29
*** inc0_ has joined #openstack-kolla19:29
*** david-lyle has quit IRC19:30
*** wmiller has quit IRC19:30
*** dwalsh has quit IRC19:30
*** mandre has quit IRC19:30
*** cinerama has quit IRC19:30
*** inc0 has quit IRC19:31
*** wmiller has joined #openstack-kolla19:31
*** huikang has joined #openstack-kolla19:34
*** cinerama has joined #openstack-kolla19:34
*** cu5 has joined #openstack-kolla19:35
*** dave-mccowan has quit IRC19:36
*** mandre has joined #openstack-kolla19:36
*** mliima has quit IRC19:36
*** huikang has quit IRC19:38
*** dave-mccowan has joined #openstack-kolla19:40
*** ayoung has joined #openstack-kolla19:40
*** david-lyle has joined #openstack-kolla19:41
*** zhiwei has joined #openstack-kolla19:43
*** dwalsh has joined #openstack-kolla19:43
*** dave-mccowan has quit IRC19:45
*** dave-mcc_ has joined #openstack-kolla19:45
*** zhiwei has quit IRC19:47
*** daneyon_ has joined #openstack-kolla19:53
*** haplo37_ has joined #openstack-kolla19:58
*** daneyon_ has quit IRC19:58
*** huikang has joined #openstack-kolla20:11
*** ppowell has quit IRC20:31
*** jtriley has quit IRC20:38
*** ayoung has quit IRC20:38
sean-k-mooneywell that didnt work. looks like the vagrent file for fule is broke. the vm worked well though.20:44
openstackgerritDavid Wang proposed openstack/kolla-kubernetes: WIP: Consolidating path resolution and searching for program files  https://review.openstack.org/32967620:44
*** huikang has quit IRC20:58
*** thumpba has quit IRC20:59
*** mark-casey has joined #openstack-kolla21:04
*** inc0_ has quit IRC21:10
openstackgerritDavid Wang proposed openstack/kolla-kubernetes: Consolidating path resolution and searching for program files  https://review.openstack.org/32967621:12
*** rhallisey has quit IRC21:14
openstackgerritKen Wronkiewicz proposed openstack/kolla: WIP: Glance interface address, memcached override, and glance override.  https://review.openstack.org/33248121:21
*** sean-k-mooney has quit IRC21:33
*** fragatina has quit IRC21:33
*** jpeeler has quit IRC21:36
*** haplo37_ has quit IRC21:37
*** JoseMello has quit IRC21:39
openstackgerritJoshua Harlow proposed openstack/kolla: Add a cloud-init RHEL(ish) bootstrap + run kolla script  https://review.openstack.org/32180221:40
*** ayoung has joined #openstack-kolla21:41
*** sacharya has joined #openstack-kolla21:44
openstackgerritJoshua Harlow proposed openstack/kolla: Add a cloud-init RHEL(ish) bootstrap + run kolla script  https://review.openstack.org/32180221:44
*** clayton has quit IRC21:46
*** clayton has joined #openstack-kolla21:47
*** sacharya has quit IRC21:49
*** zhiwei has joined #openstack-kolla21:50
*** zhiwei has quit IRC21:55
*** mbound has joined #openstack-kolla21:55
*** dwalsh has quit IRC21:59
*** huikang has joined #openstack-kolla21:59
*** huikang has quit IRC22:03
*** jrist has quit IRC22:06
*** v1k0d3n has joined #openstack-kolla22:13
*** severion has joined #openstack-kolla22:14
*** v1k0d3n has quit IRC22:18
*** vhosakot has quit IRC22:19
*** huikang has joined #openstack-kolla22:22
openstackgerritJoshua Harlow proposed openstack/kolla: Stop using a global logger for all the things  https://review.openstack.org/32188422:25
*** huikang has quit IRC22:30
*** williamcaban has quit IRC22:31
*** daneyon_ has joined #openstack-kolla22:36
*** rcarrillocruz has quit IRC22:39
*** rcarrillocruz has joined #openstack-kolla22:40
*** daneyon_ has quit IRC22:41
*** severion has quit IRC22:45
harlowjaman, the way to tell kolla to build off a custom git location is really weird to figure out23:07
harlowjathe usage of oslo.config doesn't really seem to be helping ....23:07
harlowjain that there is some yaml files, there is some cli options, there is some conf files, like madness anyone?23:10
harlowjai'd prefer like 1 damn thing, lol23:10
*** erhudy has quit IRC23:11
harlowjaits not annoying to others that there is like multiple ways to configure stuff?23:12
*** jrist has joined #openstack-kolla23:12
*** daneyon has quit IRC23:14
*** daneyon has joined #openstack-kolla23:15
harlowjafor example, just trying to get the following to run23:15
harlowja# kolla-build glance --type source   --config-file  kolla-glance.tmp23:15
harlowjawith file23:15
harlowja[glance-base]23:15
harlowjatype=git23:15
harlowjasource=git@github.com:openstack/glance.git23:15
harlowjareference=stable/mitaka23:15
harlowjaand it appears to run all the things, now am i just not passing in things right, is there some other thing happening, is this supposed to be via a CLI option, who knows23:15
*** mark-casey has quit IRC23:30
*** Jeffrey4l_ has joined #openstack-kolla23:32
harlowjaso ya, i'm a little confused as what the actual params/config/cli/or who knows what to get it do actually just build glance, lol23:33
harlowjahttp://paste.openstack.org/show/521011/ is where i got23:33
harlowjawhy its trying to clone a tarball, idk23:33
harlowjaalso whats up with the following automatically getting pulled in23:35
harlowja RUN curl http://trunk.rdoproject.org/centos7/current-passed-ci/delorean.repo /etc/yum.repos.d/kibana.yum.repo  /etc/yum.repos.d/elasticsearch.repo delorean-deps.repo even though i'm doing a source install23:35
harlowja(of just glance)23:35
*** salv-orlando has joined #openstack-kolla23:39
*** salv-orl_ has quit IRC23:42
*** sacharya has joined #openstack-kolla23:45
*** salv-orlando has quit IRC23:46
*** sacharya has quit IRC23:49
*** ssurana has quit IRC23:55

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!