Monday, 2016-05-16

*** asalkeld has joined #openstack-kolla00:11
*** dwalsh has joined #openstack-kolla00:26
*** dwalsh has quit IRC00:44
*** SiRiuS has quit IRC01:24
*** Avi82 has quit IRC01:28
*** salv-orlando has joined #openstack-kolla01:43
*** salv-orlando has quit IRC01:51
*** vhosakot has joined #openstack-kolla01:57
*** mbound has joined #openstack-kolla02:09
*** mbound has quit IRC02:14
openstackgerritJeffrey Zhang proposed openstack/kolla: Configure the rabbitmq ha policy in config file  https://review.openstack.org/31538002:14
*** yuanying_ is now known as yuanying02:17
*** vhosakot has quit IRC02:19
*** dave-mccowan has joined #openstack-kolla02:20
*** stvnoyes has quit IRC02:28
*** stvnoyes has joined #openstack-kolla02:29
*** godleon has joined #openstack-kolla02:40
*** klint has joined #openstack-kolla02:51
*** Avi82 has joined #openstack-kolla02:56
openstackgerritJeffrey Zhang proposed openstack/kolla: Fix the rabbitmq crash on CentOS binary and source deploy  https://review.openstack.org/31586003:00
*** weiyu has joined #openstack-kolla03:03
*** Avi82 has quit IRC03:06
*** coolsvap has joined #openstack-kolla03:11
*** coolsvap has quit IRC03:15
openstackgerritMerged openstack/kolla: Updated from global requirements  https://review.openstack.org/31647003:19
openstackgerritJeffrey Zhang proposed openstack/kolla: Fix the rabbitmq crash on CentOS binary and source deploy  https://review.openstack.org/31586003:20
openstackgerritZhijiang Hu proposed openstack/kolla: Update doc about how to install python-docker-py on centos  https://review.openstack.org/31595003:20
*** coolsvap has joined #openstack-kolla03:32
*** daneyon_ has joined #openstack-kolla03:56
*** daneyon_ has quit IRC04:00
openstackgerritMerged openstack/kolla: Update doc about how to install python-docker-py on centos  https://review.openstack.org/31595004:04
openstackgerritJeffrey Zhang proposed openstack/kolla: Fix the rabbitmq crash on CentOS binary and source deploy  https://review.openstack.org/31586004:26
*** v1k0d3n has quit IRC04:31
*** salv-orlando has joined #openstack-kolla04:36
*** salv-orlando has quit IRC04:45
openstackgerritJeffrey Zhang proposed openstack/kolla: Fix the rabbitmq crash on CentOS binary and source deploy  https://review.openstack.org/31586004:46
*** Liuqing has joined #openstack-kolla04:53
*** v1k0d3n has joined #openstack-kolla05:01
openstackgerritJeffrey Zhang proposed openstack/kolla: Fix the rabbitmq crash on CentOS binary and source deploy  https://review.openstack.org/31586005:23
*** mikelk has joined #openstack-kolla05:56
*** salv-orlando has joined #openstack-kolla06:02
*** salv-orlando has quit IRC06:08
openstackgerritweiyu proposed openstack/kolla: Add a cluter_network interface when we use ceph  https://review.openstack.org/31658806:12
openstackgerritweiyu proposed openstack/kolla: Add a cluter_network interface when we use ceph  https://review.openstack.org/31658806:24
*** salv-orlando has joined #openstack-kolla06:25
*** yuanying has quit IRC06:30
openstackgerritJeffrey Zhang proposed openstack/kolla: Fix the rabbitmq crash on CentOS binary and source deploy  https://review.openstack.org/31586006:33
*** tfukushima has joined #openstack-kolla06:41
openstackgerritMd Nadeem proposed openstack/kolla: Added unit test for kolla_docker  https://review.openstack.org/28513806:51
*** sacharya has quit IRC07:00
*** v1k0d3n has quit IRC07:06
*** Liuqing has quit IRC07:29
openstackgerritJeffrey Zhang proposed openstack/kolla: Fix the rabbitmq crash on CentOS binary and source deploy  https://review.openstack.org/31586007:31
*** daneyon_ has joined #openstack-kolla07:32
*** v1k0d3n has joined #openstack-kolla07:33
*** yuanying has joined #openstack-kolla07:34
*** Liuqing has joined #openstack-kolla07:36
*** daneyon_ has quit IRC07:37
*** jmccarthy has quit IRC07:39
*** shardy has joined #openstack-kolla07:40
*** jmccarthy has joined #openstack-kolla07:40
*** jmccarthy has left #openstack-kolla07:41
*** yuanying has quit IRC07:42
*** yuanying has joined #openstack-kolla07:42
*** yuanying has quit IRC07:43
*** sacharya has joined #openstack-kolla08:00
*** sacharya has quit IRC08:06
*** yuanying has joined #openstack-kolla08:08
*** mbound has joined #openstack-kolla08:09
*** salv-orlando has quit IRC08:11
*** ssurana has joined #openstack-kolla08:13
*** mbound has quit IRC08:14
*** Serlex has joined #openstack-kolla08:22
openstackgerritBenedikt Trefzer proposed openstack/kolla: Make container dind unpin old docker relase  https://review.openstack.org/29743408:26
*** dmk0202 has joined #openstack-kolla08:32
*** pbourke has joined #openstack-kolla08:32
*** pbourke has quit IRC08:33
*** pbourke has joined #openstack-kolla08:38
*** ssurana has quit IRC08:57
*** yuanying has quit IRC09:14
openstackgerritJeffrey Zhang proposed openstack/kolla: Fix the rabbitmq crash on CentOS binary and source deploy  https://review.openstack.org/31586009:14
openstackgerritPaul Bourke proposed openstack/kolla: Improve Vagrants bootstrap.sh proxy support  https://review.openstack.org/31024609:17
openstackgerritPaul Bourke proposed openstack/kolla: Fix build for oraclelinux base  https://review.openstack.org/31077409:18
openstackgerritJeffrey Zhang proposed openstack/kolla: Fix the rabbitmq crash on CentOS binary and source deploy  https://review.openstack.org/31586009:41
*** liecho has quit IRC09:47
*** rmart04 has joined #openstack-kolla09:47
openstackgerritMerged openstack/kolla: Doc rework for quickstart, multinode, and image-building  https://review.openstack.org/31188409:59
*** sacharya has joined #openstack-kolla10:02
*** sacharya has quit IRC10:07
*** yuanying has joined #openstack-kolla10:13
*** daneyon_ has joined #openstack-kolla10:15
*** daneyon_ has quit IRC10:19
*** tfukushima has quit IRC10:22
*** tfukushima has joined #openstack-kolla10:24
openstackgerritJeffrey Zhang proposed openstack/kolla: Fix the rabbitmq crash on CentOS binary and source deploy  https://review.openstack.org/31586010:24
openstackgerritJeffrey Zhang proposed openstack/kolla: Fix the rabbitmq crash on CentOS binary and source deploy  https://review.openstack.org/31586010:27
dimssbezverk : or anyone else around? please bless this one https://review.openstack.org/#/c/315776/ will unblock 5 reviews that are already approved. thanks!10:28
patchbotdims: patch 315776 - kolla-kubernetes - Major Cleanup - Get command line working10:28
*** SiRiuS has joined #openstack-kolla10:32
*** salv-orlando has joined #openstack-kolla10:34
*** salv-orlando has quit IRC10:39
*** weiyu has quit IRC10:42
coolsvapdims, blessed :)10:44
dimsthanks coolsvap !10:45
*** salv-orlando has joined #openstack-kolla10:48
openstackgerritMerged openstack/kolla-kubernetes: Major Cleanup - Get command line working  https://review.openstack.org/31577610:49
*** yuanying has quit IRC11:01
*** sbezverk has quit IRC11:04
*** yuanying has joined #openstack-kolla11:05
*** godleon has quit IRC11:09
*** SiRiuS has quit IRC11:11
*** sbezverk has joined #openstack-kolla11:16
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Add Horizon's kubernetes objects  https://review.openstack.org/31641111:18
sbezverkgood morning11:19
sbezverkdims sorry I missed you ping..11:19
*** sbezverk has quit IRC11:27
*** salv-orlando has quit IRC11:27
*** sbezverk has joined #openstack-kolla11:31
*** SiRiuS has joined #openstack-kolla11:35
*** salv-orlando has joined #openstack-kolla11:35
*** mlima has joined #openstack-kolla11:39
mlimamorning guys11:40
*** rhallisey has joined #openstack-kolla11:44
dimssbezverk : no worries :)11:48
dimsmlima : good morning11:48
*** yuanying has quit IRC11:49
*** yuanying has joined #openstack-kolla11:53
*** sdake has joined #openstack-kolla11:55
sdakemorning11:55
*** weiyu_ has joined #openstack-kolla11:55
mlimagood morning sdake11:57
*** weiyu_ has quit IRC12:08
*** sdake has quit IRC12:10
openstackgerritRyan Hallisey proposed openstack/kolla: Spec: Deploy Kolla images using Kubernetes  https://review.openstack.org/30418212:10
sbezverkdims: I see a strange issue, when I clone kolla_kubernetes I do not see any new stuff which got merged.. When you clone master, do you see newly merged things?12:11
dimssbezverk : 4 of them are still stuck. will check on it in a little bit12:12
sbezverkdims : thanks12:13
*** diogogmt has quit IRC12:15
*** yuanying has quit IRC12:17
*** diogogmt has joined #openstack-kolla12:20
*** severion has joined #openstack-kolla12:21
*** coolsvap has quit IRC12:22
*** coolsvap has joined #openstack-kolla12:23
*** v1k0d3n has quit IRC12:24
*** diogogmt has quit IRC12:29
openstackgerritDavanum Srinivas (dims) proposed openstack/kolla-kubernetes: Switch Keystone to use ConfigMap  https://review.openstack.org/31483812:30
openstackgerritDavanum Srinivas (dims) proposed openstack/kolla-kubernetes: Add RabbitMQ service  https://review.openstack.org/31566712:30
openstackgerritDavanum Srinivas (dims) proposed openstack/kolla-kubernetes: Add Mariadb service  https://review.openstack.org/31499012:30
openstackgerritDavanum Srinivas (dims) proposed openstack/kolla-kubernetes: Add a memcached service  https://review.openstack.org/31477212:30
rhalliseysbezverk dims I added logging to the spec.  Also added some alternative methods for bootstrapping12:31
dimsrhallisey : hey, good morning, ack will check in a little bit12:32
rhalliseydims, morning :)12:32
*** coolsvap has quit IRC12:33
*** diogogmt has joined #openstack-kolla12:35
sbezverkrhallisey good morning,nice job, I really like the idea of a sidecar container..12:35
*** eal_ has joined #openstack-kolla12:42
rhalliseysbezverk, ya I think it fits nice12:47
sbezverkrhallisey last friday dims' fixed the script and now I can launch service in kubernetes, have you given any thoughts for config generation for containers?12:50
openstackgerritMerged openstack/kolla-kubernetes: Switch Keystone to use ConfigMap  https://review.openstack.org/31483812:51
rhalliseysbezverk, the script depends on kolla12:51
rhalliseyright?12:51
sbezverkshould we reuse/modify ansible playbook for config generation or something else?12:51
rhalliseysbezverk, let's stick with kolla for now12:52
sbezverkrhallisey right, it depended on kolla and it was looking for it at different location..12:52
sbezverkrhallisey kolla have config and deploy kind of together, if we need to do just config we need to disable facts gathering and also we cannot process some host specific configuration12:53
openstackgerritMerged openstack/kolla-kubernetes: Add a memcached service  https://review.openstack.org/31477212:54
sbezverkexample neutron's interfaces, swift rings bunch of things which depends on actual target host config12:54
openstackgerritMerged openstack/kolla-kubernetes: Add Mariadb service  https://review.openstack.org/31499012:54
openstackgerritMerged openstack/kolla-kubernetes: Add RabbitMQ service  https://review.openstack.org/31566712:54
sbezverkrhallisey at first I thought reusing kolla would be ideal solution but deeper I look at it, I am getting less sure of that..12:55
*** unicell has quit IRC12:57
*** klint has quit IRC12:57
*** unicell has joined #openstack-kolla12:58
*** daneyon_ has joined #openstack-kolla12:58
rhalliseysbezverk, can you give me a link to an example12:58
*** jeh has quit IRC12:59
*** sbezverk_ has joined #openstack-kolla13:00
*** jeh has joined #openstack-kolla13:00
*** jeh has quit IRC13:00
*** jeh has joined #openstack-kolla13:00
*** athomas has quit IRC13:01
*** daneyon_ has quit IRC13:02
*** sbezverk has quit IRC13:03
rhalliseysbezverk_, Ideally we should use what we have13:12
rhalliseymaybe try and decouple it a bit more13:12
sbezverk_rhallisey ok sounds good13:13
eal_is there a way to deploy ceilometer with kolla? there doesn't seem to be any "enable_ceilometer" or similar knob13:17
*** jeh has quit IRC13:19
*** dwalsh has joined #openstack-kolla13:20
*** jeh has joined #openstack-kolla13:21
*** jeh has quit IRC13:21
*** jeh has joined #openstack-kolla13:21
*** Liuqing has quit IRC13:23
*** vhosakot has joined #openstack-kolla13:23
rhalliseyeal_, I don't think ceilometer is operational in kolla13:25
eal_rhallisey: ok, thanks13:26
eal_do you know if there is any particular problem with it, or is it just that nobody got around to integrating it yet?13:31
sbezverk_eal_ I think it is work in progress. you need tho check with Hui Kang.13:38
sbezverk_his id huikang13:39
*** cpolaku has joined #openstack-kolla13:39
eal_sbezverk_: thanks13:39
*** jtriley has joined #openstack-kolla13:39
openstackgerritMd Nadeem proposed openstack/kolla-kubernetes: WIP: Heat services and pod  https://review.openstack.org/31685013:41
*** Liuqing has joined #openstack-kolla13:42
*** cpolaku has quit IRC13:44
openstackgerritRyan Hallisey proposed openstack/kolla-kubernetes: WIP - Implement Nova pods and services  https://review.openstack.org/31685513:50
*** smekel_ has quit IRC14:01
openstackgerritJeffrey Zhang proposed openstack/kolla: Fix the rabbitmq crash on CentOS binary and source deploy  https://review.openstack.org/31586014:01
*** signed8bit has joined #openstack-kolla14:01
*** diogogmt has quit IRC14:02
*** smekel_ has joined #openstack-kolla14:03
*** sacharya has joined #openstack-kolla14:03
*** coolsvap has joined #openstack-kolla14:03
openstackgerritRyan Hallisey proposed openstack/kolla-kubernetes: Allow for CLI to work from kolla-kubernetes dir  https://review.openstack.org/31583814:04
*** sdake has joined #openstack-kolla14:08
*** sacharya has quit IRC14:08
sdakemorning again ;)14:08
sdakepremature wakup i u gess14:08
*** inc0 has joined #openstack-kolla14:13
inc0good morning14:13
inc0I'm back to the land of non-living14:14
sdakenice14:15
sdakewelcome back inc014:15
sdakewe released liberty14:15
inc0yeah I've seen14:15
inc0I'm happier person14:16
sdakewas actually a pretty fast turnaround I htink :)14:16
*** jtriley has quit IRC14:16
sdake3 weeks from one release to hte next14:16
coolsvapgm all14:17
coolsvapwelcome back inc014:17
openstackgerritJeffrey Zhang proposed openstack/kolla: Use a lower number of the workers  https://review.openstack.org/31687614:22
*** jtriley has joined #openstack-kolla14:23
sdakehey coolsvap14:24
*** Lyncos has left #openstack-kolla14:25
*** Lyncos has joined #openstack-kolla14:25
*** Jeffrey4l has joined #openstack-kolla14:28
*** inc0 has quit IRC14:29
*** inc0 has joined #openstack-kolla14:29
*** thumpba has joined #openstack-kolla14:30
sdakedims thanks for the rebase14:38
sdakei was just goign to pull down the review to do that ;)14:38
*** vhosakot has quit IRC14:44
*** daneyon_ has joined #openstack-kolla14:46
*** jtriley has quit IRC14:47
*** salv-orlando has quit IRC14:49
*** jtriley has joined #openstack-kolla14:49
*** salv-orlando has joined #openstack-kolla14:50
*** daneyon_ has quit IRC14:50
sdakehell hath frozen over14:54
sdakehttps://review.openstack.org/#/c/300574/1414:54
patchbotsdake: patch 300574 - kolla - Implement ceilometer ansible role14:54
openstackgerritRyan Hallisey proposed openstack/kolla-kubernetes: Allow for CLI to work from kolla-kubernetes dir  https://review.openstack.org/31583814:57
eal_ah, nice!14:59
*** diogogmt has joined #openstack-kolla15:00
*** Avi82 has joined #openstack-kolla15:01
*** prithiv has joined #openstack-kolla15:03
*** ntpttr- has joined #openstack-kolla15:05
*** pumaranikar has quit IRC15:05
openstackgerritJeffrey Zhang proposed openstack/kolla: Fix the rabbitmq crash on CentOS binary and source deploy  https://review.openstack.org/31586015:05
openstackgerritSwapnil Kulkarni (coolsvap) proposed openstack/kolla: Updated broken links with current changes  https://review.openstack.org/31690715:08
coolsvapsdake, rhallisey ^^ current quickstart changes broke most of the links15:09
rhalliseycoolsvap, what do you mean they work for me?15:11
*** haplo37 has joined #openstack-kolla15:11
coolsvaprhallisey, no it doesnt15:11
coolsvapgo to http://docs.openstack.org/developer/kolla/quickstart.html15:11
rhalliseyhttps://github.com/openstack/kolla/blob/master/doc/quickstart.rst#deploying-kolla15:11
*** eal_ has quit IRC15:12
rhalliseycoolsvap, oh I see the breakage15:12
coolsvapif i click on multinode http://docs.openstack.org/developer/kolla/multinode.rst15:12
coolsvapis displayed15:12
rhalliseyya those paths are relative15:13
sdakegroan15:13
sdakeeither fix quickly (as in now) or revert please15:14
*** pumaranikar has joined #openstack-kolla15:15
rhalliseycoolsvap, https://review.openstack.org/#/c/316907/1/doc/multinode.rst15:15
patchbotrhallisey: patch 316907 - kolla - Updated broken links with current changes15:15
rhalliseyisn't that also relative15:15
rhalliseyI don't think that will map over in git15:16
coolsvaprhallisey, its relative15:16
rhalliseyvs openstack docs15:16
sdakeI suspect there is a better way to link to other rst documentation15:17
sdakebecause we shoudl be linking to rst, and then sphinx should be outputting correct links15:17
sdakethis is how index.rst works for example15:17
*** Jeffrey4l has quit IRC15:17
coolsvapsdake, we dont need to provide rst/html15:17
coolsvaponly in case of references internal to doc15:18
coolsvapits needed15:18
coolsvapotherwise :doc: with rst name does the work15:18
sdakeya but your change addresses html file not rst file15:18
sdakethat definately doesn't seem correct15:18
sdakerstcan output in a number of formats15:18
sdakeideally all of them would work15:19
sdakeincluding man pages for example15:19
sdakehere is what i'm talkingabout: https://review.openstack.org/#/c/316907/1/doc/multinode.rst15:19
patchbotsdake: patch 316907 - kolla - Updated broken links with current changes15:19
*** sacharya has joined #openstack-kolla15:21
openstackgerritSwapnil Kulkarni (coolsvap) proposed openstack/kolla: Updated broken links with current changes  https://review.openstack.org/31690715:21
coolsvapsdake, i forgot to add the similar chagne in quistart15:21
coolsvapthe rst is not getting converted to html15:22
*** mlima has quit IRC15:22
coolsvapfor relative links we need to use html15:23
coolsvapi referenced another set of docs15:23
*** MarMat has joined #openstack-kolla15:24
sdakei really really dont like that at all15:24
sdakelets see if theat  is actually corerct15:25
coolsvapsdake, let me give you example15:25
coolsvapsdake, rhallisey https://raw.githubusercontent.com/openstack/tripleo-docs/master/doc/source/advanced_deployment/tripleo.sh.rst15:27
coolsvapsee the section Using tripleo.sh15:27
coolsvap`environment setup <http://docs.openstack.org/developer/tripleo-docs/environments/environments.html#environment-setup>`_15:27
coolsvapfor internal link they have used html, relative/non-relative15:28
coolsvapfor all other cases where we have direct documentation link :doc: <doc-name>(without rst) works just fine15:28
coolsvapsdake, rhallisey ^^15:28
*** rstarmer has joined #openstack-kolla15:30
*** rstarmer has quit IRC15:35
*** prithiv has quit IRC15:36
*** prithiv has joined #openstack-kolla15:37
*** prithiv has quit IRC15:37
coolsvaprhallisey, sdake currently the rst links are not working in git as well, with current change it will work in git only for the exception of the internal links15:38
*** mlima has joined #openstack-kolla15:40
*** Jeffrey4l has joined #openstack-kolla15:41
sdakethere has got to be a better way coolsvap15:43
coolsvapsdake, wait a min15:43
sdakecan you check out the ironic docs for similar exmaples15:43
*** Liuqing has quit IRC15:43
*** dmk0202 has quit IRC15:44
*** rmart04 has quit IRC15:45
coolsvapsdake, checking15:46
sdakecoolsvap http://www.sphinx-doc.org/en/stable/markup/inline.html15:49
sdakesee cross-referencing objects15:49
coolsvapsdake, i am on the same page :)15:49
sdake:doc: looks good15:49
coolsvapi have already done the changes for doc and ref15:50
sdakein a review?15:50
coolsvapupdating it wait15:50
coolsvapi am just looking for the solution for change in multinode.rst15:51
sdakewho is up for moving to ansible 2.0 :)15:52
rhalliseycoolsvap, using :doc:<doc> I'm not seeing it link to anything15:54
coolsvaprhallisey, just amin15:54
rhalliseycoolsvap, I mean locally15:55
coolsvapit does15:55
rhalliseyor a different git repo rather15:55
coolsvapi tested it15:55
rhalliseydo you need index.rst to specify what those links mean?15:55
coolsvapno15:55
sdakehttps://docs.ansible.com/ansible/porting_guide_2.0.html15:56
coolsvaprhallisey, updated the review please check https://review.openstack.org/31690715:58
*** inc0_ has joined #openstack-kolla15:58
coolsvapsdake, i am16:00
*** inc0 has quit IRC16:01
*** fragatina has quit IRC16:07
coolsvapsdake, if I look at ironic documentation I feel there is a major change needed16:07
*** fragatina has joined #openstack-kolla16:08
*** mark-casey has joined #openstack-kolla16:08
* coolsvap back after dinner16:08
*** mikelk has quit IRC16:10
*** inc0_ has quit IRC16:11
*** rcarrillocruz has joined #openstack-kolla16:12
rcarrillocruzsdake: heya, just saw your mail thread about moving kolla playbooks to ansible 2.0. Been looking to be involved with kolla for some time, would be happy to help and get some work items assigned (whenever they are written up)16:13
sdakercarrillocruz ya waiting on Jeffrey4l for those16:14
sdakercarrillocruz i htink one way you could get started is get familiar with how kolla operates - if not already16:14
*** salv-orl_ has joined #openstack-kolla16:15
*** von123 has joined #openstack-kolla16:16
von123Hi room16:18
*** salv-orlando has quit IRC16:18
von123i am having an issue with with my deployment16:21
*** inc0 has joined #openstack-kolla16:21
von123i keep getting an error failing at task: Waiting for virtual IP to appear16:22
sdakevon123 ever had a successful deploy?16:23
von123yes as aio16:23
sdakercarrillocruz have you ramped up on deployment thus far?16:23
sdakevon123 so AIO was working and now its not?16:23
von123but not multi16:23
sdakeoh multi isn't 'working for you16:24
von123yes16:24
sdakevon123 which distribution are running?  (source/ubuntu/binary/centos/)16:24
rcarrillocruzsdake: just the basics of kolla, deploying it on an AIO16:24
von123binary/centos16:24
sdakercarrillocruz nice :)16:24
rcarrillocruzi'm a maintainer of the openstack ansible modules16:24
rcarrillocruzso i'm aware of ansible roles, etc16:24
rcarrillocruzwould be happy to help16:24
sdakercarrillocruz cool - we definately need some ansible brainpower, because admittidly I am not an ansible rocket scientist :)16:25
rcarrillocruz++16:25
sdakevon123 would you paste your gloals.yml plz16:25
von123yep16:26
sdakeI think Jeffrey4l is closest to ansible rocket scientist on our team, so he is a good individual to leadup the ansible 2.0 work16:26
sdakevon123 run fpaste /etc/kolla/globals.yml16:26
sdakeyou may need to install fpaste first16:26
mlima..........................................................-..16:28
mlimaops, sorry :/16:29
von123http://paste.openstack.org/show/497243/16:29
mlimaI'm cleaning my keyboard :)16:29
sdakekolla_internal_vip_address: "192.168.1.43"16:29
sdakevon123 this IP is unused on your network, correct?16:30
*** vhosakot has joined #openstack-kolla16:30
sdakevon123 centos renames interfaces, so this wont work16:30
sdakenetwork_interface: "eth0"16:30
sdakevon123 neutron_external_interface: "eth1"16:30
sdakemy interfaces are like enp0s0f116:31
sdakeand crazy stuff liek that16:31
sdakeyou can use ip link show to display them16:31
sdakethis may explain why keepalived is not working for you16:31
sdakeyou can always run prechecks first to test16:31
von123yes16:32
sdakevon123 i am confused - if 192.168 is your management network, how do you also have access to a registry here:16:33
sdakedocker_registry: "130.3.192.67:4000"16:33
sdakevon123 i think you want your unused ip address to also be on 130.3.192.x16:34
*** daneyon_ has joined #openstack-kolla16:34
von123so my unsed IP should be from my floating ip pool ?16:35
sdakefloating ip, are you running on top of openstack?16:35
sdakethe management network should be accessible by all nodes in the network16:36
sdakeif 192.168 is not accessible you will get an error where you stated16:36
* coolsvap back16:36
von123so all the vm's are can access each other through the 192.168 network16:37
sdakeare you running centos vms or something to test kolla?16:37
sdakeon top of openstack?16:37
von123yes16:37
sdakei see, well kolla uses multicast - it is possible your cloud provider has that turned off in neutron16:38
von123so we have fuel deployed16:38
von123let me check16:38
sdakemulticast is used by keepalived to assign the VIP address16:38
*** daneyon_ has quit IRC16:39
*** unicell has quit IRC16:40
*** Jeffrey4l has quit IRC16:43
*** smekel_ has quit IRC16:51
*** smekel_ has joined #openstack-kolla16:52
*** d_code_ has joined #openstack-kolla16:54
*** von123 has quit IRC17:00
*** inc0 has quit IRC17:01
*** Serlex has quit IRC17:01
*** fragatina has quit IRC17:02
sdakejpeeler don't blame me for the top post, i was just continuing on from where it was left ;)17:03
*** unicell has joined #openstack-kolla17:08
*** coolsvap has quit IRC17:11
*** coolsvap has joined #openstack-kolla17:25
*** dims_ has joined #openstack-kolla17:25
*** dims has quit IRC17:26
*** unicell has quit IRC17:28
*** unicell1 has joined #openstack-kolla17:28
*** coolsvap_ has joined #openstack-kolla17:30
openstackgerritSwapnil Kulkarni (coolsvap) proposed openstack/kolla: Structuring the documentation  https://review.openstack.org/31690717:31
coolsvap_sdake, ^^17:32
*** coolsvap has quit IRC17:34
*** coolsvap_ is now known as coolsvap17:35
*** daneyon_ has joined #openstack-kolla17:45
*** inc0 has joined #openstack-kolla17:45
*** daneyon_ has quit IRC17:54
sdakesbezverk_ how do you feel about implementing lbaas support in kolla?17:58
sdakecoolsvap ping re docs update17:59
sdakecoolsvap are you sure the --- should go to ===?17:59
coolsvapsdake, yes it gives ability to reference section in document directly18:00
sdakenice18:00
sdakeso as --- you can't reference a section?18:00
coolsvapfor that you need to add label18:00
coolsvapyou need that for cross document referencing18:01
coolsvapcross-document ref do not work in git18:02
coolsvapwith this we can have in document references working in both git and web18:03
coolsvapsdake, ^^18:03
*** sbezverk_ has quit IRC18:04
sdakecoolsvap one little nitpick18:05
sdakecoolsvap and I want to see how it renders compared to what we had before18:05
sdakecoolsvap do you have an example rendering?18:05
sdakethe gate will do it for us, but it takes awhile18:05
*** sbezverk has joined #openstack-kolla18:05
sdakesbezverk ping re lbaas18:05
*** fragatina has joined #openstack-kolla18:06
coolsvapsdake, i have but its local wait18:06
sdakemy q is does it look different18:06
*** signed8bit is now known as signed8bit_Zzz18:07
coolsvapsdake, sent18:07
coolsvapcheck mail18:07
*** signed8bit_Zzz is now known as signed8bit18:08
sdakecoolsvap looks good - nice job!18:10
coolsvapsdake, thx!18:10
sdakestill there seems to be an extra cr you added18:10
openstackgerritSwapnil Kulkarni (coolsvap) proposed openstack/kolla: Structuring the documentation  https://review.openstack.org/31690718:10
sdakenot sure if that was intentional18:10
coolsvapsdake, updated the review18:10
sdakecoolsvap looks good :)18:11
*** sbezverk has quit IRC18:13
coolsvaptonight i wanted to get some hands on k8s, not now but tomorrow morning18:13
*** v1k0d3n has joined #openstack-kolla18:14
*** sbezverk has joined #openstack-kolla18:15
sdakev1k0d3n howdy18:18
sdakev1k0d3n did you manage to get that review up for folks to look at?18:18
sdakecoolsvap what are your thoughts on this review https://review.openstack.org/#/c/288936/18:20
patchbotsdake: patch 288936 - kolla - Use debian repos for debian base docker image18:20
coolsvapsdake, i already provided comments if possible merge it with the base customization effort rhallisey is doing18:21
mlimacoolsvap, why you added it? doc/build.tar.gz18:21
v1k0d3nsdake: hey...need help actually.18:22
coolsvapmlima, thx sorry i missed it bad time18:22
*** SiRiuS has quit IRC18:22
sdakeme too18:22
mlima:)18:22
sdakegood catch mlima :)18:22
gmmahav1k0d3n: howdy18:23
gmmahayou still looking to get some help with pushing your patch?18:23
*** shardy has quit IRC18:24
*** daneyon_ has joined #openstack-kolla18:25
openstackgerritSwapnil Kulkarni (coolsvap) proposed openstack/kolla: Structuring the documentation  https://review.openstack.org/31690718:25
coolsvapsdake, back to the review for debian base docker image18:26
coolsvapi think if we are customizing the base image, the efforts can be clubbed rather than one waitng for other to conflict his change18:26
sdakewhich customize base image patch?18:27
coolsvapsdake, https://review.openstack.org/#/c/314614/18:27
patchbotcoolsvap: patch 314614 - kolla - Allow the base container to be more customizable18:27
*** fragatin_ has joined #openstack-kolla18:28
coolsvapand the debian patch is halfway there18:29
coolsvapjust need to move the keys to the build.conf and add some code in build.py18:29
v1k0d3nhey gmmaha18:29
v1k0d3nyeah, can someone just work with me for a minute so i can figure out what i'm doing wrong.18:30
v1k0d3n?18:30
*** daneyon_ has quit IRC18:30
gmmahav1k0d3n: sure..18:31
gmmahacan you tell me what you have right now and what you want to do ?18:31
*** fragatina has quit IRC18:32
*** aNupoisc has joined #openstack-kolla18:35
gmmahav1k0d3n: still around?18:35
* coolsvap will sleep anytime... might not respond...zzzzz18:36
*** coolsvap is now known as coolsvap|zzzzzzz18:36
aNupoiscHi guys. I am executing kolla-ansible deploy command to deploy openstack on few nodes but stuck with heka bootstrap error18:36
aNupoiscError is here http://pastebin.com/jjc5dM9t18:36
sdakeaNupoisc moment18:36
v1k0d3nsure... gmmaha give me a little bit, and i can tell you. caught up atm.18:36
v1k0d3ni definitely want to offload this and get some help though.18:37
*** inc0 has quit IRC18:37
gmmahav1k0d3n: aah ok..18:37
gmmahav1k0d3n: yeah, lets talk and see how we can get you unblocked18:37
sdakeaNupoisc which version of ubuntu are you running?18:37
aNupoisc14.0418:37
aNupoiscserver18:38
sdakeaNupoisc did you make /run shared?18:38
sdakeand which kernel version are you using (uname -a018:39
sdakeuname -a that is18:39
aNupoiscsdake: yes i run make /run shared. Kernel is 4.2.0-35 generic18:41
sdakeaNupoisc i am not super fmailiar with ubuntu but there must be a docker log file i suspect in /var/log/docker or the like18:41
sdakei'd like to know what it says towards the end18:41
sdaketail -50 the file and paste it pls18:41
aNupoiscsdake: ok in a moment18:41
sdakeaNupoisc fwiw someone was runnign into this same problem and he ran cleanup-containers and cleanup-images, rebooted, made /run shared again, and deploy worked18:42
sdakebut i'd like the logs if you can find them18:42
sdakealso dmesg might show something interesting18:43
*** tfukushima has quit IRC18:43
aNupoisclog shows  level=warning msg="container b0586ed9fdbe09263e22c3ce2e8(..) restart canceled"18:45
sdakeaNupoisc run docker ps -a -> paste18:45
sdakeaNupoisc also if you could paste the last 500 lines of the log or so that would help18:46
aNupoiscsdake: whole lot of entried.. here is the paste http://pastebin.com/xfGa5a9E18:46
sdakedoes container b05* have a name associated with it?18:48
sdakein the log18:48
sdakelooks like you ahve a partial deploy on that node already18:48
sdake2 days old18:48
sdakeaNupoisc if deploy failed during bootstrapping, recommend cleanup-containers (which will wipe out your test deploy) and go again18:49
sdakewith a reboot inbetween18:49
sdakeand a new making of /run shared18:49
sdakeaNupoisc not sure what the deal is with that docker error, need to see the raw logs i think18:51
aNupoiscsdake: i will run it again to see the fresh logs18:52
sdakeaNupoisc ok - heads up i have meetingn in 8 minutes18:52
sdakeaNupoisc so if i'm not responsive, thats the reason :)18:52
*** SiRiuS has joined #openstack-kolla18:54
*** v1k0d3n has quit IRC18:54
*** v1k0d3n has joined #openstack-kolla18:55
aNupoiscsdake: the output is same in logs18:55
aNupoisci dont see name for container b05*18:55
sdakecan you apasate the last 500 line sof the log18:55
aNupoiscthere is only one line in the log.. time="2016-05-13T17:18:50.828999830-07:00" level=warning msg="container b05* restart canceled"18:56
aNupoiscsdake: i think i will run cleanup-containers18:56
sdakeaNupoisc i assume you have disabled l ibvirt?19:01
*** salv-orl_ has quit IRC19:07
*** inc0 has joined #openstack-kolla19:07
openstackgerritMauricio Lima proposed openstack/kolla: Manila driver session is needed only in manila-share  https://review.openstack.org/31123219:10
aNupoiscsdake: i did not touch to libvirt it usually starts automatically19:12
aNupoiscsdake: i see libvirtd not installed itself when i run libvirtd --version19:12
d_code_Im’ trying to do PCI passthrough as documented here: https://wiki.openstack.org/wiki/Pci_passthrough...the pci_passthrough_whitelist seems obvious to put in /etc/kolla/nova-compute/nova.conf… and I think the schedule config is straightforward too (nova-scheduler ?)…where does the pci_alias go for the “controller node”19:20
d_code_I thought maybe nova-conductor…but…that didn’t work19:20
d_code_nova-api ?19:20
vhosakotaNupoisc: did prechecks pass for you ?19:22
d_code_and once I make the changes, I can just do `docker restart ${container_id}` ?19:22
d_code_hmmm…that seems to have worked…now I just don’t have any hosts available….  think I need to setup storage19:23
*** fragatin_ has quit IRC19:23
d_code_if anyone has done that, I’d like confirmation that I’m barking up the right tree19:23
*** fragatina has joined #openstack-kolla19:23
aNupoiscvhosakot: yes19:23
*** rbergeron has quit IRC19:28
*** rbergeron has joined #openstack-kolla19:28
sdaked_code_ your breaking new ground :)19:32
d_code_haha…story of my life19:32
sdaked_code_ tell me about it :)19:33
d_code_:)19:33
*** dwalsh has quit IRC19:34
*** sbezverk_ has joined #openstack-kolla19:34
sbezverk_d_code_ why do not you put all required config for pci passthrough in nova.conf and then run reconfigure, all nova components will get info they need..19:35
*** sbezverk has quit IRC19:36
d_code_sbezverk_: in the template ? /usr/share/kolla/ansible/roles/nova/templates/nova.conf.j2 ?19:36
d_code_that _does_ seem like an easy approach…I’ll give it a whirl19:39
sbezverk_d_code_ no, on your deployment host create nova.conf file in /etc/kolla/config19:41
sbezverk_and then run reconfigure19:41
sbezverk_everything should be taken care of for you19:41
*** mlima has quit IRC19:45
*** sbezverk_ has quit IRC19:46
*** sbezverk has joined #openstack-kolla19:46
d_code_hmm….but it needs to have all the things the current template has, right19:51
d_code_the rendered templates19:51
sdaked_code_ no, that ini stuff you put ther egets merged with the defaults19:52
sdakelike magic it works ;)19:52
d_code_I love magic19:52
*** esharao has joined #openstack-kolla19:52
sdakeif you specify something that is already defined it is overridden19:52
sdakeits not all that magical to merge an ini file :)19:52
*** godleon has joined #openstack-kolla19:53
*** mbound has joined #openstack-kolla19:54
sdakedid aNupoisc get operational?19:54
godleonHi everyone, how can I do services rolling update in kolla? Is there any information can let me refer to? many thanks!19:54
sdakegodleon you mean how do you upgrade from one version of openstack to another?19:54
godleonyap, or minor upgrade19:55
sdakelets take an example19:55
sdakeyou are runnign the liberty release of kolla19:56
sdakeyou basically install kolla mitaka19:56
sdakevia pip or tarball19:56
sdakeor distro packaging when that becomes available in the future19:56
sdakeand run a kolla-ansible upgrade19:56
sdakeits that smiple19:56
sdakeif you have your own registry you will also need to build new images19:56
godleonsdake: wow, so all I have to do are rebuild the docker images and execute "kolla-ansible upgrade"?19:57
sdakeyup19:57
sdakenow assume a harder case - z stream to z stream19:57
godleonssake: too simple to believe .....19:57
sdakeso lets take liberty as an example19:57
sdakethis is where it gets a little more complicated19:57
sdakelets assume your docker containers are 1.0.019:57
sdakeand you have a new fix and want to release it as 1.0.119:58
sdakeyou would tag a 1.0.1 release19:58
sdakeand update the config file with "openstack_version: 1.0.1"19:58
sdakeand run kolla-ansible upgrade19:58
sdakeafter building the images of course19:58
sdakeand bam, your running 1.0.1 images19:58
sdakei would recommend not using x.y.z namespace19:58
sdakeinstead, for custom images, i'd recommend x.y.z.a19:58
sdakei.e. 1.0.0.019:58
sdakewhere the a is your version19:58
sdakethat way when upstream releases 1.0.1 you won't get clobberec19:59
sdaked19:59
sdakeand you can easily rebase to 1.0.1 via upgrade19:59
sdakei know its hard to believe it can be one command or editing a config file followed by one command19:59
godleonsdake: where can I find the information abount versions and tags?19:59
sdakebut it really is that simple19:59
sdakeundocumented, but i'll take that up today19:59
sdakethanks for pointing it out19:59
sdakethe kolla developers assume eveyrone knows how all this stuff works ;)20:00
sdakewhich is a terrible default20:00
godleonsdake: But these fancy tools are used by not only kolla developers.20:01
sdakegodleon agree, like i  said terrible default ;)20:01
godleonsdake: of course I hope I could be one in the future. I really love this project.20:01
sdakethat is why i'm going to doucment it20:01
godleon:)20:01
*** inc0 has quit IRC20:01
sdakegodleon compared to other openstack projects kolla is really easy to get into20:01
sdakewe designed the system to have a fast learning curve for operators and developers20:02
sdakeby fast, I mean 4 4 hour blocks of time20:02
sdakewhich in relative terms is fast compared to most deployment management tools :)20:02
godleonsdake: yap, not too many python code. And I know ansible and docker as well, it's really simpler to get into for me.20:03
sbezverkrhallisey ping20:03
rhalliseysbezverk, hey20:03
sbezverkrhallisey how should we deal with config variables which are not know to us at the time of generating configuration for containers?20:04
rhalliseysbezverk, do you have an example?20:05
sbezverkrhallisey we need to somehow hook up kubernetes service discovery20:05
sdakerhallisey can you ack that doc change from coolsvap|zzzzzzz20:05
sbezverkexample glance bind20:07
godleonsdake: many thanks for your answer. :)20:07
sdakerhallisey click +w on https://review.openstack.org/#/c/316907/ ;)20:07
patchbotsdake: patch 316907 - kolla - Structuring the documentation20:07
*** sbezverk_ has joined #openstack-kolla20:10
sbezverk_so we need to somehow start using probably dns name for these services in this case when the container starts up it can discover real ip address.20:10
sdakegodleon if you want to see a demo check out the webinar i did here: https://vimeopro.com/midokura/345kl39220:11
rhalliseysbezverk, so it's either dns or env vars20:11
*** sbezverk has quit IRC20:11
sbezverk_rhallisey env var will not work or at least we cannot realy on them because if by chance keystone start after glance20:12
sbezverk_rhallisey glance will not get env var updated20:12
godleonsdake: you are working in midokura?20:12
rhalliseysbezverk_, but the glance container would end up failing because it would never find keystone20:14
*** dmk0202 has joined #openstack-kolla20:14
rhalliseyin other words restarting20:14
sdakegodleon cisco20:14
sbezverk_rhallisey I think env variable goes by POD and not by container20:15
rhalliseysbezverk_, all the containers in the pod would fail20:15
sbezverk_rhallisey so container can restart as many times as you want but it seems POD controls env variable pushed to container20:15
sbezverk_rhallisey at least that is what I have observed in my test bed.. I needed to kill POD to get env variable in container updated20:16
rhalliseysbezverk_, did all the glance containers fail?20:16
*** salv-orlando has joined #openstack-kolla20:17
sbezverk_rhallisey yes, because I started them without providing config..20:17
rhalliseyweird so that didn't cause the pod to be rescheduled?20:17
sbezverk_rhallisey nope, but mind you cannot guarantee 100% that my cluster is configured for that..20:18
rhalliseysbezverk_, there was a doc I read about this I'll see if I can find it20:18
sbezverk_rhallisey sure, that would be great.. btw why you do not like idea of dns discovery? it looks more solid than env var??20:19
sbezverk_we just stick predefined service names in variables and that is it20:19
jgriffithsbezverk_: ping20:20
rhalliseysbezverk_, that sounds fine to me.  I just want to check the pod behavior20:20
sbezverk_when container starts it will discover20:20
rhalliseybecause it wasn't what I expected20:20
sbezverk_rhallisey ok, please let me know when you find that doc I will test it..20:20
openstackgerritMerged openstack/kolla: Structuring the documentation  https://review.openstack.org/31690720:22
sbezverk_jgriffith pong,20:26
jgriffithsbezverk_: hey, working up a system to test your iscsi patches20:27
jgriffithsbezverk_: I had some questions I was hoping to be able to ask you?20:27
esharaohi.. when im trying to setup the vagrant env - i get the error -  No such file or directory - python newest_dhcp_lease.py operator (Errno::ENOENT)20:27
jgriffithsbezverk_: I wanted to get a run down on how the iscsi container works20:27
esharaoany idea whats missing?20:27
jgriffithand how the compute node container interacts with it20:27
sbezverk_jgriffith sure thing, I tested even multinode20:28
jgriffithsbezverk_: yeah, then hit the glance problem :(20:28
rhalliseysbezverk_, ah20:28
rhalliseysbezverk_, ya we need a replication controller around the pods20:28
sbezverk_jgriffith are we going to do a talk for Barcelona ;-) ??20:28
rhalliseysbezverk_, pods are only create and destroyed by hand20:29
rhalliseyhttp://kubernetes.io/docs/user-guide/pod-states/20:29
jgriffithsbezverk_: yes!  We're at least going to submit assuming you're still interested20:29
sbezverk_rhallisey make sense since it monitor life of pod/container20:29
sbezverk_jgriffith absolutely20:30
*** sean-k-m1 has left #openstack-kolla20:30
jgriffithsbezverk_: cool20:30
rhalliseyya one step to many there20:30
jgriffithso first I need to understand how this works :)20:30
jgriffithI have an iscsi container and a nova-compute container20:30
sbezverk_jgriffith what do you say if we setup a webex and chat live it is much easier20:30
jgriffithsbezverk_: that would be perfect20:30
jgriffithwhen works for you?20:31
*** sean-k-mooney has joined #openstack-kolla20:31
sbezverk_jgriffith I booked up for next two days needs to pass dman re-certification exam, but starting Wednesday afternoon I am opened..20:31
jgriffithsbezverk_: let's plan for Wed afternoon then?20:32
jgriffithI'm open after 1:00 Mountain time20:32
sbezverk_jgriffith works for me20:33
sean-k-mooneyhi. sdake or any of the other cores about?20:33
sdakesean-k-mooney greetings20:33
jgriffithsbezverk_: great, I'll send you an invite20:33
sean-k-mooneyhow is everyone.20:33
sbezverk_jgriffith sounds like a plan!20:33
sean-k-mooneysdake: i wanted to ask a question regardign new feature. basicaly when should i open a spec vs blueprint vs RFE bug20:34
sean-k-mooneysdake: you indicate before that kolla rarely uses spec unless its a large chage correct20:35
*** sdake has quit IRC20:37
*** sdake has joined #openstack-kolla20:37
sdakesean-k-mooney hey just relogged20:38
sdakesean-k-mooney the reaosn we use specs is to generate lots of comments and help hone a direction for something controversial20:38
sdakeor that requires significant community involvement to get the job done20:38
sdakesean-k-mooney no offense, but nobody thinks bifrost is controversial :)20:38
sean-k-mooneyactully that is not why i was asking20:39
d_code_sdake: I put the options for PCI passthrough in /etc/kolla/nova.conf on the deployment host, and ran kolla-ansible reconfigure, but it didn’t merge my settings in the [DEFAULT] section as expected20:39
d_code_is the file in the right spot?20:39
sdake /etc/kolla/config/nova.conf20:39
d_code_bah20:39
sdakeso, no ;)20:39
d_code_lol20:39
sean-k-mooneythere are 4-5 items i would like to contibute to kolla this cycle and was wondering if  i should open blueprints/specs for them20:39
sdakebllueprints should work for most anything20:40
sbezverk_rhallisey just one more thought about env variables. I have never see env variables used in openstack service's config files. Are you 100% sure that if I use BIND=$ENV_VAR it will be correctly parsed by OpenStack process?20:40
sdakethe only spec  i htink we have htis cycle is kubernetes20:40
d_code_thanks20:40
sdakewhich is not controversial but falls into the second category of requiring broad community engagement20:40
sean-k-mooneysdake: thanks that was what i was leaning toworads but it does not hurt to ask before i open them.20:41
sdakeI also talked to the ironic folks20:41
sdakethey don't use specs in bifrost at all20:41
rhalliseysbezverk_, http://kubernetes.io/docs/user-guide/services/#environment-variables20:41
sdakea blueprint should do there20:41
sdakealong with a review for people to start looking at20:42
sdakeat this point we are just guessing at what the Ironic community will want re bifrost changes20:42
sean-k-mooneyok so on the topic of biforst i will open a blueprint in kolla and bifrost for that item20:42
sdakeso best to get their involvement early on in the review rpocess20:42
aNupoiscsdake: hey just came back from lunch20:43
sdakerather then spend a bunch o time working on an implementation that they dont liek20:43
sean-k-mooneysdake:  yep i plan to reach out to them later this week as to what is the best way to move forward on ther side.20:44
*** rmart04 has joined #openstack-kolla20:44
sean-k-mooneysdake: the other 4 items that i had on my list were as follow , hugepage support, ovs with dpdk, opendaylight and the install deps playbook.20:44
*** rmart04 has quit IRC20:46
cineramahi folks20:46
sean-k-mooneyi was going to open a blueprint for each before i do any work on them. does that sound ok to you. we may need some discussion on each but i think each are small enough not to need a spec20:46
mark-caseyhi cinerama20:46
sean-k-mooneyhi cinerama20:46
cineramasean-k-mooney, feel free to go ahead and submit your change for review in bifrost - you can always note it's WIP if appropriate20:47
cineramawe do use blueprints also20:47
sean-k-mooneyok i will clean it up and submit it with WIP in the commit message later this week20:48
v1k0d3ngmmaha: ok...can you talk me through some of this?20:48
aNupoiscsdake: i have cleaned up containers and doing the setup again20:48
v1k0d3nsorry that took so long. this day completely ran away from me.20:48
sean-k-mooneycinerama: do the bifrost devs usually hang out in the ironic channel or is there a seperate irc for bifrost?20:48
gmmahav1k0d3n: for sure20:50
gmmahav1k0d3n: totally understand. have had those days.20:50
*** CIA has quit IRC20:51
*** inc0 has joined #openstack-kolla20:51
cineramasean-k-mooney, we are usually on the ironic channel20:51
v1k0d3ngmmaha: can we do this over my att connect session (same as webex).20:52
v1k0d3n?20:52
gmmahav1k0d3n: i believe so.20:52
gmmahaas long as i dont have to install clients on my windows box, i am fine with it ;)20:52
*** jefuz has joined #openstack-kolla20:53
sean-k-mooneycinerama: cool ill pop by the ironic channel too after i have submitted the patch for review.20:54
openstackgerritSteven Dake proposed openstack/kolla: Document upgrading for operators  https://review.openstack.org/31708420:54
v1k0d3ngmmaha: i think there's a web session that would work...20:55
gmmahav1k0d3n: alright.. lets do it then20:55
sdakesean-k-mooney cool, so all those sound good although I have no idea what dpdk is :)20:55
gmmahai got 50 minutes before i will have to run out20:55
sean-k-mooneycinerama: im currently thinking of spliting it into 3 commits (sed change, introduce new vairble to control dib install and the change to decompies the playbook into 3 phase)20:56
v1k0d3nlet me pull to the latest and get my client ready...20:56
sdakesean-k-mooney the typical workflow is to open all blueprints - after which I put them in discussion phase for people to comment on20:56
sdakesean-k-mooney if you land code before discussion is done, they are typically approved20:56
sdakeunless it is something that nobody really wants20:57
sean-k-mooneycinerama:  would you further like me to split the last commit into 3 one for each phase. i can do that after the initall review also based on feedback20:57
sdakesean-k-mooney with the intel guys I'd recommend using google hangouts - client free20:57
sdakerather v1k0d3n re intel guys i'd recommend using google hangouts - client free20:57
sdakev1k0d3n their security dudes dont like chatting tools installed :)20:58
gmmahasdake: :D20:58
* gmmaha agrees with sdake 20:58
gmmahasdake: also msot of us at intel only get windows boxes.. and they tend to be "*flaky*"20:58
sean-k-mooneysdake: cool ill write up the blueprints for them this week20:58
sdakesean-k-mooney fantastic20:59
sdake;)20:59
*** daneyon_ has joined #openstack-kolla20:59
sean-k-mooneyintel can usually use any tools for comes with external parties20:59
cineramasean-k-mooney: you can do a series of dependent patches if you like, or split it. would be good if you make the topic the same for all the related changes if you break it up20:59
sean-k-mooneyi have used hangouts, bluejeans and lync in the past. we tend to use lync/skype for buisness internally but we are free to use others if its convient21:00
sdakegodleon check out the patch here: https://review.openstack.org/31708421:00
sdakesean-k-mooney i think every group is a little different ;)21:01
gmmahasean-k-mooney: Just realized you are with Intel.. howdy. I believe we were sitting right next to each other in the kolla-bifrost meeting21:01
sdakesean-k-mooney sorry to cuase confusion, that mesage was meant for v1k0d3n and gmmaha21:01
sean-k-mooneycinerama:  yes i will make a seires of depent patchs and then make the kolla on depnet on the top of the patch chain21:02
sean-k-mooneysdake: yes i realised. but just taught i would let ye know my experience. there is a differnce between what we are allowed to use and what it will support21:03
sdakei just got an add for 5x faster internet for 34.9021:04
sdakeI'd love to have 5gigabit internet21:04
sdake;)21:04
sean-k-mooneysdake: we are generally allowed to use tools such as hangouts but it will not support them if there is an issue.21:04
*** daneyon_ has quit IRC21:04
sdakesean-k-mooney roger21:04
sean-k-mooneysdake: nice are you on google fiber?21:04
sean-k-mooneygmmaha: hi yes we had not met before the summit. what part of intel are you in?21:05
gmmahasean-k-mooney: I am with SSG OTC group.. work with malini21:06
gmmahaare you from shannon?21:06
sean-k-mooneyah ok cool. im in npg working with haidee so yes im based out of shannon21:06
gmmahaaah cool..21:07
sdakesean-k-mooney cox gige21:08
v1k0d3ngmmaha: sent you the link in a direct message21:10
cineramasean-k-mooney: sounds good. oh also if you could create a release notes entry for your change that'd be great but don't let that stop you from putting up your progress so we can test etc21:10
gmmahav1k0d3n: yup.. getting into it21:10
sean-k-mooneysdake: we lowly mortals in shannon have to live with only 70mbps down and 20 up we should be getting upgraded in the next 12 months though to gigabit when it rolls out21:10
*** jtriley_ has joined #openstack-kolla21:11
*** haplo37 has quit IRC21:11
sdakei just got gige in dec21:11
sdakeof last year21:11
sdakeiirc21:11
sdakedunno can't remember anything ;)21:11
sean-k-mooneycinerama: sure yes i should do that on both side actully. do ye use reno?21:11
sean-k-mooneysdake: with gigabit broadband i pratically faster to ask google then rember anyway so no worries :)21:12
*** rhallisey has quit IRC21:13
*** jtriley has quit IRC21:13
*** jtriley_ has quit IRC21:16
cineramasean-k-mooney: we do use reno21:20
sdakesean-k-mooney kolla as well21:20
sdakei think most projectso nreno now21:20
sdakeits literally a 1 hour job at most to add support21:20
sdakehttps://launchpad.net/kolla/+milestone/newton-121:21
sdakegroan 214 bugs21:21
sean-k-mooneysdake: i should add reno support to networking-ovs-dpdk at some point. we currently dont really have release notes for our releases which i should probably fix21:24
sdakeits super easy21:24
sdakewow its loud in my office21:25
sean-k-mooneysdake: looks like there are about 70 still to start for n1.  4 New, 4 Incomplete, 8 Invalid, 33 Confirmed, 27 Triaged, 28 In Progress, 3 Fix Committed, 107 Fix Released21:29
sdakesean-k-mooney yup we have a boatload of bugs - and not all are accounted for21:29
sdakei have basically been on pto for 2 weeks ;)21:29
*** SiRiuS has quit IRC21:31
sean-k-mooneysdake: a few of the bugs for n1 are assign to people on my team so i will check the status each with them and ask them to update in launchpad.21:37
sean-k-mooneysdake: this one to support installing ovs form source https://bugs.launchpad.net/kolla/+bug/1538142 can be closed i will submit a blueprint in the future if a need arises but currently distros are shiping the ovs version i need21:40
openstackLaunchpad bug 1538142 in kolla "Support installing openvswitch from source" [Wishlist,In progress] - Assigned to sean mooney (sean-k-mooney)21:40
*** sean-k-mooney has quit IRC21:44
*** dmk0202 has quit IRC22:10
*** salv-orl_ has joined #openstack-kolla22:14
*** salv-orlando has quit IRC22:18
*** esharao has quit IRC22:18
*** Avi82 has quit IRC22:19
sbezverk_sdake ping22:20
*** signed8bit is now known as signed8bit_Zzz22:24
*** inc0 has quit IRC22:25
sdakesbezverk_ shoot22:25
sbezverk_sdake rhallisey and I chatted a bit ago and as a result I registered new BP22:26
sbezverk_https://blueprints.launchpad.net/kolla/+spec/kubernetes-service-discovery22:26
sbezverk_sdake so you are aware.. I will add content in the next few days but the idea should be visible from the summary22:27
sdakesbezverk_ we have a separate launchpad for kolla-kubernetess22:28
*** vhosakot has quit IRC22:30
sbezverk_sdake sorry did not know.. should i kill this one and re-create?22:30
*** thumpba has quit IRC22:30
sdakeyup22:31
sbezverk_sdake ok22:34
sdakev1k0d3n pingola22:34
*** mark-casey has quit IRC22:35
sbezverk_sdake is it the one (kolla-kubernetes) registered by Michael Schmidt?22:36
*** thumpba has joined #openstack-kolla22:38
sdakeyup22:42
v1k0d3nsdake: still here?22:43
v1k0d3nsorry stepped away.22:43
sdakeyup22:43
sdakewaitingfor you in webex;)22:43
v1k0d3nlol i guess i need to refresh my browser then.22:43
sdakecisco.webex.com/join/stdake22:43
*** daneyon_ has joined #openstack-kolla22:47
*** signed8bit_Zzz is now known as signed8bit22:51
*** daneyon_ has quit IRC22:52
*** signed8bit has quit IRC22:55
openstackgerritBrandon B. Jozsa proposed openstack/kolla: add bootstrap_horizon ansible tasks and dockerfile  https://review.openstack.org/31712422:55
*** asalkeld has quit IRC22:56
*** ccesario_ has joined #openstack-kolla22:57
sdakehttps://review.openstack.org/#/admin/groups/460,members22:58
*** signed8bit has joined #openstack-kolla22:59
*** weiyu has joined #openstack-kolla23:03
aNupoiscsdake: after cleaning up when i execute kolla-ansible prechecks one node is failing the test of "Check free port for MariaDB"23:05
aNupoiscsdake: and if I log in to that node i can see mysqld running on the port 3306 that MariaDB is looking for23:06
aNupoiscsdake: shall I just kill the process of mysql? I am just wondering if that application will be used sometime later?23:06
sdakeare you running mysql on your host?23:07
sdakei thought you cleaned up23:07
aNupoisci am checking for the port on target node. As i am running precheck on target node23:07
aNupoiscsdake: on host kolla-ansible prechecks works perfectly fine23:08
sdakeis mysql running on the target node in a container or on the host?23:10
sdakeyou ahve to run the cleanup script on all nodes in the cluster23:10
sdakeunfortunately that is not ansibleized23:10
sdakedont forget to reboot them and remount /run as shared23:10
sdakeand restart docker after the remount of /run23:11
harlowjaqq, how much is kube required for kolla (so far)23:11
sdakethere is probably some rc file you can put it in for ubuntian23:11
aNupoiscmysql is not running on host23:11
sdakeharlowja not at all23:11
harlowjak, phew23:11
sdakeharlowja its an optional method of deployment just starting development23:11
harlowjak23:11
sdakeits actually a separaate repo and will remain such23:11
aNupoiscsdake: shall i reboot all the nodes in cluster or just host?23:12
sdakeall nodes23:12
aNupoiscokay23:13
sdakeaNupoisc we should automate that cleanup huh? :)23:13
sdakehopefully we will see that in newton codebase23:13
aNupoiscyeah23:13
aNupoiscthat would be easy.23:13
aNupoisc:)23:13
aNupoiscsdake: okay i will reboot and see again23:14
aNupoiscbut it is giving me this on only one node all others don't have mysql23:14
*** mbound has quit IRC23:14
aNupoiscsdake: so I was wondering if I directly kill that application23:14
aNupoiscsdake: will it affect anything. It is not on host23:15
*** weiyu has quit IRC23:16
gmmahav1k0d3n: any luck getting past that issue?23:19
harlowjasdake where's the best place to see how compute nodes are managed, upgraded and all that (these being the most complex i can think of)23:21
sdakeharlowja you mean like documentation?23:22
harlowjaperhaps, ha23:22
sdakeor like code?23:22
harlowjalet's go with say the workflow, maybe in english :-P23:22
sdakewe don't document how compute is deployed or upgraded except for code23:22
harlowja:(23:22
sdakeits probably easie rto look at the playbook for compute node tbh23:22
harlowjak23:23
aNupoiscsdake: do we need mysql?23:23
sdakeharlowja https://github.com/openstack/kolla/tree/master/ansible/roles/nova/tasks23:23
sdakeaNupoisc you can kill it if you dont need it - I'm not sure why its there23:23
sdakeaNupoisc if it was already running on the host, that host may need it  for some reason23:23
sdakeif its ina  container, you can run cleanup-containers and get the job done23:23
harlowjathx23:24
sdakeharlowja her eis the deploy entry point23:24
sdakehttps://github.com/openstack/kolla/blob/master/ansible/roles/nova/tasks/deploy.yml23:24
sdakehere is the upgrade entry point:23:24
sdakehttps://github.com/openstack/kolla/blob/master/ansible/roles/nova/tasks/upgrade.yml23:24
sdakenote your looking at the single hardest service ever containerized23:24
harlowjathat's the goal :-P23:25
sdakeso keep that in mind - everything else is 5-10x simpler in comparison23:25
sdakehere is the reconfigure entrypoint: https://github.com/openstack/kolla/blob/master/ansible/roles/nova/tasks/reconfigure.yml23:25
sdakethat stuff runs in order23:26
harlowjacools23:26
sdakeyou can read the name of each task to get an idea of what is going on23:26
harlowjayup yup23:26
sdakewhat happens with kolla is deploy is called for all roles23:26
sdakeor reconfigure or upgrade23:26
*** signed8bit is now known as signed8bit_Zzz23:26
harlowjaya, i need to try it23:26
sdakethere are a few other general operations as well23:26
sdakeya try it, you will like it23:27
sdakeI recommend starting small with AIO23:27
*** weiyu_ has joined #openstack-kolla23:27
sdakelowest barrier23:27
harlowjacan i easily target some existing openstack VMs for it?23:27
sdakeyou can also deploy straight from docker hub23:27
sdakeharlowja do you mean use openstack vms to run kolla on?23:27
sdakeyes that should work - if the infrastructure supports multicast23:27
sdakekeepalived, which we use, depends on multicast23:27
sdakeshould/does23:28
sdakei've done it myself23:28
sdakesbezverk_ runs inside vms all the time23:28
harlowjawell run from my laptop, tell kolla ansible stuff to deploy to openstack vms that i give it23:28
sdakebut not openstack23:28
harlowjak23:28
harlowjai'll give it a shot23:28
sdakeyup that should work, depending on multicast23:28
harlowjak23:28
sdakei'd do aio, then you wont run into the multicast issue23:28
harlowjak23:28
sdakea fellow today was complaining about multicast i believe running on top of fuel23:28
*** godleon has quit IRC23:29
sdakebut we didn't get to the root cause of his problem23:29
harlowjai didn't think people recommended multicast anymore23:29
sdakebut i'm pretty sure its multicast23:29
sdakeno multicast is evil23:29
sdakei think we need to somehow get keepalived to use unicast23:29
sdakei am not a keepalived expert23:29
harlowjakeepalived sounds like something etcd or similar can just do23:29
*** diogogmt has quit IRC23:29
sdakei have worked on totem, which was a multicast protocol for about 6 years23:29
sdakeit was very painful, the poor switch support23:30
sdakenow ipv6 is all based on multicast23:30
sdakeso most gear has rocking multicast support now23:30
sdakebut 6 years ago this was not the case23:30
sdakeharlowja keepalived assigns a VIP to a machine23:30
sdakeharlowja it uses keepalived for healthchecking the connectivity23:31
sdakeso etcd could possibly work for that I guess, but would require custom code23:31
sdakewe wanted to use as much cots stuff as we could23:31
sdakeso as those ecosystems grow, kolla grows with them23:31
harlowjacots?23:32
sdakekolla = glue in greek - which is pretty much what it is, it glues a bunch of stuff together23:32
sdakecommon of the shelf stuff ;)23:32
sdakeof/off23:32
harlowjaya, fair enough, glue ontop of glue ontop of glue, lol23:32
harlowjaglue all the way down23:32
sdakeits not quite like that ;)23:32
sdakethere are no universe ending paradoxes in kolla :)23:33
harlowjaare u sure?23:33
sdakeyup23:33
sdakeits very simple and striaghtforward23:33
sdakethe only thing that bugs me is the usage of one of our dependencies related to ha of mariadb23:33
sdakecalled percona-xtradb23:33
sdakei dont know what it is, I dont know why we need it, and I'd like it removed23:34
sdakebut I don't know how without breaking things :)23:34
harlowjaIol, ya23:34
aNupoiscsdake: prechecks worked perfectly fine.. :)23:34
sdakeaNupoisc cool23:34
sdakeharlowja everything else is one layer of software on top of one layer of bare metal23:34
sdakeso pretty much, two layers23:34
sdakeone deploys, one is the deployment23:34
sdakekolla on top of ansible on top of baremetal23:35
sdakeopenstack on top of nova on top of mariadb/rabbitmq on  top of bare metal23:35
sdakeI guess that is 323:35
harlowja:-P23:35
sdakeanyway its as simple as it gets23:35
harlowjaif we have an existing DB ?23:35
harlowjaguess the existing stuff is gonna be ummm, interesting23:35
sdakethat is a bit more complex23:35
sdakei dont know anyone that has done a brownfield of kolla23:36
sdakeits feasible and possible23:36
sdakei'd sort out how it works in greenfield first and figure out if its a fit for you23:36
aNupoiscsdake: the deploy process is still halting at starting heka bootstrap23:36
sdakeaNupoisc you did mount run on each node23:36
sdakeaNupoisc and restart docker daemon?23:36
* sdake shakes fists at ubuntu 14.0423:37
aNupoiscyes i had done it before prechecks23:37
aNupoiscsdake: i have a script made to mount run on each node and restart docker on each node23:38
* sdake double shakes fists at ubuntu 14.0423:39
sdakedid you build your own images?23:39
aNupoiscsdake: what do you mean?23:40
*** weiyu_ has quit IRC23:41
aNupoiscsdake: do i need to run kolla build on each node23:42
aNupoisc?23:42
sdakeno only one node23:42
sdaketo one registry23:42
sdakei am just curious if you built your own or are using docker hub images23:42
aNupoiscsdake: no no23:42
aNupoiscsdake: the error is some INternalAPI error23:43
aNupoiscAPIError(HTTPError(u'500 Server Error: Internal Server Error for url: http+docker://localunixsocket/v1.22/images/create?tag=2.0.0&fromImage=172.16.2.2%323:44
aNupoisc172.16.2.2. is my host where registry is present and listens on 400023:44
sdakeoh i remember wher ewe were with your setup23:45
aNupoiscsdake: does this means nodes are unable to ping to 172.16.2.2 where registry is presnt23:45
sdakeyou had a registry on 172 and something else on 19223:45
aNupoiscsdake: nothing on 19223:45
sdakeaNupoisc what platform are you on for desktop, mac or windows or linux?23:45
sdakeaNupoisc we could use webex and you could screen share - woudl speed up the process of debug23:46
aNupoiscsdake: linux ubuntu server 14.0423:46
sdakewebex doesn't run on linux - bummer23:46
aNupoiscsdake: is there some other software23:46
aNupoisci will look for23:46
aNupoiscit23:47
*** godleon has joined #openstack-kolla23:49
godleonsdake: thanks for your information. :)23:50
aNupoiscsdake: do you use skype? (lync software)23:50
sdakeaNupoisc are you on google - we can use google chat tool23:54
sdakeit has screen sharing23:54
aNupoiscyes i will login23:54
sdakeaNupoisc my wife is traveling atm - so i have to jet in about 3-45 minutes to feed the spawn23:54
aNupoisci am here till late23:55
sdakeaNupoisc cool well lets put in a little time now23:55
aNupoiscare you going to be avail later23:55
sdakeand then after dinner i'll be around i'm sure23:56
aNupoiscsdake: i am on google23:56
aNupoiscanupnavare@gmail.com23:57
sdakedo you know how to start one of these things up23:58
sdakesteven.dake@gmail.com23:58
sdakeaNupoisc i sent you an invite23:59
sdakeso if you open up your little quotes thing in gmail23:59
sdakeit should be there23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!