Wednesday, 2016-08-31

*** v1k0d3n has joined #openstack-kolla00:01
*** jeh has quit IRC00:02
*** jeh has joined #openstack-kolla00:06
*** jeh has quit IRC00:06
*** jeh has joined #openstack-kolla00:06
*** zhurong has quit IRC00:06
*** mtaylor22 has joined #openstack-kolla00:06
openstackgerritLi Yingjun proposed openstack/kolla: Add option to support dhcp/l3 agent ha  https://review.openstack.org/35218000:10
*** gfhellma has quit IRC00:11
*** sdake has joined #openstack-kolla00:16
openstackgerritLi Yingjun proposed openstack/kolla: Add option ceilometer_database_type for ceilometer  https://review.openstack.org/34588100:17
*** v1k0d3n has quit IRC00:19
*** sdake has quit IRC00:21
*** v1k0d3n has joined #openstack-kolla00:22
*** sdake has joined #openstack-kolla00:25
sdakeDaviey around?00:27
sdakeanyone know how many mons we were running in our tesst scenrio00:27
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: WIP Add Cinder API/Backup/Scheduler components  https://review.openstack.org/36304400:29
*** duonghq has joined #openstack-kolla00:42
*** xwang has quit IRC00:45
*** v1k0d3n has quit IRC00:46
*** v1k0d3n has joined #openstack-kolla00:48
*** banix has joined #openstack-kolla00:51
*** caowei has joined #openstack-kolla00:52
duonghqmorning00:55
*** zhubingbing has joined #openstack-kolla00:56
*** salv-orlando has joined #openstack-kolla01:03
*** phuongnh has joined #openstack-kolla01:04
*** v1k0d3n has quit IRC01:04
*** v1k0d3n has joined #openstack-kolla01:07
openstackgerritDuong Ha-Quang proposed openstack/kolla: Add ansible raw task note, add apt-get update  https://review.openstack.org/36257901:10
*** salv-orlando has quit IRC01:11
*** zhiwei has joined #openstack-kolla01:12
*** salv-orlando has joined #openstack-kolla01:13
*** zhurong has joined #openstack-kolla01:13
zhubingbinghello01:17
*** salv-orlando has quit IRC01:17
*** aNupoisc has joined #openstack-kolla01:21
*** huikang has joined #openstack-kolla01:22
*** david-lyle_ has joined #openstack-kolla01:23
*** fguillot has quit IRC01:27
*** fguillot has joined #openstack-kolla01:30
*** zhubingbing has quit IRC01:35
*** yuanying has quit IRC01:45
*** yuanying has joined #openstack-kolla01:46
*** zhubingbing has joined #openstack-kolla01:49
duonghqsdake: have you done with OSIC?01:51
sdakeyup01:51
*** zhurong_ has joined #openstack-kolla02:00
duonghqsdake: can you take a glance at this bp implement: https://blueprints.launchpad.net/kolla/+spec/ansible-specific-task-become02:00
sdakeduonghq tbh - I am feeling a little troubled by all the late submisssions to the code base02:01
sdakeduonghq i'd sort of like to wait until after newton t omerge that02:01
sdakeespecially on a change like that - i thought it would be fairly straightforward a coupel weeks ago02:01
duonghqsdake: roger02:01
sdakebut it has not been tested or reviewed enough from my pov for a major architectural change02:02
*** aNupoisc has quit IRC02:02
*** zhurong has quit IRC02:02
sdakeafter we branch - seems good to me to have this kind of  functionality02:02
duonghqnot really much change here, but agree with you02:02
duonghqtoo tight schedule for this kind of change02:02
sdakeya but atleawst the work is not wasted - it will ust go into next cycle02:03
duonghqbut after other review, I wish that you can take a brief look at my work, I need some comment about my direction02:03
*** mtaylor22 has quit IRC02:03
*** mtaylor22 has joined #openstack-kolla02:04
sdakewill do02:06
duonghqthank you, sdake02:07
sdakewell duonghq i've got to the first become patch02:13
sdakeand my brain is not cooperating02:13
sdaketoo tired02:13
sdakecan I have a look tomorrow instead?02:13
duonghqit's up too you02:13
duonghqthank you very much02:13
*** unicell has quit IRC02:13
*** sdake has quit IRC02:16
*** sdake has joined #openstack-kolla02:17
*** huikang has quit IRC02:17
*** huikang has joined #openstack-kolla02:18
*** diogogmt has quit IRC02:19
*** huikang has quit IRC02:22
*** celo_r has joined #openstack-kolla02:28
*** fguillot has quit IRC02:30
*** daneyon has joined #openstack-kolla02:30
*** celo_r has quit IRC02:30
*** david-lyle_ has quit IRC02:31
*** daneyon has quit IRC02:35
*** Jeffrey4l_ has joined #openstack-kolla02:38
duonghqsdake: can you change the milestone target of my bp? due to the work is defered to next cycle02:42
sdakeduonghq yup but dont give up on it02:45
sdakek? :)02:45
duonghqok, I will follow this bp until it's finished02:45
*** huikang has joined #openstack-kolla02:53
*** huikang has quit IRC02:55
*** v1k0d3n has quit IRC02:56
*** banix has quit IRC02:57
*** kbaegis has quit IRC03:05
duonghqsdake: as I understand, the baremetal role is one of a newton feature?03:11
sdakeduonghq roger03:12
sdakeduonghq i you want t o shift focus to that or a couple weeks wfm ;)03:12
sdakethat is our #1 most important deliverable03:12
sdakei you/if you03:13
sdakethird party blueprints is #203:13
sdakeplugins rather03:13
* sdake brain cooked03:13
duonghqI think next cycle we need factor out some of sean-k-moony's work to more general role, it's really valuable work03:13
sdakeyup it needs more work03:14
sdakebut its a really good starting place03:14
sdakei'd like to see the tig stack working as well03:14
duonghqI'm sorry but what is "tig stack"03:15
sdakewe have until the 15th to choose our features wisely we intend to keep in the release for newton03:15
sdaketelegraph, influxdb, grafana03:15
sdakemewald working on it03:15
zhubingbinghi sdake03:15
zhubingbingi have a probleme03:15
zhubingbingping03:16
zhubingbingping sdake03:16
duonghqinteresting stack, but what is it for? or just prepare for other feature?03:16
*** salv-orlando has joined #openstack-kolla03:17
zhubingbingAodh log need to add to Heke?03:17
sdakeduonghq its to present performance metrics of the system03:18
duonghqfor central logging facility?03:18
sdakeduonghq - it doesn't integrate with elasticsearch03:19
duonghqgiven that influxdb dropped open-source official support for distribute deployment (iirc), I don't really like it. But it's still good time-series db03:20
sdakeinstead telegraph integrates with influxb03:20
sdakeduonghq mind gonig into more detail there03:20
sdakeyou mean influxdb has no ha?03:21
duonghqsdake: give me few second, looking for the annoucement03:22
duonghqbut I don't mean no HA, just no distributed03:22
sdakewhat is distributed deployment03:23
duonghqah, my fault, no clustering03:23
sdakeya clustering typically means ha03:23
duonghqha, lb, etc...03:23
duonghqthe duty is pushed to community03:24
*** salv-orlando has quit IRC03:24
duonghq#link https://docs.influxdata.com/influxdb/v0.13/concepts/clusters/03:24
*** huikang has joined #openstack-kolla03:26
zhubingbingping hiking03:26
zhubingbingping huikang03:26
huikangHi03:26
huikangzhubingbing03:26
* sdake angered03:27
*** ayoung has quit IRC03:27
openstackgerritDuong Ha-Quang proposed openstack/kolla: Add Ansible become to quick start guide  https://review.openstack.org/35837403:29
zhubingbingI want to talk to you about etcd.03:29
duonghqsdake: the original HA feature is fork at https://github.com/influxdata/influxdb-relay but there is no much attention here.03:30
*** diogogmt has joined #openstack-kolla03:44
sdakeduonghq that is no beuno03:44
duonghqsdake: it seems that checking if user has access to docker daemon is complicate03:50
sdakeduonghq ya - docker version and parsing output is viable03:50
sdakecould bindmount /run and check the socket file directly03:51
duonghqsdake: so, we can only know if user can connect to docker but not know the real reason,03:51
sdakethat is what docker versoin does03:51
duonghqsdake: the dockerd has option to run docker at other sock03:51
duonghq*socket03:51
sdakeduonghq yup - another option is to mount /proc in the container from the host and parse it looking for dockerd03:52
*** v1k0d3n has joined #openstack-kolla03:52
sdakea third failure scenario - tls is enabled03:52
sdakeunfortunately error reporting in ansible is terrible03:52
duonghqmany edge case here03:52
sdakeit either works or doesn't work - no rationale given as to why :(03:52
duonghqand, currently, we only support connect to docker at default sock @ localhost03:53
openstackgerritzhubingbing proposed openstack/kolla: Add aodh role  https://review.openstack.org/35102703:54
openstackgerritMd Nadeem proposed openstack/kolla: Added Ansible playbook for congress deploy  https://review.openstack.org/35062903:55
duonghqsdake: I think it is rationale to check default socker due to it is only support configuration in Kolla right now03:58
duonghq*socket03:58
*** zhubingbing has quit IRC03:58
sdakehave hard time seing someone configure the socket location differently then the default in a kolla deployment03:58
sdakemachines willbe purupose built for the job03:58
sdake(of running openstack)03:58
duonghqsadly but I do not have much experience with deploy docker03:59
duonghq(in production)04:00
sdakeya - i think not checking seems fine personaly04:00
sdakenotssure hwy that is in that patch set - seems orthogonal to the problem your tryign to solve04:00
duonghqyup, just a try to clarify fail reason for user04:01
sdakeshould probably be a precheck rathe then a runtime check04:01
duonghqI think the 'docker version' in precheck is acceptable for now04:01
duonghqyeah, I do the user check in precheck stage04:02
sdakecool04:02
duonghqI already here but I have trouble when see it first time04:02
duonghqfor user familiar with docker, it's not surprise, of course04:03
duonghqI'll save the user check of later decision04:04
duonghq*for04:05
*** huikang has quit IRC04:08
*** dave-mccowan has quit IRC04:11
*** pbourke has quit IRC04:17
*** pbourke has joined #openstack-kolla04:17
sdakehey pbourke04:25
sdakepbourke - quick q if you dont mind04:25
sdakepbourke do you have any idea how many mons were running in our test sceanrios04:25
sdakeor Jeffrey4l_ ?04:25
*** salv-orlando has joined #openstack-kolla04:27
*** salv-orlando has quit IRC04:32
*** yuanying has quit IRC04:34
*** yuanying has joined #openstack-kolla04:34
britthousersdake if you have the inventory file04:36
britthousersee which nodes were set has ceph-mon ?04:36
*** coolsvap_ has joined #openstack-kolla04:36
sdakesup coolsvap_04:37
sdakebritthouser i do - there were 20 storage nodes04:37
sdakei think there is multile ceph mons deplyed pernode hto04:37
sdakebut not sure04:37
coolsvap_sdake: hi04:37
britthouserSo with ceph there is one OSD process per drive that you alloate to Ceph04:37
britthouserBut it looks like from ansible/inventory/multinode04:37
britthouserthat ceph-mon runs on control node04:37
*** senk has joined #openstack-kolla04:38
britthouser[ceph-mon:children]04:38
britthousercontrol04:38
britthouserwhich is pretty standard04:38
britthousery ou don't typically run mon and OSDs on same node04:38
britthouserso if you had 5 controllers, then you had 5 ons04:38
britthousermons04:38
sdakesorry i meant osds04:38
openstackgerritMatthew Taylor proposed openstack/kolla: Fix nova_ssh container shell to allow instance resizes.  https://review.openstack.org/36189104:38
britthouserDoes that answer your question?04:39
sdakeya 20*16 osds then04:39
britthousercorrect04:39
britthouserMON process typically needs same quorum requirements as galera and other processes on control nodes04:39
britthouserso it make sense to place them there04:39
britthouseri.e. need an odd number04:39
mtaylor22heh04:40
britthouserand on that bombshell, I'm headed to bed. =)04:44
sdakemtaylor22 - check out reiew in your ptch04:46
mtaylor22yeah jsut saw it04:47
mtaylor22i thought about doing it in the dockerfile too04:47
mtaylor22bit i figured i'd have a bit more control in the extended start script04:47
sdakemuch better place to do it04:47
sdakethen its permanent04:47
mtaylor22mmmmmmm hokay, easy fix anyway :P04:48
mtaylor22one moment04:48
mtaylor22just testing locally first04:48
*** jtriley has joined #openstack-kolla04:48
sdakecoolsvap_ caan you help me clean up launchpad in prep for releasing newton3 tomorrow?04:49
coolsvap_sdake: yes will do04:50
sdakecoolsvap_ how youc ould help is by moving bugs that dont seem critial to occata04:50
sdakecoolsvap_ i.e. breaks kolla in some way04:51
sdakei'll be moving blueprints shortly04:51
sdakeor maybe i'll be moving the blueprints tomorrow04:52
sdakei am super beat from the beating on osic04:52
coolsvap_sdake: will do04:52
*** ChanServ sets mode: +o sdake04:52
*** sdake changes topic to "Kolla IRC meetngs on Wednesdays @ 16:00 UTC - see agenda @ https://goo.gl/OXB0DL - IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b (old logs from #kolla http://goo.gl/VKpPzA)"04:52
mdnadeem_sdake, coolsvap_ , please review it when get time : https://review.openstack.org/#/c/350629/04:54
openstackgerritMatthew Taylor proposed openstack/kolla: Fix nova_ssh container shell to allow instance resizes.  https://review.openstack.org/36189104:56
*** Jeffrey4l_ has quit IRC04:56
mtaylor22oh wait04:57
mtaylor22sdake: i figured its best only in the nova-ssh dockerfile rather than base (ie. only change where required)04:58
mtaylor22brb sec04:58
sdakemtaylor22 - right only changei n nova_ssh container04:58
sdakemdnadeem_ looks good :)05:00
sdakemdnadeem_ nice job!05:00
mdnadeem_sdake, Thanks :)05:01
sdakedidn't persoanlly test it of course05:01
sdakebut implementation looks correct05:01
*** mtaylor22 has quit IRC05:04
*** mtaylor22 has joined #openstack-kolla05:04
*** ChanServ sets mode: -o sdake05:05
sdaketime for bed05:05
sdakenight all :)05:05
mdnadeem_sdake, good night05:05
duonghqnight sdake05:06
mtaylor22sdake: i tested it locally lol05:08
*** jtriley has quit IRC05:08
*** sdake has quit IRC05:10
*** sdake_ has joined #openstack-kolla05:10
*** daneyon has joined #openstack-kolla05:12
*** salv-orlando has joined #openstack-kolla05:13
*** msimonin has joined #openstack-kolla05:13
*** daneyon has quit IRC05:17
*** zhubingbing_ has joined #openstack-kolla05:17
*** diogogmt has quit IRC05:17
*** msimonin has quit IRC05:19
*** fragatina has quit IRC05:19
*** senk has quit IRC05:20
*** sdake_ has quit IRC05:26
*** sdake has joined #openstack-kolla05:33
*** caowei has quit IRC05:41
sdakemtaylor22 does that nova ssh container resize operation now work for yu?05:43
mtaylor22yeah it does ever since i updated the shell05:43
mtaylor22with nologin = no go05:43
*** caowei has joined #openstack-kolla05:44
*** msimonin has joined #openstack-kolla05:50
*** msimonin has quit IRC05:53
*** senk has joined #openstack-kolla05:54
*** duonghq has quit IRC05:58
*** duonghq has joined #openstack-kolla06:02
*** fragatina has joined #openstack-kolla06:02
*** salv-orl_ has joined #openstack-kolla06:07
*** fragatina has quit IRC06:07
*** salv-orlando has quit IRC06:10
openstackgerritLi Yingjun proposed openstack/kolla: Add option to support dhcp/l3 agent ha  https://review.openstack.org/35218006:13
*** unicell has joined #openstack-kolla06:13
*** sdake has quit IRC06:22
*** salv-orl_ has quit IRC06:24
zhubingbing_hello06:31
zhubingbing_who06:31
zhubingbing_who know  what is add releasnotes command?06:32
duonghqzhubingbing_: guide: http://docs.openstack.org/developer/reno/usage.html06:33
zhubingbing_thanks06:34
zhubingbing_i forget it06:34
*** zhubingbing_ has quit IRC06:37
*** zhubingbing_ has joined #openstack-kolla06:38
*** Mr_Broken has joined #openstack-kolla06:41
openstackgerritDuong Ha-Quang proposed openstack/kolla: Check if ansible_user is in docker group  https://review.openstack.org/35843206:49
bjolomorning06:59
*** mtaylor22 has quit IRC07:07
*** rmart04 has joined #openstack-kolla07:08
*** msimonin has joined #openstack-kolla07:10
*** shardy has joined #openstack-kolla07:12
*** egonzalez90 has joined #openstack-kolla07:14
egonzalez90morning o/07:16
*** godleon has joined #openstack-kolla07:19
*** b_bezak has joined #openstack-kolla07:31
*** duonghq has quit IRC07:37
*** shardy has quit IRC07:39
*** salv-orlando has joined #openstack-kolla07:39
*** shardy has joined #openstack-kolla07:40
*** zhurong_ has quit IRC07:45
openstackgerritzhubingbing proposed openstack/kolla: implement Ansible rally role  https://review.openstack.org/36345607:48
*** zhurong has joined #openstack-kolla07:48
openstackgerritzhubingbing proposed openstack/kolla: implement Ansible rally role  https://review.openstack.org/36345607:50
*** daneyon has joined #openstack-kolla07:55
*** gfidente has joined #openstack-kolla07:57
*** gfidente has joined #openstack-kolla07:57
*** mgoddard_ has joined #openstack-kolla07:58
*** daneyon has quit IRC08:00
*** duonghq has joined #openstack-kolla08:01
openstackgerritzhubingbing proposed openstack/kolla: repair rally dockerfile  https://review.openstack.org/36346608:04
*** athomas has joined #openstack-kolla08:04
*** matrohon has joined #openstack-kolla08:05
*** neilus has quit IRC08:06
*** neilus has joined #openstack-kolla08:06
egonzalez90zhubingbing_, ping08:10
zhubingbing_here08:10
zhubingbing_i wil change rally08:10
*** Serlex has joined #openstack-kolla08:16
*** imcsk8 has quit IRC08:17
*** imcsk8_ has joined #openstack-kolla08:17
*** msimonin1 has joined #openstack-kolla08:19
*** msimonin has quit IRC08:20
*** kong has quit IRC08:22
*** kong has joined #openstack-kolla08:23
*** yingjun has joined #openstack-kolla08:25
openstackgerritzhubingbing proposed openstack/kolla: implement Ansible rally role  https://review.openstack.org/36345608:29
*** rkrum has quit IRC08:30
openstackgerritLi Yingjun proposed openstack/kolla: Add option to support dhcp/l3 agent ha  https://review.openstack.org/35218008:31
*** harley_ has joined #openstack-kolla08:33
openstackgerritzhubingbing proposed openstack/kolla: Add gnocchi ansible role  https://review.openstack.org/34935108:35
*** smekel_ has quit IRC08:38
*** smekel_ has joined #openstack-kolla08:38
harley_hi , everyone , I failed to build rabbitmq image.08:39
harley_ERROR:kolla.image.build.rabbitmq:The command '/bin/sh -c rm -rf /var/lib/rabbitmq/*     && curl -o /usr/lib/rabbitmq/lib/rabbitmq_server-3.5.7/plugins/rabbitmq_clusterer-3.5.x-189b3a81.ez http://www.rabbitmq.com/community-plugins/v3.5.x/rabbitmq_clusterer-3.5.x-189b3a81.ez     && /usr/lib/rabbitmq/bin/rabbitmq-plugins enable --offline        rabbitmq_management        rabbitmq_clusterer     && /bin/true' returned a non-zero code: 2308:40
openstackgerritzhubingbing proposed openstack/kolla: Add Barbican ansible role  https://review.openstack.org/35251508:42
zhubingbing_try agin08:45
zhubingbing_harley08:46
*** harley_ has quit IRC08:48
zhubingbing_again08:49
*** harleyren has joined #openstack-kolla08:54
openstackgerritPaul Bourke proposed openstack/kolla: Allow use of database for Horizon sessions  https://review.openstack.org/35979408:55
*** harleyren has quit IRC08:55
pbourkeegonzalez90: any chance you could review https://review.openstack.org/#/c/337594/ ?08:56
pbourkeegonzalez90: needs to approve for tagging today08:57
pbourkecoolsvap_: ^09:08
coolsvap_pbourke: ack09:09
egonzalez90pbourke, doing it09:10
pbourkethanks guys09:10
*** sean-k-mooneyAFK is now known as sean-k-mooney09:15
*** dwalsh has joined #openstack-kolla09:19
sean-k-mooneyif ye have time to review https://review.openstack.org/#/c/319703/ also that is the only change blocking bifrost support form merging. all the rest depend on it but are already approved09:20
*** zhubingbing_ has quit IRC09:20
sean-k-mooneypbourke: im glad that ceph check is merged though. since we were labeling partions i did find it non intutive that we were going to nuke the whole disk at first09:21
pbourkesean-k-mooney: cool cheers, yeah your input confirmed to me that we needed it09:22
*** egonzalez90 has quit IRC09:22
pbourkesean-k-mooney: a manager in oracle was freaking out when they found out the possibility of nuking a disk ;)09:22
sean-k-mooneythats the joy of linux09:23
sean-k-mooneyat least windows won let let you nuke the os while its running09:23
sean-k-mooneyactully maybe you can do it with diskparted...09:24
*** zhubingbing has joined #openstack-kolla09:25
* sean-k-mooney fight uerge to test for science on work laptop...09:25
coolsvap_duonghq: can you add explanation why https://bugs.launchpad.net/kolla/+bug/1618722 is incomplete or do you think it is addressed with https://review.openstack.org/#/c/363466/09:29
openstackLaunchpad bug 1618722 in kolla "repair rally dockerfile" [Undecided,Incomplete]09:29
*** msimonin1 has quit IRC09:30
openstackgerritsean mooney proposed openstack/kolla: introduce bifrost-deploy container  https://review.openstack.org/31970309:30
sean-k-mooneypbourke: the latest version should adress your commet.09:32
*** msimonin has joined #openstack-kolla09:32
sean-k-mooneygot to run for a bit. will be back in 30 mins or so09:32
duonghqcoolsvap_, zhubingbing_: I think zhubingbing_ should give little more detail on that, but it's ok, maybe I miss understood his idea at that moment, sorry09:35
coolsvap_duonghq: np, just wanted to check if you had any other things in mind09:35
coolsvap_i am just updating the bugs09:35
duonghqsorry again, zhubingbing_, coolsvap_09:36
coolsvap_duonghq: no need for sorry :)09:36
*** salv-orlando has quit IRC09:45
*** yingjun has quit IRC09:51
*** egonzalez90 has joined #openstack-kolla09:55
*** zhurong has quit IRC10:01
*** salv-orlando has joined #openstack-kolla10:02
*** msimonin has quit IRC10:05
*** harleyren has joined #openstack-kolla10:07
*** msimonin has joined #openstack-kolla10:08
*** Mr_Broken has quit IRC10:12
coolsvap_pbourke: do you think https://bugs.launchpad.net/kolla/+bug/1604602 can be resolved?10:28
openstackLaunchpad bug 1604602 in kolla "No build output in deploy gates" [Medium,Triaged]10:28
pbourkecoolsvap_: im sure it can10:29
pbourkecoolsvap_: I dont have time right now to look into it though10:29
coolsvap_pbourke ack10:29
zhubingbinghi10:29
coolsvap_i will update10:29
zhubingbingcoolsvap  sean-k-mooney can you help me review for rally10:30
*** duonghq has left #openstack-kolla10:30
zhubingbinghttps://review.openstack.org/#/c/363466/10:31
zhubingbinghttps://review.openstack.org/#/c/363456/10:31
zhubingbingpbourke10:31
*** chrichip has joined #openstack-kolla10:34
*** daneyon has joined #openstack-kolla10:37
*** egonzalez90 has quit IRC10:38
*** daneyon has quit IRC10:42
*** sdake has joined #openstack-kolla10:49
zhubingbingping sdake10:49
zhubingbinghi10:50
*** chrichip has quit IRC10:50
*** chrichip has joined #openstack-kolla10:51
zhubingbingping sdake10:51
sdakedude its 4am chill out10:52
sdakewhats up10:52
zhubingbingwa10:52
zhubingbingbarbican role need you review it10:53
zhubingbingcan you help me review it10:53
sdakeneed brain toboot10:55
*** chrichip has quit IRC10:56
zhubingbingsure10:56
*** chrichip has joined #openstack-kolla10:57
zhubingbingSorry, I always forget the time zone.10:57
zhubingbing- -10:57
*** phuongnh has quit IRC11:00
sdakecoolsvap_ around?11:00
*** rhallisey has joined #openstack-kolla11:02
*** salv-orlando has quit IRC11:04
coolsvap_sdake: yeah11:04
sdakecoolsvap_ thanks for the list of bugs11:04
sdakecoolsvap_ mind moving the rc1 bugs over?11:04
coolsvap_sure will do11:05
sdakecoolsvap_ looks like there is plenty11:05
coolsvap_in hour or so11:05
coolsvap_yes11:05
sdakei'll create a palceholder o111:05
sdakeya no rush11:05
coolsvap_and there are still in progress bugs11:05
sdakelee those as is11:05
coolsvap_yeah11:06
*** egonzalez90 has joined #openstack-kolla11:08
*** harleyren has quit IRC11:08
*** chrichip has quit IRC11:10
*** godleon has quit IRC11:10
sdakecoolsvap_ this needs a review if you can get ot it - or egonzalez90 https://review.openstack.org/#/c/350692/511:11
*** chrichip has joined #openstack-kolla11:11
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: WIP Add Cinder API/Backup/Scheduler components  https://review.openstack.org/36304411:18
*** chrichip has quit IRC11:18
*** wznoinsk has quit IRC11:18
*** zhiwei has quit IRC11:18
*** chrichip has joined #openstack-kolla11:19
coolsvap_sdake: bugs moved to rc111:22
*** shardy is now known as shardy_lunch11:24
*** chrichip has quit IRC11:26
*** salv-orlando has joined #openstack-kolla11:26
*** chrichip has joined #openstack-kolla11:27
*** wznoinsk has joined #openstack-kolla11:33
sdaketx11:34
sdakesbezverk_ on a tear :)11:34
*** Mr_Broken has joined #openstack-kolla11:37
sbezverk_sdake_: what is up?11:38
sdakesbezverk_ just commentary on how your doing  good fast work ;)11:39
sbezverk_sdake: thanks, it is just so exciting to see kolla-kube is taking shape11:40
*** dwalsh has quit IRC11:40
openstackgerritPaul Bourke proposed openstack/kolla: Customizations for Neutron  https://review.openstack.org/35077711:41
*** zhubingbing has quit IRC11:41
*** chrichip has quit IRC11:44
*** chrichip has joined #openstack-kolla11:45
*** coolsvap_ is now known as coolsvap11:47
*** rhallisey has quit IRC11:54
*** Mr_Broken has quit IRC11:55
*** Mr_Broken has joined #openstack-kolla11:55
*** rhallisey has joined #openstack-kolla11:59
*** Mr_Broken has quit IRC12:00
*** chrichip has quit IRC12:00
*** chrichip has joined #openstack-kolla12:00
*** salv-orlando has quit IRC12:04
*** Jeffrey4l_ has joined #openstack-kolla12:10
*** salv-orlando has joined #openstack-kolla12:12
*** mliima has joined #openstack-kolla12:12
*** shardy_lunch is now known as shardy12:15
openstackgerritChristian Berendt proposed openstack/kolla: Enable CADF events in Keystone and introduce enable_cadf_notifications  https://review.openstack.org/34900612:19
*** berendt has joined #openstack-kolla12:20
berendtcan you please review https://review.openstack.org/#/c/349006/ , would be nice to have this in m312:20
*** kbaegis has joined #openstack-kolla12:21
*** daneyon has joined #openstack-kolla12:26
openstackgerritChristian Berendt proposed openstack/kolla: Fix service_type of mistral endpoint  https://review.openstack.org/35212012:29
*** daneyon has quit IRC12:30
*** mliima has quit IRC12:31
*** mliima has joined #openstack-kolla12:32
*** openstackgerrit has quit IRC12:34
*** openstackgerrit has joined #openstack-kolla12:34
openstackgerritChristian Berendt proposed openstack/kolla: Add cloudkitty containers for type source  https://review.openstack.org/34929512:34
Jeffrey4l_berendt, done. a nit12:41
berendtJeffrey4l_ thanks12:42
berendtJeffrey4l_ I have not added it to the list of enable_* because of the description: "Additional optional OpenStack services are specified here"12:44
*** zhurong has joined #openstack-kolla12:44
openstackgerritChristian Berendt proposed openstack/kolla: Enable CADF events in Keystone and introduce enable_cadf_notifications  https://review.openstack.org/34900612:45
openstackgerritMerged openstack/kolla: introduce bifrost-deploy container  https://review.openstack.org/31970312:45
openstackgerritChristian Berendt proposed openstack/kolla: Add cloudkitty containers for type source  https://review.openstack.org/34929512:47
openstackgerritChristian Berendt proposed openstack/kolla: Install neutron-lbaas-dashboard from source in horizon container  https://review.openstack.org/33694312:48
Jeffrey4l_berendt, we have enable_neutron_lbaas. So i think it should be OK.12:48
berendtJeffrey4l_ LBAAS enables a service in OpenStack, neutron-lbaas-agent12:49
openstackgerritMerged openstack/kolla: Fix nova_ssh container shell to allow instance resizes.  https://review.openstack.org/36189112:49
berendtJeffrey4l_ cadf notifications are only a alternative messaging fomat for keystone and barbican12:49
Jeffrey4l_ok.12:50
openstackgerritMerged openstack/kolla: Add aodh role  https://review.openstack.org/35102712:52
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: WIP Add Cinder API/Backup/Scheduler components  https://review.openstack.org/36304412:56
openstackgerritMerged openstack/kolla: Customizations for Neutron  https://review.openstack.org/35077712:57
*** egonzalez90 has quit IRC13:04
*** dave-mccowan has joined #openstack-kolla13:04
openstackgerritsean mooney proposed openstack/kolla: generate bifrost yaml configs  https://review.openstack.org/34968413:06
sean-k-mooneyim going to quickly rebase the full bifrost chain again the first patch whcih merged was ahead of the rest13:08
*** fguillot has joined #openstack-kolla13:11
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: WIP Add Cinder API/Backup/Scheduler components  https://review.openstack.org/36304413:11
*** sdake_ has joined #openstack-kolla13:16
sdake_http://paste.fedoraproject.org/418051/14726493/ -> http://paste.fedoraproject.org/418051/1472649313:17
openstackgerritsean mooney proposed openstack/kolla: add bifrost deploy ansible support  https://review.openstack.org/34968513:17
openstackgerritsean mooney proposed openstack/kolla: adds bifrost ssh key generation  https://review.openstack.org/35069213:17
openstackgerritsean mooney proposed openstack/kolla: add deploy-servers command  https://review.openstack.org/34972913:17
*** rhallisey has quit IRC13:18
*** sdake has quit IRC13:19
sdake_sean-k-mooney - why rthe rebase?13:21
*** sdake_ is now known as sdake13:22
sean-k-mooneysdake: the base commit was ahead of the rest so the chain could not merge automatically13:23
*** coolsvap is now known as _coolsvap_13:23
sdakesean-k-mooney so you just reordered the commits?13:24
sdakesean-k-mooney i had left workflow off one patch13:24
sean-k-mooneysdake: i litrally use rebased them on master no code chage13:24
sdakebecause i wass waiting for gate13:24
sdakesean-k-mooney cool13:24
sean-k-mooneywell i just checked this one https://review.openstack.org/#/c/349684/1013:24
sdakei'll wait for gate and workflow them13:25
*** duonghq has joined #openstack-kolla13:25
duonghqnight13:25
sdakesean-k-mooney a rebase removes workflow+113:25
sdakenight duonghq13:25
sean-k-mooneysdake: yes it does but you had given https://review.openstack.org/#/c/349684/10 workflow +1 but jenkins failed to merge it for some reason13:26
sdakePatch Set 9: Verified-113:26
sdakeMerge Failed.13:26
sdakeThis change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.13:26
sdakeyup - it needed a rebase ;)13:26
sdakethanks13:26
sdakei'll still wait ofr gate13:27
sean-k-mooneysdake: no worries13:27
openstackgerritMerged openstack/kolla: Import the Murano core libary as part of setup  https://review.openstack.org/36000213:27
sdakeour ci needs love13:30
openstackgerritPaul Bourke proposed openstack/kolla: Add a block around oraclelinux base package install  https://review.openstack.org/36365913:34
sdakepbourke where is inc0's patch to add custoizations tobase?13:36
sdakepbourke retty sure he had submitted one13:36
pbourkesdake: yeah it's merged13:36
pbourkethis is an addition13:36
sdakehmm oesn't look like it13:36
*** harleyren has joined #openstack-kolla13:36
sdakeusing rpm still in base?13:36
pbourkebecause oraclelinux is doing funky stuff (nodeps)13:37
*** harleyren has quit IRC13:37
pbourkenot compatible with our standard macros13:37
sdakegot it13:37
sdakethanks13:37
pbourkethough...13:37
pbourkeit looks like I may need to rebase this patch13:37
openstackgerritPaul Bourke proposed openstack/kolla: Add a block around oraclelinux base package install  https://review.openstack.org/36365913:38
kbaegisHey all.  Still getting null module errors from horizon.  Is the person who fixed that last time around?13:38
kbaegisIt may very well be horizon's fault.  Just wondering what the fix/workaround was13:38
kbaegisTraceback ending 'ValueError: Empty module name'13:39
pbourkeit looks like inc0 may have missed a few oppurtunities to use the macro13:39
pbourkein other places13:39
duonghqkbaegis, iirc last week the latest image worked13:39
duonghqhasn't tried this week13:40
*** chrichip has quit IRC13:40
openstackgerritJeffrey Zhang proposed openstack/kolla: Add warning to kolla-ansible destroy action  https://review.openstack.org/35695713:41
*** chrichip has joined #openstack-kolla13:41
sdakepbourke you hae a +1 on https://review.openstack.org/#/c/35701513:42
sdakeany reason not a +2?13:42
pbourkehmm cant remember!13:43
pbourkeI think Im good with it13:43
openstackgerritMerged openstack/kolla: Add option to support dhcp/l3 agent ha  https://review.openstack.org/35218013:44
sdakeJeffrey4l_ since you hae tht patch open - one little wording chngee13:45
*** chrichip has quit IRC13:46
*** banix has joined #openstack-kolla13:46
sdakeJeffrey4l_ atually i just added naother comment there13:47
*** chrichip has joined #openstack-kolla13:47
Jeffrey4l_sdake, ok. i will add that. thanks.13:47
sdakelets try to wrap up as many reviews today as possible13:48
sdakeat 5pm pst I am submitting the milestone 3 release review13:48
openstackgerritPaul Bourke proposed openstack/kolla: Allow operators to override versionlock for redhat in base  https://review.openstack.org/36367113:48
sdakethen we can leak into rc1  bit13:48
sdakefor important features13:49
Jeffrey4l_OK13:49
sdakerc1 is 15th13:49
kbaegisWell, if anyone cares here's the traceback :) http://hastebin.com/kexoporilo.rb13:49
*** yingjun has joined #openstack-kolla13:50
openstackgerritJeffrey Zhang proposed openstack/kolla: Add warning to kolla-ansible destroy action  https://review.openstack.org/35695713:51
sdakekbaegis is this centos on centos with master?13:51
kbaegissdake: Correct13:52
kbaegisI'm trying to figure out what's going on there, but I'm not very good with django13:52
kbaegisLooks like it's trying to load the keystone portion?13:53
kbaegisLow priority if you guys are preparing an rc13:53
kbaegisBut help is always appreciated :)13:53
*** lyncos has joined #openstack-kolla13:53
sdake[06:53:22]  <sdake>iirc this is a new thing13:54
*** ayoung has joined #openstack-kolla13:54
sdake[06:53:29] amotoki (~amotoki@sp1-79-81-235.msb.spmode.ne.jp) joined the channel13:54
sdake[06:53:35]  <+tsufiev>wat?13:54
sdake[06:53:43]  <sdake>is it an old thing? :)13:54
sdake[06:54:02]  <+tsufiev>as of now we just added osprofiler requirement to horizon13:54
sdake[06:54:08] esp (~dnguyen@c-67-183-15-117.hsd1.wa.comcast.net) left IRC (Quit: esp)13:54
sdake[06:54:09]  <+tsufiev>no other commit has been merged yet13:54
sdakekbaegis - looks like horizon regression to me - join #openstack-horizon13:55
*** lyncos_ has joined #openstack-kolla13:55
*** lyncos_ has quit IRC13:55
kbaegissdake: Oh, you're already on it :)13:57
sdakekbaegis - ts* will look into it13:58
sdakekbaegis i suspect if its broken for us its broken for eveyrone because we just synced with their defaults13:58
sean-k-mooneysdake: horizon still has not closed https://bugs.launchpad.net/horizon/+bug/158576113:58
openstackLaunchpad bug 1585761 in OpenStack Dashboard (Horizon) "failed to boot instance from image without cinder volume" [High,In progress] - Assigned to Rob Cresswell (robcresswell)13:58
kbaegissdake: I was actually playing around with that.  I pulled git into the container and tried to sync back to an older tag13:59
sean-k-mooneywithout that you cant boot vm without cinder deployed from horizon13:59
kbaegisunlinked the /horizon symlink, pointed it at the repo and did pip install -U /horizon-source/git13:59
kbaegisStill doesn't work13:59
sdakewell bottom line is horizon is busted :)14:00
sdakei thinkk our implementation is correct14:00
sean-k-mooneyyep14:00
sdakeso no sense burning cycles on debugging a different project's new code changes14:00
sdakethat is why they have a core team :)14:00
*** neilus has quit IRC14:02
*** chrichip has quit IRC14:02
*** zhurong has quit IRC14:03
*** chrichip has joined #openstack-kolla14:03
*** zhurong has joined #openstack-kolla14:03
*** zhubingbing has joined #openstack-kolla14:05
*** harleyren has joined #openstack-kolla14:05
*** sdake_ has joined #openstack-kolla14:06
*** sdake has quit IRC14:07
kbaegisGood catch, horizon bug.  Workaround is to $(rm -rf /var/lib/kolla/venv/lib/python2.7/site-packages/osprofiler/)14:13
*** rhallisey has joined #openstack-kolla14:14
*** papacz has quit IRC14:15
*** zhiwei has joined #openstack-kolla14:16
sdake_kbaegis a better workaround would be to remove osprofiler from requirements.txt14:16
sdake_kbaegis but not somethign we will do at this point14:16
sdake_kbaegis will wait on horizon team to fix the bug14:16
*** michauds has joined #openstack-kolla14:20
*** zhiwei has quit IRC14:20
kbaegissdake_: They have a fix in review14:20
kbaegishttps://review.openstack.org/#/c/363701/1/osprofiler/__init__.py testing now14:20
kbaegisHow do I redeploy just horizon from image again?14:21
kbaegisIs that the —tag horizon?14:21
sdake_kbaegis today is busy day14:22
sdake_kbaegis i got the ball rolling but need to focus on othe rthings14:22
kbaegissdake_: Thanks.  I'll leave you guys be then :)14:23
duonghqkbaegis: what do you men reploy just horizon?14:24
duonghq*mean14:24
duonghqI think you can pull the horizon image than restart the container14:24
duonghqdue to horizon is single container component iirc14:25
sbezverk_kfox1111: ping14:26
sdake_Jeffrey4l_ re https://ask.openstack.org/en/question/96303/kolla-all-in-one-failed-with-openvswitch-db-container/?sort=latest14:26
sdake_is this the docker 1.12 bug you fixed?14:26
Jeffrey4l_sdake_, no.14:27
Jeffrey4l_but he is use latest kolla playbooks to deploy old images.14:27
Jeffrey4l_he should build the image again.14:27
sdake_i see14:28
sdake_he should be following the instructiosn then14:28
duonghqsdake_ seem familiar,14:28
duonghqclean everything and rebuild image and redeploy is ok,14:29
duonghqnewbie get it easily14:29
sdake_i'd like to make kolla newbie-proof :)14:29
Jeffrey4l_sdake_, we are not handle the mitaka branch doc properly14:29
sdake_Jeffrey4l_ you mean master?14:30
sdake_Jeffrey4l_ please expand - i don't understand what you mean14:31
Jeffrey4l_sdake_, yes(doc.openstack.org only show the master doc, this is talked)14:31
Jeffrey4l_iirc, in the mid-cycle?14:31
sdake_yes that is right14:31
*** papacz has joined #openstack-kolla14:31
sdake_docs.oo only show master not per tag14:31
sdake_for ALL projects14:31
Jeffrey4l_And in the mitaka/quickstart.rst, when installing kolla14:32
sdake_so our docs.oo content needs to cover master and all branches still in existance14:32
Jeffrey4l_it say: git clone https://git.openstack.org/openstack/kolla14:32
sdake_i see14:32
Jeffrey4l_pip install kolla/14:32
Jeffrey4l_which is wrong too. :(14:32
Jeffrey4l_we may need some better solution for this :)14:33
duonghqJeffrey4l_ do you have any suggestion?14:33
Jeffrey4l_openstack doc has some better solution ( which is talked, too )14:34
Jeffrey4l_let me find the link.14:34
*** harleyren has quit IRC14:35
*** david-lyle_ has joined #openstack-kolla14:37
*** salv-orlando has quit IRC14:38
*** senk has quit IRC14:39
Jeffrey4l_duonghq, sorry can not find the link right now. The solution is: put all branch doc in one file and render different branch doc by using that.14:43
Jeffrey4l_then we can put all branch's doc into doc.openstack.org.14:44
Jeffrey4l_something like that.14:44
*** zhubingbing has quit IRC14:46
*** tsufiev has joined #openstack-kolla14:46
*** tsufiev has left #openstack-kolla14:46
*** dwalsh has joined #openstack-kolla14:46
*** zhubingbing has joined #openstack-kolla14:46
*** harleyren has joined #openstack-kolla14:46
duonghqJeffrey4l_ thank you, I understood14:46
sdake_by egonzalez90 is a champ on ask.oo14:47
sdake_by/boy14:47
sdake_id like to get rhallisey's docs changes merged once they are correct14:48
sdake_and then rehash docs at summit14:49
sdake_i have some new ideas there14:49
rhalliseysdake_, would that be merge them and keep the quickstart there?14:49
sdake_rhallisey - any chance you can take over the meeting today for kolla at the 25 minute mark14:49
rhalliseyya14:49
rhalliseyjust make me a chain14:49
rhalliseychair*14:49
sdake_will do14:49
rhalliseywhen you start it14:49
*** fragatina has joined #openstack-kolla14:53
*** fragatina has quit IRC14:53
*** fragatina has joined #openstack-kolla14:54
*** fragatin_ has joined #openstack-kolla14:58
*** david-lyle_ has quit IRC14:59
openstackgerritMerged openstack/kolla: Add a block around oraclelinux base package install  https://review.openstack.org/36365914:59
*** mgoddard__ has joined #openstack-kolla15:01
*** inc0 has joined #openstack-kolla15:01
*** papacz has quit IRC15:01
inc0good morning15:02
inc0good morning Kolla15:02
kbaegisinc0: Morning!15:02
inc0ahh sorry for double post, make it a very good morning then15:02
*** fragatina has quit IRC15:02
*** dwalsh has quit IRC15:02
*** b_bezak has quit IRC15:02
duonghqkbaegis: did you success upgrade Horizon from image?15:02
*** b_bezak has joined #openstack-kolla15:03
kbaegisduonghq: No, that didn't work.  The directory was still missing after pull.  Had to full redeploy15:03
duonghqhmm, which directory? I success with this method before15:04
*** mgoddard_ has quit IRC15:04
*** hrito has joined #openstack-kolla15:04
openstackgerritMerged openstack/kolla: repair rally dockerfile  https://review.openstack.org/36346615:05
kbaegisduonghq: The issue was osprofiler.  Removing it from the site-packages is a kludge15:05
kbaegisduonghq: Reviewing a horizon patch currently15:06
duonghqkbaegis: as I understand, you want to remove the osprofiler in docker image15:07
duonghqand then deploy this image to the target nodes?15:07
*** b_bezak has quit IRC15:07
duonghqcorrect?15:07
kbaegisduonghq: No, I'm testing a patch from the horizon team15:07
kbaegisduonghq: The kludge works though.  No more 500's after removing osprofiler15:08
*** daneyon has joined #openstack-kolla15:08
*** _coolsvap_ is now known as coolsvap15:09
duonghqkbaegis: I mean you want to  test it by apply thi patch to horizon image?15:09
duonghqor just external horizon?15:09
*** mdnadeem has joined #openstack-kolla15:10
*** zhurong has quit IRC15:11
*** rmart04 has quit IRC15:11
*** msimonin has quit IRC15:13
*** mdnadeem_ has quit IRC15:13
*** daneyon has quit IRC15:13
*** diogogmt has joined #openstack-kolla15:14
*** vhosakot has joined #openstack-kolla15:15
michaudssdake: I can bp https://bugs.launchpad.net/kolla/+bug/1616155 this afternoon15:17
openstackLaunchpad bug 1616155 in kolla mitaka "Unable to import database dump with ansible module in kolla-toolbox due to missing mysql binaries." [Critical,Confirmed] - Assigned to Steven Dake (sdake)15:17
michaudssdake: I kinda lost track of that, sorry!15:17
sdake_michauds no sweat15:18
sdake_michauds typically the stable team takes care to backport15:19
sdake_michauds but we take where we can get it ;)15:19
sdake_take help that is ;)15:19
sdake_i'e assinged those backports to you - tia :)15:19
michaudssdake_ Awesome thanks! I'll get them done by eod15:19
michauds:D15:20
sdake_inc0 morning fine sir15:20
inc0ah I woken up, and 3 my reviews are merged15:21
inc0how fun15:21
inc0sean-k-mooney, did you test the interface name thingy by any chance?15:22
sdake_michauds - re losing track- tell me about it - this is why we have all this nonsense with bug tracking in git commits ;-)15:24
openstackgerritMerged openstack/kolla: Add warning to kolla-ansible destroy action  https://review.openstack.org/35695715:25
michaudssdake_ definetly, I only remembered because the milestone changed ahaha15:28
sbezverk_kfox1111: need to chat15:28
*** janki has joined #openstack-kolla15:29
openstackgerritMerged openstack/kolla: generate bifrost yaml configs  https://review.openstack.org/34968415:30
sdake_Jeffrey4l_ when you get to submitting the fio change to rally could you link the review15:31
sdake_Jeffrey4l_ could be whenever - two-four weeks out is fine :)15:31
sdake_i'm pretty sure rally will want that scenario15:31
*** huikang has joined #openstack-kolla15:36
sdake_important team meeting in t-25 minutes15:36
duonghqroger15:37
openstackgerritzhubingbing proposed openstack/kolla: implement Ansible rally role  https://review.openstack.org/36345615:37
sdake_zhubingbing - if you make a change to the rneo note for barbican we can merge it15:38
zhubingbingok15:38
zhubingbingiHow should I do it15:38
*** salv-orlando has joined #openstack-kolla15:40
*** sdake_ is now known as sdake15:40
zhubingbingsnake make a change to the rneo note  , i should add something?15:43
*** mgoddard has joined #openstack-kolla15:44
sdakezhubingbing change it to somethign like "Implement Barbican playbook in Kolla.  Barbican's mission is XYZ"15:44
sdakewhere XYZ is a cut and paste from thegovernance repo15:44
*** banix has quit IRC15:44
sdakehttp://github.com/openstack/kolla15:44
sdakerather15:44
sdakehttp://github.com/openstack/governance15:44
sdakelook for a file called projects.yaml15:44
*** mgoddard__ has quit IRC15:45
zhubingbingok15:45
kbaegisIs barbican working w/ designate?  Can I create certs automagically with the fqdn?15:46
*** salv-orlando has quit IRC15:46
sean-k-mooneyinc0: am not i have not had a change i have been fight with an os install15:46
inc0kk, I'll try it then15:46
sean-k-mooneyinc0: ill do it now as well and let you know.15:47
*** ssurana has joined #openstack-kolla15:47
sean-k-mooneyit should only take a few minutes to do15:47
sdakekbaegis doubtful15:48
sdakekbaegis we take patches :)15:48
*** matrohon has quit IRC15:48
*** msimonin has joined #openstack-kolla15:48
sean-k-mooneyinc0: it seams to be failing for me. it looks like "{{ baremetal_nic }}" is resolved before the deleation to "{{ baremetal_node }}" happens15:50
*** janki has quit IRC15:50
sean-k-mooneyinc0: i need to double check my config though15:50
*** michauds has quit IRC15:51
sdakezhubingbing your kiling me dude :)15:52
*** msimonin has quit IRC15:53
*** banix has joined #openstack-kolla15:55
*** egonzalez90 has joined #openstack-kolla15:56
Jeffrey4l_sdake, the fio should be not accept by rally i think.15:57
sdakeJeffrey4l_ why not?15:58
sdakeJeffrey4l_ i don't want proprietary tests necessarily unless they re in some kind of repo15:59
*** huikang has quit IRC15:59
duonghqmeeting time?15:59
Jeffrey4l_sdake, i can try that.15:59
Jeffrey4l_we can release our report along with the test method16:00
sdaketeam meeeting now16:02
sdake#openstack-meeting-416:02
openstackgerritzhubingbing proposed openstack/kolla: Add Barbican ansible role  https://review.openstack.org/35251516:02
*** apuimedo is now known as apuimedo|away16:03
openstackgerritVladislav Belogrudov proposed openstack/kolla: Allow Neutron to be run in DVR mode  https://review.openstack.org/35654416:03
*** imcsk8_ is now known as imcsk816:03
*** harleyren has quit IRC16:04
*** michauds has joined #openstack-kolla16:04
openstackgerritPaul Bourke proposed openstack/kolla: Allow operators to override use of get-pip.py  https://review.openstack.org/36377516:05
openstackgerritVladislav Belogrudov proposed openstack/kolla: Allow Neutron to be run in DVR mode  https://review.openstack.org/35654416:06
openstackgerritPaul Bourke proposed openstack/kolla: Allow operators to override use of get-pip.py  https://review.openstack.org/36377516:07
openstackgerritzhubingbing proposed openstack/kolla: implement Ansible rally role  https://review.openstack.org/36345616:13
openstackgerritVladislav Belogrudov proposed openstack/kolla: Allow Neutron to be run in DVR mode  https://review.openstack.org/35654416:13
*** fragatin_ has quit IRC16:14
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: WIP Add Cinder API/Backup/Scheduler components  https://review.openstack.org/36304416:16
*** chrichip has quit IRC16:16
*** msimonin has joined #openstack-kolla16:17
*** chrichip has joined #openstack-kolla16:17
*** fragatina has joined #openstack-kolla16:18
*** lyncos has quit IRC16:20
*** Serlex has quit IRC16:21
Jeffrey4l_ https://review.openstack.org/345751 ready for review.16:21
*** fragatina has quit IRC16:22
*** fragatina has joined #openstack-kolla16:22
openstackgerritMerged openstack/kolla: Chage with_ loop variables syntax to ansible 2  https://review.openstack.org/36188616:25
openstackgerritMerged openstack/kolla: add bifrost deploy ansible support  https://review.openstack.org/34968516:26
*** lyncos has joined #openstack-kolla16:28
openstackgerritMerged openstack/kolla: Use dumb-init to manage the pid 1 process  https://review.openstack.org/35701516:30
*** ssurana has quit IRC16:33
*** gfhellma has joined #openstack-kolla16:34
*** gfhellma has quit IRC16:38
*** aswadr_ has joined #openstack-kolla16:39
*** fguillot_ has joined #openstack-kolla16:44
*** gfhellma has joined #openstack-kolla16:44
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Add Cinder API/Backup/Scheduler components  https://review.openstack.org/36304416:46
*** senk has joined #openstack-kolla16:52
*** huikang has joined #openstack-kolla16:52
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Add Cinder API/Backup/Scheduler components  https://review.openstack.org/36304416:54
openstackgerritzhubingbing proposed openstack/kolla: Add gnocchi ansible role  https://review.openstack.org/34935116:54
*** unicell has quit IRC16:57
*** salv-orlando has joined #openstack-kolla16:57
*** huikang has quit IRC16:58
openstackgerritzhubingbing proposed openstack/kolla: Add Barbican ansible role  https://review.openstack.org/35251516:58
inc0ok... I need to spawn a vm on k8s16:59
inc0to make my day brighter16:59
rhalliseysbezverk_, https://bugs.launchpad.net/kolla/+bug/161626816:59
openstackLaunchpad bug 1616268 in kolla mitaka "Stale namespace removal causing "RTNETLINK answers: Invalid argument" errors" [Critical,Confirmed]16:59
rhalliseydidn't you see something like that?17:00
sean-k-mooneyrhallisey: wasnt that fix before17:00
inc0I haven't seen that appear in latest dockers17:00
Jeffrey4l_it may caused by zombie process. But we are not sure.17:00
*** mgoddard_ has joined #openstack-kolla17:00
inc0that too, l3 agent can create zombies17:00
sean-k-mooneyJeffrey4l_: this is only showing up with k8 though right17:00
Jeffrey4l_inc0, rhallisey it happened on both master and mitaka. I see it many times.17:01
inc0hmm17:01
Jeffrey4l_sean-k-mooney, i see this in ansible deployed images.17:01
inc0qdhcp would suggest zombies17:01
rhalliseysean-k-mooney, I think sbezverk_ saw it last week in k8s, but it may also be showing up here17:01
rhalliseynot sure it's the same bug.  sbezverk_ can confirm17:01
inc0as from my talk with Sam, it's neturon that spawns dnsmasq that spawns agents that's issue17:01
sean-k-mooneycould this be a regression in docker 1.1217:01
inc0grandchildren aren't reaped in docker17:01
Jeffrey4l_sean-k-mooney, yep17:02
rhalliseyinc0, ah ya17:02
rhalliseyI remember he mentioned this in Austin17:02
*** daneyon has joined #openstack-kolla17:02
Jeffrey4l_may be https://review.openstack.org/357015 this fix it . But i am not sure.17:02
Jeffrey4l_i can not re-product this issue steadily.17:02
Jeffrey4l_re-produce17:03
sean-k-mooneywell either the dumb-init or bash would solve that issue. just need a pid 1 other then the l3 agent17:03
rhalliseybrb17:03
inc0Jeffrey4l_, it makses snese, let's see if dumb init will fix it17:03
*** mgoddard has quit IRC17:03
Jeffrey4l_yep.  If so , we may need backport the dumb init to mitaka.17:03
inc0probably good idea17:03
sean-k-mooneydoes dumb-init effect the loging?17:04
sean-k-mooneye.g. docker log x17:04
inc0sean-k-mooney, so we have mostly stuff logging to file anyway17:04
inc0we rarely use docker logs17:04
Jeffrey4l_sean-k-mooney, no.17:04
inc0but no, stdout should stay the same17:04
sean-k-mooneyok cool17:05
inc0brb need food17:05
sean-k-mooneyi have kibabn deployed just dont know how to use it so nomally check docker log or the heka container17:05
Jeffrey4l_you can search all the log in kibana.17:06
*** daneyon has quit IRC17:06
*** duonghq has left #openstack-kolla17:07
*** huikang has joined #openstack-kolla17:07
*** hrito has left #openstack-kolla17:10
sdakesean-k-mooney you will need to configure it - or load a preconfig17:12
sdakeakwasnie has one she produced for austin summit17:13
*** kangh_ has joined #openstack-kolla17:13
sean-k-mooneysdake: i when through the kibana guide a few months ago but honestly i jsut have not had time to sit down and look at it properly.17:14
sdakesean-k-mooney you need a preocnfigure17:14
sdakeits not easy to configure17:14
sean-k-mooneyis anyone working on it next cycle?17:15
sean-k-mooneyits one of those things for me anyway that would definetly be nice to have just havent had the free time to learn17:16
*** fguillot_ has quit IRC17:18
sdakesean-k-mooney its a high priority for this cycle but it didn't happen17:22
sdakeso we bounced it to ocatta17:22
sdakethe implementation is almost done17:22
sdakeit needs to be made to load automatically17:22
sdakeget the setup from akwasnie :)17:22
*** egonzalez90 has quit IRC17:24
openstackgerritzhubingbing proposed openstack/kolla: Add sahara ansible role  https://review.openstack.org/35129417:26
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Generic Services, external ip & nodeport  https://review.openstack.org/36315217:26
*** ssurana has joined #openstack-kolla17:27
openstackgerritMerged openstack/kolla: Allow operators to customise rabbitmq plugins  https://review.openstack.org/36372017:29
*** huikang has quit IRC17:31
*** b_bezak has joined #openstack-kolla17:31
*** huikang has joined #openstack-kolla17:32
*** msimonin has quit IRC17:34
*** huikang has quit IRC17:36
*** bradjones has quit IRC17:38
*** bradjones has joined #openstack-kolla17:38
openstackgerritzhubingbing proposed openstack/kolla: implement Ansible rally role  https://review.openstack.org/36345617:38
*** bradjones is now known as Guest3037417:39
*** athomas has quit IRC17:39
*** unicell has joined #openstack-kolla17:39
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Add Cinder API/Backup/Scheduler components  https://review.openstack.org/36304417:40
*** mgoddard_ has quit IRC17:42
imcsk8rhallisey: where can i find tasks to participate? is there an etherpad?17:42
rhalliseyimcsk8, https://blueprints.launchpad.net/kolla-kubernetes17:43
inc0sean-k-mooney, is "add deploy-servers command" review dependant on gnocci ansible role?17:43
imcsk8thanks!17:43
inc0can you remove this dep if it's so? it will block your merge17:43
sean-k-mooneyno17:43
rhalliseyimcsk8,kolla-kubernetes or kolla?17:43
sean-k-mooneyits depdent on the other bifrost revew17:43
rhalliseyor both17:43
rhalliseyimcsk8, ^17:43
imcsk8rhallisey: are they different projects? i thought kolla-kubernetes was under kolla17:43
inc0kk then my gertty is borked17:44
rhalliseyimcsk8, they are both under kolla, but are differnt in how they deploy openstack17:44
imcsk8i'm interested in both, i've had my share of kuernetes also17:44
*** yee379 has joined #openstack-kolla17:44
sean-k-mooneyinc0: the deploy-servers is the last in the chain so once the ssh key gen patch is merged it should merge17:44
inc0I just +w botrh17:44
inc0both17:44
inc0so yay for bifrost17:44
rhalliseyimcsk8, k8s is super new so there is lots of work to be done there17:45
inc0amazing job Sean17:45
rhalliseykolla ir more stable, but still lots of work17:45
imcsk8rhallisey: cool i'll check that out, i've been into kubernetes for a while17:45
rhalliseyimcsk8, do you want to pick a service to implement17:45
rhalliseyok great17:45
inc0I'll buy you cava in Barcelona for it;)17:45
imcsk8i will :)17:45
rhalliseyimcsk8, if the service you want to add isn't there, you can add it as a bluepring17:46
rhalliseyblueprint17:46
rhalliseyimcsk8, and feel free to ask questions if you get stuck17:46
rhalliseyrecoomend following the existing pod/service templates17:46
rhalliseythey should guide you17:46
rhalliseyv1k0d3n, ^17:47
rhalliseya good way to dig in17:47
sean-k-mooneyinc0 thanks for the help in getting it done.17:47
openstackgerritMerged openstack/kolla: adds bifrost ssh key generation  https://review.openstack.org/35069217:48
openstackgerritMerged openstack/kolla: Allow operators to override versionlock for redhat in base  https://review.openstack.org/36367117:48
rhalliseymerge fest17:48
sean-k-mooneyinc0: i tested your patch by the way for https://review.openstack.org/#/c/359364/17:48
rhalliseyupdate the bps if they get completed :)17:48
sean-k-mooneyinc0: it broke on my setup17:48
inc0duh17:48
inc0ok I guess we can require baremetal_interface for now17:49
inc0it actually makes sense because ssh can be on different interface than APIs17:49
openstackgerritMerged openstack/kolla: Allow operators to override use of get-pip.py  https://review.openstack.org/36377517:50
openstackgerritVladislav Belogrudov proposed openstack/kolla: Allow Neutron to be run in DVR mode  https://review.openstack.org/35654417:50
inc0in fact....we could make this a feature and make ssh listen *only* on baremetal_interface17:50
inc0as a security feature17:50
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Make libvirt over tcp an option  https://review.openstack.org/36245717:50
sean-k-mooneyyes well this is currently used to make the hostnames resolveable for rabbit so it should be the same as the api network interface17:51
kfox1111inc0: https://review.openstack.org/#/c/362457/ ?17:51
*** huikang has joined #openstack-kolla17:52
sean-k-mooneywell i guess it dose not have to be the api network interfce but it should be the same interface used for rabbit17:52
inc0well, tbh that's a bug17:52
inc0rabbit needs API interface17:53
inc0so let's change it to api interface instead of baremetal17:53
openstackgerritzhubingbing proposed openstack/kolla: Add Barbican ansible role  https://review.openstack.org/35251517:53
*** huikang has quit IRC17:53
sean-k-mooneysure ill submit a patch for that now then17:53
inc0thanks17:53
inc0I'll update docs to make baremetal required and add this ssh config17:54
inc0it's cool.17:54
sdakehang tight folks - i'll be on in about 30 mins17:55
inc0in fact this will make us probably most secure deployment tool;)17:55
openstackgerritzhubingbing proposed openstack/kolla: Add Barbican ansible role  https://review.openstack.org/35251517:55
sdakeyup17:55
*** zhubingbing has quit IRC17:56
kfox1111inc0: thx17:57
*** gfhellma1 has joined #openstack-kolla17:58
berendtsdake ping17:59
*** gfhellma has quit IRC17:59
openstackgerritMerged openstack/kolla-kubernetes: Make libvirt over tcp an option  https://review.openstack.org/36245718:00
kfox1111inc0: one more please if you have a sec? https://review.openstack.org/#/c/363152/18:01
kfox1111nm. merge conflict... let me rebase.18:02
*** diogogmt has quit IRC18:02
*** v1k0d3n has quit IRC18:05
*** thumpba has joined #openstack-kolla18:05
kfox1111hmm... not sure why that wasn't an automatic rebase...18:05
kfox1111oh... I know why... it didn't notice the parent already merged...18:07
*** salv-orl_ has joined #openstack-kolla18:08
sbezverk_kfox1111: check this out :-)18:08
sbezverk_http://paste.openstack.org/show/565268/18:09
sbezverk_now with petset18:09
sbezverk_cinder is ready for final review18:09
kfox1111sbezverk_: nice. :)18:09
sbezverk_service and api optimization will do after corresponding changes18:09
sbezverk_in the trunk18:09
kfox1111I'd like to get #363152 in real quick and rebase the cinder one on it. give me a couple minutes and I think #363152 will be ready.18:10
*** v1k0d3n has joined #openstack-kolla18:10
*** salv-orlando has quit IRC18:10
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Generic Services, external ip & nodeport  https://review.openstack.org/36315218:12
kfox1111k. rebased.18:12
*** ajpower has quit IRC18:13
sdakerhallisey thanks for finishing the meeting out18:19
sdakerhallisey ++ :)18:19
rhalliseyno problem18:19
kfox1111inc0: ok, can you review this real quick if you got a moment? https://review.openstack.org/#/c/36315218:19
kfox1111rhallisey: you too? :)18:20
rhalliseyyessir18:20
kfox1111thx.18:20
sean-k-mooneysbezverk_: will there be a demo of kolla-k8s at the summit?18:20
v1k0d3nrhallisey: saw your note...as a guideline/suggestions for adding blueprints?18:21
rhalliseyv1k0d3n, I'll add them in18:22
rhalliseyfor all the services18:22
sdakerc1 looks fairly feasible18:22
rhalliseyand you can pick one18:22
rhalliseyv1k0d3n, will do that asap18:22
inc0kfox1111, gerrit is slow:()18:22
sdakecore reviewers - please focus your reviews on stuff related to rc1 blueprints18:22
sdake(or bugs)18:22
rhalliseyv1k0d3n, https://blueprints.launchpad.net/kolla-kubernetes/+addspec18:22
rhalliseythat's how you fill out a bp18:22
*** huikang has joined #openstack-kolla18:22
rhalliseyjust fill in the fields describing what you're working on18:23
*** ajpower has joined #openstack-kolla18:23
kfox1111sdake: where does kolla-kubernetes fit in with that?18:23
openstackgerritChristian Berendt proposed openstack/kolla: Enable CADF events in Keystone and introduce enable_cadf_notifications  https://review.openstack.org/34900618:24
*** huikang has quit IRC18:24
*** shardy is now known as shardy_afk18:24
*** shardy_afk has quit IRC18:25
sdakekfox1111 fit in with which?18:26
sdakekfox1111 rc1?18:26
sdakekfox1111 - kolla-kubernetes is on a release_independent cycle18:26
kfox1111yeah. reviewers targeting rc1 things. or was your comment about just kolla reviews and not kolla-kubernetes reviews?18:26
kfox1111ah. ok.18:26
sdakekfox1111 ya don't ignore other reviews folks, but fosuc on those blueprints :)18:27
sdakekfox1111 for kubernetes what i'd like to  see is something demoable for summit18:27
sdakei think we are close to that18:27
sdakei'd also like to present our technical foundations18:27
sdakebut i'm not doing the presenting18:28
kfox1111sdake: yeah. I think we're in pretty good shape now for demoing something.18:28
kfox1111sdake: I think we have a bunch of cleanup that should happen before we add more devs though, as it will be painful churn.18:28
sdakekfox1111 devs will come and we will take them as they do :)18:28
kfox1111so I'm pushing to get those changes agreed to/applied as quickly as I can.18:28
sdakekfox1111 roger - so what do you need18:28
kfox1111agreed. but its more like, if we reaname a service, then the devel has to delete x and recreate y.18:29
kfox1111that kind of thing is not bad, but painful if its churning a lot.18:29
sdakechurn is normal in an early code base18:29
kfox1111better to now if possible.18:29
v1k0d3nrhallisey: i submitted a blueprint the other day for LKVM stage 1.18:29
rhalliseyI saw18:29
rhalliseynice18:29
v1k0d3nis that good/bad? i don't really know what it would take now...probably has to sit for a little while.18:30
v1k0d3nuntil i'm at a place where i can start testing.18:30
rhalliseyv1k0d3n, if you want to got for that one wfm, but it's not super high prioprity because there still needs to be a lot of work on the foundation18:31
rhalliseystill missing services18:32
sdakemy suggestion would be tog et heat going18:32
sdakeeasy to demo18:32
rhalliseyCLI needs some work and we need to disguss ansible18:32
sdakecreatese fantastic demonstrations18:32
sdakeceph + cinder + heat is where I'd focus sservice wise18:32
sean-k-mooneyv1k0d3n: lkvm for the tenenat of the kolla contaienrs?18:32
rhalliseyhttps://blueprints.launchpad.net/kolla-kubernetes/+spec/rkt-lkvm-support18:33
rhalliseytrue it should probably go into kolla18:33
rhalliseythough it may span both tools18:33
sean-k-mooneylkvm will really reduce your network perfromce18:33
sdakewhat is lkvm18:34
*** vhosakot has quit IRC18:34
sdakeoh i see link reading18:34
sean-k-mooneyit like a really light qemu18:34
sdakeyou mean intel clear containers?18:34
sean-k-mooneylkvm is what clear container is based on18:34
sdakegot it - so buliding block18:35
*** vhosakot has joined #openstack-kolla18:35
sdakeso for atleat the cc condition, I think we need to consider it18:36
sdakebut I don't know if it supports the fetaures we need to run inside18:36
imcsk8rhallisey: i was checking, the kolla-k8s stuff, i think if it's combined with cockpit is a good alternative for ooo18:36
sdakefor eample host bind mounts, host ipc mode, host pid mode, and host networking mode18:36
*** huikang has joined #openstack-kolla18:37
sean-k-mooneysdake: host networking cant be done with lkvm18:37
sean-k-mooneywell it can but your container will see the vms network stack not the  baremetal servers18:37
sdakewhat about the others?18:37
rhalliseyimcsk8, I have a theory on how to re use a bunch of the tripleo work within a k8s framework18:38
sean-k-mooneysdake: with lkvm you are running the container in a hardware enforced vm context with its own kernel so container in the same lkvm instance could use pid=host ... but they would not be shared outside the lkvm instance18:39
sdakesean-k-mooney - need the functionality to work as is does today to embrace cc18:40
rhalliseyimcsk8, it's still in theory state though18:40
sdakesounds like there are a slew of technical brrier18:40
sdakes18:40
rhalliseyimcsk8, interesting observation though18:40
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: l3/metadata DaemonSets + DVR, & labels  https://review.openstack.org/35755718:41
sean-k-mooneysdake: there is a nice diagrame at the bottom of https://coreos.com/rkt/docs/latest/running-lkvm-stage1.html18:41
sean-k-mooneywell ok its not really a diagram but you can see the layers18:42
sean-k-mooneyrunnin kolla on lkvm would almost be like running kolla on magnum.18:43
kbaegisIs it fair to say that kolla is one of the most complicated docker projects currently?18:44
sean-k-mooneykbaegis: i dont know if i would acall kolla a partcarlly complicated docker project.18:44
sdakekbaegis doubtful - only 35k lines of code18:45
sdakekbaegis I'd say a different way to put it is we produce alot of functionality in avery compact (35kloc) form factor18:45
sdakeplaces like netflix/amazonetc have more complex solutions18:45
sdakeyou know, internet 15.0 companies :)18:45
sean-k-mooneykbaegis: kolla has lots of containers but they all follow a similar patteren in how they are used,deployed and created18:45
*** adnavare has joined #openstack-kolla18:46
sdakesean-k-mooney and managed long term ;)18:46
*** diogogmt has joined #openstack-kolla18:48
adnavareHi Folks, Does anyone know what extra settings are required for deploying ceph on single node? I am following https://github.com/openstack/kolla/blob/master/doc/ceph-guide.rst#managing-ceph and stuck at deploy18:48
sean-k-mooneysdake: do you think that long term management will be solve in both k8s and ansible or just one or the other18:48
sdakesean-k-mooney its already solved in kolla ansible afiac18:48
sean-k-mooneyadnavare: what are you stuck on18:48
adnavareceph is sitting forever at "Looking up disks to bootstrap for Ceph OSDs"18:48
*** thumpba has quit IRC18:49
sdakesean-k-mooney kolla-kubernetes requires more work to reach parity18:49
*** thumpba has joined #openstack-kolla18:49
sdakeadnavare your the second person that has reported a similar problem18:49
adnavareI did do "parted /dev/sdb -s -- mklabel gpt mkpart KOLLA_CEPH_OSD_BOOTSTRAP 1 -1" so it should correctly look for that partition18:49
sdakeadnavare we have been in release mode and osic mode for about a month, perhaps its time we tried that after we tag milestone 3 today18:49
*** senk has quit IRC18:49
adnavaresdake: ha ha that is me only ;)18:49
sdakeadnavare ok :)18:50
*** huikang has quit IRC18:50
sdakei thought anscopic reported it as well18:50
adnavaresdake: i have given two names for preference other is aNupOsic18:50
sdakeoh thatsy o u cool :)18:50
sdakesay where did the kuryr blueprint go rhallisey18:50
rhalliseyuh18:51
adnavaresdake: you said you were doing osic tear something with 131 nodes18:51
rhalliseyhttps://blueprints.launchpad.net/kolla/+spec/kuryr-docker-plugin18:51
rhalliseysdake, ^18:51
sdakeso - this used to be at 420 stars lsat week: https://github.com/openstack/kolla18:51
*** david-lyle_ has joined #openstack-kolla18:52
*** david-lyle_ has quit IRC18:52
adnavaresdake: sean-mooney: so any idea about the issue?18:53
sdakethanks rhallisey18:53
sdakeadnavare no idea18:53
sdakeadnavare also we have a release today - but I can give it a go tomorrow afternoon18:54
adnavaresdake:hmmm18:54
sdakeadnavare and see if it can be reproduced18:54
sdakecan you file a bug please and link it?18:54
adnavaresdake: Yeah i can definitely reproduce. But it is not throwing any error it is just sitting18:54
*** senk has joined #openstack-kolla18:55
*** senk has quit IRC18:55
adnavaresdake: also what i notice is when it is trying to run "docker exec -t kolla_toolbox sudo -E /usr/bin/ansible localhost18:55
adnavare -m find_disks" it is asking for ansible user password18:55
adnavaresdake: so do we need such user?18:55
adnavaresdake: I used to never create ansible user with Kolla18:56
sdakeadnavare - not sure what the problem is18:56
sdakeadnavare possible it was broken during our third party blueprints work18:56
sdakeinc0 may be able to help18:56
sdakeor i'll be available tomorrow18:56
adnavaresdake: ok sure18:56
sdakeadnavare I will need to see it for myself18:57
*** diogogmt has quit IRC18:57
sdakeadnavare one ething that could help is a webex ssession if your availalbe for  that18:57
*** daneyon has joined #openstack-kolla18:57
adnavaresdake: sure18:57
sdakeut tomorrow - not today ;)18:57
adnavaresdake: ha ha no problem, I want to set up ceph :)18:57
*** msimonin has joined #openstack-kolla18:58
sdakerhallisey i see some blueprints in milestone 3 which are not in implemented state18:58
sdakerhallisey what was thinking on those?18:58
rhalliseysdake, they are close18:58
*** msimonin1 has joined #openstack-kolla18:58
rhalliseythe ones that are there18:59
rhalliseycould be done today18:59
sdakewho do we need to haraas? :)18:59
sdakeharass that is18:59
sdakesmekel_ - ping re fernet19:00
*** daneyon has quit IRC19:01
*** msimonin has quit IRC19:02
*** vbel has quit IRC19:05
sdakesean-k-mooney - think for bifrost we need your patch to go thorugh ci19:05
sdakesean-k-mooney and for inc0 to rebase his patch19:05
*** vbel has joined #openstack-kolla19:05
sdakesean-k-mooney anything else outstanding?19:05
*** b_bezak has quit IRC19:07
sdakesteak -> shower brb19:15
*** fragatin_ has joined #openstack-kolla19:18
*** salv-orl_ has quit IRC19:19
*** coolsvap has quit IRC19:22
*** fragatina has quit IRC19:22
sdakesyo19:28
*** aswadr_ has quit IRC19:31
*** sdake_ has joined #openstack-kolla19:32
*** sdake has quit IRC19:33
*** sdake has joined #openstack-kolla19:35
sean-k-mooneysdake: for bifrost there should just be https://review.openstack.org/#/c/349729/19:36
*** sdake_ has quit IRC19:36
sdakeinc0 i can't upload to google drive - out of quota19:37
sdakeI just upgraded to the 100gb plan, but quota hasn't updated19:37
sdakeso as soon as that happens, I'll upload those files for you19:37
sean-k-mooneysdake: for kolla host inc0 change https://review.openstack.org/#/c/359364/ dose not work and https://review.openstack.org/#/c/362739/ is a duplicate that also does not work19:38
sdakefantastic19:39
sdakesean-k-mooney you mind taking a crack at it?19:39
sean-k-mooneysdake: ill be uploading a small bugfix that just gets rid of the baremetal_nic variable and uses the api_interface instead19:39
*** huikang has joined #openstack-kolla19:39
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Generic Services, external ip & nodeport  https://review.openstack.org/36315219:40
sean-k-mooneythe code on the master branch works without any change but you just needed to define baremetal_nic in the gloabl.yaml or in the inventory file.19:40
sdakeright - so didn't we decide in meeting we wanted to be able to specify that?19:40
sean-k-mooneybaremetal_nic?19:41
sdakeyup19:41
sdakeyou tell me - you added it :)19:41
sean-k-mooneyso it will be used to generate the host name to ip mappings for rabbitmq so infact it should always be the same as api_interface19:42
sean-k-mooneyso talking to inc0 i was jsut going to remove it and use api_interface instead19:42
*** berendt has quit IRC19:43
rhalliseyinc0, kfox1111 https://blueprints.launchpad.net/kolla-kubernetes/+spec/rabbitmq-single-queue19:43
sean-k-mooneysdake if we want to keep both we can we just need to document the use of baremetal_nic19:43
*** fragatin_ has quit IRC19:45
*** fragatina has joined #openstack-kolla19:45
*** adnavare has quit IRC19:49
*** huikang has quit IRC19:51
openstackgerritsean mooney proposed openstack/kolla: replace baremetal_nic with api_interface  https://review.openstack.org/36391619:52
sean-k-mooneysdake: https://review.openstack.org/#/c/349729/ seams to be stuck19:55
*** gfhellma1 has quit IRC19:56
*** gfhellma has joined #openstack-kolla19:57
*** sean-k-mooney is now known as sean-k-mooneyAFK20:01
*** huikang has joined #openstack-kolla20:08
sbezverk_rhallisey: kfox1111: gents after cinder control plane is merged, I want to look into cinder volume with iscsi. SInce there is not much time, I want to do a really limited version just to be able to have real cinder volumes, maybe even on a single compute node and to be able to boot instance from it. WOuld you be ok with this approach. I think global development might take too much20:10
sbezverk_time..20:10
sbezverk_what do you think?20:10
rhalliseysure20:11
rhalliseygetting it functional first is a great step20:11
sbezverk_rhallisey: cool :-) I hope Kevin agrees also20:12
rhalliseywe20:12
sbezverk_otherwise he will torture me with flexibility and covering all possibilities20:12
sbezverk_comments20:13
rhalliseywe'll have to get there at some point, but don't need to asap20:13
sbezverk_100% agree, it is more like a prototype or a baseline20:13
*** diogogmt has joined #openstack-kolla20:14
*** apuimedo|away is now known as apuimedo20:18
*** huikang has quit IRC20:18
*** banix has quit IRC20:19
*** rstarmer has quit IRC20:22
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla: Release notes for customization  https://review.openstack.org/36392420:24
sbezverk_rhallisey: while working on cinder, Kevin adn I tested cofigmap replace with new config. works fine, so for reconfiguration we need to replace existing configmap and restart container..20:26
rhalliseysbezverk_, yup20:26
rhalliseyCLI/workflow will run that20:26
sbezverk_rhallisey: it would be fun to be able to catch that event and maybe restart container automatically ?20:27
rhalliseysbezverk_, kubernetes is going to build in that feature20:27
rhalliseywhen the configmap changes restart20:28
sbezverk_rhallisey: super..20:28
*** vhosakot has quit IRC20:29
*** vhosakot has joined #openstack-kolla20:30
*** Jeffrey4l__ has joined #openstack-kolla20:34
*** Jeffrey4l_ has quit IRC20:35
*** adnavare has joined #openstack-kolla20:40
*** mark-casey has joined #openstack-kolla20:41
*** daneyon has joined #openstack-kolla20:45
*** daneyon has quit IRC20:50
*** rhallisey has quit IRC21:01
*** salv-orlando has joined #openstack-kolla21:03
*** kangh_ has quit IRC21:04
inc0sbezverk_, kfox1111 did any of you found good way to deploy k8s on multinode?21:04
*** huikang has joined #openstack-kolla21:05
*** huikang has quit IRC21:05
*** ayoung has quit IRC21:10
jrich523anyone know why the rabbitmq part is failing? http://paste.openstack.org/show/565319/21:11
jrich523it doesnt really say much21:11
sbezverk_inc0: The only reliable way to deploy multinode I found was manual.. none of the automated worked and I was spending more time troubleshooting installation than working on kube21:12
inc0duh, last thing we need it to be deployment tool for a deployment tool on top of which we would deploy21:12
jrich523i believe thats an initialization tool for a deployment tool :)21:13
sbezverk_inc0: last week rhallisey was playing with kargo21:14
inc0jrich523, issue with rabbit is that every rabbit host has to communicate to other over hostnames21:14
inc0rabbitmq doesn't know how to IP21:15
jrich523errr so this is the 3rd time i've set this up21:15
jrich523and the last two times didnt care about the ip usage21:15
sbezverk_it was almost success.. you need to check with him for the final verdict21:15
inc0so way to fix it is ensure that every controller can ping every other controller over it's hostname21:16
inc0and it has tob be api_interface21:16
inc0address21:16
jrich523also it seems to be using a name, 'localhost'21:18
jrich523which, cuz its all in one, localhost will resolve correctly from "all hosts" :)21:19
sbezverk_inc0: check this link, I used it as a guideline: https://github.com/kelseyhightower/kubernetes-the-hard-way21:19
inc0trying cargo21:25
inc0kargo21:25
*** banix has joined #openstack-kolla21:26
*** fguillot_ has joined #openstack-kolla21:27
*** banix has quit IRC21:28
inc0it's buggy21:28
*** banix has joined #openstack-kolla21:28
kfox1111I deployed manually too. just because I wanted to learn how to debug it, and didn't want scripts in my way.21:29
kfox1111(ops... :)21:29
*** fguillot_ has quit IRC21:33
jrich523so i used the multinode inventory, and used the machine name, making sure it was pingable, and, still the same thing21:41
*** thumpba has quit IRC21:41
*** diogogmt has quit IRC21:48
*** gfhellma has quit IRC21:48
yee379hi; newbie question - i trying to deploy liberty (1.1.2) - i’ve `git checkout tags/1.1.2`, did the prereq’s and i now get an error pulling in kolla-toolbox image: TASK [common : Pulling kolla-toolbox image] ************************************21:52
yee379An exception occurred during task execution. To see the full traceback, use -vvv. The error was: TypeError: 'NoneType' object has no attribute '__getitem__'21:52
yee379fatal: [localhost]: FAILED! => {"changed": false, "failed": true, "module_stderr": "Traceback (most recent call last):\n  File \"/tmp/ansible_9npklE/ansible_module_kolla_docker.py\", line 703, in <module>\n    main()\n  File \"/tmp/ansible_9npklE/ansible_module_kolla_docker.py\", line 673, in main\n    module = generate_nested_module()\n  File \"/tmp/ansible_9npklE/ansible_module_kolla_docker.py\", line 659, in generate_nested_module\n21:52
yee379 new_args.update(module._load_params()[0])\nTypeError: 'NoneType' object has no attribute '__getitem__'\n", "module_stdout": "", "msg": "MODULE FAILURE", "parsed": false}21:52
yee379(sorry for mesy dump of code)21:52
*** chrichip has quit IRC21:54
*** godleon has joined #openstack-kolla21:54
*** chrichip has joined #openstack-kolla21:55
*** msimonin1 has left #openstack-kolla21:57
*** mliima_ has joined #openstack-kolla21:59
*** mliima has quit IRC22:01
inc0so kargo kinda works22:03
kfox1111cool. :)22:03
inc0I had to dig a bit into it, but that's not horrible, I got k8s up and running22:03
inc0now, how do I deploy...22:04
sdakenice :)22:04
sdakeyee379 follow instriuctions22:05
sdakeinstead use sudo pip install kolla-ansible==1.1.222:05
sdakeyee379 first step is pip uninstall kolla22:05
sdakesorry22:05
sdakeinstead step 1: pip uninstall koll22:05
sdakestep 2: pip install koll==1.1.222:05
sdakekolla==1.1.222:05
yee379ah, i was trying the developer install - i’ll give the pip install a try :)22:06
inc0yee379, also make sure to have ansible 1.9.4 for liberty22:06
*** fguillot has quit IRC22:07
kfox1111inc: ryans been working on revised docs:22:07
kfox1111https://review.openstack.org/#/c/36246722:07
yee379thanks inc0: out of interest any reason why ansible 2 wont’ work?22:08
inc0yee379, it will with newton22:09
*** signed8bit has joined #openstack-kolla22:09
inc0ansible 2 is not backward compatible22:09
*** fguillot has joined #openstack-kolla22:09
jrich523ugh, cant figure this out22:13
openstackgerritStephan Michaud proposed openstack/kolla: Add mariadb client binaries to kolla-toolbox  https://review.openstack.org/36396222:14
yee379thanks sdrake and inc0; a pull seems to be doing a lot more now. i think it was the ansible version issue22:15
inc0yeah probably22:15
inc0with newton it's ansible 2+22:15
inc0sdake, mind acking? https://review.openstack.org/#/c/363924/22:16
inc0anyway, I'm off22:17
inc0cyas22:17
*** inc0 has quit IRC22:17
*** kbaegis has quit IRC22:17
*** mliima_ has quit IRC22:19
*** kbaegis has joined #openstack-kolla22:22
*** banix has quit IRC22:22
sbezverk_kfox1111: still around22:23
sbezverk_?22:23
*** kbaegis has quit IRC22:23
sdakeinc0 got it22:24
sdakeyee379 name is sdake22:24
sdakedrake is a pirate ;)22:24
yee379sorry! no pirates allowed him here then?22:25
sbezverk_sdake: you have something in common with Drake ;-)22:25
sdakeaye matey :)22:25
*** karlamrhein has joined #openstack-kolla22:26
wirehead_yarrr22:27
kfox1111sbezverk_: yeah. whats up?22:28
sdakemichauds ping22:29
sdakemichauds pleae usse the cherry-pick button for cherry-picking patches in gerrit22:29
sdakemichauds or use the proper cherrypick command (git cherry-pick -x)22:29
*** mark-casey has quit IRC22:30
*** banix has joined #openstack-kolla22:30
michaudssdake The cherrypick button would throw errors because of merge conflicts22:31
sbezverk_kfox1111: I plan to do cinder volume with just iscsi22:31
kfox1111I think that's probably the harder thing to get working? as you got to do the tgt stuff?22:32
sdakemichauds understoood22:32
sdakemichauds can you use git cherry-pick -x then22:32
sbezverk_I know I did that for kolla22:32
michaudssdake git didn't seem to appreciate the Dockerfile syntax change on neutron ;)22:32
kfox1111the direct rbd backend should just need the rbd config right, and nothing more.22:32
sdakemichauds oh - did you do after the third party plugins?22:32
sbezverk_I chattaed with Ryan and to be able to do something before the summit the scope will be just iscsi and probably on the single storage node22:33
sdakemichauds its critical we keep the chnge ids intact22:33
sdakemichauds and cherry-pick -x can do the job22:33
sdakeits also iport we record which commit id was cherry-picked22:33
kfox1111sbezverk_: sure, if you want to try. I'm just saying, its probably a lot easier to do ceph backed, based on personal experience.22:34
sdakeeven if it conflicts all over the place22:34
sbezverk_so once it is done and demonstrated, we can add all flavors we want..22:34
sdakewe are cherry-picking the concept, not the implementation so much this time22:34
kfox1111as it just pokes entries into ceph and lets ceph handle it. while the iscsi stack involves other daemons, the kernel, etc.22:34
sbezverk_kfox1111: just FYI so you would not be surprised not to see ceph22:34
kfox1111k.22:34
michaudssdake Ack! Should I just drop the review or is it possible to ammend the metadata through an update to the review?22:34
sdakewould like ceph  +cinder + heat if possible22:35
*** signed8bit is now known as signed8bit_Zzz22:35
sdakemichauds drop review, start over22:35
sdakemichauds i can walk you through one ove rwebex so you can learn22:35
kfox1111go for it. :) if you can get it to work, adding ceph support should be easy. :)22:35
michaudssdake I think it's good, I just noticed that the -x flag was missing on the gerrit generated cherry-pick link :)22:36
*** sbezverk_ has left #openstack-kolla22:36
sdakekfox1111 - lol too busy unforutnately22:36
sdakekfox1111 one advantage of not being ptl is I will have more time to spend actually doing implementation work ;)22:36
kfox1111hehe. yeah.22:36
sdakemichauds nah - you have to do it differenty22:37
sdakemichauds in summary22:38
sdakecheckout master22:38
sdakegit review -s22:38
sdakegit log to find the commit id22:38
sdakegit checkout stable/mitaka22:38
sdakegit cherry-pick -x commitid from mster22:38
*** sbezverk has joined #openstack-kolla22:38
sdakefix cherry-pick to mege correctly22:38
sdakethen git review -s22:38
sdakethen git review22:38
sdakei think that should do it22:38
sdakeyou may have to do the git review -s in the stable/mitaka branch22:38
sdakemichauds ^^22:38
sbezverkkfox1111: if it was working for kolla, should do for kube ;-)22:39
kfox1111sbezverk: yeah. Not saying its insurmountable. just level of effort. :)22:40
openstackgerritMerged openstack/kolla-kubernetes: Generic Services, external ip & nodeport  https://review.openstack.org/36315222:40
*** vhosakot has quit IRC22:41
*** kbaegis has joined #openstack-kolla22:41
kfox1111the gate's slow today. :)22:42
sdakekfox1111 ^^22:42
sdakekfox1111 releae week is always slow22:42
kfox1111yeah.22:42
sdakeespecially mielstone 322:42
kfox1111hence the comment earlyer about stuff like fuelccp consuming resources in crunch time. :/22:43
michaudssdake: Essentially, it's to make sure the the proper commit id is shown in the git message, right? ie: (cherry picked from commit 29c542186b8bc1b3d54611574aa953a03039d2fe)22:43
sdakekfox1111 check out this chart of just kolla: http://stackalytics.com/?module=kolla&metric=commits22:43
sdakemichauds yes and the change id is correct (as cheryr-picked022:43
sdakethe patch should I think end up with two change ids22:43
kfox1111nice.22:44
sdakekfox1111 you notice the peaks22:44
sdakethat is milestone 322:44
sdakekfox1111 the chart at the top of commits over time22:44
* kfox1111 nods22:45
openstackgerritStephan Michaud proposed openstack/kolla: Add mariadb client binaries to kolla-toolbox  https://review.openstack.org/36396822:45
*** zhurong has joined #openstack-kolla22:47
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Add Cinder API/Backup/Scheduler components  https://review.openstack.org/36304422:51
*** zhurong has quit IRC22:52
sbezverkkfox1111: please check the latest cinder PS.22:52
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Add Cinder api and cheduler components  https://review.openstack.org/36304422:53
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Add Cinder api and scheduler components  https://review.openstack.org/36304422:53
openstackgerritStephan Michaud proposed openstack/kolla: Add mariadb client binaries to kolla-toolbox  https://review.openstack.org/36396222:54
kfox1111sbezverk: reviewed22:57
yee379me again: trying to get 1.1.2 installed in an all-in-one - hitting issues with accessing the mysql database23:01
yee379unable to connect to database, check login_user and login_password are correct or /home/ansible/.my.cnf has the credentials. Exception message: (1045, \"Access denied for user 'root'@'dhcp-os-196-85.slac.stanford.edu' (using password: YES)\")23:01
yee379this is for [mariadb | Creating haproxy mysql user]23:02
yee379password its trying to use is the same as that in passwords.yml / database_password23:03
*** AnswerGuy has joined #openstack-kolla23:04
sdakesbezverk were ou the lsat one to touch magnum23:04
sdakeyee379 did you run kolla-genpwd?23:05
yee379sdake: yep23:05
sdakeyee which distro?23:05
yee379all defaults - so i guess centos / binary23:05
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Add Cinder api and scheduler components  https://review.openstack.org/36304423:06
sdakeso you didn't modify the globals.yml file at all?23:06
sdakesbezverk ping23:06
sdakev1k0d3n ping23:06
v1k0d3nyo23:06
AnswerGuySo I've been trying to wrap my head around how to use Kolla to install the OpenStack controllers (and compute nodes) under CoreOS on the bare metal hosts.23:07
yee379i had to change the openstack_release to 1.1.2 (it complained that 1.1.0 didn’t exist) and i added the kolla_internal_vip_address23:07
sdakev1k0d3n i've got a kubernetes project for the guy on your team hat likes to mentor others23:07
sdakeif yu have one of those23:07
v1k0d3nlol23:07
sdakev1k0d3n it involves implmeenting heat in kolla-kubernetes23:07
v1k0d3nthats me man.23:07
sdakev1k0d3n ok - then project for you :)23:07
v1k0d3nthat works. i would be all over that.23:08
sdakev1k0d3n kfox1111 will mentor you on how to get it rolling23:08
sdake(has volunteered atleast)23:08
v1k0d3nyeah that will be great. so reach out to kfox1111? i'm down.23:09
*** yingjun has quit IRC23:10
*** yingjun has joined #openstack-kolla23:11
*** michauds has quit IRC23:11
*** yingjun has quit IRC23:15
*** zhiwei has joined #openstack-kolla23:16
kbaegisUsing physnet1, I can't seem to ping my routers interface23:18
kbaegisI can do it from inside the netns23:19
*** zhiwei has quit IRC23:20
kbaegisI see br-ex, br-int, qbr from global23:20
kbaegisnone have ipv4 addresses assigned23:21
kbaegisI'm trying to remember if that's new23:21
kbaegisYup.  Issue w/ L3 agent.  Possibly my own, but let's see :)23:22
sdakev1k0d3n yup - as soon as your ready to begin, i think kfox will be ready23:22
sdakev1k0d3n you might need to get your  test bed sorted out first23:23
sdakerather kfox1111 ^^23:23
*** salv-orlando has quit IRC23:25
*** daneyon has joined #openstack-kolla23:27
kfox1111v1k0d3n: hi. :)23:28
kfox1111we're still trying to nail down all the install instructions to get a base system working. that part is still very green/in progress.23:28
kfox1111ryan is working on a much more up to date version of the docs here: https://review.openstack.org/#/c/36246723:29
kfox1111so that might be a good starting point.23:29
*** fguillot has quit IRC23:31
*** daneyon has quit IRC23:32
*** chrichip has quit IRC23:36
*** chrichip has joined #openstack-kolla23:37
*** chrichip has quit IRC23:42
*** yuanying has quit IRC23:43
*** chrichip has joined #openstack-kolla23:43
openstackgerritMerged openstack/kolla: Release notes for customization  https://review.openstack.org/36392423:44
*** yuanying has joined #openstack-kolla23:44
*** diogogmt has joined #openstack-kolla23:46
*** fguillot has joined #openstack-kolla23:48
sdakekfox1111 getting a dev environment rolling should be a top priority i tink23:52
sdakeaftre summit there will e many people attracted to the project23:52
sdakecould alwys use a heat template ;-)23:52
sdakethere is one kicking around that sets up kubernetes for you automaticalaly23:52
sdakelarsks is the person to talk to on that point23:53
sdakeyou give it a ndoe count and it creates the appropriate number of kubernetes minions23:53
*** hieulq has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!