Tuesday, 2016-09-06

openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Checks to start reducing Technical Debt  https://review.openstack.org/36580500:12
*** dwalsh has quit IRC00:18
*** daneyon has joined #openstack-kolla00:24
*** yingjun has joined #openstack-kolla00:25
*** fguillot has joined #openstack-kolla00:28
*** daneyon has quit IRC00:28
*** tonanhngo has joined #openstack-kolla00:40
*** tonanhngo has quit IRC00:43
*** ssurana has joined #openstack-kolla00:48
*** duonghq has joined #openstack-kolla01:00
duonghqsean-k-mooney: can you review this ps: https://review.openstack.org/#/c/365494/01:03
openstackgerritRoss Krumbeck proposed openstack/kolla: Ansible-ize OpenStack Designate  https://review.openstack.org/35326101:09
*** zhiwei has joined #openstack-kolla01:09
*** yingjun has quit IRC01:13
*** severion has joined #openstack-kolla01:16
*** v1k0d3n has quit IRC01:16
*** yingjun has joined #openstack-kolla01:19
*** 7YUABZW51 has joined #openstack-kolla01:22
*** yuanying has joined #openstack-kolla01:24
*** yuanying has quit IRC01:24
openstackgerritWei Cao proposed openstack/kolla: Add solum ansible role  https://review.openstack.org/35893801:24
*** zhurong has joined #openstack-kolla01:25
*** v1k0d3n has joined #openstack-kolla01:26
*** severion has quit IRC01:26
openstackgerritWei Cao proposed openstack/kolla: Add solum container  https://review.openstack.org/35540801:33
*** rbergeron has quit IRC01:38
*** rbergeron has joined #openstack-kolla01:38
duonghqsean-k-mooney: ping01:52
openstackgerritzhubingbing proposed openstack/kolla: Add sahara ansible role  https://review.openstack.org/35129401:53
*** fguillot has quit IRC02:01
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Checks to start reducing Technical Debt  https://review.openstack.org/36580502:02
*** fguillot has joined #openstack-kolla02:02
*** fguillot has quit IRC02:02
*** phuongnh has joined #openstack-kolla02:05
*** salv-orl_ has joined #openstack-kolla02:29
*** caowei has joined #openstack-kolla02:32
*** salv-orlando has quit IRC02:32
*** rhallisey has quit IRC02:33
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Checks to start reducing Technical Debt  https://review.openstack.org/36580502:39
*** tonanhngo has joined #openstack-kolla02:42
*** tonanhngo has quit IRC02:44
*** yuanying has joined #openstack-kolla02:52
*** yuanying has quit IRC02:55
*** yuanying has joined #openstack-kolla02:57
*** yuanying has quit IRC03:00
*** yuanying has joined #openstack-kolla03:00
openstackgerritzhubingbing proposed openstack/kolla: Add gnocchi ansible role  https://review.openstack.org/34935103:02
*** tonanhngo has joined #openstack-kolla03:02
*** tonanhngo has quit IRC03:04
*** 7YUABZW51 has quit IRC03:04
*** 5EXABAVU9 has joined #openstack-kolla03:05
*** daneyon has joined #openstack-kolla03:06
*** senk has joined #openstack-kolla03:10
*** daneyon has quit IRC03:11
*** ssurana has quit IRC03:13
openstackgerritDuong Ha-Quang proposed openstack/kolla: Specify 'become' to neccesary tasks (1)  https://review.openstack.org/35853903:14
openstackgerritDuong Ha-Quang proposed openstack/kolla: Specify 'become' for only neccesary tasks (2)  https://review.openstack.org/35903103:14
*** zhugaoxiao has quit IRC03:14
*** zhugaoxiao has joined #openstack-kolla03:14
openstackgerritDuong Ha-Quang proposed openstack/kolla: Specify 'become' for only neccesary tasks (last)  https://review.openstack.org/35909603:16
5EXABAVU9ping Mathias03:17
*** yuanying has quit IRC03:18
*** yuanying has joined #openstack-kolla03:20
openstackgerritLu lei proposed openstack/kolla: Use oslo.i18n to translate messages in kolla project  https://review.openstack.org/36582903:22
*** tonanhngo has joined #openstack-kolla03:23
openstackgerritJeffrey Zhang proposed openstack/kolla: [wip] using ci source mirror  https://review.openstack.org/36572103:23
*** tonanhngo has quit IRC03:24
*** 5EXABAVU9 has quit IRC03:26
*** tummy has joined #openstack-kolla03:38
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Add namespace and test  https://review.openstack.org/36583603:43
*** tonanhngo has joined #openstack-kolla03:52
*** coolsvap_ has joined #openstack-kolla03:52
*** tonanhngo has quit IRC03:54
*** yuanying has quit IRC04:00
*** zhubingbing_ has joined #openstack-kolla04:01
*** yuanying has joined #openstack-kolla04:02
*** sdake has joined #openstack-kolla04:05
*** v1k0d3n has quit IRC04:06
*** v1k0d3n has joined #openstack-kolla04:06
*** qbjolof has quit IRC04:09
*** v1k0d3n has quit IRC04:09
*** v1k0d3n has joined #openstack-kolla04:10
*** caowei has quit IRC04:10
*** zhubingbing_ has quit IRC04:11
*** caowei has joined #openstack-kolla04:13
*** tonanhngo has joined #openstack-kolla04:15
*** zhubingbing has joined #openstack-kolla04:15
*** tonanhngo has quit IRC04:16
*** v1k0d3n has quit IRC04:17
*** sdake has quit IRC04:25
openstackgerritzhubingbing proposed openstack/kolla: Add gnocchi ansible role  https://review.openstack.org/34935104:36
*** qbjolof has joined #openstack-kolla04:36
openstackgerritDuong Ha-Quang proposed openstack/kolla: Specify 'become' for only neccesary tasks (last)  https://review.openstack.org/35909604:38
*** harlowja_at_home has joined #openstack-kolla04:42
*** harlowja_at_home has quit IRC04:47
*** zhubingbing has quit IRC04:48
*** sdake has joined #openstack-kolla04:50
duonghqsdake: is there any way to add new user to dsvm?04:52
duonghqbefore test is run04:52
*** daneyon has joined #openstack-kolla04:54
*** daneyon has quit IRC04:59
*** sdake has quit IRC05:01
*** tonanhngo has joined #openstack-kolla05:03
*** tonanhngo has quit IRC05:04
*** sdake has joined #openstack-kolla05:10
*** sdake has quit IRC05:17
*** diogogmt has quit IRC05:19
*** zhubingbing has joined #openstack-kolla05:23
*** tonanhngo has joined #openstack-kolla05:26
*** bdaca has joined #openstack-kolla05:27
*** tonanhngo has quit IRC05:27
*** zhubingbing has quit IRC05:30
*** senk has quit IRC05:34
*** zhubingbing_ has joined #openstack-kolla05:35
*** zhubingbing_ has quit IRC05:40
*** zhubingbing_ has joined #openstack-kolla05:40
*** diogogmt has joined #openstack-kolla05:41
*** bdaca_ has joined #openstack-kolla05:43
*** bdaca has quit IRC05:47
*** tonanhngo has joined #openstack-kolla05:47
*** mdnadeem has joined #openstack-kolla05:47
*** tonanhngo has quit IRC05:48
*** mdnadeem_ has quit IRC05:50
*** msimonin has joined #openstack-kolla05:52
*** msimonin has quit IRC05:52
*** unicell1 has joined #openstack-kolla05:55
*** unicell has quit IRC05:56
*** bdaca__ has joined #openstack-kolla06:04
*** bdaca_ has quit IRC06:08
*** ankush has joined #openstack-kolla06:14
*** senk has joined #openstack-kolla06:16
*** zhubingbing_ has quit IRC06:21
*** sean-k-m1 has joined #openstack-kolla06:22
*** bdaca_ has joined #openstack-kolla06:24
*** sean-k-mooney has quit IRC06:24
*** kamal__ has joined #openstack-kolla06:24
*** bdaca__ has quit IRC06:28
kamal__mistral doesnot work with keystone3, unless /v3 is appened to auth_uri in ansible/roles/mistral/templates/mistral.conf.j206:31
kamal__is there  planned fix for this06:31
duonghqkamal__: you can file a bug06:32
kamal__ok thanks, I will06:33
bjolomorning people06:37
*** zhubingbing_ has joined #openstack-kolla06:39
*** berendt has joined #openstack-kolla06:40
*** tonanhngo has joined #openstack-kolla06:41
*** daneyon has joined #openstack-kolla06:43
*** tonanhngo has quit IRC06:43
openstackgerritMerged openstack/kolla: Fix Typo in quickstart  https://review.openstack.org/36577706:44
*** bdaca__ has joined #openstack-kolla06:44
openstackgerritTakashi Sogabe proposed openstack/kolla: Keepalived leaves VIP on the host in case of accidental removal.  https://review.openstack.org/36408506:44
berendtmorning06:44
*** zhubingbing_ has quit IRC06:45
*** zhubingbing_ has joined #openstack-kolla06:46
*** daneyon has quit IRC06:47
*** bdaca_ has quit IRC06:48
*** zhubingbing_ has quit IRC06:48
*** egonzalez90 has joined #openstack-kolla06:53
*** zhubingbing has joined #openstack-kolla06:53
egonzalez90morning o/06:53
duonghqmorning06:53
bdaca__hi06:54
openstackgerritChristian Berendt proposed openstack/kolla: Add cloudkitty containers for type source  https://review.openstack.org/34929506:54
*** kamal__ has quit IRC06:54
berendtwe should hire somebody who resolves merge conflicts..06:55
*** zhubingbing has quit IRC06:56
openstackgerritChristian Berendt proposed openstack/kolla: Enable CADF events in Keystone and introduce enable_cadf_notifications  https://review.openstack.org/34900606:58
berendtCan somebody please check and approve https://review.openstack.org/#/c/335495/06:59
*** zhubingbing_ has joined #openstack-kolla07:00
berendtnot yet.. looks like there is an issue with the new xenial images, i only tested on trusty07:00
*** v1k0d3n has joined #openstack-kolla07:01
*** zhubingbing_ has quit IRC07:02
*** bdaca_ has joined #openstack-kolla07:04
openstackgerritMd Nadeem proposed openstack/kolla: Replace deprecated rabbitmq parametrs  https://review.openstack.org/36589407:05
*** v1k0d3n has quit IRC07:06
*** bdaca__ has quit IRC07:08
*** matrohon has joined #openstack-kolla07:09
openstackgerritChristian Berendt proposed openstack/kolla: Improve script to check used source versions  https://review.openstack.org/35264007:12
*** zhubingbing has joined #openstack-kolla07:13
openstackgerritChristian Berendt proposed openstack/kolla: Enable deployment of horizon in tools/deploy_aio.sh  https://review.openstack.org/35945107:15
openstackgerritChristian Berendt proposed openstack/kolla: Install neutron-lbaas plugin in neutron-server container  https://review.openstack.org/32948707:18
*** tummy has quit IRC07:19
*** tonanhngo has joined #openstack-kolla07:19
*** tonanhngo has quit IRC07:21
*** msimonin has joined #openstack-kolla07:23
*** bdaca__ has joined #openstack-kolla07:24
*** chrichip has quit IRC07:25
openstackgerritJeffrey Zhang proposed openstack/kolla: Using CI mirror host  https://review.openstack.org/36572107:28
*** bdaca_ has quit IRC07:29
openstackgerritDuong Ha-Quang proposed openstack/kolla: Specify 'become' to neccesary tasks (1)  https://review.openstack.org/35853907:31
openstackgerritDuong Ha-Quang proposed openstack/kolla: Specify 'become' for only neccesary tasks (2)  https://review.openstack.org/35903107:31
openstackgerritDuong Ha-Quang proposed openstack/kolla: Specify 'become' for only neccesary tasks (last)  https://review.openstack.org/35909607:31
*** neilus has joined #openstack-kolla07:37
*** tonanhngo has joined #openstack-kolla07:38
*** tonanhngo has quit IRC07:40
openstackgerritdupengfei proposed openstack/kolla: Fix lost parameter --remote in generated start_ovsdb_server.sh  https://review.openstack.org/36202707:40
*** b_bezak has joined #openstack-kolla07:40
*** bdaca_ has joined #openstack-kolla07:44
*** bdaca__ has quit IRC07:49
*** bdaca__ has joined #openstack-kolla08:04
*** tonanhngo has joined #openstack-kolla08:08
*** bdaca_ has quit IRC08:08
*** tonanhngo has quit IRC08:09
*** neilus has quit IRC08:22
*** neilus has joined #openstack-kolla08:23
*** bdaca_ has joined #openstack-kolla08:24
wznoinskduonghq: if you mean after devstack's finished and before tempest is run you may want to look into local.sh devstack is looking for - https://github.com/openstack-dev/devstack/blob/master/stack.sh#L1365-L136908:27
*** Jeffrey4l has quit IRC08:28
*** bdaca__ has quit IRC08:28
*** jmccarthy has quit IRC08:28
*** salv-orlando has joined #openstack-kolla08:29
duonghqwznoinsk: thank you, I need setup non-root user for deployment due to the user is added in bootstrap-servers08:29
duonghqright before kolla-ansible deploy is run08:30
*** salv-orl_ has quit IRC08:32
*** jmccarthy has joined #openstack-kolla08:32
openstackgerritChristian Berendt proposed openstack/kolla: Improve README file  https://review.openstack.org/36594108:33
*** jmccarthy has quit IRC08:40
*** tonanhngo has joined #openstack-kolla08:42
*** jmccarthy has joined #openstack-kolla08:43
*** tonanhngo has quit IRC08:44
*** bdaca__ has joined #openstack-kolla08:44
*** jmccarthy has left #openstack-kolla08:46
*** athomas has joined #openstack-kolla08:46
*** bdaca_ has quit IRC08:49
openstackgerritChristian Berendt proposed openstack/kolla: Fix keytone options in all.yml/globals.yml  https://review.openstack.org/36595008:53
*** Serlex has joined #openstack-kolla08:56
openstackgerritYao Lu proposed openstack/kolla: TrivialFix: Delete virtual bridge artifacts when cleaning hosts  https://review.openstack.org/35892408:56
openstackgerritPaul Bourke proposed openstack/kolla: Check volume group exists for Cinder in prechecks  https://review.openstack.org/35415409:02
*** bdaca_ has joined #openstack-kolla09:05
openstackgerritPaul Bourke proposed openstack/kolla: Allow use of database for Horizon sessions  https://review.openstack.org/35979409:05
openstackgerritYao Lu proposed openstack/kolla: TrivialFix: Delete virtual bridge artifacts when cleaning hosts  https://review.openstack.org/35892409:06
*** tonanhngo has joined #openstack-kolla09:08
*** bdaca__ has quit IRC09:08
*** tonanhngo has quit IRC09:09
*** bdaca__ has joined #openstack-kolla09:25
*** bdaca_ has quit IRC09:29
openstackgerritPaul Bourke proposed openstack/kolla: Allow mysql to be used as a database for Ceilometer  https://review.openstack.org/36066909:29
*** yingjun has quit IRC09:34
*** bdaca__ has quit IRC09:38
*** shardy_afk has joined #openstack-kolla09:43
*** shardy has joined #openstack-kolla09:44
*** sdake has joined #openstack-kolla09:45
sdakeduonghq ye it canbe done09:46
sdakeduonghq but needs to be done in your patch09:46
sdakemoring folks09:46
duonghqsdake: how can I do?09:46
sdakeduonghq modify setup_gate.sh script09:50
duonghqsdake: thanks09:50
sdakeif you want it done each individual node, need to modifythe ansible code09:51
duonghqsdake: you mean the playbook?09:52
sean-k-m1duonghq: https://review.openstack.org/#/c/365494/2 looks good to me. thanks for fixing it.09:52
sdakehttps://github.com/openstack/kolla/blob/master/tools/setup_gate.sh#L12509:52
sdakeduonghq yess look at link above09:52
*** sean-k-m1 is now known as sean-k-mooney09:53
sdakethat sets up each of the individual nodes09:53
sdakesome day we hpe to have multinode gating09:53
duonghqthank sean-k-m109:53
duonghqsdake: understand09:54
*** zhubingbing has joined #openstack-kolla09:54
zhubingbinghello guys09:54
sdakezup zhubingbing onfire ;)09:56
zhubingbinglol09:57
*** v1k0d3n has joined #openstack-kolla09:57
sdakehttp://www.urbandictionary.com/define.php?term=on%20fire09:57
zhubingbingsdake, do you think i should add ceilometer to support gnocchi09:58
sdakeif it isn't too painful09:58
sdakefor both of us :)09:58
*** zhurong has quit IRC09:58
openstackgerritMd Nadeem proposed openstack/kolla: Correct Murano keystone_authtoken option name  https://review.openstack.org/36601909:59
duonghqsdake: can you review this very trivial fix: https://review.openstack.org/#/c/365494/209:59
zhubingbinghttp://www.urbandictionary.com/define.php?term=on%20fire  what to do for this website10:00
*** v1k0d3n has quit IRC10:01
zhubingbingThis site is used to do?10:01
zhubingbing- -10:02
*** jmccarthy has joined #openstack-kolla10:03
*** jmccarthy has left #openstack-kolla10:04
*** jmccarthy has joined #openstack-kolla10:05
duonghqsdake: for my bp, I have some update here: https://review.openstack.org/#/c/358539/ new approach, if you have spare time, can you review this?10:06
*** zhubingbing has quit IRC10:10
*** phuongnh has quit IRC10:14
*** zhubingbing has joined #openstack-kolla10:17
*** daneyon has joined #openstack-kolla10:19
openstackgerritMerged openstack/kolla: Init group owner of /etc/kolla to kolla  https://review.openstack.org/36549410:19
* duonghq finish working day 10:21
duonghqbye bye10:21
*** duonghq has left #openstack-kolla10:21
egonzalez90zhubingbing, ping10:23
zhubingbinghere10:23
*** caowei has quit IRC10:23
*** tonanhngo has joined #openstack-kolla10:23
*** tonanhngo has quit IRC10:23
*** daneyon has quit IRC10:24
openstackgerritVladislav Belogrudov proposed openstack/kolla: Cinder-backup misses client part for NFS backend  https://review.openstack.org/36603710:27
*** ntpttr has quit IRC10:30
*** ntpttr has joined #openstack-kolla10:31
*** sdake has quit IRC10:33
*** athomas has quit IRC10:37
*** athomas has joined #openstack-kolla10:41
*** zhubingbing has quit IRC10:44
*** tonanhngo has joined #openstack-kolla10:58
*** tonanhngo has quit IRC10:59
mliimamorning guys11:01
*** yingjun has joined #openstack-kolla11:02
egonzalez90morning mliima11:02
*** Jeffrey4l has joined #openstack-kolla11:05
*** bdaca has joined #openstack-kolla11:07
*** shardy_afk has quit IRC11:11
*** rhallisey has joined #openstack-kolla11:13
*** tonanhngo has joined #openstack-kolla11:14
*** tonanhngo has quit IRC11:16
*** zhiwei has quit IRC11:25
openstackgerritMd Nadeem proposed openstack/kolla: Correct Murano keystone_authtoken option name  https://review.openstack.org/36601911:27
mliimaguys, we have some third party plugin implemented or with your implementation in progress?11:33
*** v1k0d3n has joined #openstack-kolla11:41
openstackgerritChristian Berendt proposed openstack/kolla: Improve README file  https://review.openstack.org/36594111:42
*** fragatina has joined #openstack-kolla11:42
*** tonanhngo has joined #openstack-kolla11:42
openstackgerritChristian Berendt proposed openstack/kolla: Fix keytone options in all.yml/globals.yml  https://review.openstack.org/36595011:42
*** fragatina has quit IRC11:43
*** tonanhngo has quit IRC11:43
*** v1k0d3n has quit IRC11:46
*** kproskurin has joined #openstack-kolla11:50
*** salv-orl_ has joined #openstack-kolla11:52
*** salv-orlando has quit IRC11:52
openstackgerritPrithiv proposed openstack/kolla: Ansible roles for collectd Container  https://review.openstack.org/36608212:04
openstackgerritPrithiv proposed openstack/kolla: Ansible roles for collectd Container  https://review.openstack.org/36608212:05
*** dwalsh has joined #openstack-kolla12:06
openstackgerritMauricio Lima proposed openstack/kolla: Comment some lines in globals.yml  https://review.openstack.org/36608312:09
*** tonanhngo has joined #openstack-kolla12:09
openstackgerritVladislav Belogrudov proposed openstack/kolla: Cinder-backup misses client part for NFS backend  https://review.openstack.org/36603712:09
*** tonanhngo has quit IRC12:10
openstackgerritMauricio Lima proposed openstack/kolla: Comment some lines in globals.yml  https://review.openstack.org/36608312:10
*** zhurong has joined #openstack-kolla12:10
*** bdaca has quit IRC12:12
*** fragatina has joined #openstack-kolla12:13
openstackgerritJeffrey Zhang proposed openstack/kolla: Using CI mirror host  https://review.openstack.org/36572112:17
*** fragatina has quit IRC12:22
*** lulei has quit IRC12:27
*** ccesario has quit IRC12:29
*** kproskurin has quit IRC12:32
mliimaguys, we have some third party plugin implemented or with your implementation in progress?12:37
*** tonanhngo has joined #openstack-kolla12:40
*** tonanhngo has quit IRC12:41
*** dmsimard|pto is now known as dmsimard12:43
*** v1k0d3n has joined #openstack-kolla12:48
rhalliseymliima, I don't know if someone has one in production12:49
rhalliseyshould add a simple one12:50
*** ccesario has joined #openstack-kolla12:52
*** caowei has joined #openstack-kolla12:53
*** tonanhngo has joined #openstack-kolla12:56
*** tonanhngo has quit IRC12:57
*** dave-mccowan has joined #openstack-kolla12:58
*** Marcellin__ has joined #openstack-kolla12:59
*** daneyon has joined #openstack-kolla13:01
*** zhubingbing_ has joined #openstack-kolla13:04
*** msimonin has quit IRC13:06
*** daneyon has quit IRC13:06
*** msimonin has joined #openstack-kolla13:08
*** lrensing_ has joined #openstack-kolla13:08
lrensing_if someone has some spare time, would they mind reviewing https://review.openstack.org/#/c/358305/13:10
*** tonanhngo has joined #openstack-kolla13:17
openstackgerritzhubingbing proposed openstack/kolla: Add gnocchi ansible role  https://review.openstack.org/34935113:18
zhubingbing_hello13:18
*** tonanhngo has quit IRC13:18
matrohonhi kola devs13:25
matrohonI'm having trubles I've never seen before with kolla13:26
*** zhurong has quit IRC13:26
matrohonfew components refuse to start with an error : sudo: unknown uid 162: who are you?13:27
matrohondoes anyone have a clue?13:27
*** narasimha_SV has joined #openstack-kolla13:33
narasimha_SVironic container logs are not getting logged in log files13:34
narasimha_SVwhile checking the ansible code the only change I see from other components is13:34
narasimha_SVlog_dir variable in the conf files13:35
narasimha_SVis this the only change needs to be done or any other changes are required ?13:35
mliimahmm, ok rhallisey13:39
mliimathank you13:39
*** yingjun has quit IRC13:41
*** yingjun has joined #openstack-kolla13:41
openstackgerritJeffrey Zhang proposed openstack/kolla: Using CI mirror host  https://review.openstack.org/36572113:45
*** yingjun has quit IRC13:45
*** b_bezak_ has joined #openstack-kolla13:47
*** b_bezak has quit IRC13:49
openstackgerritVladislav Belogrudov proposed openstack/kolla: Cinder-backup fails while backing up iSCSI volumes  https://review.openstack.org/36614613:52
*** yingjun has joined #openstack-kolla13:55
*** huikang has joined #openstack-kolla13:55
zhubingbing_hi huikang13:58
huikangHi zhubingbing_13:58
*** msimonin has quit IRC14:08
*** yingjun has quit IRC14:08
*** yingjun has joined #openstack-kolla14:08
*** banix has joined #openstack-kolla14:11
*** yingjun has quit IRC14:13
*** inc0 has joined #openstack-kolla14:15
*** michauds has joined #openstack-kolla14:17
*** diogogmt has quit IRC14:20
*** zhiwei has joined #openstack-kolla14:22
*** senk has quit IRC14:25
*** zigo has quit IRC14:25
*** zhubingbing_ has quit IRC14:25
*** zhiwei has quit IRC14:26
*** zhubingbing_ has joined #openstack-kolla14:27
*** msimonin has joined #openstack-kolla14:28
*** msimonin has quit IRC14:29
*** salv-orlando has joined #openstack-kolla14:29
inc0good morning14:31
kfox1111morning.14:32
kfox1111got a bunch of reviews up. :)14:32
inc0yeah yeah, let me clear up my kolla-ansible queue first14:32
kfox1111hehe. k.14:32
*** zigo has joined #openstack-kolla14:32
*** salv-orl_ has quit IRC14:32
*** zigo is now known as Guest3914714:33
*** tonanhngo has joined #openstack-kolla14:33
*** tonanhngo has quit IRC14:35
*** yingjun has joined #openstack-kolla14:36
*** neilus has quit IRC14:36
*** msimonin has joined #openstack-kolla14:38
*** fguillot has joined #openstack-kolla14:38
*** b_bezak_ has quit IRC14:39
*** b_bezak has joined #openstack-kolla14:39
*** Guest39147 has quit IRC14:39
openstackgerritMerged openstack/kolla: Replace deprecated rabbitmq parametrs  https://review.openstack.org/36589414:42
*** zigo_ has joined #openstack-kolla14:42
*** b_bezak has quit IRC14:44
*** sdake has joined #openstack-kolla14:44
inc0sdake, howdy14:45
inc0tag happends today right?14:45
sdakeyo14:45
sdakefor miletstone 3?14:45
sdakethat was last week14:45
sdakewe tag zstreams this week14:45
inc0ok, I think dhellman wants to do this today14:46
sdakeit has alrady beeon done14:46
inc0but we're not covered by that right?14:46
sdakehttps://github.com/openstack/kolla/releases/tag/3.0.0.0b314:46
sdakecovered by which14:46
*** zigo_ has quit IRC14:47
inc0let me find mail14:47
inc0ahh this was about creation of stable/newton branch14:48
sdakethat is supposed to happen in rc114:48
sdakedid you see something about branching of stable/newton this week?14:48
openstackgerritMerged openstack/kolla: Add gnocchi ansible role  https://review.openstack.org/34935114:48
*** zigo_ has joined #openstack-kolla14:48
inc0http://lists.openstack.org/pipermail/openstack-dev/2016-August/102339.html sdake14:49
sdakewe definately donot want to branch14:49
sdakeya that is libraries14:49
sdakenot projects14:49
inc0ahh ok14:50
sdakeWe will wait to create server branches until the RC1 tag, as usual.14:50
inc0makes sense14:50
*** daneyon has joined #openstack-kolla14:50
inc0do we need to re-iterate voting about kolla-ansible14:50
inc0?14:50
inc0new repo14:50
inc0we did got majority afair when rhallisey got voting up14:51
inc0with or without end date14:51
sdakei think timing is not right14:51
sdakeatleast i dont want to split right this second14:51
sdakeatleast post rc114:51
inc0well, sure14:51
inc0that's what I mean14:51
inc0we can setup repo and prep everything14:52
sdakethe repo setup is a clone of kolla master14:52
inc0we can remove code from kolla itself after rc114:52
sdakewith a bunch of git rm after14:52
inc0or empty repo with one big commit14:52
sdakeNO14:52
inc0but I guess git rm will retain history14:53
sdakethat toaly loses all history14:53
sdakeand damages our ability to apply for stabl etags in addition14:53
inc0ok, git logistics will be figured out14:54
sdakehere is the deal14:54
sdakethe split is fine with me14:54
inc0that's exactly why I want to start doing it asap14:54
sdakebut lets do it around the end of the release14:54
inc0for backports?14:54
sdakeif we do it before, we could potentiallly crater our ability to ci14:54
inc0I was thinking to just clone repos14:54
sdakebackports will alsobe a problem14:54
inc0do backports without any issue14:54
inc0as repos will be exact clone14:54
inc0and then do git rm everything besides ansible from kolla-ansible and ansible from kolla itself14:55
*** daneyon has quit IRC14:55
inc0when we release14:55
inc03.0 officially14:55
sdakeno, we are using the current modele for 3.014:55
sdakethat is a major major change14:55
inc0yeah, that's what I mean14:55
sdakeno way i'm introdcuing that at the end of the cycle14:55
inc0we do git rm *after* we release14:55
sdakeoh14:56
sdakeok wfm14:56
inc0brb14:56
sdakei'd like to wait until h official releae is done14:56
sdakeit takes about 1 week to go through the repo creation process (waiting on tc mostly)14:56
*** papacz has quit IRC14:56
*** kproskurin has joined #openstack-kolla14:57
zhubingbing_ping Christian Berendt14:58
berendtzhubingbing_ pong14:58
zhubingbing_hello14:58
*** papacz has joined #openstack-kolla14:58
matrohonsdake, have you ever eared about issues that I encounter with kolla deployments?15:04
matrohonsdake, few components refuse to start with an error : sudo: unknown uid 162: who are you?15:04
*** rmart04_ has joined #openstack-kolla15:06
vbelmatrohon, what components?15:09
matrohonvbel : nova-compute, nova-libvirtd, neutron ovs, neutron-l3, neutron-dhcp15:10
matrohonvbel : looks like an unexpected sudo command is triggered15:10
*** egonzalez90 has quit IRC15:10
vbelthat's lots, what is your environment (host os, images)?15:11
inc0sdake, only thing we can't do before official release is git rm ansible from kolla repo15:11
inc0and that's literally single commit15:11
*** diogogmt has joined #openstack-kolla15:11
matrohonvbel : host-os : debian-testing with docker 11, base image : centos15:11
vbelmatrohon: what it tries to do with sudo?15:12
matrohonvbel : I don't know! do you know how I can figure it out?15:12
vbelin heka container there are logs for the components in /var/log/kolla15:13
zhubingbing_hi sdake15:13
vbelmatrohon: is it all-in-one deploy?15:14
matrohonvbel, yep15:14
zhubingbing_i hope cloud kitty  in newton merge, I'll finish the work with bearendt15:15
zhubingbing_cloud kitty15:15
*** tonanhngo has joined #openstack-kolla15:16
matrohonvbel nothing gets logged, the sudo cmd seems to happen before any logs gets sent15:16
*** huikang has quit IRC15:16
*** huikang has joined #openstack-kolla15:17
vbelmatrohon: can you paste your the deploy failure somewhere? e.g. paste.openstack.org15:19
*** bdaca has joined #openstack-kolla15:20
*** zigo_ is now known as zigo15:20
vbelmatrohon: another experiment I would try - run image by hand, e.g. nova and check if nova user is in (or anything with id 162)15:20
*** fragatina has joined #openstack-kolla15:20
matrohonvbel, well actually I don't have have much to past... deployment is ok, but containers fail to start, and I can see the sudo error with docker logs15:21
*** huikang has quit IRC15:22
mliimahello guys15:22
mliimajust a little question, kolla works fine with lvm?15:22
vbelmatrohon: then I would just run container by hand, e.g.  docker run -ti your_registry:port/kolla/centos-binary-nova-libvirt:3.0.0 bash  , and check "grep 162 /etc/passwd", "sudo -u nova bash"15:24
vbelmliima: yes, it should15:25
vbelmliima: though this is for demo/toy clouds :)15:25
inc0or for clouds which doesn't give a remote crap about their data15:26
mliimaok vbel, thanks15:26
openstackgerritEduardo Gonzalez proposed openstack/kolla: Add Senlin Ansible role  https://review.openstack.org/33972515:27
*** fragatina has quit IRC15:27
inc0on that note, we need to bump ceph15:27
inc0we're on hammer still15:27
mliimai'm running kolla deploy and i was using ceph, but now i have to use lvm :)15:28
openstackgerritzhubingbing proposed openstack/kolla: Add sahara ansible role  https://review.openstack.org/35129415:30
*** msimonin has left #openstack-kolla15:32
kfox1111inc0: big +115:32
kfox1111we need to get to jewel asap. :/15:32
matrohonvbel : it ends up with "Sorry, user nova is not allowed to execute '/usr/bin/bash'"15:32
inc0yeah agree15:32
inc0first thing in ocata15:32
kfox1111I'm going to have to patch all my containers with jewel until then. :/15:32
inc0this has to be careful as upgrades will be fun fun15:32
kfox1111and I'm going to try it with mitaka.15:32
kfox1111yeah.15:33
openstackgerritzhubingbing proposed openstack/kolla: implement Ansible rally role  https://review.openstack.org/36345615:33
*** caowei has quit IRC15:33
kfox1111the upgrades were'nt too bad. there's only one big change I knew of, which was which user it was running under, so a recursive chown.15:33
*** rmart04_ has quit IRC15:33
inc0I've heard good things about ceph upgrades, but we're jumping 2 releases15:33
kfox1111it use to be run as root. now its not.15:33
kfox1111inc0: hammer is an lts, and so is jewel. they have an upgrade path for that.15:34
inc0ok15:34
mliimavbel, http://paste.openstack.org/show/567195/15:35
mliimacan you help me?15:35
mliima:)15:35
sdakeif we can squeeze that in in rc1- we should15:35
*** Jeffrey4l has quit IRC15:35
sdake(jewel)15:35
vbelmatrohon: I can run the same on centos7 host15:36
kfox1111sdake: that would be awesome. :)15:36
matrohonvbel : with the same error?15:36
rhalliseyinc0, ya jewel would be nice15:36
kfox1111sdake: I got a bunch of gate tests up for kolla-kubernetes15:36
*** rmart04 has joined #openstack-kolla15:36
inc0kfox1111, you mentioned patches?15:37
kfox1111plus have whitelisted a bunch of existing issues. so we have a good list of todo's to clean up the codebase.15:37
vbelmatrohon: no, I can "sudo -u nova bash"15:37
kfox1111inc0: yeah. sec.15:37
kfox1111https://review.openstack.org/#/c/36574115:37
matrohonvbel : you run the docker run cmd as root?15:37
vbelmatrohon, mliima : do you run any kind of selinux/apparmor?15:37
vbelmatrohon: yes15:37
kfox1111https://review.openstack.org/#/c/365664/15:37
kfox1111https://review.openstack.org/#/c/365733/15:38
kfox1111https://review.openstack.org/#/c/365805/15:38
matrohonvbel : I mean you use 'docker run -u root'15:38
kfox1111and https://review.openstack.org/#/c/365836/15:38
matrohonvbel, apparmor is not installed, neither selinux15:38
mliimavbel, me too15:39
mliima:)15:39
kfox1111the first two patches are trivial.15:39
kfox1111the rest are test cases and a few fixes.15:39
kfox1111once the last 3 are through, I plan on going through and fixing the issues.15:40
vbelmatrohon, I run as root, root@cent7 ~]# docker run -ti 1.2.3.4:5000/kolla/centos-binary-nova-libvirt:3.0.0 bash15:40
vbeland i get into container as root with that15:40
matrohonvbel : intersting.. once you are in the container bash session, whoami tells you you are root?15:42
vbelmatrohon: but that's for nova-libvirt, nova-compute lands me as 'nova'15:42
matrohonvbel : whoami telles me I'm nova15:42
*** rmart04 has quit IRC15:42
kfox1111each container has a default user it runs as. some of them run as nova. some as root15:43
matrohonvbel : at the end of the dockerfile the is : USER[nova]15:43
vbelmatrohon: yes, that should be, at least for nova-compute. if you run 'id' what you get?15:43
*** sdake has quit IRC15:44
matrohonkfox1111, yep but an unexpected sudo command seems to be triggered in the container15:44
matrohonvbel : $ id15:44
matrohonuid=162(nova) gid=162(nova) groups=162(nova),99(nobody),107(qemu),1000(kolla)15:44
*** zhubingbing_ has quit IRC15:45
matrohonvbel :$ sudo -u nova ls15:45
matrohonSorry, user nova is not allowed to execute '/usr/bin/ls' as nova on c0780d04eb3a.15:45
*** berendt has quit IRC15:45
pbourke_matrohon: vbel: it seems more like a docker uid mapping issue15:45
pbourke_matrohon: how did you install / configure docker15:45
matrohonpbourke_, shouldn't it deactivated by default?15:46
kfox1111yeah. I don't think nova has sudo rights.15:46
kfox1111it usually uses rootwrap to elevate priv when needed.15:46
matrohonpbourke_, apt-get install docker.io15:46
pbourke_docker version ?15:46
matrohonkfox1111, except for sudo cmd from kolla scripts15:46
matrohonpbourke_, 1.11.215:47
vbelmliima: you probably have similar issue - it is docker related, may be old docker-py? If you try to upgrade: sudo pip install -U docker-py15:47
mliimaok15:47
mliimai'll try15:47
mliimathanks15:47
vbelmliima, matrohon : did you follow everything in http://docs.openstack.org/developer/kolla/quickstart.html#host-machine-requirements ?15:49
matrohonvbel, kfox1111, pbourke_ tehr is a command in kolla_start that I can't run as a nova user :15:49
matrohonsudo -E more /usr/local/bin/kolla_set_configs15:49
matrohonvbel : gtg, you gave me new ideas to debug the situation15:50
matrohonvbel, thanks15:51
vbelmatrohon: you are welcome, have to go to15:51
pbourke_matrohon: I haven't come across someone using debian as a host OS for kolla so far. If you get really stuck Id suggest doing up a really simple dockerfile to make sure things are working at a fundamental level15:51
pbourke_matrohon: there are notes in the quickstart about issues with ubuntu and older kernels with certain backends, perhaps cross reference with that also (http://docs.openstack.org/developer/kolla/quickstart.html#install-dependencies)15:52
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla: Change ceph version to Jewel  https://review.openstack.org/36623015:53
inc0kfox1111, ^ take a look plz15:54
*** matrohon has quit IRC15:55
jrich523morning guys15:55
*** unicell1 has quit IRC15:55
inc0hey15:55
kfox1111inc0: looks pretty good.15:56
kfox1111just need a migration job of some sort I think.15:56
inc0it has it15:56
inc0there are no notions of upgrade issues in ceph docs15:56
kfox1111hmm... there should be one...15:57
kfox1111http://ceph.com/releases/v10-2-0-jewel-released/15:57
kfox1111under hammer, general, bullet 2.15:57
kfox1111let me see....15:57
kfox1111here we go. that page, lower 'UPGRADING FROM HAMMER'15:58
kfox1111I guess we could use route 1 and add 'setuser match path' and not secure it more...15:59
inc0hmm, I wonder how this translates to container user namespace15:59
kfox1111might be good enough for newton, then we can secure better in o.15:59
mliimavbel, same error16:00
mliima...16:00
*** imcsk8 has quit IRC16:01
*** mgoddard_ has joined #openstack-kolla16:02
*** imcsk8 has joined #openstack-kolla16:02
inc0kfox1111, yeah, I'll do match path thing16:02
inc0and submit bug for drop root for ceph16:02
*** unicell has joined #openstack-kolla16:02
kfox1111k16:02
inc0I'm wondering, ceph will add it's user on startup?16:04
kfox1111no. its part of the rpm install script.16:05
kfox1111rpm -q --scripts ceph16:05
inc0so durin build16:05
kfox1111yeah.16:05
inc0should be ok then16:05
*** mgoddard has quit IRC16:05
*** david-lyle_ has joined #openstack-kolla16:05
*** david-lyle_ has quit IRC16:05
pbourke_inc0: kfox1111: we create the ceph user16:07
pbourke_via useradd16:07
*** pbourke_ is now known as pbourke16:07
*** huikang has joined #openstack-kolla16:08
kfox1111pbourke: the ceph user wasn't needed until jewel. why would we be createing it for hammer?16:08
pbourkekfox1111: because we made a project wide change to not run as root in containers16:08
inc0which doesnt' affect ceph16:09
*** senk has joined #openstack-kolla16:09
inc0it seems we created user for no reaosn whatsoever16:09
pbourke:D16:09
inc0and this particular line breaks on build16:09
inc0yay16:09
*** huikang has quit IRC16:12
*** jascott1 has joined #openstack-kolla16:13
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla: Change ceph version to Jewel  https://review.openstack.org/36623016:17
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla: Change ceph version to Jewel  https://review.openstack.org/36623016:18
jrich523so, im getting an error about it unable to find the docker module for ansible16:20
jrich523both docker and ansible are installed ok16:20
inc0jrich523, can you please paste the error somewhere?16:20
inc0I have theory what might be wrong16:21
kfox1111pbourke: oh, interesting. so the data might already be written under the correct user?16:21
jrich523http://paste.openstack.org/show/567207/16:21
inc0kfox1111, we didnt run ceph as ceph uset16:21
inc0just created it16:21
*** rhallisey has quit IRC16:21
inc0jrich523, did you install docker-py ?16:21
inc0on every host?16:22
jrich523i think i did... but.. its been a long weekend16:22
jrich523it was part of the original vm template16:22
inc0it has to be installed on target hosts too16:22
jrich523let me give that a spin tho, you might b e right16:22
jrich523yeah, its all VMWorkstation hosted, so i created a vm template of a basic node and am doing linked clones16:22
*** rhallisey has joined #openstack-kolla16:22
inc0ok, make sure that python knows how to "import docker"16:23
jrich523i think that was it16:24
jrich523lets see how the deploy goes this time :)16:24
jrich523ahh success... thanks inc016:28
inc0yay16:29
*** kproskurin has quit IRC16:34
*** vhosakot has joined #openstack-kolla16:35
jrich523i can finally create VMs16:36
jrich523that only took, what, 2 or 3 weeks lol16:36
inc0jrich523, one woot for kolla please16:36
jrich523woot woot :)16:36
inc0thank you,  your extra woot is appreciated;)16:37
jrich523that second one goes to you guys ;)16:37
jrich523cuz there is no way i could have done it without the help16:37
inc0jrich523, mind checking up our docs for what is lacking there?16:38
jrich523i've been taking notes :)16:38
inc0you *should* be able to do it without our help16:38
*** daneyon has joined #openstack-kolla16:38
openstackgerritMauricio Lima proposed openstack/kolla: Fix manila_share container isn't up after deploy  https://review.openstack.org/36624716:39
jrich523honestly i think half the problem is i suffer from an inability to read long paragraphs :)16:39
*** egonzalez90 has joined #openstack-kolla16:39
jrich523however there are a few notes i have on ways to improve it16:39
jrich523i'll probably rebuild one more time just to verify all of it16:39
inc0jrich523, to our defense, we now have playbook that will automate most of required steps16:39
jrich523and then toss in my 2 cents with a PR16:39
jrich523so i came to the party a little too soon? :)16:39
jrich523someone came in here last week with a playbook that was doing that, it was fairly impressive16:40
inc0yeah, Sean's play is great16:40
inc0tested on 130 nodes already16:40
jrich523i think it was some random guy on his own, but either way, most of the steps remaining are fairly basic, so it should be fairly easy to automate the remaining parts16:41
jrich523there really should be a date on the docs pages to let you know when it was last updated, thats one thing i prefer about a wiki, you can easily (on the page) look at the changes, but the doc repo makes perfect sense too :)16:42
*** fragatina has joined #openstack-kolla16:42
*** daneyon has quit IRC16:43
*** fragatina has quit IRC16:43
jrich523oh, the only real problem i had with the docs this last go around, was that the 'install python clients' should be before installing ansible, because one of the libraries in that section (i for get which) was a dependency for ansible, that caused a weird error that took me a while to resolve16:44
*** fragatina has joined #openstack-kolla16:44
*** mark-casey has joined #openstack-kolla16:45
*** fragatina has quit IRC16:52
*** sdake has joined #openstack-kolla16:57
*** huikang has joined #openstack-kolla16:58
inc0jrich523, you sure? I don't think ansible requires clients16:58
jrich523it was the libaries16:59
inc0you should be able to deploy without any client16:59
jrich523there are 3 listed in that section16:59
jrich523yum install python-devel libffi-devel openssl-devel gcc16:59
jrich523one of those16:59
inc0ahh these16:59
inc0yeah16:59
jrich523so that threw me for a loop a bit16:59
inc0these can be problems every now and then, not much we can do about it16:59
*** Serlex has quit IRC17:00
jrich523well thats easy to do something about, cut that section, paste it higher :)17:00
jrich523lol, like i said, going to go through it one more time17:00
sdakejrich523 thos elibraries are for developing not for instlaling purposes17:00
jrich523hmm well, ansible wanted one of them17:01
* jrich523 shrugs17:01
jrich523i used a minimal centos install17:01
*** celo_r has joined #openstack-kolla17:01
*** unicell has quit IRC17:03
*** mgoddard_ has quit IRC17:03
*** mgoddard has joined #openstack-kolla17:03
*** huikang has quit IRC17:04
*** huikang has joined #openstack-kolla17:05
*** celo_r has quit IRC17:06
*** bradjones has quit IRC17:06
*** bdaca has quit IRC17:07
*** vhosakot has quit IRC17:10
*** tonanhngo has quit IRC17:10
*** bradjones has joined #openstack-kolla17:11
*** bradjones has quit IRC17:11
*** bradjones has joined #openstack-kolla17:11
*** sdake_ has joined #openstack-kolla17:12
*** sdake has quit IRC17:15
*** vhosakot has joined #openstack-kolla17:17
*** tonanhngo has joined #openstack-kolla17:20
openstackgerritMauricio Lima proposed openstack/kolla: Fix manila_share container isn't up after deploy  https://review.openstack.org/36624717:21
*** tonanhngo has quit IRC17:21
*** huikang has quit IRC17:25
*** huikang has joined #openstack-kolla17:25
*** michauds has quit IRC17:28
*** sdake_ has quit IRC17:28
*** sdake has joined #openstack-kolla17:29
*** huikang has quit IRC17:30
*** huikang has joined #openstack-kolla17:30
*** huikang has quit IRC17:30
*** huikang has joined #openstack-kolla17:31
inc0http://mirror.centos.org/centos/7/storage/x86_64/ oh the joy, centos doesn't have jewel ceph17:31
inc0kfox1111, ^17:31
*** fragatina has joined #openstack-kolla17:32
inc0sdake, ^17:32
*** fragatina has quit IRC17:32
*** fragatina has joined #openstack-kolla17:33
*** jheroux has joined #openstack-kolla17:34
*** huikang_ has joined #openstack-kolla17:34
*** huikang has quit IRC17:35
*** vhosakot has quit IRC17:36
*** harlowja has joined #openstack-kolla17:38
mnaserthey have it inc017:39
mnaserbut its at http://buildlogs.centos.org/centos/7/storage/x86_64/ceph-jewel/17:39
mnaserno jewel release file17:39
inc0thanks17:40
*** vhosakot has joined #openstack-kolla17:44
*** michauds has joined #openstack-kolla17:45
*** lamt has joined #openstack-kolla17:45
mliimacan someone help me here http://paste.openstack.org/show/567195/ ?17:46
inc0mliima, try to add become: True17:48
mliimabmm17:48
mliimaok inc0 :)17:48
*** banix has quit IRC17:49
*** sdake has quit IRC17:49
*** egonzalez90 has quit IRC17:49
*** banix has joined #openstack-kolla17:51
kfox1111inc:really?17:53
*** huikang_ has quit IRC17:53
inc0mnaser pasted repo where it actually exists17:53
inc0now I'm trying to figure out how to use it17:54
kfox1111oh. yeah. ok. :)17:54
inc0I'm a apt guy:(17:54
*** fragatina has quit IRC17:54
*** huikang has joined #openstack-kolla17:54
*** fragatina has joined #openstack-kolla17:55
mliimasame error inc017:55
mliimanAPIError: 500 Server Error: Internal Server Error (\"{\"message\":\"mkdir /sys/kernel/config: operation not permitted\"}\")\\n'"}17:55
mliima:/17:55
kfox1111inc0: sed 's/apt-get/yum/' :)17:55
*** sdake has joined #openstack-kolla17:56
inc0mliima, how about adding privileged to start_container task?17:56
inc0kfox1111, if only it would be so simple17:56
inc0sdake, around?17:56
kfox1111inc0: I know, right? :)17:56
mliimaroot inc017:56
kfox1111why one should call it 'info' and the other 'show' is beyond me.17:57
kfox1111and worse, not alias each others.17:57
inc0sdake, how to use http://buildlogs.centos.org/centos/7/storage/x86_64/ceph-jewel/ instead of mirror.centos?17:57
mliimahttp://docs.openstack.org/developer/kolla/cinder-guide.html this guide don't have many details17:58
inc0mliima, sbezverk  you guys, talk;)17:58
inc0sbezverk wrote the thing17:58
sbezverkinc0: what is up?17:59
mliima:)17:59
mliimahey sbezverk17:59
inc0mliima  has problems with iscsi17:59
mliimayes :(17:59
mliimai have this error now17:59
mliimahttp://paste.openstack.org/show/567195/17:59
mliimasbezverk, ^^17:59
mliimabtw i'm using ubuntu 16.0418:00
*** huikang has quit IRC18:00
*** banix has quit IRC18:00
sbezverkmliima: are you on 16.04 or 14.04?18:01
*** huikang has joined #openstack-kolla18:01
mliima16.0418:01
sbezverkmlima: those steps were tested only on 14.0418:01
*** mrjk has quit IRC18:01
mliimaoh god18:01
mliimaok, i'm testing it now haha18:01
sbezverkmliima: at that time 16.04 has not been around sorry18:01
mliimaok, its fine18:02
mliimai can change to 14.0418:02
mliima:)18:02
kfox1111while your doing that, you could change it to centos7 too. ;)18:02
kfox1111:)18:03
*** banix has joined #openstack-kolla18:03
*** huikang_ has joined #openstack-kolla18:03
mliimainc0, i want to test some implementation of third party plugin18:04
mliima:)18:05
*** huikang has quit IRC18:05
sdakeafk meting tm18:06
sdakeatm that is18:06
mliimado you know if someone already done something along those lines? inc018:06
inc0mliima, we have our brand new customizations18:07
*** athomas has quit IRC18:07
mliimayes yes, i know18:07
mliima:)18:08
*** huikang_ has quit IRC18:09
*** huikang has joined #openstack-kolla18:09
*** ssurana has joined #openstack-kolla18:12
*** mrjk has joined #openstack-kolla18:13
*** huikang has quit IRC18:14
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: l3/metadata DaemonSets + DVR, & labels  https://review.openstack.org/35755718:14
*** huikang has joined #openstack-kolla18:15
inc0whoah...kolla-k8s will run DVRs? fun fun18:18
kfox1111yeah. we run dvr at our site, so this should let us use it. :)18:19
inc0what scale kfox1111 ?18:19
kfox1111few hundred nodes so far.18:19
kfox1111more are coming in each month.18:19
inc0cool, I've heard of scalling issues of OVS18:20
mark-caseykfox1111: those are using kolla or openstack in general?18:20
inc0and I was wondering if you experience these18:20
kfox1111mark-casey: hand deplyed rdo for now. I'm working on getting kolla-kubernetes up to the point where I can migrate to it. :)18:20
kfox1111inc0: none really so far.18:20
kfox1111had a lot more problems with ceilometer. :/18:21
inc0ahh the ceilometer18:21
kfox1111can't get that thing to scale/be stable to save my life. :/18:21
inc0I remember silence when I asked "who runs ceilometer on prod" in Vancouver18:21
mark-caseykfox1111: neat :)18:21
kfox1111which is a sad statement... "dvr's easier then ceilometer...." :/18:21
kfox1111some important people here bet some farms on ceilometer... :/18:22
kfox1111we warned them...18:22
*** fragatin_ has joined #openstack-kolla18:22
*** berendt has joined #openstack-kolla18:23
kfox1111meeting next... bbiab18:24
*** fragatina has quit IRC18:25
*** daneyon has joined #openstack-kolla18:27
*** senk has quit IRC18:27
*** shardy has quit IRC18:27
*** rhallisey has quit IRC18:28
*** rhallisey has joined #openstack-kolla18:30
*** daneyon has quit IRC18:31
*** tonanhngo has joined #openstack-kolla18:32
*** tonanhngo_ has joined #openstack-kolla18:34
*** mark-casey has quit IRC18:35
*** tonanhngo_ has quit IRC18:36
*** tonanhngo has quit IRC18:36
*** tonanhngo has joined #openstack-kolla18:37
*** lamt has quit IRC18:40
*** lamt has joined #openstack-kolla18:44
*** michauds has quit IRC18:56
*** huikang has quit IRC19:01
*** huikang has joined #openstack-kolla19:02
*** banix has quit IRC19:02
*** jascott1 has quit IRC19:04
*** jascott1 has joined #openstack-kolla19:04
mnaserlol ceilometer in prod19:04
mnasergood one :-P19:04
*** huikang_ has joined #openstack-kolla19:05
*** huikang has quit IRC19:06
*** vbel has quit IRC19:07
*** vbel has joined #openstack-kolla19:07
*** michauds has joined #openstack-kolla19:08
inc0ahh the Openstack jokes, all the laughts19:12
sdakemnaser we dont claim non-compute kit projects work well at scale19:17
*** fragatin_ has quit IRC19:17
sdakebut we includethem anyway so experts like yourseelf can make he judgement call19:17
sdakeit is disabled by default19:18
sdakeso no harm having in repo19:18
*** fragatina has joined #openstack-kolla19:18
sdakemnaser we do claim we have tested kolla including ceph + compute kit + elasticsearch at 123 node scale19:19
sdakeand it works fantasitcally well19:19
sdake100 compute 20 storagee 3 control19:20
*** banix has joined #openstack-kolla19:20
inc0sdake, this is about ceilometer not kolla19:20
inc0some insider joke of people who actually tried19:21
sdakeoh i thought it was ceilometer on kolla :)19:21
inc0inside joke*19:21
*** lamt has quit IRC19:24
sdakehey guys - time to rewrite kolla in go!19:24
*** rmart04 has joined #openstack-kolla19:24
lrensing_can someone review this? https://review.openstack.org/#/c/358305/19:25
*** huikang_ has quit IRC19:28
*** huikang has joined #openstack-kolla19:29
*** diogogmt has quit IRC19:29
*** diogogmt has joined #openstack-kolla19:31
*** coolsvap_ has quit IRC19:32
*** mbound has joined #openstack-kolla19:32
*** rmart04 has quit IRC19:35
*** mliima has quit IRC19:38
*** narasimha_SV has quit IRC19:40
sdakegotta jet - drive home ftl19:42
*** huikang has quit IRC19:43
*** huikang has joined #openstack-kolla19:44
*** sdake has quit IRC19:46
*** huikang_ has joined #openstack-kolla19:47
*** huikang has quit IRC19:48
kfox1111back19:51
openstackgerritWaldemar Znoinski proposed openstack/kolla: Non-default database port documentation.  https://review.openstack.org/36631520:00
*** pbourke has quit IRC20:03
*** sdake has joined #openstack-kolla20:03
*** huikang_ has quit IRC20:03
*** pbourke has joined #openstack-kolla20:03
*** huikang has joined #openstack-kolla20:04
sbezverkkfox1111: ping20:06
*** huikang has quit IRC20:08
*** huikang has joined #openstack-kolla20:10
*** banix has quit IRC20:11
kfox1111ping20:12
kfox1111I may have to duck back out in a few minutes.20:12
sbezverkkfox1111: which would be most relaible way from your point of you to get compute's mode management ip?20:13
sbezverkI meant node20:13
*** daneyon has joined #openstack-kolla20:15
inc0guys, I need centos help20:16
inc0http://buildlogs.centos.org/centos/7/storage/x86_64/ceph-jewel/ <- how to use this as repo?20:17
kfox1111get to ipmi?20:17
inc0kfox1111, I think he meants IP in mgmt interface20:18
*** unicell has joined #openstack-kolla20:18
inc0not oob20:18
*** daneyon has quit IRC20:19
sbezverkkfox1111: management20:19
sbezverksince it would be used for intercompute node connectivity20:20
*** Marx314 has joined #openstack-kolla20:21
kfox1111hmm.... still trying to get a clear picture of your question.20:25
kfox1111what software A is trying to talk to software B?20:26
kfox1111ssh? ipmi? nova -> neutron?20:26
kfox1111oh... so, 'keystone admin port?' kinds of things?20:27
sbezverkkfox1111: if you read my reply to your comment re:cinder, it appears we need to customize cinder.conf at run time20:27
sbezverkfor each compute node hosting cinder-volume20:28
kfox1111sbezverk: hmm... let me think about that for a little bit.20:28
sbezverkkfox1111: so each compute node will know about backends hosted by itself20:28
kfox1111this kind of thing hasn't been done with kubernetes yet...20:28
sbezverkkfox1111: it is what cinder folks told me20:28
kfox1111at least not without doing it as just pods.20:28
kfox1111the tricky bit comes when you throw daemonsets into the mix.20:29
sbezverkI have working prototype, all I need20:29
kfox1111most of the time, I see something like a single pod/deployment/rc per pet like thing.20:29
*** awiddersheim has joined #openstack-kolla20:29
sbezverkfrom you before I push for review is the way to get ip address20:29
kfox1111then a configmap per thingy too.20:29
sbezverkare you serious configmap per comeput node?20:29
awiddersheimHello20:30
sbezverkit is management nightmare20:30
kfox1111sbezverk: it makes me very nervious to be doing config inside the pods other then what's strictly nessisary for stuff like dvr or getting the ip for neutron.20:30
awiddersheimtrying to get the vagrant setup to work20:30
*** salv-orl_ has joined #openstack-kolla20:30
kfox1111overriding an ip is not really config.20:30
awiddersheimbut having trouble with this line in particular20:30
kfox1111writing out a whole configfile at runtime is.20:30
openstackgerritSteven Dake proposed openstack/kolla: DNM: Turn off bindeps  https://review.openstack.org/36632820:30
awiddersheimhttps://github.com/openstack/kolla/blob/master/dev/vagrant/bootstrap.sh#L17120:30
awiddersheimseems like the intention is to install kolla into the KOLLA_PATH directory but that command seems off to me20:31
sdakeinc0 thats easy dude20:31
sbezverkkfox1111: At this point I am going to go with building backend config on the fly, since no other solution exist20:32
kfox1111so, how does kolla solve this?20:32
inc0ok..20:32
kfox1111how does kolla have a different config per lvm cinder-volume?20:32
kfox1111or is that unsupported?20:32
sbezverkkfox1111: they do not, they have all backends in the same file which is not recommended way20:33
kfox1111frankly, I don't know if any op would ever run more then one lvm cinder volume node anyway.20:33
*** salv-orlando has quit IRC20:33
sdakewow wwe have a foxtrot ton of containers20:33
inc0sdake, this is repo with jewel packages https://download.ceph.com/rpm-jewel/el7/x86_64/ , this is one we use http://mirror.centos.org/centos/7/storage/x86_64/20:33
sdakeand a slew of ansible to launch it all20:33
sdakeinc0 hang tight dude20:33
kfox1111so the current kolla version generates one config with all the lvm nodes listed in it?20:34
sbezverkkfox1111: and nobody tested it, I mean multi backends in kolla20:34
sdakeinc0 https://github.com/openstack/kolla/blob/master/docker/base/Dockerfile.j2#L8820:34
sdakechange hammer to jewel20:34
inc0sdake, look at second link20:34
inc0no jewel there m820:35
sdakelooks like storage sig slacking20:35
kfox1111sbezverk: k, so it probably doesn't work there then.20:35
kfox1111hmm...20:35
sbezverkkfox1111: one last thing did iproute make to the base or it is still in openstack-base?20:35
kfox1111it should be in base I think.20:36
inc0yeah sdake, so how do I add a repo?;)20:36
*** akscram has quit IRC20:36
sbezverkkfox1111: cool so then "ip a" shold be avaialble everywhere20:36
* kfox1111 looks through the ansible cinder.conf code...20:36
sdakeinc0 http://docs.ceph.com/docs/master/install/get-packages/#add-ceph20:37
*** akscram has joined #openstack-kolla20:38
kfox1111sbezverk: I haven't ever tried a multinode lvm storage cloud (its a pain to manage and risky or costly) but I think the cinder conf as is would work?20:39
kfox1111the hostnames are different, so I think you can have the same flavor with different hostnames and it will keep them seperate.20:39
*** jascott1 has quit IRC20:40
*** jascott1 has joined #openstack-kolla20:40
*** ayoung has quit IRC20:41
inc0sdake, do I need to create repo file manually?20:41
sdakeinc0 ust install that package20:41
inc0http://paste.openstack.org/show/567207/20:43
kfox1111sbezverk: it looks like your tring to make it so you can override all of the backends in the cinder.conf. but do we need to do that? we pass in a pregenerated cinder.conf. unless the lvm-1 backend info needs to be different on each host, can't we just use the kolla one?20:43
inc0sdake, ^20:43
sbezverkkfox1111: nope because each backend requires unique ip address20:43
kfox1111I think the only crudini thing we might need is the iscsi_ip_address override20:43
kfox1111yeah.20:43
kfox1111same as nova/neutron.20:44
sdakeinc0 related to what20:44
kfox1111but I don't think we need specific overrides for any of the rest?20:44
sbezverkalso forcing people to use the same VG name is limiting20:44
inc0I did docker run -it centos:7 bash20:44
inc0try to install ceph20:44
inc0packages20:44
inc0with jewel20:44
inc0and fail:(20:44
kfox1111inc0: need python-docker?20:45
inc0kfox1111, nah, I'm trying to get jewel installed in container20:45
sdakeinc0 search that link for "RPM"20:45
inc0but rpm fails at repo20:45
kfox1111sbezverk: I kind of agree, but still think that should come from configgen somehow..20:45
sdakefrom where ceph packages start20:45
sdakeyou have to add a repo file - they dont make one available20:46
kfox1111sbezverk: what I'm trying to avoid, is deplying with my premade config file and having some template screw up my carefully crafted config.20:46
sbezverkkfox1111: when it comes from config gen this part of comde will be easily skipped by not configuring backends in kolla-kubernetes.yml20:47
sbezverkeasy :-)20:47
kfox1111sbezverk: yeah, but I do want to deploy cinder-volume...20:47
sbezverkfor me to get this back and running quickly is very optimal way..20:47
kfox1111what about a configmap per pod?20:47
sbezverkkfox1111: who and how it is goinf to be managed, I am not even talking about updating %()20:48
kfox1111or an override per host in a configmap?20:48
*** awiddersheim has quit IRC20:48
kfox1111kolla genconfig's what generates our config files.20:49
sbezverkkfox1111: if you have your config already placed in configmap, then you do not specify anything in kolla-kubernete.yml20:49
kfox1111I don't like having multiple sources of truth. :/20:49
sbezverkthen everything will work as before20:49
sbezverkthat part of code works only if you put it in kolla-kubernetes.yml20:50
kfox1111k.. let me look back through the code with that in mind...20:50
sdakeinc0 try this (documented in that link) : su -c 'rpm -Uvh https://download.ceph.com/rpm-jewel/el7/noarch/ceph-release-1-0.el7.noarch.rpm'20:51
kfox1111so there is a kolla cinder_enabled_backends too....20:51
inc0ahh I failpasted. I tried to do this, got errors20:52
*** jascott1 has quit IRC20:52
*** jascott1 has joined #openstack-kolla20:53
kfox1111sbezverk: the default if cinder_backends is not defined is for it to be defined to include rbd-1 and lvm-1 in kolla20:55
kfox1111if cinder_backed_ceph or enable_cinder_backend_lvm is true.20:56
kfox1111the kolla-kubernetes template looks to put all backends in all containers too?20:57
kfox1111oh... i see it chopping only one out I think....20:58
kfox1111oh. no, its tacking on lvm to the end of enabled_backends...20:58
kfox1111this is complicated logic...20:59
kfox1111hmmm...21:00
sbezverkkfox1111: before I was preserving exisiting backends and I was adding new ones21:00
sbezverknow since I go with 1 backend per compute node21:00
sbezverkthen it will make things more simple21:01
kfox1111I'm looking at version 10.21:01
kfox1111its appending I think.21:01
sbezverkI will find ip address of compute node in the list and if it is there I will create group21:01
sbezverkI have not pushed with new logic21:01
kfox1111k.... I think we need to think about this some more...21:02
sbezverkright 10 appends but new will replace and leave only 1 per compute node21:02
sbezverksure21:02
*** sdake has quit IRC21:02
sbezverklet me push the change and we can have another round of discussionas21:02
*** huikang has quit IRC21:02
kfox1111as an op, I can look in /etc/kolla/* and look at config or just run kolla-kubernetes.py resource-template.... and see the pod description.21:03
kfox1111k21:03
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla: Change ceph version to Jewel  https://review.openstack.org/36623021:03
kfox1111ops are going to naturally look at configfiles or at most configmaps and not so much init containers.21:04
kfox1111can we switch this over somehow to do stuff in configmaps still?21:04
*** lrensing_ has quit IRC21:04
kfox1111maybe move the templateted logic to generate the init container script into a configmap template generator instead?21:04
kfox1111then do a crudini --merge in the init-container?21:05
*** lyncos has quit IRC21:07
kfox1111btw, this is why I mentioned lvm was going to be harder then ceph. :/  cephs very streightforward here. :/21:08
*** rhallisey has quit IRC21:12
*** lyncos has joined #openstack-kolla21:15
*** inc0 has quit IRC21:15
kfox1111sbezverk: I may be able to send an architectural diagram of our production cloud... I'm asking around to see if its possible. but it will make your eyes bleed. :/21:24
kfox1111I'm trying to do the hostlabeling as flexable as possible as we've needed that kind of flexibility in our service placement and I'm sure other ops have similar strange looking placemnets that are required.21:25
*** rmart04 has joined #openstack-kolla21:26
sbezverkkfox1111: agree this is fundamental thing it would be goo to take time to come up with something flexible and easy undertsandable21:30
kfox1111can we punt and just support one node of lvm? that should work without anything special I think? (well, maybe except iscsi address override?)21:31
kfox1111that would buy us time till we can come up with a better solution.21:32
kfox1111really its the same problem ceph in kolla-kubernetes will have.21:32
*** rmart04 has left #openstack-kolla21:34
*** rhallisey has joined #openstack-kolla21:34
*** alwaysatthenoc has joined #openstack-kolla21:38
*** mbound has quit IRC21:40
*** diogogmt has quit IRC21:45
*** esmiurium has quit IRC21:46
*** esmiurium has joined #openstack-kolla21:47
*** banix has joined #openstack-kolla21:48
*** banix has quit IRC21:49
*** banix has joined #openstack-kolla21:50
*** mrjk has quit IRC21:51
*** mdnadeem has quit IRC21:53
*** alwaysatthenoc has quit IRC21:54
*** mrjk has joined #openstack-kolla21:56
*** banix has quit IRC22:00
*** rhallisey has quit IRC22:00
*** banix has joined #openstack-kolla22:01
*** lyncos has quit IRC22:04
*** fguillot_ has joined #openstack-kolla22:16
*** vhosakot has quit IRC22:22
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Add cinder volume with iscsi and lvm backend to Kube  https://review.openstack.org/36457322:28
sbezverkkfox1111: tested latest cinder PS, for now I would like to go with this solution.22:29
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Add cinder volume with iscsi and lvm backend to Kube  https://review.openstack.org/36457322:32
*** dwalsh has quit IRC22:33
*** berendt has quit IRC22:35
*** vhosakot has joined #openstack-kolla22:37
*** banix has quit IRC22:39
*** fguillot_ has quit IRC22:40
*** fguillot_ has joined #openstack-kolla22:41
kfox1111sbezverk: reviewing...22:41
*** michauds has quit IRC22:42
kfox1111can you review https://review.openstack.org/#/c/365733?22:42
*** vhosakot has quit IRC22:57
*** daneyon has joined #openstack-kolla22:57
*** yingjun has quit IRC22:59
*** yingjun has joined #openstack-kolla22:59
*** daneyon has quit IRC23:02
*** yingjun has quit IRC23:04
*** fguillot_ has quit IRC23:07
*** fguillot_ has joined #openstack-kolla23:08
*** ayoung has joined #openstack-kolla23:10
*** sdake has joined #openstack-kolla23:10
openstackgerritMerged openstack/kolla-kubernetes: Template validation/gating  https://review.openstack.org/36573323:21
*** zhiwei has joined #openstack-kolla23:23
*** bmace has joined #openstack-kolla23:26
sdakeinc0 yo23:27
*** zhiwei has quit IRC23:27
*** fguillot_ has quit IRC23:42
*** Jeffrey4l has joined #openstack-kolla23:49
*** Jeffrey4l has quit IRC23:55
*** tonanhngo has quit IRC23:55
*** fguillot_ has joined #openstack-kolla23:59
mnasersdake, i wasnt throws jabs at kolla23:59
mnaseras a fact we're moving our entire (pretty big) deployment from our puppet glue to kolla :)23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!