Monday, 2017-09-25

*** yingjun has joined #openstack-kolla00:07
*** yangyape_ has quit IRC00:08
*** yangyapeng has joined #openstack-kolla00:09
*** yangyapeng has quit IRC00:13
*** hieulq has joined #openstack-kolla00:42
*** tovin07_ has joined #openstack-kolla00:45
*** duonghq has joined #openstack-kolla00:47
duonghqmorning guys00:47
*** hrw has quit IRC00:50
*** huzhengchuan has quit IRC00:51
*** hrw has joined #openstack-kolla00:52
*** daidv has joined #openstack-kolla00:56
*** zhurong has joined #openstack-kolla01:01
*** yingjun has quit IRC01:03
kolla-slack<britthouser> :wave:01:03
duonghq\o/01:04
*** yangyapeng has joined #openstack-kolla01:12
*** kevzha01 has joined #openstack-kolla01:14
*** yangyapeng has quit IRC01:16
*** huzhengchuan has joined #openstack-kolla01:24
*** dardelean_ has joined #openstack-kolla01:33
*** caowei has joined #openstack-kolla01:35
*** dardelean_ has quit IRC01:38
*** lakerzhou1 has joined #openstack-kolla01:48
openstackgerritHeetae Ahn proposed openstack/kolla master: Add RHEL subscription registration  https://review.openstack.org/49514801:49
*** lxdong has joined #openstack-kolla02:04
openstackgerritJinxing Fang proposed openstack/kolla master: Add UEFI deploy file in ironic pxe container  https://review.openstack.org/49715802:06
*** yangyapeng has joined #openstack-kolla02:22
*** yangyapeng has quit IRC02:25
*** yangyapeng has joined #openstack-kolla02:25
openstackgerritMerged openstack/kolla-ansible master: Fix ci gate failure  https://review.openstack.org/50651502:36
*** itlinux has joined #openstack-kolla02:37
*** david-lyle has joined #openstack-kolla02:38
openstackgerritDuong Ha-Quang proposed openstack/kolla-ansible master: Fix rabbitmq tag not match in fluentd  https://review.openstack.org/50319002:40
*** lakerzhou1 has quit IRC02:52
*** yangyapeng has quit IRC02:55
*** yangyapeng has joined #openstack-kolla02:56
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible master: Copy certifications info octavia housekeeping and health manager container  https://review.openstack.org/50683202:57
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible stable/pike: Fix ci gate failure  https://review.openstack.org/50652902:58
*** spsurya has joined #openstack-kolla02:58
spsuryamorning02:58
spsuryaJeffrey4l: already done https://review.openstack.org/#/c/506515/03:01
Jeffrey4lspsurya, yep. thanks.03:01
openstackgerritJeffrey Zhang proposed openstack/kolla stable/ocata: Bump OpenStack service version  https://review.openstack.org/50697803:02
openstackgerritJeffrey Zhang proposed openstack/kolla master: Add neutron-fwaas-dashboard into horizon image  https://review.openstack.org/50691003:03
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible master: Enable neutron fwaas dashboard dynamically  https://review.openstack.org/50691103:04
*** zhurong has quit IRC03:08
*** zhurong has joined #openstack-kolla03:10
*** tovin07_ has quit IRC03:17
*** tovin07_ has joined #openstack-kolla03:23
*** itlinux has quit IRC03:30
*** gkadam has joined #openstack-kolla03:38
*** gkadam has quit IRC03:39
*** gkadam has joined #openstack-kolla03:39
*** janki has joined #openstack-kolla03:47
spsuryakrtaylor ping03:47
*** dmsimard is now known as dmsimard|off04:10
openstackgerritTuan Luong-Anh proposed openstack/kolla-kubernetes master: Update URL home-page in documents according to document migration  https://review.openstack.org/48377404:13
*** coolsvap has joined #openstack-kolla04:26
*** mdnadeem has joined #openstack-kolla04:41
*** caowei has quit IRC04:56
*** livelace has joined #openstack-kolla05:03
*** zhurong has quit IRC05:21
openstackgerritcaoyuan proposed openstack/kolla-ansible master: optimize the command format for murano start.yml  https://review.openstack.org/50698905:24
openstackgerritSurya Prakash (spsurya) proposed openstack/kolla master: Rearrange existing documentation to fit the new standard layout  https://review.openstack.org/48642305:32
*** kevzha01 has quit IRC05:34
openstackgerritcaoyuan proposed openstack/kolla-ansible master: Change the "shell" to "command" to keep consistence with others  https://review.openstack.org/50699105:37
openstackgerritcaoyuan proposed openstack/kolla-ansible master: Change the "shell" to "command" for consistence  https://review.openstack.org/50699105:38
openstackgerritcaoyuan proposed openstack/kolla-ansible master: Change the "shell" to "command" for consistence  https://review.openstack.org/50699105:40
*** kevzha01 has joined #openstack-kolla05:40
spsuryakrtaylor: inc0 gema please check this https://blueprints.launchpad.net/kolla-ansible/+spec/ka-queens-doc-restructure05:45
spsuryaI think completion of this will restructure kolla-ansible doc05:46
*** caowei has joined #openstack-kolla05:50
*** caowei has quit IRC05:53
*** caowei has joined #openstack-kolla05:56
spsuryakrtaylor has already launched for kolla one https://blueprints.launchpad.net/kolla/+spec/queens-doc-restructure06:07
openstackgerritWei Zheng proposed openstack/kolla-kubernetes master: Update the documentation link for doc migration  https://review.openstack.org/50699506:07
openstackgerritWei Zheng proposed openstack/kolla-kubernetes master: Update the documentation link for doc migration  https://review.openstack.org/50699506:11
*** yingjun has joined #openstack-kolla06:11
*** ArminderSingh- has quit IRC06:13
*** zhurong has joined #openstack-kolla06:14
openstackgerritMerged openstack/kolla master: Fix warning during tox -e genconfig  https://review.openstack.org/50618906:15
*** ArminderSingh has joined #openstack-kolla06:18
*** magicboiz has joined #openstack-kolla06:23
*** magicboiz has quit IRC06:30
*** magicboiz has joined #openstack-kolla06:31
*** unicell has joined #openstack-kolla06:31
*** dardelean_ has joined #openstack-kolla06:40
*** dardelean_ has quit IRC06:41
openstackgerritDuong Ha-Quang proposed openstack/kolla-ansible master: Specify 'become' to necessary tasks (general roles)  https://review.openstack.org/39868206:52
*** yingjun has quit IRC06:52
openstackgerritMerged openstack/kolla-ansible master: Fix rabbitmq tag not match in fluentd  https://review.openstack.org/50319006:56
*** jascott1 has quit IRC06:56
*** dardelean_ has joined #openstack-kolla07:00
*** dardelean_ has quit IRC07:05
*** pcaruana has joined #openstack-kolla07:06
*** unicell has quit IRC07:07
*** robbbe has quit IRC07:08
*** seanmurphy has joined #openstack-kolla07:10
*** zhurong has quit IRC07:14
openstackgerritSurya Prakash (spsurya) proposed openstack/kolla-ansible master: Restrustured the doc of kolla-ansible  https://review.openstack.org/50700407:22
*** zhurong has joined #openstack-kolla07:32
openstackgerritcaoyuan proposed openstack/kolla-ansible master: Change the "shell" to "command" for consistence  https://review.openstack.org/50699107:38
openstackgerritcaoyuan proposed openstack/kolla-ansible master: Change the "shell" to "command" for consistence  https://review.openstack.org/50699107:39
*** hieulq has quit IRC07:45
*** egonzalez has joined #openstack-kolla07:47
*** shardy has joined #openstack-kolla07:55
*** gkadam is now known as gkadam-afk07:55
*** dardelean_ has joined #openstack-kolla07:57
*** serlex has joined #openstack-kolla07:58
*** pron has quit IRC07:59
openstackgerritSurya Prakash (spsurya) proposed openstack/kolla-ansible master: Restrustured the doc of kolla-ansible  https://review.openstack.org/50700407:59
openstackgerritcaoyuan proposed openstack/kolla-ansible master: Optimize the yaml format  https://review.openstack.org/50699107:59
openstackgerritcaoyuan proposed openstack/kolla-ansible master: Optimize the yaml format for Barbican check.yml  https://review.openstack.org/50699108:01
dardelean_hi08:09
egonzalezdardelean_, sup08:17
egonzalezspsurya, around?08:17
spsuryaegonzalez: regarding this IIUC https://review.openstack.org/#/c/50700408:18
egonzalezspsurya, yep08:18
egonzalezspsurya, is developer section meant to only kolla dev process or for any other dev ?08:19
*** pron has joined #openstack-kolla08:20
spsuryaegonzalez: i think for kolla only08:20
spsuryaegonzalez: can you please check the PS08:21
spsuryahttps://review.openstack.org/#/c/50700408:21
*** athomas has joined #openstack-kolla08:21
spsuryai just moved few files to new places08:21
egonzalezspsurya, yeah, that's why im asking :)08:22
spsuryain my undestanding08:22
egonzalezkolla dev mode is for openstack devs, not kolla devs08:22
egonzalezjust wondering about if should be placed in developer section08:22
spsuryaegonzalez: agree i also in a bit confusion08:24
*** aagate has quit IRC08:24
spsuryai thought contribution to upstream in kolla or in openstack should go to contributor08:25
spsuryathat is why I put there :)08:25
spsuryaegonzalez08:25
openstackgerritBertrand Lallau proposed openstack/kolla-ansible master: Fluentd: fix duplicate log level naming  https://review.openstack.org/49833108:26
spsuryaegonzalez->  need your opinion on my view08:26
*** liujiong has joined #openstack-kolla08:26
*** gfidente has joined #openstack-kolla08:32
*** gfidente has quit IRC08:32
*** gfidente has joined #openstack-kolla08:32
*** zhurong has quit IRC08:32
*** gfidente is now known as gfidente|pto08:32
*** aagate has joined #openstack-kolla08:34
*** gkadam-afk is now known as gkadam08:41
*** rwsu has joined #openstack-kolla08:43
openstackgerritMerged openstack/kolla stable/pike: Install multipath binary in nova-compute image  https://review.openstack.org/50694208:43
openstackgerritMerged openstack/kolla master: Improvement in Opendaylight doc  https://review.openstack.org/50693708:43
openstackgerritDuong Ha-Quang proposed openstack/kolla-ansible master: Specify 'become' for only necessary tasks (default roles)  https://review.openstack.org/39868408:45
openstackgerritDuong Ha-Quang proposed openstack/kolla-ansible master: Specify 'become' for only neccesary tasks (all other roles)  https://review.openstack.org/39868508:45
*** zhurong has joined #openstack-kolla08:51
openstackgerritPierre Hanselmann proposed openstack/kolla-ansible master: Horizon multidomain support  https://review.openstack.org/50702008:52
openstackgerritMerged openstack/kolla-ansible master: Add ipc_mode=host for nova-compute conainer  https://review.openstack.org/49870408:52
ZopharWow pretty fast Eduardo08:54
Zophar;)08:55
ZopharSo i guess i don't do it the right way...08:55
ZopharBut the point is that i don't want to overide the whole config file....08:56
*** jascott1 has joined #openstack-kolla08:56
ZopharWill take a look at group_vars/all... thanks.08:57
egonzalezZophar, yeah, the change is worth, just i dont think each variable should be in globals, they could be in group_vars or default, which users can override in their globals.yml (release note is also good for this  ;))08:58
*** jascott1 has quit IRC09:01
Jeffrey4legonzalez, about https://review.openstack.org/506529 this patch.  what do u think about the disable selinux on master?09:01
egonzalezJeffrey4l, i think we should or keep  the var to False, or add a release note with a big warning on it09:01
Jeffrey4lok.09:03
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible stable/pike: Fix ci gate failure  https://review.openstack.org/50652909:05
openstackgerritWei Zheng proposed openstack/kolla-kubernetes master: writing convention: do not use “-y” for package install  https://review.openstack.org/50702609:14
*** lpetrut has joined #openstack-kolla09:20
*** pbourke has quit IRC09:22
*** pbourke has joined #openstack-kolla09:23
openstackgerritMerged openstack/kolla-ansible master: Add /lib/modules as volume to openvswitch_db container  https://review.openstack.org/49717609:23
openstackgerritzhongshengping proposed openstack/kolla-ansible stable/pike: Add ipc_mode=host for nova-compute conainer  https://review.openstack.org/50702809:25
openstackgerritzhongshengping proposed openstack/kolla-ansible stable/ocata: Add ipc_mode=host for nova-compute conainer  https://review.openstack.org/50702909:25
openstackgerritMerged openstack/kolla-ansible master: Added open-iscsi to default removals  https://review.openstack.org/47922609:27
*** jaosorior has joined #openstack-kolla09:28
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible stable/pike: Config my_ip to api_interface_address in cinder.conf  https://review.openstack.org/50703209:33
openstackgerritSurya Prakash (spsurya) proposed openstack/kolla master: [WIP] Fixing the running of keystone  https://review.openstack.org/46495309:43
ZopharStupid question... how can i add release note in my patches? I don't find any documentation about this topic... there's a release/notes folder ok... but what this sha1 in the filename?09:51
openstackgerritzhongshengping proposed openstack/kolla-ansible stable/pike: Fix ci gate failure  https://review.openstack.org/50652909:52
spsuryaegonzalez: your eyes like eagle ;)09:53
spsuryasharp review09:53
spsuryathanks09:53
egonzalezZophar, pip install reno https://docs.openstack.org/reno/latest/user/usage.html09:54
egonzalezZophar, then reno new <Title> , will create a file in releasenotes folder09:54
ZopharThanks09:55
openstackgerritStig Telfer proposed openstack/kolla-ansible master: Fix kolla-ansible genconfig for mariadb  https://review.openstack.org/50684309:56
kolla-slack<oxkipo> hey jamesbenson, so you are stuck on ocata??10:01
kolla-slack<oxkipo> I have successfully booted a uefi vm in openstack10:01
*** livelace has quit IRC10:03
openstackgerritoctopuszhang proposed openstack/kolla master: remove KOLLA_SKIP_EXTEND_START  https://review.openstack.org/50704310:04
spsuryaegonzalez: IIUC, i need to make all fernet services run as keystone rather than root in kolla-ansible to fix this.10:05
spsuryaotherwise keystone will run as root10:05
egonzalezmandre, are you in tripleo using KOLLA_SKIP_EXTEND_START ? re  https://review.openstack.org/50704310:05
openstackgerritoctopuszhang proposed openstack/kolla master: remove KOLLA_SKIP_EXTEND_START  https://review.openstack.org/50704310:07
*** tovin07_ has quit IRC10:10
*** duonghq has quit IRC10:10
*** tovin07_ has joined #openstack-kolla10:11
*** duonghq has joined #openstack-kolla10:11
*** liujiong has quit IRC10:12
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible stable/pike: Fix ci gate failure  https://review.openstack.org/50652910:15
*** tovin07_ has quit IRC10:17
*** zhurong has quit IRC10:21
*** zhurong has joined #openstack-kolla10:24
*** caowei has quit IRC10:29
mandreegonzalez: hey, thanks for the heads-up, we're not using KOLLA_SKIP_EXTEND_START10:30
openstackgerritMerged openstack/kolla master: Add neutron-fwaas-dashboard into horizon image  https://review.openstack.org/50691010:31
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible master: WIP: Document release process  https://review.openstack.org/50705310:41
*** hieulq has joined #openstack-kolla10:50
*** mewald has joined #openstack-kolla10:50
*** yangyapeng has quit IRC11:05
lxdongwhen stopping docker of all nodes then start ,mariadb keeps restarting, used kolla-ansible mariadb_recovery  and reconfigure but can't create instance.11:05
*** livelace has joined #openstack-kolla11:06
lxdongDoes it  mean  if I restart docker of all node, I have to redeploy ?11:08
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible master: WIP: fix deploy-guide links  https://review.openstack.org/50705811:08
*** japestinho has joined #openstack-kolla11:09
kolla-slack<britthouser> @lxdong.007 - if all your mariadb containers were stopped simultaneously, then you need to perform lights out recovery of your cluster.11:13
lxdongwhat is lights out recovery .11:15
openstackgerritPierre Hanselmann proposed openstack/kolla-ansible master: Horizon multidomain support  https://review.openstack.org/50706011:15
Zopharpfew... what a shame... my git-review command did some scrap (me as well)... sorry11:18
kolla-slack<britthouser> MariaDB is seutp to use galera clustering.  Galera expects at least one node to always be available for quorum.  If all nodes go offline, you have to start them backup in the reverse order how they went down.   So if you did a `docker stop` on node 1->2->3, then you need to bring Node3 back online first, then 2, then 1.  Make sense?11:19
kolla-slack<britthouser> If this is just a sandbox deployment, time-wise its probably easier to re-deploy.11:20
mewaldPlease review https://review.openstack.org/#/c/485150/11:21
*** clayton has quit IRC11:25
openstackgerritMerged openstack/kolla-ansible master: Make the pg and pgp value configurable  https://review.openstack.org/50484511:27
*** clayton has joined #openstack-kolla11:30
lxdongbritthouser ,makes sense enough, I don't remember which stopped first but tried both since my cluster has two compute nodes, no matter I started 2 first or 1 first, it keeps restarting about every 37 seconds.11:33
*** mewald has quit IRC11:36
lxdongIs there only two ways in this situation, lights out recovery and re-deploy? It seems lights out recovery doesn't work.11:38
*** rhallisey has joined #openstack-kolla11:42
*** jascott1 has joined #openstack-kolla11:55
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible master: Fix deploy-guide links  https://review.openstack.org/50705811:58
*** jascott1 has quit IRC11:59
*** Croata2 has joined #openstack-kolla12:03
*** goldyfruit has joined #openstack-kolla12:09
*** goldyfruit has quit IRC12:09
*** awiddersheim has joined #openstack-kolla12:11
*** sambetts|afk is now known as sambetts12:13
*** awidders_ has quit IRC12:14
*** yangyapeng has joined #openstack-kolla12:20
openstackgerritSurya Prakash (spsurya) proposed openstack/kolla-ansible master: drop keystone running as root  https://review.openstack.org/50707812:22
openstackgerritSurya Prakash (spsurya) proposed openstack/kolla master: [WIP] Fixing the running of keystone  https://review.openstack.org/46495312:35
*** gfidente|pto is now known as gfidente12:36
kolla-slack<britthouser> @lxdong - have a look at https://docs.openstack.org/kolla-ansible/latest/user/operating-kolla.html12:36
kolla-slack<britthouser> there are playbooks todo the recovery12:36
*** gkadam has quit IRC12:36
*** ansmith has joined #openstack-kolla12:36
openstackgerritMerged openstack/kolla-ansible master: Fix kolla-ansible genconfig for mariadb  https://review.openstack.org/50684312:37
*** erlon has joined #openstack-kolla12:38
*** zhurong has quit IRC12:50
*** awiddersheim has quit IRC12:57
*** awidders_ has joined #openstack-kolla12:58
*** goldyfruit has joined #openstack-kolla12:58
*** huzhengchuan has quit IRC13:02
*** lakerzhou has joined #openstack-kolla13:03
*** jistr is now known as jistr|mtg13:03
*** awidders_ has quit IRC13:04
*** awiddersheim has joined #openstack-kolla13:05
*** jtriley has quit IRC13:11
openstackgerritMerged openstack/kolla-ansible master: Fluentd: reduce CPU and I/O consumption  https://review.openstack.org/50186413:15
openstackgerritBertrand Lallau proposed openstack/kolla-ansible master: Enhance logrotate config file generation  https://review.openstack.org/49759813:19
*** larsks has quit IRC13:20
*** larsks has joined #openstack-kolla13:23
openstackgerritPierre Hanselmann proposed openstack/kolla-ansible master: Horizon multidomain flag  https://review.openstack.org/50709613:23
*** jtriley has joined #openstack-kolla13:27
openstackgerritMerged openstack/kolla-ansible master: Enable neutron fwaas dashboard dynamically  https://review.openstack.org/50691113:28
openstackgerritPierre Hanselmann proposed openstack/kolla-ansible master: Horizon multidomain flag  https://review.openstack.org/50709913:28
*** jistr|mtg is now known as jistr13:29
rwellumCan anyone explain to me how the images are tagged in the tarball repo? Just found out that pike is now 5.0.1 - which explains why 5.0.0 was not finding images. I'd like to know what 'master' is tagged at for example.13:32
rwellumMorning btw!13:32
*** gfidente has quit IRC13:33
*** athomas has quit IRC13:34
*** coolsvap has quit IRC13:35
egonzalezrwellum, version is based on pbr, ie: in stable/pike, version installed with pip is 5.0.0, but in git repo is pip version +1 = 5.0.113:36
egonzalezrwellum, https://github.com/openstack/kolla/blob/master/kolla/version.py#L15 which is the value applied to tag in build command if not specified13:37
*** lakerzhou has quit IRC13:37
*** huzhengchuan has joined #openstack-kolla13:37
egonzalezrwellum, master still 5.0.0 because there is no 6.0.0 release yet for pbr13:39
rwellumegonzalez: thanks - so you're saying 5.0.1 is correct then?13:40
*** athomas has joined #openstack-kolla13:40
egonzalezrwellum, if using local build from git yes13:40
egonzalezrwellum, you can tag --tag to whatever version need13:40
rwellumI'm using docker registry to get the pike tarball from http://tarballs.openstack.org/kolla/images/13:41
*** dave-mccowan has joined #openstack-kolla13:41
rwellumOur gate is expecting 5.0.0 - so suspecting we'll see it break13:42
egonzalezrwellum, gates should expect 5.0.0 in master and 5.0.1 in pike , example of a success gate for stable/pike, see images used http://logs.openstack.org/29/506529/6/check/gate-kolla-ansible-dsvm-deploy-centos-binary-centos-7-nv/8291957/logs/system_logs/docker-info.txt.gz13:43
*** mewald has joined #openstack-kolla13:44
egonzalezrwellum, *at least in ansible, k8s probably need the same, we gather version during runtime https://github.com/openstack/kolla-ansible/blob/master/ansible/site.yml#L3413:44
*** mewald has quit IRC13:46
*** jheroux has joined #openstack-kolla13:49
*** lrensing has joined #openstack-kolla13:50
*** bswartz has quit IRC13:50
rwellumNice  egonzalez I'll play with that logic a bit.13:53
rwellumI think current registry for k8s uses master and 5.0.0 - hence it just works.13:53
*** lrensing has quit IRC14:00
*** mewald has joined #openstack-kolla14:14
*** mdnadeem has quit IRC14:16
openstackgerritPierre Hanselmann proposed openstack/kolla-ansible stable/pike: WSGI configuration missing directive  https://review.openstack.org/50712114:17
*** jtriley has quit IRC14:19
*** hongbin has joined #openstack-kolla14:20
*** livelace2 has joined #openstack-kolla14:20
openstackgerritGaëtan Trellu proposed openstack/kolla-ansible master: Wrong secure_proxy_ssl_header value in nova.conf.j2 template  https://review.openstack.org/50713114:22
*** BlartVersenwald is now known as NobodyCam14:22
*** jtriley has joined #openstack-kolla14:23
*** livelace2 has quit IRC14:35
*** jtriley has quit IRC14:36
*** athomas has quit IRC14:39
*** bmace has quit IRC14:42
*** bmace has joined #openstack-kolla14:43
*** athomas has joined #openstack-kolla14:44
*** livelace2 has joined #openstack-kolla14:49
*** lrensing has joined #openstack-kolla14:49
*** jamesbenson has joined #openstack-kolla14:50
*** jtriley has joined #openstack-kolla14:54
openstackgerritBradley Jones proposed openstack/kolla-kubernetes master: Deploy playbook using microservices  https://review.openstack.org/47358815:14
*** athomas has quit IRC15:20
*** athomas has joined #openstack-kolla15:23
*** serlex has quit IRC15:26
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible master: Config my_ip to api_interface_address in cinder.conf  https://review.openstack.org/50717415:27
openstackgerritMerged openstack/kolla-ansible master: Optimize the yaml format for Barbican check.yml  https://review.openstack.org/50699115:28
openstackgerritJeffrey Zhang proposed openstack/kolla stable/ocata: Bump OpenStack service version  https://review.openstack.org/50697815:30
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible master: Config my_ip to api_interface_address in cinder.conf  https://review.openstack.org/50717415:30
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible stable/pike: Fix ci gate failure  https://review.openstack.org/50652915:32
*** pcaruana has quit IRC15:33
kfox1111morning.15:33
*** pcaruana has joined #openstack-kolla15:34
openstackgerritKevin Fox proposed openstack/kolla-kubernetes master: WIP update init containers from json to yaml.  https://review.openstack.org/50576115:35
mewaldplease review: https://review.openstack.org/#/c/485150/ https://review.openstack.org/#/c/486379/ https://review.openstack.org/#/c/488367/15:37
*** ntpttr_laptop has joined #openstack-kolla15:39
*** ntpttr_laptop has quit IRC15:41
*** ntpttr_laptop has joined #openstack-kolla15:41
*** ntpttr_laptop has quit IRC15:41
*** rhallisey has quit IRC15:43
openstackgerritKevin Fox proposed openstack/kolla-kubernetes master: WIP: shared netns support.  https://review.openstack.org/50543615:45
kfox1111heh. looks like they are actually removing init container alpha/beta from 1.8.15:47
kfox1111so we for sure need to land the port soon.15:47
openstackgerritMathias Ewald proposed openstack/kolla-ansible master: Add role to deploy prometheus  https://review.openstack.org/48515015:49
*** janki has quit IRC15:52
jamesbensonhey, does anyone else get this error: Cannot check dnsmasq binary /usr/sbin/dnsmasq: No such file or directory.  it's under libvirtd.log15:52
jamesbensonI'm assuming that this is the reason why my hypervisor shows I have no vCPU, memory, or disk...15:52
*** jascott1 has joined #openstack-kolla15:57
manjeetsSamYaple, no i didn't use dpdk15:59
*** sbezverk has quit IRC16:00
*** egonzalez has quit IRC16:01
*** jascott1 has quit IRC16:01
*** zhangfei has joined #openstack-kolla16:05
*** lrensing has left #openstack-kolla16:05
openstackgerritKevin Fox proposed openstack/kolla-kubernetes master: WIP update init containers from json to yaml.  https://review.openstack.org/50576116:08
*** jascott1 has joined #openstack-kolla16:09
*** jascott1 has quit IRC16:10
*** itlinux has joined #openstack-kolla16:12
*** pcaruana has quit IRC16:15
*** itlinux has quit IRC16:15
*** lpetrut has quit IRC16:16
*** seanmurphy has quit IRC16:18
*** zhangfei has quit IRC16:22
*** gkadam has joined #openstack-kolla16:24
openstackgerritKevin Fox proposed openstack/kolla-kubernetes master: WIP update init containers from json to yaml.  https://review.openstack.org/50576116:25
inc0good morning16:27
*** itlinux has joined #openstack-kolla16:27
mewaldmorning :)16:28
kfox1111morning16:29
kfox1111inc0: we get our job secrets yet?16:29
*** rob_d has joined #openstack-kolla16:33
*** athomas has quit IRC16:38
*** dardelean_ has quit IRC16:39
*** athomas has joined #openstack-kolla16:39
*** gkadam has quit IRC16:42
openstackgerritKevin Fox proposed openstack/kolla-kubernetes master: WIP update init containers from json to yaml.  https://review.openstack.org/50576116:43
*** unicell has joined #openstack-kolla16:45
*** unicell has quit IRC16:46
*** livelace2 has quit IRC16:47
*** jtriley has quit IRC16:49
*** rhallisey has joined #openstack-kolla16:53
openstackgerritBradley Jones proposed openstack/kolla-kubernetes master: Deploy playbook using microservices  https://review.openstack.org/47358816:53
*** livelace has quit IRC16:59
*** lpetrut has joined #openstack-kolla17:00
*** rob_d has quit IRC17:00
*** livelace2 has joined #openstack-kolla17:01
*** athomas has quit IRC17:01
*** athomas has joined #openstack-kolla17:03
*** dardelean_ has joined #openstack-kolla17:08
*** sbezverk has joined #openstack-kolla17:09
*** masber has quit IRC17:10
*** dardelean_ has quit IRC17:12
openstackgerritKevin Fox proposed openstack/kolla-kubernetes master: WIP update init containers from json to yaml.  https://review.openstack.org/50576117:14
*** faridda has joined #openstack-kolla17:17
*** harlowja has joined #openstack-kolla17:20
*** jtriley has joined #openstack-kolla17:25
inc0kfox1111: mordred says they migrate today17:33
*** egonzalez has joined #openstack-kolla17:33
openstackgerritKurt Taylor proposed openstack/kolla master: Kolla Documentation Restructuring  https://review.openstack.org/50480117:40
* inc0 is sad that docker registry doesn't know how to ceph17:45
kfox1111cool. thanks.17:45
kfox1111inc0: I think radosgw + docker-registry is still an option.17:45
kfox1111though a little less direct.17:45
kfox1111OR,17:45
kfox1111I think docker-registry + cephfs might work too. not sure on that one.17:45
inc0can't find good example of it, there are some incompatibilities with S3217:46
inc0S317:46
kfox1111if the latter works, that would be my preference.17:46
inc0cephfs over radosgw?17:46
kfox1111no.17:46
kfox1111cephfs direct.17:46
inc0what I meant cephfs > radosgw17:46
inc0but yeah that should just work17:47
kfox1111rados gw claims to support an nfs export mode too.17:47
inc0-v /dir/on/cephfs:/var/lib/registry17:47
kfox1111right.17:47
kfox1111I think that works, but not 100% sure there arne't locking issues.17:47
kfox1111would be good to verify that with the ceph/docker-registry folks.17:47
inc0well unless you are careful with saving stuff17:48
*** itlinux has quit IRC17:48
inc0I don't see anything that couldn't work17:48
kfox1111well, it depends on if you have more then one, and what caching they assume is done.17:48
kfox1111if it caches too heavily and never invalidates unless its write through, it could cause big problems.17:48
inc0yeah, weell that's not registry specific problem tho17:49
kfox1111yes/no.17:49
kfox1111it could be considered an architectural issue with the registry.17:49
kfox1111or they could just say "don't do that".17:49
inc0right, what I meant is we need to fine-tune ceph for that17:50
kfox1111or fine tune registry.17:50
inc0registry is not super fine-tunable on the way it works tho17:50
kfox1111its a question of, does multiple instances of the registry work properly with a shared filesystem.17:50
kfox1111could be nfs, ceph, gluster, etc.17:50
kfox1111not cephfs specific.17:50
inc0I also need to check registry+swift17:50
inc0I don't think you can deploy swift over ceph with kolla now17:51
kfox1111yeah. thats another way to do radosgw too.17:51
kfox1111swift with the ceph plugin?17:51
inc0yeah, I'm ignorant about swift but I think it has it17:51
kfox1111yeah. it does. never tried it either.17:51
kfox1111seemed like a big lift for questionable benifit.17:52
inc0it's kinda pointless to use it since well, you're just adding API translation layer17:52
inc0right, that17:52
kfox1111it lets you use things like swiftlets. but still not sure how well they would perform in that env.17:52
kfox1111anyway. kind of putting the cart before the horse a bit though too.17:53
kfox1111you need a  good registry to deploy the openstacky things.17:53
kfox1111so better off not depending on them.17:53
kfox1111or you get in a strange loop.17:53
kfox1111cephfs is one good option to break the loop.17:53
inc0well it's my understanding that infra already have swift installation17:53
inc0so we can just use it17:53
kfox1111oh. we're talking about for infra?17:54
inc0ultimately, yes17:54
inc0locally I'd go cephfs17:54
kfox1111yeah, for infra, swift may be the easiest.17:54
kfox1111I'd try that one first I think.17:54
kfox1111since they are pushing back on something as simple as running a service in a container...17:54
kfox1111asking them to do something with ceph would be out of the question.17:54
inc0right, and we don't want to get into hell of replicating registry across nodepools17:55
inc0I'll get to them with this decision when they're done with zuulv317:56
inc0they have biggest issues to focus on right now;)17:56
kfox1111kk17:57
*** itlinux has joined #openstack-kolla17:59
spsuryainc0: kfox1111 morning17:59
kfox1111morning.18:05
*** sambetts is now known as sambetts|afk18:07
*** mewald has left #openstack-kolla18:10
*** lpetrut has quit IRC18:11
*** livelace2 has quit IRC18:12
*** rwsu has quit IRC18:13
*** seanmurphy has joined #openstack-kolla18:14
openstackgerritKevin Fox proposed openstack/kolla-kubernetes master: WIP update init containers from json to yaml.  https://review.openstack.org/50576118:15
*** livelace2 has joined #openstack-kolla18:25
*** robbbe has joined #openstack-kolla18:27
*** jtriley has quit IRC18:29
*** livelace2 has quit IRC18:30
kfox1111rwellum: got time to do the resolve.conf removal today or should I put up a ps?18:31
*** jtriley has joined #openstack-kolla18:32
*** jamesbenson has quit IRC18:37
*** livelace2 has joined #openstack-kolla18:38
*** jamesbenson has joined #openstack-kolla18:40
*** jtriley has quit IRC18:43
*** livelace2 has quit IRC18:44
*** unicell has joined #openstack-kolla18:47
*** itlinux has quit IRC18:51
*** jtriley has joined #openstack-kolla18:52
*** yangyape_ has joined #openstack-kolla18:54
*** yangyapeng has quit IRC18:55
*** dave-mccowan has quit IRC18:56
*** livelace2 has joined #openstack-kolla18:56
openstackgerritOpenStack Proposal Bot proposed openstack/kolla-ansible master: Updated from global requirements  https://review.openstack.org/50464518:57
*** lpetrut has joined #openstack-kolla19:09
openstackgerritKevin Fox proposed openstack/kolla-kubernetes master: WIP update init containers from json to yaml.  https://review.openstack.org/50576119:12
*** jascott1 has joined #openstack-kolla19:13
*** lpetrut has quit IRC19:14
*** vhosakot has joined #openstack-kolla19:16
*** lrensing has joined #openstack-kolla19:16
*** robbbe has quit IRC19:17
*** dave-mccowan has joined #openstack-kolla19:24
*** dave-mccowan has quit IRC19:32
*** rwsu has joined #openstack-kolla19:32
*** dave-mccowan has joined #openstack-kolla19:32
*** itlinux has joined #openstack-kolla19:35
vhosakotsilent Monday eh?19:42
kfox1111indeed.19:43
openstackgerritKevin Fox proposed openstack/kolla-kubernetes master: Remove the resolv.conf workaround  https://review.openstack.org/50725219:43
jascott1anyone ever run one of the operators (etcd or prometheus) ? Im having timeouts when those operators are trying to hit my k8s API19:54
jascott1from a node I can hit the API w curl if I run --insecure19:54
kfox1111I have not tried either of those yet.19:56
kfox1111how did you deploy your k8s?19:57
kfox1111out of the box, it should have some amount of ability to talk back to your apiserver.19:57
jascott1yeah I thought that the nodes got the certs they need to talk to secure api but doesnt seem like it20:03
jascott1i am using playbook modeled after the kolla-k8s deployment guide20:04
jascott1dns works from container20:04
jascott1thanks I will prob poke people in kubernetes-users :)20:05
*** egonzalez has quit IRC20:05
kfox1111jascott1: yeah, there is a plugin in the apiserver that injects contact info into each pod.20:06
*** seanmurphy has quit IRC20:06
*** robbbe has joined #openstack-kolla20:06
kfox1111it normally is deployed using kubeadm. so if you are using that, it should work.20:07
kolla-slack<jascott1> yeah I am using kubeadm20:07
inc0jascott1: I had this issue with flannel tho20:07
inc0switching to weave fixed it20:07
inc0check yo tiller20:08
jascott1yeah Im re-trying with weave20:08
inc0it needs same kind of access20:08
jascott1true, tiller is working20:08
inc0so see what's different20:08
inc0maybe it's per-namespace?20:08
kfox1111it can be an rbac issue too. if you havent given permissions to a service account to do some of the things you want it to do.20:09
kfox1111kubeadm is defaulting rbac on these days.20:09
kfox1111inc0: which, btw, we should come up with a solution for. we're working around them in kolla right now in a far less then ideal way.20:10
kfox1111probably should be a 1.0 blocker....20:10
kfox1111kind of forgot about it.20:10
kfox1111can you please add it to the list?20:10
inc0right, init containers20:10
kfox1111i've got ps's up for init containers, helm parent values and removing the resolv.conf workaround currently.20:11
inc0added to list20:11
kfox1111thx.20:11
kfox1111there we go... init-container ps is almost passing all the gates....20:12
kfox1111it looks SOO much nicer not in json in yaml. :)20:12
jascott1do you know if RBAC would cause timeouts?20:13
jascott1thats what I am seeing20:13
kfox1111shoudln't cause timeouts. just permission denied.20:15
kfox1111firewall enabled? I've seen that one cause timeouts.20:15
jascott1shouldnt be but will double check20:16
*** jtriley has quit IRC20:18
*** jtriley has joined #openstack-kolla20:22
*** robbbe has quit IRC20:30
*** zhubingbing has quit IRC20:36
jascott1inc0 yup after updating everything to 1.7, weave works where canal still has that problem20:46
kfox1111did you load the canal rbac yaml?20:48
inc0jascott1: exactly what I experienced, I got to a point that it gets dropped in iptables made by flannel20:48
jascott1kfox1111 yeah the playbook loads the canal rbac when canal is used. I did update it to 1.7 and thought that might fix canal but no good20:50
*** ansmith has quit IRC20:50
-openstackstatus- NOTICE: The infra team is bringing Zuul v3 online; expect service disruptions and please see https://docs.openstack.org/infra/manual/zuulv3.html for more information.20:50
kfox1111weird. I've ran into very few issues with canal.20:52
kfox1111yay for zuul v3! :)20:52
kfox1111(or maybe that's premature... maybe I should yay after it works. ;)20:52
jascott1haha20:52
*** itlinux has quit IRC20:56
jamesbensoninc0: have a few minutes?21:07
inc0shoot jamesbenson21:07
jamesbensonI had issues with kolla5, so I redeployed 4.0.2.  But, same issues to a degree.21:08
jamesbensonThe issue is that hypervisor isn't populating21:08
*** jascott1 has quit IRC21:08
jamesbensonsome compute nodes are up and enabled, others enabled but down.21:08
jamesbensonbut no vcpus's, ram, disk21:09
jamesbensoncould this be related to external ceph?21:09
inc0hmm unliekly21:09
inc0check logs of nova-compute21:09
inc0on down nodes21:09
jamesbensonhttp://paste.openstack.org/show/621878/ looks like it has issues contacting my controllers on 192.168.2.1 and .3 and .521:12
jamesbensonthey can ping all of the controller nodes21:13
jamesbensonthe port on my controller, 5672, is listening21:14
jamesbensonnot sure what else to check :-/21:15
*** vhosakot has quit IRC21:16
*** jascott1 has joined #openstack-kolla21:17
*** vhosakot has joined #openstack-kolla21:17
*** jtriley has quit IRC21:18
inc0telnet ip:port from compute node?21:22
inc0rabbitmq is misbehaving again21:22
jamesbensontelnet: could not resolve 192.168.2.5:5672/telnet: Temporary failure in name resolution21:22
inc0who can help me reconfigure our rabbitmq so it'll cluster correctly?21:23
inc0but yeah, it failst to connect to ceph too21:23
jamesbensondang, a rabbitmq issue then?21:23
inc0sooo...networking issues?21:23
inc0well, you have errors from both ceph and rabbit21:24
inc0so looks like networking21:24
jamesbensonhmmm...21:24
jamesbensonodd.. okay21:24
openstackgerritKevin Fox proposed openstack/kolla-kubernetes master: Update init containers  https://review.openstack.org/50576121:32
jamesbensoninc0: i know this isn't a fair question, but idea idea on what part of networking?  I'm sort of at a loss on where it might be failing.  These were fresh ubuntu 16.04.3 LTS nodes.21:33
inc0hard to tell, try running ping for a while and see if there is any drops21:34
jamesbensonfrom compute to controller?21:35
*** dardelea_ has joined #openstack-kolla21:36
*** jheroux has quit IRC21:36
*** dave-mccowan has quit IRC21:43
*** shardy has quit IRC21:47
inc0jamesbenson: right21:47
jamesbensonnothing unusually... all pinged... one thing I did do, was deploy all on xenial (ga-16.04-lowlatency)....21:48
jamesbensonman, I think tomorrow i'm going to have to go back to regular kernel and verify....21:48
*** Croata2 has quit IRC21:52
inc0didn't yopu have issues with lowlatency before?21:53
*** rwsu has quit IRC21:57
*** jamesbenson has quit IRC21:59
*** jamesbenson has joined #openstack-kolla22:02
*** jamesbenson has quit IRC22:06
openstackgerritKevin Fox proposed openstack/kolla-kubernetes master: Update init containers  https://review.openstack.org/50576122:10
*** Slower has quit IRC22:25
*** dave-mccowan has joined #openstack-kolla22:44
*** Slower has joined #openstack-kolla22:52
*** lrensing has quit IRC22:56
*** dave-mcc_ has joined #openstack-kolla23:04
*** daidv has quit IRC23:07
*** zhangfei has joined #openstack-kolla23:07
*** hieulq has quit IRC23:07
*** duonghq has quit IRC23:07
*** dave-mccowan has quit IRC23:07
*** ansmith has joined #openstack-kolla23:13
*** faridda has quit IRC23:19
*** aagate has quit IRC23:24
*** lrensing has joined #openstack-kolla23:27
*** jascott1_ has joined #openstack-kolla23:27
*** jascott1 has quit IRC23:28
*** hongbin has quit IRC23:29
*** daidv has joined #openstack-kolla23:30
*** vhosakot has quit IRC23:34
*** itlinux has joined #openstack-kolla23:36
*** daidv has quit IRC23:36
*** dardelea_ has quit IRC23:39
*** masber has joined #openstack-kolla23:48
*** lrensing has quit IRC23:51
*** lrensing has joined #openstack-kolla23:55
*** lrensing has quit IRC23:55

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!