Friday, 2017-11-10

*** salv-orlando has joined #openstack-kolla00:02
*** salv-orlando has quit IRC00:06
*** klindgren has joined #openstack-kolla00:21
*** klindgren has quit IRC00:34
*** dan_ardelean has quit IRC00:36
*** newmember has quit IRC00:36
*** david-lyle has joined #openstack-kolla00:42
*** dan_ardelean has joined #openstack-kolla00:51
*** duonghq has joined #openstack-kolla00:53
*** dan_ardelean has quit IRC00:55
*** salv-orlando has joined #openstack-kolla01:03
*** gfidente has quit IRC01:03
*** gfidente has joined #openstack-kolla01:03
*** gfidente has quit IRC01:03
*** gfidente has joined #openstack-kolla01:03
*** kiennt26 has quit IRC01:06
*** salv-orlando has quit IRC01:07
openstackgerritcaoyuan proposed openstack/kolla master: Remove the ignored ceilometer_database_type  https://review.openstack.org/51669901:23
*** jbrooks has quit IRC01:24
*** jbrooks has joined #openstack-kolla01:35
*** jbrooks has quit IRC01:39
*** jbrooks has joined #openstack-kolla01:42
masbergood afternoon, I have a problem where libvirt has lost the instances01:42
masberI would like to register the vms againt to libvirt01:43
masberwhere are the instances files located?01:44
*** salv-orlando has joined #openstack-kolla02:04
*** salv-orlando has quit IRC02:08
inc0masber: /var/lib/docker/volumes/kolla_logs <- this is where logs live02:19
inc0instance files are in nova_compute (same docker dir)02:19
*** xinliang has quit IRC02:36
*** lxdong has joined #openstack-kolla02:45
lxdongMorning, I got a problem, how do we customize the version like using ceph luminous?02:46
lxdongI modified kolla-build.conf [ceph-base] type=url location=/root/v12.2.1.tar.gz02:48
openstackgerritChason Chan proposed openstack/kolla master: Fix the Fluentd image  https://review.openstack.org/51882002:51
lxdongIf I changed docker/base/Dockerfile.j2 `ceph-jewel` to `ceph-luminous` the parse of independencies of package centos-release-openstack confilcts.02:53
*** xinliang has joined #openstack-kolla02:53
*** xinliang has joined #openstack-kolla02:53
*** gaoyanami has joined #openstack-kolla03:06
*** zhubingbing has joined #openstack-kolla03:10
*** zhubingbing__ has joined #openstack-kolla03:17
*** zhubingbing has quit IRC03:18
*** zhubingbing__ has quit IRC03:18
*** zhangfei has joined #openstack-kolla03:18
spsuryasdake: yeah nice strategy for collaboration of Open Source03:20
spsuryathanks03:20
masberhi all, I have a huge issue, I fucked my openstack, then I deiced to rebuild it using kolla-ansible destroy and then kolla-ansible deploy but the problem persists03:23
masberbasically I can't create any instance03:24
masberso kolla-ansible destroy is not cleaning the environment properly03:24
*** mdnadeem has joined #openstack-kolla03:48
*** zhangfei has quit IRC03:48
lxdongTASK [glance : Pulling cephx keyring] ****************************************** fatal: [compute01 -> compute01]: FAILED! => {"changed": false, "cmd": ["docker", "exec", "ceph_mon", "ceph", "auth", "get-or-create", "client.glance", "mon", "allow r", "osd", "allow class-read object_prefix rbd_children, allow rwx pool=images, allow rwx pool=images-cache"], "delta": "0:00:00.313963", "end": "2017-11-10 11:51:07.979898", "failed"03:53
*** kiennt26 has joined #openstack-kolla03:58
*** zhangfei has joined #openstack-kolla04:00
*** salv-orlando has joined #openstack-kolla04:04
*** salv-orlando has quit IRC04:09
*** mdnadeem has quit IRC04:16
*** goutham has quit IRC04:19
*** mdnadeem has joined #openstack-kolla04:31
*** skramaja has joined #openstack-kolla04:33
*** Pavo has joined #openstack-kolla04:46
*** caowei has quit IRC05:04
*** salv-orlando has joined #openstack-kolla05:06
*** itlinux has joined #openstack-kolla05:09
*** salv-orlando has quit IRC05:10
masberhi all, is this the place where the instances are located? /var/lib/docker/volumes/nova_compute/_data/instances/_base05:21
openstackgerritChason Chan proposed openstack/kolla-ansible master: Update the deprecated syntax of fluentd rewrite rules  https://review.openstack.org/51849005:21
*** caowei has joined #openstack-kolla05:25
*** janki has joined #openstack-kolla05:25
*** mason5hb has joined #openstack-kolla05:37
*** itlinux has quit IRC05:39
*** hachi_ has joined #openstack-kolla05:44
lxdongHow to solve this failed: [localhost] (item=(0, {u'fs_uuid': u'', u'journal_device': u'/dev/sdb', u'journal': u'/dev/sdb2', u'partition': u'/dev/sdb1', u'partition_num': u'1', u'journal_num': 2, u'fs_label': u'', u'device': u'/dev/sdb', u'external_journal': False})) => {"changed": true,"failed": true, "item": [0, {"device": "/dev/sdb", "external_journal": false, "fs_label": "", "fs_uuid": "", "journal": "/dev/sdb2", "journal_05:54
lxdongstuck05:54
mason5hbhi guys - I can't deploy "nova-api-create-cell" pod because "nova service-list" and "openstack hypervisor list" is empty.05:56
mason5hbmy env: kolla-kubernetes, centos 7, kolla 5.0.1, multinode05:56
mason5hbI checked most of log files, and There is something slightly strange in nova-compute pod05:57
mason5hbhttps://paste.ubuntu.com/25929888/05:57
*** Pavo has quit IRC06:00
mason5hbmy pods is https://paste.ubuntu.com/25929900/06:00
mason5hbplease let me know how to debug it06:01
*** zshi has joined #openstack-kolla06:01
*** itlinux has joined #openstack-kolla06:02
*** salv-orlando has joined #openstack-kolla06:07
masberinc0, I can't find the instance xml file in /var/lib/docker/volumes/nova_compute06:07
*** hachi_ has quit IRC06:10
*** salv-orlando has quit IRC06:11
*** hachi_ has joined #openstack-kolla06:12
*** yangyape_ has quit IRC06:16
*** zshi has quit IRC06:16
lxdongI used cutomized luminous ceph release to build ceph- containers.06:16
*** salv-orlando has joined #openstack-kolla06:18
*** yangyapeng has joined #openstack-kolla06:21
openstackgerritRuijing proposed openstack/kolla-kubernetes master: update kolla etc example dir  https://review.openstack.org/51884206:28
*** yangyapeng has quit IRC06:30
*** yangyapeng has joined #openstack-kolla06:32
*** dan_ardelean has joined #openstack-kolla06:32
*** dan_ardelean has quit IRC06:36
*** itlinux has quit IRC06:37
*** cah_link has joined #openstack-kolla06:39
*** jaosorior has joined #openstack-kolla06:49
*** coolsvap has joined #openstack-kolla06:59
*** jbadiapa has joined #openstack-kolla07:07
*** dan_ardelean has joined #openstack-kolla07:10
*** dan_ardelean has quit IRC07:13
korean101HI Guys07:19
korean101can i downgrade use kolla-ansible?07:19
*** egonzalez has joined #openstack-kolla07:28
egonzalezmorning07:29
*** xinliang has quit IRC07:29
*** yangyape_ has joined #openstack-kolla07:30
*** zshi has joined #openstack-kolla07:32
*** yangyapeng has quit IRC07:33
*** dardelean has joined #openstack-kolla07:33
*** xinliang has joined #openstack-kolla07:43
*** janki has quit IRC07:44
*** janki has joined #openstack-kolla07:44
*** mandre is now known as mandre_afk07:50
*** mandre_ is now known as mandre07:50
*** zhurong has joined #openstack-kolla07:50
*** gkadam has joined #openstack-kolla07:55
*** dan_ardelean has joined #openstack-kolla08:01
*** dan_ardelean has quit IRC08:01
*** zhurong has quit IRC08:01
*** dan_ardelean has joined #openstack-kolla08:01
*** mgoddard has joined #openstack-kolla08:06
*** magicboiz has joined #openstack-kolla08:08
*** mwall has joined #openstack-kolla08:10
*** magicboiz has quit IRC08:13
*** gkadam has quit IRC08:18
*** gkadam has joined #openstack-kolla08:18
*** magicboiz has joined #openstack-kolla08:19
mason5hbegonzalez, Can you check my problem above?08:20
egonzalezmason5hb, what problem?08:21
mason5hbI am deploying kolla-kubernetes, but when installing nova-compute, a nova-api-create-cell pod dosen't be deployed, because "nova service-list" and "openstack hypervisor list" is empty.08:25
*** gkadam has quit IRC08:25
*** gkadam has joined #openstack-kolla08:25
mason5hbmy env: kolla-kubernetes, centos 7, kolla 5.0.1, multinode08:25
mason5hbI checked most of log files, and There is something slightly strange in nova-compute pod08:26
mason5hbhttps://paste.ubuntu.com/25929888/08:26
mason5hbAn error dosen't occure in any log files (rabbimq.log, nova.log,.....)08:28
*** yangyapeng has joined #openstack-kolla08:31
*** rmart04 has joined #openstack-kolla08:32
mason5hbI think it is related to hostname, most pods use pod-name as a hostname, but nova-compute uses real node name as a hostname..08:33
mason5hbBut, I am not sure..08:33
*** yangyape_ has quit IRC08:34
openstackgerritzhubingbing proposed openstack/kolla-ansible master: Enable showing multiple locations for ceph plugin  https://review.openstack.org/51886408:40
egonzalezmason5hb, is compute pod running? cells are created?08:42
mason5hbYes08:42
mason5hbthis is my whole pods https://paste.ubuntu.com/25930569/08:44
egonzalezafter a few seconds compute appears in nova service-list ?08:44
*** jaosorior is now known as jaosorior_lunch08:45
*** dan_ardelean has quit IRC08:47
openstackgerritzhubingbing proposed openstack/kolla-ansible master: Remove show_image_direct_url for ceph plugin  https://review.openstack.org/51886408:49
mason5hbno, the list is empty08:53
mason5hbI found, an error in nova-api-manage-db..08:53
mason5hbhttps://paste.ubuntu.com/25930606/08:53
*** dan_ardelean has joined #openstack-kolla08:53
*** mgoddard has quit IRC08:54
mason5hbegonzalez, maybe I should create "nova_api.cell_mappings" table08:55
lxdonghave no idea after customizing ceph version to lumious it failed in [TASK Bootstrapping Ceph OSDs]08:55
lxdongluminous08:56
egonzalezmason5hb, so cell creation failed, no cell0 exists then08:56
mason5hbpods regarding creating cell is not crashoff.. so I thought it succeed.08:58
mason5hbthanks egonzalez.08:59
lxdongI rebuild all docker images and deploy ,problem remains.09:00
lxdongI added ceph.repo of luminous release to centos-base, it built with expected 12.2.1 version from console.09:11
*** ktibi has joined #openstack-kolla09:11
*** amoralej|off is now known as amoralej09:11
egonzalezlxdong, support for luminous is not implemented09:12
lxdongoh, got it, what's the plan09:13
egonzalezi wouldn't expect to work by itself09:13
egonzalezwe need to migrate jewel to luminous and create upgrade path09:14
egonzalezis not only make queens work under luminous, also ensure upgrade pike-queens not break09:14
lxdongwhich means baremetal deployment is the only way if I want use luminous currently?09:16
mason5hbegonzalez, do you know log-in password of mariadb-009:18
mason5hb?09:18
egonzalezlxdong, external ceph would made it09:19
egonzalezmason5hb, dunno where k8s stores passwords, in ansible we have in /etc/kolla/passwords09:19
mason5hbThanks a lot,09:20
lxdongok,thanks for heading up09:22
*** mandre_afk has quit IRC09:23
ktibihi egonzalez, I don't know if you saw my talk with inc0 about named server which listen only on private network09:23
ktibiegonzalez http://eavesdrop.openstack.org/irclogs/%23openstack-kolla/%23openstack-kolla.2017-11-09.log.html#t2017-11-09T16:19:0209:24
*** kiennt26 has quit IRC09:25
*** jascott1 has quit IRC09:25
*** jascott1 has joined #openstack-kolla09:26
egonzalezktibi, you have designate-mds which listen on public networks09:26
egonzalezmdns is a simple dns server09:27
ktibimdns listen on 53 ?09:28
*** mgoddard has joined #openstack-kolla09:28
egonzalezproblem with named to public. we have to change group to network group (upgrade issues), all traffic will go through public networks (designate->bind traffic) too09:28
egonzalezktibi, 535409:29
egonzalezin dns_interface IP09:29
ktibiok for me it listen on same IP09:30
ktibiprivate network09:30
*** jascott1 has quit IRC09:31
ktibinslookup on port 5354 no works :/09:33
ktibiegonzalez ok works with dig ><09:35
ktibiso I can change the listen for mdns09:35
egonzalezmdns is listening on dns_interface which should be accessible from instances09:38
egonzalezis in docs https://docs.openstack.org/kolla-ansible/latest/reference/designate-guide.html09:38
*** dan_ardelean has quit IRC09:40
ktibiegonzalez ok but dns_interface can be VIP ?09:40
berendtsince yesterday my neutron bootstrap is broken, anyone seen this issue?09:41
berendthttps://www.irccloud.com/pastebin/ZMNZgAfG/09:41
egonzalezktibi, nope unless you deploy your own ngnix or any loadbalancer that support udp, haproxy doesnt09:41
ktibiegonzalez ok thx :)09:42
egonzalezberendt, using networking-sfc?09:42
*** Zopar has joined #openstack-kolla09:42
berendtegonzalez: is it enabled by default in the images?09:42
*** dan_ardelean has joined #openstack-kolla09:43
*** ipsecguy_ has joined #openstack-kolla09:44
berendtegonzalez: enable_neutron_sfc is no in kolla-ansible09:44
egonzalezis installed in neutron-base by default09:44
egonzalezmaster or stable?09:44
berendtstable/ocata09:44
berendtthink sfc plugin is installed by default, yes09:44
*** ipsecguy has quit IRC09:45
*** dan_ardelean has quit IRC09:47
*** dan_ardelean has joined #openstack-kolla09:53
berendtfound my issue, i mixed a newer plugin version with an older neutron version09:53
egonzalezcustom builds?09:57
egonzalezin ocata networking-sfc was not installed in neutron-base (sfc) was broken in that release09:57
*** kevzha01 has quit IRC10:02
*** mgoddard has quit IRC10:02
*** Zopar has quit IRC10:03
lxdongTASK [nova : Check cinder keyring file] failed ,how to generate keyring perservice10:08
*** mgoddard has joined #openstack-kolla10:08
egonzalezlxdong, thats admin work outside kolla, someone had a script to generate keyrings iirc10:15
*** tone_zrt has quit IRC10:17
lxdonglike this ceph auth get-or-create client.nova mds 'allow' osd 'allow *' mon 'allow *' > /etc/ceph/keyring?10:17
egonzalezyep10:20
lxdongcan it be the same with ceph.client.admin.keyring?10:20
*** caowei has quit IRC10:21
*** mwall has quit IRC10:21
*** daidv has quit IRC10:21
egonzalezlxdong, can. but i dont recommend that for security reasons10:21
*** caowei has joined #openstack-kolla10:21
*** caowei has quit IRC10:21
*** hieulq has quit IRC10:23
lxdongyes,cautious enough10:24
*** gaoyanami has quit IRC10:32
*** openstack has joined #openstack-kolla21:54
*** ChanServ sets mode: +o openstack21:54
*** jamesbenson has quit IRC22:15
*** lukepatrick has quit IRC22:22
*** Pavo has joined #openstack-kolla22:28
*** lukepatrick has joined #openstack-kolla22:33
*** Pavo has quit IRC22:41
*** jamesbenson has joined #openstack-kolla22:46
*** jamesbenson has quit IRC22:51
*** Pavo has joined #openstack-kolla22:53
*** lukepatrick has quit IRC22:55
*** jamesbenson has joined #openstack-kolla22:57
*** jamesbenson has quit IRC23:01
*** jamesbenson has joined #openstack-kolla23:06
*** jamesbenson has quit IRC23:11
*** Pavo has quit IRC23:15
*** salv-orlando has quit IRC23:15
*** salv-orlando has joined #openstack-kolla23:23
*** TxGirlGeek has joined #openstack-kolla23:23
*** salv-orl_ has joined #openstack-kolla23:23
*** jamesbenson has joined #openstack-kolla23:26
*** salv-orlando has quit IRC23:27
*** jamesbenson has quit IRC23:32
*** jamesbenson has joined #openstack-kolla23:40
*** litmaj0r has joined #openstack-kolla23:43
*** jamesbenson has quit IRC23:44
*** jamesbenson has joined #openstack-kolla23:47
*** jamesbenson has quit IRC23:52
*** salv-orl_ has quit IRC23:54
*** salv-orlando has joined #openstack-kolla23:55
*** salv-orlando has quit IRC23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!