Tuesday, 2019-06-11

« Monday, 2019-06-10 Index Wednesday, 2019-06-12 »
*** zhanglong has joined #openstack-kolla00:20
openstackgerritJohn Hinman proposed openstack/kolla-ansible master: WIP. Fixes for ovs-vsctl.sh, add scripts for starting ovsdpdk-db and ovs-vswitchd with option for ODL.  https://review.opendev.org/65526400:26
openstackgerritJohn Hinman proposed openstack/kolla-ansible master: Fix ovs script permissions, add back kubernetes script, remove openvswitch group, remove unnecessary variable registration. WIP. Fixes for ovs-vsctl.sh, add scripts for starting ovsdpdk-db and ovs-vswitchd with option for ODL.  https://review.opendev.org/65526400:31
*** roukoswarf has joined #openstack-kolla00:46
roukoswarfhmm, doing an upgrade from rocky to stein, not going so hot, kolla-ansible kills all nova containers, then complains theyre dead, also does similar for neutron, and stuff like horizon never change tag from rocky to stein... any ideas?00:47
*** iniazi has quit IRC00:56
*** iniazi has joined #openstack-kolla00:56
*** igordc has quit IRC00:56
*** gregoryo has joined #openstack-kolla00:58
*** icarusfactor has joined #openstack-kolla01:00
*** schwicht has joined #openstack-kolla01:00
*** factor has quit IRC01:02
roukoswarfseems like horizon roles are never even being hit...01:08
*** icarusfactor has quit IRC01:19
*** factor__ has joined #openstack-kolla01:19
*** gkadam_ has quit IRC01:22
*** gkadam_ has joined #openstack-kolla01:22
*** factor__ has quit IRC01:24
*** factor__ has joined #openstack-kolla01:25
*** schwicht has quit IRC01:25
roukoswarfTLDR why does upgrade miss a lot of things reconfigure does? upgrade just skips right over horizon, yet reconfigure upgrades horizon01:28
*** sshnaidm has quit IRC01:33
*** sshnaidm has joined #openstack-kolla01:35
*** gkadam_ has quit IRC01:38
*** gkadam_ has joined #openstack-kolla01:38
*** kplant has quit IRC01:39
*** factor__ has quit IRC01:49
*** factor__ has joined #openstack-kolla01:50
*** iclon__ has joined #openstack-kolla01:50
*** iclon_ has quit IRC01:52
*** guozijn has joined #openstack-kolla01:54
*** zhanglong has quit IRC01:57
*** zhanglong has joined #openstack-kolla01:59
*** schwicht has joined #openstack-kolla02:01
*** roukoswarf has quit IRC02:08
*** whoami-rajat has joined #openstack-kolla02:09
*** gkadam_ has quit IRC02:11
*** factor__ has quit IRC02:17
*** itlinux has joined #openstack-kolla02:17
*** schwicht has quit IRC02:18
*** factor__ has joined #openstack-kolla02:18
*** factor__ has quit IRC02:18
*** hongbin has joined #openstack-kolla02:25
*** guozijn has quit IRC02:30
*** zhanglong has quit IRC02:35
*** zhanglong has joined #openstack-kolla02:40
*** schwicht has joined #openstack-kolla02:43
*** zhanglong has quit IRC03:17
*** zhanglong has joined #openstack-kolla03:20
*** gkadam has joined #openstack-kolla03:41
*** hongbin has quit IRC04:01
*** janki has joined #openstack-kolla04:10
*** gkadam has quit IRC04:11
*** zhanglong has quit IRC04:14
*** dave-mccowan has quit IRC04:23
*** ChewieBeardy has quit IRC04:26
*** gkadam has joined #openstack-kolla04:28
*** gkadam has quit IRC04:35
*** skramaja has joined #openstack-kolla04:35
*** JangwonLee__ has joined #openstack-kolla04:55
*** JangwonLee_ has quit IRC04:59
*** luksky has joined #openstack-kolla05:09
*** schwicht has quit IRC05:14
*** luksky has quit IRC05:25
*** radeks_ has joined #openstack-kolla05:31
*** radeks_ has quit IRC05:38
*** zhanglong has joined #openstack-kolla05:41
*** radeks_ has joined #openstack-kolla05:44
*** Wasaac has joined #openstack-kolla05:48
*** threestrands has joined #openstack-kolla05:52
*** Wasaac has quit IRC05:53
*** Luzi has joined #openstack-kolla05:53
*** threestrands has quit IRC05:53
*** pcaruana has joined #openstack-kolla06:55
*** Wasaac has joined #openstack-kolla07:05
*** rpittau|afk is now known as rpittau07:08
*** Wasaac has quit IRC07:12
*** Wasaac has joined #openstack-kolla07:13
*** hamzaachi has joined #openstack-kolla07:32
openstackgerritKrzysztof Klimonda proposed openstack/kolla-ansible master: Implement TLS encryption for internal endpoints  https://review.opendev.org/66355507:42
openstackgerritKrzysztof Klimonda proposed openstack/kolla-ansible master: Add support for encrypting backend HAProxy traffic  https://review.opendev.org/66451607:42
openstackgerritKrzysztof Klimonda proposed openstack/kolla-ansible master: Add support for self-signed SSL certificates  https://review.opendev.org/66451707:42
*** hamzaachi has quit IRC07:55
*** hamzaachi has joined #openstack-kolla07:56
*** gfidente has joined #openstack-kolla08:02
openstackgerritMerged openstack/kolla-ansible master: Include cron_generator script in coverage report  https://review.opendev.org/66309708:05
*** devep has joined #openstack-kolla08:08
*** gregoryo has quit IRC08:12
*** zhanglong has quit IRC08:13
*** zhanglong has joined #openstack-kolla08:16
*** dougsz has joined #openstack-kolla08:17
*** hamzaachi_ has joined #openstack-kolla08:19
*** k_mouza has joined #openstack-kolla08:20
*** hamzaachi has quit IRC08:21
*** hamzaachi_ has quit IRC08:25
*** hamzaachi has joined #openstack-kolla08:28
*** k_mouza has quit IRC08:29
*** k_mouza has joined #openstack-kolla08:30
*** hamzaachi_ has joined #openstack-kolla08:35
*** hamzaachi has quit IRC08:38
mgoddardmichaelbarkdoll: your neutron_external_interface should be on a tagged VLAN interface so that neutron can apply tenant VLAN tags08:41
mgoddardmichaelbarkdoll: and it should be a normal interface, rather than a bridge08:45
*** zhanglong has quit IRC08:53
*** priteau has joined #openstack-kolla08:57
*** zhanglong has joined #openstack-kolla09:00
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Add CI job for ironic  https://review.opendev.org/56882909:22
*** hamzaachi__ has joined #openstack-kolla10:05
*** hamzaachi_ has quit IRC10:06
*** hamzaachi_ has joined #openstack-kolla10:08
*** hamzaachi__ has quit IRC10:10
*** k_mouza_ has joined #openstack-kolla10:13
*** k_mouza has quit IRC10:16
*** pcaruana has quit IRC10:19
*** k_mouza_ has quit IRC10:25
*** k_mouza has joined #openstack-kolla10:26
*** k_mouza has quit IRC10:29
*** k_mouza has joined #openstack-kolla10:30
*** zhanglong has quit IRC10:31
*** jchhatbar has joined #openstack-kolla10:55
*** janki has quit IRC10:56
*** jchhatbar has quit IRC10:59
*** janki has joined #openstack-kolla10:59
*** janki has quit IRC11:00
*** janki has joined #openstack-kolla11:01
*** pcaruana has joined #openstack-kolla11:09
*** kplant has joined #openstack-kolla11:15
*** dave-mccowan has joined #openstack-kolla11:23
*** devep has quit IRC11:31
*** dougsz has quit IRC11:37
*** schwicht has joined #openstack-kolla11:49
openstackgerritRafael Weingärtner proposed openstack/kolla-ansible master: Standardize use and construction of endpoint URLs  https://review.opendev.org/65215711:50
*** janki has quit IRC11:51
*** janki has joined #openstack-kolla11:51
*** gkadam has joined #openstack-kolla12:03
*** dave-mccowan has quit IRC12:05
*** Wasaac has quit IRC12:06
*** Wasaac has joined #openstack-kolla12:16
*** goldyfruit has quit IRC12:17
*** dougsz has joined #openstack-kolla12:18
*** jchhatbar has joined #openstack-kolla12:21
*** janki has quit IRC12:24
*** gkadam has quit IRC12:26
*** gkadam has joined #openstack-kolla12:27
*** jchhatbar has quit IRC12:27
*** jchhatbar has joined #openstack-kolla12:27
*** gfidente has quit IRC12:32
*** gfidente has joined #openstack-kolla12:34
openstackgerritMerged openstack/kolla-ansible master: Set log message field name in Monasca Fluentd plugin  https://review.opendev.org/66099012:43
*** zbr|ruck is now known as zbr|rover12:44
*** harsha has joined #openstack-kolla13:08
harshahello13:09
harshai am stuck at  pre-deployment checks for hosts, i am following this link - https://docs.openstack.org/kolla-ansible/stein/user/quickstart.html13:09
harshaTASK [ironic : Checking ironic-agent files exist for Ironic Inspector] ************************************************************************************************************************************* failed: [172.31.1.122 -> localhost] (item=ironic-agent.kernel) => {"changed": false, "failed_when_result": true, "item": "ironic-agent.kernel", "stat": {"exists": false}} failed: [172.31.1.122 -> localhost] (item=ironic-agen13:10
yoctozeptoharsha: please use the paste service to paste13:12
yoctozeptopaste.openstack.org13:12
openstackgerritRadosław Piliszek proposed openstack/kolla master: WIP: Clean up test process  https://review.opendev.org/66458013:13
harshaok i will13:13
harshahttp://paste.openstack.org/show/752738/13:13
kplantcan you paste your globals.yml?13:15
kplanthttps://docs.openstack.org/kolla-ansible/rocky/reference/ironic-guide.html13:15
kplantyou may have missed the steps to grab the kernel and initramfs13:15
harshai see. thanks!13:17
*** goldyfruit has joined #openstack-kolla13:26
*** signed8bit has joined #openstack-kolla13:26
*** gkadam has quit IRC13:41
*** gkadam has joined #openstack-kolla13:42
*** ktibi has joined #openstack-kolla13:43
openstackgerritRadosław Piliszek proposed openstack/kolla master: WIP: Clean up test process  https://review.opendev.org/66458013:43
yoctozeptofellow devs: what is the role of kolla-toolbox? I see this is missing in any docs13:45
*** mchlumsky has joined #openstack-kolla13:46
*** rouk has joined #openstack-kolla13:47
ktibiyoctozepto, I guess used for scan disks, or for create user in openstack13:47
ktibihttps://github.com/openstack/kolla/tree/master/docker/kolla-toolbox13:47
yoctozeptoktibi: thanks, I have the sources on me - wanted some motivational insight from insiders13:49
*** jchhatbar has quit IRC13:52
*** mchlumsky has quit IRC13:59
*** pcaruana has quit IRC14:04
mgoddardyoctozepto: we use it for various things - DB config, openstack service, endpoint, user, role etc. creation14:15
mgoddardyoctozepto: putting dependencies of ansible modules in the container means we don't need to install them on the hosts14:16
openstackgerritMichal Nasiadka proposed openstack/kolla master: Bump up pkg versions in kolla-toolbox  https://review.opendev.org/64241614:24
openstackgerritMichal Nasiadka proposed openstack/kolla master: Bump up pkg versions in kolla-toolbox  https://review.opendev.org/64241614:28
*** dave-mccowan has joined #openstack-kolla14:29
*** pcaruana has joined #openstack-kolla14:30
*** pcaruana has quit IRC14:31
*** pcaruana has joined #openstack-kolla14:31
*** harsha has quit IRC14:39
*** harsha has joined #openstack-kolla14:39
harshahello, i am on development mode, i ran "./kolla-ansible -i ../../multinode deploy" i got the following error: http://paste.openstack.org/show/752746/14:42
*** happyhemant has joined #openstack-kolla14:44
kplantdo you see haproxy on your control node?14:45
kplantalso, do you see 172.31.1.10/32 assigned on your control node?14:45
*** cah_link has joined #openstack-kolla14:45
harshayes i can see haproxy container on control node - http://paste.openstack.org/show/752747/.14:47
*** kklimonda has quit IRC14:47
*** kklimonda has joined #openstack-kolla14:48
michaelbarkdollBig shout out to kplant for helping me get multiple external provider vlans working with kolla-ansible :)  A true life saver having him as part of this community.14:48
kplantty ty14:53
harshaalso, the paste also contains the ipaddress of the control node14:54
*** itlinux has quit IRC14:55
*** harsha_ has joined #openstack-kolla14:57
*** harsha has quit IRC14:58
*** mchlumsky has joined #openstack-kolla14:59
*** harsha_ has quit IRC15:00
*** skramaja has quit IRC15:15
*** hamzy_ is now known as hamzy15:17
*** pcaruana has quit IRC15:17
*** Luzi has quit IRC15:18
*** gkadam has quit IRC15:22
*** gkadam has joined #openstack-kolla15:22
yoctozeptomgoddard: clear, it is used for kolla-ansible as helper15:40
mnasiadkamgoddard: seen something similar http://logs.openstack.org/16/642416/11/check/kolla-ansible-centos-source/91d62f6/primary/logs/kolla/nova/nova-compute.txt.gz#_2019-06-11_15_23_47_408 ?15:42
*** pcaruana has joined #openstack-kolla15:43
*** igordc has joined #openstack-kolla15:44
*** luksky has joined #openstack-kolla15:47
*** gkadam has quit IRC15:53
*** gkadam has joined #openstack-kolla15:53
*** pcaruana has quit IRC15:55
*** gfidente has quit IRC16:01
*** gfidente has joined #openstack-kolla16:03
*** k_mouza_ has joined #openstack-kolla16:09
*** hamzaachi_ has quit IRC16:13
*** k_mouza has quit IRC16:13
*** k_mouza_ has quit IRC16:14
*** gfidente has quit IRC16:15
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Fix placement log perms in config.json  https://review.opendev.org/66463116:16
*** hamzaachi_ has joined #openstack-kolla16:16
*** Sravan has joined #openstack-kolla16:26
openstackgerritMichal Nasiadka proposed openstack/kolla master: Add sha1 in ceph fetch keys  https://review.opendev.org/65562316:31
yoctozeptoguys, cryptography 1.9 stopped to compile for us (in lower-constraints)16:33
yoctozeptoovernight :_)16:33
mgoddardmnasiadka: nope, haven't seen that16:33
mnasiadkamgoddard: but still I have a feeling placement is not logging correctly, will try to solve this when back at home on Thu.16:34
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Add support for sha256 in ceph key distribution  https://review.opendev.org/65584516:37
*** Sravan has quit IRC16:38
*** whoami-rajat has quit IRC16:38
*** ktibi has quit IRC16:41
*** gfidente has joined #openstack-kolla16:42
michaelbarkdollAny idea which docker container might have logs associated with why qrouter didn't start on a controller node?16:45
*** Wasaac has quit IRC16:47
*** pcaruana has joined #openstack-kolla16:49
*** Sravan has joined #openstack-kolla16:49
priteaumichaelbarkdoll: I think that would be neutron_l3_agent16:51
michaelbarkdollYep got it thanks16:51
openstackgerritRadosław Piliszek proposed openstack/kolla master: WIP: Clean up test process  https://review.opendev.org/66458016:52
*** rpittau is now known as rpittau|afk16:55
*** itlinux has joined #openstack-kolla16:57
*** luksky has quit IRC16:59
michaelbarkdollOn external multi-vlan deploy with first vlan working, on 2nd vlan qrouter fails to start on controller3 pulled `docker exec -u 0 -it neutron-l3-agent cat /var/log/kolla/neutron-l3-agent.log` http://paste.openstack.org/show/752768/ looks like there is some issue with Failed to process compatible router: 878aaf8b-89e4-453b-8582-102c9977ff64: Exception: The 'gateway_external_network_id' option must be configured for t17:00
michaelbarkdollHere is how i created my second router and public network subnets: http://paste.openstack.org/show/752757/17:00
michaelbarkdollMy configuration is stated here: https://ask.openstack.org/en/question/122223/kolla-ansible-multiple-external-vlans-configuration/17:01
michaelbarkdollNot sure why gateway_external_network_id is giving me issues or where to set it.  Have to head to lunch, bbl.17:03
yoctozeptohttps://www.ubuntuupdates.org/package/core/bionic/main/updates/openssl17:05
yoctozeptohmph17:05
*** whoami-rajat has joined #openstack-kolla17:05
yoctozeptotheir LTS...17:05
*** luksky has joined #openstack-kolla17:05
yoctozeptoI am cleaning reqs17:05
yoctozeptoseems like we do not need so many17:05
*** luksky has quit IRC17:12
*** Wasaac has joined #openstack-kolla17:16
*** Sravan has quit IRC17:17
*** cah_link has quit IRC17:19
*** Sravan has joined #openstack-kolla17:28
*** hamzaachi_ has quit IRC17:36
*** dougsz has quit IRC17:49
*** priteau has quit IRC17:54
*** KeithMnemonic has joined #openstack-kolla18:10
michaelbarkdollOk, I found a recommended solution to the issue I'm facing from redhat https://access.redhat.com/solutions/4068251 basically, I should create /etc/kolla/config/l3_agent.ini with contents http://paste.openstack.org/show/752772/  I'm not sure why redhat says not to use it in a production environment though?18:18
*** Wasaac has quit IRC18:21
*** Wasaac has joined #openstack-kolla18:21
michaelbarkdollSorry, file change should've read /etc/kolla/config/neutron/l3_agent.ini18:25
*** qqmber has joined #openstack-kolla18:25
qqmberHi, I have installed Openstack Rocky about 6 weeks ago with kolla-ansible, and now I'm trying to add a new host. The problem is when I'm running "bootstrap-servers", in "baremetal : Generate /etc/hosts for all of the nodes" tasks fails with this: "fatal: [antofagasta.dalmacia.local]: FAILED! => {"msg": "The task includes an option with an undefined variable. The error was: 'dict object' has no attribute 'ipv4'\n\nThe error appears to h18:27
qqmberave been in '/usr/share/kolla-ansible/ansible/roles/baremetal/tasks/pre-install.yml': line 19, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n\n- name: Generate /etc/hosts for all of the nodes\n  ^ here\n"}"18:27
qqmberaccording to https://github.com/kubernetes-sigs/kubespray/issues/769, this is a ansible problem.. but this bug os from 2017, so maybe is not exactly the same...18:27
qqmberany clue how to fix this?18:27
qqmber3 weeks ago, when I add another host, hadn't any problem.18:28
qqmberI have installed ansible 2.7.918:29
*** Wasaac has quit IRC18:38
*** pcaruana has quit IRC18:39
qqmbergot the problem... the new host has a different netwrok_interface. I had configured the difference in the inventory file (multinode is called) as "newserver.domain.local network_interface=em3" (instead em1), but was necessary to comment out the "network_interface" in globals.yml and add that configuration for the old hosts in multinode (pointing to em1)18:52
qqmberthat did the trick18:52
*** ktibi has joined #openstack-kolla18:52
*** priteau has joined #openstack-kolla18:54
*** priteau has quit IRC18:54
*** ktibi has quit IRC18:55
*** k_mouza has joined #openstack-kolla19:04
*** k_mouza has quit IRC19:08
*** Wasaac has joined #openstack-kolla19:11
*** Sravan has quit IRC19:11
*** Sravan has joined #openstack-kolla19:14
openstackgerritRadosław Piliszek proposed openstack/kolla master: Fix lower-constraints test fail due to failing dep build  https://review.opendev.org/66467619:14
*** Wasaac has quit IRC19:16
*** igordc has quit IRC19:26
*** JangwonLee__ has quit IRC19:27
*** Sravan has quit IRC19:30
*** Sravan has joined #openstack-kolla19:34
*** Sravan has quit IRC19:41
openstackgerritRadosław Piliszek proposed openstack/kolla master: Fix lower-constraints test fail due to failing dep build  https://review.opendev.org/66467619:52
*** hamzaachi has joined #openstack-kolla19:56
*** kplant has quit IRC19:57
*** qqmber has quit IRC19:59
*** gkadam has quit IRC20:04
*** gkadam has joined #openstack-kolla20:05
yoctozeptomgoddard, mnasiadka: if https://review.opendev.org/664676 passes checker, please make it merge, thanks :-)20:06
*** JamesBenson has joined #openstack-kolla20:17
*** Wasaac has joined #openstack-kolla20:18
*** radeks_ has quit IRC20:34
*** Wasaac has quit IRC20:41
*** Wasaac has joined #openstack-kolla20:41
*** itlinux has quit IRC21:07
*** luksky has joined #openstack-kolla21:09
*** scottsol has joined #openstack-kolla21:10
michaelbarkdollWe'll redhat's solution didn't work for my multiple external vlan issue.  Hmmm21:19
*** Sravan has joined #openstack-kolla21:27
*** igordc has joined #openstack-kolla21:31
*** luksky has quit IRC21:35
*** Sravan has quit IRC21:46
*** JamesBenson has quit IRC21:48
michaelbarkdollmgoddard: Does this still work? neutron_bridge_name: "br-ex,br-ex2" neutron_external_interface: "eth1,eth2" in /etc/kolla/globals.yml source: https://bugs.launchpad.net/kolla/+bug/162625921:53
openstackLaunchpad bug 1626259 in kolla " Allow operators to provision multiple physical networks" [Wishlist,Confirmed]21:53
*** Sravan has joined #openstack-kolla21:54
*** Wasaac has quit IRC22:02
*** Sravan has quit IRC22:04
*** Sravan has joined #openstack-kolla22:05
*** Sravan has quit IRC22:07
*** Sravan has joined #openstack-kolla22:07
*** itlinux has joined #openstack-kolla22:14
*** Wasaac has joined #openstack-kolla22:21
*** scottsol has quit IRC22:31
*** hamzaachi has quit IRC22:32
*** Wasaac has quit IRC22:34
*** Sravan has quit IRC22:38
*** itlinux has quit IRC22:38
*** Sravan has joined #openstack-kolla22:38
*** kplant has joined #openstack-kolla22:41
*** whoami-rajat has quit IRC22:55
*** Sravan has quit IRC22:55
*** gfidente has quit IRC22:59
*** Sravan has joined #openstack-kolla23:01
*** Sravan has quit IRC23:07
*** Sravan has joined #openstack-kolla23:09
*** goldyfruit has quit IRC23:14
*** Sravan has quit IRC23:17
*** JamesBenson has joined #openstack-kolla23:18
*** JamesBenson has quit IRC23:22
*** factor has joined #openstack-kolla23:22
*** goldyfruit has joined #openstack-kolla23:40
« Monday, 2019-06-10 Index Wednesday, 2019-06-12 »

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!