Saturday, 2019-01-19

*** macza has quit IRC00:00
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add openstack integration to skydive  https://review.openstack.org/63185800:07
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add openstack integration to skydive  https://review.openstack.org/63185800:22
*** openstackgerrit has quit IRC01:05
*** hwoarang has quit IRC01:07
*** hwoarang_ has joined #openstack-ansible01:07
*** spatel has joined #openstack-ansible01:10
spatelcloudnull: yt?01:10
spatelI have question related ELK01:11
*** hwoarang_ has quit IRC01:31
*** hwoarang has joined #openstack-ansible01:31
*** markvoelker has joined #openstack-ansible01:47
*** kopecmartin has quit IRC01:51
*** spatel has quit IRC02:04
*** markvoelker has quit IRC02:17
*** vnogin has joined #openstack-ansible02:42
*** kopecmartin has joined #openstack-ansible02:43
*** TxGirlGeek has joined #openstack-ansible02:44
*** vnogin has quit IRC02:47
*** kopecmartin has quit IRC02:54
*** kopecmartin has joined #openstack-ansible02:55
*** markvoelker has joined #openstack-ansible03:14
*** TxGirlGeek has quit IRC03:16
*** DanyC has joined #openstack-ansible03:27
*** DanyC has quit IRC03:31
*** markvoelker has quit IRC03:47
*** radeks__ has joined #openstack-ansible04:12
*** hwoarang has quit IRC04:33
*** hwoarang has joined #openstack-ansible04:36
*** Soopaman has joined #openstack-ansible04:39
*** hwoarang has quit IRC04:43
*** hwoarang has joined #openstack-ansible04:44
*** markvoelker has joined #openstack-ansible04:45
*** Soopaman has quit IRC05:05
*** hwoarang has quit IRC05:06
*** hwoarang has joined #openstack-ansible05:08
*** kopecmartin has quit IRC05:09
*** kopecmartin has joined #openstack-ansible05:10
*** markvoelker has quit IRC05:17
*** kopecmartin has quit IRC05:55
*** radeks__ has quit IRC06:35
*** hwoarang has quit IRC06:43
*** hwoarang has joined #openstack-ansible06:44
*** pcaruana has joined #openstack-ansible07:30
*** pcaruana|afk| has joined #openstack-ansible07:38
*** markvoelker has joined #openstack-ansible07:44
*** pcaruana has quit IRC08:00
*** pcaruana|afk| is now known as pcaruana08:00
*** markvoelker has quit IRC08:17
*** markvoelker has joined #openstack-ansible09:14
*** Darcidride_ has joined #openstack-ansible09:31
*** kopecmartin has joined #openstack-ansible09:38
*** hamzaachi has joined #openstack-ansible09:41
*** Darcidride_ has quit IRC09:47
*** markvoelker has quit IRC09:47
*** hamzaachi has quit IRC09:55
*** Darcidride_ has joined #openstack-ansible10:01
*** dcdamien has joined #openstack-ansible10:15
*** dcdamien has quit IRC10:24
*** Darcidride_ has quit IRC10:42
*** markvoelker has joined #openstack-ansible10:44
*** kopecmartin has quit IRC10:57
*** kopecmartin has joined #openstack-ansible10:57
*** kopecmartin is now known as kopecmartin|off10:58
*** tosky has joined #openstack-ansible11:03
*** hogepodge has quit IRC11:08
*** markvoelker has quit IRC11:17
*** markvoelker has joined #openstack-ansible12:14
*** Darcidride_ has joined #openstack-ansible12:17
*** markvoelker has quit IRC12:48
*** hwoarang has quit IRC13:01
*** johnthetubaguy has quit IRC13:03
*** hwoarang has joined #openstack-ansible13:04
*** johnthetubaguy has joined #openstack-ansible13:04
*** Darcidride_ has quit IRC13:09
*** markvoelker has joined #openstack-ansible13:45
*** Darcidride_ has joined #openstack-ansible14:00
*** Darcidride_ has quit IRC14:01
*** radeks__ has joined #openstack-ansible14:10
*** partlycloudy has left #openstack-ansible14:15
*** markvoelker has quit IRC14:17
*** hwoarang has quit IRC14:20
*** hwoarang has joined #openstack-ansible14:23
*** nyloc has quit IRC14:57
*** nyloc has joined #openstack-ansible15:06
*** shyamb has joined #openstack-ansible15:12
*** markvoelker has joined #openstack-ansible15:14
*** tosky has quit IRC15:21
*** DanyC has joined #openstack-ansible15:38
*** DanyC has quit IRC15:39
*** DanyC has joined #openstack-ansible15:41
*** markvoelker has quit IRC15:48
*** DanyC has quit IRC15:56
*** hwoarang has quit IRC16:03
*** hwoarang has joined #openstack-ansible16:05
*** DanyC has joined #openstack-ansible16:20
*** shyamb has quit IRC16:28
*** markvoelker has joined #openstack-ansible16:45
*** sm806 has quit IRC17:04
*** sm806 has joined #openstack-ansible17:04
*** hogepodge has joined #openstack-ansible17:11
*** markvoelker has quit IRC17:17
*** radeks__ has quit IRC17:21
*** pcaruana has quit IRC17:21
*** DanyC has quit IRC17:37
*** partlycloudy has joined #openstack-ansible17:46
*** DanyC has joined #openstack-ansible18:13
*** markvoelker has joined #openstack-ansible18:15
*** DanyC has quit IRC18:22
guilhermespah broken_one yep! We found that neutron-keepalived-state-change wasnt being linked to /usr/local/bin/18:26
guilhermespI also found that the namespace clean up is not working properly too. Like, we create a router, delete it and the namespaces keeps there.... I didn't have time to submit a fix for this but would be nice to have a PR for us to review!18:27
*** openstackgerrit has joined #openstack-ansible18:34
openstackgerritMerged openstack/openstack-ansible-ops master: Add openstack integration to skydive  https://review.openstack.org/63185818:34
*** markvoelker has quit IRC18:48
*** kmadac has joined #openstack-ansible18:58
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-ops master: Ensure skydive binary is built as static  https://review.openstack.org/63193419:06
kmadachello, i'm trying to install calico neutron driver and it needs etcd database to be installed. I have only one control node so I add IP of mgmt interface to conf.d/etcd.conf. When I run deployment it ends up on task etcd : Verify etcd cluster health with error: error while evaluating conditional (inventory_hostname == groups[etcd_cluster_group][0])19:06
kmadac: list object has no element 019:06
kmadacis it possible that is because I have only one node and not 3 as it is written in documentation?19:07
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-ops master: Ensure skydive binary is built as static  https://review.openstack.org/63193419:09
jenglisch_guilhermesp: the symlink hack is your problem, the rootwrap kill thingy checks if the process to kill is part of the $PATH of the process wihch is calling the kill command (neutron-l3-agent in this case), and your symlink invokes a python script with relies in /openstack/venv/neutron-<versoin>/bin/ and hence it is not able to kill it19:12
jenglisch_if you fix your PATH on neutron-l3-agent to include the venv's bin directory, it will work properly19:12
jrosserkmadac: you can check that your etcd host groups look right with scripts/inventory-manage.py -G19:12
kmadac@jrosser: thanks, looks like the group etcd_cluster_group doesnt exists. As I'm beginner with OSA deployment, can you give me an hint why it does not exist when I added it to /etc/openstack_deploy/conf.d/etcd.conf?19:17
*** hogepodge has quit IRC19:21
jrosserkmadac: etcd_cluster_group is defined here as the string 'etcd' https://github.com/logan2211/ansible-etcd/blob/master/defaults/main.yml#L40, so it is looking for a group called etcd19:28
partlycloudyhello folks, a quick question: can i put flat and vlan on the same bridge br-vlan, simply by removing the 'host_bind_override' under the global_overrides > provider_networks > networks [flat]?19:33
partlycloudyI see there is a suggestion to create a veth pair for the flat network, if using the same bridge as the vlan network.19:34
kmadac@jrosser: unfortunatelly neither etcd group exists. As it is not first deployment on those hosts, is there any cache which I should delete to force recreation of inventory/groups?19:35
jrosserpartlycloudy: in the example configurations the "flat" network is actually the untagged packets on br-vlan19:35
jrosserpartlycloudy: neutron requires an interface not a bridge so the example config uses the veth and eth12 to achieve that19:35
jrosserpartlycloudy: however - you may well be better to not use a flat network19:36
jrosserkmadac: it looks like you should add an etcd_hosts: section to your openstack_user_config19:37
jrosserkmadac: each time you run a playbook it uses a dynamic inventory script, inventory/dynamic_inventory.py and that will update the hosts/groups based on your openstack_user_config and env.d19:38
partlycloudyjrosser: thank you! now i got it.19:39
jrosserpartlycloudy: the external network could be a tagged vlan on br-vlan, or you can have a dedicated interface19:40
kmadac@jrosser: i have it there and when I run dynamic_inventory.py, etcd group is there, but when I run inventory-manage.py -G group is not there19:40
partlycloudyjrosser: i see. and if i want to share the same bridge as vlan, i need to create a veth pair, i think?19:41
jrosserpartlycloudy: i think so.....19:42
kmadac@jrosser: ok, for some reson, now, when I run openstack-ansible etcd-install.yml, it started to install etcd on infra node, I did something and now it works :)19:43
partlycloudyjrosser: i see. many thanks!19:43
partlycloudyhas anyone hit any issue with 'Volumes' in horizon dashboard, if using _member_ or member role?19:44
*** markvoelker has joined #openstack-ansible19:45
partlycloudyi am unable to create volumes in horizon if my role is set to _member_ or member, but i can do it with cli.19:46
kmadac@jrosser: thanks for your help19:47
partlycloudyi hit the same bug with tripleo before https://bugs.launchpad.net/tripleo/+bug/179781119:47
openstackLaunchpad bug 1797811 in tripleo "Users with _member_ or member roles cannot use cinder-volume via Horizon Dashboard" [High,Triaged]19:47
partlycloudyopenstack: ah yes! that was me.19:47
jrosserpartlycloudy: i think there is a bit of a question if our horizon setup shares the same policy files as the openstack apis19:51
*** aedc has joined #openstack-ansible19:52
partlycloudyjrosser: wish i could do something, but i'm too new to openstack. still trying hard to catch up…19:55
*** kmadac has quit IRC19:56
jrosserpartlycloudy: thats ok! even just filing a bug on launchpad against opentack-ansible with all the details is super helpful19:56
partlycloudyjrosser: thanks! that one was under tripleo. is it duplicated to post another one under openstack-ansible?20:01
*** hwoarang has quit IRC20:04
*** hwoarang has joined #openstack-ansible20:05
*** spsurya has quit IRC20:14
*** markvoelker has quit IRC20:18
*** DanyC has joined #openstack-ansible20:23
*** hogepodge_ has joined #openstack-ansible20:27
*** hogepodge_ has quit IRC20:27
*** DanyC has quit IRC20:27
*** hogepodge has joined #openstack-ansible20:27
*** markvoelker has joined #openstack-ansible21:15
*** hwoarang has quit IRC21:34
*** hwoarang has joined #openstack-ansible21:36
*** markvoelker has quit IRC21:48
*** dave-mccowan has joined #openstack-ansible21:55
*** aludwar has quit IRC22:30
*** aludwar has joined #openstack-ansible22:34
cloudnullafternoons22:43
guilhermespcloudnull: o/22:43
cloudnullspatel I am now22:43
cloudnullhows it guilhermesp?22:43
guilhermespnice here cloudnull thanks for asking. I have a bunch of PRs to submit but there are some annoying issues with rocky deployments to prioritize :P22:45
*** markvoelker has joined #openstack-ansible22:45
cloudnullbuuu.22:45
cloudnullannoying issues are never fun :)22:46
guilhermespyep, I PRs are better :P22:46
*** tosky has joined #openstack-ansible22:47
guilhermespdunno if it is related to policy but I can't create magnum clusters due to authorization failures when heat tries to create the nodes22:47
*** dave-mccowan has quit IRC22:51
*** markvoelker has quit IRC23:18
*** tosky has quit IRC23:22
*** DanyC has joined #openstack-ansible23:23
*** DanyC has quit IRC23:27
cloudnullis that in rocky ?23:42
cloudnulland using the heat / magnum CLI23:42
guilhermespyep23:42
guilhermespI tested some standalone heat stacks23:42
cloudnullI would expect failures like that when in horizon due to policy things23:43
guilhermespeverything ok, cli and horizon23:43
cloudnullok.23:43
cloudnullso maybe just magnum policy issues?23:43
guilhermespheat fails when tries OS::Heat::ResourceGroup23:43
guilhermespI was just taking a look now to see if there was something strange23:43
guilhermespseems that we use the same policy for a while23:43
cloudnullwe carry - https://github.com/openstack/openstack-ansible-os_magnum/blob/master/templates/policy.json.j2?23:43
cloudnullmaybe this is another issue where the policy has been moved into code?23:44
guilhermespthat's the only thing now that comes to my mind... i've been trying to debug everywhere23:44
cloudnullyup - https://github.com/openstack/magnum/tree/stable/rocky/etc/magnum23:44
guilhermespbut just magnum raises eh error23:44
cloudnulllooks like there's no policy file anymore23:44
guilhermesphuuuuum23:45
cloudnulllooks like pike was the last time magnum carried a static file23:45
cloudnullhttps://github.com/openstack/magnum/tree/stable/pike/etc/magnum23:45
guilhermespthat is a good clue23:46
guilhermespvery good clue23:46
guilhermespso maybe an issue at our side?23:46
cloudnullodyssey4me did a few of these - https://review.openstack.org/#/q/topic:smart-sources-stable/rocky+(status:open+OR+status:merged)23:46
cloudnulllooks like we need to do a few more23:46
guilhermespyep... we've been experiencing issues with cinder too23:47
guilhermesplike non-admin users gets horizon error pop ups everytime23:47
guilhermespso maybe replicate these PRs to roles like os_magnum23:48
guilhermespI can do some sort of manual tests here as I have a deployment already23:49
cloudnull++23:49
cloudnullif we just delete the policy files and restart the service it should work, if this is the fix23:49
guilhermesplet me see23:49
guilhermesphuum seems that just deleting /etc/magnum/policy.json is not the issue23:52
guilhermespCluster error, stack status: CREATE_FAILED, stack_id: 7e7e0648-4844-440a-b19f-36220ebe2381, reason: Resource CREATE failed: AuthorizationFailure: resources.swarm_masters.resources[0].resources.master_wait_handle: Authorization failed.23:52
cloudnullcan you check the heat-engine.log ?23:56
cloudnullmaybe theres something in there that provides some more insight ?23:56
guilhermespso just to confirm, in rocky we have just the heat-api container right?23:57
guilhermespand in this container, just heat.log23:57
*** hwoarang has quit IRC23:57
guilhermespaaaaaalso, heat also has a policy.json23:58
guilhermespmaybe delete it too23:58
*** hwoarang has joined #openstack-ansible23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!