Tuesday, 2017-10-24

*** pbandark has quit IRC00:00
*** dxiri has quit IRC00:09
*** snowman48391 has quit IRC00:22
*** chyka has quit IRC00:23
*** snowman4839 has joined #openstack-ansible00:24
*** vnogin has joined #openstack-ansible00:33
*** vnogin has quit IRC00:37
*** hw_wutianwei has joined #openstack-ansible00:39
openstackgerritMerged openstack/openstack-ansible-os_tempest master: Use the deployment host to download images for tempest  https://review.openstack.org/51320000:42
*** thorst has joined #openstack-ansible00:43
*** thorst has quit IRC00:44
*** snowman48391 has joined #openstack-ansible00:46
*** snowman4839 has quit IRC00:46
*** dave-mccowan has joined #openstack-ansible01:01
*** kiennt26 has joined #openstack-ansible01:02
*** snowman48391 has quit IRC01:05
*** snowman4839 has joined #openstack-ansible01:06
*** thorst has joined #openstack-ansible01:33
*** vnogin has joined #openstack-ansible01:34
*** pramodrj07 has quit IRC01:34
*** MasterOfBugs has quit IRC01:34
*** snowman4839 has quit IRC01:35
*** snowman4839 has joined #openstack-ansible01:35
*** vnogin has quit IRC01:38
*** acormier has joined #openstack-ansible01:39
*** thorst has quit IRC01:39
*** markvoelker has joined #openstack-ansible01:43
*** captaindave has quit IRC01:49
*** captaindave has joined #openstack-ansible01:56
*** acormier has quit IRC01:58
openstackgerritMerged openstack/openstack-ansible-apt_package_pinning stable/ocata: Initial Zuul v3 role jobs  https://review.openstack.org/51427402:09
idlemindthx wlmbasson and snowman483902:10
*** galstrom_zzz is now known as galstrom02:29
*** gouthamr has quit IRC02:33
snowman4839any ideas why my instance on a public vlan network can't receive arp replys but I can see the arp requests and replies at br-vlan?02:39
*** dxiri has joined #openstack-ansible02:43
*** dxiri has quit IRC02:47
*** galstrom is now known as galstrom_zzz03:03
*** acormier has joined #openstack-ansible03:11
*** acormier has quit IRC03:12
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Improve execution time by using dynamic groups  https://review.openstack.org/51387603:13
*** acormier has joined #openstack-ansible03:13
cloudnullsnowman4839: do you see them through the tap device the instance is connected to ?03:14
*** acormier_ has joined #openstack-ansible03:28
*** acormier has quit IRC03:31
*** armaan has quit IRC03:33
*** dave-mccowan has quit IRC03:47
*** gouthamr has joined #openstack-ansible03:49
*** acormier_ has quit IRC03:49
*** acormier has joined #openstack-ansible03:50
*** acormier has quit IRC03:54
*** mpranjic has quit IRC03:55
*** gkadam_ has joined #openstack-ansible03:56
*** poopcat has quit IRC04:00
openstackgerritMerged openstack/openstack-ansible-apt_package_pinning master: Remove unified queue from gate pipeline  https://review.openstack.org/51420604:03
*** gouthamr has quit IRC04:04
*** newmember has joined #openstack-ansible04:07
*** armaan has joined #openstack-ansible04:14
*** nshetty has joined #openstack-ansible04:19
*** udesale has joined #openstack-ansible04:22
*** armaan has quit IRC04:29
*** weezS has joined #openstack-ansible04:34
*** weezS has quit IRC04:39
korean101hi guys04:45
korean101ERROR 2003 (HY000): Can't connect to MySQL server on '' (113 \"No route to host\")04:45
korean101when i deploy multinode, i got this ERRORs04:45
korean101when deploy to allinone, doesn't got ERROR04:46
korean101how can i do?04:46
*** kiennt26 has quit IRC04:51
*** br0k3n has joined #openstack-ansible04:53
openstackgerritMerged openstack/openstack-ansible-os_tempest stable/ocata: Initial Zuul v3 role jobs  https://review.openstack.org/51429604:54
openstackgerritMerged openstack/openstack-ansible-os_swift stable/ocata: Initial Zuul v3 role jobs  https://review.openstack.org/51429504:54
*** br0k3n has quit IRC04:57
*** br0k3n has joined #openstack-ansible04:57
*** chyka has joined #openstack-ansible05:12
*** udesale has quit IRC05:12
*** udesale has joined #openstack-ansible05:13
*** udesale has quit IRC05:13
*** chyka has quit IRC05:16
*** udesale has joined #openstack-ansible05:17
openstackgerritMerged openstack/openstack-ansible-os_nova stable/ocata: Initial Zuul v3 role jobs  https://review.openstack.org/51429105:18
openstackgerritMerged openstack/openstack-ansible-os_keystone stable/ocata: Initial Zuul v3 role jobs  https://review.openstack.org/51429005:18
openstackgerritMerged openstack/openstack-ansible-os_horizon stable/ocata: Initial Zuul v3 role jobs  https://review.openstack.org/51428805:18
openstackgerritMerged openstack/openstack-ansible-galera_server stable/ocata: Initial Zuul v3 role jobs  https://review.openstack.org/51427805:18
openstackgerritMerged openstack/openstack-ansible-galera_client master: Remove unified queue from gate pipeline  https://review.openstack.org/51420905:18
openstackgerritMerged openstack/openstack-ansible-lxc_container_create master: Remove unified queue from gate pipeline  https://review.openstack.org/51421305:18
openstackgerritMerged openstack/openstack-ansible-repo_server master: Remove unified queue from gate pipeline  https://review.openstack.org/51424705:18
openstackgerritMerged openstack/openstack-ansible-os_glance master: Remove unified queue from gate pipeline  https://review.openstack.org/51422305:37
openstackgerritMerged openstack/openstack-ansible-galera_server master: Remove unified queue from gate pipeline  https://review.openstack.org/51421105:37
*** markvoelker has quit IRC05:43
*** markvoelker has joined #openstack-ansible05:44
*** yolanda has joined #openstack-ansible05:44
*** markvoelker has quit IRC05:48
openstackgerritMerged openstack/openstack-ansible-os_designate master: Remove unified queue from gate pipeline  https://review.openstack.org/51422205:49
korean101anyone succesful deploy to multinode (pike releases)?06:02
korean101allinone is easy06:02
*** jwitko has quit IRC06:02
korean101but multinode is so hard06:03
*** Oku_OS-away is now known as Oku_OS06:09
*** mma has joined #openstack-ansible06:14
*** brad[] has quit IRC06:18
*** brad[] has joined #openstack-ansible06:19
evrardjpkorean101: multinode shouldn't be that hard06:21
evrardjpwhat is the issue?06:21
korean101evrardjp: HI06:21
korean101evrardjp: ERROR 2003 (HY000): Can't connect to MySQL server on '' (113 \"No route to host\")06:21
korean101evrardjp: I use 4 nodes06:22
evrardjplooks like a networking/routing issue06:22
*** jvidal has joined #openstack-ansible06:22
evrardjpare you connecting the proper bridges?06:22
evrardjpdo you have br-mgmt on all your 4 nodes?06:22
korean101evrardjp: br-mgmt?06:22
korean101evrardjp: br-ex br-int br-tun06:23
*** huxinhui__ has joined #openstack-ansible06:23
evrardjpthat's definitely not in our deploy guide06:23
*** huxinhui__ is now known as huxinhui06:23
korean101evrardjp: i use 4 VMs06:23
evrardjpare you deploying openstack-ansible following our upstream documentation ?06:23
korean101evrardjp: and each VM have 3 NICs06:23
evrardjpkorean101: doesn't matter, same thing06:23
korean101evrardjp: https://docs.openstack.org/kolla-ansible/pike/quickstart.html this?06:24
evrardjpthis is openstack-ansible not kolla :p06:24
evrardjpyou can have more details about networking there: https://docs.openstack.org/project-deploy-guide/openstack-ansible/pike/targethosts-networkconfig.html06:25
evrardjpa test example: https://docs.openstack.org/project-deploy-guide/openstack-ansible/pike/app-config-test.html06:25
evrardjpor a prod example: https://docs.openstack.org/project-deploy-guide/openstack-ansible/pike/app-config-prod.html06:25
korean101but i'm in wrong channel...06:26
korean101i try to deploy via kolla06:26
evrardjpok. sad to see you go!06:27
evrardjpif you are looking for a different solution, you can always come back.06:27
korean101evrardjp: thanks for reply06:27
korean101evrardjp: ok got it06:27
evrardjpno worries06:27
korean101evrardjp: kolla use openstack-ansible06:27
korean101evrardjp: i know!06:27
evrardjpI can't say that part, I am not aware of the recent kolla internals.06:28
korean101evrardjp: i try to that links what you told me06:28
*** yolanda has quit IRC06:40
*** jbadiapa_ has joined #openstack-ansible06:41
evrardjpkorean101: those links are for openstack-ansible... For kolla I don't know06:43
*** jbadiapa has quit IRC06:44
korean101evrardjp: yes!06:44
*** markvoelker has joined #openstack-ansible06:44
*** s_murli has joined #openstack-ansible06:47
*** rodolof has joined #openstack-ansible06:48
*** Miouge has joined #openstack-ansible06:50
s_murliWhen I run "openstack-ansible setup-hosts.yml", the script is struck at "Wait for ssh to be available". After some time i get an error saying ""Timeout when waiting for search string OpenSSH in x.x.x.x".06:50
s_murliI went to the host and tried to ssh the container, it failed as well.06:50
s_murlii did a lxc-attach <container name>, and I see that the corresponding IP address is not up. I did "ifup eth1" and i see that the IP gets assigned06:52
s_murliI exited out of container and did tried "ssh <container name>" and it worked fine.06:52
s_murliI see this issue with all the continers06:52
s_murliLooks like the interface was not made up.06:52
s_murliInside the container, in the file "/etc/network/interfaces" i see this line: source /etc/network/interfaces.d/*.cfg06:54
s_murlieth1.cfg is available in the path "/etc/network/interfaces.d/eth1.cfg" with the following content:06:54
s_murliAny idea why the IPs are not up in the container?06:55
tnogistoperhaps an ip conflict?06:56
tnogistoI had problems with container connectivity, when for some reason it gave out reserved ip-s to containers06:57
s_murliI am using VMs connected to private virtual network. So IP conflict can happen only when ansible scripts assigned duplicate IPs.06:58
tnogistocheck the inventory.json file06:59
*** maybebuggy has joined #openstack-ansible07:01
s_murliThis are the only places where the IP "" is used07:02
*** pcaruana has joined #openstack-ansible07:02
s_murlii dont see it repeating in any other place !! :(07:02
*** vnogin has joined #openstack-ansible07:04
*** sm123 has joined #openstack-ansible07:07
MiougeIn the setup-openstack playbook in “Attempt venv download” it says “urlopen error timed out” (see https://thepasteb.in/p/48hQcW1px93W5Ul ) but the URL is accessible both from the host and the container, I don’t see where the problem is?07:08
*** kiennt26 has joined #openstack-ansible07:12
evrardjpMiouge: maybe try again?07:15
evrardjptnogisto: that sounds bad.07:16
evrardjptnogisto: it shouldn't happen, we SET the ip for this purpose07:17
*** br0k3n has quit IRC07:17
evrardjps_murli: so you mean that ALL your containers don't receive an ip on the br-mgmt until you bump their state manually?07:18
*** markvoelker has quit IRC07:18
evrardjpwe haven't seen that in our gates07:18
MiougeI tried ~5 times total, it always fails at the same task07:20
MiougeAny idea where I should dig into?07:21
s_murlievrardjp: Ya, all the containers do get the IPs assigned until i do "ifup eth1"07:31
s_murlievrardjp: I dont have to do a "ifdown", just "ifup" get the IP assigned07:32
evrardjpMiouge: which ansible version?07:34
evrardjpwhich openstack-ansible version too?07:35
evrardjpprobably worth doing with ANSIBLE_DEBUG=yes in your environment variables07:35
Miougeansible I’ll give debug a try07:35
evrardjpMiouge: which branch are you on?07:35
evrardjps_murli: so lxc-ls -f doesn't the ip?07:36
MiougeYes, I am on 14.2.9 newton07:37
MiougeNo specific reason for Newton other than I am checking the newton docs, so I can try out Pike instead07:39
*** nshetty has quit IRC07:39
*** nshetty has joined #openstack-ansible07:40
*** wlmbasson_ has joined #openstack-ansible07:40
*** br0k3n has joined #openstack-ansible07:40
*** br0k3n1 has joined #openstack-ansible07:43
*** dasTor has quit IRC07:44
*** br0k3n has quit IRC07:44
*** vnogin has quit IRC07:45
*** wlmbasson_ has quit IRC07:45
*** yolanda has joined #openstack-ansible07:46
*** SmearedBeard has joined #openstack-ansible07:50
evrardjpMiouge: yeah you should try pike instead!07:58
evrardjpNewton is EOL last week.07:58
evrardjpwe have not tagged EOL yet07:58
evrardjpbut you shouldn't run newton, bad idea :p07:58
evrardjpI suspect a lxc networking issue or an ansible module failure07:59
evrardjpMiouge: of maybe you have multiple machines and the content didn't got the chance to be mirrored yet.07:59
MiougeI think I ended up in the newton guide because of google, I am re-running setup-hosts with Pike (16.0.1) now. I have only 1 infra node at the moment (I start simple)08:02
gokhanhi team, I am trying to install Osa on stable/ocata branch. I am getting error on gnocchi installation on perform db sync task . but when I tried 10 days or 2 weeks ago it is installed successfully. I think somechanges happened on branch.08:04
gokhanthis error log http://paste.openstack.org/show/624429/08:05
*** pbandark has joined #openstack-ansible08:05
gokhanthis is my openstack_user_config.yml file  http://paste.openstack.org/show/624430/08:06
gokhanand this is my user_variables.yml file http://paste.openstack.org/show/624431/08:06
*** SmearedBeard is now known as SmearedBeard-AFK08:08
*** SmearedBeard-AFK is now known as SmearedBeard08:08
*** vnogin has joined #openstack-ansible08:09
*** SmearedBeard is now known as SmearedBeard-AFK08:10
*** SmearedBeard-AFK is now known as SmearedBeard08:13
*** markvoelker has joined #openstack-ansible08:15
gokhanI saw a bug . It is same with my problem https://bugs.launchpad.net/openstack-ansible/+bug/172453808:21
openstackLaunchpad bug 1724538 in openstack-ansible "gnocchi install api runtime error numpy version 0xa 0xb" [Undecided,New]08:21
*** pmannidi has quit IRC08:31
s_murlihttps://thepasteb.in/p/oYhl3OllADNiZ "lxc-ls -f" doesn't show the IP either08:32
evrardjpgokhan: yes I saw that in our gates recently now08:32
*** taseer1 has joined #openstack-ansible08:32
evrardjpmaybe since our last bump08:32
*** taseer2 has joined #openstack-ansible08:33
*** Taseer has quit IRC08:33
gokhanevrardjp : ok I think for solution I can ask gnocchi channel08:36
evrardjpyes, but I think it's explicit08:36
*** taseer1 has quit IRC08:37
*** taseer2 is now known as Taseer08:39
*** maybebuggy has quit IRC08:40
Miougeevrardjp: so Pike setup-openstack.yml is passing the os-keystone-install.yml thanks for the tip08:41
evrardjpgokhan: if you could check with the gnocchi channel if it's an internal version change that could help08:41
evrardjpgokhan: we have this patch pending releases: https://review.openstack.org/#/c/512048/208:41
evrardjpit would bump the gnocchi version08:42
*** gokhan has quit IRC08:42
evrardjpMiouge: well now we have another bug with a certain ansible module08:42
evrardjpMiouge: I hope you have bootstrapped ansible08:42
evrardjpI mean use the bootstrap ansible script once more08:42
evrardjp(sometimes ppl forget to re-run this after doing a git checkout stable/pike)08:43
MiougeYes, I re-ran the whole deploy guide scripts/bootstrap-ansible.sh setup-hosts.yml setup-infra.yml and setup-openstack.yml08:43
evrardjpfrom a clean environment?08:43
evrardjp(without containers I mean)08:43
evrardjpor directly trying to override?08:43
MiougeYes, I rm:ed the /etc/openstack-ansible but I did not re-deploy the target hosts, should I?08:43
evrardjpif you remove opt and re-started this, you'll still have your old config08:44
*** electrofelix has joined #openstack-ansible08:44
evrardjpso you'll still have old containers08:44
evrardjpwell let's see if we can do that :p08:44
MiougeThat’s right, LXC container did not change name08:44
evrardjptechnically I'd have destroyed the existing containers08:45
*** gokhan has joined #openstack-ansible08:45
evrardjpthen re-started the deployment08:45
*** gokhan has quit IRC08:45
evrardjp(bootstrap ansible, setup hosts, setip infra, setup openstack)08:45
*** gokhan has joined #openstack-ansible08:46
MiougeOK, so I can clean /etc/openstack-ansible and re-install the OS on the hosts to get a clean setup?08:46
gokhanevrardjp: ok08:46
s_murliI see something strange, when i try to bring up eth1 as a command in lxc-attach, it fails saying "No such file or directory". But i can attach to the container and bring up eth1.08:47
*** markvoelker has quit IRC08:48
*** hwoarang has quit IRC08:48
s_murliProbably some issue with container interface??!!08:48
*** chyka has joined #openstack-ansible08:48
evrardjps_murli: do you have source /etc/network/interfaces.d/*.cfg in your /etc/network/interfaces?08:50
evrardjps_murli: I have never seen that before08:50
evrardjpI think it maybe a configuration issue08:50
*** hwoarang has joined #openstack-ansible08:51
*** armaan has joined #openstack-ansible08:52
*** chyka has quit IRC08:52
odyssey4meevrardjp would you like https://review.openstack.org/513200 ported back to pike to help improve gate reliability?08:59
evrardjpodyssey4me: oh I forgot this one too. Yeah sure. Thanks!08:59
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_tempest stable/pike: Use the deployment host to download images for tempest  https://review.openstack.org/51457109:00
tnogistoreally dumb question, but on which container does nova-status command live?09:00
evrardjptnogisto: probably all the nova ones :)09:01
evrardjp(it's in a venv, don't forget that part!)09:01
tnogistoif my api_os_compute_container says command not found?09:01
tnogistois that bad :) ?09:01
evrardjpI don't remember nova-status as a command to be honest09:02
evrardjpbut have you enabled the venv?09:02
evrardjpthe venv should be in /openstack/09:02
evrardjpsomewhere around that09:02
tnogistotrying to figure out why it says no viable hosts found when I try to launch an instance09:03
*** maybebuggy has joined #openstack-ansible09:05
tnogistoenabled venv? perhaps not, is that a manual step or should one of the playbooks done it?09:05
tnogistoas all the playbooks ran successfully09:05
evrardjpoh if you're just looking for logs, you can simply go into your /openstack/ folder on your host09:09
evrardjpit should have the container logs09:09
openstackgerritMerged openstack/openstack-ansible-galera_client stable/newton: Find and remove existing galera sources files  https://review.openstack.org/51319109:10
*** gkadam_ has quit IRC09:11
*** gkadam has joined #openstack-ansible09:13
*** dasTor has joined #openstack-ansible09:14
*** dasTor_ has joined #openstack-ansible09:14
*** dasTor_ has quit IRC09:14
openstackgerritMerged openstack/openstack-ansible-os_heat master: Remove unified queue from gate pipeline  https://review.openstack.org/51422509:26
*** dasTor has quit IRC09:33
*** dasTor has joined #openstack-ansible09:33
*** hw_wutianwei has quit IRC09:34
gunixi started a playbook from another terminal09:34
gunixand i have no access there now09:34
gunixany way to see its log ?09:34
gunixto see if it was sucessful or not09:34
*** DanyC has joined #openstack-ansible09:35
odyssey4megunix tmux for the win09:35
gunixyea, i didn't run it with tmux09:36
odyssey4mewe do set this by default though: https://github.com/openstack/openstack-ansible/blob/master/scripts/openstack-ansible.rc#L1909:36
gunixand the job finished, but it's on the terminal at home09:36
odyssey4meso you should find the log file there09:36
openstackgerritMerged openstack/openstack-ansible-os_tempest stable/newton: Initial OSA zuul v3 role jobs  https://review.openstack.org/51402409:36
gunixodyssey4me: thank you!09:37
gunixodyssey4me: i have 21M of logs :D09:38
gunix141744 lines of log09:38
evrardjpodyssey4me: can be go further with https://review.openstack.org/#/c/512635/7 ?09:40
*** dasTor has quit IRC09:41
*** markvoelker has joined #openstack-ansible09:44
*** hachi_ has joined #openstack-ansible09:52
evrardjpafk lunch09:54
*** thorst has joined #openstack-ansible09:56
tnogistois there an example page of all the variables that should be set in openstack_user_config.yml?09:57
*** armaan has quit IRC09:58
tnogistoaka, currently it looks like in order to use dns names between multiple hosts I should also set resolvconf_search_domains?09:58
tnogistoas otherwise the short version names dont work?09:59
gunixi got this error yesterday: https://bpaste.net/show/c81ec6e0906009:59
gunixsome permission denied related to swift rings. i thought it would go away if i run setup everything again09:59
gunixfrom one look do you guys have any idea where i made a mistake?10:00
odyssey4meevrardjp can has a full question?10:00
*** thorst has quit IRC10:00
odyssey4metnogisto you should not set variables/settings in openstack_user_config... they should all go into user_variables.yml10:01
odyssey4metnogisto openstack_user_config goes into the inventory - those persist, whereas user_*.yml files are applied as extra vars and do not persist unless you have them in the file10:01
odyssey4metnogisto also, by default all hosts will have their /etc/hosts file populated based on the inventory you give OSA - so short names you've given in openstack_user_config will work10:02
odyssey4meif you'd prefer to, you can enable unbound DNS hosts and the system will use that for DNS resolution instead10:03
gunixhmm does the node running ansible need a lot of ram ?10:03
odyssey4megunix hmm, looks like the swift user's ssh keys weren't populated10:03
odyssey4medid you perhaps use limit when deploying some of the hosts?10:04
gunixodyssey4me: before running everything, i got the pub key of the root user from the ansible host to all other nodes10:04
gunixdo i need to share any other ssh keys for swift hosts?10:05
odyssey4megunix no, the swift user gets a key created for it and that is distributed when running the role10:05
odyssey4metry removing your cached facts, then re-running the swift playbook10:06
evrardjp[m]odyssey4me: lawl10:06
gunixodyssey4me: i think i will run again through everything, but reduce the number of hosts, since i am getting memory related errors10:06
evrardjp[m]I meant "now that we have zuul.d in the integrated repo, maybe we can continue this cleanup patch, only to keep the build docs and release notes for all repos ? or even clean everything up?10:08
openstackgerritkourosh vivan proposed openstack/openstack-ansible-os_cinder master: Change ceph example backend name  https://review.openstack.org/51458810:08
odyssey4meevrardjp that clean up patch was for the cross-repo tests, not the integrated repo - I can do one for the integrated repo10:12
odyssey4meuntil the cross repo test base is merged into the tests repo, I can't progress that patch10:12
odyssey4mewell I suppose I can by using depends-on10:12
*** markvoelker has quit IRC10:18
*** s_murli has quit IRC10:21
*** sm123 has quit IRC10:21
odyssey4meevrardjp updated to remove all the legacy tests now10:23
openstackgerritMerged openstack/ansible-hardening master: Remove Zuulv3 queue and add linters test  https://review.openstack.org/51347510:33
gunixis there any documentation for multi cell setup? since multiple cells are now default with pike10:35
*** stuartgr has joined #openstack-ansible10:37
*** dasTor has joined #openstack-ansible10:42
*** huxinhui has quit IRC10:42
gunixodyssey4me: cached facts are in /etc/openstack_deploy/ansible_facts, right?10:48
openstackgerritMerged openstack/openstack-ansible-lxc_hosts stable/pike: Add unzip to Centos pkg list  https://review.openstack.org/51195210:49
odyssey4megunix yup10:50
evrardjpodyssey4me: thanks10:53
*** mma has quit IRC10:53
*** udesale has quit IRC10:53
*** mma has joined #openstack-ansible10:53
*** yolanda has quit IRC10:55
*** ArchiFleKs has quit IRC10:56
*** ArchiFleKs has joined #openstack-ansible10:56
*** mma has quit IRC10:58
evrardjpodyssey4me: I am worried about this kind of things in logs: http://logs.openstack.org/39/514239/1/gate/openstack-ansible-functional-ubuntu-xenial/3bb1914/job-output.txt.gz#_2017-10-23_17_47_13_42065010:59
evrardjplook at the time10:59
*** ansibler has joined #openstack-ansible11:01
*** vnogin has quit IRC11:02
odyssey4methat'd be interesting to try to understand what happened there - but unless that happens a lot there's probably not much that can be done about it11:02
odyssey4memaybe use logstash.o.o to do a query to see how often we get timeouts for xenial?11:03
ansiblerHi, I want to recreate rabbit-mq containers. How to do that in most efficient way? "#ansible-playbook -vvv playbooks/setup-hosts.yml --limit rabbitmq_all" is failing as no such containers exist.11:04
evrardjpodyssey4me: it happened a few times already. To be honest, I don't know how to use logstash.o.o11:04
odyssey4metime to figure it out11:05
*** newmember has quit IRC11:10
*** ansibler has quit IRC11:13
*** PTO has joined #openstack-ansible11:14
*** markvoelker has joined #openstack-ansible11:15
*** acormier has joined #openstack-ansible11:15
*** smatzek has joined #openstack-ansible11:15
evrardjpI don't have enough time to figure it out.11:17
evrardjpdoesn't seem to work, so I'll pass :p11:17
*** vnogin has joined #openstack-ansible11:18
*** acormier has quit IRC11:19
PTOTrying to deploy Openstack Ocata, but gnocchi install fails: RuntimeError: module compiled against API version 0xb but this version of numpy is 0xa. Can this be due to the ansible deployment host is running ubuntu 17.04?11:19
*** acormier has joined #openstack-ansible11:19
odyssey4meevrardjp the commit message in https://review.openstack.org/#/c/514038/ doesn't match what it's doing11:20
evrardjpoh I am on it anyway11:20
evrardjpthere are further things need fixing11:21
evrardjplet me -1 W11:21
evrardjpPTO 17.04 is not supported11:22
evrardjpbut that's not the problem11:22
evrardjpother ppl expressed the issue on this channel11:23
evrardjpand there is a bug open11:23
evrardjpbut no fix yet11:23
odyssey4mewell, using 17.04 as a deployment host could cause problems11:23
PTOThat explains allot :-)11:23
PTOSo far, everything has worked as expced on 17.04 as deployment host. I have a complete install running with no issues, except the gnocchi bugs11:24
*** acormier has quit IRC11:24
odyssey4meheh, interesting11:24
PTOBut i am considering moving the ansible deployment in a 16.04 container11:24
evrardjpI think it's time for me to start a list with ppl interested by fixing gnocchi11:24
evrardjpand the full Telemetry stack11:24
PTOThanks for the quick clarifications on gnocchi. I guess the best workaround it removing the metrics_hosts from the openstac_user_config.yml file?11:26
tnogistoodyssey4me: yes, metal hosts /etc/hosts file populates, but container one doesnt, aka short names only work on metal hosts. Also, in order to define "resolvconf_search_domains" do I only need to define it in user_variables.yml as a single line or do I need to do something more?11:33
odyssey4metnogisto all containers resolve hosts through the host11:33
odyssey4meso it should not be necessary, although I don't personally have experience with the issues you're seeing11:34
gunixPTO: why do you try 17.04 when in half an year you will get the new LTS (18.04) ?11:34
tnogistooki, strange, I can ping the short name on the host, but not on the container.11:35
PTOgunix, because the IT deparment deployed the jumphost :-/11:35
gunixPTO: try running a container for 16.04 inside the jump host. you should have new kernel with old packages, so should work fine.11:35
gunixlxd-init and lxc launch ubuntu:16.0411:35
PTOWill do so. So far, all deployments from 17.04 to 16.04 has been successful11:36
openstackgerritMerged openstack/openstack-ansible-os_tempest master: add var to set a specific public network gateway_ip  https://review.openstack.org/51340711:44
*** udesale has joined #openstack-ansible11:46
*** markvoelker has quit IRC11:48
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-tests stable/newton: [WIP] Update tests for linters  https://review.openstack.org/51403811:48
gunixhow much ram do you need on the VM running ansible ?11:50
gunixAn exception occurred during task execution. To see the full traceback, use -vvv. The error was: OSError: [Errno 12] Cannot allocate memory11:50
gunixi keep getting errors like this. right now it has 1.5GB mem and 3.5 swap. it got mem full and swap full and throwed the error after that11:50
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-plugins stable/newton: Initial OSA zuul v3 role jobs  https://review.openstack.org/51403011:51
*** mma has joined #openstack-ansible11:53
*** mrch has joined #openstack-ansible11:53
*** mma has quit IRC12:02
*** chyka has joined #openstack-ansible12:03
*** thorst has joined #openstack-ansible12:04
*** acormier has joined #openstack-ansible12:07
*** acormier has quit IRC12:08
*** chyka has quit IRC12:08
*** acormier has joined #openstack-ansible12:09
Miougeevrardjp: In the end with Pike I get the same error as with Newton: “os_glance : Ensure glance service” fails because it uses http:// on an https:// endpoint. Is it related to external_lb_vip_address being as as internal_lb_vip_address?12:09
*** PTO has quit IRC12:13
*** acormier has quit IRC12:13
evrardjpMiouge: yes that's it!12:14
evrardjpuse two different addresses.12:14
evrardjpthis way you have proper isolation12:14
MiougeI am guessing internal_lb_vip_address sets up HAProxy on HTTP and external_lb_vip_address on HTTPS?12:14
evrardjpbut it's still better to have external and internal vip different12:17
evrardjpexternal vip can even be a domain name!12:17
odyssey4meMiouge yes it does, on the same port... which is why you can't share an address unless you disable HTTPS for public endpoints12:18
MiougeOK, so once I have it working on different IPs I can use a DNS name to resolves to the external IP then12:18
odyssey4meMiouge better to start using the DNS name from the start - make sure it resolves to something12:19
openstackgerritAndy McCrae proposed openstack/openstack-ansible-openstack_hosts stable/pike: Change repo name to pike  https://review.openstack.org/51463112:20
evrardjpagreed with odyssey4me there12:20
smatzekodyssey4me: what is the net outcome for the "Add default configuration files to data_files" changes? the ML seems divided. Bottom line, do you still want to merge that in Trove?12:23
*** hachi_ has quit IRC12:24
*** chyka has joined #openstack-ansible12:24
MiougeMmm OK. So whatever the external_lb_vip_address DNS name resolves to needs to be bindable for HAProxy right?12:25
mhaydengood morning, folks12:28
*** chyka has quit IRC12:29
*** dave-mccowan has joined #openstack-ansible12:30
*** Pingue has joined #openstack-ansible12:32
openstackgerritManuel Buil proposed openstack/openstack-ansible-os_neutron master: L3 Support for ODL deployments  https://review.openstack.org/49745812:32
evrardjpmhayden: hey!12:35
evrardjpMiouge: yes12:35
evrardjpMiouge: and resolvable by containers12:35
openstackgerritMerged openstack/openstack-ansible-rabbitmq_server master: Remove unified queue from gate pipeline  https://review.openstack.org/51424512:39
gunixhow much memory do you need on the machine runnig the ansible playbooks ?12:39
evrardjpnot much12:42
evrardjpdepends on the amount of nodes12:42
gunixit failing with 1.5 GB mem and 3.5 gb swap12:42
evrardjpyou have killed processes?12:42
gunixwhat do you mean?12:43
evrardjphow do you know it fails?12:43
evrardjpis your ansible process getting killed?12:43
gunixAn error occurred during task execution. To see the full traceback, use -vvv. The error was: OSError: [Errno 12] Cannot allocate memory12:44
gunixand i can see with htop the memory is full12:44
*** br0k3n1 has quit IRC12:44
gunixafter that, the memory drops back to 100 MB12:44
gunixand ansible stops12:44
odyssey4meQueens shall be henceforth known as the cycle where all we did was convert from zuul v2 to zuul v3 :/12:47
*** br0k3n has joined #openstack-ansible12:47
*** dxiri has joined #openstack-ansible12:49
gunixodyssey4me: what about cells?12:54
gunixcause with pike they said multiple cells are default, and that we should keep for each cell it's own database12:54
gunixhow does osa deal with situations like this, for environments with 4-5 regions?12:55
*** esberglu has joined #openstack-ansible12:55
openstackgerritMerged openstack/openstack-ansible-os_horizon master: Remove unified queue from gate pipeline  https://review.openstack.org/51422612:56
odyssey4megunix for now OSA does a single cell per inventory - although it'd probably be a small set of changes to make it multi-cell... but we haven't had anyone pick that work up12:56
evrardjpodyssey4me: where is your positive attitude?12:56
*** yolanda has joined #openstack-ansible12:56
odyssey4meevrardjp huh?12:56
evrardjp"Queens shall be henceforth known as the cycle where all we did was convert from zuul v2 to zuul v3 :/"12:56
gunixodyssey4me: how do you deploy at work for multi-region? cause you have some huge environments... do you deploy manually?12:56
*** mgariepy has left #openstack-ansible12:56
*** mgariepy has joined #openstack-ansible12:57
odyssey4meevrardjp well, it's M1 and we're still doing just that12:57
odyssey4megunix we use an inventory per region12:57
mgariepyodyssey4me, evrardjp, mhayden is the rabbitmq mirror mirrorred on infra ?12:57
odyssey4meso each region is its own complete ansible inventory - each separated12:57
mgariepyTotal                                              210 kB/s |  51 MB12:57
gunixodyssey4me: so is swift connected between regions? or only one swift per region?12:57
odyssey4megunix that said, most of our environments are newton or less...12:58
mgariepyeverytime we install from that repo (at least for that check) it takes forever.12:58
odyssey4megunix oh, with swift there is multi-region support already there since liberty I think... our swift role tests that per commit12:58
gunixodyssey4me: hmm so you will jump to ocata when newton is out of support ?12:58
mgariepy4-5 minutes for each install task.12:58
gunixand now you just test pike/queens so you are ready ... in 2018 to deploy it?12:59
odyssey4megunix it's a process - we have over 50 environments12:59
gunixodyssey4me: oh, so it's just a lot of work. i was wondering if it's smart to stay on older versions, since they are ... more "stable"12:59
evrardjpmgariepy: I don't know but yes, it takes a while. I don't know how to check trends on logstash.o.o to give you more evidence13:00
odyssey4megunix typically it's not smart to stay on old versions, no - they're harder to get fixes for when things are broken... and if you see patches to fix something in openstack upstream it's harder to port them back if you want to13:00
odyssey4meso typically it's smart to try and get to the latest release before half way through the next development cycle13:01
odyssey4meie by the time of the summit13:01
gunixis an upgrade hard? i mean, you guys are the pros on openstack. is it a lot of effort to change from newton to ocata? or from mitaka to newton?13:01
gunixodyssey4me: so right now best version is ... ocata? and when queens will be out, the best version would be pike?13:02
odyssey4megunix no, I mean Pike is now released - by half way through the Queens cycle you should be aiming to have upgraded to Pike13:02
evrardjpI'd go for pike13:02
gunixoh ok. so around december an upgrade to pike13:03
odyssey4meupgrades are easy, but you should do your due diligence of ensuring you test in a test environment beforehand13:03
mgariepygunix it gets easier to upgrade with time. and when you have done it a couple of time you have more confidence.13:03
odyssey4meit's easy especially if you have only one set of configs you care about13:04
gunixthe updates are what scare a lot of people away from openstack13:04
*** armaan has joined #openstack-ansible13:04
gunixit's not that they are hard, it's that you have to go through that every 6 months13:04
openstackgerritAndy McCrae proposed openstack/openstack-ansible-pip_install stable/pike: Change repo name openstack-ocata to openstack-pike  https://review.openstack.org/51465313:06
gunixwhat that would be cool13:06
gunixso you just pip install openstack-ansible? :D13:07
odyssey4megunix that's been discussed a few times... we think we can make that happen, but it'll take time which no-one has right now13:08
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-openstack_hosts master: [DNM] Test depends on.  https://review.openstack.org/51465413:08
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: [DNM] Test depends-on  https://review.openstack.org/51465613:11
openstackgerritMajor Hayden proposed openstack/ansible-hardening stable/ocata: Zuulv3 jobs for Ocata  https://review.openstack.org/51444313:13
openstackgerritMajor Hayden proposed openstack/openstack-ansible-rsyslog_client stable/ocata: Fix postrotate  https://review.openstack.org/51435013:14
*** jwitko_ has joined #openstack-ansible13:14
*** SmearedBeard has quit IRC13:15
mhaydenandymccr: this might be in your interests -> https://review.openstack.org/#/c/514588/13:15
*** rodolof has quit IRC13:16
*** rodolof has joined #openstack-ansible13:16
openstackgerritMajor Hayden proposed openstack/ansible-hardening stable/pike: Zuulv3 migration  https://review.openstack.org/51346113:17
mhaydenif any gertty users have opinions here -> https://review.openstack.org/51466213:19
logan-thanks for the event link mhayden.13:20
mhaydenlogan-: de nada -- i always love free stuff13:20
mhaydeni wasn't sure if there were folks at your office who might want to learn more Ansible13:20
*** dxiri has quit IRC13:22
* lbragstad meanders in with a coffee traveler13:23
lbragstadodyssey4me: o/13:23
*** dxiri has joined #openstack-ansible13:23
logan-yup definitely. it popped up someones meetup thing last week so a couple of us registered13:23
andymccrmhayden: ack13:23
jwitko_what link?!13:23
odyssey4melbragstad if you're ok with it, we'd like to ditch the legacy zuul jobs from the keystone repo https://review.openstack.org/51459213:23
odyssey4mewe'll replace it with something that works and is not a legacy job13:24
odyssey4mealthough the question is whether you'd like that job to be defined in the keystone repo, or in project-config13:24
odyssey4meevrardjp did you see what andymccr picked up? https://review.openstack.org/514653 - that's a problem for both master and pike... and I wonder if that's part of why the CentOS builds are slow?13:25
odyssey4memaybe the wrong repo reconfiguration's being done?13:25
andymccrodyssey4me: its just the name its not the actual repo13:26
odyssey4meandymccr sure, but perhaps the host also has other repositories?13:26
mhaydenjwitko_: ansible meetup day in dallas13:26
evrardjpurl is the same13:26
mhaydenjwitko_: https://www.ansible.com/automates13:26
odyssey4meie there may be the RDO repo configured twice - each with a different name13:26
evrardjpworst case is now we'd have two rdo configured13:26
odyssey4meexactly - that's two sets of caches to update... slowing it down13:26
andymccrodyssey4me: yeah i think the repo config for centos is still a mess - although i think its been simplified13:27
andymccrid rather we only configured that stuff in one place13:27
evrardjpok I will start my cleanup of pip install role I guess.13:27
*** dxiri has quit IRC13:27
lbragstadodyssey4me: so does that mean keystone will be without rolling upgrade testing for a short period of time?13:29
openstackgerritAndy McCrae proposed openstack/openstack-ansible-pip_install master: Change repo name openstack-ocata to openstack-pike  https://review.openstack.org/51466913:29
openstackgerritAndy McCrae proposed openstack/openstack-ansible-openstack_hosts master: Change repo name openstack-ocata to openstack-pike  https://review.openstack.org/51467213:30
odyssey4melbragstad yeah - although the job was only experimental in the keystone pipeline so it wasn't being tested unless someone asked for it13:30
odyssey4meour job is being tested right now, so it's not completely without13:31
odyssey4melbragstad I'd be happy to submit a replacement job now if you want - but you need to let me know whether you'd prefer it in project-config, or in the keystone repo... typically for these kind of jobs it should probably be in the keystone repo so that you guys can adjust its status easily13:32
lbragstadwe can put it in the keystone repo13:33
lbragstadthat makes sense13:33
lbragstadwhere is the new job going to live? project-config13:33
*** jwitko_ is now known as jwitko13:34
*** dxiri has joined #openstack-ansible13:39
*** dxiri has quit IRC13:39
*** dxiri has joined #openstack-ansible13:39
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-openstack_hosts master: Update release codename to Queens  https://review.openstack.org/51467713:42
gunixomg i guess my first osa build finished13:43
gunixi am so confused atm i forgot which password i need for horizon13:43
gunixwhich one was it?13:43
*** dxiri has quit IRC13:44
*** MikeW has joined #openstack-ansible13:46
MikeWHey QQ is anyone using designate with the designate-sink handlers? It looks like my deploy didn't set up exchanges in rabbitmq, and I'm just wondering what I can do to get this integration to work13:47
*** SmearedBeard has joined #openstack-ansible13:49
gunixfond it, nevermind13:49
Miougegunix: do a “grep keystone_auth_admin_password /etc/openstack_deploy/user_secrets.yml” :)13:49
gunixMiouge: yes, found it13:50
gunixMiouge: what about demo pass ? cause i can't change project even if i am admin13:54
*** ansibler has joined #openstack-ansible13:54
MiougeI don’t know about the password for “demo” and “alt_demo” but you can reset them from the admin account13:55
odyssey4melbragstad the base job for our cross-repo tests is in openstack-ansible-tests13:57
odyssey4meI'll push up a patch in a bit13:57
ansiblerhi, trying to install OSA third time, somehow setup-infrastructure.yml does not set up rabbit-mq containers with first time, if rerun, then installs, but afterwards I noticed rejected rabbitmq requests from other services. For the first run there are the errors: https://pastebin.com/raw/ZwcricqM14:00
ansiblerany ideas what's missing for successfull install ?14:00
ansiblertrying OSA 16.0.114:01
andymccrodyssey4me: interestingly we set the prio for that repo to 50 but it wasnt named properly so that prio wouldnt have applied14:06
odyssey4meandymccr hmm, that might affect the reliability of the jobs14:07
andymccrso fixing the name should fix that14:07
odyssey4megood catch!14:07
gunixhow do you connect to the containers after deploying osa?14:08
gunixi did lxc-console container_name and it asks for user/pass14:08
ansiblergunix: lxc-attach -n <containername>14:09
odyssey4megunix lxc-attach -n14:09
gunixi connected with ssh and it worked, but thanks14:09
gunixi figured that the ansible node should have the keys in the containers :D14:10
openstackgerritMaxime Guyot proposed openstack/openstack-ansible master: Fix typo  https://review.openstack.org/51468614:10
lbragstadodyssey4me: ok - cool, i'm happy to take a look when you get a patch up14:13
odyssey4melbragstad cool beans14:13
*** kiennt26 has quit IRC14:14
openstackgerritMerged openstack/openstack-ansible-tests master: Add cross-repo base job  https://review.openstack.org/51345314:15
*** shardy has joined #openstack-ansible14:15
*** vnogin has quit IRC14:15
lbragstadodyssey4me: is there a ML thread advertising this to affected projects?14:15
ansiblerrabbit-mq does not install on first run of setup-infrastructure.yml   https://pastebin.com/raw/ZwcricqM  Any hints appreciated14:16
openstackgerritMerged openstack/openstack-ansible-os_neutron master: Reinstore upgrade testing in Neutron  https://review.openstack.org/51432314:17
*** udesale has quit IRC14:21
*** rodolof has quit IRC14:24
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_almanach master: Updated from OpenStack Ansible Tests  https://review.openstack.org/51469214:24
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_freezer master: Updated from OpenStack Ansible Tests  https://review.openstack.org/51469414:25
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_monasca master: Updated from OpenStack Ansible Tests  https://review.openstack.org/51469514:25
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_monasca-agent master: Updated from OpenStack Ansible Tests  https://review.openstack.org/51469614:25
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_monasca-ui master: Updated from OpenStack Ansible Tests  https://review.openstack.org/51469714:25
mhaydenevrardjp: would you want to remove your megadeuce on this one? https://review.openstack.org/50126314:25
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_octavia master: Updated from OpenStack Ansible Tests  https://review.openstack.org/51469814:25
openstackgerritOpenStack Proposal Bot proposed openstack/ansible-hardening master: Updated from OpenStack Ansible Tests  https://review.openstack.org/51469914:26
odyssey4melbragstad nope - the list of projects is very small, and most only had the job experimental anyway14:29
odyssey4melol, hello proposal bot14:30
odyssey4mewelcome back14:30
idlemindany chance i can use a raspberry pi for the 3rd infra node? (i have 2 lab servers, not a 3rd)14:31
openstackgerritMerged openstack/openstack-ansible-rsyslog_server stable/ocata: Initial Zuul v3 role jobs  https://review.openstack.org/51430614:31
*** mbuil has joined #openstack-ansible14:32
*** nshetty has quit IRC14:32
evrardjpdear cloudnull, DimGR, andymccr, d34dh0r53, hughsaunders, b3rnard0, palendae, odyssey4me, serverascode, rromans, erikmwilson, mancdaz, _shaps_, BjoernT, claco, echiu, dstanek, jwagner, ayoung, prometheanfire, evrardjp,14:32
evrardjparbrandes, mhayden, scarlisle, luckyinva, ntt, javeriak, spotz, vdo, jmccrory, alextricity25, jasondotstar, admin0, michaelgugino, ametts, v1k0d3n, severion, bgmccollum, darrenc, JRobinson__, asettle, colinmcnamara,14:32
evrardjpthorst, adreznec, eil397, qwang,nishpatwa_, cathrichardson, drifterza, hwoarang, cshen, ullbeking:14:32
evrardjpthe osa bug triage will start in 1h30’. Please have a look at the bug list before starting: https://etherpad.openstack.org/p/osa-bugtriage14:32
evrardjpThank you14:32
evrardjpidlemind: I don't think so :p14:33
*** vnogin has joined #openstack-ansible14:33
odyssey4meidlemind technically, possibly - but you would wait a very long time for the repo build process because the CPU isn't very good14:33
odyssey4mealso, your database and rabbitmq would operate super slowly14:34
idlemindthx oh that's true a lot of "from source" stuff14:34
*** hamzy has quit IRC14:35
openstackgerritMerged openstack/openstack-ansible-rsyslog_client stable/ocata: Initial Zuul v3 role jobs  https://review.openstack.org/51430514:35
*** DanyC_ has joined #openstack-ansible14:36
openstackgerritTaseer Ahmed proposed openstack/openstack-ansible master: Integrate Congress with OSA.  https://review.openstack.org/50397114:36
hwoarangevrardjp: i am on business trip so i am not sure if i will make it to the meeting14:37
evrardjpno worries hwoarang :)14:37
ansibleridlemind: maybe 2 VirtualBox VMs on one physical and then you got 3 hosts in total..14:38
evrardjpodyssey4me: idlemind the rpi will OOM14:38
*** DanyC has quit IRC14:38
evrardjpIt's not possible.14:38
idlemindya but then i reboot a physical host and lose the db so 2 hosts basically equals 114:38
evrardjptake a beefier arm node if you want to stick with arm :p14:39
idlemindevradjp thx ya that's always a worry (1gb of ram)14:39
openstackgerritMerged openstack/openstack-ansible-openstack_hosts master: Update release codename to Queens  https://review.openstack.org/51467714:39
idlemindnah prolly just pick up a third x86 host14:39
idlemindfor the lab14:39
evrardjpidlemind: virtual machines?14:39
idlemindmaybe a nuc14:39
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Improve execution time by using dynamic groups  https://review.openstack.org/51387614:39
idlemindevrardjp ya my lab currently has 2 hypervisors14:40
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Convert the AIO from using overlayfs to machinectl  https://review.openstack.org/51017514:40
*** maybebuggy has quit IRC14:41
openstackgerritMerged openstack/openstack-ansible-pip_install master: Change repo name openstack-ocata to openstack-pike  https://review.openstack.org/51466914:41
mhaydenugh, i've got that error again in Newton -> Unexpected Exception: 'Inventory' object has no attribute 'get_group_dict'14:42
*** gouthamr has joined #openstack-ansible14:42
mhaydencan't remember how i solved it before14:42
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_keystone stable/ocata: Add security headers to web accessable services.  https://review.openstack.org/51397414:44
openstackgerritMerged openstack/openstack-ansible-plugins stable/ocata: Initial Zuul v3 role jobs  https://review.openstack.org/51430114:45
hwoarangevrardjp: proposal bot works https://review.openstack.org/#/c/514692/ :)14:45
evrardjpI know :) I followed this14:46
hwoarangone less problem to solve14:46
*** pbandark has quit IRC14:46
openstackgerritAndy McCrae proposed openstack/openstack-ansible-pip_install stable/pike: Change repo name openstack-ocata to openstack-pike  https://review.openstack.org/51470414:48
*** acormier has joined #openstack-ansible14:48
*** acormier has quit IRC14:49
*** jvidal has quit IRC14:49
*** acormier has joined #openstack-ansible14:50
*** ansibler has quit IRC14:52
*** acormier has quit IRC14:54
openstackgerritMerged openstack/openstack-ansible-repo_server stable/ocata: Initial Zuul v3 role jobs  https://review.openstack.org/51430414:55
*** armaan has quit IRC14:55
*** mbuil has quit IRC14:56
openstackgerritMerged openstack/openstack-ansible-galera_client stable/ocata: Initial Zuul v3 role jobs  https://review.openstack.org/51427614:58
openstackgerritMerged openstack/openstack-ansible-openstack_hosts stable/ocata: Initial Zuul v3 role jobs  https://review.openstack.org/51428314:58
openstackgerritMerged openstack/openstack-ansible-haproxy_server stable/ocata: Initial Zuul v3 role jobs  https://review.openstack.org/51427914:58
openstackgerritMerged openstack/openstack-ansible-ceph_client stable/ocata: Initial Zuul v3 role jobs  https://review.openstack.org/51427514:58
openstackgerritMerged openstack/openstack-ansible-memcached_server stable/ocata: Initial Zuul v3 role jobs  https://review.openstack.org/51428214:58
openstackgerritMerged openstack/openstack-ansible-openstack_openrc stable/ocata: Initial Zuul v3 role jobs  https://review.openstack.org/51428414:58
openstackgerritMerged openstack/openstack-ansible-lxc_hosts stable/ocata: Initial Zuul v3 role jobs  https://review.openstack.org/51428114:58
openstackgerritMerged openstack/openstack-ansible-pip_install stable/ocata: Initial Zuul v3 role jobs  https://review.openstack.org/51430015:01
*** ansibler has joined #openstack-ansible15:02
openstackgerritMerged openstack/openstack-ansible-rsyslog_client stable/newton: Logrotate not restarting rsyslog  https://review.openstack.org/51433315:04
openstackgerritMerged openstack/openstack-ansible-rsyslog_client stable/newton: Fix postrotate  https://review.openstack.org/51435715:04
openstackgerritMerged openstack/openstack-ansible-repo_build stable/ocata: Initial Zuul v3 role jobs  https://review.openstack.org/51430315:04
openstackgerritMerged openstack/openstack-ansible-lxc_container_create stable/ocata: Initial Zuul v3 role jobs  https://review.openstack.org/51428015:04
openstackgerritMajor Hayden proposed openstack/ansible-hardening stable/newton: Zuulv3 jobs for Newton  https://review.openstack.org/51444415:05
*** Oku_OS is now known as Oku_OS-away15:08
*** chyka has joined #openstack-ansible15:12
openstackgerritMajor Hayden proposed openstack/openstack-ansible-tests stable/pike: Add fedora to run_tests_common.sh  https://review.openstack.org/51471115:13
*** vnogin has quit IRC15:13
openstackgerritMajor Hayden proposed openstack/ansible-hardening stable/pike: Zuulv3 migration  https://review.openstack.org/51346115:14
openstackgerritMerged openstack/openstack-ansible-rabbitmq_server stable/ocata: Initial Zuul v3 role jobs  https://review.openstack.org/51430215:15
openstackgerritMajor Hayden proposed openstack/ansible-hardening stable/pike: Zuulv3 jobs for Pike  https://review.openstack.org/51346115:15
*** dxiri has joined #openstack-ansible15:16
*** mummer has joined #openstack-ansible15:17
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_almanach master: Updated from OpenStack Ansible Tests  https://review.openstack.org/51469215:17
*** ansibler has quit IRC15:20
*** hamzy has joined #openstack-ansible15:21
*** TxGirlGeek has joined #openstack-ansible15:23
*** galstrom_zzz is now known as galstrom15:23
*** andressanchez has quit IRC15:26
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-os_keystone master: Remove v2 default variables  https://review.openstack.org/51471715:29
openstackgerritMerged openstack/openstack-ansible-os_heat stable/ocata: Initial Zuul v3 role jobs  https://review.openstack.org/51428715:31
openstackgerritMerged openstack/openstack-ansible-os_glance stable/ocata: Add voting CentOS.  https://review.openstack.org/51444615:33
openstackgerritKevin Lefevre proposed openstack/openstack-ansible-os_nova master: Enable KSM support for Nova  https://review.openstack.org/50786215:34
openstackgerritMerged openstack/ansible-hardening master: Updated from OpenStack Ansible Tests  https://review.openstack.org/51469915:37
openstackgerritMerged openstack/openstack-ansible-pip_install stable/pike: Change repo name openstack-ocata to openstack-pike  https://review.openstack.org/51470415:37
*** acormier has joined #openstack-ansible15:39
*** acormier has quit IRC15:40
*** acormier has joined #openstack-ansible15:40
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_keystone stable/pike: Remove unified queue from gate pipeline  https://review.openstack.org/51472015:45
*** newmember has joined #openstack-ansible15:46
openstackgerritMerged openstack/openstack-ansible-os_octavia master: Add OpenStack-Ansible metadata  https://review.openstack.org/51050215:47
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests stable/pike: Remove unified queue from gate pipeline  https://review.openstack.org/51472215:49
*** yolanda has quit IRC15:54
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server stable/newton: Remove unified queue from gate pipeline  https://review.openstack.org/51472415:55
*** exodusftw has quit IRC15:59
evrardjpBug triage cloudnull, DimGR, andymccr, d34dh0r53, hughsaunders, b3rnard0, palendae, odyssey4me, serverascode, rromans, erikmwilson, mancdaz, _shaps_, BjoernT, claco, echiu, dstanek, jwagner, ayoung, prometheanfire, evrardjp, arbrandes, mhayden, scarlisle, luckyinva, ntt, javeriak, spotz, vdo, jmccrory, alextricity25, jasondotstar, admin0, michaelgugino, ametts, v1k0d3n, severion, bgmccollum, darrenc, JRobinson__, asettle,16:02
evrardjpcolinmcnamara, thorst, adreznec, eil397, qwang,nishpatwa_, cathrichardson, drifterza, hwoarang, cshen16:02
evrardjpHere is our bug list for today https://etherpad.openstack.org/p/osa-bugtriage16:02
evrardjp#startmeeting openstack_ansible_meeting16:02
openstackMeeting started Tue Oct 24 16:02:25 2017 UTC and is due to finish in 60 minutes.  The chair is evrardjp. Information about MeetBot at http://wiki.debian.org/MeetBot.16:02
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:02
*** openstack changes topic to " (Meeting topic: openstack_ansible_meeting)"16:02
openstackThe meeting name has been set to 'openstack_ansible_meeting'16:02
evrardjp#link https://bugs.launchpad.net/openstack-ansible/+bug/172453816:02
openstackLaunchpad bug 1724538 in openstack-ansible "gnocchi install api runtime error numpy version 0xa 0xb" [Undecided,New]16:02
*** acormier has quit IRC16:02
openstackgerritMerged openstack/openstack-ansible master: Fix typo  https://review.openstack.org/51468616:02
evrardjpconfirmed medium16:03
evrardjpI've been working with some ppl it's a requirements problem. We can pin it.16:03
*** acormier has joined #openstack-ansible16:03
evrardjpin the gnocchi role16:03
evrardjp(to be proven)16:03
evrardjpok next then16:03
evrardjp#link https://bugs.launchpad.net/openstack-ansible/+bug/172402516:03
openstackLaunchpad bug 1724025 in openstack-ansible "https://github.com/openstack/openstack-ansible/blob/master/tests/roles/bootstrap-host/tasks/check-requirements.yml invalid regular expression to identify the space available in /" [Undecided,New]16:03
evrardjphave you seen that?16:04
andymccrno - i would've thought we'd see a lot of failures for that if it was broken16:04
odyssey4menever seen it - looking16:05
evrardjpyeah, so question is: do we override that in our gateS?16:05
evrardjpto skip the test/16:05
evrardjpskip the test? *16:05
andymccri wouldnt have thought so16:05
andymccri mean if we do, thats really not good16:05
odyssey4meno we don't16:06
odyssey4mebut some nodes have root disk space, and some have second disks16:06
odyssey4menot sure what the profile is these days16:06
odyssey4methis is only touching those which need to use the root disk space16:07
odyssey4meI can take a peek at that16:07
evrardjpI don't mark it as confirmed right now16:07
*** acormier has quit IRC16:07
xgerman_evrajdip: so I need to 1) Migrate my job to zuul 2) Review/Fix tests16:08
*** exodusftw has joined #openstack-ansible16:08
evrardjpandymccr: will love the next one16:08
evrardjp#link https://bugs.launchpad.net/openstack-ansible/+bug/172325716:08
openstackLaunchpad bug 1723257 in openstack-ansible "Pike: can't install nova-compute and ceph-osd side by side" [Undecided,New]16:08
evrardjpxgerman_: this is bug triage but yes.16:09
evrardjpthanks xgerman_!16:09
evrardjpI can help you on the patterns16:09
evrardjplet's sync after the meeting16:09
andymccrdidnt we add ceph v3 support? logan- ?16:10
logan-note yet :(16:10
logan-not yet*16:10
openstackgerritMerged openstack/ansible-hardening stable/ocata: Zuulv3 jobs for Ocata  https://review.openstack.org/51444316:10
logan-gate roulette16:10
andymccrhes talking about stable anyway.16:10
logan-we have v3 in master16:11
evrardjpyeah but I think for Pike it's better to move to v316:11
logan-that patch is stable/pike16:11
andymccrahh ok16:11
andymccryeah makes sense16:11
evrardjpBecause right now Pike is pinned with a beta sha, IIRC16:11
evrardjpright logan-?16:11
andymccrok i'll take a look at helping get that to work16:11
logan-correct evrardjp16:11
andymccrit seems like the correct solution is to move to ceph-ansible v3.0.4 or w/e16:11
evrardjpandymccr: logan-: has already something pending16:11
andymccryeah he pasted it evrardjp :D16:12
evrardjpandymccr: yes it would be nice16:12
andymccri dont remember it being that complicated though16:12
andymccrto move to v3 that is16:12
logan-ah right 3.0.4 tagged now, should prob bump the tags in that patch16:12
logan-its all v3.0.3 in there16:12
andymccrok cool will put some work into that16:13
evrardjpthat's detail, and it can be picked in the a-r-r bumps I GUESS16:13
andymccri'll put a comment in the bug16:13
evrardjpwoops on all caps16:13
evrardjpok great16:13
evrardjpthanks all!16:13
evrardjp#link https://bugs.launchpad.net/openstack-ansible/+bug/172302916:13
openstackLaunchpad bug 1723029 in openstack-ansible "nova-console-container spice not installing correct" [Undecided,New]16:13
odyssey4meevrardjp a-r-r bumps don't do external repositories ;)16:13
evrardjpodyssey4me: it does now.16:13
odyssey4meinteresting - ok16:13
evrardjplong story I will skip that for the triage :p16:13
openstackgerritLogan V proposed openstack/openstack-ansible stable/pike: Add ceph-ansible v3 support  https://review.openstack.org/51265516:14
openstackgerritMerged openstack/openstack-ansible-os_tempest stable/pike: Use the deployment host to download images for tempest  https://review.openstack.org/51457116:15
openstackgerritMerged openstack/openstack-ansible-tests stable/ocata: Add voting CentOS.  https://review.openstack.org/51444516:15
evrardjpthaat could have been nice to have a branch there16:15
evrardjpit looks like there is placement, which makes it O and above16:15
evrardjpspice looks ok to me16:16
evrardjpany idea?16:16
andymccrwe need more info16:16
andymccrdid tasks fail?16:16
andymccrwhat version is he running16:17
evrardjpI meant I agree.16:17
andymccrwould also be good to know if it actually installed hte packages16:17
andymccre.g. is spice installed and just not running16:17
andymccrcos it failed to start16:17
andymccror whats the deal16:17
evrardjpok I will comment on the bug16:18
evrardjp#link https://bugs.launchpad.net/openstack-ansible/+bug/172220016:18
openstackLaunchpad bug 1722200 in openstack-ansible "percona-xtrabackup unmet dependencies" [Undecided,New]16:18
andymccrif the gate failed16:19
evrardjphas anyone experienced that?16:19
andymccrthen confirmed at the least ;D16:19
evrardjpwell I haven't seen a gate failure16:20
andymccrohh upgraded fine16:20
odyssey4mewe're not seeing it in the gate, and the only time I've seen that sort of thing is when using your own repositories16:20
odyssey4meyour comment is fair - need more details16:20
evrardjpso we agree: Incomplete.16:21
andymccrpy3.5 seems weird16:21
evrardjpfun with ceilometer for next:16:21
evrardjp#link https://bugs.launchpad.net/openstack-ansible/+bug/172155416:21
openstackLaunchpad bug 1721554 in openstack-ansible "os_ceilometer fails without swift installed" [Medium,New]16:21
evrardjpit seems we recently have a series of ppl wanting Telemetry. I am trying to convert them to maintaining the role, but I am not successful yet :D16:22
odyssey4methat seems like vars with no defaults in the role16:22
evrardjpthis can potentially come from the move of the group vars16:23
odyssey4meand yes, perhaps that too16:23
odyssey4mealthough, this is pike - I don't think we did a port back of the scoping changes16:23
evrardjpit was master at that time16:23
evrardjpI mean the group vars change happened in master during the Pike timeframe16:24
odyssey4meno, the scoping patch came after pike released16:24
evrardjpor maybe that's not it.16:24
openstackgerritMerged openstack/openstack-ansible master: Add python as an install step  https://review.openstack.org/51433516:24
odyssey4methat's only in master16:25
evrardjpuntil someone confirms it, should we leave the bug as is?16:25
*** pcaruana has quit IRC16:25
odyssey4megiven that autoscaling is a popular use-case, we might have to figure out how to test it periodically or something16:25
*** weezS has joined #openstack-ansible16:26
evrardjpyeah that would be nice to get some contributions, I will send a call to the ML with a link to an etherpad, listing what should be done for the telemetry stack16:26
evrardjpif we have enough time this cycle, I can work on it16:26
evrardjpbut right now it's low on our prio list, so we'll see if someone steps up.16:27
evrardjpin the meantime, I suggest we leave the bug as is, stating we need more ppl to triage the bug16:27
evrardjp#link https://bugs.launchpad.net/openstack-ansible/+bug/171951716:28
openstackLaunchpad bug 1719517 in openstack-ansible "Ceilometer policy.json includes python unicode encoding" [Undecided,New]16:28
evrardjpmore ceilometer...16:28
evrardjpceilometer has no tests in O/P16:28
evrardjpit won't pass16:28
andymccrceilometer <316:28
andymccrif everybody who filed a bug for ceilometer/gnocchi just helped to maintain the role16:29
andymccrwe would have 0 bugs for ceilomter/gnocchi16:29
evrardjpI fixed something in master for gnocchi, but that's not enough, we need more contributions16:29
evrardjpStill, because it passes master, we are in a weird state for role maturity.16:30
*** RandomTech has joined #openstack-ansible16:30
RandomTechhey everyone, i have encountered a problem16:30
andymccrppl seem to like them though16:30
evrardjplet's leave it as is. I will just add them into the etherpad and send the mail to the ML16:31
evrardjpandymccr: the bugs?16:31
evrardjpor the Telemetry stack :p16:31
evrardjpok let's move on16:31
evrardjp#link https://bugs.launchpad.net/openstack-ansible/+bug/171459716:31
openstackLaunchpad bug 1714597 in openstack-ansible "multi OS repo-build needs to be more intuitive " [Undecided,New] - Assigned to Jesse Pretorius (jesse-pretorius)16:31
andymccrthe stack16:31
RandomTechI tried to run register with template and it threw an error. any sugestions?16:31
evrardjpRandomTech: we'll handle that after our meeting if you don't mind16:31
evrardjpthat is an old bug16:32
RandomTechno rush16:32
evrardjpodyssey4me: do you remember what we discussed in that triage, or should I get the logs back?16:32
odyssey4meI haven't had a chance to look at it - as discussed previously I need some sort of repeatable test environment to very it and fix it.16:33
*** shardy has quit IRC16:33
odyssey4meas yet it's not confirmed16:33
odyssey4methe mentioned patch in the comments there possibly fixed it, if it was an issue16:34
evrardjplet's leave it as is, he will expire if we can't find time.16:34
evrardjpit has no priority since it's maybe fixed.16:34
evrardjp#link https://bugs.launchpad.net/openstack-ansible/+bug/170836016:34
openstackLaunchpad bug 1708360 in openstack-ansible "Openstack-Ansible Install Fails with OVS" [Undecided,New]16:34
evrardjpstill no resources I guess?16:35
evrardjpanyone up for the OVS challenge yet?16:35
evrardjp#link https://bugs.launchpad.net/openstack-ansible/+bug/170714216:36
openstackLaunchpad bug 1707142 in openstack-ansible "pip_install: "The following packages cannot be authenticated"" [Undecided,New]16:36
evrardjpHas someone seen that?16:36
evrardjpwe can leave it as is16:36
andymccrive not seen that16:36
andymccrwould love to see ovs testing/work but hey ;P thats been cycles16:37
evrardjpwell that's gonna need to be part of some opnfv work, so we're gonna get there :)16:37
evrardjpok next16:38
evrardjp#link https://bugs.launchpad.net/openstack-ansible/+bug/170644616:38
openstackLaunchpad bug 1706446 in openstack-ansible "Keystone bootstrap failed when using LDAP" [Undecided,New]16:38
evrardjpnothing new under the horizon?16:38
evrardjppun intended16:38
andymccri got nothing on that ;D16:39
evrardjpok let's move on16:39
odyssey4me'upgrade to mitaka' - I thought we agree ages ago that mitaka is EOL and therefore the bug cannot be fixed16:39
evrardjpwe are forced to do that...16:39
evrardjpoh yeah we are probably waiting for expiry16:39
odyssey4meah - previous discussion16:39
odyssey4mean ldap back-end test has long been on my list16:40
odyssey4mebut it's a long list16:40
evrardjpwell it doesn't matter for now for this triage!16:40
odyssey4methis is a wontfix simply because mitaka is EOL16:41
odyssey4meno need to wait for expiry16:41
andymccrwe cant fix16:41
andymccrcant fix wont fix16:41
*** DanyC_ has quit IRC16:41
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_almanach stable/ocata: Updated from OpenStack Ansible Tests  https://review.openstack.org/51474716:41
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_aodh stable/ocata: Updated from OpenStack Ansible Tests  https://review.openstack.org/51474816:42
odyssey4menever mind the fact that service accounts are not designed, in keystone, to be in LDAP16:42
*** DanyC has joined #openstack-ansible16:42
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_barbican stable/ocata: Updated from OpenStack Ansible Tests  https://review.openstack.org/51474916:42
openstackgerritBjoern Teipel proposed openstack/openstack-ansible-os_cinder master: Document reasonable radosgw timeout  https://review.openstack.org/51475016:42
odyssey4methey're supposed to be in the DB only16:42
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_ceilometer stable/ocata: Updated from OpenStack Ansible Tests  https://review.openstack.org/51475116:42
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_designate stable/ocata: Updated from OpenStack Ansible Tests  https://review.openstack.org/51475216:42
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_ironic stable/ocata: Updated from OpenStack Ansible Tests  https://review.openstack.org/51475316:42
evrardjpI marked it in won't fix16:42
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_monasca stable/ocata: Updated from OpenStack Ansible Tests  https://review.openstack.org/51475416:42
evrardjpdoesn't fit openstack project plans to fix this16:43
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_sahara stable/ocata: Updated from OpenStack Ansible Tests  https://review.openstack.org/51475516:43
*** DanyC has quit IRC16:43
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_zaqar stable/ocata: Updated from OpenStack Ansible Tests  https://review.openstack.org/51475616:43
evrardjpok the next ones are in the same state.16:43
evrardjpso I guess we are done for today16:43
evrardjpis there anything to add for someone?16:43
andymccrnothing from me16:43
*** acormier has joined #openstack-ansible16:43
evrardjplet's wrap up then!16:44
evrardjpthanks everyone!16:44
*** openstack changes topic to "Launchpad: https://launchpad.net/openstack-ansible || Weekly Meetings: https://wiki.openstack.org/wiki/Meetings/openstack-ansible || Review Dashboard: https://goo.gl/tTmdgs"16:44
openstackMeeting ended Tue Oct 24 16:44:12 2017 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:44
openstackMinutes:        http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2017/openstack_ansible_meeting.2017-10-24-16.02.html16:44
odyssey4methx evrardjp16:44
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2017/openstack_ansible_meeting.2017-10-24-16.02.txt16:44
openstackLog:            http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2017/openstack_ansible_meeting.2017-10-24-16.02.log.html16:44
evrardjpRandomTech: we'd need the log to help you with the error16:44
evrardjpbut if you did a templating issue, the chances are high that it would fail without you getting further... unless ignore errors is used.16:45
*** pbandark has joined #openstack-ansible16:46
openstackgerritBjoern Teipel proposed openstack/openstack-ansible-os_cinder master: Document reasonable radosgw timeout  https://review.openstack.org/51475016:49
RandomTechi got it fixed16:50
*** BjoernT has joined #openstack-ansible16:50
RandomTechi accidentally had register under template instade of parralel with it16:51
*** br0k3n has quit IRC16:51
*** BjoernT has quit IRC17:01
*** mrch has quit IRC17:01
*** chigang_ has quit IRC17:01
openstackgerritMichael Johnson proposed openstack/openstack-ansible-os_octavia master: Add zuul v3 support/jobs  https://review.openstack.org/51476717:02
odyssey4meevrardjp how did we both miss the octavia repo in the zuul job setup?17:05
openstackgerritMichael Johnson proposed openstack/openstack-ansible-os_octavia master: Add zuul v3 support/jobs  https://review.openstack.org/51476717:05
johnsomYep, just added it17:05
*** acormier has quit IRC17:06
odyssey4mejohnsom apologies, I don't know how we missed it17:06
johnsomNP, yeah the first patch I forgot the git add... Doh17:06
*** acormier has joined #openstack-ansible17:06
odyssey4mejohnsom another tweak needed17:07
*** acormier has quit IRC17:07
*** acormier has joined #openstack-ansible17:07
*** acormier_ has joined #openstack-ansible17:08
evrardjpodyssey4me: yes17:08
*** acormier_ has quit IRC17:08
openstackgerritMichael Johnson proposed openstack/openstack-ansible-os_octavia master: Add zuul v3 support/jobs  https://review.openstack.org/51476717:09
*** acormier_ has joined #openstack-ansible17:09
johnsomFair enough, removed for now17:09
*** acormier_ has quit IRC17:09
evrardjpjohnsom: sorry for that glitch17:09
*** acormier_ has joined #openstack-ansible17:09
*** acormier_ has quit IRC17:09
johnsomNo worries, we got it covered17:10
odyssey4meevrardjp FYI the keystone cross-pore patch is up: https://review.openstack.org/#/c/514765/17:10
evrardjpwe can also have cross repo things for you17:10
odyssey4methat'll do the upgrade test on their repo17:10
*** acormier_ has joined #openstack-ansible17:10
evrardjpcross pore? :p17:10
odyssey4me*cross-repo even17:10
evrardjpI will review it17:10
odyssey4meI'm not convinced that the rest of our tooling will work as it's supposed to with zuul v3 - will validate and fix with that patch17:10
*** acormier has quit IRC17:12
*** acormier_ has quit IRC17:15
openstackgerritMerged openstack/openstack-ansible-openstack_hosts master: Change repo name openstack-ocata to openstack-pike  https://review.openstack.org/51467217:15
*** phalmos has joined #openstack-ansible17:21
odyssey4meevrardjp now the nova-lxd patch: https://review.openstack.org/#/c/514770/17:21
admin0\o .. triage starts when i leave office, and ends after i reach home :D17:21
*** phalmos_ has joined #openstack-ansible17:24
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-openstack_hosts stable/pike: Change repo name openstack-ocata to openstack-pike  https://review.openstack.org/51477117:25
odyssey4meandymccr mhayden evrardjp ^17:25
*** phalmos has quit IRC17:27
odyssey4mealright, I'm out for the night - cheers all17:30
*** gkadam has quit IRC17:30
RandomTechis there a way to revert a change only if something fails17:31
*** weezS has quit IRC17:32
evrardjpgood night odyssey4me17:37
evrardjpnot sure what you meant RandomTech17:37
evrardjpI am gone for today too!17:37
evrardjpcya tomorrow!17:37
mgariepycya evrardjp17:39
RandomTechfor example if restarting networking fails i want to revert what i did to the interfaces file17:39
*** vnogin has joined #openstack-ansible17:43
openstackgerritMajor Hayden proposed openstack/openstack-ansible-lxc_hosts stable/pike: lxc_cache_preparation: Convert the LXC cache preparation to async task  https://review.openstack.org/51477617:46
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_swift stable/pike: Suppress rsync warnings w/command  https://review.openstack.org/50126317:47
*** acormier has joined #openstack-ansible17:48
openstackgerritMerged openstack/openstack-ansible-openstack_hosts stable/pike: Change repo name openstack-ocata to openstack-pike  https://review.openstack.org/51477117:49
mhaydencloudnull: https://review.openstack.org/51346117:49
mgariepymhayden, https://review.openstack.org/#/c/514350/17:49
* mhayden looksees17:49
mgariepythanks sir.17:50
mhaydenmgariepy: ça a l'air fantastique17:50
mgariepytu prends des cours de français ?17:50
mgariepymhayden, est tu capables de faire des é ?17:51
cloudnullmucho si17:51
mhaydentu prends des cours de français == "Do you pretend to drink Coors in France?"17:52
*** vnogin has quit IRC17:52
* mhayden waits for evrardjp's rage17:52
mhaydenmgariepy: no hablo frances, pero hablo un poco de espanol ;)17:52
mhaydenpero, cuando hablo espanol en mi casa, mi esposa me dice "PARATE!"17:53
mhaydenNO ME DIGAS17:55
*** acormier has quit IRC17:55
mhaydeni speak spanish like George W. Bush17:55
mhaydenhorrible accent17:55
mgariepyI don't speak spanish  but I have a terrible accent in english.17:55
mhaydenah i can understand ya just fine17:56
mhaydenthe people in barcelona usually had this response to me when i spoke spanish: https://media.giphy.com/media/xhN4C2vEuapCo/giphy-tumblr.gif17:56
openstackgerritMerged openstack/openstack-ansible-rsyslog_client stable/ocata: Fix postrotate  https://review.openstack.org/51435018:02
*** smatzek has quit IRC18:09
*** acormier has joined #openstack-ansible18:09
*** gunix has quit IRC18:09
*** smatzek has joined #openstack-ansible18:10
admin0hi all .. if I do “openstack image list” as a user, it give me “Not Found (HTTP 404) (Request-ID: req-fd6f3440-6cf7-4846-b20a-44e7d02e3965)” .. but when i do the same via horizon ( i.e login from horizon ) it works fine … as a user, it fails on the cli18:10
admin0openstack image list as admin from util container works18:10
admin0openstack image list as user from util container works18:11
admin0so only image fails as user login from non-admin container :(18:11
admin0i mean from everywhere else18:12
admin0let me paste both debugs18:12
*** gunix has joined #openstack-ansible18:13
*** smatzek has quit IRC18:14
*** pbandark1 has joined #openstack-ansible18:18
*** pbandark has quit IRC18:19
*** pbandark1 is now known as pbandark18:19
admin0this is one: working from util container:  https://gist.github.com/a1git/d9456d101176cbc631a9ff165daa6c41  .. this is same user from everywhere else which does not work:  https://gist.github.com/a1git/87cde15c7b2f7671c5236ed97d24b45918:19
openstackgerritMajor Hayden proposed openstack/ansible-hardening master: Add scaffolding for contrib tasks  https://review.openstack.org/51438518:20
*** acormier has quit IRC18:21
*** acormier has joined #openstack-ansible18:22
*** electrofelix has quit IRC18:23
*** weezS has joined #openstack-ansible18:26
*** acormier has quit IRC18:26
*** SmearedBeard is now known as SmearedBeard-AFK18:29
cloudnulladmin0: looks like https://my.turnkey.cloud:9292 is up and passing traffic. can you grab the debug output from a failed request?18:32
cloudnulloh sorry, I didn't look at the second link18:32
cloudnullone sec18:32
*** SmearedBeard-AFK has quit IRC18:33
*** SmearedBeard has joined #openstack-ansible18:34
*** TxGirlGeek has quit IRC18:35
*** stuartgr has quit IRC18:35
xgerman_for people keeping track patch 85501cb broke the Octavia scenario in os-ansible18:36
cloudnulladmin0: looks like the token response is using the internal interface18:36
cloudnullcan you share what the openrc file or clouds.yml looks like?18:36
cloudnullxgerman_: how so ?18:37
cloudnullis that something we can add a gate check for ?18:37
xgerman_a var required for neutron (when Octavia runs) got removed from all/18:38
cloudnullxgerman_: something you can patch and get up for review?18:38
xgerman_yes, but I need to get my bearings apparently I have to do hostvars[‘localhost’][‘var’] so will be patches in different repos18:38
cloudnullif that var needs to be shared across services then move it back to all/18:39
xgerman_I put up jobs for a gate in the pre zuul days — maybe it got lost in migration18:39
xgerman_cloudnull: just two services18:39
cloudnullit looks like this change is only in master.18:39
xgerman_I was working on new stuff ;-)18:40
cloudnullso we can fix it before it gets into the release18:40
openstackgerritMajor Hayden proposed openstack/ansible-hardening master: Docs/Reno fixes  https://review.openstack.org/51479018:40
xgerman_will put up a patch18:40
cloudnullcool . you should be able to get it working like it used to by just moving the vars back to a global position.18:40
openstackgerritMajor Hayden proposed openstack/ansible-hardening master: Add scaffolding for contrib tasks  https://review.openstack.org/51438518:43
openstackgerritGerman Eichberger proposed openstack/openstack-ansible master: Fixes a var dependency between Neutron and Octavia  https://review.openstack.org/51479118:45
xgerman_^^ yep18:45
xgerman_now I need to go digging to find out what happened to the job18:47
*** Neptu has quit IRC18:50
*** vakuznet has joined #openstack-ansible18:54
gunixam i still online?18:56
gunixsorry, yes, nevermind.18:56
*** phalmos_ has quit IRC18:57
gunixi keep getting this error: Permission denied, please try again.", "Permission denied, please try again.", "Permission denied (publickey,password).", "rsync: connection unexpectedly closed (0 bytes received so far) [Receiver]", "rsync error: error in rsync protocol data stream (code 12) at io.c(226) [Receiver=3.1.1]"], "stdout": "", "stdout_lines": []}18:57
*** DanyC has joined #openstack-ansible18:57
gunixon osa-ctrl-2_swift_proxy_container-df5d1a8a18:57
*** vakuznet has quit IRC18:57
gunixonT ASK [os_swift : Get swift rings]18:58
gunixon TASK [os_swift : Get swift rings]18:58
cloudnullgunix: you appear to be online :)18:59
xgerman_cloudnull: The jobs merged - https://review.openstack.org/#/c/491109/ —- maybe they got lost in the zuul shuffle or I made another mistake18:59
cloudnullxgerman_: likely needs to be adjusted for zuulv319:00
xgerman_yep, I was hoping it would migrate by itself…19:01
cloudnullgunix:  can you rerun os-swift-install.yml in debug?19:01
cloudnulldo you have ssh access to the swift node?19:01
cloudnulland what's the task name where it's failing ?19:02
gunixi wrote the task above19:02
openstackgerritMarc Gariépy (mgariepy) proposed openstack/openstack-ansible-rsyslog_client stable/ocata: Fix mutiple restart of rsyslog daemon  https://review.openstack.org/51479619:02
openstackgerritMarc Gariépy (mgariepy) proposed openstack/openstack-ansible-rsyslog_client stable/newton: Fix mutiple restart of rsyslog daemon  https://review.openstack.org/51479719:02
gunixhow do i run in debugg?19:03
cloudnullso this is where its falling apart19:03
cloudnullrunning in debug use -vvvv19:04
cloudnullso that task runs as the swift user19:05
cloudnullwhich should have setup its own keys19:05
cloudnullon your swift hosts.19:05
gunixi can set the keys up19:05
gunixfor which user do i have to do that?19:05
admin0cloudnull: https://gist.github.com/a1git/02a9789b6aa7c917927a1c8cd2d00093  — the rc19:06
cloudnullgunix: the os_swift role will add the "swift" user to the hosts and containers running swift.19:07
cloudnulland that should do all of the key setup19:07
gunixbtw, i did grep -r "Get swift rings" in /opt/ but i didn't find anything. where are these tasks located?19:08
cloudnulladmin0: can you try setting http://paste.openstack.org/show/624513/ to see if it works19:09
gunixhere is the bpaste with -vvvv: https://bpaste.net/show/89f821b1220819:09
cloudnullgunix: /etc/ansible/roles19:10
gunixoh, it's there19:10
gunixthank you19:10
cloudnullgunix: could you add ssh keys to the swift users and rerun? or try removing the swift users from the containers/hosts and rerun?19:11
gunixyea i will but right now i want to check logs to see if "/etc/ansible/roles/os_swift/tasks/swift_key_distribute.yml" did it's job19:12
cloudnullthose keys should be there, https://github.com/openstack/openstack-ansible-os_swift/blob/08787f9c85c08322c17f97842f13669833a9d3b7/tasks/swift_pre_install.yml#L32-L4119:12
cloudnullbut maybe something went crazy19:12
gunixcloudnull: i would check the keys in /home/swift/.ssh/id_rsa.pub on the swift_proxy containers ... or not?19:12
cloudnullyes, and then make sure the authorized_key file has the required pub keys19:13
*** poopcat has joined #openstack-ansible19:14
gunixu=root ... ssh swift@IP19:16
gunixi think it's the root key19:16
cloudnullthat task should be changing to the swift user when its run19:17
gunixalso, found this in logs: https://bpaste.net/show/85cbacf5118119:17
cloudnullinteresting that it skipped on osa-swift-19:18
cloudnullmaybe just remove the swift user and let the playbook re-create it ?19:19
gunixbest way to fix would be to copy the keys but i am still curious WHY it failed19:20
gunixany ideea how to check thy it skipped?19:20
gunixit's not even ok check, it's skip19:20
cloudnullin debug it may shed some light into what constraint was skipped19:20
cloudnullyou can force key rotation by running the playbook w/ -e swift_recreate_keys=true19:21
cloudnull`openstack-ansible os-swift-install.yml -e swift_recreate_keys=true`19:21
cloudnulllooks like that task skips when no key is defined in the running facts19:22
*** TxGirlGeek has joined #openstack-ansible19:23
*** DanyC_ has joined #openstack-ansible19:25
*** RandomTech has quit IRC19:25
*** DanyC has quit IRC19:28
*** TxGirlGeek has quit IRC19:30
*** TxGirlGeek has joined #openstack-ansible19:30
*** pbandark has quit IRC19:30
*** TxGirlGeek has quit IRC19:33
*** TxGirlGeek has joined #openstack-ansible19:34
gunixyea i could have read that cause i looked at that script 10 mins ago but it seems i was to ignorant19:34
gunixi hate my self when something is obvious and in my face and i miss it19:35
*** RandomTech has joined #openstack-ansible19:35
gunixso just "lxc-attach -n swift_proxy" and "su - swift"  and "ssh-keygen" should do the job i think19:36
RandomTechis there a way to tell template to put its backup in a specific location?19:36
*** TxGirlGeek has quit IRC19:38
*** DanyC_ has quit IRC19:42
*** DanyC has joined #openstack-ansible19:43
gunixcloudnull: https://bpaste.net/show/42b9f52d67a819:44
*** phalmos has joined #openstack-ansible19:45
gunixi think i found the issue. it's doing src from the ansible machine (if i got this right) and the keys SHOULD be in /var/lib/swift/.ssh/id_rsa.pub but for some reason they are not19:47
*** DanyC has quit IRC19:47
*** rodolof has joined #openstack-ansible19:48
openstackgerritMajor Hayden proposed openstack/ansible-hardening master: Docs/Reno fixes  https://review.openstack.org/51479019:51
*** TxGirlGeek has joined #openstack-ansible19:51
*** TxGirlGeek has quit IRC19:56
*** smatzek has joined #openstack-ansible19:56
*** TxGirlGeek has joined #openstack-ansible19:57
openstackgerritMajor Hayden proposed openstack/ansible-hardening master: Add scaffolding for contrib tasks  https://review.openstack.org/51438519:58
*** smatzek has quit IRC20:00
cloudnullgunix: hum...20:02
*** Smeared_Beard has joined #openstack-ansible20:03
*** SmearedBeard has quit IRC20:03
gunixcloudnull: also found this: https://bpaste.net/show/6f3dc7b9807f20:03
gunixbut i don't understand exactly what it should do. i am a little confused. sorry. i am still a noob at osa :D20:04
*** TxGirlGeek has quit IRC20:04
cloudnullit should be pulling the file and storing the contents as a task20:04
cloudnull**as a hostvar20:04
cloudnullthat hostvar is then referenced later when it distributes the authorized_keys  file on the storage nodes.20:05
cloudnullwhich should all be happening as the "swift" user.20:05
*** vnogin has joined #openstack-ansible20:06
gunixwhat is a hostvar?20:07
gunixnvm, found in ansible docu, it's an array20:07
*** rcarrillocruz has quit IRC20:08
*** rcarrill1 has joined #openstack-ansible20:09
gunixcloudnull: ok so checkt this out ... i sshed into the swift_proxy contaner and it has the pub key at the right location: https://bpaste.net/show/cab9f029ce1d20:12
cloudnullthat swift user and key should be on all of your hosts that will be used for swift purposes.20:13
cloudnullansible -m shell -a 'ls /var/lib/swift/.ssh; id swift' swift_all20:13
gunixcloudnull: should i run that from a specific folder?20:14
Smeared_BeardHey, I'm a bit confused on how to setup my openstack_user_config.yaml in regards to the networking.. I have br-mgmt and br-vlan on 2 subinterfaces on eth, and br-vxlan, and br-storage on subinterfaces on eth1 but not 100% clear how to set this in the config file.. reading https://docs.openstack.org/project-deploy-guide/openstack-ansible/draft/app-networking.html#openstack-user-config-reference and potentially just need to20:14
cloudnullit should work from anywhere, but /opt/openstack_ansible/playbooks is fairly normal20:14
Smeared_Beard host_bind_override and to eth0:0, eth0:1 etc?20:14
*** captaindave has quit IRC20:15
gunixcloudnull: https://bpaste.net/show/58c395d14ab320:15
cloudnullSmeared_Beard: setting the default interface using the sub string should be fine in the openstack_user_config.yml20:15
cloudnullgunix: looks like osa-swift-1 | SUCCESS | rc=0 >> is missing the authorized_keys file .20:16
cloudnullbut that's quite odd.20:16
cloudnullandymccr: you around ?20:16
gunixcloudnull: i will manually create the authorized keys and populate it with the id_rsa.pub20:16
cloudnullyou can manually resolve that by putting the file on to your swfit hosts. but that should be automaticallyy created.20:17
gunixyea, i will manually fix it. but i wanted to troubleshoot because i feel like trying to help cause osa is so cool20:17
gunixi hope i did help.20:17
cloudnullwith ansible you can pull/push the file.20:17
cloudnullansible -m fetch -a 'src=/var/lib/swift/.ssh/authorized_keys dest=/tmp/authorized_keys' osa-ctrl-2_swift_proxy_container-df5d1a8a20:18
cloudnullthen copy it out20:18
cloudnullansible -m fetch -a 'src=/tmp/authorized_keys dest=/var/lib/swift/.ssh/authorized_keys' osa-swift-120:19
cloudnull** ansible -m copy -a 'src=/tmp/authorized_keys dest=/var/lib/swift/.ssh/authorized_keys' osa-swift-120:19
cloudnull I use ansible a lot of adhoc commands, I teat it a lot like a better dsh command20:20
gunixkeys are different20:20
*** TxGirlGeek has joined #openstack-ansible20:20
cloudnullthe auth keys file should contain all of the keys from all of the other nodes.20:21
cloudnullits like a mesh20:21
gunixcloudnull: ansible -m shell -a 'cat /var/lib/swift/.ssh/id_rsa.pub' swift_all | grep -v SUCCESS | ssh osa-swift-1 tee -a /var/lib/swift/.ssh/authorized_keys20:21
gunixoneliner ftw :)20:21
gunixcloudnull: now i rerun the playbook and hope that it won't be kind enough to deleted authorized keys as it might have conflict with some imaginary friend20:23
* cloudnull fingers crossed.20:24
Smeared_Beardcloudnull it's probably because it's late but do you mean? the net_name?20:26
gunixcloudnull: play recap: 0 (zero) fails.20:27
gunixi am commenting out everything before os-swift-install.yml and also os-swift-install.yml and reruning setup-openstack.yml20:28
*** TxGirlGeek has quit IRC20:29
gunixi dont know how to thank you, but here is a picture with a bike, from facebook, since you like bikes: https://scontent-amt2-1.xx.fbcdn.net/v/t1.0-9/21314826_1384491658337657_7569765326567345284_n.jpg?oh=3213ea641331c553b40f4bb30b961704&oe=5A61580420:30
*** TxGirlGeek has joined #openstack-ansible20:32
gunixi think my deployment is complete. nothing failed any more20:32
gunixhmm i have no images. i thought by default OSA gets cirros20:40
openstackgerritMajor Hayden proposed openstack/ansible-hardening master: Docs/Reno fixes  https://review.openstack.org/51479020:42
*** DanyC has joined #openstack-ansible20:45
*** TxGirlGeek has quit IRC20:47
*** TxGirlGeek has joined #openstack-ansible20:47
cloudnullno, no images or networks by default20:48
cloudnullbut we have a thing that can give you some test networks20:48
cloudnullyou could also run the tempest playbook which gives you some basic flavors, images, networks20:49
cloudnullgunix: https://github.com/openstack/openstack-ansible-ops/blob/master/multi-node-aio/playbooks/openstack-service-setup.yml20:49
gunixcloudnull: thank you a lot. i will check this stuff out tomorrow. it's almost midnight here20:51
mhaydenlooks like we have a GPG key issue on CentOS7 in the pike branch20:51
*** smatzek has joined #openstack-ansible20:53
gunixmhayden: i deployed osa aio today with centos7 and had no issue. well, it took about 8 hours.20:53
gunixyum installs are crashing from time to time but they work when reruning playbook20:54
openstackLaunchpad bug 1727066 in openstack-ansible "Pike CentOS 7 gates failing with GPG key error" [High,Confirmed] - Assigned to Major Hayden (rackerhacker)20:56
*** phalmos has quit IRC20:56
gunixhmm, this is upstream, not 16.0.121:00
openstackgerritMajor Hayden proposed openstack/openstack-ansible-tests master: Hide yum-config-manager output  https://review.openstack.org/51483521:01
openstackgerritMajor Hayden proposed openstack/openstack-ansible-tests stable/pike: Hide yum-config-manager output  https://review.openstack.org/51483721:02
openstackgerritMajor Hayden proposed openstack/openstack-ansible-tests stable/ocata: Hide yum-config-manager output  https://review.openstack.org/51483821:05
*** thorst has quit IRC21:06
openstackgerritMajor Hayden proposed openstack/ansible-hardening master: Docs/Reno fixes  https://review.openstack.org/51479021:07
*** thorst has joined #openstack-ansible21:07
*** woodard has joined #openstack-ansible21:07
*** TxGirlGeek has quit IRC21:11
*** RandomTech has quit IRC21:11
*** TxGirlGeek has joined #openstack-ansible21:11
*** thorst has quit IRC21:12
openstackgerritMajor Hayden proposed openstack/openstack-ansible stable/pike: Bump role SHAs for CentOS repo fix  https://review.openstack.org/51484221:14
*** Miouge has quit IRC21:16
*** TxGirlGeek has quit IRC21:16
mhaydenif someone has a moment to look over some ansible-hardening patches, i'd be much obliged https://review.openstack.org/#/q/project:openstack/ansible-hardening+status:open21:16
*** esberglu has quit IRC21:18
*** esberglu has joined #openstack-ansible21:19
*** esberglu has quit IRC21:24
*** TxGirlGeek has joined #openstack-ansible21:24
*** smatzek has quit IRC21:25
snowman4839so I may have restarted my 3 infra servers at the same time and now my galera won't come up. Any ideas on how to restart the cluster without losing anything?21:26
*** dankolbrs has quit IRC21:28
*** rodolof has quit IRC21:31
*** thorst has joined #openstack-ansible21:32
*** dankolbrs has joined #openstack-ansible21:33
*** thorst has quit IRC21:36
*** TxGirlGeek has quit IRC21:37
*** thorst has joined #openstack-ansible21:38
*** esberglu has joined #openstack-ansible21:39
*** thorst has quit IRC21:43
*** TxGirlGeek has joined #openstack-ansible21:45
*** TxGirlGeek has quit IRC21:49
*** TxGirlGeek has joined #openstack-ansible21:49
*** vnogin has quit IRC21:51
*** TxGirlGeek has quit IRC21:53
*** TxGirlGeek has joined #openstack-ansible21:54
*** TxGirlGeek has quit IRC22:04
*** TxGirlGeek has joined #openstack-ansible22:05
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-lxc_hosts master: SUSE: Improve openSUSE repositories handling  https://review.openstack.org/51485022:09
*** galstrom is now known as galstrom_zzz22:12
prometheanfiremhayden: how often do you need to renew the ham tech license?22:15
openstackgerritGerman Eichberger proposed openstack/openstack-ansible-os_octavia master: [WIP] Improve event streaming with a better Octavia verison  https://review.openstack.org/51485222:31
*** TxGirlGeek has quit IRC22:32
*** TxGirlGeek has joined #openstack-ansible22:34
*** weezS has quit IRC22:35
*** mummer has quit IRC22:37
*** TxGirlGeek has quit IRC22:39
*** TxGirlGeek has joined #openstack-ansible22:42
*** thorst has joined #openstack-ansible22:43
*** DanyC has quit IRC22:48
*** thorst has quit IRC22:49
*** TxGirlGeek has quit IRC22:49
*** TxGirlGeek has joined #openstack-ansible22:51
gunixhmmm ... using this flag: nova_compute_driver: lxd.LXDDriver, the compute nodes will deploy with LXD instead of KVM ?22:55
gunixin fact, like this:  nova_virt_type: lxd23:00
*** TxGirlGe_ has joined #openstack-ansible23:00
*** TxGirlGeek has quit IRC23:01
*** chyka has quit IRC23:04
*** weezS has joined #openstack-ansible23:08
*** TxGirlGe_ has quit IRC23:11
*** weezS has quit IRC23:12
*** askb has quit IRC23:12
*** Smeared_Beard has quit IRC23:15
*** esberglu has quit IRC23:25
*** smatzek has joined #openstack-ansible23:26
*** chyka has joined #openstack-ansible23:27
*** smatzek has quit IRC23:30
*** TxGirlGeek has joined #openstack-ansible23:31
*** TxGirlGeek has quit IRC23:31
*** chyka has quit IRC23:32
*** smatzek has joined #openstack-ansible23:41
*** smatzek has quit IRC23:49
cloudnullgunix: yup if you want an lxc hypervisor type23:56
cloudnullyou can mix and match hypervisors if you want. kvm(powervm, x86), lxd, qemu, etc.23:58
cloudnullthe only restriction is that you can only have 1 hypervisor type per compute host.23:59
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_freezer master: Updated from global requirements  https://review.openstack.org/51425823:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!