| *** jrobinson_ has joined #openstack-ansible | 00:05 | |
| *** jrobinson_ is now known as jrobinson | 00:05 | |
| *** whiteveil has joined #openstack-ansible | 00:07 | |
| *** hybridpollo has quit IRC | 00:09 | |
| *** jmckind has quit IRC | 00:13 | |
| *** hybridpollo has joined #openstack-ansible | 00:16 | |
| *** jamesdenton has joined #openstack-ansible | 00:21 | |
| *** BjoernT has quit IRC | 00:25 | |
| *** acormier has quit IRC | 00:26 | |
| *** schwicht has joined #openstack-ansible | 00:27 | |
| *** acormier has joined #openstack-ansible | 00:28 | |
| *** acormier has quit IRC | 00:29 | |
| *** thorst has joined #openstack-ansible | 00:31 | |
| *** manheim has joined #openstack-ansible | 00:34 | |
| *** thorst has quit IRC | 00:36 | |
| *** sdake has quit IRC | 00:36 | |
| *** thorst has joined #openstack-ansible | 00:41 | |
| *** sdake has joined #openstack-ansible | 00:42 | |
| *** May-meimei has quit IRC | 00:46 | |
| *** mpjetta has quit IRC | 00:52 | |
| *** cuongnv has joined #openstack-ansible | 00:56 | |
| *** jmckind has joined #openstack-ansible | 00:56 | |
| *** cuongnv has quit IRC | 00:56 | |
| *** cuongnv has joined #openstack-ansible | 00:57 | |
| *** thorst has quit IRC | 01:01 | |
| *** crushil has joined #openstack-ansible | 01:03 | |
| *** cjloader has joined #openstack-ansible | 01:04 | |
| cloudnull | stevelle: ping | 01:06 |
|---|---|---|
| stevelle | cloudnull: pong | 01:06 |
| *** acormier has joined #openstack-ansible | 01:07 | |
| *** ngupta has quit IRC | 01:07 | |
| *** cloudtrainme has joined #openstack-ansible | 01:10 | |
| *** jmckind is now known as jmckind_ | 01:13 | |
| *** cjloader has quit IRC | 01:14 | |
| *** jmckind_ is now known as jmckind | 01:14 | |
| *** jamielennox is now known as jamielennox|away | 01:16 | |
| *** whiteveil has quit IRC | 01:23 | |
| *** May-meimei has joined #openstack-ansible | 01:23 | |
| *** dimtheo_ has quit IRC | 01:24 | |
| *** karimb has quit IRC | 01:30 | |
| *** jmckind is now known as jmckind_ | 01:32 | |
| *** jmckind_ is now known as jmckind | 01:34 | |
| *** jmckind is now known as jmckind_ | 01:34 | |
| *** jmckind_ is now known as jmckind | 01:34 | |
| *** whiteveil has joined #openstack-ansible | 01:35 | |
| *** sanfern has quit IRC | 01:36 | |
| *** cjloader has joined #openstack-ansible | 01:44 | |
| *** joelgriffiths has quit IRC | 01:44 | |
| *** adrian_otto has quit IRC | 01:44 | |
| *** cjloader has quit IRC | 01:45 | |
| *** jrobinson is now known as jrobinson-afk | 01:48 | |
| *** acormier has quit IRC | 01:57 | |
| *** cjloader has joined #openstack-ansible | 02:00 | |
| *** jmckind has quit IRC | 02:00 | |
| *** manheim has quit IRC | 02:00 | |
| *** jrobinson-afk is now known as jrobinson | 02:02 | |
| *** chhavi has joined #openstack-ansible | 02:03 | |
| *** manheim has joined #openstack-ansible | 02:06 | |
| *** Mahe has quit IRC | 02:07 | |
| *** chhavi has quit IRC | 02:07 | |
| *** cjloader has quit IRC | 02:08 | |
| *** jamesden_ has joined #openstack-ansible | 02:09 | |
| *** smatzek_ has joined #openstack-ansible | 02:09 | |
| *** whiteveil has quit IRC | 02:09 | |
| *** Mahe has joined #openstack-ansible | 02:09 | |
| *** smatzek_ has quit IRC | 02:09 | |
| *** smatzek_ has joined #openstack-ansible | 02:10 | |
| *** hybridpollo has quit IRC | 02:10 | |
| *** sdake_ has joined #openstack-ansible | 02:10 | |
| *** sdake has quit IRC | 02:13 | |
| *** jamesden_ has quit IRC | 02:15 | |
| *** mmalik4_ has quit IRC | 02:15 | |
| *** ngupta has joined #openstack-ansible | 02:16 | |
| *** jamesden_ has joined #openstack-ansible | 02:19 | |
| *** MasterOfBugs has quit IRC | 02:20 | |
| *** cjloader has joined #openstack-ansible | 02:22 | |
| *** smatzek_ has quit IRC | 02:22 | |
| *** cjloader has quit IRC | 02:23 | |
| *** cjloader has joined #openstack-ansible | 02:24 | |
| *** agrebennikov_ has quit IRC | 02:24 | |
| *** schwicht has quit IRC | 02:26 | |
| *** hybridpollo has joined #openstack-ansible | 02:26 | |
| *** manheim has quit IRC | 02:27 | |
| *** sdake_ is now known as sdake | 02:28 | |
| *** woodard has joined #openstack-ansible | 02:28 | |
| *** cjloader has quit IRC | 02:29 | |
| *** woodard has quit IRC | 02:32 | |
| *** ngupta has quit IRC | 02:33 | |
| *** ngupta has joined #openstack-ansible | 02:33 | |
| *** ngupta has quit IRC | 02:38 | |
| *** esberglu has joined #openstack-ansible | 02:43 | |
| *** esberglu has quit IRC | 02:48 | |
| *** hybridpollo has quit IRC | 02:49 | |
| *** hybridpollo has joined #openstack-ansible | 02:50 | |
| jamesdenton | hey cloudnull - quick question | 02:50 |
| *** sanfern has joined #openstack-ansible | 02:50 | |
| cloudnull | o/ | 02:52 |
| cloudnull | what's up ? | 02:52 |
| *** gouthamr has quit IRC | 02:53 | |
| *** pjh03 has joined #openstack-ansible | 02:53 | |
| *** cloudtrainme has quit IRC | 02:53 | |
| jamesdenton | well - let me verify again before i ask :P | 02:54 |
| dmsimard | cloudnull: UI rework is merging \o/ | 02:55 |
| dmsimard | I'm cutting a release candidate tonight and I'll test it in your gate | 02:55 |
| cloudnull | woot! | 02:55 |
| cloudnull | that's awesome | 02:55 |
| dmsimard | it's much much more performant since you last looked at it :) | 02:56 |
| *** pjh03 has quit IRC | 02:57 | |
| jamesdenton | cloudnull Does the keystone service user have an rsa key generated at some point? | 02:59 |
| cloudnull | dmsimard: nice! | 03:00 |
| cloudnull | i look forward to using it soon :) | 03:00 |
| jamesdenton | keystone system user, rather. In the keystone container(s) | 03:00 |
| cloudnull | jamesdenton: there's an ssh key that's created for the keystone user | 03:00 |
| cloudnull | which is used to sync the fernet tokens | 03:00 |
| jamesdenton | right. that task is failing for me, and I was digging around looking for that key | 03:01 |
| cloudnull | that key should be in the /var/lib/keystone dir | 03:01 |
| cloudnull | well.. /var/lib/keystone/,ssh | 03:01 |
| cloudnull | .ssh | 03:01 |
| cloudnull | damn cant type | 03:01 |
| *** rpittau_ has joined #openstack-ansible | 03:02 | |
| jamesdenton | thx. | 03:02 |
| *** jamesden_ has quit IRC | 03:03 | |
| cloudnull | ok, gotta run. bbs | 03:03 |
| jamesdenton | thanks again | 03:04 |
| *** rpittau has quit IRC | 03:04 | |
| openstackgerrit | David Moreau Simard proposed openstack/openstack-ansible-tests master: Do not merge: Test ARA 0.12.0rc1 https://review.openstack.org/439962 | 03:04 |
| *** hybridpolio has joined #openstack-ansible | 03:04 | |
| logan- | jamesdenton are you having ssh key problems with keystone? | 03:06 |
| jamesdenton | logan- yes. | 03:06 |
| logan- | multi-node on master? | 03:06 |
| jamesdenton | multi-node on master | 03:06 |
| logan- | run with keystone_serial=100% in your vars or apply https://review.openstack.org/#/c/438219/ | 03:07 |
| *** hybridpollo has quit IRC | 03:08 | |
| jamesdenton | awesome logan-, thank you | 03:09 |
| logan- | no prob :) | 03:10 |
| jamesdenton | glad to see i wasn't doing something dumb this time :P | 03:10 |
| jamesdenton | is master still Ocata? | 03:12 |
| logan- | no, the stable/ocata branch was cut a week or two back. master is now pike work | 03:12 |
| openstackgerrit | David Moreau Simard proposed openstack/openstack-ansible master: Implement ARA logging and reporting for openstack-ansible gate jobs https://review.openstack.org/396324 | 03:13 |
| openstackgerrit | David Moreau Simard proposed openstack/openstack-ansible master: Implement ARA logging and reporting for openstack-ansible gate jobs https://review.openstack.org/396324 | 03:13 |
| jamesdenton | gotcha. I found last week that stable/ocata seemed to be missing some of the sr-iov bits. will have to look again | 03:14 |
| *** ngupta has joined #openstack-ansible | 03:15 | |
| logan- | ahh yeah I think some of that just merged in the last few days. it might not be picked to the ocata branch yet. if you see something missing please push backports to ocata so we can get it completely implemented there | 03:16 |
| jamesdenton | will do | 03:16 |
| *** hybridpollo has joined #openstack-ansible | 03:25 | |
| dmsimard | logan-: o/ new ara version live in the gate: http://logs.openstack.org/62/439962/1/check/gate-openstack-ansible-tests-ansible-func-centos-7/f9fc8c2/logs/ara/reports/index.html | 03:39 |
| dmsimard | took me a couple keystrokes and clicks to see that tempest failed on missing run_tempests.sh :D | 03:40 |
| dmsimard | tasks -> search box: failed and click on the failed label | 03:40 |
| logan- | that's awesome | 03:41 |
| logan- | beats scrolling thru the gate logs :P | 03:42 |
| dmsimard | beats scrolling through 10MB+ of gate logs* | 03:42 |
| logan- | i was excited to see you mention the new version is much more efficient yesterday... hopefully that means we might be able to get it running in the integrated gate :) | 03:42 |
| *** mmalik4 has joined #openstack-ansible | 03:43 | |
| dmsimard | logan-: yup, that review has it for integrated gate I believe: https://review.openstack.org/#/c/396324/ | 03:43 |
| *** hybridpolio has quit IRC | 03:44 | |
| dmsimard | it's rc1 but if everything goes well and nothing looks broken I'll cut the release tomorrow -- currently testing it in a couple places first https://review.openstack.org/#/q/topic:ara-0.12 | 03:44 |
| logan- | oool | 03:44 |
| logan- | cool* | 03:44 |
| dmsimard | so far so good | 03:44 |
| dmsimard | I gotta poke infra so that they look at my .svg image rendering issue fix on logs.o.o :( | 03:45 |
| *** thorst has joined #openstack-ansible | 03:50 | |
| *** thorst has quit IRC | 03:50 | |
| sdake | hey folks if your interested in cross project collaboration with other projects please join #openstack-deployment | 03:57 |
| *** mmalik4 has quit IRC | 04:01 | |
| *** shausy has joined #openstack-ansible | 04:02 | |
| *** udesale has joined #openstack-ansible | 04:07 | |
| *** whiteveil has joined #openstack-ansible | 04:10 | |
| *** whiteveil has quit IRC | 04:12 | |
| *** poopcat has quit IRC | 04:21 | |
| *** thorst has joined #openstack-ansible | 04:32 | |
| *** thorst has quit IRC | 04:32 | |
| *** esberglu has joined #openstack-ansible | 04:32 | |
| *** Jeffrey4l has joined #openstack-ansible | 04:32 | |
| *** jrobinson is now known as jrobinson-afk | 04:35 | |
| *** esberglu has quit IRC | 04:36 | |
| *** poopcat has joined #openstack-ansible | 04:38 | |
| *** adrian_otto has joined #openstack-ansible | 04:38 | |
| *** acormier has joined #openstack-ansible | 04:39 | |
| *** hybridpollo has quit IRC | 04:43 | |
| *** hybridpollo has joined #openstack-ansible | 04:52 | |
| *** hybridpollo has quit IRC | 04:53 | |
| *** adrian_otto has quit IRC | 04:54 | |
| *** h5t4 has joined #openstack-ansible | 04:57 | |
| *** crushil has quit IRC | 04:57 | |
| *** poopcat has quit IRC | 04:58 | |
| *** thorst has joined #openstack-ansible | 05:03 | |
| *** sunjon_ has quit IRC | 05:07 | |
| *** sdake has quit IRC | 05:08 | |
| *** chhavi has joined #openstack-ansible | 05:14 | |
| *** thorst has quit IRC | 05:16 | |
| *** acormier has quit IRC | 05:28 | |
| *** yolanda has quit IRC | 05:35 | |
| *** Jack_Iv has joined #openstack-ansible | 05:46 | |
| openstackgerrit | Darren Chan proposed openstack/openstack-ansible master: [docs] Add content to the troubleshooting chapter https://review.openstack.org/440144 | 05:46 |
| *** h5t4 has quit IRC | 05:54 | |
| *** jrobinson-afk is now known as jrobinson | 05:56 | |
| *** arturb has quit IRC | 06:03 | |
| *** ngupta has quit IRC | 06:18 | |
| *** esberglu has joined #openstack-ansible | 06:21 | |
| *** esberglu has quit IRC | 06:26 | |
| *** lwiecek has joined #openstack-ansible | 06:29 | |
| *** Jack_Iv has quit IRC | 06:41 | |
| *** Amit82 has joined #openstack-ansible | 06:41 | |
| *** Jack_Iv has joined #openstack-ansible | 06:42 | |
| Amit82 | Hi All | 06:44 |
| Amit82 | I have deployed Openstack using Openstack Ansible. I am using Newton release from tag 14.0.8. My test environment is containing only Compute Node and Controller Node (Infra Node). | 06:44 |
| Amit82 | When using python sdk, I am getting following error while making connection to externalviblp_address (192.168.255.45) binded to port 5000 | 06:45 |
| Amit82 | openstack.exceptions.SDKException: Connection failure that may be retried. | 06:45 |
| Amit82 | Any clue about this issue? More detailed traces are at: | 06:45 |
| Amit82 | http://paste.openstack.org/show/601053/ | 06:45 |
| *** Jack_Iv_ has joined #openstack-ansible | 06:46 | |
| *** Jack_Iv has quit IRC | 06:47 | |
| *** h5t4_ has joined #openstack-ansible | 06:51 | |
| *** vnogin has joined #openstack-ansible | 06:54 | |
| *** McMurlock1 has joined #openstack-ansible | 07:03 | |
| *** vnogin has quit IRC | 07:08 | |
| *** hwoarang has quit IRC | 07:28 | |
| *** hwoarang has joined #openstack-ansible | 07:29 | |
| *** Jack_Iv_ has quit IRC | 07:33 | |
| *** Jack_Iv has joined #openstack-ansible | 07:34 | |
| *** Jack_Iv has quit IRC | 07:35 | |
| *** Jack_Iv has joined #openstack-ansible | 07:35 | |
| *** jrobinson has quit IRC | 07:46 | |
| *** Jack_Iv has quit IRC | 08:00 | |
| *** Jack_Iv has joined #openstack-ansible | 08:01 | |
| *** Jack_Iv has quit IRC | 08:06 | |
| *** esberglu has joined #openstack-ansible | 08:10 | |
| *** winggundamth has joined #openstack-ansible | 08:10 | |
| openstackgerrit | Ravi Gummadi proposed openstack/openstack-ansible-galera_server stable/ocata: Cap the number of worker threads https://review.openstack.org/440190 | 08:13 |
| *** pcaruana has joined #openstack-ansible | 08:13 | |
| *** esberglu has quit IRC | 08:15 | |
| *** retreved has quit IRC | 08:15 | |
| *** retreved has joined #openstack-ansible | 08:16 | |
| lwiecek | Hello everyone | 08:29 |
| lwiecek | i have a question. I want to install ONLY keystone with the ansible role.. No rabbitmq, nothing, just pure keystone without containers on target node. How am I supposed to configure the openstack-ansible role to only install keystone? I know that i have to change property is_metal to true, to avoid containers, what else? how to disable rabbitmq and such stuff? | 08:30 |
| *** Jack_Iv has joined #openstack-ansible | 08:31 | |
| *** DFFlanders has joined #openstack-ansible | 08:40 | |
| *** sunjon_ has joined #openstack-ansible | 08:45 | |
| *** sdake has joined #openstack-ansible | 08:51 | |
| *** sdake_ has joined #openstack-ansible | 08:51 | |
| *** sdake has quit IRC | 08:55 | |
| *** fandi has joined #openstack-ansible | 09:04 | |
| *** fandi has quit IRC | 09:09 | |
| rabel_b1 | jeffrey4l : would you mind to open https://bugs.launchpad.net/kolla-ansible/+bug/1669075 again? At least until someone gives a comment in the bug why this is not a bug. Because in my opinion it is, as I said there. | 09:11 |
| openstack | Launchpad bug 1669075 in kolla-ansible "kolla-ansible pull with kolla_ansible-4.0.0.0rc1 fails, because of missing tag in docker registry" [Undecided,Invalid] | 09:11 |
| *** thorst has joined #openstack-ansible | 09:13 | |
| rabel_b1 | sry, wrong channel | 09:14 |
| *** thorst has quit IRC | 09:18 | |
| *** DanyC has joined #openstack-ansible | 09:18 | |
| *** arturb has joined #openstack-ansible | 09:23 | |
| *** Jeffrey4l has quit IRC | 09:25 | |
| *** Jeffrey4l has joined #openstack-ansible | 09:25 | |
| *** udesale__ has joined #openstack-ansible | 09:26 | |
| *** udesale has quit IRC | 09:28 | |
| *** Oku_OS-away is now known as Oku_OS | 09:30 | |
| *** Jeffrey4l has quit IRC | 09:31 | |
| openstackgerrit | Ravi Gummadi proposed openstack/openstack-ansible-galera_server stable/ocata: Cap the number of worker threads https://review.openstack.org/440190 | 09:34 |
| *** electrofelix has joined #openstack-ansible | 09:37 | |
| *** chhavi has quit IRC | 09:38 | |
| *** chhavi has joined #openstack-ansible | 09:38 | |
| *** DimGR has joined #openstack-ansible | 09:39 | |
| *** sdake_ is now known as sdake | 09:41 | |
| *** Jeffrey4l has joined #openstack-ansible | 09:43 | |
| *** IRC-Source_71442 has joined #openstack-ansible | 09:43 | |
| *** sprvn has joined #openstack-ansible | 09:47 | |
| *** udesale__ has quit IRC | 09:47 | |
| *** udesale has joined #openstack-ansible | 09:48 | |
| *** IRC-Source_71442 is now known as Chekov | 09:50 | |
| Chekov | Hi all, I have a question about an openstack-ansible install. Specfically, the galera container install fails due to a SSL validation problem of the haproxy connection to the repo server. | 09:51 |
| Chekov | It crashed like this: | 09:51 |
| Chekov | https://thepasteb.in/p/qjhLZ7pzXljcB | 09:52 |
| odyssey4me | lwiecek if you just want keystone on a host, then just use the keystone role and your own playbook | 09:52 |
| odyssey4me | you'll need to work out the vars that need setting, but that's how you do it | 09:52 |
| odyssey4me | you're making your life complicated by trying other ways | 09:52 |
| odyssey4me | I referred you to the integrated build playbook as a reference, not to use for your use case | 09:53 |
| Chekov | However, if I try to access the file via curl or wget using https things work if I register the haproxy cert on the galera container | 09:53 |
| Chekov | what am I doing wrong? | 09:53 |
| *** manheim_ has joined #openstack-ansible | 09:56 | |
| evrardjp | had someone a look at nea1's issue? | 09:56 |
| DimGR | Hi I have a host which has a subnet/27 routed to it , so it can use a floating ip . My question is this : should this host go under network_hosts: or under compute_hosts in user_config.yml ? | 09:58 |
| *** manheim_ has quit IRC | 09:58 | |
| *** manheim_ has joined #openstack-ansible | 09:58 | |
| evrardjp | nea1: so, long story short, you have a clean ubuntu 16.04 from upstream, you are using default AIO, and you have issues with rabbitmq | 09:58 |
| *** esberglu has joined #openstack-ansible | 09:59 | |
| *** chhavi has quit IRC | 09:59 | |
| evrardjp | https://bugs.launchpad.net/openstack-ansible/+bug/1669125 | 09:59 |
| openstack | Launchpad bug 1669125 in openstack-ansible "rabbitmq-server fails so start with ubuntu16.04" [Undecided,New] | 09:59 |
| *** cuongnv has quit IRC | 10:03 | |
| *** esberglu has quit IRC | 10:03 | |
| evrardjp | I think I may have found the problem | 10:05 |
| openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-os_nova master: Change /etc/default/libvirt-bin to libvirtd https://review.openstack.org/440284 | 10:06 |
| DimGR | anyone ? | 10:07 |
| nea1 | evrardjp: no AIO | 10:09 |
| odyssey4me | andymccr any idea why the upgrade test in https://review.openstack.org/#/c/438002/ is failing? | 10:09 |
| andymccr | odyssey4me: yeah - basically the libvirt changes are blocking it | 10:09 |
| odyssey4me | ah, this one? https://review.openstack.org/439760 | 10:10 |
| andymccr | https://review.openstack.org/#/c/440284/ and this | 10:10 |
| andymccr | then it should work - although an AIO upgrade wont work due to some funky nova-ness | 10:10 |
| andymccr | which im working on today | 10:10 |
| *** sdake has quit IRC | 10:18 | |
| *** hachi has quit IRC | 10:19 | |
| *** adogrant has joined #openstack-ansible | 10:22 | |
| *** sdake has joined #openstack-ansible | 10:22 | |
| *** admin0 has joined #openstack-ansible | 10:24 | |
| admin0 | \o/ — i am in reading :D | 10:24 |
| admin0 | netherlands => germany => netherlands => belgium => france => uk — 5 countries in 10 hours :) | 10:25 |
| adogrant | Hi all, We have a OSA Mitaka install and all of a sudden we are no longer to launch instances. I have narrowed it down to glance being the issue and I am seeing some oddness in the logs. Has anyone come across this before?: | 10:25 |
| adogrant | 2017-03-02 10:17:56.701 2110 ERROR glance.registry.client.v1.client | 10:25 |
| adogrant | 2017-03-02 10:17:56.702 2110 ERROR glance.common.wsgi [req-c490de71-e9db-4e3d-a1b1-53a4033c10f0 ad7e01d762024a3485263e0abafa98bc 8ff3028a3b4048cfbc226f28fb1385ca - - -] Caught error: The request returned a 302 Multiple Choices. This genera | 10:25 |
| adogrant | lly means that you have not included a version indicator in a request URI. | 10:25 |
| adogrant | didn't want to do a full stack trace in here | 10:25 |
| *** udesale__ has joined #openstack-ansible | 10:26 | |
| admin0 | The request returned a 302 Multiple Choices. — 2 images of the same name ? | 10:26 |
| adogrant | I thought that - but I have just done an image list and they all seem different: | 10:27 |
| *** udesale has quit IRC | 10:28 | |
| *** udesale__ has quit IRC | 10:30 | |
| *** chhavi has joined #openstack-ansible | 10:30 | |
| adogrant | whenever I try to create an instance via CLI the complaint is: Could not find resource: image-id | 10:30 |
| openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-os_nova stable/newton: Set libvirt default file to a variable https://review.openstack.org/440318 | 10:32 |
| *** askb has quit IRC | 10:33 | |
| *** doda has joined #openstack-ansible | 10:36 | |
| doda | hi folks | 10:36 |
| nea1 | evrardjp: "I think I may have found the problem"? | 10:37 |
| admin0 | adogrant: openstack server create --flavor m1.small --image "centos" --key-name mykey.pub --security-group default --nic net-id=UUID instance-name | 10:38 |
| admin0 | openstack image list will give you the names | 10:38 |
| admin0 | nto sure what you are seeing | 10:38 |
| *** admin0 has quit IRC | 10:41 | |
| *** sdake has quit IRC | 10:41 | |
| *** sanfern has quit IRC | 10:44 | |
| adogrant | I seem to have the right details - here is an image example: | 10:46 |
| *** admin0 has joined #openstack-ansible | 10:47 | |
| adogrant | | d5d43ba0-82e9-43de-8883-5ebaf07bf3e3 | Ubuntu-16.04 | active | | 10:47 |
| adogrant | my command: | 10:47 |
| adogrant | openstack server create --flavor g1.small --image "Ubuntu-16.04" --key-name ib-desktop --security-group default --nic net-id=e2d925f0-63c1-442f-9158-6a138e5847ce gmtest | 10:47 |
| adogrant | error is: Could not find resource Ubuntu-16.04 | 10:47 |
| *** admin0 has quit IRC | 10:47 | |
| *** manheim_ has quit IRC | 10:49 | |
| *** manheim_ has joined #openstack-ansible | 10:50 | |
| *** DFFlanders has quit IRC | 10:51 | |
| *** manheim_ has quit IRC | 10:51 | |
| *** manheim_ has joined #openstack-ansible | 10:51 | |
| *** sanfern has joined #openstack-ansible | 10:54 | |
| odyssey4me | mhayden I've added the monitoring library suggestion as a cross-project topic for deployment tooling here: https://etherpad.openstack.org/p/deployment-pike | 10:56 |
| doda | what is a replacement for scripts/run-playbooks.sh ? | 10:56 |
| doda | i'm trying to do an AIO install | 10:56 |
| odyssey4me | andymccr I've also added the bits that we discussed with the openstack-helm crew | 10:56 |
| odyssey4me | v1k0d3n ^ | 10:56 |
| odyssey4me | doda run-playbooks is still there | 10:57 |
| andymccr | odyssey4me: ahh sweet thanks odyssey4me | 10:57 |
| doda | yeah but it gives an info message and quits, The "scripts/run-playbooks.sh" script has exited. This script is no longer needed from now on. | 10:57 |
| odyssey4me | doda yes, once it's been run once, you should use the playbooks directly from then on | 10:58 |
| odyssey4me | in fact you don't need to use run-playbooks at all | 10:58 |
| doda | ah, yeah i see | 10:58 |
| doda | it printed a different error, i'll check that out | 10:58 |
| doda | early on, nothing was installed | 10:59 |
| DimGR | Can someone help debug this error please http://paste.openstack.org/show/601109/ | 10:59 |
| DimGR | Hmm it can not find ansible-playbook ? | 11:09 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_horizon stable/ocata: Use horizon_ssl_protocol variable https://review.openstack.org/439885 | 11:11 |
| *** sdake has joined #openstack-ansible | 11:12 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_horizon stable/newton: Use horizon_ssl_protocol variable https://review.openstack.org/439888 | 11:13 |
| *** Jack_Iv has quit IRC | 11:13 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_horizon stable/mitaka: Use horizon_ssl_protocol variable https://review.openstack.org/439889 | 11:13 |
| *** Jack_Iv has joined #openstack-ansible | 11:13 | |
| *** Amit82 has quit IRC | 11:14 | |
| *** thorst has joined #openstack-ansible | 11:14 | |
| *** sanfern has quit IRC | 11:15 | |
| *** sprvn has quit IRC | 11:17 | |
| *** Jack_Iv has quit IRC | 11:18 | |
| *** thorst has quit IRC | 11:19 | |
| *** dileepr has quit IRC | 11:19 | |
| pjm6 | good morning | 11:20 |
| *** Chekov has quit IRC | 11:20 | |
| pjm6 | anyone here could do authentication in rabbitmq web management console ? | 11:20 |
| pjm6 | with user monitoring and pass provided in user_secrets.yml ? | 11:20 |
| *** Chekov has joined #openstack-ansible | 11:21 | |
| evrardjp | nea1: sorry I was in a meeting | 11:23 |
| evrardjp | woops w/c | 11:24 |
| *** chhavi has quit IRC | 11:34 | |
| *** Andrew_jedi has joined #openstack-ansible | 11:34 | |
| *** manheim_ has quit IRC | 11:38 | |
| *** manheim_ has joined #openstack-ansible | 11:38 | |
| *** stuartgr has joined #openstack-ansible | 11:39 | |
| *** manheim_ has quit IRC | 11:43 | |
| *** chhavi has joined #openstack-ansible | 11:43 | |
| *** Chekov has quit IRC | 11:45 | |
| *** sdake has quit IRC | 11:49 | |
| *** sdake has joined #openstack-ansible | 11:50 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-galera_client master: Updated from global requirements https://review.openstack.org/440399 | 11:51 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-galera_server master: Updated from global requirements https://review.openstack.org/440400 | 11:51 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-haproxy_server master: Updated from global requirements https://review.openstack.org/440401 | 11:51 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-lxc_container_create master: Updated from global requirements https://review.openstack.org/440402 | 11:51 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-lxc_hosts master: Updated from global requirements https://review.openstack.org/440403 | 11:51 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-memcached_server master: Updated from global requirements https://review.openstack.org/440404 | 11:51 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-openstack_hosts master: Updated from global requirements https://review.openstack.org/440405 | 11:51 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-openstack_openrc master: Updated from global requirements https://review.openstack.org/440406 | 11:51 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-ops master: Updated from global requirements https://review.openstack.org/440407 | 11:51 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-os_aodh master: Updated from global requirements https://review.openstack.org/440408 | 11:51 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-os_barbican master: Updated from global requirements https://review.openstack.org/440409 | 11:51 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-os_ceilometer master: Updated from global requirements https://review.openstack.org/440410 | 11:51 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-os_cinder master: Updated from global requirements https://review.openstack.org/440411 | 11:51 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-os_cloudkitty master: Updated from global requirements https://review.openstack.org/440412 | 11:51 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-os_designate master: Updated from global requirements https://review.openstack.org/440413 | 11:51 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-os_glance master: Updated from global requirements https://review.openstack.org/440414 | 11:51 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-os_gnocchi master: Updated from global requirements https://review.openstack.org/440415 | 11:51 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-os_heat master: Updated from global requirements https://review.openstack.org/440416 | 11:51 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-os_horizon master: Updated from global requirements https://review.openstack.org/440417 | 11:51 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-os_ironic master: Updated from global requirements https://review.openstack.org/440418 | 11:51 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-os_keystone master: Updated from global requirements https://review.openstack.org/440419 | 11:51 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-os_magnum master: Updated from global requirements https://review.openstack.org/440420 | 11:51 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-os_monasca master: Updated from global requirements https://review.openstack.org/440421 | 11:51 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-os_neutron master: Updated from global requirements https://review.openstack.org/440422 | 11:51 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-os_nova master: Updated from global requirements https://review.openstack.org/440423 | 11:52 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-os_rally master: Updated from global requirements https://review.openstack.org/440424 | 11:52 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-os_sahara master: Updated from global requirements https://review.openstack.org/440425 | 11:52 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-os_swift master: Updated from global requirements https://review.openstack.org/440426 | 11:52 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-os_tempest master: Updated from global requirements https://review.openstack.org/440427 | 11:52 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-os_trove master: Updated from global requirements https://review.openstack.org/440428 | 11:52 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-os_watcher master: Updated from global requirements https://review.openstack.org/440429 | 11:52 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-os_zaqar master: Updated from global requirements https://review.openstack.org/440430 | 11:52 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-pip_install master: Updated from global requirements https://review.openstack.org/440431 | 11:52 |
| *** manheim_ has joined #openstack-ansible | 11:52 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-plugins master: Updated from global requirements https://review.openstack.org/440433 | 11:52 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-rabbitmq_server master: Updated from global requirements https://review.openstack.org/440434 | 11:52 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-repo_build master: Updated from global requirements https://review.openstack.org/440435 | 11:52 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-repo_server master: Updated from global requirements https://review.openstack.org/440436 | 11:52 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-rsyslog_client master: Updated from global requirements https://review.openstack.org/440437 | 11:52 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-rsyslog_server master: Updated from global requirements https://review.openstack.org/440438 | 11:52 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-security master: Updated from global requirements https://review.openstack.org/440440 | 11:52 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-specs master: Updated from global requirements https://review.openstack.org/440441 | 11:52 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-tests master: Updated from global requirements https://review.openstack.org/440442 | 11:52 |
| *** sdake_ has joined #openstack-ansible | 11:55 | |
| *** sdake has quit IRC | 11:56 | |
| evrardjp | not proposal bot | 11:57 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-rabbitmq_server master: Reload systemd-daemon in all cases https://review.openstack.org/440463 | 11:57 |
| nea1 | evrardjp: welcome back then ^^ | 12:04 |
| nea1 | so what was your idea? | 12:04 |
| *** T42X has joined #openstack-ansible | 12:05 | |
| evrardjp | the one just above | 12:06 |
| evrardjp | but that shouldn't be solving your issue | 12:06 |
| evrardjp | probably | 12:06 |
| *** winggundamth has quit IRC | 12:09 | |
| *** sdake_ is now known as sdake | 12:09 | |
| nea1 | evrardjp: nope, hasn't helped | 12:10 |
| evrardjp | ok | 12:11 |
| evrardjp | Man that's a crazy bug | 12:11 |
| evrardjp | so everything works, except rabbitmq | 12:11 |
| evrardjp | right? | 12:11 |
| evrardjp | rabbitmq doesn't start in your rabbitmq container | 12:12 |
| evrardjp | you double checked | 12:12 |
| nea1 | mysql server is running | 12:12 |
| evrardjp | and rabbitmqctl status | 12:12 |
| nea1 | on the new node | 12:12 |
| evrardjp | ok | 12:12 |
| nea1 | yep, same error | 12:12 |
| evrardjp | epmd doesn't run either | 12:12 |
| evrardjp | ? | 12:12 |
| nea1 | on the other setup openstack network list etc. works, but server list not for e.g. | 12:13 |
| evrardjp | wait | 12:13 |
| nea1 | 6005 /usr/lib/erlang/erts-7.3/bin/epmd -daemon | 12:13 |
| evrardjp | and beam? | 12:13 |
| nea1 | nope, the daemon is there | 12:13 |
| nea1 | the line above | 12:13 |
| nea1 | yep | 12:13 |
| evrardjp | ha, I thought you said it didn't work? | 12:13 |
| nea1 | it doesn't | 12:14 |
| evrardjp | so rabbitmqctl cluster_status works? | 12:14 |
| nea1 | the process is there but seams like nothing helse | 12:14 |
| nea1 | * unable to connect to epmd (port 4369) on hetzner1: address (cannot connect to host/port) | 12:14 |
| evrardjp | netstat -lntp | grep epmd ? | 12:14 |
| evrardjp | grep -e epmd -e beam just to be sure | 12:15 |
| nea1 | both there | 12:15 |
| nea1 | with multiple ports | 12:16 |
| evrardjp | where do you see this issue? | 12:16 |
| nea1 | unable to connect to epmd (port 4369) on hetzner1: address (cannot connect to host/port) | 12:16 |
| nea1 | as soon as i use rabbitmqctl [what-ever] | 12:17 |
| nea1 | the ports are there but it seams like they are not responding | 12:17 |
| Andrew_jedi | nea1: Hi, Is it possible that you could stop the haproxy and paste the output of "netstat -ntlp" ? | 12:19 |
| evrardjp | so when inside the container you see the port listed in netstat -ltnp but can't connect with rabbitmqctl cluster_status | 12:19 |
| evrardjp | Andrew_jedi: haproxy doesn't interface with rabbitmq IIRC | 12:19 |
| evrardjp | or maybe for its mgmt interface at best | 12:20 |
| *** smatzek_ has joined #openstack-ansible | 12:20 | |
| Andrew_jedi | evrardjp: server controller_rabbit_mq_container-ea29cbde 172.29.239.164:15672 check port 15672 inter 12000 rise 3 fall 3 | 12:21 |
| *** smatzek_ has quit IRC | 12:21 | |
| evrardjp | 15672 is the mgmt interface | 12:21 |
| *** smatzek_ has joined #openstack-ansible | 12:21 | |
| evrardjp | just a website to do commands on rabbitmq | 12:21 |
| evrardjp | :p | 12:21 |
| evrardjp | we used to not have that | 12:21 |
| *** ngupta has joined #openstack-ansible | 12:22 | |
| nea1 | http://termbin.com/5uzn | 12:23 |
| nea1 | evrardjp: yep, I can't connect | 12:24 |
| DimGR | How can I solve this error ? ERROR! Unexpected Exception: [Errno 12] Cannot allocate memory I think its specific to ansible | 12:25 |
| DimGR | And ram is still free | 12:26 |
| nea1 | output of the commands from rabbitmq container: http://termbin.com/qoks | 12:26 |
| evrardjp | DimGR: could you be more specific? | 12:26 |
| evrardjp | nea1: haha | 12:26 |
| evrardjp | rabbit@hetzner1: | 12:26 |
| Andrew_jedi | evrardjp: Ahhh, okay! | 12:27 |
| evrardjp | not 'rabbitmq-cli-22@hetzner1-rabbit-mq-container-d17233cb' | 12:27 |
| evrardjp | you are trying to connect on the host there | 12:27 |
| *** ngupta has quit IRC | 12:27 | |
| evrardjp | could you recheck your /etc/hosts? | 12:27 |
| DimGR | evrardjp this error pops up after a while of running the setup-hosts.yml | 12:28 |
| evrardjp | and your openstack_user_config or conf.d for rabbit ? | 12:28 |
| evrardjp | DimGR: Probably during your run, you'll hit an OOM with a container, then the container stops, and the ram is freed | 12:28 |
| evrardjp | so when you use free before and after, it seems ok | 12:29 |
| nea1 | o_O | 12:29 |
| *** sdake_ has joined #openstack-ansible | 12:29 | |
| DimGR | the target hosts have plenty of ram , should I increase the ram on my deployment host ? | 12:29 |
| evrardjp | nea1: your cluster seem to want to contact rabbit@hetzner1 which doesn't sound right | 12:29 |
| nea1 | hosts http://termbin.com/2m96 | 12:29 |
| nea1 | yep, now that you say it | 12:29 |
| nea1 | but from where does it get that hostname? | 12:30 |
| nea1 | it is not in the haproxy config so of cause it won't work | 12:30 |
| *** sdake has quit IRC | 12:30 | |
| nea1 | and as i understood from before it shouldn't be in the haproxy so the hostname which it is trying to use is wrong | 12:30 |
| evrardjp | nea1: openstack_user_config or conf.d ? | 12:31 |
| *** arbrandes1 has joined #openstack-ansible | 12:31 | |
| nea1 | evrardjp: http://paste.openstack.org/show/Rju8y8MR9JPuQTbZ7Uri/ | 12:31 |
| *** arbrandes has quit IRC | 12:33 | |
| nea1 | and in conf.d there are only .example and .aio files | 12:34 |
| odyssey4me | evrardjp this may have something to do with it? https://review.openstack.org/353649 | 12:34 |
| *** cloudtrainme has joined #openstack-ansible | 12:34 | |
| evrardjp | nea1: can you privately send me the openstack_inventory.json ? | 12:35 |
| nea1 | evrardjp: mail? - do you have a gpg key for that? | 12:36 |
| DimGR | S there something I can check evrardjp ? | 12:36 |
| *** arbrandes has joined #openstack-ansible | 12:36 | |
| Andrew_jedi | evrardjp: If there are old facts in /etc/openstack_deploy where the user mentioned incorrect ip for infrastructure services and later the user update the IP, then the facts may not be updated right ? | 12:38 |
| Andrew_jedi | DimGR: what does "lxc-top -s m " says ? | 12:38 |
| *** arbrandes1 has quit IRC | 12:39 | |
| openstackgerrit | Alexandra Settle proposed openstack/openstack-ansible master: [docs] Add content to the troubleshooting chapter https://review.openstack.org/440144 | 12:39 |
| odyssey4me | backport review for https://review.openstack.org/439244 please | 12:40 |
| DimGR | Andrew_jedi, this error popped up in the first steps of running the playbook , in fact in the setup-hosts.yml. | 12:40 |
| openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-os_nova stable/newton: Set libvirt default file to a variable https://review.openstack.org/440318 | 12:41 |
| Andrew_jedi | DimGR: btw how much RAM does your deploy host have ? | 12:43 |
| *** cloudtrainme has quit IRC | 12:45 | |
| *** thorst has joined #openstack-ansible | 12:45 | |
| DimGR | Andrew_jedi, it had 1 gb ram , I did not though I would need more ram for ansible , I raised the ram now to 3gb and I will try again | 12:47 |
| evrardjp | Andrew_jedi: good point | 12:49 |
| evrardjp | nea1: could you do rm -rf /etc/openstack_deploy/ansible_facts | 12:50 |
| evrardjp | lxc-stop -n <rabbit mq container name> | 12:50 |
| evrardjp | lxc-destroy -n <name> | 12:51 |
| evrardjp | openstack-ansible lxc-container-create.yml --limit <containername> | 12:51 |
| evrardjp | openstack-ansible rabbitmq-install.yml --limit <containername> | 12:52 |
| evrardjp | because nothing looks wrong in your current inventory | 12:52 |
| evrardjp | but maybe cache is busted | 12:52 |
| evrardjp | but that's weird | 12:52 |
| evrardjp | you said you started clean, so I supposed it was clean :) | 12:52 |
| openstackgerrit | Ravi Gummadi proposed openstack/openstack-ansible-os_aodh master: Cap the number of worker processes https://review.openstack.org/440530 | 12:52 |
| mgariepy | morning everyone | 12:56 |
| nea1 | evrardjp: fatal: [hetzner1_rabbit_mq_container-d17233cb]: FAILED! => {"failed": true, "msg": "No file was found when using with_first_found. Use the 'skip: true' option to allow this task to be skipped if no files are found"} | 12:58 |
| *** sdake has joined #openstack-ansible | 12:59 | |
| *** sdake_ has quit IRC | 13:01 | |
| *** sanfern has joined #openstack-ansible | 13:02 | |
| pjm6 | evrardjp: nea1: i'm having troubles with rabbitmq too, i tried to remove all containers and i'm getting the same error as nea1 | 13:03 |
| Andrew_jedi | nea1: You need to run setup-hosts.yaml and cancel it after few tasks and then use "openstack-ansible lxc-container-create.yml --limit <containername>" again | 13:05 |
| *** schwicht has joined #openstack-ansible | 13:06 | |
| pjm6 | Andrew_jedi: I confirm it solves the problem, just need setup module to execute in order to get the ansible facts of the infra hosts | 13:07 |
| evrardjp | I thought lxc-container-create used setup | 13:08 |
| Andrew_jedi | pjm6: Awesome :) | 13:08 |
| evrardjp | let me double check | 13:08 |
| pjm6 | btw: theoricaly if we just destroy all rabbitmq cluster | 13:09 |
| pjm6 | and recreate it | 13:09 |
| evrardjp | https://github.com/openstack/openstack-ansible/blob/master/playbooks/lxc-containers-create.yml#L18 | 13:09 |
| pjm6 | we would not loose anything right? | 13:09 |
| evrardjp | that should work | 13:09 |
| pjm6 | assuming that when we do that there's not pending works | 13:09 |
| mhayden | buenos dias | 13:09 |
| evrardjp | oh yes I understood | 13:09 |
| evrardjp | you can't gather facts yet | 13:10 |
| pjm6 | mhayden: o/ | 13:10 |
| pjm6 | evrardjp: probably that's because we are limit the container? | 13:10 |
| Andrew_jedi | pjm6: I think so, yes, but you may want to confirm it from other people as well | 13:10 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-rabbitmq_server master: [Wip] Reload systemd-daemon in all cases https://review.openstack.org/440463 | 13:10 |
| evrardjp[m] | Yes it's partially that. | 13:12 |
| evrardjp[m] | You can't gather facts with something not created yet | 13:12 |
| pjm6 | yep that make senses :D | 13:12 |
| openstackgerrit | Ravi Gummadi proposed openstack/openstack-ansible-os_aodh master: Cap the number of worker processes https://review.openstack.org/440530 | 13:14 |
| pjm6 | evrardjp[m]: regarding rebuilding rabbit_mq_containers, if there's no pending task in rabbitmq, it would not be a problem to remaking it all or there's something that we must preserve? | 13:14 |
| *** schwicht has quit IRC | 13:14 | |
| *** sdake_ has joined #openstack-ansible | 13:16 | |
| Andrew_jedi | pjm6: I guess, If you take a backup of mnesia directory before rebuilding then you should be fine in case of any issues | 13:18 |
| *** schwicht has joined #openstack-ansible | 13:19 | |
| *** sdake has quit IRC | 13:19 | |
| *** schwicht has quit IRC | 13:20 | |
| openstackgerrit | Ravi Gummadi proposed openstack/openstack-ansible-os_gnocchi master: Cap the number of worker processes https://review.openstack.org/440549 | 13:23 |
| *** ngupta has joined #openstack-ansible | 13:23 | |
| *** esberglu has joined #openstack-ansible | 13:24 | |
| *** Andrew_jedi has quit IRC | 13:26 | |
| *** rpittau_ is now known as rpittau | 13:26 | |
| openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-os_nova master: Adjust ordering for nova_db_setup https://review.openstack.org/439691 | 13:27 |
| *** ngupta has quit IRC | 13:27 | |
| nea1 | evrardjp[m]: `openstack-ansible openstack-hosts-setup.yml` for the facts `openstack-ansible lxc-containers-create.yml --limit hetzner1_rabbit_mq_container-d17233cb` for the container `openstack-ansible rabbitmq-install.yml` => fail again with the same error | 13:31 |
| nea1 | Error: unable to connect to node rabbit@hetzner1: nodedown | 13:31 |
| *** klamath has joined #openstack-ansible | 13:31 | |
| *** klamath has quit IRC | 13:32 | |
| *** klamath has joined #openstack-ansible | 13:32 | |
| openstackgerrit | Marc Gariépy proposed openstack/openstack-ansible-ceph_client master: Make sure libvirtd is started. https://review.openstack.org/440556 | 13:33 |
| cloudnull | mornings | 13:35 |
| mgariepy | good morning cloudnull | 13:35 |
| cloudnull | hows it mgariepy? | 13:35 |
| mgariepy | not too bad, getting tired of fighting with ceph .. :) | 13:35 |
| mgariepy | yourself ? | 13:36 |
| openstackgerrit | Merged openstack/openstack-ansible-openstack_hosts master: Updated from global requirements https://review.openstack.org/440405 | 13:37 |
| openstackgerrit | Merged openstack/openstack-ansible-lxc_container_create master: Updated from global requirements https://review.openstack.org/440402 | 13:38 |
| openstackgerrit | Merged openstack/openstack-ansible-os_barbican master: Updated from global requirements https://review.openstack.org/440409 | 13:38 |
| openstackgerrit | Merged openstack/openstack-ansible-ceph_client master: Updated from global requirements https://review.openstack.org/440398 | 13:38 |
| openstackgerrit | Merged openstack/openstack-ansible-os_cinder master: Updated from global requirements https://review.openstack.org/440411 | 13:38 |
| *** jpstnh has joined #openstack-ansible | 13:38 | |
| *** retreved has quit IRC | 13:39 | |
| cloudnull | mgariepy: doing well myself. | 13:40 |
| cloudnull | I'm a recent addition into the ceph fight, but i can see how that would make one tired. | 13:40 |
| cloudnull | :) | 13:40 |
| mgariepy | haha well it' | 13:41 |
| openstackgerrit | Merged openstack/openstack-ansible-apt_package_pinning master: Updated from global requirements https://review.openstack.org/440397 | 13:41 |
| openstackgerrit | Merged openstack/openstack-ansible-galera_client master: Updated from global requirements https://review.openstack.org/440399 | 13:42 |
| openstackgerrit | Merged openstack/openstack-ansible-haproxy_server master: Updated from global requirements https://review.openstack.org/440401 | 13:42 |
| openstackgerrit | Merged openstack/openstack-ansible-lxc_hosts master: Updated from global requirements https://review.openstack.org/440403 | 13:42 |
| mgariepy | not that bad, but the centos stuff is starting to get me haha :) | 13:42 |
| openstackgerrit | Merged openstack/openstack-ansible-memcached_server master: Updated from global requirements https://review.openstack.org/440404 | 13:42 |
| openstackgerrit | Merged openstack/openstack-ansible-ops master: Updated from global requirements https://review.openstack.org/440407 | 13:42 |
| openstackgerrit | Merged openstack/openstack-ansible-os_aodh master: Updated from global requirements https://review.openstack.org/440408 | 13:42 |
| openstackgerrit | Merged openstack/openstack-ansible-os_designate master: Updated from global requirements https://review.openstack.org/440413 | 13:43 |
| openstackgerrit | Merged openstack/openstack-ansible-os_gnocchi master: Updated from global requirements https://review.openstack.org/440415 | 13:43 |
| openstackgerrit | Merged openstack/openstack-ansible-os_neutron master: Updated from global requirements https://review.openstack.org/440422 | 13:43 |
| openstackgerrit | Merged openstack/openstack-ansible-os_tempest master: Updated from global requirements https://review.openstack.org/440427 | 13:43 |
| openstackgerrit | Merged openstack/openstack-ansible-os_zaqar master: Updated from global requirements https://review.openstack.org/440430 | 13:43 |
| openstackgerrit | Merged openstack/openstack-ansible-repo_server master: Updated from global requirements https://review.openstack.org/440436 | 13:44 |
| openstackgerrit | Merged openstack/openstack-ansible-rsyslog_client master: Updated from global requirements https://review.openstack.org/440437 | 13:44 |
| openstackgerrit | Merged openstack/openstack-ansible-specs master: Updated from global requirements https://review.openstack.org/440441 | 13:44 |
| openstackgerrit | Merged openstack/openstack-ansible-tests master: Updated from global requirements https://review.openstack.org/440442 | 13:44 |
| openstackgerrit | Merged openstack/openstack-ansible-os_ceilometer master: Updated from global requirements https://review.openstack.org/440410 | 13:44 |
| openstackgerrit | Merged openstack/openstack-ansible-os_cloudkitty master: Updated from global requirements https://review.openstack.org/440412 | 13:45 |
| openstackgerrit | Merged openstack/openstack-ansible-os_ironic master: Updated from global requirements https://review.openstack.org/440418 | 13:45 |
| openstackgerrit | Merged openstack/openstack-ansible-os_monasca master: Updated from global requirements https://review.openstack.org/440421 | 13:45 |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova master: Updated from global requirements https://review.openstack.org/440423 | 13:45 |
| openstackgerrit | Merged openstack/openstack-ansible-os_rally master: Updated from global requirements https://review.openstack.org/440424 | 13:46 |
| openstackgerrit | Merged openstack/openstack-ansible-os_sahara master: Updated from global requirements https://review.openstack.org/440425 | 13:46 |
| openstackgerrit | Merged openstack/openstack-ansible-os_swift master: Updated from global requirements https://review.openstack.org/440426 | 13:46 |
| openstackgerrit | Merged openstack/openstack-ansible-os_trove master: Updated from global requirements https://review.openstack.org/440428 | 13:46 |
| mgariepy | hmm http://logs.openstack.org/16/439816/1/check/gate-openstack-ansible-openstack-ansible-aio-centos-7-nv/6bbbcb8/logs/openstack/aio1-nova/nova-compute.log.txt.gz#_2017-03-01_21_34_27_365 | 13:46 |
| openstackgerrit | Merged openstack/openstack-ansible-os_watcher master: Updated from global requirements https://review.openstack.org/440429 | 13:46 |
| openstackgerrit | Merged openstack/openstack-ansible-pip_install master: Updated from global requirements https://review.openstack.org/440431 | 13:46 |
| mhayden | andymccr: so https://review.openstack.org/439157 didn't help | 13:46 |
| openstackgerrit | Merged openstack/openstack-ansible-plugins master: Updated from global requirements https://review.openstack.org/440433 | 13:46 |
| mhayden | doing the service setup prior to deploying the placement service still causes the service to fail the first time | 13:47 |
| openstackgerrit | Merged openstack/openstack-ansible-rabbitmq_server master: Updated from global requirements https://review.openstack.org/440434 | 13:47 |
| mhayden | what's weird is that the placement api appears to not log anything when it fails to start | 13:47 |
| openstackgerrit | Merged openstack/openstack-ansible-repo_build master: Updated from global requirements https://review.openstack.org/440435 | 13:47 |
| openstackgerrit | Merged openstack/openstack-ansible-rsyslog_server master: Updated from global requirements https://review.openstack.org/440438 | 13:47 |
| mhayden | but the system journal shows that it failed and respawned 2-3 minutes later without a problem | 13:47 |
| openstackgerrit | Merged openstack/openstack-ansible-security master: Updated from global requirements https://review.openstack.org/440440 | 13:48 |
| openstackgerrit | Merged openstack/openstack-ansible master: Updated from global requirements https://review.openstack.org/440396 | 13:48 |
| openstackgerrit | Merged openstack/openstack-ansible-openstack_openrc master: Updated from global requirements https://review.openstack.org/440406 | 13:48 |
| cloudnull | mgariepy: is that a read only socket problem ? | 13:48 |
| openstackgerrit | Merged openstack/openstack-ansible-os_glance master: Updated from global requirements https://review.openstack.org/440414 | 13:48 |
| openstackgerrit | Merged openstack/openstack-ansible-os_heat master: Updated from global requirements https://review.openstack.org/440416 | 13:48 |
| andymccr | mhayden: what are you trying to achieve? | 13:48 |
| andymccr | mhayden: or rather what is the issue youre solving there | 13:48 |
| openstackgerrit | Merged openstack/openstack-ansible-os_keystone master: Updated from global requirements https://review.openstack.org/440419 | 13:48 |
| cloudnull | or just that the nova perms are too restrictive ? | 13:48 |
| openstackgerrit | Merged openstack/openstack-ansible-os_magnum master: Updated from global requirements https://review.openstack.org/440420 | 13:48 |
| mhayden | andymccr: solving the problem where the placement api tries to start initially and fails | 13:49 |
| *** cloudtrainme has joined #openstack-ansible | 13:49 | |
| mhayden | then magically starts 2 minutes later | 13:49 |
| mhayden | successfully | 13:49 |
| andymccr | mhayden: ahh did not know that was happening :P | 13:49 |
| *** Jeffrey4l has quit IRC | 13:49 | |
| andymccr | mhayden: surely service setup wouldnt impact that? its not likely to connect to itself is it? | 13:50 |
| mhayden | yeah -- it's taking > 2 min to start the service | 13:50 |
| evrardjp | nea1: so there is an issue somewhere | 13:50 |
| mhayden | but if you look at the system journal, it fails on first run -- then systemd tries to restart it 2 min later with success | 13:50 |
| evrardjp | that makes your cluster think the host has something | 13:50 |
| mhayden | causes the ansible task to hang for 2-3 m | 13:50 |
| andymccr | mhayden: hmm | 13:50 |
| evrardjp | mhayden: is it possible to change the delay ? | 13:51 |
| mhayden | sure | 13:51 |
| mhayden | but i wonder why it fails the first time | 13:51 |
| mhayden | it doesn't log anything the first time around | 13:51 |
| mgariepy | cloudnull, not sure yet but i would guess for the restriction | 13:52 |
| openstackgerrit | Merged openstack/openstack-ansible-os_horizon master: Updated from global requirements https://review.openstack.org/440417 | 13:52 |
| openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-tests stable/ocata: Set the Nova wsgi processes and threads https://review.openstack.org/440564 | 13:52 |
| evrardjp | pjm6: do you also have the same issues with rabbit as nea1 ? | 13:53 |
| lwiecek | Hello. -#=#-#=#- Is there a way to install keystone with keystone ansible role wide open? not in python virtual env? is there a simple solution for that? | 13:54 |
| mhayden | lwiecek: we used to support that, but it was removed -- is there a problem with virtualenvs for you? | 13:54 |
| lwiecek | yes | 13:55 |
| lwiecek | i want to install pure keystone on machine (no rabbitmq, nothing) | 13:55 |
| lwiecek | so i use openstack-ansible-os_keystone role | 13:55 |
| lwiecek | + all openstack role dependencies that are specified in meta | 13:55 |
| lwiecek | everything installs fine, until step [ensure tenant]. failure: Internal Server Error (HTTP 500) -keystone does not respond. | 13:56 |
| lwiecek | i checked apache logs and i see error: cli arguments already parsed | 13:56 |
| openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-os_nova stable/ocata: Adjust ansible_hostname to ansible_nodename https://review.openstack.org/440565 | 13:56 |
| lwiecek | so I go into file /etc/httpd/conf.d/keystone-httpd.conf and I see that there are few spaces missing in the beggining of the line (some error with jinja templating) | 13:56 |
| andymccr | https://review.openstack.org/#/c/439691/ this should fix our upgrade vs greenfield problem for nova. | 13:57 |
| lwiecek | and this is a reason why wsgi is executed from wrong python virtual env (unreadable argument)... | 13:57 |
| lwiecek | <VirtualHost *:5000> WSGIDaemonProcess keystone-service user=keystone group=keystone processes=2 threads=1 display-name=%{GROUP} python-path=/openstack/venvs/keystone-testing/lib/python2.7/site-packages | 13:58 |
| lwiecek | this line WSGI~ is missing 4 spaces at the beggining of the line. no idea how to fix this because its automatically generated.. I use newest ansible (2.2.1) | 13:59 |
| *** cloudtrainme has quit IRC | 13:59 | |
| cloudnull | lwiecek: https://github.com/openstack/openstack-ansible-os_keystone/blob/master/templates/keystone-httpd.conf.j2#L5 | 14:00 |
| cloudnull | can you try editing the template and removing the trailing - | 14:00 |
| openstackgerrit | Merged openstack/openstack-ansible-pip_install master: Use block-rescue for pip install https://review.openstack.org/439828 | 14:00 |
| cloudnull | change -%} to %} | 14:01 |
| cloudnull | then rerun the role | 14:01 |
| *** The_Intern has joined #openstack-ansible | 14:01 | |
| openstackgerrit | Merged openstack/openstack-ansible-galera_server master: Updated from global requirements https://review.openstack.org/440400 | 14:02 |
| *** The_Intern has quit IRC | 14:03 | |
| *** vnogin has joined #openstack-ansible | 14:03 | |
| lwiecek | cloudnull ok the role is running i will report asap about the result | 14:05 |
| cloudnull | thanks! | 14:05 |
| *** schwicht has joined #openstack-ansible | 14:05 | |
| *** Jack_Iv has joined #openstack-ansible | 14:07 | |
| ioni | why was 14.04 dropped from ocata? | 14:07 |
| andymccr | ioni: no projects are supporting it for newton+ | 14:08 |
| andymccr | we decided to keep it for Newton so you could upgrade to Newton on trusty, then upgrade Ubuntu to 16.04 | 14:08 |
| andymccr | but OSA is one of the only projects that did that, so there is a chance we will lose testing infra for newton/trusty gates at some point during this cycle. | 14:09 |
| ioni | i do have quite a lot of nodes with 14.04 | 14:09 |
| ioni | and the mix with 14.04 and 16.04 didn't work at all | 14:10 |
| andymccr | ioni: did you try upgrading the nodes individually or did you remove/reinstall them completely and then try adding them back in? | 14:10 |
| odyssey4me | ioni we did do some fixes based on your feedback, but yeah it'd be nice to get some further feedback from a lab test | 14:11 |
| ioni | i had the controller on 14.04 and had compute node on 16.04 | 14:11 |
| ioni | and that didn't work | 14:11 |
| andymccr | ioni: would be great to get feedback on that so we can fix some of that up | 14:11 |
| *** fguillot has joined #openstack-ansible | 14:12 | |
| ioni | so everything in one region is 14.04 and in a seconde region is 16.04 | 14:12 |
| *** The_Intern has joined #openstack-ansible | 14:12 | |
| ioni | i have to see how to move to 16.04 on the first region | 14:12 |
| ioni | any recommendation? | 14:13 |
| alextricity25 | cloudnull: If you get a moment, could you update https://review.openstack.org/#/c/437232/7, please? | 14:13 |
| openstackgerrit | Merged openstack/openstack-ansible-galera_server stable/ocata: Cap the number of worker threads https://review.openstack.org/440190 | 14:14 |
| nea1 | evrardjp: i think he was talking about the issue with the missing / brocken facts | 14:14 |
| evrardjp | k | 14:15 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server stable/ocata: Fix fact set using ternary filter https://review.openstack.org/439150 | 14:16 |
| nea1 | as he wrote that "it" had fixed it (where Andrew wrote "You need to run setup-hosts.yaml and cancel it after few tasks [...]") | 14:16 |
| ioni | andymccr, do you happen to know if there were technical limitation on running ocata on 14.04? | 14:16 |
| ioni | andymccr, or you guys wanted to support only the latest tls from ubuntu | 14:17 |
| *** crushil has joined #openstack-ansible | 14:17 | |
| odyssey4me | ioni as it stands right now our newton support on trusty is at risk of not being testable in our gate checks because openstack officially stopped supporting trusty with mitaka | 14:18 |
| odyssey4me | so we removed all the trusty support code in ocata - ocata absolutely will not work on trusty | 14:18 |
| ioni | ok | 14:19 |
| *** gouthamr has joined #openstack-ansible | 14:19 | |
| ioni | how do you guys suggest to move to 16.04 nodes that already run 14.04? | 14:19 |
| odyssey4me | we're fighting to keep our gate checks in place to verify newton/trusty support until newton is EOL, but we have been warned that the trusty nodes may be removed entirely from the nodepool | 14:19 |
| odyssey4me | ioni I think that jmccrory has been working on a general plan and is hopefully going to push up a review to the docs repo with the general process | 14:20 |
| cloudnull | alextricity25: lookin | 14:20 |
| odyssey4me | but what's been discussed so far is along the lines of: | 14:20 |
| odyssey4me | 1. rekick the first controller with xenial (trusty must be wiped from the host) and re-deploy OSA onto it | 14:21 |
| odyssey4me | 2. rekick the secondary control plane hosts in the same way | 14:21 |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova stable/newton: Set libvirt default file to a variable https://review.openstack.org/440318 | 14:21 |
| odyssey4me | 3. work through each compute/swift host one at a time - move instances to another host, rekick, move instances back | 14:22 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-pip_install stable/ocata: Use block-rescue for pip install https://review.openstack.org/440589 | 14:22 |
| evrardjp | nea1: could you try something for me? | 14:23 |
| evrardjp | ansible -m debug -a "msg={{ hostvars[groups[rabbitmq_host_group][0]]['ansible_hostname'] }}" rabbitmq_all | 14:24 |
| evrardjp | replace rabbitmq_host_group with rabbitmq_all :) | 14:24 |
| nea1 | evrardjp: "msg": "hetzner1-rabbit-mq-container-d17233cb" | 14:24 |
| nea1 | sec | 14:24 |
| *** cjloader has joined #openstack-ansible | 14:25 | |
| evrardjp | is that the same value as your container name? | 14:25 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-pip_install stable/newton: Use block-rescue for pip install https://review.openstack.org/440595 | 14:26 |
| nea1 | evrardjp: http://termbin.com/ptdu seams like he hasn't got a rabbitmq_all group o_O | 14:26 |
| evrardjp | you forgot quotes :) | 14:27 |
| evrardjp | ansible -m debug -a "msg={{ hostvars[groups['rabbitmq_all'][0]]['ansible_hostname'] }}" rabbitmq_all | 14:27 |
| nea1 | ok, then it is fine | 14:27 |
| evrardjp | the node you have returned is your rabbitmq_primary_cluster_node | 14:27 |
| nea1 | but rabbitmq_host_group didn't have any either ^^ | 14:27 |
| evrardjp | because that was a var :) | 14:27 |
| evrardjp | but that's a var scoped in defaults | 14:28 |
| evrardjp | I don't know why it worked | 14:28 |
| nea1 | well then why is he still trying to use hetzner1 ^^ | 14:28 |
| evrardjp | the other nodes are connecting by doing | 14:28 |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova master: Change /etc/default/libvirt-bin to libvirtd https://review.openstack.org/440284 | 14:28 |
| evrardjp | https://github.com/openstack/openstack-ansible-rabbitmq_server/blob/cf6f08b31bd58a26b8f035b77cdbc457bb9e580b/tasks/rabbitmq_cluster_join.yml#L39 | 14:28 |
| *** stelouie has joined #openstack-ansible | 14:29 | |
| *** stelouie_ has joined #openstack-ansible | 14:29 | |
| *** Jeffrey4l has joined #openstack-ansible | 14:29 | |
| logan- | ioni odyssey4me: yep that is the general process I've gone with. it is going ok. my compute/storage node pain is eased by the stateless node stuff but in terms of control node stuff 14.04->16.04 rebuild is pretty smooth other than the keystone credentials bug that is getting worked out soon. i'm reloading my last controller in my dev cluster atm, probably will do prod next week and write up the general process I used | 14:29 |
| lwiecek | cloudnull Im sorry but I have to go for now. I wil be back on monday and finish running the playbook and report You if it fixed the issue or not | 14:30 |
| nea1 | well there is only one node, so that shouldn't be used(?) | 14:30 |
| ioni | logan-, cool | 14:30 |
| logan- | ioni: one major thing to watch out for currently if you reimage controllers (specifically the first controller where repo_build occurs, keystone[0] lives, etc) is this: https://bugs.launchpad.net/openstack-ansible/+bug/1667960 | 14:30 |
| openstack | Launchpad bug 1667960 in openstack-ansible "Rebuilding keystone[0] container breaks credential keys" [Critical,Confirmed] | 14:30 |
| evrardjp | https://github.com/openstack/openstack-ansible-rabbitmq_server/blob/cf6f08b31bd58a26b8f035b77cdbc457bb9e580b/tasks/rabbitmq_cluster.yml#L18 | 14:30 |
| evrardjp | nea1: could you try something different? | 14:31 |
| andymccr | hmm logan- would it be possible to move to a "run_once" rather than a when inventory_hostname == group[0] | 14:31 |
| evrardjp | edit your /etc/ansible/roles/rabbitmq_server/tasks/rabbitmq_cluser.yml and remove static:no below the cluster create | 14:31 |
| logan- | no andymccr. first we need to add a task to collect all of the keys from all of the keystone containers | 14:31 |
| ioni | logan-, so the general ideea is to add a second controller with xenial, build the services(without pushing the compute nodes) since the services built on 16.04, won't work in 14.04 | 14:31 |
| nea1 | well as he is trying to run that is must be correct | 14:31 |
| evrardjp | andymccr: I guess depend on the serial ? | 14:31 |
| nea1 | ok, sec | 14:31 |
| ioni | logan-, then remove the controller with 14.04, reintall compute node, move instances to compute node etc | 14:32 |
| evrardjp | nea1: then add in tasks/rabbitmq_cluster_create.yml a debug task like | 14:32 |
| andymccr | logan-: i thought the idea of the key sync stuff was to do that? | 14:32 |
| logan- | andymccr: no, the key sync checks if keys exist on keystone[0], if they don't, it generates new ones and then distributes them to the other containers, overwriting the old ones | 14:33 |
| logan- | it never checks the other nodes for existing keys first | 14:33 |
| andymccr | logan-: ahh i see. | 14:33 |
| *** fabg has joined #openstack-ansible | 14:33 | |
| andymccr | logan-: but if you ran it against keystone[1] it would then work? | 14:33 |
| andymccr | e.g. it would sync all the keystone[1] keys to keystone[0] | 14:33 |
| evrardjp | nea1: http://paste.openstack.org/show/601143/ | 14:33 |
| evrardjp | after the first task in cluster create | 14:34 |
| evrardjp | and see what's going on when your run rabbitmq playbook | 14:34 |
| odyssey4me | logan- oh awesome :) | 14:34 |
| ioni | logan-, where are you going to post the documentation? | 14:34 |
| *** lwiecek has quit IRC | 14:34 | |
| logan- | andymccr: don't think so, i think that is one of the many tasks in the role that are hard coded on keystone[0] | 14:34 |
| openstackgerrit | Merged openstack/openstack-ansible-os_cinder stable/ocata: Use stable/ocata branch for tempest plugin repo https://review.openstack.org/439874 | 14:34 |
| andymccr | logan-: yeah i think we ahve similar issues with swift - its any role that strongly requires things to be setup and then distributed | 14:34 |
| *** Jeffrey4l has quit IRC | 14:35 | |
| andymccr | logan-: we copy all the swift stuff over so in theory if you remove swift_all[0] it would run against the next swift_all[0] and still work, but if swift_all[0] is just unavailable i imagine it would bomb | 14:35 |
| andymccr | which isnt ideal | 14:35 |
| logan- | yeah :( | 14:35 |
| andymccr | logan-: maybe we need a way to determine the first available node rather htan keystone[0] | 14:35 |
| openstackgerrit | Merged openstack/openstack-ansible-os_cinder stable/ocata: Provide empty default for cinder_backends https://review.openstack.org/439475 | 14:35 |
| odyssey4me | andymccr evrardjp logan- perhaps we should start implementing the use of the deploy node as a place to keep copies of things, then distribute from there | 14:36 |
| evrardjp | agreed | 14:36 |
| logan- | ioni: not sure yet.. maybe on my blog. but yes to answer your question my control is 3x 14.04 currently. I build a 4th node and install 16.04. then shutdown a control node, swap the drives from the 16.04 node, and run OSA to rebuild the containers. | 14:36 |
| evrardjp | put it in /etc/openstack_deploy/files | 14:36 |
| odyssey4me | it would simplify things dramatically, and we could re-use this mechanism for ssl keys/certs and loads of other things | 14:36 |
| evrardjp | that's what I used previously :p | 14:37 |
| logan- | ioni: i'll drop you a link once I've got it written up | 14:37 |
| odyssey4me | yeah, basically setup a folder in /etc/openstack_deploy which contains things we copy between nodes - then always ship from the deployment node out | 14:37 |
| logan- | odyssey4me: yeah thats a potential solution | 14:37 |
| nea1 | evrardjp: http://termbin.com/w609 | 14:37 |
| ioni | logan-, cool, i'll ping you next week? | 14:37 |
| andymccr | i think that's ok as long as we back it up onto other hosts too | 14:37 |
| odyssey4me | in some cases we may generate on a target host, then pull, then push | 14:37 |
| logan- | odyssey4me: but for the credential keys I think its probably unnecessary. we already have the keys on the other 2 containers. we can just collect them all, filter by uniques, and then populate all existing keys first before distributing | 14:38 |
| andymccr | logan-: yeah i kinda agree, if we have to distribute them everywhere anyway it makes more sense to come up with a method that doesnt involve linking to node[0] | 14:38 |
| andymccr | swift is the same. | 14:38 |
| *** rmelero has joined #openstack-ansible | 14:38 | |
| andymccr | e.g. test consistency - if its the same or some are empty (e.g. they are new) pick any non-empty host to be the sync host | 14:39 |
| logan- | yep | 14:39 |
| nea1 | evrardjp: i fount the problem -.- | 14:39 |
| odyssey4me | andymccr yeah, for maximum protection we'd have to check all node if they have the thing we need and pull it if it doesn't exist on the deploy node | 14:39 |
| evrardjp | ok tell me. | 14:40 |
| evrardjp | I've spent too much time on this :p | 14:40 |
| nea1 | hetzner injects your hostname into the hosts on install | 14:40 |
| nea1 | and it uses the public ip | 14:40 |
| nea1 | but openstack-ansible sets 127.0.1.1 for the node name | 14:40 |
| andymccr | host files are fun :D | 14:40 |
| logan- | ioni: sure sounds good | 14:40 |
| nea1 | what sound wrong too but it works if rabbitmq tries to use that on its on node | 14:41 |
| evrardjp | nea1: that doesn't sound right | 14:41 |
| odyssey4me | logan- I trust you to come up with an elegant solution ;) | 14:41 |
| nea1 | because dnsmasq resolves hetzner1 to 127.0.1.1 | 14:41 |
| evrardjp | what you pasted was on the container | 14:41 |
| evrardjp | rabbitmq checks the hosts file for clustering, and I'm not aware he is doing reverse lookup | 14:42 |
| *** ngupta has joined #openstack-ansible | 14:42 | |
| evrardjp | using libc dns libs or whatever it's named | 14:42 |
| evrardjp | (pun intended) | 14:42 |
| nea1 | yep, that is fine, but it seams like rabbitmqctl is always trying to use the hostname of the host | 14:42 |
| *** ngupta_ has joined #openstack-ansible | 14:43 | |
| evrardjp | it uses the hostname but should only read /etc/hosts IIRC | 14:43 |
| *** esberglu has quit IRC | 14:43 | |
| evrardjp | anyway, let's see how it goes on your host | 14:43 |
| evrardjp | if you disable your dhcp from hetzner1 | 14:43 |
| evrardjp | and if it works better in your container | 14:43 |
| logan- | odyssey4me: maybe too much faith, but we'll see, i'm going for "less of a wrecking ball" :P in the mean time, some eyes on this would be appreciated: https://review.openstack.org/#/c/438219/ | 14:43 |
| evrardjp | but that's definitely an edge case here | 14:43 |
| odyssey4me | andymccr evrardjp logan- mgariepy FYI here's the review for adding the periodic jobs for OSA to test centos and upgrades: https://review.openstack.org/419517 | 14:43 |
| logan- | not just odyssey4me too, any input is appreciated | 14:44 |
| odyssey4me | I have no idea whether it's all right or not | 14:44 |
| evrardjp | logan-: I'll remove my vote on it | 14:44 |
| nea1 | evrardjp: ... sry was wrong >.< | 14:44 |
| evrardjp | this way we can merge it, and maybe improve later | 14:44 |
| logan- | evrardjp: agreed thanks | 14:44 |
| evrardjp | I still don't like it, but I don't have an alternative to propose right now :/ | 14:45 |
| nea1 | ping hetzner1 the way I'd assumed but yep, you are right rabbbitmqctl doesn't use that | 14:45 |
| logan- | thats great odyssey4me. how complete is the upgrade scenario now? | 14:45 |
| evrardjp | still, it's worth cleaning up just in case there is a weird overlap bug we didn't see in the past | 14:45 |
| evrardjp | maybe 16.04 and systemd stuff :p | 14:45 |
| evrardjp | if I can, I'll happily blame systemd-resolvd. | 14:46 |
| *** ngupta has quit IRC | 14:46 | |
| odyssey4me | logan- with that periodic we'll have to change how gate-check-commit works to understand the 'deploy' versus 'upgrade' action parameter - but with that we'll be able to test any scenario's deploy and upgrade | 14:46 |
| odyssey4me | I'll be pushing up a patch shortly to address that change | 14:46 |
| fabg | Hi osa folks, got an error on task os-neutron, tag neutron-config (newton 14.0.7). http://paste.openstack.org/show/601146/ Any idea ? | 14:46 |
| odyssey4me | logan- argh, https://review.openstack.org/438219 makes my brain hurt | 14:47 |
| * odyssey4me saves it for tomorrow when he has a fresh head | 14:47 | |
| logan- | haha ok | 14:49 |
| *** ngupta_ has quit IRC | 14:49 | |
| *** ngupta has joined #openstack-ansible | 14:49 | |
| cloudnull | thanks lwiecek | 14:50 |
| openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-os_nova master: Adjust ordering for nova_db_setup https://review.openstack.org/439691 | 14:50 |
| andymccr | ^ should work now! | 14:50 |
| *** manheim_ has quit IRC | 14:51 | |
| nea1 | evrardjp: ok, so I just did a lot of noise about nothing >.< ... the issue still stays, why is rabbitmqctl trying to use hetzner1 as server | 14:51 |
| odyssey4me | cloudnull I'm guessing it's the '-' before the '%}' in this line? https://github.com/openstack/openstack-ansible-os_keystone/blob/master/templates/keystone-httpd.conf.j2#L5 | 14:51 |
| odyssey4me | odd - because it's not causing trouble in the gate | 14:52 |
| odyssey4me | lwiecek ^ | 14:52 |
| evrardjp | did you run the debug task nea1 ? | 14:53 |
| nea1 | evrardjp: what i get if i add 127.0.0.1 hetzner1 to my hosts when running rabbitmqctl cluster_status http://termbin.com/zj21 | 14:54 |
| cloudnull | agreeded. odd | 14:54 |
| nea1 | evrardjp: the debug output http://termbin.com/w609 | 14:54 |
| cloudnull | **agreed | 14:54 |
| evrardjp | nea1: http://termbin.com/zj21 shows the problem | 14:56 |
| evrardjp | cookie set | 14:56 |
| evrardjp | node name is wrong | 14:56 |
| evrardjp | epmd issue | 14:56 |
| evrardjp | so | 14:56 |
| evrardjp | could you disable dhcp from eth0 in your container | 14:57 |
| evrardjp | see if works better | 14:57 |
| evrardjp | after a restart of epmd | 14:58 |
| *** TxGirlGeek has joined #openstack-ansible | 14:59 | |
| *** mpjetta has joined #openstack-ansible | 15:00 | |
| *** esberglu has joined #openstack-ansible | 15:01 | |
| *** TxGirlGeek has quit IRC | 15:02 | |
| nea1 | evrardjp: `ifdown eth0` `rabbitmqctl cluster_status` > * unable to connect to epmd (port 4369) on hetzner1: nxdomain (non-existing domain) | 15:02 |
| *** TxGirlGeek has joined #openstack-ansible | 15:02 | |
| nea1 | and i restarted the service of cause | 15:02 |
| *** sawblade6 has joined #openstack-ansible | 15:02 | |
| nea1 | and if I add hetzner1 to 172.0.1.1 I get the same message as above (zj21 | 15:03 |
| openstackgerrit | Tom Jose Kalapura proposed openstack/openstack-ansible-haproxy_server master: Define haproxy_ssl_protocol variable. https://review.openstack.org/439912 | 15:03 |
| *** manheim_ has joined #openstack-ansible | 15:05 | |
| *** acormier has joined #openstack-ansible | 15:06 | |
| *** TxGirlGeek has quit IRC | 15:06 | |
| *** kstev has joined #openstack-ansible | 15:13 | |
| *** crushil has quit IRC | 15:15 | |
| openstackgerrit | Mark Hamzy proposed openstack/openstack-ansible master: Add support to install a molteniron server https://review.openstack.org/427255 | 15:15 |
| *** chhavi has quit IRC | 15:15 | |
| *** crushil has joined #openstack-ansible | 15:15 | |
| *** Andrew_jedi has joined #openstack-ansible | 15:16 | |
| *** TxGirlGeek has joined #openstack-ansible | 15:16 | |
| openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-os_nova stable/ocata: Split upgrade testing into it's own shell script https://review.openstack.org/438002 | 15:16 |
| *** chris_hultin|AWA is now known as chris_hultin | 15:16 | |
| *** TxGirlGeek has quit IRC | 15:16 | |
| *** TxGirlGeek has joined #openstack-ansible | 15:17 | |
| *** shausy has quit IRC | 15:19 | |
| *** sunjon_ has quit IRC | 15:20 | |
| *** TxGirlGeek has quit IRC | 15:21 | |
| *** whiteveil has joined #openstack-ansible | 15:22 | |
| *** Andrew_jedi has quit IRC | 15:23 | |
| *** TxGirlGeek has joined #openstack-ansible | 15:24 | |
| andymccr | jamesdenton: ok i have a fix for the service not starting issue: https://review.openstack.org/#/c/439691/ - additionally https://review.openstack.org/#/c/440565/ should fix the hostname issue for placement | 15:26 |
| andymccr | or rather a fix for the DB perm issue | 15:26 |
| andymccr | i think that should cover off the nova upgrade issues you saw. i'll try take a look at the galera problems but that may not make release. | 15:27 |
| *** Andrew_jedi has joined #openstack-ansible | 15:27 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Adjust gate-check-commit for deploy/upgrade testing https://review.openstack.org/440631 | 15:28 |
| andymccr | mhayden: on that placement thing - dont the logs indicate that its actually nova-compute taking ages to restart? | 15:29 |
| andymccr | http://logs.openstack.org/65/440565/1/check/gate-openstack-ansible-os_nova-ansible-func-ubuntu-xenial/db5c8c5/console.html#_2017-03-02_14_33_16_794135 | 15:30 |
| andymccr | for example | 15:30 |
| andymccr | mhayden: ara logs suggest the same | 15:32 |
| *** whiteveil has quit IRC | 15:32 | |
| *** lucasxu has joined #openstack-ansible | 15:32 | |
| *** whiteveil has joined #openstack-ansible | 15:34 | |
| logan- | looks like that updated ara took less than 1 min to generate integrated repo stuff if i'm reading correctly http://logs.openstack.org/24/396324/9/check/gate-openstack-ansible-openstack-ansible-aio-ubuntu-xenial/71a03bb/console.html#_2017-03-02_04_08_54_210744 | 15:35 |
| *** TxGirlGeek has quit IRC | 15:37 | |
| andymccr | logan-: yeah that doesnt seem too bad then! | 15:38 |
| *** TxGirlGeek has joined #openstack-ansible | 15:38 | |
| *** marst has joined #openstack-ansible | 15:40 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_ceilometer master: Remove Ceilometer API Service https://review.openstack.org/437232 | 15:42 |
| *** Andrew_jedi has quit IRC | 15:44 | |
| *** Matias has quit IRC | 15:44 | |
| mhayden | andymccr: haven't gotten into that deeply enough yet | 15:45 |
| andymccr | mhayden: fair fair | 15:45 |
| mhayden | OSA Weekly Meeting in 15 minutes! | 15:45 |
| mhayden | cloudnull, mattt, andymccr, d34dh0r53, hughsaunders, b3rnard0, palendae, Sam-I-Am, odyssey4me, serverascode, rromans, erikmwilson, mancdaz, _shaps_, BjoernT, claco, echiu, dstanek, jwagner, ayoung, prometheanfire, evrardjp, arbrandes, mhayden, scarlisle, luckyinva, ntt, javeriak, automagically, spotz, vdo, jmccrory, alextricity25, jasondotstar, admin0, michaelgugino, ametts, v1k0d3n, severion, | 15:45 |
| mhayden | bgmccollum, darrenc, JRobinson__, asettle, colinmcnamara, thorst, adreznec, eil397, qwang,nishpatwa_, cathrichardson, drifterza, sc68cal | 15:45 |
| mhayden | (in #openstack-meeting-4, of course) | 15:45 |
| d34dh0r53 | whew, real IRC | 15:45 |
| mhayden | indeed | 15:45 |
| spotz | heheh | 15:45 |
| mhayden | slacker | 15:45 |
| spotz | d34dh0r53: How goes?:) | 15:46 |
| d34dh0r53 | spotz: not bad, how's the new gig? | 15:46 |
| asettle | Hooray | 15:46 |
| asettle | mhayden: you're back hosting? | 15:46 |
| *** Andrew_jedi has joined #openstack-ansible | 15:47 | |
| *** doda has quit IRC | 15:47 | |
| andymccr | mhayden: have you prepared gifs? | 15:49 |
| *** galstrom_zzz is now known as galstrom | 15:53 | |
| *** TxGirlGeek has quit IRC | 15:54 | |
| *** TxGirlGeek has joined #openstack-ansible | 15:54 | |
| mhayden | not really ;) | 15:55 |
| *** The_Intern has quit IRC | 15:56 | |
| spotz | d34dh0r53: I'm liking it, keeping me busy:) | 15:56 |
| *** Andrew_jedi has quit IRC | 15:56 | |
| *** TxGirlGeek has quit IRC | 15:59 | |
| *** The_Intern has joined #openstack-ansible | 15:59 | |
| *** schwicht has quit IRC | 16:04 | |
| *** fabg has quit IRC | 16:04 | |
| *** TxGirlGeek has joined #openstack-ansible | 16:04 | |
| *** fabg has joined #openstack-ansible | 16:04 | |
| *** galstrom is now known as galstrom_zzz | 16:04 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova stable/ocata: Adjust ansible_hostname to ansible_nodename https://review.openstack.org/440565 | 16:05 |
| *** yolanda has joined #openstack-ansible | 16:05 | |
| *** jmckind has joined #openstack-ansible | 16:05 | |
| *** galstrom_zzz is now known as galstrom | 16:06 | |
| *** markvoelker has quit IRC | 16:07 | |
| *** admin0 has joined #openstack-ansible | 16:07 | |
| *** Oku_OS is now known as Oku_OS-away | 16:07 | |
| SamYaple | nea1: can you run $(getent ahostsv4 `hostname`) | 16:09 |
| SamYaple | nea1: that will do the same resolving checks that erlang does | 16:09 |
| *** rmelero has quit IRC | 16:09 | |
| *** DanyC has quit IRC | 16:10 | |
| nea1 | SamYaple: evrardjp I just noticed that `HOSTNAME=$(hostname) rabbitmqctl cluster_status` works | 16:10 |
| nea1 | for some reason the HOSTNAME in `env` is wrong | 16:10 |
| nea1 | but hostname returns the correct value | 16:11 |
| SamYaple | hmmm | 16:11 |
| *** Matias has joined #openstack-ansible | 16:11 | |
| nea1 | SamYaple: http://termbin.com/cltw | 16:11 |
| *** DanyC has joined #openstack-ansible | 16:12 | |
| *** markvoelker has joined #openstack-ansible | 16:12 | |
| SamYaple | nea1: having it resolve to 127.0.1.1 is a bad thing for clustering | 16:12 |
| SamYaple | but it should be alright. | 16:13 |
| nea1 | SamYaple: that seams to be the way OSA does it(?) I haven't changed anything on the hosts | 16:14 |
| SamYaple | yea thats why im saying it should be fine | 16:14 |
| SamYaple | it can make things more complicated, but i dont think thats whats happening here | 16:14 |
| *** galstrom is now known as galstrom_zzz | 16:14 | |
| nea1 | hostnamectl returns "Failed to create bus connection: No such file or directory" in the container ... | 16:15 |
| *** galstrom_zzz is now known as galstrom | 16:15 | |
| *** DanyC has quit IRC | 16:16 | |
| *** jamesden_ has joined #openstack-ansible | 16:18 | |
| *** cloudtrainme has joined #openstack-ansible | 16:19 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Added a common tag to the common tasks https://review.openstack.org/440665 | 16:19 |
| *** fabg has quit IRC | 16:19 | |
| *** fabg has joined #openstack-ansible | 16:20 | |
| rabel_b1 | mhayden: could you make a +2 out of your -1 in https://review.openstack.org/#/c/430900/ ? ;) all the missing dependencies should be backported now and the change passes the gates now. | 16:20 |
| *** TxGirlGeek has quit IRC | 16:23 | |
| *** manheim_ has quit IRC | 16:24 | |
| nea1 | it seams like the HOSTNAME in the env is the nodes name everywhere | 16:24 |
| SamYaple | nea1: yea i was just confirming that | 16:25 |
| mgariepy | damn .. /usr/local/bin/openstack-ansible: line 64: 27471 Segmentation fault | 16:26 |
| cloudnull | seg fault ?! | 16:29 |
| *** fabg has quit IRC | 16:30 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova stable/ocata: Change /etc/default/libvirt-bin to libvirtd https://review.openstack.org/440671 | 16:30 |
| *** fabg has joined #openstack-ansible | 16:30 | |
| mgariepy | cloudnull, yep, twice on 2 differents vms this morning. | 16:30 |
| nea1 | I just tested it on my other setup, there only one container doesn't fail | 16:30 |
| cloudnull | so that has to be something within ansible | 16:31 |
| cloudnull | line 64 in that file is the "fi" | 16:31 |
| cloudnull | of the wrapper | 16:31 |
| SamYaple | nea1: can you repeat that last comment? | 16:32 |
| SamYaple | are you saying in a different environment its broken too? | 16:32 |
| *** TxGirlGeek has joined #openstack-ansible | 16:36 | |
| nea1 | SamYaple: there are container which seam to be fine | 16:37 |
| nea1 | I noticed that dbus is missing in the rabbitmq container, but that still doesn't solve the problem, but removes the "Failed to create bus connection: No such file or directory" Error | 16:38 |
| *** manheim_ has joined #openstack-ansible | 16:38 | |
| openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-os_nova stable/ocata: Adjust ordering for nova_db_setup https://review.openstack.org/440679 | 16:39 |
| openstackgerrit | Merged openstack/openstack-ansible-os_ceilometer master: Remove Ceilometer API Service https://review.openstack.org/437232 | 16:39 |
| evrardjp | logan-: https://docs.openstack.org/developer/openstack-ansible/ocata/developer-docs/contribute.html#development-cycle-checklist | 16:40 |
| logan- | great thanks | 16:40 |
| evrardjp | I guess we could document the ceph bits there in milestone 2 | 16:40 |
| *** h5t4_ has quit IRC | 16:41 | |
| *** cloudtrainme has quit IRC | 16:41 | |
| logan- | yep i think m2 is perfect, esp. with tests running now | 16:41 |
| *** agrebennikov_ has joined #openstack-ansible | 16:42 | |
| *** pcaruana has quit IRC | 16:42 | |
| openstackgerrit | Nolan Brubaker proposed openstack/openstack-ansible master: Restructure lib directory to install via pip https://review.openstack.org/418076 | 16:45 |
| openstackgerrit | Nolan Brubaker proposed openstack/openstack-ansible master: Restructure lib directory to install via pip https://review.openstack.org/418076 | 16:46 |
| nea1 | evrardjp: SamYaple `unset HOSTNAME` `rabbitmqctl status` works fine too, so the question is from where it the HOSTNAME in the env coming from, it is not in any /etc/ nor /root/ files | 16:47 |
| *** fabg has quit IRC | 16:48 | |
| *** mmalik4_ has joined #openstack-ansible | 16:49 | |
| evrardjp | that's a good question! | 16:49 |
| evrardjp | could you indicate that in the bug? | 16:50 |
| evrardjp | this way when someone looks for a fix, they know the cause and will therefore look at how to fix it | 16:50 |
| evrardjp | if you don't do it yourself :) | 16:50 |
| *** chhavi has joined #openstack-ansible | 16:51 | |
| *** jmckind_ has joined #openstack-ansible | 16:52 | |
| *** jmckind has quit IRC | 16:54 | |
| nea1 | well the question is where to fix it | 16:55 |
| nea1 | the quickfix is done easily but there should it actually be done | 16:55 |
| evrardjp | I'd grep for HOSTNAME accross the whole codebase. Barbarian method. | 16:55 |
| evrardjp | else lxc-container-create, rabbitmq, or lxc-hosts role for a more surgical approach | 16:56 |
| evrardjp | SamYaple: any idea? | 16:57 |
| *** fabg has joined #openstack-ansible | 16:58 | |
| SamYaple | evrardjp: haah i did the same thing | 16:58 |
| SamYaple | nea1: ive been trying to dig into _where_ HOSTNAME comes from | 16:58 |
| SamYaple | the only thing i found was lxc.utsname, but thats not begin set as far as i can tell | 16:59 |
| evrardjp | SamYaple: we may need to check also ansible_env.hostname or things like that so... | 16:59 |
| nea1 | evrardjp: ../etc/openstack_deploy/ansible_facts/hetzner1_rabbit_mq_container-d17233cb: "HOSTNAME": "hetzner1", | 16:59 |
| nea1 | ../etc/openstack_deploy/ansible_facts/hetzner1: "HOSTNAME": "hetzner1", | 16:59 |
| evrardjp | -i | 16:59 |
| *** fabg has quit IRC | 16:59 | |
| nea1 | but the strange part is `ansible -m shell -a "env | grep HOSTNAME" all` returns HOSTNAME=hetzner1 for all | 17:00 |
| *** schwicht has joined #openstack-ansible | 17:00 | |
| SamYaple | nea1: did you set 'global_environment_variables' or soething? | 17:01 |
| *** sdake has joined #openstack-ansible | 17:02 | |
| SamYaple | better question, how was this ever working | 17:03 |
| *** jpstnh has quit IRC | 17:04 | |
| odyssey4me | jmccrory logan- andymccr evrardjp I'd appreciate any feedback for https://review.openstack.org/440631 to help get the upgrade tests for the integrated build working | 17:04 |
| evrardjp | nea1: that's definitively a source of issues :) | 17:05 |
| evrardjp | SamYaple: haha :) | 17:05 |
| *** sdake_ has quit IRC | 17:06 | |
| SamYaple | evrardjp: whats really funny is i think rabbitmq is the _ONLY_ one that would have issues with that | 17:06 |
| evrardjp | would that be dnsmasq that messes up everything? I can't understand that :) | 17:06 |
| nea1 | SamYaple: don't know what global_environment_variables should be ^^ | 17:06 |
| evrardjp | well for me I hoped it was using /etc/hosts, so I thought rabbitmq would have been the only one NOT impacted :p | 17:06 |
| SamYaple | nea1: well it doesnt need to be set at all. is it set in your configs? | 17:06 |
| nea1 | the config is default, except for http://paste.openstack.org/show/Rju8y8MR9JPuQTbZ7Uri/ | 17:07 |
| evrardjp | nea1 pay attention to what you say, you said to me you didn't define anything. | 17:07 |
| evrardjp | :D | 17:07 |
| SamYaple | evrardjp: HOSTNAME is an env keyword that rabbitmq uses as a final override. you can also add it to rabbitmq-env.conf and rabbitmq will source that before starting | 17:07 |
| *** cloudtrainme has joined #openstack-ansible | 17:07 | |
| evrardjp | good to know! | 17:07 |
| openstackgerrit | Ravi Gummadi proposed openstack/openstack-ansible-os_ironic master: Cap the number of worker processes https://review.openstack.org/440706 | 17:08 |
| nea1 | oh, yea HOSTNAME would be perfect in global_environment_variables xD | 17:08 |
| *** schwicht has quit IRC | 17:08 | |
| logan- | ok odyssey4me added to queue | 17:09 |
| nea1 | SamYaple: the user_variables.yml is untouched | 17:09 |
| nea1 | directly from stable/ocata | 17:09 |
| logan- | jmccrory thanks for that etherpad... added a bunch of notes.. good luck :P | 17:09 |
| *** whiteveil has quit IRC | 17:10 | |
| *** crushil has quit IRC | 17:10 | |
| *** DanyC has joined #openstack-ansible | 17:12 | |
| *** TxGirlGeek has quit IRC | 17:16 | |
| *** TxGirlGeek has joined #openstack-ansible | 17:17 | |
| nea1 | evrardjp: I don't have the time to fix this, but I'm noticing that my workaround isn't working either - ansible doesn't load the bashrc / profile does it? | 17:18 |
| evrardjp | nope | 17:19 |
| evrardjp | it executes python on the node | 17:19 |
| nea1 | so how do i fix the env for that ^^ | 17:19 |
| *** doda has joined #openstack-ansible | 17:19 | |
| SamYaple | nea1: im pretty confused as to how that is getting set | 17:22 |
| evrardjp | I'm thinking lxc_container_create or lxc_hosts | 17:22 |
| evrardjp | or openstack_hosts | 17:22 |
| nea1 | as soon as I run the rabbitmq-install.yml, this returns >.< => ansible_facts/hetzner1_rabbit_mq_container-d17233cb: "HOSTNAME": "hetzner1", | 17:23 |
| nea1 | SamYaple: yep, i have no idea | 17:23 |
| SamYaple | cloudnull: do you recall if you are using lxc.utsname or something to set the HOSTNAME in the containers at the time of lxc create? | 17:23 |
| SamYaple | im not seeing anything that sets that env var anywhere | 17:23 |
| evrardjp | lxc.utsname is good | 17:23 |
| nea1 | usually it is set in lxc containers with lxc.utsname, but the are fine | 17:24 |
| SamYaple | wierdness | 17:24 |
| evrardjp | what is lxc_cache_environment ? | 17:24 |
| cloudnull | SamYaple: we set it within the container using /etc/hosts and /etc/hostname, then call ``hostname -f /etc/hostname`` | 17:26 |
| cloudnull | i'd like to set it within the config | 17:26 |
| cloudnull | however doing so would trigger a container restart | 17:26 |
| cloudnull | up until recently that is | 17:26 |
| *** manheim_ has quit IRC | 17:26 | |
| cloudnull | we could likely revisit that now | 17:26 |
| hwoarang | mgariepy: hello! do you have a bit of time to talk about the centos7 playbooks in openstack ansible? i am working on the suse support and i have a question some centos7 stuff for the galera_server role | 17:26 |
| evrardjp | cloudnull: /etc/hosts is good and /etc/hostname is good | 17:26 |
| nea1 | evrardjp: fatal: [hetzner1_rabbit_mq_container-d17233cb]: FAILED! => {"failed": true, "msg": "the field 'args' has an invalid value, which appears to include a variable that is undefined. The error was: 'lxc_cache_environment' is undefined\n\nThe error appears to have been in '/etc/ansible/roles/rabbitmq_server/tasks/rabbitmq_cluster_create.yml': line 29, column 3, but may\nbe elsewhere in the file | 17:27 |
| evrardjp | at least that's what I heard | 17:27 |
| nea1 | depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n\n- name: debug hostname\n ^ here\n"} | 17:27 |
| nea1 | i added it to the rabbitmq_server/tasks/rabbitmq_cluster_create.yml | 17:27 |
| evrardjp | ok so you have this variable overriden | 17:27 |
| nea1 | as debug message | 17:27 |
| evrardjp | yes I understood you :) | 17:27 |
| evrardjp | well I'd do this: | 17:28 |
| evrardjp | openstack-ansible lxc-container-destroy.yml --limit <rabbitmq container name? | 17:28 |
| evrardjp | unset the HOSTNAME var | 17:28 |
| evrardjp | do the same with container create | 17:28 |
| evrardjp | and see how it goes | 17:28 |
| evrardjp | to see if it's carried during container create or something else | 17:29 |
| openstackgerrit | Ravi Gummadi proposed openstack/openstack-ansible-os_sahara master: Cap the number of worker threads https://review.openstack.org/440716 | 17:30 |
| nea1 | I'm just trying that, but it is still strange, as I restarted the container, and well there is no "hetzer1" in /etc or so which should lead to it setting the hostname | 17:31 |
| *** The_Intern has quit IRC | 17:32 | |
| *** The_Intern has joined #openstack-ansible | 17:32 | |
| nea1 | evrardjp: nope, didn't help | 17:33 |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova master: Adjust ordering for nova_db_setup https://review.openstack.org/439691 | 17:34 |
| *** lucasxu has quit IRC | 17:36 | |
| *** lucasxu has joined #openstack-ansible | 17:38 | |
| mgariepy | hwoarang, sure, i'm currently in a meeting and lunch after that but we can have a quick chat after this. | 17:39 |
| mgariepy | hwoarang, mhayden is very knowledgeable on the centos stuff also ;) | 17:39 |
| mhayden | whee | 17:39 |
| odyssey4me | andymccr I take it that you're still working on making the ocata upgrade test work for os_nova? I see it's failing in https://review.openstack.org/440679 | 17:40 |
| odyssey4me | oh, it's probably https://review.openstack.org/440671 that needs to merge | 17:40 |
| odyssey4me | logan- ^ :) | 17:40 |
| andymccr | https://review.openstack.org/#/c/438002/ <-- that needs to merge | 17:40 |
| *** admin0 has quit IRC | 17:40 | |
| andymccr | the libvirtd change wont matter since we dont set listen_tcp to 1 so it doesnt get touched | 17:41 |
| andymccr | but once the patch i linked above merges then upgrade tests are all working! | 17:41 |
| odyssey4me | andymccr gimme gimme gimme your review before midnight :) https://review.openstack.org/440631 | 17:41 |
| hwoarang | mgariepy: mhayden: ok :) for now i have a simple question. The line 136 in tasks/galera_install_yum.yml ('...UPDATE mysql.user SET Password=PASSWORD('$rootpass')...) doesn't make much sense to me. $rootpass variable is empty. So in the line above you set the root pass to '{{galera_root_password}}', then you set it to empty, so subsequent mysql connections fail in the rest of the playbooks. more or less... what do i miss? :) | 17:42 |
| *** doda has quit IRC | 17:43 | |
| odyssey4me | FYI we can expect to see infra mirrors for mariadb 10.0 and 10.1 within the next day as https://review.openstack.org/354203 has merged | 17:46 |
| *** vnogin has quit IRC | 17:49 | |
| logan- | nice! | 17:49 |
| *** vnogin has joined #openstack-ansible | 17:49 | |
| *** adrian_otto has joined #openstack-ansible | 17:52 | |
| *** h5t4 has joined #openstack-ansible | 17:53 | |
| *** vnogin has quit IRC | 17:54 | |
| *** lucasxu has quit IRC | 17:54 | |
| SamYaple | odyssey4me: w00t | 17:54 |
| *** Andrew_jedi has joined #openstack-ansible | 17:57 | |
| SamYaple | i was really hoping rabbitmq 3.7.0 would land before ocata, but alas it did not | 17:57 |
| SamYaple | it has some really awesome stuff. like autoclustering and any-order node restarting | 17:58 |
| SamYaple | not to mention the config file format is no longer native erlang ugliness. its ini-type config (mostly) | 17:59 |
| *** vzkyr3 has joined #openstack-ansible | 18:01 | |
| odyssey4me | SamYaple yeah, d34dh0r53 has been salivating over it | 18:03 |
| SamYaple | he aint the only one | 18:03 |
| d34dh0r53 | yep | 18:04 |
| SamYaple | ive been running the RC at my house because i cannot wait | 18:04 |
| SamYaple | its been kinda buggy :/ | 18:04 |
| d34dh0r53 | we can't even get 3.6.7 :/ | 18:04 |
| *** stuartgr has quit IRC | 18:04 | |
| SamYaple | all that sweet sweet 3.7.0 work | 18:05 |
| *** karimb has joined #openstack-ansible | 18:05 | |
| jmccrory | odyssey4me question on https://review.openstack.org/#/c/440631 | 18:05 |
| *** schwicht has joined #openstack-ansible | 18:08 | |
| *** stelouie has left #openstack-ansible | 18:12 | |
| *** vnogin has joined #openstack-ansible | 18:13 | |
| *** adogrant has quit IRC | 18:14 | |
| odyssey4me | jmccrory answered | 18:14 |
| *** woodard has joined #openstack-ansible | 18:15 | |
| *** TxGirlGeek has quit IRC | 18:15 | |
| *** TxGirlGeek has joined #openstack-ansible | 18:16 | |
| vnogin | guys, did any one face this issue? http://paste.openstack.org/show/601170/ | 18:17 |
| vnogin | newton/stable | 18:18 |
| *** vzkyr3 has quit IRC | 18:18 | |
| *** cloudtrainme has quit IRC | 18:19 | |
| odyssey4me | vnogin looks like a transient failure? | 18:19 |
| odyssey4me | Temporary failure in name resolution | 18:19 |
| *** TxGirlGeek has quit IRC | 18:20 | |
| vnogin | odyssey4me: and I need to deploy lab today :))) | 18:20 |
| odyssey4me | vnogin multi-node? | 18:20 |
| *** woodard has quit IRC | 18:20 | |
| odyssey4me | vnogin execute scripts/fastest-infra-wheel-mirror.py | 18:21 |
| vnogin | odyssey4me: big scale lab :) | 18:21 |
| evrardjp | cloudnull: did you think of using an ansible cache_plugin to basically fast fetch/fast reuse of cruton data? | 18:22 |
| odyssey4me | then add the var 'repo_build_pip_extra_indexes:' into user_variables.yml with a single list item that contains the result from running that script | 18:22 |
| evrardjp | you can there store facts super fact with cassandra backend | 18:22 |
| cloudnull | i have. | 18:22 |
| *** TxGirlGeek has joined #openstack-ansible | 18:22 | |
| cloudnull | i did not implement it | 18:22 |
| evrardjp | hehe :D | 18:22 |
| odyssey4me | vnogin but you may just have a dns resolution issue on your hosts | 18:22 |
| evrardjp | You had a nice idea there. | 18:22 |
| evrardjp | just saying | 18:22 |
| *** McMurlock1 has quit IRC | 18:23 | |
| *** whiteveil has joined #openstack-ansible | 18:24 | |
| vnogin | odyssey4me: damn... Jesse, I owe you beer )) I need to sleep ) | 18:24 |
| evrardjp | haha | 18:25 |
| evrardjp | yes I guess it must be late for you! | 18:25 |
| *** crushil has joined #openstack-ansible | 18:25 | |
| odyssey4me | vnogin good luck! | 18:26 |
| vnogin | evrardjp: yep) | 18:27 |
| vnogin | odyssey4me: tnx | 18:27 |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova stable/ocata: Change /etc/default/libvirt-bin to libvirtd https://review.openstack.org/440671 | 18:29 |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova stable/ocata: Adjust ordering for nova_db_setup https://review.openstack.org/440679 | 18:29 |
| *** The_Intern has quit IRC | 18:32 | |
| *** lucasxu has joined #openstack-ansible | 18:32 | |
| *** The_Intern has joined #openstack-ansible | 18:32 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_octavia master: Octavia role hacking https://review.openstack.org/417210 | 18:34 |
| *** TxGirlGeek has quit IRC | 18:35 | |
| *** TxGirlGeek has joined #openstack-ansible | 18:36 | |
| *** The_Intern has quit IRC | 18:37 | |
| *** chhavi has quit IRC | 18:41 | |
| *** The_Intern has joined #openstack-ansible | 18:41 | |
| *** Andrew_jedi has quit IRC | 18:42 | |
| *** weezS has joined #openstack-ansible | 18:43 | |
| *** schwicht has quit IRC | 18:43 | |
| xgerman | does this ring a bell? | 18:46 |
| xgerman | https://www.irccloud.com/pastebin/anuf2Iwe/ | 18:46 |
| xgerman | stevelle, mhayden? | 18:47 |
| logan- | xgerman: can you provide the contents of /var/log/keystone/keystone.log from that container | 18:48 |
| logan- | xgerman: you may be hitting https://bugs.launchpad.net/openstack-ansible/+bug/1667960 | 18:49 |
| openstack | Launchpad bug 1667960 in openstack-ansible "Rebuilding keystone[0] container breaks credential keys" [Critical,Confirmed] | 18:49 |
| xgerman | yep, likely | 18:50 |
| xgerman | https://www.irccloud.com/pastebin/jf8s1SNQ/ | 18:50 |
| xgerman | here is the stacktrace | 18:50 |
| logan- | looks like some other issue | 18:51 |
| xgerman | mmh, this is a fresh AIO install | 18:52 |
| logan- | which branch? master? | 18:52 |
| xgerman | of course master | 18:52 |
| *** crushil has quit IRC | 18:53 | |
| *** admin0 has joined #openstack-ansible | 18:53 | |
| *** crushil has joined #openstack-ansible | 18:53 | |
| *** sdake_ has joined #openstack-ansible | 18:54 | |
| logan- | do you have the ansible playbook run log of os-keystone-install | 18:54 |
| *** sdake has quit IRC | 18:55 | |
| xgerman | where would I find those | 18:55 |
| xgerman | ? | 18:55 |
| logan- | your console, the tasks taht were run before it failed | 18:56 |
| xgerman | ok | 18:56 |
| logan- | did you run the playbooks multiple times? or is this the first run? | 18:57 |
| xgerman | 1st run | 18:57 |
| logan- | odd that credential_migrate is even being run | 18:59 |
| logan- | it should be skipped for greenfield | 18:59 |
| xgerman | yeah https://usercontent.irccloud-cdn.com/file/KFCST6B1/log.txt | 19:00 |
| xgerman | ^^ here is the output | 19:01 |
| *** DanyC has quit IRC | 19:02 | |
| logan- | looks like something to do with https://github.com/openstack/openstack-ansible-os_keystone/commit/d2e00019b49e6a07adb89b84536921a06c19ff0e jmccrory | 19:02 |
| logan- | "Check current state of Keystone DB" failed the playbook | 19:02 |
| jmccrory | oh, if that's a fresh install you'll need to make sure the keystone_git_branch is at least at 99db3c83e09b8c1df25ec06fe99530aa088c325f | 19:04 |
| jmccrory | https://review.openstack.org/#/c/432376/ | 19:04 |
| jmccrory | the check command wasn't working for new installs until that patch | 19:05 |
| *** manheim_ has joined #openstack-ansible | 19:05 | |
| logan- | cool thx | 19:05 |
| jamesden_ | andymccr were you able to replicate that DB table perms issue? | 19:05 |
| hamzy | andymccr, what is the process to import a new role https://github.com/hamzy/os_molteniron.git into the openstack namespace? | 19:06 |
| *** vnogin has quit IRC | 19:06 | |
| *** adrian_otto has quit IRC | 19:07 | |
| *** thorst has quit IRC | 19:09 | |
| *** manheim_ has quit IRC | 19:09 | |
| *** thorst has joined #openstack-ansible | 19:10 | |
| jmccrory | keystone_git_install_branch * ^ | 19:10 |
| agrebennikov_ | evrardjp may I have your attention please? | 19:10 |
| *** vnogin has joined #openstack-ansible | 19:10 | |
| evrardjp | hum yes? | 19:14 |
| evrardjp | sorry if I did something wrong. | 19:14 |
| evrardjp | :D | 19:14 |
| *** thorst has quit IRC | 19:14 | |
| *** adrian_otto has joined #openstack-ansible | 19:15 | |
| agrebennikov_ | evrardjp it is about galera_client_ssl thing | 19:16 |
| agrebennikov_ | can you take a look real quick? | 19:16 |
| evrardjp | sure | 19:17 |
| evrardjp | ok | 19:18 |
| evrardjp | I remember | 19:18 |
| evrardjp | so my point was | 19:18 |
| evrardjp | if we are using the default, no need to override it in group_vars | 19:18 |
| evrardjp | when we are ready to override this var, let's do it | 19:18 |
| *** lucasxu has quit IRC | 19:18 | |
| *** lucasxu has joined #openstack-ansible | 19:19 | |
| evrardjp | so I don't complain about the introduction of galera_client_use_ssl, etc. | 19:19 |
| evrardjp | I just think it would be great to set it to True :) | 19:19 |
| evrardjp | but as long as it's not ready I don't see the point | 19:19 |
| openstackgerrit | Merged openstack/openstack-ansible-os_horizon stable/ocata: Use horizon_ssl_protocol variable https://review.openstack.org/439885 | 19:19 |
| odyssey4me | evrardjp better to do the same as we do for rabbitmq | 19:20 |
| evrardjp | yes | 19:20 |
| evrardjp | agreed odyssey4me | 19:20 |
| evrardjp | move to true :) | 19:20 |
| evrardjp | in the openstack-ansible | 19:20 |
| evrardjp | when ready | 19:20 |
| odyssey4me | we should not use ssl for role tests, and that should be the default - but we set it to true in group_vars so that the integrated build uses it | 19:20 |
| evrardjp | yes | 19:20 |
| evrardjp | precisely! | 19:20 |
| odyssey4me | this way we test both code paths | 19:20 |
| odyssey4me | everything must merge into the galera_client and galera_server roles, and any other roles which require changes... then we implement it in the integrated gate | 19:21 |
| evrardjp | agrebennikov_: so keep the patch under your hand somewhere, cause you're gonna need it soon :) | 19:21 |
| *** adrian_otto has quit IRC | 19:23 | |
| *** sdake_ has quit IRC | 19:24 | |
| *** adrian_otto has joined #openstack-ansible | 19:25 | |
| agrebennikov_ | not sure I'm following :/ | 19:25 |
| agrebennikov_ | do I keep the naming? | 19:26 |
| agrebennikov_ | of the vars | 19:26 |
| evrardjp | there is no problem with the naming | 19:26 |
| evrardjp | the commit shouldn't exist right now | 19:26 |
| agrebennikov_ | why? | 19:26 |
| odyssey4me | agrebennikov_ as an example, using rabbitmq | 19:26 |
| evrardjp | because by default we are using (in the galera_client and server role) the same value as what you re defining in group_vars | 19:26 |
| odyssey4me | we, in every role, set use_ssl for rabbitmq to false by default: https://github.com/openstack/openstack-ansible-os_keystone/blob/master/defaults/main.yml#L119 | 19:27 |
| evrardjp | so we are carrying code that doesn't do anything, which is source of confusions | 19:27 |
| agrebennikov_ | I mean, I just don't want to duplicate the var in the roles.... or you mean I HAVE to? | 19:27 |
| odyssey4me | then in group_vars for the integrated build we set it to true: https://github.com/openstack/openstack-ansible/blob/master/playbooks/inventory/group_vars/all.yml#L288 | 19:27 |
| *** schwicht has joined #openstack-ansible | 19:27 | |
| odyssey4me | agrebennikov_ yes, every role must have a default that does not rely on external input | 19:28 |
| odyssey4me | that ensures that it can run independently | 19:28 |
| agrebennikov_ | I see... that was confusing :) | 19:28 |
| agrebennikov_ | so each value in the group vars should Necessarily be mentioned in the role's defaults as well | 19:29 |
| odyssey4me | so each role should have a namespaced var, for example: keystone_galera_use_ssl | 19:29 |
| odyssey4me | but it should be defaulted in the role to false | 19:29 |
| agrebennikov_ | which means it will not be jsut one unified var..... | 19:30 |
| odyssey4me | then in group_vars, have a galera_use_ssl var set to true, which is used to set keystone_galera_use_ssl: "{{ galera_use_ssl }}" | 19:30 |
| agrebennikov_ | instead you want me to create 15 vars XYZ_galera_use_ssl? | 19:30 |
| odyssey4me | that way there is an easy key var, but each service can also be set independently | 19:30 |
| odyssey4me | yes | 19:30 |
| *** electrofelix has quit IRC | 19:31 | |
| odyssey4me | it's a pain, but that's how best to do it | 19:31 |
| odyssey4me | it ensures that there is individual service control using namespaced vars | 19:31 |
| agrebennikov_ | and then keystone role will have its own keystone_galera_use_ssl in the defaults, set to false? | 19:31 |
| odyssey4me | yes | 19:32 |
| odyssey4me | in the role tests it will not use ssl, but in the integrated build it will use ssl - that way both code paths are tested and deployers have the choice | 19:32 |
| agrebennikov_ | well.... as you wish :) | 19:33 |
| odyssey4me | it's important also because in some cases we may find that something doesn't work properly, for example swift doesn't support RPC over SSL so we had to hard set https://github.com/openstack/openstack-ansible/blob/master/playbooks/inventory/group_vars/swift_all.yml#L24 | 19:33 |
| agrebennikov_ | let me make a quick change then | 19:33 |
| *** admin0 has quit IRC | 19:33 | |
| agrebennikov_ | but do I have to then do barbican_use_ssl, magnum_use_ssl, trove_use_ssl? | 19:33 |
| agrebennikov_ | and stuff like that | 19:33 |
| odyssey4me | barbican_galera_use_ssl, etc yes | 19:34 |
| odyssey4me | each role's var is namespaced | 19:34 |
| agrebennikov_ | or I only add those vars which I'm in fact going to change right now? | 19:34 |
| agrebennikov_ | no, I'm telling about smtng else | 19:34 |
| agrebennikov_ | in openstack-ansible group_vars | 19:34 |
| agrebennikov_ | in my commit | 19:34 |
| odyssey4me | better to implement the vars in all the roles first, before going for the integrated build set | 19:35 |
| agrebennikov_ | do I have to only mention 6 components or 26 components which will potentially use ssl | 19:35 |
| agrebennikov_ | ok, yeah, it makes sense | 19:35 |
| agrebennikov_ | I just thought about having one var in the head first | 19:35 |
| odyssey4me | otherwise things break badly, and all development is stalled | 19:35 |
| agrebennikov_ | totally agree, my bad | 19:35 |
| agrebennikov_ | ok, let me submit all roles for now | 19:36 |
| agrebennikov_ | description of the feature in the role required? | 19:36 |
| agrebennikov_ | each role | 19:36 |
| odyssey4me | the defaults are exposed as documentation, so a comment wiht the var is good | 19:37 |
| agrebennikov_ | gotcha | 19:37 |
| agrebennikov_ | tnx! | 19:37 |
| odyssey4me | I would recommend just doing one role first, establishing the pattern, then doing the rest once the first is merged | 19:37 |
| *** MasterOfBugs has joined #openstack-ansible | 19:37 | |
| agrebennikov_ | it's actually over there already.. ust need to add the var https://review.openstack.org/#/c/438095/ | 19:38 |
| *** The_Intern has quit IRC | 19:38 | |
| agrebennikov_ | but then | 19:39 |
| palendae | Should we add a confirm step to removing hosts/groups? :) | 19:39 |
| agrebennikov_ | what to do with the actual path to the CA cert? | 19:39 |
| palendae | Let’s be sure as we encounter problems, we invest the effort to make the fix effective, complete and long lasting | 19:39 |
| palendae | Oops, meant https://aws.amazon.com/message/41926/ | 19:39 |
| openstackgerrit | Merged openstack/openstack-ansible-galera_server stable/ocata: Fix fact set using ternary filter https://review.openstack.org/439150 | 19:40 |
| *** The_Intern has joined #openstack-ansible | 19:41 | |
| odyssey4me | agrebennikov_ what do you mean? | 19:44 |
| *** adrian_otto has quit IRC | 19:45 | |
| odyssey4me | agrebennikov_ https://docs.openstack.org/security-guide/databases/database-transport-security.html is not very helpful | 19:46 |
| odyssey4me | agrebennikov_ this is apparently a start: http://stackoverflow.com/questions/8014781/how-to-make-mysql-connection-that-requires-ca-cert-with-sqlalchemy-or-sqlobject | 19:48 |
| *** Rodrigo_BR has quit IRC | 19:51 | |
| odyssey4me | agrebennikov_ what you can try - not sure if these work any more, but you can add ssl_ca_file, ssl_cert_file and ssl_key_file to the conf file of any service | 19:51 |
| odyssey4me | I think it goes under the [ssl] or [DEFAULT] section, not sure | 19:52 |
| odyssey4me | oh, hang on - I see you're passing it into the connection string | 19:53 |
| odyssey4me | then I really don't understand what your question is :) | 19:54 |
| *** cloudtrainme has joined #openstack-ansible | 20:01 | |
| *** jamielennox|away is now known as jamielennox | 20:02 | |
| DimGR | TASK [lxc_container_create : Wait for ssh to be available] does this mean there is a problem with the bridges ? This part of the role just now started giving errors about not being able to ssh into the containers | 20:05 |
| nea1 | evrardjp: SamYaple I just noticed that when I use ssh to connect to the container the HOSTNAME is not set in `env` and `echo $HOSTNAME` returns the correct hostname - seams like this comes somewhere from lxc-attach | 20:05 |
| agrebennikov_ | odyssey4me, sorry, I was away for a bit... I was asking about the war only :) in general everything is ready | 20:07 |
| agrebennikov_ | the var of the path for the mysql CA cert | 20:07 |
| agrebennikov_ | you can take a look at the patch, it is pretty simple (if you have a minute) | 20:07 |
| odyssey4me | agrebennikov_ any vars in a role should be namespaced ideally, although exceptions can be made | 20:08 |
| odyssey4me | I would say that the user-provided var can be consistent across roles though - that makes sense | 20:09 |
| odyssey4me | not sure - push a patch up and let's see | 20:09 |
| odyssey4me | (sorry - busy in something else right now) | 20:09 |
| agrebennikov_ | absolutely | 20:09 |
| openstackgerrit | Tom Jose Kalapura proposed openstack/openstack-ansible-haproxy_server master: Define haproxy_ssl_protocol variable. https://review.openstack.org/439912 | 20:10 |
| *** DanyC has joined #openstack-ansible | 20:12 | |
| *** askb has joined #openstack-ansible | 20:14 | |
| mrda | Morning OSA | 20:18 |
| palendae | Morning mrda | 20:19 |
| mrda | o/ | 20:19 |
| nea1 | evrardjp: SamYaple and the content of ansible_env gets set by the gather_facts (which has the HOSTNAME= set) and overwriting the HOSTNAME in /etc/openstack_deploy/ansible_facts/ doesn't help | 20:24 |
| nea1 | or better saied the ansible_env is the env of the host | 20:24 |
| *** vnogin has quit IRC | 20:25 | |
| *** vnogin has joined #openstack-ansible | 20:25 | |
| *** chris_hultin is now known as chris_hultin|AWA | 20:28 | |
| openstackgerrit | Andrey Grebennikov proposed openstack/openstack-ansible-os_nova master: Added MySQL connection SSL support https://review.openstack.org/438095 | 20:29 |
| agrebennikov_ | odyssey4me, that one | 20:31 |
| openstackgerrit | Tom Jose Kalapura proposed openstack/openstack-ansible-haproxy_server master: Define haproxy_ssl_protocol variable. https://review.openstack.org/439912 | 20:33 |
| *** TxGirlGeek has quit IRC | 20:33 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_gnocchi master: Cap the number of worker processes https://review.openstack.org/440549 | 20:35 |
| *** h5t4 has quit IRC | 20:35 | |
| *** thorst has joined #openstack-ansible | 20:35 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_build master: Add non *.whl files to MANIFEST.in https://review.openstack.org/439659 | 20:36 |
| *** cloudtrainme has quit IRC | 20:36 | |
| *** vnogin has quit IRC | 20:37 | |
| openstackgerrit | Miguel Alex Cantu (alextricity25) proposed openstack/openstack-ansible master: [WIP] Remove Ceilometer API Service https://review.openstack.org/438740 | 20:39 |
| *** DFFlanders has joined #openstack-ansible | 20:47 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_ironic master: Cap the number of worker processes https://review.openstack.org/440706 | 20:49 |
| *** Andrew_jedi has joined #openstack-ansible | 20:50 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_aodh master: Cap the number of worker processes https://review.openstack.org/440530 | 20:50 |
| *** crushil has quit IRC | 20:56 | |
| *** crushil has joined #openstack-ansible | 20:57 | |
| openstackgerrit | Merged openstack/openstack-ansible-pip_install stable/ocata: Use block-rescue for pip install https://review.openstack.org/440589 | 21:02 |
| *** vnogin has joined #openstack-ansible | 21:06 | |
| *** smatzek_ has quit IRC | 21:10 | |
| hwoarang | logan-: hello! do you mind if i ping you about this? https://github.com/Logan2211/ansible-etcd/pull/8 :) TIA | 21:12 |
| openstackgerrit | Merged openstack/openstack-ansible-pip_install stable/newton: Use block-rescue for pip install https://review.openstack.org/440595 | 21:16 |
| *** Andrew_jedi has quit IRC | 21:17 | |
| *** TxGirlGeek has joined #openstack-ansible | 21:18 | |
| mgariepy | hwoarang, we can chat tomorrow if you want i was kinda stuck in a meeting today | 21:18 |
| mgariepy | hwoarang, I should be back at 8 or 9 am eastern tomorrow | 21:19 |
| *** kjw3 has joined #openstack-ansible | 21:19 | |
| *** adrian_otto has joined #openstack-ansible | 21:20 | |
| openstackgerrit | Merged openstack/openstack-ansible-tests stable/ocata: Set the Nova wsgi processes and threads https://review.openstack.org/440564 | 21:22 |
| hwoarang | mgariepy: sure no problem | 21:24 |
| *** The_Intern has quit IRC | 21:30 | |
| *** The_Intern has joined #openstack-ansible | 21:30 | |
| *** TxGirlGeek has quit IRC | 21:32 | |
| *** The_Intern has quit IRC | 21:35 | |
| openstackgerrit | Tom Jose Kalapura proposed openstack/openstack-ansible-haproxy_server master: Define haproxy_ssl_bind_options variable. https://review.openstack.org/439912 | 21:36 |
| *** The_Intern has joined #openstack-ansible | 21:37 | |
| *** karimb has quit IRC | 21:37 | |
| *** karimb has joined #openstack-ansible | 21:38 | |
| openstackgerrit | Andrey Grebennikov proposed openstack/openstack-ansible-os_nova master: Added MySQL connection SSL support https://review.openstack.org/438095 | 21:40 |
| *** jrobinson has joined #openstack-ansible | 21:43 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_build master: Add non *.whl files to MANIFEST.in https://review.openstack.org/439659 | 21:44 |
| *** chris_hultin|AWA is now known as chris_hultin | 21:45 | |
| *** chris_hultin is now known as chris_hultin|AWA | 21:49 | |
| *** Jack_Iv has quit IRC | 21:50 | |
| *** Jack_Iv has joined #openstack-ansible | 21:51 | |
| *** whiteveil has quit IRC | 21:51 | |
| *** The_Intern has quit IRC | 21:52 | |
| *** cjloader_ has joined #openstack-ansible | 21:53 | |
| *** The_Intern has joined #openstack-ansible | 21:54 | |
| *** xar- has quit IRC | 21:55 | |
| *** Jack_Iv has quit IRC | 21:55 | |
| *** DanyC has quit IRC | 21:57 | |
| *** cjloader has quit IRC | 21:57 | |
| *** cjloader_ has quit IRC | 21:58 | |
| *** fguillot has quit IRC | 22:05 | |
| *** thorst has quit IRC | 22:08 | |
| *** xar- has joined #openstack-ansible | 22:09 | |
| dolphm | what does ssl termination for keystone? | 22:10 |
| dolphm | i'm assuming the answer is "it depends", but i only see apache config for it | 22:12 |
| *** The_Intern has quit IRC | 22:13 | |
| *** The_Intern has joined #openstack-ansible | 22:13 | |
| *** jamesden_ has quit IRC | 22:15 | |
| *** manheim_ has joined #openstack-ansible | 22:15 | |
| *** crushil has quit IRC | 22:17 | |
| *** TxGirlGeek has joined #openstack-ansible | 22:17 | |
| *** The_Intern has quit IRC | 22:18 | |
| andymccr | dolphm: it'd be apache (but haproxy can do it too) | 22:19 |
| jmccrory | dolphm : think the options for OSA right now are physical lb, haproxy, or apache/nginx | 22:19 |
| *** manheim_ has quit IRC | 22:20 | |
| andymccr | dolphm: ideally with the new community goal all services are on nginx/apache so we set it up that way :) | 22:20 |
| *** The_Intern has joined #openstack-ansible | 22:20 | |
| *** stelouie_ has quit IRC | 22:23 | |
| openstackgerrit | Andrey Grebennikov proposed openstack/openstack-ansible-os_nova master: Added MySQL connection SSL support https://review.openstack.org/438095 | 22:24 |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova stable/ocata: Split upgrade testing into it's own shell script https://review.openstack.org/438002 | 22:26 |
| *** schwicht has quit IRC | 22:27 | |
| *** jmckind_ has quit IRC | 22:31 | |
| *** ngupta_ has joined #openstack-ansible | 22:32 | |
| openstackgerrit | German Eichberger proposed openstack/openstack-ansible-os_neutron master: Adds Octavia to Neutron https://review.openstack.org/428979 | 22:32 |
| *** gouthamr has quit IRC | 22:33 | |
| openstackgerrit | German Eichberger proposed openstack/openstack-ansible master: Additions to install OpenStack Octavia https://review.openstack.org/422062 | 22:33 |
| *** ngupta has quit IRC | 22:34 | |
| *** ngupta_ has quit IRC | 22:36 | |
| *** thorst has joined #openstack-ansible | 22:36 | |
| *** thorst has quit IRC | 22:41 | |
| *** rmelero has joined #openstack-ansible | 22:45 | |
| openstackgerrit | Merged openstack/openstack-ansible master: Added a common tag to the common tasks https://review.openstack.org/440665 | 22:47 |
| *** kstev has quit IRC | 22:52 | |
| *** gouthamr has joined #openstack-ansible | 22:57 | |
| *** schwicht has joined #openstack-ansible | 23:01 | |
| *** admin0 has joined #openstack-ansible | 23:08 | |
| *** sdake has joined #openstack-ansible | 23:09 | |
| *** adrian_otto has quit IRC | 23:16 | |
| *** thorst has joined #openstack-ansible | 23:17 | |
| *** sdake has quit IRC | 23:18 | |
| *** sdake has joined #openstack-ansible | 23:19 | |
| *** thorst has quit IRC | 23:19 | |
| *** GustavoChalco has joined #openstack-ansible | 23:20 | |
| *** hw_wutianwei1 has joined #openstack-ansible | 23:21 | |
| *** mmalik4_ has quit IRC | 23:21 | |
| *** lucasxu has quit IRC | 23:22 | |
| GustavoChalco | Hello, I been facing a problem when trying to run openstack-ansible setup-infrastructure.yml --syntax-check | 23:22 |
| *** ngupta has joined #openstack-ansible | 23:23 | |
| GustavoChalco | I'm getting the following result : ERROR! Attempted to execute "/opt/openstack-ansible/playbooks/inventory/dynamic_inventory.py" as inventory script: Inventory script (/opt/openstack-ansible/playbooks/inventory/dynamic_inventory.py) had an execution error: global_overrides can't be found in user config | 23:23 |
| *** hw_wutianwei has quit IRC | 23:23 | |
| *** hw_wutianwei1 is now known as hw_wutianwei | 23:23 | |
| *** The_Intern has quit IRC | 23:24 | |
| *** acormier has quit IRC | 23:25 | |
| openstackgerrit | Andrey Grebennikov proposed openstack/openstack-ansible-os_nova master: Added MySQL connection SSL support https://review.openstack.org/438095 | 23:29 |
| *** schwicht has quit IRC | 23:31 | |
| *** adrian_otto has joined #openstack-ansible | 23:31 | |
| *** marst has quit IRC | 23:31 | |
| *** MasterOfBugs has quit IRC | 23:32 | |
| *** MasterOfBugs has joined #openstack-ansible | 23:33 | |
| *** jamielennox is now known as jamielennox|away | 23:37 | |
| *** klamath has quit IRC | 23:37 | |
| jmccrory | GustavoChalco is your /etc/openstack_deploy/openstack_user_config.yml missing a global_overrides section? https://docs.openstack.org/project-deploy-guide/openstack-ansible/newton/app-config-prod.html#production-environment-config | 23:38 |
| *** MasterOfBugs has quit IRC | 23:38 | |
| *** sdake has quit IRC | 23:40 | |
| *** sdake_ has joined #openstack-ansible | 23:40 | |
| *** TxGirlGeek has quit IRC | 23:41 | |
| *** galstrom is now known as galstrom_zzz | 23:41 | |
| GustavoChalco | jmccrory I been following these guide https://docs.openstack.org/project-deploy-guide/openstack-ansible/ocata/run-playbooks.html | 23:42 |
| *** marst has joined #openstack-ansible | 23:42 | |
| *** jmckind has joined #openstack-ansible | 23:47 | |
| *** jmckind has quit IRC | 23:47 | |
| *** dimtheo_ has joined #openstack-ansible | 23:50 | |
| *** DimGR has quit IRC | 23:51 | |
| *** jmckind has joined #openstack-ansible | 23:52 | |
| *** admin0 has quit IRC | 23:52 | |
| *** Jack_Iv has joined #openstack-ansible | 23:52 | |
| *** admin0 has joined #openstack-ansible | 23:53 | |
| *** sdake_ has quit IRC | 23:53 | |
| *** admin0 has quit IRC | 23:56 | |
| vnogin | guys, all containers failed with the following error http://paste.openstack.org/show/601202/ does anyone know what's wrong? :) | 23:57 |
| *** Jack_Iv has quit IRC | 23:57 | |
| *** dimtheo_ has quit IRC | 23:58 | |
| *** karimb has quit IRC | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!