*** evrardjp[m] has quit IRC | 00:05 | |
*** csmart has quit IRC | 00:05 | |
*** csmart has joined #openstack-ansible | 00:12 | |
*** bgmccollum has quit IRC | 00:13 | |
*** idlemind has quit IRC | 00:14 | |
*** idlemind has joined #openstack-ansible | 00:15 | |
*** shan5464_ has quit IRC | 00:19 | |
*** shananigans has joined #openstack-ansible | 00:19 | |
*** bgmccollum has joined #openstack-ansible | 00:20 | |
*** masber has joined #openstack-ansible | 00:21 | |
masber | good morning, I am getting this error message during openstack deployment "Both host:compute1 and host:storage1 have address:192.168.20.24 assigned. Cannot assign same ip to both hosts" is there any workaround for this so I can have storage and compute on same node? | 00:22 |
---|---|---|
masber | right now I am playing with openstack-ansible and I only have 2 nodes, one for management and the other for compute | 00:22 |
*** yifei has quit IRC | 00:28 | |
*** yifei has joined #openstack-ansible | 00:29 | |
*** masber has quit IRC | 00:29 | |
*** evrardjp[m] has joined #openstack-ansible | 00:34 | |
*** dave-mccowan has joined #openstack-ansible | 01:07 | |
*** masber has joined #openstack-ansible | 01:10 | |
masber | good morning, I am following this example to deploy my first openstack using openstack-ansible https://docs.openstack.org/project-deploy-guide/openstack-ansible/pike/app-config-test.html#test-environment-config | 01:12 |
masber | my question is will this config file deploy openstack on containers? if so, how can I avoid this? I just want the services to be installed int he hosts | 01:12 |
*** pmannidi has joined #openstack-ansible | 01:15 | |
*** tone_zrt has joined #openstack-ansible | 01:19 | |
masber | good morning, another question. I am getting this error http://paste.openstack.org/raw/640652/ after chaning "infra1" to "controller" in my /etc/openstack_deploy/openstack_user_config.yml file | 01:23 |
*** phalmos__ has quit IRC | 01:37 | |
*** yifei has quit IRC | 01:57 | |
*** yifei has joined #openstack-ansible | 01:57 | |
*** jafeha__ has joined #openstack-ansible | 02:13 | |
*** jafeha has quit IRC | 02:16 | |
*** dave-mccowan has quit IRC | 03:09 | |
*** bhujay has joined #openstack-ansible | 03:42 | |
*** chhavi has joined #openstack-ansible | 04:08 | |
bhujay | Gokhan27: Hi Gokhan , installation went through well , I can see cloudkitty service in openstack. However , horizon integration has not happened. I have included the pip pkgs in the var/main.yml under horizon role , also the dashboard portion in post_installation but running runninng horios_horizon plabook fails with msg": "'horizon_venv_lib_dir' is undefined" | 04:14 |
bhujay | Gokhan27: also, durng repor build I I din't see any thing related to cloudkitty dash board is getting downlaoded | 04:15 |
*** chhavi has quit IRC | 04:39 | |
*** udesale has joined #openstack-ansible | 04:54 | |
masber | good afternoon, I am trying to install openstack using OSA and the appendix A configuration test file https://docs.openstack.org/project-deploy-guide/openstack-ansible/pike/app-config-test.html | 05:02 |
masber | my problem is that I only have 2 hosts (a vm as a controller and physical machine for computing/storage) | 05:03 |
masber | OSA does not allow me to put cinder backend and compute on same node. What options do I have? | 05:03 |
*** armaan has joined #openstack-ansible | 05:26 | |
*** hybridpollo has quit IRC | 05:54 | |
*** savvas` has joined #openstack-ansible | 05:55 | |
bhujay | masber: you may create a nfs share , that should work | 06:00 |
masber | bhujay, I think I got around it but now it fails when running setup-hosts.yml playbook https://bpaste.net/show/487870e844f5 | 06:01 |
bhujay | masber:it failed to start container , setup-hosts has four playbooks , the error shows it has failed at container creation stage . | 06:08 |
masber | the problem is that I am not familiar with lxc | 06:09 |
masber | in docker I would do docker log | 06:09 |
bhujay | the four playbooks are include: openstack-hosts-setup.yml | 06:10 |
bhujay | - include: security-hardening.yml | 06:10 |
bhujay | - include: lxc-hosts-setup.yml | 06:10 |
bhujay | - include: lxc-containers-create.yml | 06:10 |
bhujay | can u run the third playbook , lxc-hosts-setup and see everthing is ok | 06:11 |
bhujay | Run the play books with -vv options to capture more details . after this from controller host check using lxc-ls to list if the containers are present . Then you can drop the containers using openstack-ansible lxc-container-destroy and rerun lxc-containers-create.yml . | 06:14 |
masber | thank you, doing it now | 06:16 |
masber | another question, do I need to assigned the external_lb_vip_address and internal_lb_vip_address IPs to the nic? before installation? | 06:18 |
*** pmannidi_ has joined #openstack-ansible | 06:28 | |
*** savvas` has quit IRC | 06:29 | |
*** pmannidi has quit IRC | 06:30 | |
*** savvas` has joined #openstack-ansible | 06:30 | |
*** chhavi has joined #openstack-ansible | 06:33 | |
bhujay | Gokhan27: Trying with horizon_lib_dir instead of horizon_venv_lib_dir | 06:34 |
*** udesale__ has joined #openstack-ansible | 06:45 | |
*** nshetty has joined #openstack-ansible | 06:46 | |
*** savvas` has quit IRC | 06:47 | |
*** jbadiapa has joined #openstack-ansible | 06:47 | |
*** udesale has quit IRC | 06:48 | |
*** savvas` has joined #openstack-ansible | 06:49 | |
masber | bhujay, https://bpaste.net/show/89ef6992d374 | 06:50 |
masber | lxc-ls command on controller node shows nothing | 06:50 |
masber | sorry my bad, I have to run as root https://bpaste.net/show/69670362e3ff | 06:51 |
*** udesale has joined #openstack-ansible | 06:52 | |
*** savvas` has quit IRC | 06:54 | |
*** udesale__ has quit IRC | 06:54 | |
*** sm806 has joined #openstack-ansible | 06:56 | |
sm806 | Need a help with "openstack-ansible setup-infrastructure.yml" command. | 06:57 |
sm806 | When i execute this command, "infra1_repo_container-xxxxx" is failing | 06:57 |
sm806 | in the failure logs i see "No matching distribution found for pyasn1>=0.3.7 (from python-ldap)" | 06:57 |
sm806 | I tried attaching to repo-container and executed the same command that ansible to trying to execute: "/opt/venv-build-script.sh /var/www/repo/os-releases/16.0.1/ubuntu-16.04-x86_64/venv-build-options-os_keystone.txt" | 06:58 |
*** savvas` has joined #openstack-ansible | 06:58 | |
sm806 | Building venv keystone-16.0.1-x86_64... Could not find a version that satisfies the requirement pyasn1>=0.3.7 (from python-ldap) (from versions: 0.3.1) No matching distribution found for pyasn1>=0.3.7 (from python-ldap) | 06:58 |
sm806 | Any pointers on what could be the issue !!?? | 06:59 |
*** savvas` has quit IRC | 07:03 | |
*** pcaruana has joined #openstack-ansible | 07:04 | |
*** savvas` has joined #openstack-ansible | 07:07 | |
speedmann | sn806 I've seen this issue with newton release too... I guess I fixed it it with some override. if this would work for you, I can have a look | 07:11 |
*** savvas` has quit IRC | 07:12 | |
*** chigang_ has quit IRC | 07:13 | |
sm806 | Apparently looks like its bug as mentioned in "https://review.openstack.org/#/c/525299/" | 07:13 |
*** chigang_ has joined #openstack-ansible | 07:13 | |
*** brad[] has quit IRC | 07:15 | |
sm806 | I am apply this patch manually and trying it out. | 07:15 |
*** exodusftw has quit IRC | 07:15 | |
*** exodusftw has joined #openstack-ansible | 07:18 | |
*** jvidal has joined #openstack-ansible | 07:19 | |
*** savvas` has joined #openstack-ansible | 07:22 | |
*** cshen has joined #openstack-ansible | 07:27 | |
bhujay | sm806: i had the same problem , solved by locally changing the python-lad to pyldap in keystone role | 07:28 |
*** armaan_ has joined #openstack-ansible | 07:36 | |
*** armaan has quit IRC | 07:37 | |
*** mardim has joined #openstack-ansible | 07:38 | |
sm806 | bhujay: thanks, i am trying out the same. | 07:42 |
*** savvas` has quit IRC | 07:45 | |
*** epalper has joined #openstack-ansible | 07:47 | |
*** pbandark has joined #openstack-ansible | 07:47 | |
*** hamza21 has joined #openstack-ansible | 07:49 | |
*** sm806 has quit IRC | 07:53 | |
*** savvas` has joined #openstack-ansible | 07:55 | |
*** savvas` has quit IRC | 08:00 | |
*** armaan_ has quit IRC | 08:03 | |
*** mbuil has joined #openstack-ansible | 08:03 | |
*** jafeha__ has quit IRC | 08:04 | |
*** pbandark has quit IRC | 08:04 | |
*** pbandark has joined #openstack-ansible | 08:05 | |
evrardjp | good morning | 08:09 |
evrardjp | sm806 please update your code | 08:10 |
evrardjp | bhujay: it shouldn't need a manual update it's already solved in the latest code | 08:10 |
bhujay | evrardjp: Ok will recheck . I tired with stable/pike. | 08:17 |
*** pmannidi_ has quit IRC | 08:17 | |
*** shardy has joined #openstack-ansible | 08:18 | |
bhujay | Gokhan27: I got the rating menu in Horizon now . Created a Hashmap for instance update with flavor as samll , however while instance launching dont see any price information . Any Idea ? | 08:19 |
*** savvas` has joined #openstack-ansible | 08:19 | |
bhujay | gokhan_:I got the rating menu in Horizon now . Created a Hashmap for instance update with flavor as samll , however while instance launching dont see any price information . Any Idea ? | 08:20 |
*** armaan has joined #openstack-ansible | 08:21 | |
bhujay | evrardjp: Sir , Any idea when cloudkitty will be integrated with OSA as main stream feature ? | 08:21 |
*** pradiprwt has joined #openstack-ansible | 08:28 | |
evrardjp | bhujay: when people will work on it, because it's not one of my priorities for this cycle. Currently my priorities are bare metal and nspawn, then docs, adding more scenarios like ovs, translating the docs, offline installs further improvements, ... | 08:29 |
evrardjp | bhujay: it's maybe worth asking the cloudkitty devs | 08:30 |
*** jafeha has joined #openstack-ansible | 08:31 | |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: [DNM] testing virtualenv shell script https://review.openstack.org/531687 | 08:32 |
*** game-on has joined #openstack-ansible | 08:33 | |
evrardjp | bhujay: do you have a timeline for your project? | 08:33 |
evrardjp | because maybe I/we can mentor you to get there, so your project would be a success, and if you contribute your work back, it would be a win-win for both your company and the community | 08:34 |
evrardjp | jafeha: good morning :) | 08:34 |
*** savvas` has quit IRC | 08:35 | |
*** savvas` has joined #openstack-ansible | 08:38 | |
*** savvas` has quit IRC | 08:43 | |
*** savvas` has joined #openstack-ansible | 08:47 | |
jafeha | good morning evrardjp | 08:49 |
jafeha | and good morning to everyone :) | 08:50 |
*** savvas` has quit IRC | 08:51 | |
*** mbuil has quit IRC | 08:51 | |
bhujay | evrardjp: That sounds great. My target is by June this year. Everybody is very skeptical about this initiative since there is no formal commercial support I have taken . Getting some mentoring from you all will certainly speed up the project and boost my team's confidence | 08:52 |
evrardjp | jafeha: I found out Friday what was the root cause of the failure, so i can go further and advance on many topics. | 08:53 |
jafeha | hehe, i saw a lot of commits, what was going on there? | 08:53 |
evrardjp | bhujay: it's being part of the community: We help you, you're glad it happens, you help us, and it continues... Everlasting benefit loop. | 08:54 |
evrardjp | jafeha: https://bugs.launchpad.net/openstack-ansible/+bug/1741634 | 08:54 |
openstack | Launchpad bug 1741634 in openstack-ansible "virtualenv-tools is unreliable for changing path in venvs" [Critical,New] - Assigned to Jean-Philippe Evrard (jean-philippe-evrard) | 08:54 |
evrardjp | jafeha: on every branch on top of that. Fun stuff. | 08:54 |
evrardjp | I am glad we are deploying on containers, which isolates the issue in most of the cases. | 08:55 |
evrardjp | Or when people deploy on clean machines, that's also working. | 08:55 |
jafeha | that looks like fun | 08:55 |
evrardjp | hwoarang: are you there? | 08:55 |
evrardjp | or any cores around? I'd like to discuss the approach for fixing that nasty bug | 08:56 |
ThomasSch | hi | 08:58 |
evrardjp | hey ThomasSch | 08:58 |
*** savvas` has joined #openstack-ansible | 09:02 | |
*** armaan_ has joined #openstack-ansible | 09:06 | |
hwoarang | evrardjp: good morning. give me 10 minutes to get some coffee first before i start talking ;p | 09:06 |
*** savvas` has quit IRC | 09:06 | |
*** armaan has quit IRC | 09:09 | |
*** armaan_ has quit IRC | 09:10 | |
*** armaan has joined #openstack-ansible | 09:10 | |
*** savvas` has joined #openstack-ansible | 09:11 | |
epalper | howarang: good morning. | 09:14 |
epalper | i saw your email regarding the issue "problems with bringing up openstack in AIO flavor with OVS". when I tried with OSA master, i see an issue with "Perform online data migrations" in the cinder play | 09:14 |
epalper | it fails with the error "packet_write_wait: Connection to UNKNOWN port 0: Broken pipe". is there an issue with running OSA master ? | 09:15 |
odyssey4me | o/ | 09:16 |
evrardjp | odyssey4me: hello! | 09:16 |
evrardjp | hwoarang: odyssey4me so, it's about the bug I just mentioned here above | 09:22 |
evrardjp | https://bugs.launchpad.net/openstack-ansible/+bug/1741634 | 09:23 |
openstack | Launchpad bug 1741634 in openstack-ansible "virtualenv-tools is unreliable for changing path in venvs" [Critical,New] - Assigned to Jean-Philippe Evrard (jean-philippe-evrard) | 09:23 |
evrardjp | this way you don't need to scroll | 09:23 |
hwoarang | ok let me read it | 09:24 |
evrardjp | the big part of my concern now, is that the project we use is dead. So I wanted to discuss what we can do | 09:24 |
evrardjp | 1) Vendor in the fix inside our code (I don't really like it, but it's an option) | 09:25 |
evrardjp | 2) Migrate away from it | 09:25 |
evrardjp | Listening if you have other propositions. | 09:25 |
*** shardy has quit IRC | 09:27 | |
*** armaan has quit IRC | 09:28 | |
*** armaan has joined #openstack-ansible | 09:29 | |
*** shardy has joined #openstack-ansible | 09:32 | |
*** savvas` has quit IRC | 09:34 | |
evrardjp | for the migrate away, we can do two ways: two tasks (1 find, and 1 lineinfile looping over find results) which sounds inefficent, or one shell task that potentially breaks idempotency (if we don't do it correctly) but is faster. | 09:34 |
hwoarang | phew | 09:35 |
hwoarang | ok yeah sedding might be better | 09:35 |
evrardjp | yeah that's what I thought too, too many files to sed, and we have to always replace the first line, with an always known value. | 09:37 |
evrardjp | too many files to lineinfile* | 09:37 |
odyssey4me | evrardjp we have a reference of the sed if you like - lemme find it | 09:40 |
ashak | I had a few problems over the weekend, I sorta worked through them so that I could continue. But i'd like to know what i'm doing wrong or whether my understanding is wrong, or wheter I missed something in the docs... | 09:41 |
ashak | My bare metal hosts are running CentOS 7, but I had issues where the infra hosts firewalls were blocking communication between the containers. Adding an allow rule to the INPUT and FORWARD chains solved that. But I couldn't find anything in the docs suggesting that the target hosts needed any firewall related things disabled, only mention of it i the deployment host. | 09:43 |
evrardjp | odyssey4me: hughsaunders gave me one from rpc, apparently we just need to sed the shebang | 09:43 |
evrardjp | but I am all ears | 09:44 |
evrardjp | you both the agree on non vendoring it in, right? | 09:44 |
evrardjp | not* | 09:44 |
*** john51_ has joined #openstack-ansible | 09:44 | |
ashak | After that, I had two repo servers. But my galera container was failing trying to install pip. I eventually realised that one of the repo containers had /var/www/repo/os-releases/16.0.5/centos-7.4-x86_64/ , which was full of stuff. The other only had /var/www/repo/os-releases/16.0.5/ which was empty. I couldn't work out how to populate the second one at all, so to continue I just ended up kicking | 09:44 |
*** savvas` has joined #openstack-ansible | 09:44 | |
ashak | the second one out o fthe load balancer | 09:44 |
*** udesale has quit IRC | 09:45 | |
odyssey4me | evrardjp yep, that's the one I\m thinking of - and can't seem to find | 09:46 |
*** udesale has joined #openstack-ansible | 09:46 | |
*** john51 has quit IRC | 09:46 | |
evrardjp | I have it :) | 09:46 |
*** nshetty is now known as nshetty|afk | 09:47 | |
*** savvas` has quit IRC | 09:49 | |
*** mbuil has joined #openstack-ansible | 09:51 | |
*** savvas` has joined #openstack-ansible | 09:53 | |
*** bootsha has joined #openstack-ansible | 09:56 | |
*** savvas` has quit IRC | 09:58 | |
*** armaan has quit IRC | 09:59 | |
*** Taseer has joined #openstack-ansible | 10:02 | |
*** savvas` has joined #openstack-ansible | 10:02 | |
Taseer | odyssey4me: can you please help get around this error => http://logs.openstack.org/91/522491/22/check/openstack-ansible-functional-ubuntu-xenial/ba5c427/job-output.txt.gz#_2017-12-22_12_25_42_025656 | 10:03 |
*** armaan has joined #openstack-ansible | 10:05 | |
*** tnogisto has quit IRC | 10:06 | |
*** mrch has joined #openstack-ansible | 10:06 | |
*** mrch has quit IRC | 10:06 | |
openstackgerrit | Merged openstack/openstack-ansible-ops master: Stop building a newton venv for LEAP upgrades https://review.openstack.org/531010 | 10:06 |
*** sxc731 has joined #openstack-ansible | 10:07 | |
*** mbuil has quit IRC | 10:09 | |
odyssey4me | Taseer it would appear that the os_congress role has an incorrect constraint: https://github.com/openstack/openstack-ansible-os_congress/blob/master/defaults/main.yml#L42 | 10:10 |
odyssey4me | instead of: - - "git+{{ congress_git_repo }}@{{ congress_git_install_branch }}#egg=congress" | 10:11 |
odyssey4me | it should be: - "git+{{ congress_git_repo }}@{{ congress_git_install_branch }}#egg=congress" | 10:11 |
odyssey4me | hwoarang evrardjp could you peek at https://review.openstack.org/#/c/529377/ when you have a moment? | 10:12 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/pike: Update all SHAs for Pike 2017-12-20 https://review.openstack.org/529424 | 10:15 |
ANKITA | hi is bounding essential for deployment host ? | 10:17 |
*** SmearedBeard has joined #openstack-ansible | 10:19 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/pike: Fix sources-branch-updater https://review.openstack.org/531708 | 10:23 |
*** savvas` has quit IRC | 10:23 | |
-openstackstatus- NOTICE: zuul has been restarted, all queues have been reset. please recheck your patches when appropriate | 10:24 | |
Taseer | odyssey4me: okay, I'll try out your suggestion | 10:26 |
*** savvas` has joined #openstack-ansible | 10:27 | |
openstackgerrit | Taseer Ahmed proposed openstack/openstack-ansible-os_congress master: Introduce os_congress role in gerrit https://review.openstack.org/522491 | 10:28 |
*** nshetty|afk is now known as nshetty | 10:29 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/pike: Fix sources-branch-updater https://review.openstack.org/531708 | 10:29 |
epalper | hwoarang: did you get a chance to look at my previous message ? | 10:30 |
*** stuartgr has joined #openstack-ansible | 10:30 | |
hwoarang | epalper: no i didn't see a highlight | 10:31 |
*** savvas` has quit IRC | 10:31 | |
*** bootsha_ has joined #openstack-ansible | 10:31 | |
epalper | oh! sorry. there was a typo in your name | 10:32 |
hwoarang | odyssey4me: re https://review.openstack.org/#/c/529377/ are we sure python2.7 exists everywhere? | 10:32 |
hwoarang | maybe python2 is safer? | 10:32 |
hwoarang | don't know just saying :) | 10:32 |
*** bootsha has quit IRC | 10:33 | |
epalper | Its regarding the issue "problems with bringing up openstack in AIO flavor with OVS". when I tried with OSA master, i see a problem with "Perform online data migrations" in the cinder play | 10:34 |
epalper | https://github.com/openstack/openstack-ansible/blob/master/playbooks/os-cinder-install.yml#L214 | 10:34 |
odyssey4me | hwoarang on a mac, which is where I typically run updates from, python2.7 exists, but python2 does not | 10:34 |
odyssey4me | on ubuntu, both exist | 10:34 |
hwoarang | ah ok | 10:34 |
*** udesale has quit IRC | 10:34 | |
hwoarang | epalper: i am not aware of any issues with master atm. does a regular linux bring thing work? | 10:34 |
epalper | this task simply hangs and seeing the following in cinder api logs: https://paste.ubuntu.com/26345901/ | 10:34 |
*** udesale has joined #openstack-ansible | 10:35 | |
hwoarang | or does this happen with vanilla/linux-bridge OSA/master too? | 10:35 |
odyssey4me | ANKITA what do you mean by bounding? | 10:35 |
epalper | i haven't tried linux brige, but it works for mini flavor | 10:35 |
epalper | mini flavor for ovs | 10:35 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/ocata: Fix sources-branch-updater https://review.openstack.org/531710 | 10:35 |
*** bootsha_ has quit IRC | 10:36 | |
hwoarang | mini is not the same with AIO | 10:36 |
hwoarang | in terms of configuration | 10:36 |
hwoarang | but you should try without XCI at all | 10:36 |
hwoarang | xci adds a bunch of stuff on top of AIO | 10:36 |
epalper | i was trying to do: openstack-ansible -vvv -i /root/releng-xci/.cache/repos/openstack-ansible/inventory /root/releng-xci/.cache/repos/openstack-ansible/playbooks/setup-openstack.yml | 10:37 |
epalper | but xci does all other pre configuations | 10:38 |
hwoarang | but you throw too many things into the mix | 10:39 |
hwoarang | one thing you need to establish is if it happens with linux bridge | 10:39 |
hwoarang | and you can't compare mini with AIO | 10:40 |
hwoarang | but we should be talking about these things in #opnfv-pharos because nothing so far suggests it's an upstream OSA problem | 10:40 |
epalper | okay | 10:41 |
ANKITA | odyssey4me am i to create bond interfaces in deployment host too? | 10:42 |
epalper | Let me try with linux bridge | 10:42 |
odyssey4me | ANKITA no, the deployment host just needs access to the br-mgmt network, and the internet | 10:47 |
*** jvidal has quit IRC | 10:47 | |
*** bootsha has joined #openstack-ansible | 10:50 | |
openstackgerrit | Taseer Ahmed proposed openstack/openstack-ansible-os_congress master: Introduce os_congress role in gerrit https://review.openstack.org/522491 | 10:53 |
ANKITA | then y am i facing an issue with containers ssh | 10:53 |
*** savvas` has joined #openstack-ansible | 10:54 | |
ANKITA | the services installation fails also pip packages have an error too! | 10:54 |
ANKITA | @odyssey4me | 10:54 |
odyssey4me | ANKITA you'll have to troubleshoot the networking between the deployment host and the container to figure that out - verify whether you can connect to each item in the path | 10:54 |
*** udesale has quit IRC | 10:54 | |
*** mbuil has joined #openstack-ansible | 10:54 | |
odyssey4me | sure, if there are connectivity issues, everything will fail, so that needs to work before you attempt anything else | 10:55 |
*** armaan has quit IRC | 10:55 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_zaqar stable/pike: Fix for lookup and get_url occuring in different places https://review.openstack.org/531715 | 10:55 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_zaqar stable/ocata: Fix for lookup and get_url occuring in different places https://review.openstack.org/531716 | 10:56 |
ANKITA | @odyssey4me how can i ensure good connectivity? | 10:56 |
*** electrofelix has joined #openstack-ansible | 10:56 | |
odyssey4me | ANKITA I'm sorry - I can't afford the time to help you do network troubleshooting. It would be best if you rely on google for that, and ask this community for specifics when it comes to more specific problems or errors based on what you see as evidence. Right now your query is *way* to vague to allow us to provide actionable assistance. | 10:58 |
ANKITA | thanks for help | 10:59 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests stable/pike: Skip ansible-lint test against roles https://review.openstack.org/531717 | 11:00 |
ANKITA | can you suggest the best and stable repo for production deployment? | 11:00 |
odyssey4me | what do you mean by 'best and stable repo' - for what specifically? | 11:01 |
*** armaan has joined #openstack-ansible | 11:02 | |
*** Taseer has quit IRC | 11:08 | |
*** taseer1 has joined #openstack-ansible | 11:08 | |
*** bootsha has quit IRC | 11:09 | |
openstackgerrit | Merged openstack/openstack-ansible-repo_build master: Add librados-dev to distro package list https://review.openstack.org/530570 | 11:11 |
*** savvas` has quit IRC | 11:16 | |
bhujay | Gokhan27: Error in horizon container while creating a cloud kitty rating service mapping https://gist.github.com/anonymous/bfa44ee54afefe929241beeea8f1c5aa | 11:18 |
ashak | I have problems with my glance containers talking to keystone: Unable to establish connection to http://172.29.236.3:35357/v3/auth/tokens: ('Connection aborted.', BadStatusLine(\"''\",))\n", | 11:20 |
ashak | But I can totally connect to that IP and port frmo within the container?! | 11:20 |
ashak | Oh wait.. I think I remember this from playing with openstack before trying out the ansible stuff... By default things ssem to try to talk to keystone using the wrong identity API version, I remember having to force it to use the newer one on centos boxes. | 11:24 |
ashak | how on earth do I do that with osa?! | 11:25 |
*** savvas` has joined #openstack-ansible | 11:27 | |
*** bootsha has joined #openstack-ansible | 11:30 | |
*** savvas` has quit IRC | 11:32 | |
*** tone_zrt has quit IRC | 11:35 | |
*** bootsha has quit IRC | 11:35 | |
*** tone_zrt has joined #openstack-ansible | 11:35 | |
*** savvas` has joined #openstack-ansible | 11:36 | |
*** chhavi has quit IRC | 11:38 | |
*** chhavi has joined #openstack-ansible | 11:39 | |
*** smatzek has joined #openstack-ansible | 11:40 | |
*** smatzek has quit IRC | 11:40 | |
*** savvas` has quit IRC | 11:40 | |
*** smatzek has joined #openstack-ansible | 11:40 | |
*** savvas` has joined #openstack-ansible | 11:45 | |
*** sm806 has joined #openstack-ansible | 11:46 | |
pradiprwt | Hi ivveh, I need some information regarding ceph integration ... I have did it but with some manual steps | 11:48 |
bndzor | worked out of the box for me : | 11:48 |
bndzor | :) | 11:48 |
pradiprwt | ANKITA : you can go without bonding also, it's up to you to keep services up from networking connectivity | 11:50 |
*** nyloc has quit IRC | 11:55 | |
*** Gokhan27 has joined #openstack-ansible | 11:57 | |
*** mrtenio has quit IRC | 12:00 | |
*** savvas` has quit IRC | 12:06 | |
*** savvas` has joined #openstack-ansible | 12:09 | |
*** dave-mccowan has joined #openstack-ansible | 12:09 | |
*** bootsha has joined #openstack-ansible | 12:13 | |
odyssey4me | ashak you don't need to, not unless you've got something else weird going on (old environment, migrated DB from a different installer, etc) - the defaults work, as long as your networking works | 12:14 |
*** Gokhan27 has quit IRC | 12:14 | |
*** savvas` has quit IRC | 12:14 | |
odyssey4me | we've been using the keystone v3 api since kilo, and it works - the only trouble relates to either the LB not working quite right or the networking not being quite right... and those are almost always configuration issues | 12:15 |
*** udesale has joined #openstack-ansible | 12:16 | |
ashak | 'this is brand new, still trying to build it. The networking seems to be fine. From the container I can telnet to the load balancer keystone port and get a connection. With tcpdump on the load balancer I see packets going to and from the keystone container. | 12:17 |
ashak | I'll take a look at the keystone logs after lunch | 12:17 |
*** savvas` has joined #openstack-ansible | 12:18 | |
odyssey4me | ashak what branch/tag is this? | 12:18 |
*** bootsha has quit IRC | 12:19 | |
odyssey4me | ashak but yeah - to figure out what's wrong there we'll need to know more - the branch/tag being used, and perhaps some validation on exactly what queries are happening - also what does haproxy think about the backends... does it think they're up? | 12:20 |
*** bootsha has joined #openstack-ansible | 12:20 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_barbican stable/ocata: Update paste, policy and rootwrap configurations 2018-01-08 https://review.openstack.org/531726 | 12:25 |
*** sxc731 has quit IRC | 12:26 | |
*** savvas` has quit IRC | 12:26 | |
openstackgerrit | Merged openstack/openstack-ansible master: Reorder cinder service installs https://review.openstack.org/528140 | 12:27 |
odyssey4me | if any cores have a bit of time, I've pushed a patch to standardise the tacker role a bit to work properly with the sources-branch-updater: https://review.openstack.org/529159 | 12:31 |
*** sxc731 has joined #openstack-ansible | 12:32 | |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-os_keystone master: Replace virtualenv-tools by a script https://review.openstack.org/531731 | 12:34 |
*** bootsha has quit IRC | 12:34 | |
*** bootsha has joined #openstack-ansible | 12:37 | |
*** bootsha has quit IRC | 12:43 | |
*** bootsha has joined #openstack-ansible | 12:44 | |
*** game-on has quit IRC | 12:46 | |
*** bootsha_ has joined #openstack-ansible | 12:47 | |
*** bootsha_ has quit IRC | 12:47 | |
*** dave-mccowan has quit IRC | 12:47 | |
*** bootsha_ has joined #openstack-ansible | 12:48 | |
*** armaan has quit IRC | 12:48 | |
*** armaan has joined #openstack-ansible | 12:49 | |
*** dave-mccowan has joined #openstack-ansible | 12:49 | |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: Build everything on metal https://review.openstack.org/504224 | 12:49 |
*** armaan has quit IRC | 12:49 | |
*** armaan has joined #openstack-ansible | 12:50 | |
*** bootsha has quit IRC | 12:50 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/ocata: Fix sources-branch-updater https://review.openstack.org/531710 | 12:58 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/ocata: Fix sources-branch-updater https://review.openstack.org/531710 | 13:01 |
*** gokhan_ has quit IRC | 13:03 | |
*** chhavi has quit IRC | 13:08 | |
*** chhavi has joined #openstack-ansible | 13:10 | |
*** bootsha_ has quit IRC | 13:14 | |
ashak | odyssey4me: so this is tag 16.0.5 | 13:15 |
evrardjp | odyssey4me: answered on https://review.openstack.org/#/c/531123/2 | 13:15 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/ocata: Update all SHAs for Ocata 2017-12-21 https://review.openstack.org/529431 | 13:17 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/ocata: Update all SHAs for Ocata 2018-01-08 https://review.openstack.org/529431 | 13:17 |
*** chhavi has quit IRC | 13:22 | |
*** chhavi has joined #openstack-ansible | 13:23 | |
ashak | odyssey4me: haproxy thinks both keystone containers are up | 13:23 |
ashak | for both keystone_service-back and keystone_admin-back | 13:24 |
odyssey4me | ashak so the admin backend is up? | 13:24 |
odyssey4me | ok good | 13:24 |
*** savvas` has joined #openstack-ansible | 13:24 | |
*** pcaruana has quit IRC | 13:25 | |
*** pcaruana has joined #openstack-ansible | 13:25 | |
*** savvas` has quit IRC | 13:27 | |
*** savvas` has joined #openstack-ansible | 13:27 | |
*** ThomasSch_ has joined #openstack-ansible | 13:28 | |
*** bhujay has quit IRC | 13:28 | |
*** ThomasSch has quit IRC | 13:28 | |
*** nshetty has quit IRC | 13:31 | |
*** gkadam has joined #openstack-ansible | 13:33 | |
*** woodard has quit IRC | 13:36 | |
*** woodard has joined #openstack-ansible | 13:36 | |
mgariepy | morning and happy new year everyone ! | 13:36 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/ocata: Fix sources-branch-updater and add docs https://review.openstack.org/531710 | 13:37 |
odyssey4me | evrardjp given that OpenStack tests using the latest pip/setuptools/wheel, we should always be updating them even in the stable branches - we have always done it, except when we've seen breakage caused by issues with them | 13:39 |
odyssey4me | there was a long period of instability, which is why we avoided updates for a few months | 13:39 |
odyssey4me | but given that it's all stable again, we need to continue updating, otherwise we're using different versions to upstream | 13:40 |
*** sxc731 has quit IRC | 13:42 | |
odyssey4me | evrardjp replied in https://review.openstack.org/#/c/529431/2/global-requirement-pins.txt | 13:43 |
*** nshetty has joined #openstack-ansible | 13:46 | |
mhayden | morning | 13:46 |
Bico_Fino | morning. | 13:47 |
mhayden | i hope y'all enjoyed three weeks without me destroying gate jobs ;) | 13:47 |
ashak | odyssey4me: Hrm, if I watch hatop for keystone things. Then telnet from the galnce container to the vip and port for keystone. I see SCUR increase for the keystone_admin-front frontend. But never anything for the backend ones. I must have been too tired to read my tcpdump properly last night | 13:52 |
*** ivveh has quit IRC | 13:52 | |
*** woodard has quit IRC | 14:02 | |
*** esberglu has joined #openstack-ansible | 14:03 | |
*** gameon has joined #openstack-ansible | 14:03 | |
*** sxc731 has joined #openstack-ansible | 14:05 | |
openstackgerrit | Merged openstack/openstack-ansible-os_tacker master: Update paste, policy and rootwrap configurations 2017-12-19 https://review.openstack.org/529159 | 14:07 |
*** gameon has quit IRC | 14:07 | |
*** esberglu has quit IRC | 14:17 | |
*** esberglu has joined #openstack-ansible | 14:17 | |
*** smatzek has quit IRC | 14:21 | |
*** esberglu has quit IRC | 14:22 | |
*** nshetty has quit IRC | 14:30 | |
*** esberglu has joined #openstack-ansible | 14:32 | |
*** esberglu_ has joined #openstack-ansible | 14:33 | |
*** esberglu_ is now known as esberglu__ | 14:34 | |
evrardjp | mhayden: that was awful | 14:36 |
evrardjp | mgariepy: happy new year :) | 14:36 |
*** hw_wutianwei has joined #openstack-ansible | 14:36 | |
*** esberglu has quit IRC | 14:37 | |
*** armaan_ has joined #openstack-ansible | 14:38 | |
*** armaan has quit IRC | 14:38 | |
evrardjp | mhayden: please don't break master, I am very close of merging bare metal, I'd be very frustrated if you break it :p | 14:38 |
mhayden | haha only getting started on reviews | 14:38 |
mhayden | :P | 14:38 |
*** armaan_ has quit IRC | 14:38 | |
*** hamza21 has quit IRC | 14:38 | |
*** hachi has joined #openstack-ansible | 14:38 | |
*** armaan has joined #openstack-ansible | 14:39 | |
*** pbandark1 has joined #openstack-ansible | 14:39 | |
*** nyloc has joined #openstack-ansible | 14:40 | |
*** pbandark has quit IRC | 14:41 | |
*** pbandark1 is now known as pbandark | 14:41 | |
*** bhujay has joined #openstack-ansible | 14:45 | |
evrardjp | odyssey4me: could you answer on https://review.openstack.org/#/c/531123/2/scripts/run-upgrade.sh@170 ? | 14:51 |
evrardjp | cloudnull: if/when you're back, could you check at https://bugs.launchpad.net/openstack-ansible/+bug/1741462 ? | 14:52 |
openstack | Launchpad bug 1741462 in openstack-ansible "P-Q upgrade fails due to change in inventory" [Undecided,New] - Assigned to Jean-Philippe Evrard (jean-philippe-evrard) | 14:52 |
*** gokhan_ has joined #openstack-ansible | 14:52 | |
openstackgerrit | Merged openstack/openstack-ansible-os_monasca master: Update docs config for linters https://review.openstack.org/531313 | 14:52 |
*** tnogisto has joined #openstack-ansible | 14:53 | |
*** esberglu__ is now known as esberglu | 14:54 | |
*** bhujay has quit IRC | 14:55 | |
*** afred312 has quit IRC | 14:57 | |
*** afred312 has joined #openstack-ansible | 14:57 | |
evrardjp | ofc anyone else can help on this bug :) | 14:58 |
*** armaan has quit IRC | 14:59 | |
*** sm806 has quit IRC | 15:05 | |
*** SerenaFeng has joined #openstack-ansible | 15:10 | |
*** sxc731 has quit IRC | 15:11 | |
*** smatzek has joined #openstack-ansible | 15:15 | |
*** smatzek has quit IRC | 15:15 | |
*** smatzek has joined #openstack-ansible | 15:15 | |
*** smatzek has quit IRC | 15:15 | |
*** smatzek has joined #openstack-ansible | 15:16 | |
openstackgerrit | David Wilde proposed openstack/openstack-ansible-specs master: Add spec for ELK stack in openstack-ansible https://review.openstack.org/527769 | 15:20 |
*** stuartgr has left #openstack-ansible | 15:22 | |
*** bhujay has joined #openstack-ansible | 15:22 | |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-lxc_hosts master: Allow NetworkManager to work (if present) https://review.openstack.org/528368 | 15:23 |
*** stuartgr has joined #openstack-ansible | 15:23 | |
*** RandomTech has joined #openstack-ansible | 15:25 | |
openstackgerrit | Merged openstack/openstack-ansible master: [DOCS] Add limit parameter to adding a new compute section https://review.openstack.org/531193 | 15:25 |
ashak | do I have to do any magic to get haproxy logging working? I see it's configured to log to 127.0.0.1 local0 and local1, and rsyslog has some haproxy related config in /etc/rsyslog.d/99-haproxy-local-logging.conf, but I get no logs :( | 15:25 |
openstackgerrit | Merged openstack/openstack-ansible-os_zaqar stable/ocata: Fix for lookup and get_url occuring in different places https://review.openstack.org/531716 | 15:26 |
*** woodard has joined #openstack-ansible | 15:26 | |
mgariepy | ashak, logs are in /var/log/haproxy.log | 15:28 |
RandomTech | hey andymccr are you availible? | 15:28 |
mgariepy | ashak, unfortunately i didn't had time to dig into that to fix the haproxy logging. (the quick test tried wasn't working) | 15:29 |
ashak | mgariepy: that's my problem, /var/log/haproxy/ exists, but it contains nothing | 15:29 |
*** SamYaple_ has quit IRC | 15:30 | |
*** SamYaple has joined #openstack-ansible | 15:30 | |
mgariepy | on the haproyx host this is the rsyslog config that logs haproxy: /etc/rsyslog.d/49-haproxy.conf | 15:31 |
ashak | hrm, I don't have that? But I do have: /etc/rsyslog.d/99-haproxy-local-logging.conf | 15:31 |
*** hachi has quit IRC | 15:32 | |
*** sxc731 has joined #openstack-ansible | 15:32 | |
openstackgerrit | Merged openstack/openstack-ansible-os_zaqar stable/pike: Fix for lookup and get_url occuring in different places https://review.openstack.org/531715 | 15:32 |
RandomTech | Does anyone here know much about the ceph install part of OSA? | 15:33 |
mhayden | RandomTech: that's a good question for andymccr and logan- | 15:33 |
logan- | o/ | 15:33 |
RandomTech | logan-: are you availible a minute? | 15:34 |
logan- | yessir | 15:34 |
*** tnogisto has quit IRC | 15:34 | |
RandomTech | it seems ceph did not install properly during our setup, but our playbooks did not report errors. would you like to see what we have? | 15:34 |
RandomTech | \or could you take a look at what its saying? | 15:35 |
*** tnogisto has joined #openstack-ansible | 15:35 | |
mgariepy | ashak, what OS/release ? | 15:35 |
ashak | CentOS 7 | 15:35 |
mgariepy | on ubuntu haproxy ships the rsyslog config | 15:36 |
mgariepy | what config file are in the haproxy pkg on centos ? | 15:36 |
*** armaan has joined #openstack-ansible | 15:43 | |
*** woodard has quit IRC | 15:43 | |
logan- | RandomTech: yeah did you deploy osa using an existing ceph cluster or are you also using osa to deploy the ceph cluster itself? | 15:43 |
logan- | what kind of issues are you having? | 15:44 |
*** woodard has joined #openstack-ansible | 15:44 | |
RandomTech | logan-: We used osa to deploy ceph and this is the error it gives: http://paste.openstack.org/show/640956/ | 15:46 |
logan- | I don't think the admin keyring gets copied everywhere so that shouldn't be expected to work on every part of the cluster | 15:47 |
logan- | try running that command inside one of the ceph-mon containers | 15:47 |
RandomTech | how do i get into the container? | 15:48 |
logan- | lxc-attach -n `lxc-ls -1 | grep ceph-mon` | 15:48 |
ashak | mgariepy: hrm, nothing seems to own 99-haproxy-local-logging.conf. I've no idea where it comes from... looking at the actual package /etc/haproxy/haproxy.cfg, /etc/logrotate.d/haproxy and /etc/sysconfig/haproxy are the only obvious config files it creates | 15:49 |
RandomTech | okay it works in the contrainer logan- :) | 15:50 |
RandomTech | how do you check osds again? | 15:51 |
openstackgerrit | Merged openstack/ansible-hardening stable/pike: tasks: Add missing tags for async tasks https://review.openstack.org/528749 | 15:51 |
logan- | 'ceph osd tree' is handy, 'ceph -w', 'ceph health detail', etc are good status checking commands | 15:52 |
RandomTech | okay its not seeing the osd | 15:53 |
mgariepy | ashak, "/etc/rsyslog.d/99-haproxy-local-logging.conf" is shipped by OSA | 15:54 |
RandomTech | this is what its looking like logan-: http://paste.openstack.org/show/640965/ | 15:56 |
*** SamYaple has quit IRC | 15:57 | |
*** SamYaple has joined #openstack-ansible | 15:57 | |
*** SamYaple has quit IRC | 15:58 | |
*** SamYaple has joined #openstack-ansible | 15:58 | |
*** TxGirlGeek has joined #openstack-ansible | 15:59 | |
openstackgerrit | Merged openstack/openstack-ansible-os_horizon stable/newton: Set WSGIApplicationGroup %{GLOBAL} as recommended https://review.openstack.org/529035 | 15:59 |
*** hw_wutianwei has quit IRC | 16:02 | |
ashak | mgariepy: ah. So why don't I have any logs? ;) | 16:02 |
*** SerenaFeng has quit IRC | 16:03 | |
mgariepy | the config is not quite right i would assume. | 16:03 |
logan- | RandomTech: gotcha.. you'll need to start checking for ceph-osd services running on your osd hosts, check logs, etc | 16:03 |
*** phalmos has joined #openstack-ansible | 16:04 | |
mgariepy | ashak, here the default config shipped by ubuntu : http://paste.openstack.org/show/640966/ | 16:05 |
*** chyka has joined #openstack-ansible | 16:05 | |
mgariepy | ashak, if you find the right config for haproyx logging, please let us know or submit a patch to fix it. | 16:06 |
*** mrtenio has joined #openstack-ansible | 16:10 | |
jrosser | whats kind of deploy times are people getting? currently ~5hours for a very modest test lab here.... | 16:12 |
*** DanyC has joined #openstack-ansible | 16:12 | |
openstackgerrit | Merged openstack/openstack-ansible-os_horizon stable/pike: Set WSGIApplicationGroup %{GLOBAL} as recommended https://review.openstack.org/529033 | 16:13 |
openstackgerrit | Merged openstack/openstack-ansible-os_horizon stable/ocata: Set WSGIApplicationGroup %{GLOBAL} as recommended https://review.openstack.org/529034 | 16:13 |
mgariepy | jrosser, what os ? what is the hw ? | 16:13 |
mgariepy | 5hours for a new deploy is kinda long. but there are some vars that can be set to accelerate that. | 16:14 |
jrosser | ubuntu, a couple of reasonable 12 core dell r730 | 16:14 |
jrosser | some kbm vm for actual "hosts" on those | 16:14 |
jrosser | *kvm | 16:14 |
mgariepy | some service are deployed in serial | 16:14 |
mgariepy | hdd or ssd ? | 16:14 |
jrosser | ramdisk | 16:15 |
mgariepy | jrosser, http://paste.openstack.org/show/640967/ | 16:17 |
mgariepy | set those and retry. | 16:17 |
mgariepy | should be a lot faster. | 16:17 |
*** brad[] has joined #openstack-ansible | 16:18 | |
jrosser | mgariepy: ah is that parallelising things thatwould be serial for an upgrade? | 16:19 |
mgariepy | i would do upgrade with those. | 16:20 |
mgariepy | might occurs downtime for some services.. | 16:20 |
mgariepy | i would NOT do upgrade with those. | 16:20 |
mgariepy | sorry forgot a word.. | 16:21 |
RandomTech | logan-: i cant find any info relating to the osds any idea where to look | 16:23 |
jrosser | mgariepy: excellent thanks for the tip, will give that a go | 16:23 |
jrosser | its driven by jenkins so its fresh every time, no upgrades | 16:24 |
*** udesale has quit IRC | 16:30 | |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-specs master: Improve user experience by simplifying the guides https://review.openstack.org/531850 | 16:32 |
*** chhavi has quit IRC | 16:38 | |
spotz | ANyone here not get a ballot for the Board of Directors voting who thinks they should have? Working with the Foundation to track down missing ballots | 16:42 |
evrardjp | I haven't received one I think | 16:46 |
evrardjp | not sure I should have one | 16:47 |
spotz | evrardjp: Foundation member? | 16:47 |
evrardjp | yeah :) | 16:47 |
*** pcaruana has quit IRC | 16:48 | |
evrardjp | I received one in 2017 | 16:48 |
spotz | evrardjp: jbryce thinks they've just tracked the issue down, hang on a sec | 16:49 |
*** DanyC has quit IRC | 16:49 | |
evrardjp | great | 16:50 |
spotz | evrardjp: add yourself here https://etherpad.openstack.org/p/2018_BoD_ballots | 16:53 |
mgariepy | that's interesting.. https://bugs.launchpad.net/nova/+bug/1741364 | 16:53 |
openstack | Launchpad bug 1741364 in OpenStack Compute (nova) "ceph ephemeral info not updated during live migrate" [Undecided,New] | 16:53 |
mgariepy | in addition to: https://bugs.launchpad.net/nova/+bug/1452641 | 16:54 |
openstack | Launchpad bug 1452641 in OpenStack Compute (nova) "Static Ceph mon IP addresses in connection_info can prevent VM startup" [Medium,Confirmed] | 16:54 |
mgariepy | logan-, ^^ | 16:54 |
openstackgerrit | Merged openstack/openstack-ansible stable/ocata: Update all SHAs for Ocata 2018-01-08 https://review.openstack.org/529431 | 16:57 |
cloudnull | mornings | 17:01 |
cloudnull | evrardjp: looking at that bug now | 17:03 |
RandomTech | hey cloudnull do you know how to check why the ceph osd arnt showing up? | 17:07 |
cloudnull | no idea :\ | 17:07 |
cloudnull | sorry | 17:08 |
*** TxGirlGeek has quit IRC | 17:11 | |
*** woodard has quit IRC | 17:11 | |
ashak | mgariepy: logging on Centos seems to be broken in general. For example config says write default things to /var/log/syslog (debian like location) rather than /var/log/messages... That would be fine, but it also says drop privileges to the syslog user... the syslog user has no permissions in /var/log so it cna't create /var/log/syslog. | 17:12 |
*** woodard has joined #openstack-ansible | 17:12 | |
ashak | touching /var/log/syslog and chowning it to syslog at least gives me a syslog now... I haven't managed to work out why the haproxy logs don't work yet though | 17:13 |
jrosser | RandomTech: seeing as your mons didnt think there were any osd, id start with very basic connectivity ping from wherever the mons are to the osd. | 17:13 |
jrosser | i.e from inside the mon container to the ip of the osd on the storage network, if you have one | 17:15 |
*** bhujay has quit IRC | 17:15 | |
mgariepy | ashak, what's in the haproxy logrotate file ? | 17:15 |
ashak | mgariepy: https://gist.github.com/ashak/a56ce58ffa65d1d22e588b72cc1112d0 | 17:16 |
jrosser | cloudnull: is the multiple container backend store stuff (zfs etc) in pike? | 17:16 |
*** TxGirlGeek has joined #openstack-ansible | 17:16 | |
RandomTech | it can reach the osd host from the monitor container | 17:17 |
RandomTech | jrosser: ^ | 17:17 |
RandomTech | we did find that we were missing a group bind however | 17:17 |
mgariepy | ashak, ok. | 17:18 |
ashak | rsyslog iself seems very unhappy with its config. It's logging stuff like: | 17:18 |
*** woodard has quit IRC | 17:18 | |
ashak | Jan 8 17:18:31 infra2 rsyslogd: message repeated 9 times: [ action 'action 3' resumed (module 'builtin:omfile') [v8.24.0 try http://www.rsyslog.com/e/2359 ]] | 17:18 |
ashak | Jan 8 17:18:31 infra2 rsyslogd: action 'action 3' suspended, next retry is Mon Jan 8 17:19:01 2018 [v8.24.0 try http://www.rsyslog.com/e/2007 ] | 17:18 |
evrardjp | cloudnull: thanks, that's helping me a ton | 17:18 |
jrosser | RandomTech: ok well if youre happy with the netwoking move onto logfiles and tcpdump to see if you can see them trying to talk | 17:19 |
*** woodard has joined #openstack-ansible | 17:19 | |
RandomTech | i wasnt able to find any logs on the osd host | 17:19 |
RandomTech | . /var/log/ceph is empty | 17:19 |
jrosser | and the services have started ok? im not in front of a ceph to examine right now sadly | 17:20 |
RandomTech | how would i check the osd service? | 17:22 |
Bico_Fino | RandomTech ceph -s | 17:23 |
RandomTech | thats throws an error on the osd host as it does not have the admin keyring, only the client one | 17:23 |
Bico_Fino | can you try from one that has the admin? | 17:25 |
RandomTech | the ceph mon containers do | 17:25 |
RandomTech | Bico_Fino: http://paste.openstack.org/show/640984/ | 17:27 |
Bico_Fino | there are 0 osds RandomTech | 17:27 |
RandomTech | im trying to figure out why | 17:28 |
RandomTech | because we listed two hosts as osd hosts in the config | 17:28 |
Bico_Fino | maybe a typo? :) | 17:28 |
RandomTech | not that i can see | 17:29 |
Bico_Fino | and if you try to deploy ceph again? | 17:32 |
RandomTech | thats what we were going to try to do next | 17:32 |
RandomTech | we were hoping to figure out whats happening first though | 17:32 |
ashak | mgariepy: ok, it's all literally permissioning. If I simply removed the privilege drop to the syslog user the haproxy log gets populated. | 17:32 |
ashak | Jan 8 17:31:25 localhost haproxy[21303]: 172.29.239.47:41082 [08/Jan/2018:17:31:23.513] keystone_admin-front-1/1: SSL handshake failure | 17:32 |
Bico_Fino | RandomTech you using ceph-ansible? | 17:33 |
RandomTech | we were using osa | 17:33 |
Bico_Fino | I remember had to use ceph-ansible because of bluestore support | 17:35 |
evrardjp | RandomTech: Bico_Fino osa uses ceph-ansible | 17:36 |
ashak | odyssey4me: the above log lines are what I see when the glance container tries to talk to keystone. I think that's simply the haproxy frontend suggesting is has an SSL handshake failure with whatever is happening in the Ensure glance service task. | 17:38 |
*** RandomTech has quit IRC | 17:38 | |
ashak | Which seems to be using the keystone role to register glance | 17:41 |
*** epalper has quit IRC | 17:42 | |
evrardjp | spotz: I am glad you like the spec | 17:47 |
evrardjp | I would need your help on making this possible :D | 17:48 |
spotz | evrardjp: Yeah I figured:) | 17:50 |
*** savvas`_ has joined #openstack-ansible | 17:53 | |
openstackgerrit | Merged openstack/openstack-ansible master: Define GATE_EXIT_RUN_DSTAT before use https://review.openstack.org/531131 | 17:55 |
*** savvas` has quit IRC | 17:56 | |
*** hachi has joined #openstack-ansible | 17:57 | |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible stable/pike: Define GATE_EXIT_RUN_DSTAT before use https://review.openstack.org/531866 | 17:57 |
*** sxc731 has quit IRC | 18:11 | |
*** mbuil has quit IRC | 18:18 | |
mhayden | hwoarang / cloudnull: i fixed the linting shenanigans on https://review.openstack.org/528368 | 18:24 |
cloudnull | nice! lgtm . | 18:25 |
*** shardy is now known as shardy_afk | 18:27 | |
*** shardy_afk has quit IRC | 18:35 | |
*** armaan has quit IRC | 18:36 | |
odyssey4me | ashak if you're using the same IP for internal and public endpoints, that's not going to work - the same port can't serve http and https | 18:36 |
odyssey4me | I'm out for the night, cheers all! | 18:36 |
*** shardy_afk has joined #openstack-ansible | 18:36 | |
*** armaan has joined #openstack-ansible | 18:36 | |
spotz | night odyssey4me | 18:36 |
*** jafeha__ has joined #openstack-ansible | 18:48 | |
*** jafeha has quit IRC | 18:49 | |
*** stuartgr has quit IRC | 18:54 | |
*** TxGirlGeek has quit IRC | 18:55 | |
*** TxGirlGeek has joined #openstack-ansible | 18:56 | |
*** sxc731 has joined #openstack-ansible | 18:56 | |
*** TxGirlGeek has joined #openstack-ansible | 18:59 | |
*** poopcat has joined #openstack-ansible | 19:03 | |
*** TxGirlGeek has quit IRC | 19:04 | |
*** poopcat1 has joined #openstack-ansible | 19:08 | |
*** poopcat has quit IRC | 19:08 | |
jrosser | cloudnull: is the multiple container backend store stuff (zfs etc) in pike? | 19:15 |
*** TxGirlGeek has joined #openstack-ansible | 19:21 | |
*** pramodrj07 has joined #openstack-ansible | 19:22 | |
*** pramodrj07 has quit IRC | 19:22 | |
openstackgerrit | Merged openstack/openstack-ansible-tests stable/pike: Skip ansible-lint test against roles https://review.openstack.org/531717 | 19:28 |
ashak | odyssey4me: oh right | 19:32 |
ashak | that might explain it | 19:32 |
ivve | lbaas v2 horizon is still not available in osa? | 19:46 |
*** ivve has quit IRC | 19:54 | |
*** hybridpollo has joined #openstack-ansible | 19:59 | |
*** ivve has joined #openstack-ansible | 20:06 | |
*** hybridpollo has quit IRC | 20:06 | |
*** hybridpollo has joined #openstack-ansible | 20:07 | |
ivve | nvm, it does work. seems like i was sleeping under a stone :) | 20:15 |
-openstackstatus- NOTICE: The jobs and queues in Zuul between 19:55UTC and 20:20UTC have been lost after recovering from a crash, you might need to re-check your patches if they were being tested during that period. | 20:38 | |
*** openstack has quit IRC | 20:38 | |
*** openstack has joined #openstack-ansible | 20:42 | |
*** ChanServ sets mode: +o openstack | 20:42 | |
*** TxGirlGeek has quit IRC | 20:45 | |
*** TxGirlGeek has joined #openstack-ansible | 20:46 | |
*** hachi has quit IRC | 20:51 | |
*** TxGirlGeek has quit IRC | 20:51 | |
*** TxGirlGeek has joined #openstack-ansible | 20:56 | |
*** woodard_ has joined #openstack-ansible | 20:57 | |
*** woodard has quit IRC | 20:57 | |
*** openstackgerrit has quit IRC | 21:03 | |
*** smatzek has quit IRC | 21:11 | |
*** smatzek has joined #openstack-ansible | 21:11 | |
*** smatzek has quit IRC | 21:16 | |
ashak | As part of running os-cinder-install.yml, the task 'galera_client : Install galera distro packages' wants to install packages on one of my infra nodes and is failing with this: | 21:18 |
ashak | file /etc/my.cnf from install of MariaDB-common-10.1.30-1.el7.centos.x86_64 conflicts with file from package mariadb-config-3:10.1.20-2.el7.x86_64 | 21:18 |
ashak | and a few other files with the same package names | 21:18 |
*** woodard_ has quit IRC | 21:25 | |
*** woodard has joined #openstack-ansible | 21:26 | |
*** sxc731 has quit IRC | 21:35 | |
*** TxGirlGeek has quit IRC | 21:50 | |
*** smatzek has joined #openstack-ansible | 21:52 | |
*** esberglu has quit IRC | 21:53 | |
*** smatzek has quit IRC | 21:56 | |
*** TxGirlGeek has joined #openstack-ansible | 21:59 | |
*** TxGirlGeek has quit IRC | 21:59 | |
*** esberglu has joined #openstack-ansible | 22:04 | |
*** Smeared_Beard has joined #openstack-ansible | 22:05 | |
*** SmearedBeard has quit IRC | 22:08 | |
*** savvas`_ has quit IRC | 22:08 | |
*** savvas` has joined #openstack-ansible | 22:09 | |
*** savvas` has quit IRC | 22:14 | |
*** TxGirlGeek has joined #openstack-ansible | 22:14 | |
*** afred312 has quit IRC | 22:22 | |
*** woodard has quit IRC | 22:24 | |
ashak | mariadb-config comes from @openstack-pike repository. The MariaDB-client it's trying to install comes from teh MariaDB repository. | 22:29 |
ashak | Is it possible i've tried to put two things on the infra hosts that conflict with each other's mariadb packages in some way? | 22:29 |
*** chhavi has joined #openstack-ansible | 22:34 | |
*** dave-mccowan has quit IRC | 22:37 | |
*** chhavi has quit IRC | 22:38 | |
*** TxGirlGeek has quit IRC | 22:41 | |
*** TxGirlGeek has joined #openstack-ansible | 22:46 | |
*** TxGirlGeek has quit IRC | 22:53 | |
*** afred312 has joined #openstack-ansible | 23:00 | |
*** john51_ has quit IRC | 23:01 | |
*** john51 has joined #openstack-ansible | 23:04 | |
*** chyka_ has joined #openstack-ansible | 23:06 | |
*** chyka has quit IRC | 23:09 | |
*** chyka_ has quit IRC | 23:13 | |
*** chyka has joined #openstack-ansible | 23:14 | |
*** TxGirlGeek has joined #openstack-ansible | 23:14 | |
*** pmannidi has joined #openstack-ansible | 23:31 | |
*** chyka_ has joined #openstack-ansible | 23:32 | |
*** chyka has quit IRC | 23:35 | |
*** openstackgerrit has joined #openstack-ansible | 23:47 | |
openstackgerrit | Merged openstack/openstack-ansible-lxc_hosts master: Allow NetworkManager to work (if present) https://review.openstack.org/528368 | 23:47 |
*** chyka_ has quit IRC | 23:48 | |
*** Smeared_Beard has quit IRC | 23:49 | |
*** chyka has joined #openstack-ansible | 23:49 | |
*** phalmos has quit IRC | 23:52 | |
*** chyka_ has joined #openstack-ansible | 23:55 | |
*** chyka has quit IRC | 23:55 | |
*** ashak has quit IRC | 23:58 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!