*** chyka has quit IRC | 00:00 | |
*** yifei has joined #openstack-ansible | 00:17 | |
mwynne | Does anyone know how to configure the MTU for the eth0 network? The private 10.0.3.0 network. | 00:20 |
---|---|---|
mwynne | I need that to be non-standard, but can't seem to get it to change. | 00:21 |
*** marst has quit IRC | 00:35 | |
fatdrag0n | mwynne: use this http://www.ubuntugeek.com/how-to-change-mtu-maximum-transmission-unit-of-network-interface-in-ubuntu-linux.html | 00:36 |
mwynne | fatdrag0n: I know how to change the mtu manually | 00:37 |
fatdrag0n | had to mess around with that for ipsec strongswan and csr1000v | 00:37 |
mwynne | the problem is that when the lxc containers are created the dnsmasq dhcp server is serving up an MTU of 1500 and I'm not sure if/where that's configured through OSA | 00:37 |
mwynne | Sicne it installs the necessary packages I assumed I should be able to do it via a config | 00:38 |
mwynne | I don't know how OSA is starting the dnsmasq process so I don't know how to change it.. | 00:40 |
fatdrag0n | wow a lots of mtu in the configs uner ansible_facts/aio1 for me.. | 00:40 |
mwynne | fatdrag0n: yeah, those are for the mgmt,vxlan,vlan networks. | 00:41 |
mwynne | Those are correct for me | 00:42 |
mwynne | Because I was able to configure them. | 00:42 |
fatdrag0n | there is dnsmaasq stuff @ https://docs.openstack.org/openstack-ansible-os_neutron/latest/ | 00:44 |
mwynne | fatdrag0n: That's neutron dnsmasq. Not the same unfortunately :( | 00:46 |
mwynne | I need these changes on the host, not in neutron. | 00:46 |
fatdrag0n | I did lots of dnsmasq on ubuntu..https://help.ubuntu.com/community/Dnsmasq what host u need this done on? | 00:53 |
*** jose-phillips has quit IRC | 00:53 | |
fatdrag0n | openstack ansible? | 00:53 |
fatdrag0n | I keep looking if I find something | 00:54 |
*** jose-phillips has joined #openstack-ansible | 00:54 | |
fatdrag0n | what's the command to see the containers? | 00:57 |
*** chyka has joined #openstack-ansible | 01:01 | |
fatdrag0n | oh got it.. lxc-ls -f | 01:02 |
fatdrag0n | nice deployment | 01:03 |
fatdrag0n | ok, leaving devstack and mirantis fuel for ansible openstck exploration for a bit | 01:03 |
*** chyka has quit IRC | 01:06 | |
*** vnogin has joined #openstack-ansible | 01:19 | |
*** hw_wutianwei has joined #openstack-ansible | 01:22 | |
*** vnogin has quit IRC | 01:24 | |
*** vishwanathj has joined #openstack-ansible | 01:30 | |
mwynne | fatdrag0n: what did you use for the internal_lb_vip_address and external_lb_vip_address? | 01:30 |
mwynne | fatdrag0n: Do those need to be IP addresses assigned to your host? Or NOT assigned to your host? | 01:31 |
*** hw_wutianwei has quit IRC | 01:37 | |
*** hw_wutianwei has joined #openstack-ansible | 01:44 | |
fatdrag0n | have not done any networking customization to OSA yet, looking forward to it.. if I can find all the files I need to tweak for my openstack networking | 01:53 |
fatdrag0n | in devstack I had a local.conf that I put it my networking info ther | 01:54 |
mwynne | my galera container is trying to pip install from my internal_lb_vip_address and failing | 02:08 |
mwynne | Has anyone seen this before?? | 02:08 |
mwynne | it's not using the IP of my repo conatiner | 02:10 |
mwynne | I'm assuming haproxy should be running on that IP? | 02:30 |
mwynne | but isn't? | 02:30 |
*** rstarmer has joined #openstack-ansible | 02:33 | |
mwynne | fatdrag0n: Do you have the haproxy service running on your host? | 02:34 |
fatdrag0n | no haproxy container, but haproxy process/services running | 02:51 |
jiaopengju | I am following openstack-ansible aio example to install a test environment. but faild in executing ‘openstack-ansible setup-infrastructure.yml’. In the galera container, I found errors: https://paste.ubuntu.com/26212602/ | 03:14 |
jiaopengju | anyone can help me? | 03:15 |
fatdrag0n | File '/var/lib/mysql/mariadb-bin.index' not found (Errcode: 13 "Permission denied") | 03:17 |
jiaopengju | yes, but actually this file is exist | 03:17 |
jiaopengju | and its owner is ‘mysql’ | 03:17 |
*** aludwar has quit IRC | 03:17 | |
fatdrag0n | permission then | 03:19 |
jiaopengju | I changed the permission to 777, but always fail to start | 03:19 |
*** markvoelker has joined #openstack-ansible | 03:24 | |
jiaopengju | some ideas? | 03:29 |
*** pradiprwt has quit IRC | 03:46 | |
*** dave-mccowan has quit IRC | 03:51 | |
*** gloksinia has joined #openstack-ansible | 03:56 | |
*** markvoelker has quit IRC | 03:58 | |
*** gouthamr has quit IRC | 04:18 | |
*** rstarmer has quit IRC | 04:42 | |
*** markvoelker has joined #openstack-ansible | 04:55 | |
*** chhavi has joined #openstack-ansible | 05:03 | |
*** chhavi has quit IRC | 05:07 | |
*** pradiprwt has joined #openstack-ansible | 05:12 | |
*** ivve has quit IRC | 05:12 | |
pradiprwt | Hi, I am getting error while running "setup-infrastructure.yml" playbook, It is getting failed at the step "Create OpenStack-Ansible requirement wheels". | 05:14 |
pradiprwt | I observed the error is "Failed building wheel for libvirt-python" | 05:14 |
*** octo-fs has joined #openstack-ansible | 05:16 | |
pradiprwt | Any suggestion, how to resolve this issue | 05:16 |
*** vnogin has joined #openstack-ansible | 05:19 | |
*** vnogin has quit IRC | 05:24 | |
*** ivve has joined #openstack-ansible | 05:27 | |
*** markvoelker has quit IRC | 05:28 | |
*** hybridpollo has quit IRC | 05:31 | |
*** poothia has joined #openstack-ansible | 05:37 | |
*** chhavi has joined #openstack-ansible | 05:39 | |
*** nshetty has joined #openstack-ansible | 05:40 | |
*** chhavi has quit IRC | 05:45 | |
*** chhavi has joined #openstack-ansible | 05:46 | |
*** chyka has joined #openstack-ansible | 05:50 | |
*** chyka has quit IRC | 05:51 | |
*** nshetty is now known as nshetty|mtg | 06:02 | |
*** chyka has joined #openstack-ansible | 06:15 | |
*** chyka has quit IRC | 06:20 | |
*** markvoelker has joined #openstack-ansible | 06:25 | |
*** ivveh has joined #openstack-ansible | 06:31 | |
*** gkadam has joined #openstack-ansible | 06:38 | |
*** yolanda has joined #openstack-ansible | 06:47 | |
*** armaan has quit IRC | 06:55 | |
*** armaan has joined #openstack-ansible | 06:55 | |
ivveh | hey guys, any recommendations on the most stable release if using centos7? (pike not working to well) | 06:56 |
pradiprwt | ivveh : I am deploying ocata but facing issue while repo build | 06:58 |
*** ankita_ has joined #openstack-ansible | 06:58 | |
*** markvoelker has quit IRC | 06:59 | |
*** chyka has joined #openstack-ansible | 07:08 | |
*** chyka has quit IRC | 07:13 | |
*** mma has joined #openstack-ansible | 07:21 | |
*** nshetty|mtg is now known as nshetty | 07:23 | |
pradiprwt | hi guys, I am facing issue with internal load balancer, haproxy playbook executed successfully but while installing pip packeges for galara container it is not able to communicate with ip which is assign for internal lb | 07:28 |
pradiprwt | any idea what can be problem | 07:29 |
*** jvidal has joined #openstack-ansible | 07:29 | |
ankita_ | pradiprwt is it an aio setup ? | 07:31 |
ankita_ | or production? | 07:31 |
*** nshetty is now known as nshetty|lunch | 07:32 | |
pradiprwt | ankita_: it is multi node with single controller | 07:34 |
ankita_ | am not sure if single controller can support haproxy... | 07:35 |
ankita_ | load balancing and ha needs at least 3 ctrls | 07:35 |
pradiprwt | yeah, I did some changes in openstack_user_config file | 07:35 |
*** shardy has joined #openstack-ansible | 07:37 | |
*** shardy has quit IRC | 07:37 | |
pradiprwt | ankita_: have you tried installation with centos 7? | 07:38 |
ankita_ | no ubuntu | 07:38 |
ankita_ | for ha | 07:38 |
pradiprwt | ok | 07:39 |
*** shardy has joined #openstack-ansible | 07:41 | |
ankita_ | extra_container.yml.example | 07:47 |
ankita_ | edited? | 07:48 |
*** fxpester has joined #openstack-ansible | 07:49 | |
*** mbuil has joined #openstack-ansible | 07:56 | |
*** nshetty|lunch has quit IRC | 08:01 | |
*** epalper has joined #openstack-ansible | 08:12 | |
*** nshetty has joined #openstack-ansible | 08:13 | |
mardim | odyssey4me, evrardjp good morning :) | 08:25 |
mardim | odyssey4me, evrardjp I hope you are doing well | 08:25 |
*** bigboss has joined #openstack-ansible | 08:25 | |
mardim | odyssey4me, evrardjp we are tryinh to pass this patch from the gates https://review.openstack.org/#/c/510909/ | 08:25 |
mardim | odyssey4me, evrardjp But it keeps failing in linters gate and the error is not related to the patch | 08:26 |
mardim | odyssey4me, I think you solved a similar error in the past | 08:26 |
bigboss | hi.. we're trying to set up openstack-ansible newton version on ubuntu 16 but are facing an error | 08:26 |
bigboss | When I run setup-infrastructure, I get an error in the installation of PIP packages in galera container | 08:27 |
mardim | odyssey4me, evrardjp I think the error is this http://logs.openstack.org/09/510909/26/check/openstack-ansible-linters/2a690db/job-output.txt.gz#_2017-12-18_21_06_24_448618 | 08:27 |
mardim | odyssey4me, evrardjp Any idea ? | 08:28 |
bigboss | This is the error.. FAILED! => {"changed": false, "cmd": "/usr/local/bin/pip install -U --isolated --constraint http://172.29.233.121:8181/os-releases/14.0.2/requirements_absolute_requirements.txt ndg-httpsclient requests", "failed": true, "invocation": {"module_args": {"chdir": null, "editable": true, "executable": null, "extra_args": "--isolated --constraint http://172.29.233.121:8181/os-releases/14.0.2/requirements_ab | 08:28 |
pradiprwt | bigboss: Are you able to ping 172.29.233.121 | 08:30 |
bigboss | yeah. i ran the cmd in the terminal and it ran successfully | 08:30 |
pradiprwt | ok | 08:30 |
pradiprwt | login to galera container and thy curl http://172.29.233.121:8181 | 08:31 |
bigboss | ok | 08:31 |
pradiprwt | mostly this problem is happening because of networking configuration | 08:33 |
*** yolanda__ has joined #openstack-ansible | 08:34 | |
*** yolanda has quit IRC | 08:36 | |
*** deus_ex has joined #openstack-ansible | 08:39 | |
bigboss | pradiprwt: it's not reachable. No route to host. | 08:40 |
pradiprwt | yeah, thats the problem | 08:40 |
pradiprwt | are you installing multi node or single node | 08:40 |
*** pedja has quit IRC | 08:41 | |
bigboss | i have 2 controllers and 1 compute | 08:41 |
pradiprwt | ok | 08:41 |
pradiprwt | installing in VM or bare metal ? | 08:41 |
jiaopengju | I am following openstack-ansible aio example to install a test environment. but faild in executing ‘openstack-ansible setup-infrastructure.yml’. In the galera container, I found errors: https://paste.ubuntu.com/26212602/ any ideas? | 08:41 |
bigboss | i'm using one controller also as an load balancer. It's installed on VMs | 08:41 |
pradiprwt | ok, | 08:42 |
pradiprwt | enable promiscuous mode for virtual switch | 08:42 |
pradiprwt | and try to run the same command | 08:42 |
bigboss | ok. thanks! | 08:43 |
bigboss | pradiprwt: do you mean the promiscuous mode setting in Virtual box networks? | 08:45 |
pradiprwt | yes | 08:46 |
bigboss | okay | 08:46 |
pradiprwt | set it to Allow VM | 08:46 |
pradiprwt | I am also facing the same issue with bare metal in centos 7 | 08:47 |
pradiprwt | trying to debug it | 08:47 |
bigboss | I set it to promiscuous mode but curl <ip> still throws an error when I run it inside the container | 08:48 |
pradiprwt | ok | 08:48 |
armaan | folks, anybody running Magnum here? | 08:51 |
*** markvoelker has joined #openstack-ansible | 08:56 | |
fdegir | evrardjp: regarding frozen shas for 17.0.0.0b2 | 08:56 |
fdegir | evrardjp: I just deployed aio using vagrant to check heat issues we are seeing in opnfv | 08:57 |
fdegir | evrardjp: and those issues exist in osa as well | 08:57 |
fdegir | evrardjp: commands like openstack orchestration service list and openstack stack list results in | 08:57 |
fdegir | evrardjp: ERROR: You are not authorized to use index. | 08:57 |
fdegir | hwoarang: ^ | 08:58 |
*** chyka has joined #openstack-ansible | 08:58 | |
*** chyka has quit IRC | 09:02 | |
*** DanyC has joined #openstack-ansible | 09:09 | |
*** SmearedBeard has joined #openstack-ansible | 09:11 | |
*** deus_ex has quit IRC | 09:26 | |
*** markvoelker has quit IRC | 09:29 | |
hwoarang | fdegir: what shas? we reverted the shas for roles in https://review.openstack.org/#/c/527936/ | 09:32 |
fdegir | hwoarang: I used the frozen shas thinking if they're frozen, they're well tested | 09:33 |
fdegir | hwoarang: https://review.openstack.org/#/c/527936/ | 09:33 |
*** armaan has quit IRC | 09:33 | |
hwoarang | they were just frozen for the intermediate release | 09:33 |
*** armaan has joined #openstack-ansible | 09:34 | |
fdegir | yes and intermediate release means things should work relatively better, isn't it? | 09:34 |
fdegir | I can try the tip of master to see how it looks | 09:34 |
hwoarang | ok | 09:35 |
*** SmearedBeard has quit IRC | 09:38 | |
openstackgerrit | Markos Chandras (hwoarang) proposed openstack/ansible-hardening master: DNM - Testing lint fixes https://review.openstack.org/529011 | 09:39 |
openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-tests master: Skip ansible-lint test against roles https://review.openstack.org/528690 | 09:42 |
*** fatdrag0n has quit IRC | 09:44 | |
*** armaan has quit IRC | 09:45 | |
*** pradiprwt has quit IRC | 09:46 | |
*** armaan has joined #openstack-ansible | 09:46 | |
*** pradiprwt has joined #openstack-ansible | 09:48 | |
pradiprwt | bigboss : Is the issue solved ? | 09:48 |
pradiprwt | The problem is from haproxy | 09:50 |
openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-tests master: Skip ansible-lint test against roles https://review.openstack.org/528690 | 09:53 |
*** DanyC has quit IRC | 09:54 | |
*** DanyC has joined #openstack-ansible | 09:54 | |
*** vnogin has joined #openstack-ansible | 09:55 | |
*** gun1x has quit IRC | 09:59 | |
*** DanyC has quit IRC | 09:59 | |
*** pedja has joined #openstack-ansible | 10:02 | |
openstackgerrit | Merged openstack/ansible-hardening stable/ocata: Remove old /etc/profile config block https://review.openstack.org/528426 | 10:08 |
*** gun1x has joined #openstack-ansible | 10:10 | |
hwoarang | odyssey4me: good morning. Does my reply on https://review.openstack.org/#/c/528690/ answer your question? | 10:12 |
hwoarang | and os_neutron fails at it should :) | 10:12 |
*** DanyC has joined #openstack-ansible | 10:14 | |
*** gfa has quit IRC | 10:15 | |
openstackgerrit | Manuel Buil proposed openstack/openstack-ansible-os_neutron master: Provide support for SFC deployments https://review.openstack.org/510909 | 10:21 |
*** SmearedBeard has joined #openstack-ansible | 10:25 | |
pradiprwt | Hi All, I am facing issue with HAproxy, it is not able to bind virtual IP because if that galera pip installation is getting failed.. | 10:25 |
*** nshetty has quit IRC | 10:25 | |
*** nshetty has joined #openstack-ansible | 10:25 | |
*** markvoelker has joined #openstack-ansible | 10:26 | |
*** gfa has joined #openstack-ansible | 10:42 | |
openstackgerrit | Merged openstack/openstack-ansible-os_cinder master: Add MySQL connection SSL support https://review.openstack.org/527829 | 10:45 |
*** Smeared_Beard has joined #openstack-ansible | 10:46 | |
*** electrofelix has joined #openstack-ansible | 10:46 | |
*** SmearedBeard has quit IRC | 10:47 | |
*** epalper has quit IRC | 10:51 | |
*** epalper has joined #openstack-ansible | 10:52 | |
*** vnogin has quit IRC | 10:55 | |
*** vnogin has joined #openstack-ansible | 10:56 | |
*** markvoelker has quit IRC | 11:00 | |
odyssey4me | hwoarang does my reply to your reply make any sense? | 11:03 |
odyssey4me | hwoarang also, the os_neutron patch still appears to be passing? | 11:04 |
odyssey4me | oh I see in the recheck it's failing as it should | 11:05 |
openstackgerrit | Merged openstack/openstack-ansible-os_horizon master: Set WSGIApplicationGroup %{GLOBAL} as recommended https://review.openstack.org/526423 | 11:10 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_horizon stable/pike: Set WSGIApplicationGroup %{GLOBAL} as recommended https://review.openstack.org/529033 | 11:12 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_horizon stable/ocata: Set WSGIApplicationGroup %{GLOBAL} as recommended https://review.openstack.org/529034 | 11:14 |
hwoarang | odyssey4me: let me drop that and run the cross repo checks again | 11:14 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_horizon stable/newton: Set WSGIApplicationGroup %{GLOBAL} as recommended https://review.openstack.org/529035 | 11:14 |
openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-tests master: Skip ansible-lint test against roles https://review.openstack.org/528690 | 11:14 |
odyssey4me | hwoarang we should probably do a test patch on top of that which purposefully does something to fail as well | 11:14 |
hwoarang | the DNM os_neutron is ok right? | 11:15 |
odyssey4me | yup, but we should do one for the tests repo too, as that covers two types - one that has roles, and one that does not | 11:15 |
odyssey4me | s/roles/role_name/ | 11:15 |
hwoarang | right | 11:17 |
hwoarang | but the -tests is being tested itself | 11:17 |
hwoarang | oh | 11:17 |
hwoarang | inception | 11:17 |
hwoarang | it's being tested using the master branch so yeah lets try | 11:17 |
openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-tests master: DNM - Testing lint fixes https://review.openstack.org/497241 | 11:18 |
*** ivveh has quit IRC | 11:20 | |
*** ankita_ has quit IRC | 11:22 | |
*** armaan has quit IRC | 11:28 | |
*** armaan has joined #openstack-ansible | 11:28 | |
openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-tests master: DNM - Testing lint fixes https://review.openstack.org/497241 | 11:30 |
*** stuartgr has joined #openstack-ansible | 11:33 | |
*** armaan has quit IRC | 11:33 | |
*** armaan has joined #openstack-ansible | 11:33 | |
hwoarang | odyssey4me: inception works ^ http://logs.openstack.org/41/497241/6/check/openstack-ansible-linters/92bcf99/job-output.txt.gz#_2017-12-19_11_39_04_271274 | 11:40 |
hwoarang | i think i am done with it | 11:40 |
odyssey4me | awesome sauce, thanks for working that up! | 11:41 |
odyssey4me | that will save us considerable pain both now and into the future! | 11:42 |
openstackgerrit | Merged openstack/openstack-ansible stable/pike: designate variables for neutron integration https://review.openstack.org/528750 | 11:42 |
hwoarang | no problem. lets see what pieces I will have to pick after that | 11:44 |
*** armaan has quit IRC | 11:45 | |
*** yolanda__ is now known as yolanda | 11:50 | |
*** zkynet has joined #openstack-ansible | 11:50 | |
*** smatzek has joined #openstack-ansible | 11:56 | |
*** markvoelker has joined #openstack-ansible | 11:57 | |
*** zkynet has quit IRC | 12:00 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_build master: Ensure that all release files are in the manifest https://review.openstack.org/529043 | 12:01 |
*** zkynet has joined #openstack-ansible | 12:01 | |
odyssey4me | hwoarang ^ that's a pretty simple fix, but urgently needed for us - if you have a moment please review | 12:01 |
pradiprwt | Hi, I am facing issue while running keystone playbook it is getting failed at DB creation here is error output ..http://paste.openstack.org/show/629302/ | 12:14 |
odyssey4me | pradiprwt which tag/branch is that? | 12:16 |
pradiprwt | it is ocata branch | 12:17 |
odyssey4me | is that a new install, or an upgrade? | 12:17 |
odyssey4me | ok, so you deployed from the head of the stable/ocata branch? | 12:17 |
pradiprwt | yes it is new install with centos 7 | 12:17 |
odyssey4me | is it a single node environment, or multi-node environment? | 12:18 |
pradiprwt | one controller and one compute | 12:19 |
*** vnogin has quit IRC | 12:19 | |
odyssey4me | ok, can you check whether the galera back-end is up via haproxy using hatop? | 12:19 |
odyssey4me | and can you attach to the galera container and verify the state of the cluster? | 12:19 |
odyssey4me | https://docs.openstack.org/openstack-ansible/latest/admin/maintenance-tasks/galera.html#verify-cluster-status | 12:20 |
mbuil | hwoarang: SUCCESS finally!!! https://review.openstack.org/#/c/510909/ | 12:21 |
pradiprwt | odyssey4me: http://paste.openstack.org/show/629303/ | 12:21 |
odyssey4me | pradiprwt ok, it seems that's fine | 12:22 |
pradiprwt | This command returns error "ansible galera_container -m shell -a "mysql -h localhost -e 'show status like \"%wsrep_cluster_%\";'"" | 12:23 |
pradiprwt | http://paste.openstack.org/show/629304/ | 12:24 |
odyssey4me | ok, so 127.0.0.1 works, but localhost does not? | 12:25 |
*** Smeared_Beard has quit IRC | 12:25 | |
pradiprwt | yes | 12:26 |
odyssey4me | ah, interesting - it seems that we're only doing a grant to 127.0.0.1 | 12:27 |
odyssey4me | ok, but does using localhost matter - let's see | 12:28 |
*** vnogin has joined #openstack-ansible | 12:28 | |
*** markvoelker has quit IRC | 12:29 | |
pradiprwt | odyssey4me : I have verified the mysql configuration file, it seems the bind-address have ipv6 value :: | 12:33 |
odyssey4me | pradiprwt if you go into the galera container, then try to access the system using the internal_lb_address does it work? | 12:34 |
pradiprwt | yes, I am able to ping the internal lb ip | 12:35 |
pradiprwt | the ip is the same controller host ip | 12:35 |
odyssey4me | mysql ping, or icmp ping? | 12:35 |
pradiprwt | icmp ping | 12:35 |
*** nshetty is now known as nshetty|afk | 12:35 | |
odyssey4me | try using mysql to verify that the lb thinks the system is up | 12:35 |
pradiprwt | odyssey4me: yes it is able to communicate using internal lb ip but password not accepting for keystone user | 12:39 |
odyssey4me | the keystone user doesn't exist yet - the first task was to create the db, the second is to create the user | 12:39 |
odyssey4me | the first one failed | 12:39 |
odyssey4me | try and create the db manually? | 12:39 |
odyssey4me | or try re-running the os-keystone playbook? | 12:39 |
odyssey4me | with -vvv | 12:39 |
pradiprwt | ok | 12:40 |
pradiprwt | os-keystone playbook output >> http://paste.openstack.org/show/629309/ | 12:41 |
*** hw_wutianwei has quit IRC | 12:43 | |
odyssey4me | ok, so in the galera container if you execute: mysql -h 192.168.20.11 -u root ping | 12:44 |
odyssey4me | does that work? | 12:44 |
pradiprwt | I am able to create database also from galara container | 12:44 |
pradiprwt | this error >> ERROR 2013 (HY000): Lost connection to MySQL server at 'reading initial communication packet', system error: 0 "Internal error/check (Not system error)" | 12:45 |
odyssey4me | ok, so again - please verify whether haproxy thinks the db is up | 12:45 |
pradiprwt | how to verify it ? | 12:46 |
*** yifei has quit IRC | 12:46 | |
odyssey4me | you'll need to run hatop on the host - I can't recall the syntax exactly | 12:46 |
pradiprwt | ok | 12:46 |
odyssey4me | echo "show info;show stat" | nc -U /var/run/haproxy.stat | 12:46 |
pradiprwt | output of "show info;show stat" | nc -U /var/run/haproxy.stat >> http://paste.openstack.org/show/629310/ | 12:49 |
odyssey4me | galera-back is showing DOWN | 12:50 |
odyssey4me | ok, so now we need to figure out why | 12:50 |
odyssey4me | is the galera server container listening on port 9200? | 12:51 |
pradiprwt | tried with telnet but connection refused for port 9200 with galera container | 12:54 |
odyssey4me | ok, can you verify whether the xinet/xinetd service is running in the container | 12:54 |
odyssey4me | if not, can you check whether it has any logs to show why it's not running? | 12:54 |
odyssey4me | verify whether it's installed or not | 12:54 |
pradiprwt | there is no service xinet/xinetd on galera container | 12:56 |
odyssey4me | hmm, ok - can you check whether the galera_server role has this stuff in it? https://github.com/openstack/openstack-ansible-galera_server/commit/515ab131fa27b7e66f75abb4c886b5b57ca9d41b | 12:56 |
odyssey4me | your copy of the role in /etc/ansible/roles/galera_server | 12:57 |
pradiprwt | odyssey4me: I have verified that changes with this commit are not available in my environment | 13:02 |
odyssey4me | pradiprwt ok, then that's weird because the ansible bootstrap would have put it there for you | 13:03 |
odyssey4me | did you perhaps bootstrap with a tag first, then change to the head of the branch and forget to bootstrap again? | 13:03 |
pradiprwt | if I remember I tried first with tag 15.1.13 and later changed with branch but I had executed the bootstrap script in both cases | 13:05 |
*** nshetty|afk is now known as nshetty | 13:07 | |
odyssey4me | ok, can you re-execute the ansible bootstrap now - then check whether that content is present afterwards? | 13:07 |
pradiprwt | sure | 13:07 |
*** stuartgr has quit IRC | 13:09 | |
*** SmearedBeard has joined #openstack-ansible | 13:11 | |
pradiprwt | odyssey4me: yes now I can see the changes in my environment | 13:15 |
odyssey4me | ok, good - now you'll need to re-execute all the playbooks to make sure the updates are applied properly | 13:15 |
pradiprwt | ok | 13:15 |
odyssey4me | openstack-ansible setup-hosts.yml setup-infrastructure.yml setup-openstack.yml | 13:15 |
pradiprwt | yes | 13:16 |
pradiprwt | I got one more issue but it solved by editing one of file in repo | 13:16 |
pradiprwt | it was happen with repo build | 13:17 |
odyssey4me | what issue was that? | 13:18 |
pradiprwt | error was >> Failed building wheel for libvirt-python\nERROR: Failed to build one or more wheels" | 13:18 |
pradiprwt | I have added one line in "global-requirement-pins.txt" | 13:18 |
pradiprwt | the line was "libvirt_python>=3.5.0" | 13:19 |
odyssey4me | oh? what did you add? | 13:19 |
odyssey4me | that's not a good idea | 13:19 |
odyssey4me | the tested version for ocata is https://github.com/openstack/requirements/blob/stable/ocata/upper-constraints.txt#L184 and with that change you're overriding it | 13:20 |
odyssey4me | if there's an issue building the wheel, then I'd like to see the actual failure output | 13:20 |
odyssey4me | in the repo container /var/log/repo/ will contain some logs which may have the failure in it | 13:21 |
pradiprwt | I have console error log >> http://paste.openstack.org/show/629314/ | 13:24 |
pradiprwt | what should I need to do | 13:25 |
pradiprwt | If I will remove the line it may I will get the same issue ... Is there any other way ? | 13:25 |
*** markvoelker has joined #openstack-ansible | 13:27 | |
*** markvoelker has quit IRC | 13:28 | |
*** markvoelker has joined #openstack-ansible | 13:29 | |
*** armaan has joined #openstack-ansible | 13:34 | |
mgariepy | morning everyone | 13:35 |
odyssey4me | pradiprwt I don't see an actual error there, please check the log I suggested | 13:36 |
odyssey4me | mgariepy morning - please review https://review.openstack.org/529043 asap - I need that merged and ported back to pike urgently | 13:36 |
odyssey4me | pradiprwt until I get an actual error, I can't advise a solution - but using an open ended version for libvirt's wheel is absolutely a bad idea | 13:37 |
mgariepy | done | 13:37 |
odyssey4me | ta | 13:38 |
mgariepy | ping me when you backport into pike. | 13:38 |
odyssey4me | hopefully hwoarang will return some time soon and be the other reviewer ;) | 13:38 |
mgariepy | evrardjp, isn't there ? | 13:38 |
odyssey4me | nah, most ppl are on holiday - including mhayden cloudnull and evrardjp | 13:39 |
mgariepy | ha | 13:39 |
mgariepy | good for them | 13:39 |
mgariepy | i'll be on holiday starting friday :) | 13:39 |
pradiprwt | odyssey4me: I have complete console error output but openstack paste is not taking that much lines | 13:40 |
pradiprwt | odyssey4me >>> https://pastebin.com/0xJyBtEH | 13:41 |
odyssey4me | pradiprwt I'd prefer to see the /var/log/repo/repo_builder.log from the repo container - put it in a gist or something | 13:42 |
pradiprwt | let me try to reproduce the error again | 13:43 |
pradiprwt | I had deleted the repo container | 13:44 |
*** armaan has quit IRC | 13:45 | |
*** dave-mccowan has joined #openstack-ansible | 13:45 | |
*** nshetty has quit IRC | 13:46 | |
*** tnogisto has joined #openstack-ansible | 13:46 | |
*** yifei has joined #openstack-ansible | 13:58 | |
mgariepy | pradiprwt, you might have the log on the host under /openstack/ | 14:07 |
mgariepy | depending on how you deleted the container. | 14:07 |
pradiprwt | mgariepy : i have deleted the container using lxc-container-destroy playbook | 14:09 |
*** vnogin has quit IRC | 14:10 | |
*** vnogin has joined #openstack-ansible | 14:10 | |
odyssey4me | yeah, if you answer yes to both questions it will wipe all traces of the container including the logs | 14:11 |
*** vnogin has quit IRC | 14:21 | |
*** hw_wutianwei has joined #openstack-ansible | 14:23 | |
*** vnogin has joined #openstack-ansible | 14:24 | |
pradiprwt | If I want to install from scratch then what are the things I need to make clear in host | 14:26 |
*** zkynet has quit IRC | 14:26 | |
pradiprwt | and what is most stable and tested branch or tag for centos, I want to go for ocata | 14:27 |
*** smatzek has quit IRC | 14:29 | |
hwoarang | odyssey4me: sorry extended lunch time break :p | 14:29 |
hwoarang | im on it | 14:29 |
odyssey4me | pradiprwt the last tag is what was working when last released, however you may have found a new bug that needs addressing so I really want that log | 14:30 |
odyssey4me | either that or I'll have to build a test system myself :/ | 14:30 |
*** cshen has quit IRC | 14:31 | |
hwoarang | mgariepy: could you have a look at https://review.openstack.org/#/c/528690/ please? that will help unblock linter/gate issues on roles | 14:31 |
*** cshen has joined #openstack-ansible | 14:31 | |
pradiprwt | odyssey4me : I want to install it from beaning... so I want to clean the environment ... and I can update you the status | 14:31 |
odyssey4me | pradiprwt best is to re-kick your host | 14:31 |
odyssey4me | cleaning up is a PITA and if you miss one small thing you'll end up wasting time trying to figure out why something that should work, is not | 14:32 |
*** zkynet has joined #openstack-ansible | 14:33 | |
mgariepy | hwoarang, done. | 14:33 |
pradiprwt | ok then I will reinstall the os, | 14:33 |
hwoarang | mgariepy: awesome thanks! | 14:33 |
pradiprwt | odyssey4me: now time to leave, I will update you tomorrow | 14:34 |
mgariepy | pradiprwt, you probably go with pike. | 14:34 |
mgariepy | if it's a new install. | 14:34 |
*** octo-fs has quit IRC | 14:35 | |
*** octo-fs has joined #openstack-ansible | 14:35 | |
pradiprwt | mgariepy: sure but I have requirement of ocata version | 14:36 |
odyssey4me | mgariepy not sure if you have a gap to check if this can be verified, but pradiprwt had an issue with his build from the head of ocata where the libvirt-python wheel failed to build | 14:37 |
mgariepy | odyssey4me, i don't think i have time for that | 14:38 |
mgariepy | i need to migrate a couple server to xenial i would like to have it done by friday | 14:39 |
mgariepy | http://logs.openstack.org/periodic/git.openstack.org/openstack/openstack-ansible/stable/ocata/openstack-ansible-deploy-aio-centos-7/2f227ba/job-output.txt.gz#_2017-12-19_07_16_32_577056 | 14:40 |
mgariepy | seems like it has issues. | 14:40 |
mgariepy | sad that we don't have the logs for this periodic build. | 14:40 |
*** zkynet has quit IRC | 14:41 | |
odyssey4me | hmm, ok - I guess it's time to fire up an AIO then | 14:41 |
*** gouthamr has joined #openstack-ansible | 14:47 | |
*** zkynet has joined #openstack-ansible | 14:49 | |
*** sxc731 has joined #openstack-ansible | 14:53 | |
*** sxc731 has quit IRC | 14:56 | |
*** zkynet has quit IRC | 14:57 | |
openstackgerrit | Merged openstack/openstack-ansible-repo_build master: Ensure that all release files are in the manifest https://review.openstack.org/529043 | 14:57 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_build stable/pike: Ensure that all release files are in the manifest https://review.openstack.org/529088 | 14:57 |
odyssey4me | hwoarang mgariepy ^ :) thanks | 14:57 |
*** zkynet has joined #openstack-ansible | 14:57 | |
hwoarang | all sorts of interesting bugs... | 14:58 |
*** smatzek has joined #openstack-ansible | 14:58 | |
mgariepy | I thing you meant: features... ;p | 14:58 |
*** zkynet has quit IRC | 14:58 | |
hwoarang | a fine line ;p | 14:59 |
*** yifei has quit IRC | 15:01 | |
*** zkynet has joined #openstack-ansible | 15:01 | |
*** MikeW has joined #openstack-ansible | 15:03 | |
MikeW | Hey guys got a dumb question... can anyone point me to some documentation that would allow me to deploy base containers for ceilometer pre-reqs (mongodb) using what's already in openstack-ansible? | 15:04 |
MikeW | i.e. can I create an env.d yaml file and run lxc-container-create with a limit referencing it? Or would I have to develop an entire role? | 15:05 |
hwoarang | mgariepy: and that one please https://review.openstack.org/#/c/528003/ :) | 15:06 |
*** pedja has quit IRC | 15:07 | |
mgariepy | hwoarang, done | 15:08 |
hwoarang | awesome! | 15:08 |
*** marst has joined #openstack-ansible | 15:10 | |
openstackgerrit | Merged openstack/openstack-ansible-tests master: Skip ansible-lint test against roles https://review.openstack.org/528690 | 15:13 |
hwoarang | odyssey4me: could you remind me again why ./playbooks/defaults/repo_packages/openstack_services.yml pins SHAs for services instead of using the master branch? | 15:13 |
odyssey4me | hwoarang that's to manage the upheaval created by upstream changes, giving us the opportunity to do our own work and only getting that interference once every two weeks when we bump the SHA's | 15:16 |
odyssey4me | I suppose we could try using the master branch for a while and see how that goes. | 15:16 |
odyssey4me | we're doing that in the roles anyway | 15:16 |
odyssey4me | MikeW there are many roles to do those things, and no-one has submitted a playbook to implement those | 15:17 |
odyssey4me | MikeW more importantly, afaik mongodb is no longer supported by the telemetry stack as of pike | 15:17 |
mgariepy | we control the changes in the roles. it's not quite the same for the other project. | 15:18 |
*** chyka has joined #openstack-ansible | 15:20 | |
hwoarang | right | 15:21 |
mgariepy | why are you asking ? do you need / want to go with master instead ? | 15:23 |
hwoarang | no i am just curious | 15:24 |
*** chyka has quit IRC | 15:26 | |
*** chyka has joined #openstack-ansible | 15:26 | |
*** chhavi has quit IRC | 15:30 | |
*** ivve has quit IRC | 15:30 | |
*** chyka has quit IRC | 15:31 | |
*** systems-sk has quit IRC | 15:33 | |
*** fxpester has quit IRC | 15:35 | |
*** zkynet has quit IRC | 15:38 | |
*** zkynet has joined #openstack-ansible | 15:38 | |
*** cshen has quit IRC | 15:40 | |
*** ivve has joined #openstack-ansible | 15:43 | |
MikeW | odyssey4me Ahh ok I see. What if I just want bare containers on my infra hosts with IPs on my container network and then I can just manually install? | 15:45 |
*** sxc731 has joined #openstack-ansible | 15:56 | |
openstackgerrit | Merged openstack/openstack-ansible-repo_build stable/pike: Ensure that all release files are in the manifest https://review.openstack.org/529088 | 16:04 |
*** zkynet has quit IRC | 16:09 | |
*** DanyC has quit IRC | 16:11 | |
*** zkynet has joined #openstack-ansible | 16:12 | |
*** hw_wutianwei has quit IRC | 16:14 | |
odyssey4me | MikeW you'd need to create a host group by implementing something like https://github.com/openstack/openstack-ansible/blob/master/inventory/env.d/etcd.yml in your /etc/openstack_deploy/env.d folder (create one if you don't already have one) | 16:20 |
odyssey4me | then you can use the applicable host group in your conf.d/openstack_user_config to set which hosts you want the containers on | 16:20 |
odyssey4me | an example which matches up to that file is https://github.com/openstack/openstack-ansible/blob/master/etc/openstack_deploy/conf.d/etcd.conf.example | 16:21 |
mwynne | odyssey4me: Question for you. How can I specify the MTU of the lxc network (eth0, 10.0.3.0 network) that's created in all the containers? | 16:25 |
mwynne | odyssey4me: container_mtu for each of vxlan, mgmt, and vlan networks isn't sufficient in my case. I'm assuming that's possible somehow? | 16:27 |
mwynne | odyssey4me: And if I don't want to use cinder is it possible to just remove the storage_hosts section of the config? | 16:31 |
*** armaan has joined #openstack-ansible | 16:37 | |
openstackgerrit | Hugh Saunders proposed openstack/openstack-ansible-tests master: Cope with disappearing files when compressing https://review.openstack.org/529109 | 16:37 |
MikeW | odyssey4me Thanks a ton! The example I found earlier had way less information in it | 16:39 |
*** jvidal has quit IRC | 16:43 | |
*** octo-fs has quit IRC | 16:43 | |
*** vnogin has quit IRC | 16:49 | |
*** octo-fs has joined #openstack-ansible | 16:55 | |
ivve | yo, during repobuild it's trying to fetch molteniron which fails, is there a way to skip it? can't seems to find it (thought it was the requirements files) | 16:56 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/pike: Update repo_build role SHA for manifest fix https://review.openstack.org/529115 | 17:00 |
odyssey4me | ivve molteniron should be skipped unless you've used the option to build all wheels, or you have hosts in its host group | 17:01 |
odyssey4me | hwoarang mgariepy could you peek at https://review.openstack.org/529115 please? :) | 17:01 |
hwoarang | let me check | 17:02 |
*** fatdragon has joined #openstack-ansible | 17:02 | |
odyssey4me | thanks | 17:02 |
*** DanyC has joined #openstack-ansible | 17:04 | |
*** DanyC_ has joined #openstack-ansible | 17:05 | |
*** DanyC has quit IRC | 17:08 | |
mwynne | odyssey4me: Any help with MTU stuff? | 17:10 |
ivve | odyssey4me: thats the wierd part, i don't. reran it without changes. now it was skipped.. so strange | 17:12 |
ivve | and now it failed in building wheels. it really doesn't want me to deploy on centos | 17:15 |
*** goldenfri has joined #openstack-ansible | 17:15 | |
jmccrory | mwynne https://github.com/openstack/openstack-ansible-lxc_hosts/blob/stable/pike/defaults/main.yml#L64 does this not work? | 17:19 |
*** zkynet has quit IRC | 17:20 | |
*** cshen has joined #openstack-ansible | 17:21 | |
*** epalper has quit IRC | 17:21 | |
mwynne | jmccrory: can I just change that in user_variables? | 17:21 |
mwynne | That looks like what I want | 17:21 |
jmccrory | yes | 17:21 |
*** sxc731 has quit IRC | 17:22 | |
*** gkadam has quit IRC | 17:22 | |
*** SmearedBeard has quit IRC | 17:24 | |
*** zkynet has joined #openstack-ansible | 17:26 | |
mwynne | jmccrory: Great, thanks! | 17:27 |
mwynne | I'm following the Pike installation gude (16.0.5) and this task is timing out: TASK [lxc_hosts : Ensure that the LXC cache has been prepared] | 17:28 |
mwynne | 60 retries and it fails. | 17:29 |
*** zkynet has quit IRC | 17:30 | |
*** mbuil has quit IRC | 17:31 | |
*** zkynet has joined #openstack-ansible | 17:31 | |
*** zkynet has quit IRC | 17:36 | |
openstackgerrit | Jimmy McCrory proposed openstack/openstack-ansible-os_cinder master: Configure backends from API host https://review.openstack.org/529122 | 17:39 |
openstackgerrit | Jimmy McCrory proposed openstack/openstack-ansible master: Reorder cinder service installs https://review.openstack.org/528140 | 17:41 |
mwynne | jmccrory: I don't need cinder for my deployment. Apart from removing the storage host section in my configuration, do I need to do anything else? | 17:42 |
jmccrory | mwynne you can remove any containers if they were already created and remove them from the inventory (scripts/inventory-manage.py) if they exist there | 17:44 |
mwynne | jmccrory: Great, thanks. | 17:50 |
*** cshen has quit IRC | 17:58 | |
*** sxc731 has joined #openstack-ansible | 18:15 | |
ivve | odyssey4me: did you get that log for the ocata build on centos? | 18:16 |
odyssey4me | ivve nope, I've been doing other work | 18:16 |
ivve | im running a build of my own and probably ran into the same thing while building libvirt-python | 18:17 |
MikeW | odyssey4me Hey thanks again that definitely was the right direction. I think I may have broken something elsewhere in my environment getting an error on line 41 of the main.yml in lxc_container_create role not sure what it's trying to gather. If I know what it's doing I can probably debug myself | 18:17 |
ivve | odyssey4me: if you want i can put it in a pastebin, how long up do you need it to be (its really long) | 18:18 |
odyssey4me | ivve if you can find the actual error for the broken wheel build, that will do | 18:18 |
*** jvidal has joined #openstack-ansible | 18:18 | |
*** chyka has joined #openstack-ansible | 18:18 | |
odyssey4me | ivve is that centos too? | 18:19 |
ivve | odyssey4me: yesbox | 18:19 |
ivve | probably found a bug for centos7 + pike as well | 18:19 |
ivve | (stable) | 18:19 |
ivve | although i don't have the logs anymore :( | 18:19 |
ivve | but i have a workaround | 18:19 |
odyssey4me | ok, let's look at ocata first - then we can discuss pike | 18:20 |
ivve | https://hastebin.com/apoqovoxaj.bash | 18:22 |
ivve | i guess thats a start | 18:22 |
*** armaan has quit IRC | 18:24 | |
*** hamza21 has joined #openstack-ansible | 18:25 | |
*** rmcall has joined #openstack-ansible | 18:30 | |
odyssey4me | hmm, it might be missing a library or something | 18:31 |
odyssey4me | probably a package missing | 18:31 |
ivve | alright | 18:31 |
odyssey4me | lemme just finish this other stuff then I can turn back to that | 18:31 |
ivve | sure thing | 18:31 |
odyssey4me | if you can poke a bit at it, maybe do some research, you might find it before I do :) | 18:32 |
odyssey4me | the constraint here is that we can't change to a newer version - we must only use the version set in upper constraints | 18:32 |
odyssey4me | a newer version has not been tested by any openstack for ocata | 18:32 |
ivve | aye some guy was able to fix it with setting libvirt_python>=3.5.0 in global-requirements-pint.txt | 18:32 |
*** cshen has joined #openstack-ansible | 18:33 | |
odyssey4me | yes, that is not an option - it presents far too much risk to stable environments | 18:33 |
odyssey4me | this used to work, so something has changed - and it's most likely a missing package related to qemu/libvirt | 18:33 |
odyssey4me | https://bugzilla.redhat.com/show_bug.cgi?id=1217398 came up, but doesn't have much of a conclusion | 18:34 |
openstack | bugzilla.redhat.com bug 1217398 in libvirt-python "[1.2.13] [Solved] Missing type converters during build" [High,Closed: nextrelease] - Assigned to libvirt-maint | 18:34 |
odyssey4me | these errors are important though: ERROR: failed virConnectSecretEventRegisterAny | 18:34 |
odyssey4me | ERROR: failed virStorageVolGetInfoFlags | 18:34 |
*** hamza21 has quit IRC | 18:37 | |
*** hamza21 has joined #openstack-ansible | 18:37 | |
ivve | well its not installed on the host | 18:40 |
ivve | libvirt-python that is | 18:40 |
ivve | https://review.openstack.org/#/c/517891/ | 18:41 |
ivve | just finding other related stuff | 18:42 |
*** jvidal has quit IRC | 18:43 | |
*** chyka has quit IRC | 18:45 | |
*** hamza21 has quit IRC | 18:48 | |
*** chyka_ has joined #openstack-ansible | 18:49 | |
*** hamza21 has joined #openstack-ansible | 18:49 | |
*** chyka_ has quit IRC | 18:49 | |
*** chyka_ has joined #openstack-ansible | 18:50 | |
*** chyka_ has quit IRC | 18:54 | |
ivve | odyssey4me: i gotta run, please notify me if you find anything. the issue for pike however was that rabbitcontainers (i guess all containers) had $HOSTNAME in env. so broker tried to start on controller node hostname instead of container hostname, was solved with unsetting hostname variable. can't really find a way to set (or unset) it properly. lxcconfig had the proper settings but env kept getting through. i guess it somehow | 18:56 |
ivve | gets sourced somewhere.. anyway that installation also encountered other stuff once that was solved, had to do with mysql credentials but i didn't persue that and went for ocata instead | 18:56 |
*** fatdragon has quit IRC | 18:57 | |
*** armaan has joined #openstack-ansible | 18:57 | |
*** fatdragon has joined #openstack-ansible | 18:58 | |
mwynne | ivve: Are these issues with the 16.0.5 pike installation? | 18:58 |
ivve | mwynne: on centos7 | 18:59 |
mwynne | Oh, ok. | 18:59 |
ivve | :) | 18:59 |
*** poopcat has joined #openstack-ansible | 19:00 | |
*** fatdragon has quit IRC | 19:02 | |
MikeW | Hey I'm getting this error on lxc-containers-create when trying to generate some custom containers: https://pastebin.com/CwFj1ESL what am I missing? | 19:03 |
*** gkadam has joined #openstack-ansible | 19:03 | |
*** poopcat1 has joined #openstack-ansible | 19:04 | |
*** poopcat has quit IRC | 19:07 | |
ivve | pike on ubuntu is flawless :) | 19:11 |
*** chyka has joined #openstack-ansible | 19:12 | |
mwynne | ivve: you say that... but I just got this: http://paste.openstack.org/show/629363/ | 19:12 |
ivve | odyssey4me: so the container has this one installed: libvirt-devel 3.2.0 14.el7_4.5 | 19:13 |
mwynne | I don't need tempest, but building it's venv failed. | 19:13 |
ivve | (x86_64) | 19:14 |
*** shardy has quit IRC | 19:14 | |
ivve | oh noes :P | 19:14 |
*** alanmeadows has quit IRC | 19:15 | |
mwynne | I seem to get "random" failures like this and I have no idea why. | 19:15 |
*** alanmeadows has joined #openstack-ansible | 19:15 | |
mwynne | How do I go about debugging that issue? | 19:16 |
mwynne | Is there a log somewhere for this stuff? | 19:16 |
*** chyka has quit IRC | 19:17 | |
*** fatdragon has joined #openstack-ansible | 19:18 | |
odyssey4me | ivve we've hit that rabbit issue before - and it got solved, so I wonder how that came back... which branch was that? | 19:19 |
ivve | used stable/pike when i cloned | 19:21 |
ivve | and that was yesterday | 19:21 |
ivve | so im guessing 17....b2 | 19:24 |
odyssey4me | uh, no 17 is queens IIRC... 17 is pike | 19:24 |
odyssey4me | *16 | 19:24 |
odyssey4me | but ok, just pike was good enough for the answer | 19:25 |
ivve | basically the latest tag 16 then. so 16.0.5? | 19:27 |
mwynne | http://paste.openstack.org/show/629367/ | 19:32 |
mwynne | I got this backtrace while the tempest venv installs | 19:32 |
mwynne | And installation fails | 19:32 |
mwynne | 16.0.5 ubuntu 1604 | 19:32 |
*** openstack has joined #openstack-ansible | 19:44 | |
*** ChanServ sets mode: +o openstack | 19:44 | |
*** gouthamr has quit IRC | 19:45 | |
odyssey4me | mwynne I think that backtrace is normal | 19:45 |
mwynne | odyssey4me: re-running seemed to work. Not sure why tempest failed the first time, but it worked the second (even with that backtrace). | 19:47 |
*** electrofelix has quit IRC | 19:48 | |
mwynne | jmccrory: I've remove the cinder storage_hosts section from my config becuase I don't need it. scripts/inventory-manage.py points to a new file now, but I'm unsure of what needs to be changed. Any pointers? | 19:53 |
*** Rodrigo_BR has joined #openstack-ansible | 19:59 | |
Rodrigo_BR | Hello ! Someone used the tag 16.0.5 for deploy a new multi node cluster ? | 19:59 |
mwynne | Rodrigo_BR: I'm in the process of doing that right now. | 19:59 |
*** gouthamr has joined #openstack-ansible | 20:00 | |
Rodrigo_BR | mwynne: nice ! Me too ... | 20:00 |
mwynne | Good luck | 20:01 |
*** gouthamr has quit IRC | 20:01 | |
jmccrory | mwynne if you see any cinder components with 'inventory-manage -l' remove them with 'inventory-manage -r' | 20:02 |
*** pedja has joined #openstack-ansible | 20:02 | |
Rodrigo_BR | wynne: I will post the result in 3 or 4 hours .... thanks and good luck. | 20:03 |
mwynne | jmccrory: How/where do I need to run that? `openstack-ansible inventory-manage -l`? | 20:04 |
jmccrory | inside your openstack-ansible folder ./scripts/inventory-manage.py | 20:05 |
jmccrory | https://docs.openstack.org/openstack-ansible/newton/developer-docs/inventory.html | 20:05 |
*** sxc731 has quit IRC | 20:06 | |
mwynne | thanks | 20:11 |
*** hybridpollo has joined #openstack-ansible | 20:16 | |
ivve | odyssey4me: i will try the libvirt_python>=3.5.0 just to see if it works as a workaround | 20:17 |
odyssey4me | ivve if you do that, rather do "libvirt-python==3.5.0" | 20:17 |
odyssey4me | >= makes it open ended, so what you install today and what you install tomorrow may be different | 20:17 |
*** gkadam has quit IRC | 20:18 | |
odyssey4me | the point of constraints is to ensure that it is *always* the same stuff | 20:18 |
ivve | roger | 20:18 |
mwynne | jmccrory: Can I do that after I've run the playbooks? | 20:20 |
mwynne | jmccrory: Or am I screwed now? | 20:20 |
mwynne | jmccrory: The cinder conatiner has already been deployed, etc.. | 20:22 |
*** hybridpollo has quit IRC | 20:22 | |
jmccrory | mwynne : you'll want to destroy the cinder containers before removing them from the inventory then | 20:23 |
*** hybridpollo has joined #openstack-ansible | 20:23 | |
mwynne | jmccrory: Ok. just a simple lxc-destroy? | 20:23 |
jmccrory | there's a playbook for that, lxc-containers-destroy.yml | 20:23 |
jmccrory | use --limit with that to destroy just the cinder containers | 20:24 |
*** armaan has quit IRC | 20:27 | |
mwynne | jmccrory: --limit cinder? | 20:28 |
jmccrory | mwynne --limit cinder_api_container,cinder_volumes_container | 20:29 |
mwynne | jmccrory: Thank you :) | 20:30 |
*** shardy has joined #openstack-ansible | 20:36 | |
*** octo-fs has quit IRC | 20:38 | |
*** armaan has joined #openstack-ansible | 20:38 | |
openstackgerrit | Merged openstack/openstack-ansible stable/ocata: designate variables for neutron integration https://review.openstack.org/528705 | 20:40 |
*** vnogin has joined #openstack-ansible | 20:44 | |
*** poison666 has joined #openstack-ansible | 20:45 | |
openstackgerrit | Fatih Degirmenci proposed openstack/openstack-ansible-os_heat master: Revert "Update static files" https://review.openstack.org/529147 | 20:52 |
openstackgerrit | Fatih Degirmenci proposed openstack/openstack-ansible-os_heat master: Revert "Update static files" https://review.openstack.org/529147 | 20:52 |
fdegir | evrardjp: odyssey4me: hwoarang: if you can take a look at this | 20:53 |
fdegir | evrardjp: odyssey4me: hwoarang: https://review.openstack.org/#/c/529147/ | 20:54 |
*** smatzek has quit IRC | 20:54 | |
fdegir | the commit message of the original change wasn't clear regarding the reason for update of the files | 20:54 |
odyssey4me | :/ Unfortunately evrardjp has not been updating those with every SHA bump, so now we're getting issues with them being out of date | 20:55 |
odyssey4me | me, thanks for doing that - apologies for the issue showing up in the first place | 20:56 |
odyssey4me | oh hang on , this is a revert | 20:56 |
odyssey4me | I'm confused | 20:56 |
openstackgerrit | Merged openstack/openstack-ansible-os_cinder master: tests: test-cinder-upgrades.sh: Remove the exit trap https://review.openstack.org/528472 | 20:56 |
fdegir | odyssey4me: yes, the change causes issues with heat | 20:59 |
odyssey4me | fdegir oh, I see what happened here - he updated it to a version later than the version we're pinned to | 20:59 |
fdegir | I've been trying different things and finally tried reverting locally and the issue seems to be solved | 20:59 |
odyssey4me | ok, I think it's time we do a general update - we can't have the roles test off the head of master, but the integrated repo not do the same | 21:00 |
fdegir | so, what should be the way forward for the heat issue? | 21:01 |
fdegir | does that revert look good or? | 21:01 |
odyssey4me | I'll push up a patch now to get the integrated repo sorted out properly. | 21:01 |
fdegir | cause I tried latest heat with latest os_heat role and it doesn't even deploy | 21:01 |
odyssey4me | yeah, that's understandable | 21:02 |
*** chyka has joined #openstack-ansible | 21:02 | |
odyssey4me | weird though, because master uses the latest role :/ | 21:02 |
fdegir | but do you exercise the commands that fail for us | 21:02 |
fdegir | or what heat test cases are run | 21:02 |
odyssey4me | ah, probably not | 21:02 |
fdegir | I was looking at this: https://docs.openstack.org/openstack-ansible-os_tempest/latest/ | 21:03 |
fdegir | and talking to hwoarang but I am not sure if gates override what's set in tempest | 21:03 |
fdegir | I mean aio | 21:03 |
fdegir | in the meantime, I am trying the change before evrardjp's and pin to that one in opnfv | 21:04 |
fdegir | we currently pinned to evrardjp's so the change reverting is probably not crucial for us anymore but might be important for someone else | 21:05 |
*** chyka has quit IRC | 21:06 | |
odyssey4me | I have some work in the pipeline which I haven't been managing to get to which will make this all a lot simpler. We'll be able to grab the various files straight out of the venv instead of templating them. I just need some time, or a clone. ;) | 21:06 |
fdegir | ok | 21:07 |
fdegir | whatever you do will be (ab)used by us and will come back to you :) | 21:07 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_barbican master: Update paste, policy and rootwrap configurations 2017-12-19 https://review.openstack.org/529149 | 21:08 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_ceilometer master: [New files - needs update] Update paste, policy and rootwrap configurations 2017-12-19 https://review.openstack.org/529151 | 21:09 |
odyssey4me | well, if you have some hands - I can put a sample together for one repo and perhaps your many hands can get it done sooner? | 21:09 |
odyssey4me | hmm, these scripts are a bit dated | 21:09 |
odyssey4me | yet another thing to fix :/ | 21:10 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_heat master: Update paste, policy and rootwrap configurations 2017-12-19 https://review.openstack.org/529153 | 21:10 |
fdegir | I really wanted to do that my hands is full of setting 3rd party ci for osa | 21:10 |
odyssey4me | hah, fair enough | 21:11 |
fdegir | that's how we hit this issue, while setting up periodic job against osa master | 21:11 |
fdegir | followed by verify jobs | 21:11 |
odyssey4me | well - I'm going on leave for three weeks from the end of this week - so best we get this working with the current method before then ;) | 21:11 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_keystone master: [New files - needs update] Update paste, policy and rootwrap configurations 2017-12-19 https://review.openstack.org/529154 | 21:11 |
fdegir | anything works | 21:11 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron master: Update paste, policy and rootwrap configurations 2017-12-19 https://review.openstack.org/529156 | 21:12 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova master: Update paste, policy and rootwrap configurations 2017-12-19 https://review.openstack.org/529157 | 21:14 |
*** hamza21 has quit IRC | 21:15 | |
*** armaan has quit IRC | 21:16 | |
*** armaan_ has joined #openstack-ansible | 21:17 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_tacker master: [New files - needs update] Update paste, policy and rootwrap configurations 2017-12-19 https://review.openstack.org/529159 | 21:18 |
*** DanyC_ has quit IRC | 21:19 | |
*** vnogin has quit IRC | 21:21 | |
openstackgerrit | Merged openstack/openstack-ansible-os_neutron stable/ocata: Add [designate] section in neutron.conf https://review.openstack.org/528700 | 21:22 |
*** armaan_ has quit IRC | 21:28 | |
*** armaan has joined #openstack-ansible | 21:29 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Update all SHAs for Queens 2017-12-19 https://review.openstack.org/529163 | 21:30 |
odyssey4me | hwoarang fdegir mgariepy ^ that appears to be sorely needed, we haven't updated in a month | 21:31 |
odyssey4me | jmccrory ^ | 21:32 |
odyssey4me | alright, I'm out for the night | 21:33 |
mwynne | Is the order of the includes in the setup-openstack playbook the order everything's executed in? | 21:34 |
mwynne | This is taking a very long time for me, and I'm only on nova containers :S | 21:34 |
*** DanyC has joined #openstack-ansible | 21:41 | |
openstackgerrit | Merged openstack/openstack-ansible-os_neutron stable/pike: Add [designate] section in neutron.conf https://review.openstack.org/528752 | 21:42 |
*** armaan has quit IRC | 21:48 | |
*** armaan has joined #openstack-ansible | 21:48 | |
*** armaan has quit IRC | 22:05 | |
*** armaan has joined #openstack-ansible | 22:06 | |
*** mma has quit IRC | 22:11 | |
*** mma has joined #openstack-ansible | 22:12 | |
*** mma has quit IRC | 22:16 | |
*** cshen has quit IRC | 22:17 | |
mwynne | fatal: [controller-7_neutron_agents_container-fa6bf641]: FAILED! => {"changed": true, "failed": true, "module_stderr": "mesg: ttyname failed: Inappropriate ioctl for device\n", "module_stdout | 22:24 |
mwynne | ": "", "msg": "MODULE FAILURE", "rc": 245} | 22:25 |
mwynne | Can anyone tell me what this means? | 22:25 |
mwynne | Does it not like my TERM? | 22:37 |
*** shardy has quit IRC | 22:37 | |
*** marst has quit IRC | 22:41 | |
*** vnogin has joined #openstack-ansible | 22:59 | |
*** poopcat1 is now known as poopcat | 23:10 | |
*** DanyC has quit IRC | 23:24 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!