| *** charcol has joined #openstack-ansible | 00:01 | |
| *** yifei has joined #openstack-ansible | 00:01 | |
| *** smatzek has quit IRC | 00:04 | |
| logan- | mhayden: yeah connection: local is interesting. iirc one of the problems i ran into with https://review.openstack.org/#/c/429019/ was host connection stuff. been thinking about giving it another spin | 00:05 |
|---|---|---|
| logan- | i can turn the limestone ci on for stable/ocata once https://review.openstack.org/#/c/489301/ merges, so push the button if it looks good please :) | 00:06 |
| cloudnull | one button pushed, just need one more :P | 00:10 |
| *** acormier has joined #openstack-ansible | 00:11 | |
| logan- | ty both of you | 00:12 |
| cloudnull | boom ! | 00:12 |
| cloudnull | jmccrory: | 00:12 |
| *** chyka has quit IRC | 00:13 | |
| *** acormier has quit IRC | 00:15 | |
| *** vishwana_ has joined #openstack-ansible | 00:18 | |
| *** vishwanathj has quit IRC | 00:22 | |
| *** acormier has joined #openstack-ansible | 00:26 | |
| openstackgerrit | Logan V proposed openstack/openstack-ansible stable/ocata: [DNM] Test Limestone 3rd party CI on Ocata https://review.openstack.org/488498 | 00:29 |
| logan- | great, the 'on patchset' trigger for ocata works | 00:30 |
| *** pmannidi has joined #openstack-ansible | 00:31 | |
| *** perniciouscaffei has joined #openstack-ansible | 00:32 | |
| *** thorst_afk has joined #openstack-ansible | 00:46 | |
| *** thorst_afk has quit IRC | 00:54 | |
| *** hw_wutianwei has joined #openstack-ansible | 00:56 | |
| *** woodard has joined #openstack-ansible | 01:17 | |
| openstackgerrit | Merged openstack/openstack-ansible stable/ocata: Lists of user variables files in bootstrap-host role https://review.openstack.org/489301 | 01:29 |
| *** thorst_afk has joined #openstack-ansible | 01:29 | |
| *** phalmos has quit IRC | 01:34 | |
| *** thorst_afk has quit IRC | 01:38 | |
| *** thorst_afk has joined #openstack-ansible | 01:38 | |
| *** thorst_afk has quit IRC | 01:43 | |
| *** https_GK1wmSU has joined #openstack-ansible | 01:46 | |
| *** https_GK1wmSU has left #openstack-ansible | 01:47 | |
| *** thorst_afk has joined #openstack-ansible | 01:55 | |
| *** thorst_afk has quit IRC | 01:55 | |
| *** thorst_afk has joined #openstack-ansible | 02:11 | |
| *** phalmos has joined #openstack-ansible | 02:17 | |
| *** acormier has quit IRC | 02:19 | |
| *** galstrom_zzz is now known as galstrom | 02:19 | |
| *** acormier has joined #openstack-ansible | 02:19 | |
| *** acormier has quit IRC | 02:24 | |
| *** thorst_afk has quit IRC | 02:25 | |
| *** galstrom is now known as galstrom_zzz | 02:30 | |
| *** hybridpollo has quit IRC | 02:38 | |
| *** esberglu has joined #openstack-ansible | 02:39 | |
| *** hybridpolio has joined #openstack-ansible | 02:40 | |
| mw_ | cloudnull: Is there a way to teardown/delete/undo what openstack-ansible creates? I've seen references to a teardown script but it doesn't seem to exist in the repo anymore? | 02:40 |
| *** galstrom_zzz is now known as galstrom | 02:44 | |
| *** esberglu has quit IRC | 02:44 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Convert vars in files to host_vars https://review.openstack.org/489445 | 02:44 |
| *** hybridpollo has joined #openstack-ansible | 02:46 | |
| *** hybridpolio has quit IRC | 02:47 | |
| *** esberglu has joined #openstack-ansible | 02:49 | |
| *** raddaoui has quit IRC | 02:54 | |
| *** hybridpollo has quit IRC | 03:01 | |
| *** galstrom is now known as galstrom_zzz | 03:08 | |
| *** lbragstad_ has joined #openstack-ansible | 03:14 | |
| *** lbragstad has quit IRC | 03:14 | |
| *** hybridpollo has joined #openstack-ansible | 03:17 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Convert vars in files to host_vars https://review.openstack.org/489445 | 03:21 |
| *** gouthamr has quit IRC | 03:28 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Convert vars in files to host_vars https://review.openstack.org/489445 | 03:36 |
| *** marst has joined #openstack-ansible | 03:36 | |
| *** charcol has quit IRC | 03:36 | |
| *** udesale has joined #openstack-ansible | 03:43 | |
| *** phalmos has quit IRC | 03:44 | |
| *** charcol has joined #openstack-ansible | 03:53 | |
| *** phalmos has joined #openstack-ansible | 04:01 | |
| *** poopcat has quit IRC | 04:04 | |
| LiterateHawk | Is there a way to split up what haproxy binds to and what the admin URLs are? We have an external SSL terminator, but horizon sets the spice URL to the external lb address and not the SSL address. I can't seem to figure out what I need for that | 04:05 |
| LiterateHawk | I cen set external_lb_address to the SSL address, but haproxy won't properly bind | 04:08 |
| *** hybridpollo has quit IRC | 04:23 | |
| *** gkadam has joined #openstack-ansible | 04:23 | |
| *** LiterateHawk has quit IRC | 04:23 | |
| *** thorst_afk has joined #openstack-ansible | 04:26 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Convert vars in files to host_vars https://review.openstack.org/489445 | 04:31 |
| *** thorst_afk has quit IRC | 04:31 | |
| *** udesale__ has joined #openstack-ansible | 04:32 | |
| *** udesale has quit IRC | 04:34 | |
| cloudnull | literateHawk you can set the spice URL (console address) to be something else. | 04:54 |
| cloudnull | the console addr is a proxy address so you can change that to whatever's convenient | 04:55 |
| cloudnull | https://github.com/openstack/openstack-ansible/blob/215bb56fb3666446ab34c33eb436d9fd8afeed28/group_vars/all/haproxy.yml#L154-L166 | 04:56 |
| *** chyka has joined #openstack-ansible | 04:58 | |
| *** chyka has quit IRC | 05:02 | |
| *** peri has joined #openstack-ansible | 05:07 | |
| *** charcol has quit IRC | 05:12 | |
| *** charcol has joined #openstack-ansible | 05:12 | |
| peri | hi, having a question on running osa in developer_mode. I'm trying to test https://review.openstack.org/#/c/480128/ for ODL/OVS integration | 05:13 |
| peri | so I hope this can be tested in developer mode, without depending on git url specified in ansible-role-requirements.yml | 05:14 |
| peri | Can someone help me with pointers how it can be tested ? | 05:15 |
| *** https___GK1wmSU has joined #openstack-ansible | 05:21 | |
| *** https__GK1wmSU has joined #openstack-ansible | 05:21 | |
| *** https___GK1wmSU has left #openstack-ansible | 05:23 | |
| *** https__GK1wmSU has left #openstack-ansible | 05:23 | |
| openstackgerrit | Merged openstack/openstack-ansible stable/newton: Fix bug of unbound variable in scripts-library.sh https://review.openstack.org/489260 | 05:25 |
| *** chyka has joined #openstack-ansible | 05:29 | |
| *** chyka has quit IRC | 05:34 | |
| *** ivveh has quit IRC | 05:59 | |
| *** phalmos has quit IRC | 06:03 | |
| *** drifterza has joined #openstack-ansible | 06:03 | |
| *** esberglu has quit IRC | 06:06 | |
| *** esberglu has joined #openstack-ansible | 06:06 | |
| *** esberglu has quit IRC | 06:15 | |
| *** tobberydberg has joined #openstack-ansible | 06:23 | |
| *** tobberydberg has quit IRC | 06:23 | |
| *** tobberydberg has joined #openstack-ansible | 06:24 | |
| *** thorst_afk has joined #openstack-ansible | 06:28 | |
| *** perniciouscaffei has quit IRC | 06:28 | |
| *** thorst_afk has quit IRC | 06:32 | |
| *** mbuil has joined #openstack-ansible | 06:35 | |
| *** peri has quit IRC | 06:59 | |
| *** epalper has joined #openstack-ansible | 07:00 | |
| *** epalper has quit IRC | 07:00 | |
| *** peri has joined #openstack-ansible | 07:01 | |
| *** radafshar1983 has quit IRC | 07:06 | |
| *** pcaruana has joined #openstack-ansible | 07:06 | |
| *** radafshar1983 has joined #openstack-ansible | 07:06 | |
| *** markus_z has joined #openstack-ansible | 07:10 | |
| *** yolanda__ has joined #openstack-ansible | 07:14 | |
| *** yolanda__ is now known as yolanda | 07:15 | |
| *** charcol has quit IRC | 07:15 | |
| *** Oku_OS-away is now known as Oku_OS | 07:28 | |
| *** gkadam is now known as gkadam-afk | 07:33 | |
| *** sxc731 has joined #openstack-ansible | 07:41 | |
| *** sxc731 has left #openstack-ansible | 07:41 | |
| *** sxc731 has joined #openstack-ansible | 07:42 | |
| *** armaan has joined #openstack-ansible | 07:44 | |
| hw_wutianwei | hi when I run openstack-ansible, I meet some issue in install pip | 08:00 |
| hw_wutianwei | here is the log http://paste.openstack.org/show/617088/ | 08:00 |
| *** jvidal has joined #openstack-ansible | 08:04 | |
| evrardjp | good morning | 08:12 |
| hw_wutianwei | could anyone help me? | 08:14 |
| evrardjp | what's your issue hw_wutianwei? | 08:15 |
| evrardjp | I have no log today... | 08:15 |
| evrardjp | I mean no IRC log | 08:15 |
| *** fxpester has joined #openstack-ansible | 08:16 | |
| *** yolanda has quit IRC | 08:17 | |
| *** mbuil has quit IRC | 08:18 | |
| *** yolanda has joined #openstack-ansible | 08:18 | |
| *** mbuil has joined #openstack-ansible | 08:18 | |
| hw_wutianwei | evrardjp: I meet some issue in install pip | 08:20 |
| hw_wutianwei | here is the log http://paste.openstack.org/show/617088/ | 08:20 |
| hw_wutianwei | evrardjp: when run openstack-ansible setup-hosts | 08:21 |
| evrardjp | oh yeah setuptools 36.2.0 | 08:22 |
| evrardjp | so | 08:22 |
| evrardjp | 36.2.0 was busted and there was a tiny fraction of time we didn't pin it | 08:22 |
| evrardjp | maybe you deployed during that time | 08:22 |
| evrardjp | the problem of this version, IIRC what odyssey4me told me: it was hard to upgrade/downgrade from it when doing something else at the same time -- example installing other packages | 08:23 |
| evrardjp | hw_wutianwei: so, two choices for you, depending on the state of your deploy | 08:24 |
| evrardjp | 1) start from scratch if you can afford it | 08:24 |
| evrardjp | 2) cleanup manually | 08:24 |
| evrardjp | (using ansible) | 08:24 |
| evrardjp | I'd myself choose the cleanup :p | 08:24 |
| evrardjp | hw_wutianwei: also, don't forget to update your repos before redeploying? | 08:25 |
| lvdombrkr | hello everyone, I have issue with openstack-ansible 15.1.7, after setup-openstack.yml failed once, there is problem to rerun setup (failed tasks which previously was done) | 08:26 |
| *** thorst_afk has joined #openstack-ansible | 08:27 | |
| evrardjp | lvdombrkr: what's your issue? | 08:27 |
| *** markvoelker has quit IRC | 08:30 | |
| *** markvoelker has joined #openstack-ansible | 08:31 | |
| *** thorst_afk has quit IRC | 08:32 | |
| hw_wutianwei | evrardjp: I don't have any idea how to cleanup manually (using ansible),could you give me some instruction? | 08:33 |
| lvdombrkr | evrardjp: i run openstack-ansible setup-openstack.yml it failed on infra1_glance_container-8e8b5fc9 PIP install, i reslolved problem with that task and rerun setup-openstack.yml | 08:33 |
| lvdombrkr | evardjp: after that failed keystone_container, os_keystone : Wait for services to be up, which actually before was succesfully complete | 08:34 |
| *** markvoelker has quit IRC | 08:35 | |
| armaan | hello, I am trying to deploy stable/mitaka and getting this error http://paste.openstack.org/show/617090/, I know that mitaka is eol now but I will really appreciate if someone can point out how can I fix this? | 08:36 |
| lvdombrkr | evardjp: so actually now each time when i try setup-openstack.yml TASK [os_keystone : Wait for services to be up] is failed | 08:37 |
| *** gkadam-afk is now known as gkadam | 08:38 | |
| lvdombrkr | evardjp: despite that in first running it was OK | 08:39 |
| evrardjp | armaan: are you running this with proper facts? Maybe you should cleanup your facts in /etc/openstack_deploy/ansible_facts and re-run the playbook | 08:39 |
| *** pbandark has joined #openstack-ansible | 08:40 | |
| evrardjp | lvdombrkr: could you check if you containers are alright? | 08:40 |
| evrardjp | hw_wutianwei: I'd check the setuptool version installed on your container/hosts | 08:41 |
| armaan | evrardjp: tried that ... bit same result | 08:42 |
| evrardjp | hw_wutianwei: you could check on the host, by trying ansible -m shell -a "easy_install --version" hosts | 08:42 |
| evrardjp | armaan: try running with more verbosity | 08:42 |
| evrardjp | armaan: -vvv for example | 08:42 |
| armaan | ok | 08:42 |
| evrardjp | and then maybe ANSIBLE_DEBUG=true (...) | 08:42 |
| lvdombrkr | evarjdjp: yes, container ir up and running | 08:44 |
| *** electrofelix has joined #openstack-ansible | 08:44 | |
| hw_wutianwei | evrardjp: controller00 | SUCCESS | rc=0 >> | 08:45 |
| hw_wutianwei | setuptools 36.2.0 from /usr/local/lib/python2.7/dist-packages (Python 2.7) | 08:45 |
| armaan | evrardjp: ok, btw I have not seen Travis in OSA irc channel from some time. Is he not active here these days. I wanted to ask him whether I can use his mitaka branch to deploy ovs + mitaka? | 08:45 |
| evrardjp | hw_wutianwei: that's your wrong package. | 08:45 |
| evrardjp | hw_wutianwei: I guess there are two things to do: Find out why you have it (did you install something on your host, not in a venv, with pip?) | 08:46 |
| evrardjp | and the second is removing by using a version that's properly working :D | 08:46 |
| evrardjp | that's an upstream bug, we are just victims here :D | 08:46 |
| evrardjp | armaan: Travis is not involved in OpenStack anymore | 08:46 |
| hw_wutianwei | maybe, it was | 08:47 |
| evrardjp | hw_wutianwei: ? | 08:47 |
| hw_wutianwei | it was install when install operating system | 08:47 |
| armaan | ohhhh :/ | 08:47 |
| evrardjp | can someone have a look at lvdombrkr issue? | 08:48 |
| hw_wutianwei | so we need to uninstall this package? | 08:48 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-ops master: Re-run setup-hosts before re-deploy. https://review.openstack.org/489531 | 08:49 |
| evrardjp | hw_wutianwei: yes, and install a proper version that matches the constraints in your branch | 08:50 |
| evrardjp | that would be better. | 08:50 |
| hw_wutianwei | I use master, so which version is ok? | 08:50 |
| evrardjp | hw_wutianwei: https://github.com/openstack/openstack-ansible/blob/master/global-requirement-pins.txt#L13 | 08:52 |
| evrardjp | 33.1.1 | 08:52 |
| hw_wutianwei | evrardjp: ok | 08:52 |
| hw_wutianwei | evrardjp: thanks, I will try | 08:53 |
| evrardjp | hw_wutianwei: so yeah you need to uninstall this version everywhere, and install that version instead. | 08:54 |
| evrardjp | hw_wutianwei: you deployed master like last week or end of two weeks ago, right? :D | 08:54 |
| evrardjp | this was a nightmare :D | 08:54 |
| evrardjp | ask odyssey4me ;) | 08:54 |
| hw_wutianwei | evrardjp: yep | 08:55 |
| lvdombrkr | anybody any ideas about my issue? | 09:02 |
| neith | lvdombrkr: check keystone log ? | 09:03 |
| *** armaan has quit IRC | 09:06 | |
| *** armaan has joined #openstack-ansible | 09:07 | |
| *** sxc731 has quit IRC | 09:18 | |
| *** armaan has quit IRC | 09:22 | |
| *** armaan has joined #openstack-ansible | 09:23 | |
| lvdombrkr | neith: there is no any errors... | 09:24 |
| *** Oku_OS is now known as Oku_OS-away | 09:25 | |
| armaan | evrardjp: Should i use mitaka-eol branch or a 13.* tag to build mitaka setup? | 09:34 |
| *** yifei has quit IRC | 09:35 | |
| *** Oku_OS-away is now known as Oku_OS | 09:37 | |
| evrardjp | mitaka is eol, is mitaka-eol should be the latest tag. | 09:38 |
| *** marst_ has joined #openstack-ansible | 09:38 | |
| *** marst has quit IRC | 09:38 | |
| armaan | evrardjp: sorry, that was a stupid question. By mistake i assumed that mitaka-eol is a branch. sorry for the noise | 09:40 |
| evrardjp | ahah no worries :) | 09:40 |
| *** esberglu has joined #openstack-ansible | 09:48 | |
| *** esberglu has quit IRC | 09:53 | |
| *** udesale__ has quit IRC | 09:56 | |
| *** stuartgr has joined #openstack-ansible | 10:04 | |
| *** mugsie has quit IRC | 10:22 | |
| *** mugsie has joined #openstack-ansible | 10:25 | |
| *** mugsie has quit IRC | 10:25 | |
| *** mugsie has joined #openstack-ansible | 10:25 | |
| *** kristian__ has joined #openstack-ansible | 10:25 | |
| *** chyka has joined #openstack-ansible | 10:25 | |
| *** thorst_afk has joined #openstack-ansible | 10:28 | |
| *** chyka has quit IRC | 10:30 | |
| *** mugsie has quit IRC | 10:31 | |
| *** markvoelker has joined #openstack-ansible | 10:31 | |
| *** thorst_afk has quit IRC | 10:32 | |
| *** mugsie has joined #openstack-ansible | 10:33 | |
| *** mugsie has quit IRC | 10:33 | |
| *** mugsie has joined #openstack-ansible | 10:33 | |
| *** pmannidi has quit IRC | 10:38 | |
| *** yifei has joined #openstack-ansible | 10:46 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops master: Ensure openstack_deploy directory is create before copy https://review.openstack.org/488538 | 10:48 |
| *** yifei has quit IRC | 10:51 | |
| openstackgerrit | Merged openstack/openstack-ansible-ops master: Ensure openstack_deploy directory is create before copy https://review.openstack.org/488538 | 10:55 |
| odyssey4me | hw_wutianwei that issue was resolved in the last release, which tag/branch are you using? | 10:59 |
| odyssey4me | armaan note also that travis' work on OVS was done in newton, not mitaka | 11:01 |
| armaan | odyssey4me: Yes, but afaik he had a local branch for mitaka as well | 11:02 |
| *** smatzek has joined #openstack-ansible | 11:04 | |
| *** markvoelker has quit IRC | 11:05 | |
| *** penguintamer_ has joined #openstack-ansible | 11:10 | |
| *** penguintamer has quit IRC | 11:10 | |
| openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-os_swift master: [WIP] Implement uWSGI for Swift services https://review.openstack.org/486694 | 11:13 |
| *** drifterza1 has joined #openstack-ansible | 11:17 | |
| *** drifterza has quit IRC | 11:19 | |
| *** acormier has joined #openstack-ansible | 11:20 | |
| *** acormier has quit IRC | 11:25 | |
| *** markvoelker has joined #openstack-ansible | 11:30 | |
| *** esberglu has joined #openstack-ansible | 11:37 | |
| *** thorst_afk has joined #openstack-ansible | 11:40 | |
| *** acormier has joined #openstack-ansible | 11:42 | |
| *** esberglu has quit IRC | 11:42 | |
| *** pester has joined #openstack-ansible | 11:43 | |
| *** fxpester has quit IRC | 11:46 | |
| *** pester has quit IRC | 11:51 | |
| *** fxpester has joined #openstack-ansible | 11:52 | |
| *** ivveh has joined #openstack-ansible | 11:55 | |
| *** drifterza1 has quit IRC | 12:06 | |
| openstackgerrit | Juan Vidal Allende proposed openstack/openstack-ansible master: Add support for OpenDaylight deployment in neutron https://review.openstack.org/480131 | 12:10 |
| *** chyka has joined #openstack-ansible | 12:11 | |
| *** acormier has quit IRC | 12:13 | |
| *** acormier has joined #openstack-ansible | 12:14 | |
| *** chyka has quit IRC | 12:15 | |
| *** acormier has quit IRC | 12:18 | |
| *** drifterza has joined #openstack-ansible | 12:21 | |
| *** thorst_afk has quit IRC | 12:22 | |
| *** udesale has joined #openstack-ansible | 12:23 | |
| *** armaan has quit IRC | 12:23 | |
| *** esberglu has joined #openstack-ansible | 12:24 | |
| *** gkadam has quit IRC | 12:26 | |
| andymccr | dmsimard: on that liberasurecode bug Tim Burke has said that its a bug that was fixed upstream in 1.5.0 so do you think that would be enough to warrant a version bump? I guess its less critical now since whatever has changed in the build is working, but may still be worth bacporting | 12:33 |
| dmsimard | andymccr: Tim Burke ? Like the Red Hat VP ? | 12:35 |
| andymccr | dmsimard: no swiftstack pretty sure :) | 12:35 |
| dmsimard | Odd coincidence lol | 12:36 |
| andymccr | swift core dev. but if it makes the backport easier then sure then Red Hat VP :D | 12:36 |
| andymccr | https://bugs.launchpad.net/openstack-ansible/+bug/1707220 | 12:36 |
| openstack | Launchpad bug 1707220 in openstack-ansible "Swift Erasure Code fails with liberasurecode 1.4.0 on CentOS" [Undecided,New] | 12:36 |
| *** armaan has joined #openstack-ansible | 12:36 | |
| dmsimard | andymccr: I think we are going to update it anyway, it was a matter of getting knowledgeable folks from our end to weigh in | 12:37 |
| dmsimard | I'll ping again. | 12:38 |
| * dmsimard searches for BZ | 12:38 | |
| stuartgr | cloudnull: I'm trying the new multinode AIO build. The VMs all get 10.0.2.x addresses from dhcpd but the "Wait for container connectivity" step times out with connection refused on all VMs | 12:39 |
| *** esberglu has quit IRC | 12:39 | |
| andymccr | dmsimard: sweet :) more just a prod - nothing is on fire, thanks for looking into it again! | 12:40 |
| *** sxc731 has joined #openstack-ansible | 12:43 | |
| dmsimard | andymccr: you never figured out why it started happening all of a sudden huh ? And it's still reproduceable ? | 12:48 |
| andymccr | dmsimard: it is on an older image of CentOS7 | 12:50 |
| andymccr | newer builds seem ok | 12:50 |
| andymccr | but https://github.com/openstack/liberasurecode/commit/0962144 suggests it could be to do with the CPUs | 12:50 |
| andymccr | which was the bug fix linked to indicate the problem being fixed | 12:51 |
| *** electrofelix has quit IRC | 12:52 | |
| *** peri has quit IRC | 12:53 | |
| *** esberglu has joined #openstack-ansible | 12:55 | |
| *** woodard has quit IRC | 12:56 | |
| *** woodard has joined #openstack-ansible | 12:57 | |
| *** thorst_afk has joined #openstack-ansible | 12:57 | |
| *** yifei has joined #openstack-ansible | 12:57 | |
| *** electrofelix has joined #openstack-ansible | 12:58 | |
| *** kylek3h has joined #openstack-ansible | 13:01 | |
| *** evrardjp[m] has quit IRC | 13:02 | |
| *** csmart has quit IRC | 13:02 | |
| *** gouthamr has joined #openstack-ansible | 13:03 | |
| *** acormier has joined #openstack-ansible | 13:07 | |
| *** acormier has quit IRC | 13:11 | |
| *** lucasxu has joined #openstack-ansible | 13:20 | |
| *** drifterza has quit IRC | 13:21 | |
| *** LiterateHawk has joined #openstack-ansible | 13:21 | |
| cloudnull | stuartgr: are you able to check in on the vms with virtmanager? | 13:24 |
| cloudnull | are they pxe booting ? | 13:24 |
| cloudnull | i've had a couple issues with the isc-dhcpd server where that would happen, restarting the server seems to fix it | 13:25 |
| jrosser_ | he's afk right now | 13:25 |
| jrosser_ | one of them did eventually start | 13:25 |
| jrosser_ | but we just fight w bit with virt manager not connecting | 13:25 |
| cloudnull | mornings btw | 13:26 |
| cloudnull | jrosser_: ah. | 13:26 |
| cloudnull | I wonder if we could implement a stand alone console for the VMs something like shell-in-a-box ? | 13:27 |
| cloudnull | I just use virtmanager, but i can see having access to a stand-alone console could be nice | 13:27 |
| jrosser_ | remember this from last time that theres something cryptic we had to do to get virtmanager going - just forgotton what that was :) | 13:30 |
| *** drifterza has joined #openstack-ansible | 13:32 | |
| *** jwitko_ has joined #openstack-ansible | 13:36 | |
| stuartgr | Looking at the nginx access log, it looks like swift1 and swift2 requested their pxeboot files but the others didn't. But syslog shows 9 VMs getting addresses from dhcpd. | 13:36 |
| *** jwitko has joined #openstack-ansible | 13:36 | |
| openstackgerrit | Merged openstack/openstack-ansible-ops master: Convert vars in files to host_vars https://review.openstack.org/489445 | 13:36 |
| *** jwitko__ has joined #openstack-ansible | 13:37 | |
| *** cmart has quit IRC | 13:40 | |
| *** csmart has joined #openstack-ansible | 13:40 | |
| cloudnull | so the vms are running ? | 13:40 |
| cloudnull | and built successfully ? | 13:40 |
| cloudnull | but there's no networking ? | 13:40 |
| *** jwitko has quit IRC | 13:41 | |
| *** jwitko has joined #openstack-ansible | 13:41 | |
| *** jwitko_ has quit IRC | 13:41 | |
| stuartgr | it looks that way | 13:41 |
| cloudnull | I've also had an issues similar to that where the playbook run fails but does not trigger the handlers. | 13:41 |
| cloudnull | so the nginx config is not in effect | 13:41 |
| cloudnull | can you curl 10.0.2.100/scripts | 13:42 |
| cloudnull | does that show you the files in the /var/www/pxe/scripts director y? | 13:42 |
| *** kristian__ has quit IRC | 13:43 | |
| cloudnull | sorry... 10.0.2.1 | 13:43 |
| *** kristian__ has joined #openstack-ansible | 13:43 | |
| *** jwitko has quit IRC | 13:43 | |
| cloudnull | `curl 10.0.2.1/scripts` | 13:43 |
| *** jwitko__ has quit IRC | 13:43 | |
| stuartgr | I can ping 10.0.2.1 but curl just hangs | 13:44 |
| cloudnull | restart nginx | 13:45 |
| cloudnull | also is br-dhcp up ? | 13:45 |
| *** evrardjp[m] has joined #openstack-ansible | 13:49 | |
| stuartgr | vm-br-dhcp is up with address 10.0.2.1 | 13:49 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add force handlers to the build command https://review.openstack.org/489610 | 13:50 |
| openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-os_ironic master: [WIP] Enable virtualBMC testing https://review.openstack.org/381049 | 13:50 |
| cloudnull | stuartgr: and is nginx running ? | 13:50 |
| stuartgr | yes, according to 'service nginx status' | 13:50 |
| cloudnull | can you restart it for good measure and curl again | 13:53 |
| cloudnull | the /etc/nginx/sites-enabled/default file should be setup to point at /var/www/pxe | 13:53 |
| cloudnull | and that should be serving the content | 13:53 |
| odyssey4me | I have some vague recollection about PXE boot servers not being able to handle too many queries at once, but that's some pretty old memories. | 13:53 |
| cloudnull | ++ I used NGINX to ensure the static file handling is up to the task, tftp should only be there for the initial pxelinux boot and handing off the preseed | 13:54 |
| cloudnull | though we could use nginx for that too if we wanted. | 13:55 |
| stuartgr | sites-enabled/default looks ok, restarted ok, but curl 10.0.2.1/scripts still hangs | 13:55 |
| odyssey4me | lol, yeah - I went down a wormhole the other night and found out that nginx is a little like systemd | 13:55 |
| odyssey4me | you can pretty much use it for anything | 13:55 |
| cloudnull | http://paste.openstack.org/show/617125/ | 13:56 |
| cloudnull | stuartgr: ^ that's what it should be doing | 13:56 |
| cloudnull | is there a route issue maybe ? | 13:56 |
| cloudnull | odyssey4me: yup, its like a swiss army knife | 13:56 |
| stuartgr | I can ping 10.0.2.1 | 13:57 |
| cloudnull | stuartgr: what about curl localhost/scripts/ | 13:58 |
| *** chyka has joined #openstack-ansible | 13:59 | |
| *** drifterza has quit IRC | 14:01 | |
| stuartgr | sorry - it's our fault! We have http_proxy set in the environment and no_proxy set for the OLD multinode aio addresses | 14:02 |
| *** japestinho has joined #openstack-ansible | 14:02 | |
| *** galstrom_zzz is now known as galstrom | 14:02 | |
| *** chyka has quit IRC | 14:03 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add force handlers to the build command https://review.openstack.org/489610 | 14:03 |
| cloudnull | ah. | 14:04 |
| cloudnull | stuartgr: so maybe we need to add better proxy handling ? | 14:04 |
| *** lbragstad_ is now known as lbragstad | 14:04 | |
| cloudnull | something i missed in the port? | 14:04 |
| LiterateHawk | Yay! Got my first instance up and accessible from my provider network. Thanks to everyone who helped :) | 14:04 |
| cloudnull | LiterateHawk: woot! | 14:05 |
| *** kristia__ has joined #openstack-ansible | 14:05 | |
| jrosser_ | cloudnull: we added that other proxy stuff into the rest of OSA where it sets environment: in the playbooks | 14:05 |
| jrosser_ | that might work quite well here too | 14:05 |
| cloudnull | ++ | 14:05 |
| jrosser_ | our issue really was that for our previous mnaio we had hard coded into the machine prep stuff the NO_PROXY value | 14:06 |
| jrosser_ | which had to match what the mnaio was going to create | 14:06 |
| stuartgr | this was our commit to the OSA playbooks: https://git.openstack.org/cgit/openstack/openstack-ansible/commit/?id=77ac88197c223968e845e57706b81af24d6aa443 | 14:08 |
| *** cmart has joined #openstack-ansible | 14:08 | |
| *** kristian__ has quit IRC | 14:08 | |
| *** markus_z has quit IRC | 14:13 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add environment options and re-flow the README.rst https://review.openstack.org/489615 | 14:13 |
| cloudnull | ^ stuartgr jrosser_ | 14:13 |
| *** bauruine has quit IRC | 14:15 | |
| *** jamesden_ has joined #openstack-ansible | 14:16 | |
| *** jamesdenton has quit IRC | 14:18 | |
| *** bauruine has joined #openstack-ansible | 14:21 | |
| *** craigs__ has joined #openstack-ansible | 14:24 | |
| *** cmart has quit IRC | 14:24 | |
| *** udesale has quit IRC | 14:26 | |
| *** lucasxu has quit IRC | 14:27 | |
| *** marst_ has quit IRC | 14:28 | |
| *** armaan has quit IRC | 14:32 | |
| *** marst has joined #openstack-ansible | 14:35 | |
| *** drifterza has joined #openstack-ansible | 14:36 | |
| *** cmart has joined #openstack-ansible | 14:40 | |
| openstackgerrit | David Moreau Simard proposed openstack/openstack-ansible master: Dynamically retrieve the location of ARA to work on both py2 & py3 https://review.openstack.org/485938 | 14:48 |
| *** chyka has joined #openstack-ansible | 14:53 | |
| *** chyka has quit IRC | 14:57 | |
| openstackgerrit | Juan Vidal Allende proposed openstack/openstack-ansible master: Add support for OpenDaylight deployment in neutron https://review.openstack.org/480131 | 14:59 |
| *** acormier has joined #openstack-ansible | 15:01 | |
| *** jamesden_ has quit IRC | 15:02 | |
| andymccr | EmilienM: are you deploying swift with mod_wsgi/uwsgi in tripleo? | 15:03 |
| *** acormier_ has joined #openstack-ansible | 15:03 | |
| EmilienM | andymccr: no | 15:04 |
| EmilienM | you? | 15:04 |
| andymccr | EmilienM: trying | 15:04 |
| *** Oku_OS is now known as Oku_OS-away | 15:04 | |
| EmilienM | andymccr: what challenge do you have? | 15:04 |
| andymccr | EmilienM: the apps all load up fine, but you cant really put anything - trying to debug more now, ive set the body-size and some other things to try account for object size, but so far no dice | 15:05 |
| *** acormier has quit IRC | 15:05 | |
| *** jamesdenton has joined #openstack-ansible | 15:05 | |
| andymccr | EmilienM: when i figure it out i'll let you know - if you're planning on imping it for tripleo/puppet, can probably benefit from that | 15:06 |
| EmilienM | andymccr: for sure | 15:06 |
| *** yifei has quit IRC | 15:07 | |
| *** yifei has joined #openstack-ansible | 15:09 | |
| *** jvidal has quit IRC | 15:14 | |
| *** chyka has joined #openstack-ansible | 15:16 | |
| *** armaan has joined #openstack-ansible | 15:16 | |
| *** galstrom is now known as galstrom_zzz | 15:21 | |
| *** pcaruana has quit IRC | 15:22 | |
| openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-os_ironic master: [WIP] Enable virtualBMC testing https://review.openstack.org/381049 | 15:23 |
| dmsimard | andymccr: what does "swift with wsgi" mean ? proxy server ? | 15:27 |
| andymccr | dmsimard: proxy + object/container/account servers | 15:27 |
| *** boxrick1 is now known as boxrick | 15:27 | |
| dmsimard | ok! | 15:28 |
| andymccr | there is some example conf here: https://github.com/openstack/swift/tree/master/examples | 15:28 |
| *** yifei has quit IRC | 15:28 | |
| *** tobberyd_ has joined #openstack-ansible | 15:29 | |
| *** tobberydberg has quit IRC | 15:33 | |
| *** tobberyd_ has quit IRC | 15:34 | |
| *** pcaruana has joined #openstack-ansible | 15:40 | |
| *** andreas_s has quit IRC | 15:41 | |
| *** drifterza has quit IRC | 15:42 | |
| *** hamzy has quit IRC | 15:49 | |
| openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-os_swift master: [WIP] Implement uWSGI for Swift services https://review.openstack.org/486694 | 15:50 |
| *** drifterza has joined #openstack-ansible | 15:53 | |
| *** mbuil has quit IRC | 15:58 | |
| *** drifterza has quit IRC | 15:59 | |
| evrardjp | Bug triage cloudnull, DimGR, andymccr, d34dh0r53, hughsaunders, b3rnard0, palendae, odyssey4me, serverascode, rromans, erikmwilson, mancdaz, _shaps_, BjoernT, claco, echiu, dstanek, jwagner, ayoung, prometheanfire, evrardjp, arbrandes, mhayden, scarlisle, luckyinva, ntt, javeriak, spotz, vdo, jmccrory, alextricity25, jasondotstar, admin0, michaelgugino, ametts, v1k0d3n, severion, bgmccollum, darre | 16:00 |
| evrardjp | nc, JRobinson__, asettle, colinmcnamara, thorst, adreznec, eil397, qwang,nishpatwa_, cathrichardson, drifterza, hwoarang, cshen | 16:00 |
| evrardjp | Here is our bug list for today https://etherpad.openstack.org/p/osa-bugtriage | 16:00 |
| evrardjp | #startmeeting openstack_ansible_meeting | 16:00 |
| openstack | Meeting started Tue Aug 1 16:00:40 2017 UTC and is due to finish in 60 minutes. The chair is evrardjp. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:00 |
| openstack | The meeting name has been set to 'openstack_ansible_meeting' | 16:00 |
| evrardjp | #topic rollcall | 16:01 |
| spotz | \o/ | 16:01 |
| evrardjp | sorry for the lack of ping one hour before the meeting! | 16:01 |
| evrardjp | You all know the drill ;) | 16:01 |
| andymccr | im here but i need to leave in a few mins :( | 16:01 |
| evrardjp | Ahah ok | 16:02 |
| evrardjp | let's make it quick then | 16:02 |
| evrardjp | #topic this week's bug | 16:02 |
| evrardjp | #topic this week's bugs | 16:02 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1707265 | 16:02 |
| openstack | Launchpad bug 1707265 in openstack-ansible "config_template broken on ansible 2.3?" [Undecided,New] | 16:02 |
| *** lucasxu has joined #openstack-ansible | 16:04 | |
| evrardjp | wasn't this recently fixed? | 16:04 |
| andymccr | its not impacting other jobs, i wonder what the deal is there then | 16:04 |
| logan- | not fixed yet | 16:05 |
| logan- | it is broken when overrides are provided in 2.3 | 16:06 |
| evrardjp | yeah | 16:06 |
| logan- | but not all overrides apparently, as the plugins gate still passes | 16:06 |
| evrardjp | did you manage to split your openstack_user_config_overrides to see how it triggers? | 16:06 |
| logan- | based on the error it sounds like it might be specific to yaml dumping, so maybe only yaml based templates | 16:06 |
| logan- | let me try something real quick | 16:07 |
| evrardjp | ok | 16:08 |
| evrardjp | let's go onto next one then | 16:10 |
| evrardjp | until proven confirmed | 16:10 |
| evrardjp | next? | 16:10 |
| logan- | well as far as confirming it, feel free to just use the regular openstack_user_config aio file and provide the overrides in my gist | 16:11 |
| evrardjp | that's true :) | 16:11 |
| evrardjp | I didn't got the chance to do it, sorry. | 16:11 |
| evrardjp | I trust you on it anyway :p | 16:12 |
| odyssey4me | I wonder if the unicode handling patch is the source of all the misery | 16:12 |
| odyssey4me | sorry, this one I meant https://github.com/openstack/openstack-ansible-plugins/commit/76d5f02a32465028b47347048dde96533595036b | 16:13 |
| odyssey4me | nah, that looks fine | 16:13 |
| odyssey4me | anyway - apologies for the diversion | 16:14 |
| evrardjp | ok let's move to something else | 16:16 |
| evrardjp | we are losing time on the first bug | 16:16 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1707220 | 16:16 |
| openstack | Launchpad bug 1707220 in openstack-ansible "Swift Erasure Code fails with liberasurecode 1.4.0 on CentOS" [Undecided,New] | 16:16 |
| odyssey4me | looks like things are happening there | 16:16 |
| evrardjp | yeah, should mark this as confirmed, and low "scheduled to fix soon" | 16:17 |
| odyssey4me | perhaps confirm, mark in progress and assign to andy? | 16:17 |
| evrardjp | in progress low andy is ok | 16:17 |
| evrardjp | next | 16:18 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1707142 | 16:18 |
| openstack | Launchpad bug 1707142 in openstack-ansible "pip_install: "The following packages cannot be authenticated"" [Undecided,New] | 16:18 |
| odyssey4me | I'd say high actually, seeing as it's a breaking issue | 16:18 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: [WIP] Add nspawn container driver https://review.openstack.org/477017 | 16:18 |
| *** vishwana_ has quit IRC | 16:18 | |
| *** vishwanathj has joined #openstack-ansible | 16:19 | |
| odyssey4me | we could perhaps switch to adding a key like we do for mariadb and such | 16:20 |
| odyssey4me | instead of installing the package | 16:20 |
| odyssey4me | but that is a little weird | 16:20 |
| evrardjp | Well the thing is I didn't have the same issue on my latest ubuntu16.04 | 16:21 |
| evrardjp | but that's because it's intermittent | 16:21 |
| odyssey4me | maybe add some retries to the install task? | 16:21 |
| odyssey4me | I wondr where the real issue is here | 16:22 |
| odyssey4me | maybe there's a race between the key being added to the keychain and the repo refresh being done? | 16:22 |
| evrardjp | I don't know | 16:24 |
| cloudnull | could be something with apt-cacher-ng | 16:24 |
| odyssey4me | it'll be a tough one to confirm | 16:24 |
| cloudnull | its proxy'ing through the repo server | 16:24 |
| odyssey4me | hmm, that's true too | 16:24 |
| evrardjp | cloudnull: oh... | 16:24 |
| cloudnull | which is caching keys | 16:24 |
| evrardjp | indeed | 16:24 |
| cloudnull | so maybe there's a purge needed somewhere along the way ? | 16:24 |
| odyssey4me | but the key is installed via a package | 16:24 |
| evrardjp | well maybe there is vagrant cache too? | 16:25 |
| odyssey4me | it could be that the metadata caching is an issue though | 16:25 |
| cloudnull | ++ | 16:25 |
| evrardjp | but the workarounds are weird to me | 16:25 |
| odyssey4me | it is a little odd - the key install should actually be *less* reliable | 16:26 |
| mw_ | cloudnull: Hopefully a quick question for you. Is it possible to change the MTU of the lxcbr0 bridge that OSA creates? I've seen references to the `lxc_net_mtu` config that can be set in user_variables.yml in older versions of OSA, but not in the version recommended for Newton. I've tried setting it, but it doesn't seem to have any effect. Do you know if it still exists, or if there's another way to change it? | 16:27 |
| evrardjp | I'll spin up the vagrant box | 16:28 |
| evrardjp | and see how it goes | 16:28 |
| evrardjp | or at least I will try | 16:28 |
| evrardjp | let's talk about the next bug | 16:28 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1706595 | 16:28 |
| openstack | Launchpad bug 1706595 in openstack-ansible "Explicitly set file permissions on tasks" [Undecided,New] | 16:28 |
| odyssey4me | mw_ it's all still there: https://github.com/openstack/openstack-ansible/blob/master/etc/openstack_deploy/openstack_user_config.yml.example#L164 | 16:28 |
| cloudnull | mw_: yes you can change the lxcbr0 mtu , let me grab the option you need to set | 16:29 |
| cloudnull | what odyssey4me said | 16:29 |
| evrardjp | I think it's a great idea | 16:30 |
| evrardjp | confirmed wishlist | 16:30 |
| odyssey4me | regarding the bug - I'd say it's wishlist, great idea for the lint test | 16:30 |
| evrardjp | agreed | 16:30 |
| evrardjp | next | 16:30 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1706446 | 16:31 |
| openstack | Launchpad bug 1706446 in openstack-ansible "Keystone bootstrap failed when using LDAP" [Undecided,New] | 16:31 |
| evrardjp | mitaka is eol... | 16:31 |
| evrardjp | I think the bug shows we need to improve our ldap testing. | 16:32 |
| odyssey4me | that's not a mitaka upgrade | 16:32 |
| evrardjp | venv is mitaka | 16:33 |
| odyssey4me | keystone doesn't have a bootstrap in mitaka as far as I remember | 16:33 |
| mw_ | odyssey4me: Do I just need a new "network" entry in provider_networks for the lxcbr0 container_bridge and a container_mtu for that network? | 16:33 |
| mw_ | Is that how it's done now? | 16:33 |
| odyssey4me | apparently there is:https://github.com/openstack/openstack-ansible-os_keystone/blob/mitaka-eol/tasks/keystone_service_setup.yml#L38 | 16:34 |
| odyssey4me | mw_ we're busy with bug triage right now, please wait until we're done | 16:34 |
| mw_ | Sorry, will do. | 16:36 |
| odyssey4me | well, it's mitaka - there's nothing we can do for that, but if the issue is also valid for master then we can try to resolve it there | 16:36 |
| evrardjp | I think it's low | 16:36 |
| evrardjp | because of the amount of ppl working with ldap | 16:36 |
| evrardjp | but I think there is a gap with our testing for ldap | 16:36 |
| odyssey4me | ideally we need an ldap test in the keystone role | 16:36 |
| evrardjp | what do you think? | 16:37 |
| evrardjp | confirmed / low ? | 16:37 |
| openstackgerrit | Logan V proposed openstack/openstack-ansible-plugins master: [DNM] Reproduce bug 1707265 https://review.openstack.org/489660 | 16:37 |
| openstack | bug 1707265 in openstack-ansible "config_template broken on ansible 2.3?" [Undecided,New] https://launchpad.net/bugs/1707265 | 16:37 |
| jmccrory | think it would be fixed by keystone here, https://review.openstack.org/#/c/293488/ | 16:37 |
| evrardjp | jmccrory: 1y 5mo ago? | 16:38 |
| evrardjp | that's like M timeline right? | 16:38 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Use ansible-runtime python for internal scripts https://review.openstack.org/489661 | 16:39 |
| jmccrory | that made it into mitaka, wonder what tag it would've been for OSA | 16:39 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Use ansible-runtime python for internal scripts https://review.openstack.org/489661 | 16:40 |
| jmccrory | keystone_admin_user_name probably needs to actually exist in LDAP too | 16:42 |
| evrardjp | well mitaka-eol tag should get keystone mitaka-eol | 16:42 |
| evrardjp | so we should be covered. | 16:42 |
| evrardjp | if we ever run that | 16:42 |
| odyssey4me | I don't think we managed ot update to mitaka-eol, but a user can do that if it's not included. | 16:43 |
| odyssey4me | That's a good review to add to the bug though | 16:43 |
| odyssey4me | yes, if I recall correctly if ou're using LDAP as the *only* back-end (which is not actually what keystone is designed for btw), then you have to precreate all the users | 16:44 |
| odyssey4me | keystone is designed to have the services in SQL in the primary back-endand LDAP for users as a secondary back-end | 16:44 |
| evrardjp | ok let's continue then | 16:45 |
| evrardjp | I'll document this in the bug | 16:45 |
| evrardjp | next | 16:45 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1706122 | 16:45 |
| openstack | Launchpad bug 1706122 in openstack-ansible "openstack-ansible rabbitmq installs latest release of erlang which is not supported" [Undecided,New] | 16:45 |
| evrardjp | looks like valid and critical | 16:46 |
| odyssey4me | cloudnull jmccrory I thought this was resolved? | 16:46 |
| evrardjp | oh so better than confirmed, we could go fix released? | 16:47 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Use ansible-runtime python for internal scripts https://review.openstack.org/489661 | 16:47 |
| jmccrory | https://review.openstack.org/#/c/478679/ | 16:47 |
| cloudnull | yea that should be resolved. | 16:47 |
| cloudnull | jmccrory: and i think that was backported to ocata | 16:48 |
| cloudnull | ? | 16:48 |
| jmccrory | yep, https://review.openstack.org/#/c/478548/ | 16:48 |
| evrardjp | I'll mark at "reporter should give more info" | 16:48 |
| evrardjp | with a link to the review | 16:48 |
| evrardjp | next | 16:50 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1705476 | 16:50 |
| openstack | Launchpad bug 1705476 in openstack-ansible "AIO Builds for Newton & Ocata failing on Ubuntu 16.04 running on Virtual Box (exact same process works OK on Rackspace Public Cloud Ubuntu 16.04 Images)" [Undecided,New] - Assigned to Major Hayden (rackerhacker) | 16:50 |
| evrardjp | I'll mark this is as incomplete, as we are waiting for feedback from Geoff | 16:50 |
| evrardjp | next | 16:51 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1705469 | 16:51 |
| openstack | Launchpad bug 1705469 in openstack-ansible "newton config-template change breaks previously working configuration" [Undecided,New] | 16:51 |
| logan- | fwiw since we're back on config_template here's an isolated repro of the earlier bug https://review.openstack.org/#/c/489660/ | 16:52 |
| logan- | cloudnull ^ | 16:52 |
| cloudnull | oh excellent | 16:52 |
| cloudnull | and that's in newton ? | 16:52 |
| evrardjp | thanks logan- | 16:53 |
| cloudnull | looks lke we may need to revert https://review.openstack.org/#/c/486754/ | 16:53 |
| evrardjp | logan may I edit your patch? | 16:53 |
| logan- | evrardjp go for it | 16:53 |
| evrardjp | I'd like to write fixes-bug: | 16:54 |
| evrardjp | in case we actually fix it there:p | 16:54 |
| evrardjp | or alternatively, the revert. | 16:54 |
| evrardjp | oh no that's just for the latest. | 16:54 |
| odyssey4me | newton either needs fixing, or a revert of both https://review.openstack.org/484980 and https://review.openstack.org/486754 - I also asked prometheanfire to add tests to validate whether the patches fixed things, but that hasn't happened | 16:55 |
| evrardjp | why did this merge? | 16:56 |
| odyssey4me | no tests, therefore no ability to verify | 16:56 |
| evrardjp | yeah, ok we'll improve next time :) | 16:56 |
| evrardjp | ok so let's mark the bug as confirmed, and assign it to prometheanfire ? | 16:57 |
| evrardjp | prometheanfire: are you there? | 16:57 |
| evrardjp | I marked it as confirmed and high | 16:58 |
| *** pcaruana has quit IRC | 16:58 | |
| evrardjp | we are done for today | 16:59 |
| evrardjp | #endmeeting | 17:01 |
| openstack | Meeting ended Tue Aug 1 17:01:32 2017 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 17:01 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2017/openstack_ansible_meeting.2017-08-01-16.00.html | 17:01 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2017/openstack_ansible_meeting.2017-08-01-16.00.txt | 17:01 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2017/openstack_ansible_meeting.2017-08-01-16.00.log.html | 17:01 |
| dmsimard | Are you guys using a release candidate of Ansible 2.3.2 ? | 17:02 |
| dmsimard | Looks like ARA is reporting 2.3.2 but afaict it's still in RC4 | 17:02 |
| *** hamzy has joined #openstack-ansible | 17:03 | |
| *** armaan has quit IRC | 17:05 | |
| *** armaan has joined #openstack-ansible | 17:06 | |
| cloudnull | when folks get a min, https://review.openstack.org/#/c/489661/ that's a blocker on new py3.5 systems | 17:06 |
| cloudnull | dmsimard: 2.3.2.0 in master | 17:07 |
| dmsimard | cloudnull: ah, from source ? | 17:07 |
| cloudnull | yes. | 17:07 |
| logan- | dmsimard: https://github.com/openstack/openstack-ansible/blob/master/scripts/bootstrap-ansible.sh#L25 | 17:08 |
| logan- | there was a bug in 2.3.1 with include_role that we had to pull in a fix for | 17:08 |
| dmsimard | logan-: oh, which one ? handlers ? | 17:08 |
| cloudnull | dmsimard: https://github.com/openstack/openstack-ansible/blob/master/scripts/bootstrap-ansible.sh#L25 | 17:08 |
| spotz | Ok guys I've been putting comments in https://bugs.launchpad.net/openstack-ansible/+bug/1703621. I think we can skip the first part of it as the docs are there but should we add the second part in(it was an afterthought of the bug)? | 17:09 |
| openstack | Launchpad bug 1703621 in openstack-ansible "Appendix A conflict with /etc/openstack_deploy/openstack_user_config.yml.example" [Medium,Confirmed] - Assigned to Amy Marrich (amy-marrich) | 17:09 |
| cloudnull | ha. | 17:09 |
| cloudnull | logan-: beat me to is :) | 17:09 |
| logan- | dmsimard: the fix is https://github.com/ansible/ansible/commit/eeaa67657750005b5ff9c287b1883fc08692814d | 17:10 |
| logan- | osa bumped to that sha here: https://github.com/openstack/openstack-ansible/commit/4514082e3bb2169637cb8af6f59a7f8d310ba7dc | 17:11 |
| *** sxc731 has quit IRC | 17:12 | |
| logan- | there are issues where when statements were being misapplied from the parent into the included role tasks | 17:12 |
| *** perniciouscaffei has joined #openstack-ansible | 17:12 | |
| mw_ | odyssey4me: Could you give me a little more info on that container_mtu option for my use case? Do I need an additional network field for lxcbr0 that configures the MTU? | 17:12 |
| dmsimard | logan-: ah, the other thing that bit me in 2.3.1 was https://github.com/ansible/ansible/issues/26718 | 17:14 |
| logan- | dmsimard: id love to get some eyes on this one :) https://github.com/ansible/ansible/issues/27494 | 17:16 |
| dmsimard | logan-: whoa I've never been so far as using jinja includes in ansible | 17:17 |
| mw_ | odyssey4me: I have used the container_mtu option for br-mgmt etc.. but it doesn't work for lxcbr0 so I must be doing something wrong. | 17:19 |
| *** phschwartz has quit IRC | 17:21 | |
| *** phschwartz has joined #openstack-ansible | 17:22 | |
| *** mbuil has joined #openstack-ansible | 17:24 | |
| mw_ | cloudnull: Have a second regarding that question? | 17:33 |
| *** kristia__ has quit IRC | 17:38 | |
| *** kristian__ has joined #openstack-ansible | 17:39 | |
| openstackgerrit | David Moreau Simard proposed openstack/openstack-ansible master: Dynamically retrieve the location of ARA to work on both py2 & py3 https://review.openstack.org/485938 | 17:40 |
| *** mbuil has quit IRC | 17:41 | |
| *** lucasxu has quit IRC | 17:41 | |
| openstackgerrit | Jimmy McCrory proposed openstack/openstack-ansible-os_designate master: Deprecate rpc_backend option https://review.openstack.org/469767 | 17:43 |
| *** electrofelix has quit IRC | 17:43 | |
| *** kristian__ has quit IRC | 17:43 | |
| *** perniciouscaffei has quit IRC | 17:45 | |
| *** ivve has quit IRC | 17:45 | |
| mw_ | Anyone? I'd really appreciate some help here :) | 17:48 |
| cloudnull | mw_: sure | 17:51 |
| cloudnull | can you open up the /etc/network/interfaces.d/lxcbr0 file | 17:52 |
| cloudnull | and see if you have the mtu setting ? | 17:52 |
| cloudnull | also are you plugging that bridge into anything ? | 17:52 |
| cloudnull | or is it using the default bridge_ports none ? | 17:52 |
| stuartgr | cloudnull: in multi-node-aio/playbooks/host_vars value of "server_vm_fixed_addr" is the same in swift1.yml and swift2.yml ?? | 17:53 |
| *** dmsimard is now known as dms | 17:54 | |
| *** dms is now known as dmsimard | 17:55 | |
| cloudnull | opps, that a typo | 17:56 |
| mw_ | cloudnull: It looks like I got it working. I'm just waiting for the script to complete. If I post my config for lxcbr0 in a few minutes would you mind taking a quick look to see if it makes sense? | 17:59 |
| cloudnull | sounds good | 17:59 |
| mw_ | Thanks a lot :) | 17:59 |
| *** dmsimard is now known as dms | 17:59 | |
| *** dms is now known as dmsimard | 17:59 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: fix vm server ip typo https://review.openstack.org/489688 | 18:00 |
| cloudnull | stuartgr: ^ | 18:00 |
| stuartgr | cloudnull: swift3 now conflicts with loadbalancer1 which is also using 10.0.2.142 | 18:01 |
| stuartgr | perhaps loadbalancer should be 150? | 18:01 |
| cloudnull | ++ | 18:01 |
| *** dmsimard is now known as dms | 18:02 | |
| *** markvoelker has quit IRC | 18:02 | |
| *** markvoelker has joined #openstack-ansible | 18:02 | |
| *** lucasxu has joined #openstack-ansible | 18:02 | |
| *** lucasxu has quit IRC | 18:02 | |
| *** dms is now known as dmsimard | 18:03 | |
| *** dmsimard is now known as dmoreaus | 18:07 | |
| *** dmoreaus is now known as dmsimard | 18:07 | |
| *** kristian__ has joined #openstack-ansible | 18:09 | |
| *** kristian__ has quit IRC | 18:09 | |
| *** kristian__ has joined #openstack-ansible | 18:09 | |
| *** galstrom_zzz is now known as galstrom | 18:13 | |
| *** stuartgr has quit IRC | 18:13 | |
| *** EmilienM is now known as emacchi | 18:14 | |
| *** emacchi is now known as EmilienM | 18:14 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: fix vm server ip typo and isolate hosts into ip blocks https://review.openstack.org/489688 | 18:15 |
| cloudnull | ‎stuartgr‎ ‎jrosser_‎ ^ | 18:15 |
| SamYaple | mw_: did you get help the other day? | 18:26 |
| mw_ | SamYaple: With which issue? :p | 18:28 |
| mw_ | I think I did though, yeah. | 18:28 |
| SamYaple | dhcp/not-dhcp for container ips | 18:28 |
| SamYaple | its dhcp right? | 18:28 |
| mw_ | Oh, god. haha | 18:28 |
| mw_ | Yeah, it is. | 18:29 |
| *** poopcat has joined #openstack-ansible | 18:29 | |
| SamYaple | good you had me scared i had forgotten all my OSA knowledge | 18:29 |
| mw_ | I had to disable port security on some ports. I'm running OS inside OS. It's horrible haha | 18:29 |
| SamYaple | well had yo utold me that... | 18:30 |
| mw_ | Yeah... :( | 18:31 |
| *** albertcard1 has joined #openstack-ansible | 18:33 | |
| mw_ | cloudnull: https://pastebin.com/EncPcWAC This is what I have in my openstack_user_config for the lxcbr0 network. | 18:34 |
| mw_ | It results in the creation of another interface (dfd095c0@if743) in the containers though, on top of the eth0 and eth1 that should exist. | 18:34 |
| odyssey4me | mw_ why would you need to set the MTU for lxcbr0 - it's only used to communicate with the host itself | 18:34 |
| mw_ | odyssey4me: It's also used as the gateway, no? | 18:35 |
| odyssey4me | container -> host, then host does comms via default interface | 18:35 |
| *** poopcat has quit IRC | 18:35 | |
| odyssey4me | the container traffic is natted through the host | 18:35 |
| mw_ | odyssey4me: I need a smaller MTU on the eth0 interface inside the container then, no? | 18:36 |
| prometheanfire | evrardjp: sorry about that, I'll take another look then | 18:36 |
| mw_ | odyssey4me: I'm trying to use OSA to spin up OS instances inside an OS environment. | 18:36 |
| odyssey4me | mw_ we do that all the time, with no MTU adjustments to lxcbr0 | 18:36 |
| mw_ | So I need the MTU to be 1450. If I leave the MTU of that interface at 1500 I'm unable to get outside. | 18:36 |
| mw_ | odyssey4me: Do the eth0 interfaces not need a smaller MTU? | 18:37 |
| mw_ | Am I crazy? | 18:37 |
| odyssey4me | mw_ not as far as I know, because they communicate only to the host so it's all a kernel hairpin | 18:38 |
| odyssey4me | the host may need a different MTU, that's a different matter | 18:38 |
| mw_ | The host running the LXC containers? All the interfaces on the host apart from lxcbr0 have an MTU of 1450. | 18:39 |
| odyssey4me | well, all I can say is that every single one of our tests executes from inside an openstack environment on an instance and none of them need mtu adjustments as far as I can see or can remember | 18:40 |
| mw_ | If I leave the MTU at it's default of 1500 my containers aren't able to apt-get update during the installation steps. | 18:40 |
| odyssey4me | here's the integrated build's network config: https://github.com/openstack/openstack-ansible/blob/master/etc/network/interfaces.d/aio_interfaces.cfg#L31 | 18:40 |
| odyssey4me | and here, as an example is the info fed ot the lxc_hosts role for the nva role https://github.com/openstack/openstack-ansible-os_nova/blob/master/tests/host_vars/localhost.yml | 18:41 |
| odyssey4me | *nova | 18:41 |
| mw_ | odyssey4me: That's for lxc hosts which are VMs inside of OS? | 18:42 |
| *** pbandark has quit IRC | 18:42 | |
| odyssey4me | the issue may have nothing to do with the MTU and everything to do with the openstack environment implementing spoofing protection | 18:42 |
| odyssey4me | yes, all our tests run on VM's in an openstack environment | 18:42 |
| *** ThiagoCMC has joined #openstack-ansible | 18:43 | |
| mw_ | odyssey4me: If I lower the MTU I'm able apt-get update from the container. Without it I'm not, which is why I believed that was the issue. | 18:43 |
| mw_ | When OS spawns new instances DHCP assigns an MTU of 1450 to the new instances as well. | 18:43 |
| mw_ | At least in my case it does... | 18:43 |
| odyssey4me | oh, that's interesting | 18:44 |
| odyssey4me | well, then... hmm | 18:44 |
| mw_ | Due to vxlan, I would assume.... | 18:44 |
| odyssey4me | it appears that there's a setting for the lxc bridge: https://github.com/openstack/openstack-ansible-lxc_hosts/blob/master/templates/lxc-net-bridge.cfg.j2#L11 | 18:44 |
| odyssey4me | lxc_net_mtu | 18:45 |
| odyssey4me | add that to your user_variables file and it should do the trick | 18:45 |
| mw_ | Yeah, I've seen that. It didn't seem to work for me though. It's also undocumented, so I wasn't sure of the state of it. | 18:45 |
| mw_ | I'm trying it again right now, actually. | 18:46 |
| mw_ | How do you not require a smaller MTU. No VXLAN? | 18:46 |
| openstackgerrit | Logan V proposed openstack/openstack-ansible-plugins master: [DNM] Reproduce bug 1707265 https://review.openstack.org/489660 | 18:52 |
| openstack | bug 1707265 in openstack-ansible "config_template broken on ansible 2.3?" [Undecided,New] https://launchpad.net/bugs/1707265 | 18:52 |
| *** armaan has quit IRC | 18:57 | |
| *** albertcard1 is now known as poopcat | 18:57 | |
| *** armaan has joined #openstack-ansible | 18:57 | |
| *** kristian__ has quit IRC | 18:57 | |
| mw_ | odyssey4me: ^^ | 18:58 |
| mw_ | I'm curious now.. | 18:58 |
| *** hybridpollo has joined #openstack-ansible | 18:59 | |
| *** hybridpollo has quit IRC | 19:05 | |
| *** hybridpollo has joined #openstack-ansible | 19:07 | |
| openstackgerrit | Logan V proposed openstack/openstack-ansible-plugins master: Fix dumping hostvars to yaml from overrides https://review.openstack.org/489660 | 19:22 |
| *** gkadam has joined #openstack-ansible | 19:29 | |
| openstackgerrit | Logan V proposed openstack/openstack-ansible-plugins master: Fix dumping hostvars to yaml from overrides https://review.openstack.org/489660 | 19:29 |
| logan- | cloudnull: ^ fixes it, no idea if thats the correct way to fix it or not :P | 19:30 |
| *** acormier_ has quit IRC | 19:31 | |
| *** acormier has joined #openstack-ansible | 19:32 | |
| cloudnull | nice! | 19:32 |
| cloudnull | if it works, and passes the gate, its the right way :P | 19:32 |
| *** acormier has quit IRC | 19:33 | |
| *** acormier has joined #openstack-ansible | 19:34 | |
| *** acormier has quit IRC | 19:34 | |
| *** acormier has joined #openstack-ansible | 19:34 | |
| *** acormier has quit IRC | 19:34 | |
| *** acormier has joined #openstack-ansible | 19:35 | |
| openstackgerrit | Logan V proposed openstack/openstack-ansible-plugins master: Fix dumping hostvars to yaml from overrides https://review.openstack.org/489660 | 19:36 |
| *** ivve has joined #openstack-ansible | 19:37 | |
| SamYaple | cloudnull: im going to remember you said that.... | 19:37 |
| logan- | haha | 19:37 |
| *** acormier has quit IRC | 19:39 | |
| *** tadas_ has joined #openstack-ansible | 19:41 | |
| palendae | That logic's only valid if the gate checks for such a thing ;) | 19:44 |
| openstackgerrit | Logan V proposed openstack/openstack-ansible master: [DNM] Testing Limestone 3rd party CI https://review.openstack.org/488409 | 19:45 |
| *** acormier has joined #openstack-ansible | 19:51 | |
| *** acormier has quit IRC | 19:52 | |
| *** acormier has joined #openstack-ansible | 19:53 | |
| openstackgerrit | German Eichberger proposed openstack/openstack-ansible master: Octavia scenario https://review.openstack.org/483520 | 19:54 |
| xgerman_ | ^^ rebased | 19:55 |
| *** acormier has quit IRC | 19:57 | |
| openstackgerrit | Logan V proposed openstack/openstack-ansible-plugins master: config_template python 3 compatibility https://review.openstack.org/488280 | 20:00 |
| openstackgerrit | Logan V proposed openstack/openstack-ansible master: [DNM] Testing Limestone 3rd party CI https://review.openstack.org/488409 | 20:02 |
| openstackgerrit | German Eichberger proposed openstack/openstack-ansible master: Octavia scenario https://review.openstack.org/483520 | 20:03 |
| openstackgerrit | Logan V proposed openstack/openstack-ansible-plugins master: config_template python 3 compatibility https://review.openstack.org/488280 | 20:12 |
| xgerman_ | https://www.irccloud.com/pastebin/vhp342Py/ | 20:15 |
| xgerman_ | LoganV_ do we need to specify the path for the user var aio file? | 20:15 |
| mw_ | cloudnull: Is it possible to undo/rollback the work done by an OSA deployment? | 20:16 |
| logan- | looking | 20:16 |
| xgerman_ | thx - I think so | 20:16 |
| mw_ | cloudnull: If I deploy and need to update a config, what's the best course of action there? I've run into issues just re-running the scripts after making the config file changes. | 20:16 |
| logan- | commented in the review xgerman_ :) | 20:17 |
| prometheanfire | hwoarang: you work on OSA too? | 20:19 |
| openstackgerrit | German Eichberger proposed openstack/openstack-ansible master: Octavia scenario https://review.openstack.org/483520 | 20:20 |
| mw_ | Does anyone know about the ability to roll back or revert OSA deployments? | 20:44 |
| logan- | mw_: you can rebuild containers, but there's not a "rollback" implemented | 20:45 |
| mw_ | logan-: Is just stopping and destroying the containers sufficient? | 20:46 |
| *** armaan has quit IRC | 20:46 | |
| logan- | it depends what you're trying to do. even if you stop and destroy all of the containers, there are still changes OSA has made on the hosts that will remain present | 20:46 |
| logan- | but yes, if you stop and destroy a container, the playbooks will rebuild it | 20:47 |
| mw_ | logan-: Yeah. I ran into an issue where interfaces were being created that were no longer a part of the playbook. So I was wondering how to get around that kind of thing, where destroying the container isn't enough. | 20:47 |
| mw_ | I'm having to delete and re-create stacks using heat when I run into weird issues, and that's becoming painful. | 20:48 |
| logan- | heh yeah | 20:53 |
| mw_ | logan-: Any idea how to get around that? Is there a core set of config files I could purge before re-reploying? | 20:54 |
| logan- | what interfaces are you trying to purge | 20:55 |
| mw_ | I was getting veth pairs in the containers on top of the eth[01] interfaces. | 20:57 |
| *** gkadam has quit IRC | 20:57 | |
| mw_ | Which I believe was leftover from a bad config I was using previously | 20:57 |
| *** fxpester has quit IRC | 20:57 | |
| mw_ | After deleting that network from the config they were still appearing after deleting the containers | 20:58 |
| *** galstrom is now known as galstrom_zzz | 20:58 | |
| *** armaan has joined #openstack-ansible | 21:00 | |
| *** galstrom_zzz is now known as galstrom | 21:01 | |
| *** galstrom is now known as galstrom_zzz | 21:03 | |
| logan- | oh, so interfaces inside of the containers, not on the host then. I think you're on the right track with deleting the container and rebuilding it. if you rebuild and the interface comes back then try deleting the container on the server and also remove it from inventory using openstack-ansible/scripts/inventory-manage.py | 21:04 |
| mw_ | Ah, ok. Good stuff. Thanks :) | 21:07 |
| *** marst has quit IRC | 21:09 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: [WIP] Add nspawn container driver https://review.openstack.org/477017 | 21:09 |
| mw_ | I'm following this guide (https://docs.openstack.org/project-deploy-guide/openstack-ansible/newton/app-config-test.html#), and at the bottom it says to add this config to user_variables: `openstackservice_publicuri_proto: http` since my external and internal lb vip addresses are the same. During the setup-openstack phase of deployment glance tries to query the HTTP endpoint (http://192.168.11.111:35357/v3/auth/tokens), and it fa | 21:16 |
| mw_ | Is there an additional configuration setting I need to change? I didn't see a mention of anything else. | 21:16 |
| *** acormier has joined #openstack-ansible | 21:30 | |
| *** smatzek has quit IRC | 21:42 | |
| *** phalmos has joined #openstack-ansible | 21:42 | |
| *** phalmos has quit IRC | 21:48 | |
| mw_ | I'm getting this from the glance service during setup-openstack: keystoneauth1.exceptions.auth.AuthorizationFailure: Authorization failed: Unable to establish connection to http://192.168.11.111:35357/v3/auth/tokens | 21:53 |
| mw_ | Does that mean the credentials used were unauthorized? | 21:54 |
| mw_ | Or it was unable to reach the endpoint? | 21:55 |
| *** esberglu has quit IRC | 21:58 | |
| *** phalmos has joined #openstack-ansible | 22:00 | |
| *** smatzek has joined #openstack-ansible | 22:01 | |
| openstackgerrit | weezer su proposed openstack/openstack-ansible-ops master: Add the openstack-service-setup.sh back https://review.openstack.org/489764 | 22:02 |
| *** smatzek_ has joined #openstack-ansible | 22:02 | |
| *** thorst_afk has quit IRC | 22:05 | |
| mw_ | Anyone? This is killing me here :S | 22:05 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: [WIP] Add nspawn container driver https://review.openstack.org/477017 | 22:06 |
| cloudnull | hey mw_ back | 22:06 |
| * cloudnull reading back | 22:06 | |
| *** smatzek has quit IRC | 22:06 | |
| cloudnull | mw_: on the hap issue i'd simply add a second vip to the node where it's running | 22:07 |
| cloudnull | it can be within the same subnet | 22:07 |
| cloudnull | but having two vips (internal, external) will allow the role / playbook to execute normally. | 22:07 |
| mw_ | Is that the potential cause of that error I'm getting? | 22:08 |
| cloudnull | yes. | 22:08 |
| mw_ | This one: keystoneauth1.exceptions.auth.AuthorizationFailure: Authorization failed: Unable to establish connection to http://192.168.11.111:35357/v3/auth/tokens | 22:08 |
| mw_ | Sorry, just double checking haha | 22:08 |
| cloudnull | while you can disable a whole mess of things to disable ssl on teh external vip its easier to simply assign 1 more ip and let it operate normally. | 22:09 |
| cloudnull | you can check it | 22:09 |
| cloudnull | hatop is install | 22:09 |
| cloudnull | where haproxy is | 22:09 |
| cloudnull | and you can see if the backends are up | 22:09 |
| cloudnull | curl $backend:5000 | 22:09 |
| cloudnull | curl $backend:35357 | 22:09 |
| cloudnull | and if you get a json response keystone is working normally | 22:10 |
| cloudnull | $backend == container address | 22:10 |
| mw_ | the 10.0.XX address? | 22:10 |
| cloudnull | that or the management | 22:11 |
| *** cmart has quit IRC | 22:11 | |
| * cloudnull assuming 10.0.xx is the host container address. | 22:11 | |
| *** kylek3h has quit IRC | 22:12 | |
| *** esberglu has joined #openstack-ansible | 22:12 | |
| *** kylek3h has joined #openstack-ansible | 22:13 | |
| mw_ | root@infra01-glance-container-0d0ab9da:/# wget 192.168.11.111:35357 --2017-08-01 22:12:54-- http://192.168.11.111:35357/ Connecting to 192.168.11.111:35357... connected. HTTP request sent, awaiting response... No data received. Retrying. | 22:13 |
| mw_ | fails on HTTP | 22:13 |
| *** kylek3h has quit IRC | 22:13 | |
| *** acormier has quit IRC | 22:13 | |
| mw_ | cloudnull: downloads index.html over https | 22:13 |
| *** acormier has joined #openstack-ansible | 22:14 | |
| mw_ | 192.168.11.111 is the IP of my host's mgmt bridge | 22:14 |
| mw_ | The internal ip (10.XX) works fine over HTTP. | 22:15 |
| mw_ | So, that's fun, haha. | 22:15 |
| mw_ | cloudnull: Can I just add another interface to the host, and assign it an IP on the 192.168.11.0 subnet, and use that as the external VIP? | 22:15 |
| *** esberglu has quit IRC | 22:17 | |
| cloudnull | yu | 22:18 |
| cloudnull | **yup | 22:18 |
| *** acormier has quit IRC | 22:18 | |
| *** armaan has quit IRC | 22:18 | |
| cloudnull | they just have to be different | 22:19 |
| *** thorst_afk has joined #openstack-ansible | 22:19 | |
| cloudnull | it doesn't matter if they're only off by 1 address | 22:19 |
| mw_ | Ok, that's what I figured. Thanks a lot!! | 22:20 |
| *** smatzek_ has quit IRC | 22:20 | |
| *** ivve has quit IRC | 22:22 | |
| *** esberglu has joined #openstack-ansible | 22:23 | |
| *** thorst_afk has quit IRC | 22:24 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: [WIP] Add nspawn container driver https://review.openstack.org/477017 | 22:30 |
| mw_ | cloudnull: If I change that IP in my config, what do I need to re-run to get that to take effect? | 22:33 |
| mw_ | cloudnull: Do I need to re-run all the playbooks? | 22:34 |
| *** smatzek_ has joined #openstack-ansible | 22:36 | |
| mw_ | Or do I need to blow away containers and start again | 22:39 |
| cloudnull | I'd rerun setup-everything | 22:39 |
| mw_ | hosts/infra/openstack? | 22:39 |
| cloudnull | you should not need to destroy the containers. | 22:39 |
| mw_ | Should take care of it? | 22:40 |
| cloudnull | setup-everything.yml has those baked in | 22:40 |
| cloudnull | but yes. | 22:40 |
| cloudnull | that should take care of it | 22:40 |
| mw_ | ahh | 22:40 |
| mw_ | cloudnull: Thanks for the help! | 22:40 |
| cloudnull | np | 22:40 |
| mw_ | cloudnull: An exception occurred during task execution. To see the full traceback, use -vvv. The error was: OSError: [Errno 12] Cannot allocate memory | 22:46 |
| mw_ | haha | 22:46 |
| mw_ | classic! | 22:46 |
| mw_ | 8 gigs isn't enough? | 22:47 |
| *** smatzek_ has quit IRC | 22:49 | |
| cloudnull | is this an all in one ? | 22:50 |
| mw_ | Nope | 22:50 |
| cloudnull | if so 8GiB is enough | 22:50 |
| mw_ | 2 nodes | 22:51 |
| mw_ | 1 controller and 1 compute | 22:51 |
| cloudnull | oh it should be enough for sure. | 22:51 |
| mw_ | That's what I thought. | 22:51 |
| cloudnull | we gate on 8GiB | 22:51 |
| mw_ | weeeeird | 22:51 |
| cloudnull | that's all that openstack-infra will give us | 22:51 |
| cloudnull | are you deploying master ? | 22:51 |
| mw_ | That was with runing setup-everything. I'm going to just try setup-hosts for now. | 22:52 |
| mw_ | No, i'll get you the version. one sec. | 22:52 |
| cloudnull | I have been seeing that error w/ master on my local systems . | 22:52 |
| cloudnull | the latest ansible seems super mem hungry | 22:52 |
| mw_ | 14.2.6 | 22:52 |
| mw_ | As suggested in the newton OSA guide | 22:53 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: [WIP] Add nspawn container driver https://review.openstack.org/477017 | 22:53 |
| cloudnull | yea that shouldn't be having this particular issue | 22:53 |
| mw_ | I'm running them individually to see if that has an impact... | 22:54 |
| mw_ | does setup everything attempt to do some things in parallel or something? | 22:54 |
| cloudnull | no, but it will load everything at once. | 22:55 |
| *** craigs__ has quit IRC | 22:55 | |
| cloudnull | so maybe that was the issue | 22:56 |
| mw_ | Ah, interesting. | 22:56 |
| mw_ | maybe 8gb, with containers already running isn't enough? | 22:56 |
| cloudnull | no, like i said, we gate on 8GiB | 22:57 |
| cloudnull | you still seeing the issues | 22:57 |
| cloudnull | ? | 22:57 |
| *** https_GK1wmSU has joined #openstack-ansible | 22:58 | |
| mw_ | Not if I run individually. | 22:59 |
| mw_ | Only with setup-everything | 22:59 |
| cloudnull | oh, hum. | 22:59 |
| cloudnull | I wonder what the major consumer is | 22:59 |
| *** https_GK1wmSU has left #openstack-ansible | 22:59 | |
| mw_ | Not too sure right now. | 23:00 |
| mw_ | I'll just stick with re-running all the playbooks individually for now, and hope that the new external lb VIP takes effect... | 23:01 |
| *** esberglu has quit IRC | 23:06 | |
| cloudnull | ++ | 23:06 |
| *** ivve has joined #openstack-ansible | 23:08 | |
| *** mattoliverau_ has joined #openstack-ansible | 23:09 | |
| openstackgerrit | German Eichberger proposed openstack/openstack-ansible-os_octavia master: Enable V2 Octavia API (Experimental) https://review.openstack.org/484440 | 23:11 |
| *** esberglu has joined #openstack-ansible | 23:12 | |
| xgerman_ | ^^^ good to go | 23:13 |
| *** chyka has quit IRC | 23:19 | |
| mw_ | cloudnull: Oh no! OOM again running them in parallel! | 23:24 |
| mw_ | not parallel, I'm an idiot. Running them in serial. | 23:24 |
| mw_ | setup-openstack.yml | 23:25 |
| mw_ | TASK [pip_install : Gather variables for each operating system] **************** ERROR! Unexpected Exception: [Errno 12] Cannot allocate memory | 23:25 |
| *** mattoliverau_ is now known as mattoliverau | 23:25 | |
| cloudnull | oh noes | 23:25 |
| cloudnull | what the system sitting at in terms of ram when idle | 23:26 |
| mw_ | Oh, shit. I think I know what the problem is. My deployment node doesn't have 8gb of ram. | 23:26 |
| mw_ | The target nodes to. But I bet the deployment host is running OOM | 23:26 |
| *** jamesden_ has joined #openstack-ansible | 23:35 | |
| *** jamesdenton has quit IRC | 23:35 | |
| *** jamesden_ has quit IRC | 23:39 | |
| *** jamesdenton has joined #openstack-ansible | 23:41 | |
| *** chyka has joined #openstack-ansible | 23:42 | |
| *** gouthamr has quit IRC | 23:43 | |
| -openstackstatus- NOTICE: osic nodes have been removed from nodepool due to a problem with the mirror host beginning around 22:20 UTC. please recheck any jobs with failures installing packages. | 23:46 | |
| *** chyka has quit IRC | 23:49 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: [WIP] Add nspawn container driver https://review.openstack.org/477017 | 23:53 |
| *** markvoelker has quit IRC | 23:53 | |
| *** acormier has joined #openstack-ansible | 23:55 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!