Friday, 2020-03-06

*** jralbert has joined #openstack-ansible00:01
jralbertIs this bug a known issue? https://bugs.launchpad.net/openstack-ansible/+bug/181504300:02
openstackLaunchpad bug 1815043 in openstack-ansible "running os-nova-install.yml --tags nova-config does note generate config" [Undecided,New]00:02
jralbertI certainly can't make config changes to nova using the nova-config tag, which I know worked in the Queens releases - did something change? It's not very pleasant to have to re-run the full install playbook for minor operational changes00:02
*** joshualyle has joined #openstack-ansible00:19
*** joshualyle has quit IRC00:23
jralbertAnybody have thoughts on this? I'm a bit concerned at how many fairly major-seeming bug reports are untouched in the queue. I can raise to my management about trying to get some time to contribute if there's a shortage of cycles to maintain the project01:01
*** tosky has quit IRC01:39
*** spatel has joined #openstack-ansible01:40
*** KeithMnemonic1 has quit IRC01:52
*** KeithMnemonic1 has joined #openstack-ansible01:53
*** waxfire has quit IRC01:54
*** waxfire has joined #openstack-ansible01:54
*** owalsh has quit IRC01:58
*** gyee has quit IRC02:00
*** owalsh has joined #openstack-ansible02:07
*** joshualyle has joined #openstack-ansible02:54
*** joshualyle has quit IRC02:58
*** jralbert has quit IRC04:28
*** spatel has quit IRC04:53
*** udesale has joined #openstack-ansible04:55
*** weshay has quit IRC05:01
*** joshualyle has joined #openstack-ansible05:02
*** weshay has joined #openstack-ansible05:05
*** joshualyle has quit IRC05:06
*** dave-mccowan has quit IRC05:17
*** raukadah is now known as chandankumar05:24
*** joshualyle has joined #openstack-ansible05:26
*** joshualyle has quit IRC05:31
openstackgerritMerged openstack/openstack-ansible master: Re-order gate cleanup pip package removal  https://review.opendev.org/70998605:34
*** evrardjp has quit IRC05:35
*** evrardjp has joined #openstack-ansible05:35
*** ondrejburian has joined #openstack-ansible06:03
*** ondrejbu- has quit IRC06:03
*** udesale_ has joined #openstack-ansible06:21
*** udesale has quit IRC06:23
*** jbadiapa has joined #openstack-ansible06:26
*** udesale has joined #openstack-ansible06:28
*** udesale_ has quit IRC06:29
*** udesale_ has joined #openstack-ansible06:33
*** udesale has quit IRC06:35
openstackgerritErik Berg proposed openstack/openstack-ansible stable/train: WIP/DNM: Upgrade ceph to nautilus and enable msgr2  https://review.opendev.org/71077806:56
jrossersnadge: yes just rerun the tempest playbook06:59
snadgeyup.. i got that sorted, i now have a test OA install on vsphere, and its now also installed on a prod/staging setup..07:01
snadgeso we'll be moving from rocky on RHEL, to train on centos.. after it has been tested etc07:02
*** mkuf_ is now known as mkuf07:06
jrossersnadge: awesome!07:26
jrossersnadge: if you are interested in contributing more generally to OSA then centos is an area we could use more effort07:27
*** joshualyle has joined #openstack-ansible07:48
*** joshualyle has quit IRC07:53
*** sshnaidm_ has joined #openstack-ansible07:57
*** sshnaidm|afk has quit IRC07:58
*** joshualyle has joined #openstack-ansible08:20
*** fghaas has joined #openstack-ansible08:21
*** joshualyle has quit IRC08:25
*** fghaas has quit IRC08:32
*** tosky has joined #openstack-ansible08:40
*** fghaas has joined #openstack-ansible08:44
*** rpittau|afk is now known as rpittau08:58
*** joshualyle has joined #openstack-ansible09:11
*** joshualyle has quit IRC09:16
*** yolanda has quit IRC09:29
*** yolanda has joined #openstack-ansible09:33
*** trident has quit IRC09:34
*** trident has joined #openstack-ansible09:36
*** joshualyle has joined #openstack-ansible09:42
*** joshualyle has quit IRC09:46
*** stingrayza has quit IRC09:58
*** stingrayza has joined #openstack-ansible09:59
*** pcaruana has joined #openstack-ansible10:23
johanssoneHi people! I have a bit of an issue..Basically I'm trying to add new compute nodes on 18.04 in one of our deployments and I'm hitting http://paste.openstack.org/show/790388/. The currently active computes are all running 16.04, but I'd rather add new things at 18.04 at this point, as they'll need to be re-deployed later anyway.. Environment is running on OSA tag 18.1.5, so Rocky. To be this looks like a pure python problem, but just wanted10:32
johanssone to pick your brain a bit before going down that rabbithole..Seem something similar before?10:32
*** aedc has joined #openstack-ansible10:39
*** _kukacz has joined #openstack-ansible10:45
*** fghaas has quit IRC10:46
*** fghaas has joined #openstack-ansible10:55
*** joshualyle has joined #openstack-ansible10:58
*** _kukacz has quit IRC10:59
*** _kukacz has joined #openstack-ansible11:02
*** joshualyle has quit IRC11:03
*** sshnaidm_ is now known as sshnaidm|afk11:13
*** gshippey has joined #openstack-ansible11:32
*** joshualyle has joined #openstack-ansible11:33
*** rpittau is now known as rpittau|bbl11:36
*** joshualyle has quit IRC11:38
openstackgerritMerged openstack/openstack-ansible-ops master: Do not delegate ILM template & policy updates  https://review.opendev.org/71007911:41
*** fghaas has quit IRC11:47
jrosserjohanssone: have you upgraded your infra nodes to 18.04?11:48
jrosserjohanssone: the python wheels are built on the repo servers on the infra nodes. SImplistically, those repo server containers must be running the same OS release as the new nodes you are deploying. There is a dependancy between some python wheels and the system libraries in some cases, like libssl, and I think this is what you are seeing11:50
*** fghaas has joined #openstack-ansible11:55
johanssonejrosser: hmm, no, I've just leveraged the `repo_build_os_distro_version` found https://github.com/openstack/openstack-ansible-repo_build/blob/957039ea2991966ec5bf7a90a1cadea175324334/defaults/main.yml#L41. But yea, that sounds reasonable. Looking through the code, it should be enough to re-create the repo containers on 18.04 right, or maybe those are in turn using dependencies for physical infra nodes?11:56
jrosseri think the only thing that var does is drive the resulting directory name repo_build_release_path11:57
jrosseri think someone else recently did the same and converted the repo containers to 18.04 on a 16.04 host11:57
openstackgerritDuncan Martin Walker proposed openstack/openstack-ansible-ops master: Subdivision of elastic-logstash group  https://review.opendev.org/70784911:58
jrosserif you find a clean method of doing that we should write up how to do it11:58
jrosserthe only thing shared between the host and the container is the kernel, and a few config files that get copied across which might need attention11:59
johanssoneyea, I found http://lists.openstack.org/pipermail/openstack-discuss/2019-April/005089.html, but its the reverse (16.04 containers on 18.04) host. I'll do some tests and see what I can come up with. Thanks for the answers so far!11:59
*** jbadiapa has quit IRC12:02
*** zigo has quit IRC12:02
*** maharg102 has quit IRC12:02
*** maharg101 has joined #openstack-ansible12:03
*** jbadiapa has joined #openstack-ansible12:03
*** irclogbot_3 has quit IRC12:05
*** irclogbot_3 has joined #openstack-ansible12:05
*** mhayden has quit IRC12:06
*** irclogbot_3 has quit IRC12:07
*** irclogbot_2 has joined #openstack-ansible12:07
*** zigo has joined #openstack-ansible12:09
*** jbadiapa has quit IRC12:10
*** mhayden has joined #openstack-ansible12:10
*** nicolasbock has joined #openstack-ansible12:18
*** zigo has quit IRC12:31
*** fghaas has quit IRC12:40
*** fghaas has joined #openstack-ansible12:46
*** zigo has joined #openstack-ansible12:47
*** udesale has joined #openstack-ansible12:55
*** udesale_ has quit IRC12:57
*** joshualyle has joined #openstack-ansible13:15
noonedeadpunkjrosser: yeah, that memcache thing is pretty.... in bad timing I'd say:)13:15
*** rpittau|bbl is now known as rpittau13:18
jrossernoonedeadpunk: I’m also surprised they do it this way with no opportunity to transition13:19
jrosserparticularly as pymemcache is not s direct dependancy of oslo.cache so is never pulled in automatically13:20
noonedeadpunkyeah, this no transition thing upsets the more.13:21
*** joshualyle has quit IRC13:23
noonedeadpunkbut I guess memcahced pool used only for keystone though...13:23
noonedeadpunks/guess/thought/13:24
noonedeadpunkat least directly set to use it....13:25
jrosseroh well I don’t know really - we have python-memcached all over the place so I wonder if keystone middleware needs it13:26
*** spatel has joined #openstack-ansible13:30
*** spatel has quit IRC13:30
*** trident has quit IRC13:30
*** trident has joined #openstack-ansible13:32
*** rh-jelabarre has joined #openstack-ansible13:34
*** joshualyle has joined #openstack-ansible13:45
*** fghaas has quit IRC13:50
*** fghaas has joined #openstack-ansible13:51
*** fghaas has left #openstack-ansible14:05
*** owalsh has quit IRC14:10
*** weshay is now known as weshay|ruck14:12
*** owalsh has joined #openstack-ansible14:18
*** trident has quit IRC14:22
*** spatel has joined #openstack-ansible14:22
*** cshen has joined #openstack-ansible14:24
*** trident has joined #openstack-ansible14:24
*** spatel has quit IRC14:27
*** joshualyle has quit IRC14:28
*** joshualyle has joined #openstack-ansible14:28
*** udesale has quit IRC14:45
*** fghaas has joined #openstack-ansible14:50
*** dave-mccowan has joined #openstack-ansible14:54
*** _kukacz has quit IRC14:58
openstackgerritDuncan Martin Walker proposed openstack/openstack-ansible-ops master: Subdivision of elastic-logstash group  https://review.opendev.org/70784915:00
*** owalsh has quit IRC15:00
*** spatel has joined #openstack-ansible15:01
openstackgerritDuncan Martin Walker proposed openstack/openstack-ansible-ops master: Subdivision of elastic-logstash group  https://review.opendev.org/70784915:32
*** owalsh has joined #openstack-ansible15:34
*** owalsh has quit IRC15:40
*** spatel has quit IRC15:45
*** pcaruana has quit IRC15:48
*** owalsh has joined #openstack-ansible15:50
*** owalsh_ has joined #openstack-ansible15:53
*** owalsh- has joined #openstack-ansible15:54
*** owalsh has quit IRC15:57
*** owalsh_ has quit IRC15:58
*** _kukacz has joined #openstack-ansible16:08
*** spatel has joined #openstack-ansible16:10
*** _kukacz has quit IRC16:11
*** _kukacz has joined #openstack-ansible16:12
*** _kukacz has quit IRC16:14
*** _kukacz has joined #openstack-ansible16:16
*** cshen has quit IRC16:20
*** idlemind_ has quit IRC16:21
*** idlemind has joined #openstack-ansible16:21
*** _kukacz has quit IRC16:26
*** kopecmartin is now known as kopecmartin|afk16:29
*** gyee has joined #openstack-ansible16:29
*** owalsh has joined #openstack-ansible16:32
*** owalsh_ has joined #openstack-ansible16:33
*** fghaas has quit IRC16:34
*** owalsh| has joined #openstack-ansible16:34
*** owalsh^ has joined #openstack-ansible16:35
*** owalsh- has quit IRC16:35
*** owalsh has quit IRC16:37
*** chandankumar is now known as raukadah16:38
*** owalsh_ has quit IRC16:38
*** owalsh| has quit IRC16:39
*** joshualyle has quit IRC16:49
*** joshualyle has joined #openstack-ansible16:49
*** rpittau is now known as rpittau|afk17:04
*** spatel has quit IRC17:30
*** evrardjp has quit IRC17:35
*** evrardjp has joined #openstack-ansible17:35
*** joshualyle has quit IRC17:37
openstackgerritMerged openstack/openstack-ansible-tests master: Do not compress log files before uploading  https://review.opendev.org/71111017:48
openstackgerritMerged openstack/openstack-ansible-tests master: Pin version of tox used for Centos-7 tests  https://review.opendev.org/71101517:53
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-apt_package_pinning master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71168717:53
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-ceph_client master: Updated from OpenStack Ansible Tests  https://review.opendev.org/70946617:53
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-galera_client master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71168817:53
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-galera_server master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71168917:53
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-haproxy_server master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71169017:54
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-lxc_container_create master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71169117:54
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-lxc_hosts master: Updated from OpenStack Ansible Tests  https://review.opendev.org/70947117:54
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-memcached_server master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71169217:54
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-nspawn_container_create master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71169317:54
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-nspawn_hosts master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71169417:54
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-openstack_hosts master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71169517:54
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-openstack_openrc master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71169617:54
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-ops master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71169717:55
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_aodh master: Updated from OpenStack Ansible Tests  https://review.opendev.org/70947917:55
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_barbican master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71169817:55
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_blazar master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71169917:55
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_ceilometer master: Updated from OpenStack Ansible Tests  https://review.opendev.org/70948217:55
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_cinder master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71170017:55
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_cloudkitty master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71170117:55
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_congress master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71170217:55
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_designate master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71170317:56
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_glance master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71170417:56
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_gnocchi master: Updated from OpenStack Ansible Tests  https://review.opendev.org/70948817:56
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_heat master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71170517:56
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_horizon master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71170617:56
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_ironic master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71170717:56
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_keystone master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71170817:57
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_magnum master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71170917:57
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_manila master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71171017:57
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_masakari master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71171117:57
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_mistral master: Updated from OpenStack Ansible Tests  https://review.opendev.org/70949817:57
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_murano master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71171217:58
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_neutron master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71171317:58
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_nova master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71171417:58
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_octavia master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71171517:58
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_panko master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71171617:58
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_placement master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71171717:58
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_rally master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71171817:58
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_sahara master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71171917:59
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_swift master: Updated from OpenStack Ansible Tests  https://review.opendev.org/70950817:59
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_tacker master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71172017:59
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_tempest master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71172117:59
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_trove master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71172217:59
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_zun master: Updated from OpenStack Ansible Tests  https://review.opendev.org/70951217:59
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-pip_install master: Updated from OpenStack Ansible Tests  https://review.opendev.org/70951317:59
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-plugins master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71172318:00
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-rabbitmq_server master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71172418:00
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-repo_build master: Updated from OpenStack Ansible Tests  https://review.opendev.org/70951618:00
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-repo_server master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71172518:00
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-rsyslog_client master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71172618:00
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-rsyslog_server master: Updated from OpenStack Ansible Tests  https://review.opendev.org/70951918:00
openstackgerritOpenStack Proposal Bot proposed openstack/ansible-config_template master: Updated from OpenStack Ansible Tests  https://review.opendev.org/70952018:00
openstackgerritOpenStack Proposal Bot proposed openstack/ansible-hardening master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67184018:01
openstackgerritOpenStack Proposal Bot proposed openstack/ansible-role-python_venv_build master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71172718:01
openstackgerritOpenStack Proposal Bot proposed openstack/ansible-role-systemd_mount master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71172818:01
openstackgerritOpenStack Proposal Bot proposed openstack/ansible-role-systemd_networkd master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71172918:01
openstackgerritOpenStack Proposal Bot proposed openstack/ansible-role-systemd_service master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71173018:01
*** nurdie has joined #openstack-ansible18:15
nurdieAttempting Rocky -> Stein upgrade right now.18:15
nurdiehttps://pastebin.com/vbtG8TFB18:15
nurdieThe only thing I have in /etc/openstack_depoly/env.d is a neutron.yml, and I'm pretty sure it's there from the Queens -> Rocky upgrade. There was a bug that required me to set is_metal: true18:16
*** spatel has joined #openstack-ansible18:17
nurdie"/etc/openstack_deploy/env.d/neutron.yml": https://pastebin.com/sXBqXygT18:17
*** spatel has quit IRC18:17
*** spatel has joined #openstack-ansible18:17
nurdieShould I just remove that? I'm worried about that breaking Neutron. We have 3 controllers with services containers18:18
nurdieMaybe this was from Pike -> Queens when neutron server got pulled from its container?18:18
noonedeadpunknurdie: can you compare /etc/openstack_deploy/env.d/neutron.yml with /opt/openstack-ansible/inventory/env.d/neutron.yml?18:20
noonedeadpunkif they are the same - than you can probably drop it.18:20
noonedeadpunkotherwise I'd say to run upgrade with set env varibale SKIP_CUSTOM_ENVD_CHECK=true18:20
nurdienoonedeadpunk: Thanks a bunch! It was just a couple of extraneous newlines18:24
noonedeadpunkalways welcome:)18:32
*** gshippey has quit IRC18:52
openstackgerritMerged openstack/openstack-ansible-apt_package_pinning master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71168718:55
openstackgerritMerged openstack/openstack-ansible-ops master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71169718:58
openstackgerritMerged openstack/openstack-ansible-nspawn_container_create master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71169319:00
openstackgerritMerged openstack/openstack-ansible-nspawn_hosts master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71169419:06
*** fghaas has joined #openstack-ansible19:13
openstackgerritMerged openstack/openstack-ansible-haproxy_server master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71169019:17
*** ahosam has joined #openstack-ansible19:18
openstackgerritMerged openstack/openstack-ansible-plugins master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71172319:21
*** fghaas has quit IRC19:37
nurdieI got another one!19:53
nurdiehttps://pastebin.com/T1vtKYyz19:53
nurdieThat happened while setup-hosts.yml -e 'lxc_container_allow_restarts=false' --limit 'galera_all:rabbitmq_all' was running19:54
nurdiegalera1 of 3 is down and won't restart19:54
nurdiemysqld doesn't exist19:54
nurdieLooks like yum removed mariadb before that19:55
openstackgerritMerged openstack/openstack-ansible stable/stein: Fix idempotency for os-lxc-container-setup.yml  https://review.opendev.org/70866720:02
nurdieI think I figured out what happened20:03
nurdieThe glaera_server task removed MariaDB 10.1.34, updated the repo file, and tried to install 10.3.13. Yum broke due to a bad centos repo, so I fixed that on the container directly and restarted the play, which didn't try to reinstall the MariaDB rpms for some reason20:04
nurdieSmall suggestion if anyone cares, for galera upgrades, use "yum --disablerepo=* --enablerepo=MariaDB update MariaDB" instead of removing the old package and installing the new one20:07
nurdieFor RHEL/Centos20:07
*** ahosam has quit IRC20:29
*** ahosam has joined #openstack-ansible20:30
*** nurdie has quit IRC20:41
*** weshay|ruck is now known as weshay20:41
*** spatel has quit IRC20:44
*** dave-mccowan has quit IRC21:11
*** mwhahaha has quit IRC21:11
*** tinwood has quit IRC21:13
*** ThiagoCMC has quit IRC21:13
*** mathlin has quit IRC21:13
*** ChanServ has quit IRC21:13
*** sep has quit IRC21:13
*** melwitt has quit IRC21:13
*** johnsom has quit IRC21:13
*** noonedeadpunk has quit IRC21:13
*** aspiers has quit IRC21:13
*** jonher has quit IRC21:13
*** fridtjof[m] has quit IRC21:13
*** mugsie has quit IRC21:13
*** Jeffrey4l has quit IRC21:13
*** jrosser has quit IRC21:13
*** donnyd has quit IRC21:13
*** fyx has quit IRC21:13
*** logan- has quit IRC21:13
*** nwonknu has quit IRC21:13
*** jroll has quit IRC21:13
*** zigo has quit IRC21:13
*** waxfire has quit IRC21:13
*** mgariepy has quit IRC21:13
*** itsjg has quit IRC21:13
*** wpp has quit IRC21:13
*** crazzy has quit IRC21:13
*** arxcruz|rover has quit IRC21:13
*** bjoernt has quit IRC21:13
*** bverschueren has quit IRC21:13
*** spotz has quit IRC21:13
*** rh-jelabarre has quit IRC21:13
*** nicolasbock has quit IRC21:13
*** zbr|pto has quit IRC21:13
*** Brace has quit IRC21:13
*** persia has quit IRC21:13
*** jmccrory has quit IRC21:13
*** sum12 has quit IRC21:13
*** poopcat has quit IRC21:13
*** kukacz has quit IRC21:13
*** yolanda has quit IRC21:13
*** weshay has quit IRC21:13
*** prometheanfire has quit IRC21:13
*** jhesketh has quit IRC21:13
*** yoctozepto has quit IRC21:13
*** partlycloudy has quit IRC21:13
*** brad- has quit IRC21:13
*** mbuil has quit IRC21:13
*** ioni has quit IRC21:13
*** tacco has quit IRC21:13
*** heikkine has quit IRC21:13
*** dmsimard|off has quit IRC21:13
*** gchamoul has quit IRC21:13
*** tbarron has quit IRC21:13
*** django has quit IRC21:13
*** tobberydberg has quit IRC21:13
*** EmilienM has quit IRC21:13
*** antonym has quit IRC21:13
*** owalsh^ has quit IRC21:13
*** irclogbot_2 has quit IRC21:13
*** maharg101 has quit IRC21:13
*** KeithMnemonic1 has quit IRC21:13
*** mkuf has quit IRC21:13
*** cp- has quit IRC21:13
*** vesper11 has quit IRC21:13
*** evrardjp has quit IRC21:13
*** aedc has quit IRC21:13
*** hwoarang has quit IRC21:13
*** CeeMac has quit IRC21:13
*** soren has quit IRC21:13
*** dasp has quit IRC21:13
*** ChosSimbaOne has quit IRC21:13
*** mmercer has quit IRC21:13
*** strattao has quit IRC21:13
*** janno has quit IRC21:13
*** cyberpear has quit IRC21:13
*** mcarden has quit IRC21:13
*** Adri2000 has quit IRC21:13
*** d34dh0r53 has quit IRC21:13
*** cloudnull has quit IRC21:13
*** gixx has quit IRC21:13
*** cjloader has quit IRC21:13
*** ahosam has quit IRC21:13
*** stingrayza has quit IRC21:13
*** ansmith has quit IRC21:13
*** mrda has quit IRC21:13
*** johanssone has quit IRC21:13
*** ebbex has quit IRC21:13
*** timburke has quit IRC21:13
*** djhankb has quit IRC21:13
*** redrobot has quit IRC21:13
*** ianychoi has quit IRC21:13
*** Blinkiz has quit IRC21:13
*** oligau has quit IRC21:13
*** guilhermesp has quit IRC21:13
*** dirk has quit IRC21:13
*** gouthamr has quit IRC21:13
*** Carcer has quit IRC21:13
*** toanster has quit IRC21:13
*** snadge has quit IRC21:13
*** nyloc has quit IRC21:13
*** tosky has quit IRC21:13
*** sshnaidm|afk has quit IRC21:13
*** ondrejburian has quit IRC21:13
*** gillesMo has quit IRC21:13
*** bjolo has quit IRC21:13
*** raukadah has quit IRC21:13
*** mhayden has quit IRC21:13
*** NobodyCam has quit IRC21:13
*** andrewbonney has quit IRC21:13
*** gyee has quit IRC21:13
*** trident has quit IRC21:13
*** goldenfri has quit IRC21:13
*** openstackgerrit has quit IRC21:13
*** Miouge has quit IRC21:13
*** mpjetta has quit IRC21:13
*** NewJorg has quit IRC21:13
*** redkrieg has quit IRC21:13
*** gary_perkins has quit IRC21:13
*** idlemind has quit IRC21:13
*** masterpe has quit IRC21:13
*** mubix has quit IRC21:13
*** alanmeadows has quit IRC21:13
*** mnaser has quit IRC21:13
*** gundalow has quit IRC21:13
*** rpittau|afk has quit IRC21:13
*** Anticimex has quit IRC21:13
*** ahosam has joined #openstack-ansible21:13
*** evrardjp has joined #openstack-ansible21:13
*** owalsh^ has joined #openstack-ansible21:13
*** gyee has joined #openstack-ansible21:13
*** idlemind has joined #openstack-ansible21:13
*** dave-mccowan has joined #openstack-ansible21:13
*** trident has joined #openstack-ansible21:13
*** rh-jelabarre has joined #openstack-ansible21:13
*** zigo has joined #openstack-ansible21:13
*** nicolasbock has joined #openstack-ansible21:13
*** mhayden has joined #openstack-ansible21:13
*** irclogbot_2 has joined #openstack-ansible21:13
*** maharg101 has joined #openstack-ansible21:13
*** aedc has joined #openstack-ansible21:13
*** stingrayza has joined #openstack-ansible21:13
*** yolanda has joined #openstack-ansible21:13
*** tosky has joined #openstack-ansible21:13
*** sshnaidm|afk has joined #openstack-ansible21:13
*** ondrejburian has joined #openstack-ansible21:13
*** weshay has joined #openstack-ansible21:13
*** waxfire has joined #openstack-ansible21:13
*** KeithMnemonic1 has joined #openstack-ansible21:13
*** ansmith has joined #openstack-ansible21:13
*** mkuf has joined #openstack-ansible21:13
*** mgariepy has joined #openstack-ansible21:13
*** mathlin has joined #openstack-ansible21:13
*** ThiagoCMC has joined #openstack-ansible21:13
*** tinwood has joined #openstack-ansible21:13
*** mwhahaha has joined #openstack-ansible21:13
*** cp- has joined #openstack-ansible21:13
*** hwoarang has joined #openstack-ansible21:13
*** CeeMac has joined #openstack-ansible21:13
*** itsjg has joined #openstack-ansible21:13
*** goldenfri has joined #openstack-ansible21:13
*** openstackgerrit has joined #openstack-ansible21:13
*** NobodyCam has joined #openstack-ansible21:13
*** Miouge has joined #openstack-ansible21:13
*** soren has joined #openstack-ansible21:13
*** andrewbonney has joined #openstack-ansible21:13
*** prometheanfire has joined #openstack-ansible21:13
*** masterpe has joined #openstack-ansible21:13
*** fridtjof[m] has joined #openstack-ansible21:13
*** vesper11 has joined #openstack-ansible21:13
*** dasp has joined #openstack-ansible21:13
*** ChanServ has joined #openstack-ansible21:13
*** ChosSimbaOne has joined #openstack-ansible21:13
*** oligau has joined #openstack-ansible21:13
*** d34dh0r53 has joined #openstack-ansible21:13
*** mpjetta has joined #openstack-ansible21:13
*** Anticimex has joined #openstack-ansible21:13
*** raukadah has joined #openstack-ansible21:13
*** nyloc has joined #openstack-ansible21:13
*** gouthamr has joined #openstack-ansible21:13
*** Carcer has joined #openstack-ansible21:13
*** toanster has joined #openstack-ansible21:13
*** Blinkiz has joined #openstack-ansible21:13
*** cjloader has joined #openstack-ansible21:13
*** gixx has joined #openstack-ansible21:13
*** Brace has joined #openstack-ansible21:13
*** persia has joined #openstack-ansible21:13
*** jmccrory has joined #openstack-ansible21:13
*** sum12 has joined #openstack-ansible21:13
*** poopcat has joined #openstack-ansible21:13
*** kukacz has joined #openstack-ansible21:13
*** tacco has joined #openstack-ansible21:13
*** ioni has joined #openstack-ansible21:13
*** mbuil has joined #openstack-ansible21:13
*** heikkine has joined #openstack-ansible21:13
*** dmsimard|off has joined #openstack-ansible21:13
*** gchamoul has joined #openstack-ansible21:13
*** tbarron has joined #openstack-ansible21:13
*** django has joined #openstack-ansible21:13
*** tobberydberg has joined #openstack-ansible21:13
*** EmilienM has joined #openstack-ansible21:13
*** antonym has joined #openstack-ansible21:13
*** crazzy has joined #openstack-ansible21:13
*** bjoernt has joined #openstack-ansible21:13
*** arxcruz|rover has joined #openstack-ansible21:13
*** bverschueren has joined #openstack-ansible21:13
*** spotz has joined #openstack-ansible21:13
*** wpp has joined #openstack-ansible21:13
*** melwitt has joined #openstack-ansible21:13
*** johnsom has joined #openstack-ansible21:13
*** noonedeadpunk has joined #openstack-ansible21:13
*** aspiers has joined #openstack-ansible21:13
*** jonher has joined #openstack-ansible21:13
*** orwell.freenode.net sets mode: +o ChanServ21:13
*** logan- has joined #openstack-ansible21:13
*** nwonknu has joined #openstack-ansible21:13
*** jroll has joined #openstack-ansible21:13
*** zbr|pto has joined #openstack-ansible21:13
*** rpittau|afk has joined #openstack-ansible21:13
*** fyx has joined #openstack-ansible21:13
*** gundalow has joined #openstack-ansible21:13
*** donnyd has joined #openstack-ansible21:13
*** jrosser has joined #openstack-ansible21:13
*** mnaser has joined #openstack-ansible21:13
*** brad- has joined #openstack-ansible21:13
*** cloudnull has joined #openstack-ansible21:13
*** dirk has joined #openstack-ansible21:13
*** gary_perkins has joined #openstack-ansible21:13
*** partlycloudy has joined #openstack-ansible21:13
*** Adri2000 has joined #openstack-ansible21:13
*** mcarden has joined #openstack-ansible21:13
*** cyberpear has joined #openstack-ansible21:13
*** guilhermesp has joined #openstack-ansible21:13
*** jhesketh has joined #openstack-ansible21:13
*** janno has joined #openstack-ansible21:13
*** alanmeadows has joined #openstack-ansible21:13
*** mubix has joined #openstack-ansible21:13
*** Jeffrey4l has joined #openstack-ansible21:13
*** yoctozepto has joined #openstack-ansible21:13
*** snadge has joined #openstack-ansible21:13
*** ianychoi has joined #openstack-ansible21:13
*** bjolo has joined #openstack-ansible21:13
*** redrobot has joined #openstack-ansible21:13
*** djhankb has joined #openstack-ansible21:13
*** timburke has joined #openstack-ansible21:13
*** redkrieg has joined #openstack-ansible21:13
*** ebbex has joined #openstack-ansible21:13
*** johanssone has joined #openstack-ansible21:13
*** strattao has joined #openstack-ansible21:13
*** mmercer has joined #openstack-ansible21:13
*** mrda has joined #openstack-ansible21:13
*** gillesMo has joined #openstack-ansible21:13
*** mugsie has joined #openstack-ansible21:13
*** NewJorg has joined #openstack-ansible21:13
*** sep has joined #openstack-ansible21:13
openstackgerritMerged openstack/openstack-ansible-galera_client master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71168821:26
openstackgerritMerged openstack/openstack-ansible-openstack_openrc master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71169621:36
*** nurdie has joined #openstack-ansible21:38
openstackgerritMerged openstack/openstack-ansible-memcached_server master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71169221:39
*** nurdie_ has joined #openstack-ansible21:40
*** nicolasbock has quit IRC21:42
*** nurdie has quit IRC21:44
openstackgerritMerged openstack/ansible-role-python_venv_build master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71172721:46
openstackgerritMerged openstack/openstack-ansible-repo_server master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71172521:46
openstackgerritMerged openstack/openstack-ansible-rabbitmq_server master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71172421:49
openstackgerritMerged openstack/openstack-ansible-os_sahara master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71171921:54
openstackgerritMerged openstack/ansible-role-systemd_networkd master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71172921:56
openstackgerritMerged openstack/openstack-ansible-os_trove master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71172221:57
openstackgerritMerged openstack/openstack-ansible-os_keystone master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71170821:59
openstackgerritMerged openstack/openstack-ansible-openstack_hosts master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71169522:00
openstackgerritMerged openstack/openstack-ansible-os_heat master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71170522:03
openstackgerritMerged openstack/openstack-ansible-os_masakari master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71171122:04
openstackgerritMerged openstack/openstack-ansible-os_designate master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71170322:05
openstackgerritMerged openstack/openstack-ansible-os_congress master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71170222:07
openstackgerritMerged openstack/openstack-ansible-os_murano master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71171222:09
openstackgerritMerged openstack/openstack-ansible-galera_server master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71168922:10
openstackgerritMerged openstack/openstack-ansible-os_tacker master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71172022:12
openstackgerritMerged openstack/ansible-role-systemd_service master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71173022:15
openstackgerritMerged openstack/openstack-ansible-os_swift master: Updated from OpenStack Ansible Tests  https://review.opendev.org/70950822:17
openstackgerritMerged openstack/openstack-ansible-os_barbican master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71169822:28
CeeMacsnadge: are you still about?22:33
CeeMacI'm curious about your lab setup on vsphere :D22:33
openstackgerritMerged openstack/openstack-ansible-os_rally master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71171822:38
*** joshualyle has joined #openstack-ansible22:41
*** spatel has joined #openstack-ansible22:41
*** spatel has quit IRC22:42
*** joshualyle has quit IRC22:44
openstackgerritMerged openstack/openstack-ansible-ceph_client master: Updated from OpenStack Ansible Tests  https://review.opendev.org/70946622:44
*** jrosser has quit IRC22:51
openstackgerritMerged openstack/openstack-ansible-os_manila master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71171022:52
*** jrosser has joined #openstack-ansible22:53
*** ansmith has quit IRC23:05
snadgei just happen to be yes23:08
snadgeCeeMac: not a lot to say about it really, apart from you need to enable promiscuous mode on the vswitch, allow arp changes and forged transmits.. otherwise the bridging / arp stuff just doesn't work23:10
snadgealso at least on centos hosts, there's a bug with nested KVM virtualisation, so i needed to enable a setting on the compute nodes to stop instances from just freezing on boot23:11
snadgeOn the compute node(s) in the [libvirt] section of /etc/nova/nova.conf set hw_machine_type as follows:  hw_machine_type = x86_64=pc-i440fx-rhel7.2.023:14
CeeMacsnadge: do you have multiple nodes running containers? How is your host networking set up, dual up links? I had problems with cross host container network connectivity last time i tried. I have a feeling it was to do with teaming and fail over settings (route based on originating port id)23:24
openstackgerritMerged openstack/openstack-ansible-os_nova master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71171423:29
*** joshualyle has joined #openstack-ansible23:31
*** rh-jelabarre has quit IRC23:31
*** joshualyle has quit IRC23:35
*** ahosam has quit IRC23:35
openstackgerritMerged openstack/openstack-ansible-os_octavia master: Updated from OpenStack Ansible Tests  https://review.opendev.org/71171523:42
*** tosky has quit IRC23:51

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!