| admin0 | thanks cloudnull .. | 00:00 |
|---|---|---|
| cloudnull | enjoy your evening | 00:00 |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova master: Remove linked libs when using ironic compute https://review.openstack.org/647888 | 00:04 |
| openstackgerrit | Merged openstack/openstack-ansible master: Add panko to integrated build https://review.openstack.org/647898 | 00:11 |
| nurdie_ | In an upgrade, haproxy-install.yml failed with the conditional check 'not is_metal | bool' failing from os-lxc-container-setup.yml | 00:13 |
| nurdie_ | Pike to Queens upgrade, containerized services | 00:14 |
| nurdie_ | Any ideas on where to even start with that? | 00:16 |
| nurdie_ | The entire run-upgrade.sh has gone flawlessly, so I know is_metal is false | 00:16 |
| openstackgerrit | Merged openstack/openstack-ansible master: Add telemetry service bundle to AIO tests https://review.openstack.org/647921 | 00:19 |
| nurdie_ | The error was: error while evaluating conditional (not is_metal | bool): {{ properties.is_metal | default(false) }}: 'properties' is undefined | 00:21 |
| *** dxiri has quit IRC | 00:30 | |
| nurdie_ | Is this an ansible bug? o_0 | 00:30 |
| *** tosky has quit IRC | 00:31 | |
| nurdie_ | Our environment has services containerized, but haproxy is on metal. I also found that reflected in the group properties for haproxy | 00:48 |
| nurdie_ | My workaround was running haproxy-install.yml --extra-vars "is_metal=true", then I commented out the plays that already ran in run-upgrade.sh and it seems to be continuing on just fine | 00:49 |
| *** cmart has quit IRC | 00:51 | |
| *** luksky has quit IRC | 00:52 | |
| *** markvoelker has joined #openstack-ansible | 01:18 | |
| nurdie_ | https://pastebin.com/jfz2ei0A | 01:21 |
| nurdie_ | Galera upgrade failed >_< | 01:21 |
| nurdie_ | This is nowhere on the internet | 01:24 |
| nurdie_ | I was able to restart mysql on infra1_galera. Thank the gods | 01:32 |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-os_horizon master: Place policy in correct folder https://review.openstack.org/648806 | 01:55 |
| cloudnull | nurdie_ did you make it go ? | 02:34 |
| cloudnull | kinda sounds like bad facts | 02:34 |
| cloudnull | however, properties is something in the inventory | 02:35 |
| cloudnull | when you upgraded did you checkout then re-bootstrap? or are you upgrading with the `run-upgrade.sh` script ? | 02:35 |
| openstackgerrit | Mohammed Naser proposed openstack/ansible-role-python_venv_build master: speedup: move when block to outside include https://review.openstack.org/648809 | 02:36 |
| nurdie_ | cloudnull: no | 02:39 |
| nurdie_ | cloudnull: I did run-upgrade.sh | 02:39 |
| nurdie_ | So | 02:39 |
| nurdie_ | I think specifying is_metal=true for haproxy-install messed up the inventory somehow | 02:40 |
| nurdie_ | ansible infra1 -a msg="{{ hostvars['infra1_galera_container-688806d6']['ansible_host'] }}" -vvvv | 02:40 |
| nurdie_ | That gives me the right fact | 02:40 |
| cloudnull | haproxy, by default runs on metal so maybe there's no need to set that. | 02:40 |
| cloudnull | the entry haproxy_hosts will simply ensure hap is running on the physical host | 02:41 |
| nurdie_ | The haproxy play fails without setting that | 02:41 |
| nurdie_ | cloudnull: https://pastebin.com/kcg2U6aX | 02:42 |
| nurdie_ | I found an ansible related bug that may be responsible for that, but I'm not sure | 02:42 |
| nurdie_ | I'm completely stuck here lol | 02:43 |
| cloudnull | hum, | 02:45 |
| cloudnull | [WARNING]: Found both group and host with same name: infra3 that looks odd to me | 02:45 |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible master: octavia: use br-lbaas IP for health managers https://review.openstack.org/648793 | 02:46 |
| cloudnull | maybe you have an infra{1..3} group? | 02:46 |
| nurdie_ | I do | 02:46 |
| cloudnull | which is causing some confusion ? | 02:46 |
| nurdie_ | infra1, 2 and 3 | 02:46 |
| nurdie_ | 3 controllers HA | 02:46 |
| cloudnull | but do you have a group named infra1 with the host named infra1 too ? | 02:46 |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-os_octavia master: Update role for new source build process https://review.openstack.org/648231 | 02:47 |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-os_octavia master: Updated from OpenStack Ansible Tests https://review.openstack.org/639544 | 02:47 |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-os_octavia master: Break out config files for each octavia service https://review.openstack.org/603228 | 02:47 |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-os_octavia master: Fix old docs listing octavia as experimental https://review.openstack.org/636776 | 02:47 |
| cloudnull | nurdie_ something like | 02:47 |
| cloudnull | https://pasted.tech/pastes/0cece922e23cf5caeebeb924a57c4f045b636ba6 | 02:47 |
| nurdie_ | ansible infra1 -m debug -a msg="{{ groups['infra1'] }}" -vvvv | 02:47 |
| nurdie_ | Gives me nothing | 02:47 |
| cloudnull | running that from the /opt/openstack-ansible/playbooks directory ? | 02:48 |
| nurdie_ | Where do I search for that? Yes that could be a thing | 02:48 |
| nurdie_ | Yes, I am | 02:48 |
| cloudnull | that config would be in /etc/openstack_deploy | 02:48 |
| mnaser | cores: please review https://review.openstack.org/#/q/topic:use-integrated-repo-for-all-tests+is:open -- that's the last stuff we need left to land integrated testing everywhere | 02:49 |
| nurdie_ | Is _infrastructure_hosts a group? | 02:49 |
| cloudnull | if you have a similar set of config you may need to hack on your openstack_inventory.json file to correct the issue, once those groups are removed. | 02:49 |
| cloudnull | os-infra_hosts | 02:49 |
| * cloudnull dont remember seeing an _infrastructure_hosts | 02:50 | |
| cloudnull | mnaser looking | 02:50 |
| nurdie_ | os-infra_hosts is empty | 02:50 |
| nurdie_ | No it's not lol | 02:51 |
| mnaser | I think trove is the only non integrated one right now.. I can't really do much more about it | 02:51 |
| nurdie_ | yes it is! | 02:51 |
| nurdie_ | [root@deployhost openstack_deploy]# grep group openstack_inventory.json | grep infra1 | 02:55 |
| nurdie_ | That gives nothing. Does that help? | 02:55 |
| cloudnull | this is a good example of the required config options - https://gist.github.com/cloudnull/eab22ba500843343470a7fd1e3f55d1c#file-openstack_user_config-yml-L131-L180 | 02:56 |
| cloudnull | the json would need to be flatted for that grep to work | 02:57 |
| cloudnull | can you `grep -rni infra1 /etc/openstack_deploy | 02:58 |
| cloudnull | just to see if infra1 is used in anything in /etc/openstack_deploy/{conf.d,env.d} | 02:58 |
| nurdie_ | It is not used in conf.d or env.d | 02:59 |
| cloudnull | used more than once in the openstack_user_config.yml file ? | 02:59 |
| nurdie_ | We found it I think | 03:00 |
| nurdie_ | https://bugs.launchpad.net/openstack-ansible/+bug/1755609 | 03:01 |
| openstack | Launchpad bug 1755609 in openstack-ansible "Galera xinetd only_from listens to load balancers' "ansible_host" rather than container management IP" [Medium,Confirmed] | 03:01 |
| nurdie_ | That fixed our problem, but now the play might be failing to create galera users | 03:01 |
| nurdie_ | lo | 03:01 |
| cloudnull | ah! | 03:01 |
| cloudnull | so the xinetd needed to be set to 0.0.0.0 ? | 03:02 |
| cloudnull | ive seen that when haproxy running on the infra hosts, is that the case in your env ? | 03:02 |
| nurdie_ | Yes | 03:02 |
| nurdie_ | It's running on the infrahosts | 03:02 |
| nurdie_ | Now galera users weren't created >_< | 03:02 |
| cloudnull | https://github.com/openstack/openstack-ansible-galera_server/blob/master/defaults/main.yml#L67-L76 | 03:03 |
| cloudnull | that option can be set for persistence, if youve not already | 03:03 |
| nurdie_ | Yes that's how we fixed it | 03:04 |
| nurdie_ | Thanks! | 03:04 |
| nurdie_ | But not with 0.0.0.0. We used our container management network CIDR | 03:04 |
| *** cshen has joined #openstack-ansible | 03:06 | |
| cloudnull | ++ | 03:08 |
| cloudnull | thats a better solution that 0.0.0.0 | 03:08 |
| nurdie_ | We're having to massage it now | 03:08 |
| nurdie_ | Seems like it stops mysql and tries to create galera monitoring users without restarting mysql | 03:09 |
| cloudnull | galera_server will need to have an upgrade variable set to go | 03:11 |
| *** cshen has quit IRC | 03:11 | |
| cloudnull | however it should be running, the playbooks wont shut it down without firing a handler to restart it | 03:11 |
| cloudnull | if it is down on all of the nodes, within the container you can run `galera_new_cluster` to restart it | 03:12 |
| nurdie_ | cloudnull: Thanks for your help I really appreciate it | 03:15 |
| cloudnull | anytime | 03:16 |
| openstackgerrit | Merged openstack/openstack-ansible-os_panko master: Test using integrated build https://review.openstack.org/648514 | 04:00 |
| openstackgerrit | Merged openstack/openstack-ansible-os_ceilometer master: Test using integrated build https://review.openstack.org/648513 | 04:01 |
| openstackgerrit | Merged openstack/openstack-ansible-os_aodh master: Test using integrated build https://review.openstack.org/647851 | 04:01 |
| openstackgerrit | Merged openstack/openstack-ansible-os_gnocchi master: Test using integrated build https://review.openstack.org/648515 | 04:21 |
| *** nurdie_ has quit IRC | 04:48 | |
| *** rickflare has quit IRC | 06:21 | |
| *** DanyC has joined #openstack-ansible | 06:30 | |
| openstackgerrit | Merged openstack/openstack-ansible master: gate: cache /etc/pip.conf inside containers https://review.openstack.org/648566 | 06:40 |
| openstackgerrit | Dirk Mueller proposed openstack/openstack-ansible master: Re-enable openSUSE Leap 15.0 aio_metal jobs https://review.openstack.org/646032 | 06:41 |
| *** dirk has joined #openstack-ansible | 06:41 | |
| *** DanyC has quit IRC | 08:02 | |
| *** DanyC has joined #openstack-ansible | 09:03 | |
| *** DanyC has quit IRC | 09:19 | |
| *** hwoarang has quit IRC | 09:26 | |
| *** hwoarang has joined #openstack-ansible | 09:27 | |
| *** phasespace has quit IRC | 09:28 | |
| openstackgerrit | Merged openstack/ansible-role-python_venv_build master: speedup: move when block to outside include https://review.openstack.org/648809 | 09:37 |
| openstackgerrit | Merged openstack/openstack-ansible master: Add the manila service to OSA https://review.openstack.org/645653 | 09:58 |
| openstackgerrit | Merged openstack/openstack-ansible master: rally: add empty rally.yml.aio file https://review.openstack.org/648741 | 10:21 |
| openstackgerrit | Merged openstack/openstack-ansible-os_horizon master: Place policy in correct folder https://review.openstack.org/648806 | 10:33 |
| *** tosky has joined #openstack-ansible | 10:47 | |
| openstackgerrit | Merged openstack/ansible-role-python_venv_build master: Add fact gathing for hardware when building venvs https://review.openstack.org/648708 | 11:10 |
| *** jbadiapa has quit IRC | 11:16 | |
| *** johnthetubaguy has quit IRC | 11:16 | |
| *** stuartgr has quit IRC | 11:16 | |
| *** arbrandes has quit IRC | 11:16 | |
| *** timburke has quit IRC | 11:16 | |
| *** timburke has joined #openstack-ansible | 11:16 | |
| *** johnthetubaguy has joined #openstack-ansible | 11:17 | |
| *** stuartgr has joined #openstack-ansible | 11:17 | |
| *** arbrandes has joined #openstack-ansible | 11:17 | |
| *** crazzy has quit IRC | 11:20 | |
| *** crazzy has joined #openstack-ansible | 11:22 | |
| evrardjp | FYI release tooling is now complaining, since https://review.openstack.org/#/c/645653/ . This introduced manila, but that role has no release notes handling | 11:29 |
| openstackgerrit | Merged openstack/openstack-ansible-os_swift master: Updated from OpenStack Ansible Tests https://review.openstack.org/639550 | 11:30 |
| evrardjp | oh no my bad, it's just the trackbranch that is missing | 11:32 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: Add trackbranch for manila https://review.openstack.org/648822 | 11:33 |
| openstackgerrit | Merged openstack/openstack-ansible-os_barbican master: cleanup: stop installing git for barbican run-time https://review.openstack.org/648256 | 11:35 |
| evrardjp | I changed the release tooling to care of those cases -- but we said we'll have trackbranch everywhere though | 11:42 |
| evrardjp | so now it's silently passing through these errors, which I am not sure it's good. | 11:43 |
| *** luksky has joined #openstack-ansible | 11:54 | |
| *** hamzaachi has joined #openstack-ansible | 12:02 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_rally master: Test using integrated build https://review.openstack.org/648598 | 13:11 |
| odyssey4me | mnaser Yes, I think our --trusted-host CLI parameter is overriding the pip.conf one... I was hoping that pip would merge them, but it seems not. I would think, personally, that this is a bug given that all other settings in the global pip.conf result in a merge of the settings. | 13:15 |
| *** markvoelker has quit IRC | 13:25 | |
| *** DanyC has joined #openstack-ansible | 13:32 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/ansible-role-python_venv_build master: Add upstream pip bug reference https://review.openstack.org/648824 | 13:40 |
| *** DanyC has quit IRC | 14:21 | |
| openstackgerrit | Merged openstack/openstack-ansible master: octavia: use br-lbaas IP for health managers https://review.openstack.org/648793 | 14:56 |
| *** luksky has quit IRC | 15:07 | |
| openstackgerrit | Merged openstack/openstack-ansible master: Add trackbranch for manila https://review.openstack.org/648822 | 15:35 |
| *** luksky has joined #openstack-ansible | 16:03 | |
| mnaser | o/ | 16:31 |
| mnaser | evrardjp: hi! once we land https://review.openstack.org/#/c/636776/ - https://review.openstack.org/#/c/648509/ - https://review.openstack.org/#/c/639544/ - https://review.openstack.org/#/c/648231/ - https://review.openstack.org/#/c/648112/ -- we can branch stable/stein I think | 16:36 |
| mnaser | some of those are "nice to have" | 16:36 |
| mnaser | but they're all in the gate now and likely finishing at the same time | 16:37 |
| mnaser | everything has been moved to python_venv_build, we killed repo_build, integrated tests everywhere, what an awesome effort by everyone | 16:37 |
| *** luksky has quit IRC | 16:39 | |
| *** tosky has quit IRC | 16:41 | |
| *** goldenfri has quit IRC | 17:00 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_octavia master: Test using integrated build https://review.openstack.org/648509 | 17:56 |
| openstackgerrit | Merged openstack/openstack-ansible-os_octavia master: Fix old docs listing octavia as experimental https://review.openstack.org/636776 | 18:03 |
| openstackgerrit | Merged openstack/openstack-ansible-os_octavia master: Update role for new source build process https://review.openstack.org/648231 | 18:03 |
| openstackgerrit | Merged openstack/openstack-ansible-os_octavia master: Updated from OpenStack Ansible Tests https://review.openstack.org/639544 | 18:03 |
| openstackgerrit | Merged openstack/openstack-ansible-os_panko master: Remove extras https://review.openstack.org/648112 | 18:05 |
| openstackgerrit | Michael Johnson proposed openstack/openstack-ansible-os_octavia master: Set octavia_amp_image_owner_id by default https://review.openstack.org/648744 | 18:12 |
| mnaser | evrardjp: we can branch stable/stein and release rc :) | 18:22 |
| *** DanyC has joined #openstack-ansible | 18:26 | |
| *** markvoelker has joined #openstack-ansible | 18:42 | |
| *** DanyC has quit IRC | 18:53 | |
| *** DanyC has joined #openstack-ansible | 18:53 | |
| *** DanyC has quit IRC | 19:01 | |
| *** markvoelker has quit IRC | 19:05 | |
| *** markvoelker has joined #openstack-ansible | 19:05 | |
| *** DanyC has joined #openstack-ansible | 19:23 | |
| *** DanyC has quit IRC | 19:31 | |
| *** samueldmq has quit IRC | 19:31 | |
| *** DanyC has joined #openstack-ansible | 19:34 | |
| *** hamzaachi has quit IRC | 19:35 | |
| *** DanyC has quit IRC | 19:38 | |
| *** DanyC has joined #openstack-ansible | 19:38 | |
| *** DanyC has quit IRC | 19:43 | |
| *** DanyC has joined #openstack-ansible | 19:52 | |
| *** djhankb has quit IRC | 19:53 | |
| *** DanyC has quit IRC | 19:54 | |
| *** DanyC has joined #openstack-ansible | 19:58 | |
| *** DanyC has quit IRC | 20:00 | |
| *** DanyC has joined #openstack-ansible | 20:01 | |
| *** luksky has joined #openstack-ansible | 20:44 | |
| *** hamzy has quit IRC | 20:53 | |
| *** djhankb has joined #openstack-ansible | 21:09 | |
| djhankb | is there a way to set /etc/neutron/plugins/ml2/linuxbridge_agent.ini settings with overrides similar to how you set "neutron_neutron_conf_overrides:" in user_variables.yml? | 21:09 |
| djhankb | what I am trying to do is set "physical_interface_mappings" as well as "bridge_mappings" in the [linux_bridge] section of linuxbridge_agent.ini. Perhaps there is a way other than an overrides option that I am not aware of | 21:11 |
| *** DanyC has quit IRC | 21:36 | |
| openstackgerrit | Michael Johnson proposed openstack/openstack-ansible-os_octavia master: Set octavia_amp_image_owner_id by default https://review.openstack.org/648744 | 21:51 |
| openstackgerrit | Mohammed Naser proposed openstack/ansible-role-python_venv_build master: Revert "speedup: move when block to outside include" https://review.openstack.org/648840 | 21:56 |
| *** hamzy has joined #openstack-ansible | 22:01 | |
| *** markvoelker has quit IRC | 23:11 | |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-os_horizon master: Copy over YAML policy files https://review.openstack.org/648841 | 23:18 |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-os_horizon master: Copy over YAML policy files https://review.openstack.org/648841 | 23:27 |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-os_horizon master: Stop installing extra packages for Horizon https://review.openstack.org/648842 | 23:27 |
| *** kplant has joined #openstack-ansible | 23:35 | |
| *** DanyC has joined #openstack-ansible | 23:36 | |
| *** DanyC has quit IRC | 23:40 | |
| *** markvoelker has joined #openstack-ansible | 23:42 | |
| *** DanyC has joined #openstack-ansible | 23:45 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!