| *** cshen has joined #openstack-ansible | 00:11 | |
| *** cshen has quit IRC | 00:16 | |
| *** MickyMan77 has joined #openstack-ansible | 00:44 | |
| *** MickyMan77 has quit IRC | 00:52 | |
| *** maharg101 has joined #openstack-ansible | 01:41 | |
| *** maharg101 has quit IRC | 01:45 | |
| *** cshen has joined #openstack-ansible | 02:12 | |
| *** cshen has quit IRC | 02:16 | |
| *** cp- has quit IRC | 02:25 | |
| *** cp- has joined #openstack-ansible | 02:28 | |
| *** cyberpear has joined #openstack-ansible | 02:46 | |
| *** macz_ has joined #openstack-ansible | 02:54 | |
| *** macz_ has quit IRC | 02:59 | |
| *** miloa has joined #openstack-ansible | 04:03 | |
| *** MickyMan77 has joined #openstack-ansible | 04:09 | |
| *** cshen has joined #openstack-ansible | 04:12 | |
| *** cshen has quit IRC | 04:16 | |
| *** MickyMan77 has quit IRC | 04:18 | |
| *** mindthecap has quit IRC | 04:29 | |
| *** mindthecap has joined #openstack-ansible | 04:29 | |
| *** evrardjp has quit IRC | 04:33 | |
| *** evrardjp has joined #openstack-ansible | 04:33 | |
| *** mindthecap has quit IRC | 04:43 | |
| *** MickyMan77 has joined #openstack-ansible | 04:44 | |
| *** MickyMan77 has quit IRC | 04:48 | |
| *** MickyMan77 has joined #openstack-ansible | 04:48 | |
| *** cyberpear has quit IRC | 04:55 | |
| *** recyclehero has quit IRC | 05:05 | |
| *** recyclehero has joined #openstack-ansible | 05:12 | |
| *** cshen has joined #openstack-ansible | 05:34 | |
| *** cshen has quit IRC | 05:38 | |
| *** maharg101 has joined #openstack-ansible | 05:42 | |
| *** maharg101 has quit IRC | 05:47 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible stable/ussuri: Bump SHAs for stable/ussuri https://review.opendev.org/755975 | 06:25 |
|---|---|---|
| jrosser | morning | 06:29 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_neutron master: Fix linter errors https://review.opendev.org/755573 | 06:33 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-ceph_client master: Fix linter errors https://review.opendev.org/755697 | 06:37 |
| noonedeadpunk | mornings! | 06:41 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_keystone master: Fix linter errors https://review.opendev.org/755568 | 06:43 |
| noonedeadpunk | argh https://zuul.opendev.org/t/openstack/build/4567735a5d5a4bf08b333d1459352d2d/log/job-output.txt#20741 | 06:43 |
| noonedeadpunk | and they've dropped all pg_num options from the role | 06:44 |
| jrosser | logs seem really slow to load recently | 06:46 |
| noonedeadpunk | yeah | 06:46 |
| jrosser | i think they just take away those vars we used to use, but the options are still there? | 06:46 |
| * jrosser looks for patch | 06:46 | |
| jrosser | it's this isnt it https://github.com/ceph/ceph-ansible/commit/cb44f655fc5921ae153bc737ff042e40e9b9aa77#diff-5a429d6364fa796579c46ab1ba5b99c8L8-L9 | 06:48 |
| *** MickyMan77 has quit IRC | 06:49 | |
| noonedeadpunk | ah yes. but that means we need to override all pools... | 06:49 |
| *** MickyMan77 has joined #openstack-ansible | 06:50 | |
| jrosser | the change to pg_num is really bad | 06:53 |
| noonedeadpunk | I will increase mon_max_pg_per_osd I guess | 06:54 |
| noonedeadpunk | oh my, just found this https://opendev.org/openstack/openstack-ansible/src/branch/master/playbooks/defaults/ceph_ansible.yml | 06:55 |
| *** MickyMan77 has quit IRC | 06:58 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-lxc_container_create master: Fix linter errors https://review.opendev.org/755700 | 06:59 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-lxc_container_create master: Fix linter errors https://review.opendev.org/755700 | 06:59 |
| *** MickyMan77 has joined #openstack-ansible | 07:04 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Update ansible-lint==4.3.5, flake8==3.8.3, bashate>=0.5.1 https://review.opendev.org/755065 | 07:05 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-lxc_container_create master: Fix linter errors https://review.opendev.org/755700 | 07:08 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-lxc_container_create master: Add centos-8/focal/bionic zuul jobs for the different storage backends https://review.opendev.org/755996 | 07:08 |
| *** andrewbonney has joined #openstack-ansible | 07:12 | |
| *** pcaruana has joined #openstack-ansible | 07:12 | |
| *** cshen has joined #openstack-ansible | 07:13 | |
| jrosser | noonedeadpunk: we should unblock telemetry - starts here i think https://review.opendev.org/#/c/755866/ | 07:16 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_gnocchi master: Use the utility host for db setup tasks https://review.opendev.org/754722 | 07:17 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-galera_server master: Explicitly use mysql collection https://review.opendev.org/755594 | 07:18 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-galera_server master: Use infra jobs instead of functional https://review.opendev.org/755586 | 07:19 |
| *** yolanda has quit IRC | 07:21 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: Fix octavia tempest tests https://review.opendev.org/755737 | 07:21 |
| *** rpittau|afk is now known as rpittau | 07:29 | |
| *** maharg101 has joined #openstack-ansible | 07:30 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-lxc_container_create master: Add centos-8/focal/bionic zuul jobs for the different storage backends https://review.opendev.org/755996 | 07:33 |
| openstackgerrit | Merged openstack/openstack-ansible-os_gnocchi master: Fix linter errors https://review.opendev.org/755866 | 07:34 |
| *** yolanda has joined #openstack-ansible | 07:37 | |
| *** tosky has joined #openstack-ansible | 07:42 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_neutron master: Fix linter errors https://review.opendev.org/755573 | 07:44 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-tests master: Trace execution of test-ansible-syntax.sh https://review.opendev.org/756003 | 08:03 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-lxc_container_create master: Add centos-8/focal/bionic zuul jobs for the different storage backends https://review.opendev.org/755996 | 08:07 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-lxc_container_create master: Fix linter errors https://review.opendev.org/755700 | 08:09 |
| jrosser | noonedeadpunk: i think these need to be removed http://codesearch.openstack.org/?q=defaults%2Fceph_ansible.yml | 08:19 |
| jrosser | because this is now deleted? https://review.opendev.org/#/c/755065/7/playbooks/defaults/ceph_ansible.yml | 08:19 |
| noonedeadpunk | ah, yes | 08:19 |
| noonedeadpunk | eventually now I'm not so sure that I did right, but that looked very weird | 08:20 |
| noonedeadpunk | as we had ceph_conf_overrides defined twice... | 08:21 |
| jrosser | thats bound to be confusing | 08:22 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Update ansible-lint==4.3.5, flake8==3.8.3, bashate>=0.5.1 https://review.opendev.org/755065 | 08:23 |
| *** jbadiapa has joined #openstack-ansible | 08:27 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_cloudkitty master: Updated from OpenStack Ansible Tests https://review.opendev.org/755532 | 08:39 |
| *** cp- has quit IRC | 08:45 | |
| *** cp- has joined #openstack-ansible | 08:49 | |
| arxcruz | noonedeadpunk: jrosser where the collect logs script is located for osa jobs? i need to figure out why the openstack-ansible-deploy-aio_distro_metal_tempestconf-centos-8 is failing | 08:56 |
| arxcruz | it says connection refused when tri to access the keystone api endpoint | 08:56 |
| arxcruz | but I need to collect the .config/clouds.yaml and the tempest.conf files | 08:57 |
| jrosser | the thing that collects the logs is here https://github.com/openstack/openstack-ansible/blob/master/scripts/log-collect.sh | 08:57 |
| openstackgerrit | Merged openstack/openstack-ansible-galera_server master: Fix linter errors https://review.opendev.org/755698 | 08:59 |
| recyclehero | morning guys | 09:00 |
| recyclehero | where can I find the logs for haproxy? | 09:00 |
| recyclehero | /var/lib/haproxy is the chroot from there /dev/log but thats a special file. | 09:01 |
| recyclehero | from the infra host | 09:01 |
| jrosser | recyclehero: journalctl -u haproxy | 09:02 |
| jrosser | arxcruz: i think your tempest.conf is here https://zuul.opendev.org/t/openstack/build/8e09c647b0504886b9e81f6a9031ad63/log/logs/etc/host/tempest/tempest.conf.txt | 09:07 |
| arxcruz | jrosser: nope, this is the default tempest.conf file | 09:23 |
| jrosser | ok :) unfortunately we do not use tempestconf in OSA so i'm not surprised we don't collect the log files | 09:23 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-lxc_container_create master: Add centos-8/focal/bionic zuul jobs for the different storage backends https://review.opendev.org/755996 | 09:28 |
| *** miloa has quit IRC | 09:29 | |
| ebbex | if i define container_extra_networks in /etc/openstack_deploy/group_vars/dnsaas_containers.yml, how come all containers get this additional network? | 09:33 |
| ebbex | Or rather shouldn't this apply only to containers in dnsaas_containers group? | 09:34 |
| *** pto has joined #openstack-ansible | 09:34 | |
| openstackgerrit | Arx Cruz proposed openstack/openstack-ansible master: DNM - Storing home directory https://review.opendev.org/756025 | 09:36 |
| *** sshnaidm|afk is now known as sshnaidm | 09:47 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_nova master: Updated from OpenStack Ansible Tests https://review.opendev.org/755541 | 09:49 |
| openstackgerrit | Arx Cruz proposed openstack/openstack-ansible-os_tempest master: Fix tempest init logic https://review.opendev.org/753393 | 09:51 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_keystone master: Fix linter errors https://review.opendev.org/755568 | 09:54 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Update ansible-lint==4.3.5, flake8==3.8.3, bashate>=0.5.1 https://review.opendev.org/755065 | 09:54 |
| noonedeadpunk | ebbex: because you will also define network in provider_networks? | 09:56 |
| noonedeadpunk | are you referencing? https://docs.openstack.org/openstack-ansible/latest/reference/configuration/extra-networks.html | 09:57 |
| *** recyclehero has quit IRC | 09:57 | |
| noonedeadpunk | But I think that it's probably worth setting container_extra_networks in group_vars anyway... | 09:57 |
| *** pmannidi has joined #openstack-ansible | 09:58 | |
| noonedeadpunk | I feel that container_vars are buggy for a while... | 09:58 |
| jrosser | you should be able to add an interface to just one container group | 09:59 |
| jrosser | i do this | 09:59 |
| jrosser | to debug i would use a ad-hoc ansible debug command to print var=container_extra_networks for the group all_containers | 10:00 |
| jrosser | then take it out of your group vars, double check for duplicate definition in user_variables etc | 10:00 |
| pto | Im still trying to federated identities to work on OpenStack Quuens. The keystone table is "locked" because SQL triggers make them read only. Browsing the code, these triggers should be dropped during upgrade. Question is now - why are they not dropped? | 10:12 |
| pto | E.g. https://opendev.org/openstack/keystone/commit/8c190a1a29dbb17fee044827fc9b651918dfc51e | 10:12 |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova master: Fix linter errors https://review.opendev.org/755574 | 10:28 |
| jrosser | pto: you are probably best asking that in openstack-keystone | 10:36 |
| jrosser | it's not really the OSA ansible code thats doing that directly, its internal to the service i think? | 10:37 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-lxc_container_create master: Add centos-8/focal/bionic zuul jobs for the different storage backends https://review.opendev.org/755996 | 10:39 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-lxc_container_create master: Add centos-8/focal/bionic zuul jobs for the different storage backends https://review.opendev.org/755996 | 10:43 |
| ebbex | noonedeadpunk: Yeah pretty much, ah i think i see what i did there. it should probably say group_bind: [dnsaas_containers] in my case? | 10:44 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-lxc_container_create master: Add centos-8/focal/bionic zuul jobs for the different storage backends https://review.opendev.org/755996 | 10:45 |
| ebbex | or perhaps not at all, I'm not interested/can't set static ip's on the extra network for designate as it's not under my control (which i know is sorta a bad idea) | 10:46 |
| pto | jrosser: To me, it appears to be an update contract which is not applied correctly. Question is, if its a keystone internal thing or an command which needs to be applied. I will try in #openstack-keystone | 10:46 |
| ebbex | jrosser: thanks for the tip, i see that dnsaas_containers contains all containers, whilst designate_all contains what I'm looking for. | 10:51 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_senlin master: Use the utility host for db setup tasks https://review.opendev.org/756039 | 10:57 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_senlin master: Updated from OpenStack Ansible Tests https://review.opendev.org/752892 | 10:58 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-nspawn_hosts master: Fix CI jobs https://review.opendev.org/755322 | 11:04 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-nspawn_hosts master: Add CI jobs for ubuntu focal https://review.opendev.org/755305 | 11:04 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-nspawn_hosts master: Update supported operating systems https://review.opendev.org/755306 | 11:05 |
| openstackgerrit | Merged openstack/openstack-ansible-os_rally master: Updated from OpenStack Ansible Tests https://review.opendev.org/755543 | 11:05 |
| openstackgerrit | Merged openstack/openstack-ansible-openstack_hosts master: Fix linter errors https://review.opendev.org/755704 | 11:07 |
| openstackgerrit | Merged openstack/openstack-ansible stable/train: Bump SHAs for stable/train https://review.opendev.org/755974 | 11:11 |
| *** pto has quit IRC | 11:19 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_trove master: Updated from OpenStack Ansible Tests https://review.opendev.org/755547 | 11:26 |
| *** pto has joined #openstack-ansible | 11:27 | |
| *** shyamb has joined #openstack-ansible | 11:29 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-nspawn_hosts master: Add CI jobs for ubuntu focal https://review.opendev.org/755305 | 11:39 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-nspawn_hosts master: Update supported operating systems https://review.opendev.org/755306 | 11:39 |
| *** mgariepy has quit IRC | 11:45 | |
| openstackgerrit | Marcus Klein proposed openstack/openstack-ansible-ceph_client master: Add configuration example for Ceph configuration from files. https://review.opendev.org/756051 | 11:54 |
| openstackgerrit | Marcus Klein proposed openstack/openstack-ansible master: Add link to configuration example for Ceph configuration from files. https://review.opendev.org/755797 | 11:59 |
| kleini | jrosser, noonedeadpunk: ^^^ moved my documenation to ceph_client role. | 12:01 |
| *** rfolco has joined #openstack-ansible | 12:06 | |
| noonedeadpunk | can I ask you to reference this doc from that section as well? https://opendev.org/openstack/openstack-ansible-ceph_client/src/branch/master/doc/source/configure-ceph.rst#user-content-configuration-file-overrides | 12:07 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: Fix octavia tempest tests https://review.opendev.org/755737 | 12:09 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-ceph_client master: Fix linter errors https://review.opendev.org/755697 | 12:09 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-ceph_client master: Allow to proceed with role if ceph_conf_file is set https://review.opendev.org/755820 | 12:10 |
| openstackgerrit | James Gibson proposed openstack/openstack-ansible-ops master: Change ansible tests to prefer Python3 over Python2 in vitualenv https://review.opendev.org/751773 | 12:11 |
| pto | jrosser: I think i have make it work. Commening out the task "- include: keystone_federation_sp_idp_setup.yml" and the play completes the play sucessful, and unlocks the SQL tables. Commenting it in again and running the same role makes everything seems to work. | 12:11 |
| noonedeadpunk | kleini: or may I edit it a little? | 12:12 |
| jrosser | pto: that sounds like the tasks may be a bit out of sequence? | 12:12 |
| pto | jrosser: It seems so. Sould I open a bug or pr on it or is the queens code dead? | 12:13 |
| jrosser | pto: like we are doing the idp setup bit at the wrong point during an upgrade | 12:13 |
| openstackgerrit | Marcus Klein proposed openstack/openstack-ansible-ceph_client master: Add configuration example for Ceph configuration from files. https://review.opendev.org/756051 | 12:13 |
| jrosser | it would be better to do a patch if you can, i don't think we will have an easy way to reproduce this | 12:13 |
| kleini | noonedeadpunk, added the additional link | 12:14 |
| jrosser | pto: i think that the interesting thing will be if the issue is only ever for the version upgrade you are doing now | 12:15 |
| jrosser | or if this would affect any version | 12:15 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-ceph_client master: Allow to proceed with role if ceph_conf_file is set https://review.opendev.org/755820 | 12:16 |
| *** mgariepy has joined #openstack-ansible | 12:17 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-ceph_client master: Allow to proceed with role if ceph_conf_file is set https://review.opendev.org/755820 | 12:17 |
| arxcruz | noonedeadpunk: jrosser so https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_c97/753393/8/check/openstack-ansible-deploy-aio_distro_metal_tempestconf-centos-8/c97338b/logs/home/.config/openstack/clouds.yaml.txt | 12:17 |
| arxcruz | does it sounds right for you guys? | 12:18 |
| arxcruz | tempestconf is getting the http://172.29.236.100:5000/v3 but it's getting connection refused | 12:18 |
| arxcruz | chandankumar: ^ | 12:18 |
| noonedeadpunk | is it in lxc? | 12:19 |
| arxcruz | not sure what you mean | 12:19 |
| jrosser | noonedeadpunk: it's the distro / metal / tempestconf job | 12:20 |
| jrosser | looks like something listens on port 5000 https://zuul.opendev.org/t/openstack/build/c97338b87f0941b890f993fcd6b26169/log/logs/openstack/instance-info/ss_10-47-03.log.txt#30 | 12:20 |
| arxcruz | maybe is a firewall issue? | 12:21 |
| noonedeadpunk | arxcruz: are you sure it tries to reach that IP and not public one? | 12:22 |
| openstackgerrit | Andrew Bonney proposed openstack/openstack-ansible-os_tempest stable/train: Pin designate-tempest-plugin to 0.7.0 for train branch https://review.opendev.org/756057 | 12:23 |
| arxcruz | noonedeadpunk: oh shit, you're right | 12:23 |
| arxcruz | "2020-10-05 10:47:00.964 94398 ERROR tempest urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='158.69.76.30', port=5000): Max retries exceeded with url: /v3/projects (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fb69c62d828>: Failed to establish a new connection: [Errno 111] Connection refused',))", | 12:23 |
| openstackgerrit | Andrew Bonney proposed openstack/openstack-ansible-os_designate stable/train: Fix python interpreter bug for designate source installs on train https://review.opendev.org/755720 | 12:23 |
| noonedeadpunk | as on public... we don't have haproxy yet | 12:23 |
| noonedeadpunk | as we kind of need this to get public IP working https://review.opendev.org/#/c/733408/ | 12:25 |
| jrosser | arxcruz: we recently merged a patch to ensure that services only bind to the internal IP rather than 0.0.0.0 | 12:25 |
| jrosser | and that needed to get in before we could land the haproxy for bare metal deploys patch | 12:25 |
| noonedeadpunk | jrosser: btw I guess magnum will be just broken until then... | 12:26 |
| jrosser | so it's possible this used to work by accident before due to the binding to 0.0.0.0 | 12:26 |
| jrosser | noonedeadpunk: yes i was looking at a few failing things earlier and they all look the say | 12:26 |
| jrosser | *same | 12:26 |
| jrosser | but even haproxy will kind of not help | 12:26 |
| jrosser | becasue everything will blow up on the self signed certitificate too unless can be told not to verify | 12:27 |
| noonedeadpunk | but how we do with lxc? we don't have valid ssl there | 12:27 |
| jrosser | tbh i don't know | 12:28 |
| *** shyamb has quit IRC | 12:28 | |
| jrosser | feels like something else has changed very recently (maybe even in tempest) that makes this all break | 12:28 |
| noonedeadpunk | I mean that magnum iirc tries to reach keystone from master nodes or smth like this? | 12:28 |
| jrosser | oh well thats OK, we fixed heat for that a while ago | 12:29 |
| jrosser | there is a config for that now in heat.conf | 12:29 |
| arxcruz | noonedeadpunk: it seems tempestconf only accepts publicURL | 12:29 |
| noonedeadpunk | then you can try setting depends-on this https://review.opendev.org/#/c/733408/ | 12:29 |
| jrosser | oh wow - is that actually working? | 12:30 |
| *** cshen has quit IRC | 12:33 | |
| noonedeadpunk | yeah, look at magnum) https://review.opendev.org/#/c/755569/4 | 12:37 |
| noonedeadpunk | it was failing in tempest without it - I didn't wait until posting logs unfortunatelly:( | 12:38 |
| noonedeadpunk | jrosser: btw, I'm a bit out of good ideas, how to distribute galera-ca.pem across all roles. This is neded for using galera SSL. We have variables like http://codesearch.openstack.org/?q=keystone_galera_ssl_ca_cert&i=nope&files=&repos= which exist but does not help in deploying certificates... | 12:44 |
| noonedeadpunk | *across all hosts | 12:44 |
| noonedeadpunk | we create it here https://opendev.org/openstack/openstack-ansible-galera_server/src/branch/master/tasks/galera_server_ssl_self_signed.yml#L29-L36 | 12:46 |
| noonedeadpunk | and we put it with galera_client part https://opendev.org/openstack/openstack-ansible-galera_server/src/branch/master/tasks/galera_client_ssl.yml | 12:46 |
| noonedeadpunk | run galera_client part against all hosts? | 12:47 |
| noonedeadpunk | and eventually things work right now until galera_ssl_server == galera_server_bootstrap_node | 12:49 |
| openstackgerrit | Marcus Klein proposed openstack/openstack-ansible-ceph_client master: Add configuration example for Ceph configuration from files. https://review.opendev.org/756051 | 12:51 |
| kleini | noonedeadpunk, anything I can do regarding the failing ansible-linters for my reviews? I don't think, those failures are due to my change, except the too long line, which is already fixed now | 12:52 |
| jrosser | noonedeadpunk: does this help? https://review.opendev.org/#/c/641445/ | 12:53 |
| noonedeadpunk | partially | 12:55 |
| noonedeadpunk | in case of self-signed, we create ca after openstack_hsts run... | 12:56 |
| noonedeadpunk | so for user-provided this might be ok | 12:57 |
| *** weshay|ruck has joined #openstack-ansible | 12:57 | |
| jrosser | i think this is where we would be better refactoring a bit | 12:58 |
| jrosser | generally it would be simpler if all of these roles galera/hproxy/whatever just accept a cert from the deploy host | 12:59 |
| jrosser | and that can either be self signed or genuine | 12:59 |
| jrosser | then as far as the role is concerned both cases work the same and we take out the complexity | 13:00 |
| noonedeadpunk | yeah... | 13:00 |
| noonedeadpunk | and use the same self-signed ssl for all these services, or only CA? | 13:02 |
| *** cshen has joined #openstack-ansible | 13:03 | |
| * jrosser just meetings for a bit | 13:09 | |
| noonedeadpunk | just infra jobs were working nicely, unti I decided to test out SSL https://review.opendev.org/#/c/755586/ | 13:11 |
| noonedeadpunk | and now I feel that this part needs to be handled in better way than it is now... but not sure I see good approcach without really rewriting the whole thing | 13:11 |
| noonedeadpunk | But I think that at least CA should be really placed on deploy host and spread across hosts, and in case of self-signed we probably should use that CA | 13:13 |
| noonedeadpunk | (don't interrrupt on this during meetings ofc) | 13:14 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-ceph_client master: Add configuration example for Ceph configuration from files. https://review.opendev.org/756051 | 13:15 |
| *** redrobot has joined #openstack-ansible | 13:31 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Update ansible-lint==4.3.5, flake8==3.8.3, bashate>=0.5.1 https://review.opendev.org/755065 | 13:32 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Add infra testing scenario https://review.opendev.org/755497 | 13:35 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Add infra testing scenario https://review.opendev.org/755497 | 13:35 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Add infra testing scenario https://review.opendev.org/755497 | 13:36 |
| *** spatel has joined #openstack-ansible | 13:37 | |
| *** pto has quit IRC | 14:01 | |
| *** rfolco is now known as rfolco|brb | 14:03 | |
| *** recyclehero has joined #openstack-ansible | 14:14 | |
| jrosser | noonedeadpunk: long long ago i did make a start on something https://review.opendev.org/#/c/644555/ | 14:19 |
| jrosser | thats probably most of the things needed to make a CA (new/fixed ansible modules may help make it nicer) | 14:21 |
| noonedeadpunk | the question is also if we want to use same self-SSL for all services? | 14:41 |
| jrosser | i think there are two parts to this | 14:42 |
| jrosser | if the user does not supply a CA and key then a self signed one must be created | 14:42 |
| jrosser | the for each service we create a cert/key signed by the original one, as they are needed | 14:43 |
| jrosser | i think my patch kind of looked at the first bit | 14:43 |
| jrosser | noonedeadpunk: lets make some notes? https://etherpad.opendev.org/p/osa-certificates-refactor | 14:46 |
| *** macz_ has joined #openstack-ansible | 14:46 | |
| *** macz_ has joined #openstack-ansible | 14:47 | |
| noonedeadpunk | I think that we probably need a role for this, which will have 2 path - create/deploy CA and create/deploy certificates | 14:49 |
| noonedeadpunk | or a module | 14:49 |
| openstackgerrit | Erik Berg proposed openstack/openstack-ansible-lxc_container_create master: Allow user to override UseRoutes in template https://review.opendev.org/756088 | 14:52 |
| * noonedeadpunk following and has suggestions | 15:00 | |
| jrosser | i'm kind of typed everything i'm thinking about - just hack in it if you've got more | 15:01 |
| openstackgerrit | Erik Berg proposed openstack/openstack-ansible-lxc_container_create master: Allow user to override UseDNS in template https://review.opendev.org/756096 | 15:02 |
| noonedeadpunk | dunno how comment there, so let me just say main point I was thinking about:) I think that self-singed certificates should be created per role, and in case we have not user provided one, but self-signed - no reason in re-using it? | 15:03 |
| *** mgariepy has quit IRC | 15:03 | |
| noonedeadpunk | so we can generate them not during deploy. but CA is generated during deploy and stored on the deploy host | 15:05 |
| noonedeadpunk | ok, let me comment lol | 15:05 |
| jrosser | sure :) | 15:05 |
| openstackgerrit | Merged openstack/openstack-ansible-os_cinder master: Updated from OpenStack Ansible Tests https://review.opendev.org/755531 | 15:10 |
| openstackgerrit | Erik Berg proposed openstack/openstack-ansible-lxc_container_create master: Allow user to override UseDNS in template https://review.opendev.org/756096 | 15:18 |
| openstackgerrit | Merged openstack/openstack-ansible-os_tacker master: Updated from OpenStack Ansible Tests https://review.opendev.org/755546 | 15:24 |
| *** recyclehero has quit IRC | 15:26 | |
| noonedeadpunk | jrosser: are certs issued even for IP addr agoing to be "verified"? | 15:28 |
| *** recyclehero has joined #openstack-ansible | 15:28 | |
| jrosser | they can be - i was just digging around in the openstack-ansible-ops repo because cloudnull did all sorts of stuff like this with osquery and the other add-ons | 15:29 |
| noonedeadpunk | oh | 15:29 |
| jrosser | but we still have /etc/hosts populated even without unbound so i think its do-able | 15:29 |
| noonedeadpunk | adding container names in haproxy, uh... | 15:30 |
| noonedeadpunk | but I think it is | 15:30 |
| jrosser | it would be nice to be running this without --insecure or equivalent | 15:31 |
| openstackgerrit | Merged openstack/openstack-ansible-os_keystone master: Fix linter errors https://review.opendev.org/755568 | 15:31 |
| jrosser | otherwise all sorts of problems will be hidden that only come up when real certs are used | 15:31 |
| noonedeadpunk | what we will be using for internal vip name?:) will just add something to hosts? | 15:32 |
| recyclehero | hey guys, if I only have one infra and one compute is it normal that all of keepalived tasks either skips or have nothing written infront of them | 15:33 |
| recyclehero | setup-infrastructure.yml | 15:33 |
| noonedeadpunk | recyclehero: totaly. you don't need keepalived when having <2 of haproxy instances | 15:33 |
| recyclehero | so whats the purpose of VIP in my case? | 15:34 |
| recyclehero | who handles the ARP proxy | 15:34 |
| noonedeadpunk | in your case just haproxy will listen on the VIPs | 15:34 |
| *** gyee has joined #openstack-ansible | 15:34 | |
| jrosser | VIP is a bit misleading name without keepalived, it's just an IP that typically you need to assign to br-mgmt on the infra host | 15:35 |
| noonedeadpunk | but without keeaplived I think it needs to be configured on interface manually | 15:35 |
| jrosser | you need to have two distinct IP, one for internal and one for external endpoint, otherwise bad-things will happen | 15:36 |
| noonedeadpunk | and internal vip on br-mgmt and public vip on public interface... | 15:36 |
| recyclehero | intersting tell me more please | 15:36 |
| recyclehero | if keepalived was present the VIPs listend by proxing arp on br-vlan and br-mgmt | 15:38 |
| recyclehero | jrosser: you mean change internal_lb_vip_address to the ip given to br-mgmt in network/interfaces | 15:39 |
| noonedeadpunk | no br-vlan is used only by neutron agents to provide vlan network for tenant vms | 15:39 |
| recyclehero | noonedeadpunk: aha ok the provider network which provides for the br-vlan | 15:40 |
| noonedeadpunk | yeh:) | 15:40 |
| jrosser | recyclehero: yes i think you can do that for the internal vip address setting | 15:41 |
| noonedeadpunk | recyclehero: I'd sayy just add this VIP maually to the interface as an alias IP | 15:41 |
| noonedeadpunk | recyclehero: or you can eventually override `haproxy_use_keepalived: true` in your user_variables | 15:42 |
| jrosser | recyclehero: you have to do that manually in this case because for an HA deployment as you point out keepalived would do this on your behalf | 15:42 |
| recyclehero | noonedeadpunk: so I'll set haproxy_use_keepalived: false, and change the internal_lb_vip_address to the br-mgmt ip | 15:44 |
| noonedeadpunk | jrosser: I like what we had written down. but please, let's not bring these changes in V?:) we can start working on role and testing things, but let's leave breaking changes after release?:) | 15:45 |
| recyclehero | jrosser: make an VIP by doing ARP manually or just the above | 15:45 |
| jrosser | just put the IP you want for the internal vip on br-mgmt, or use the one you already have there | 15:45 |
| jrosser | noonedeadpunk: oh yes i really want to get V done ASAP | 15:46 |
| noonedeadpunk | I'm just thinking about the time, when you decide to scale up, and you will need to have an extra IP anyway... | 15:46 |
| jrosser | kind of not so happy how much breakage with the linters and everything | 15:46 |
| noonedeadpunk | 755065 - fingers crossed | 15:48 |
| jrosser | i was just looking at that myself :) | 15:49 |
| noonedeadpunk | ceph passed | 15:49 |
| *** ChiTo has joined #openstack-ansible | 15:50 | |
| jrosser | i think we may be OK this time | 15:50 |
| noonedeadpunk | and debian as well... | 15:50 |
| noonedeadpunk | we need to summon someone for +W | 15:50 |
| * jrosser on it | 15:50 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Switch integrated linters to focal https://review.opendev.org/755759 | 15:51 |
| jrosser | hmm great time for slack to be having a bad day | 15:51 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Fix focal ceph jobs https://review.opendev.org/753376 | 15:51 |
| noonedeadpunk | oh, it's a bad guy today for me as well... | 15:51 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Use haproxy for metal deployments https://review.opendev.org/733408 | 15:52 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Fix octavia tempest tests https://review.opendev.org/755737 | 15:52 |
| *** gshippey has joined #openstack-ansible | 15:53 | |
| *** recyclehero has quit IRC | 15:59 | |
| gshippey | in relation to https://review.opendev.org/#/c/755261/ - would it be a good idea to provision a read only back up user to galera, and use those credentials within the back up script? @noonedeadpunk | 16:00 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Update integrated ansible-lint rules https://review.opendev.org/756121 | 16:00 |
| noonedeadpunk | gshippey: I'm not sure that read-only will be enough, as it might need table lock as well | 16:01 |
| noonedeadpunk | but provision some extra user with specified permissions is a good idea:) | 16:02 |
| gshippey | I will look into that then :)! | 16:03 |
| *** rfolco|brb is now known as rfolco | 16:03 | |
| ChiTo | Hi OSA team, I am still a little bit confused on the networking configurations, I am trying to deploy my own provider-network but I don't know If I have to previously configured my interfaces with OVS or Linux bridge or if both can live together? | 16:05 |
| noonedeadpunk | both can't live together for sure | 16:05 |
| ChiTo | My deployment is on CentOS 7.x and I would like to get a provider network for my floating IP addresses with a VLAN assigned on a bond and a Vxlan for the overlay | 16:05 |
| *** recyclehero has joined #openstack-ansible | 16:05 | |
| ChiTo | my question is if the vxlan can be previously configured with my own linux-bridge approach and just let the br-provider to be managed by OVS on the computes and neutron servers? | 16:06 |
| *** rpittau is now known as rpittau|afk | 16:06 | |
| ChiTo | noonedeadpunk: oh I see, thanks, so ideally is to let OVS to configure both the vxlan and external/vlan/provider network right? | 16:07 |
| noonedeadpunk | yes, exactly | 16:07 |
| jrosser | ChiTo: the defaults will be linux bridge for eveything, unless you have specifically configured it for OVS | 16:07 |
| ChiTo | noonedeadpunk: If that is the case, should I manage my ifcfg-br-vxlan internally assigning the OVSType and things like that? | 16:07 |
| ChiTo | independently on what the playbook does? | 16:08 |
| ChiTo | jrosser: Yep, I changed it to OVS applying the neutron_openvswitch_agent on the group binds because eventually I need DVR | 16:08 |
| jrosser | ok cool | 16:09 |
| ChiTo | jrosser: So I can just let the playbook to manage my br-provider assigning it to a physical interface for the bridge mappings (In my case a bonding interface) but not configure it on the Operating System right? | 16:10 |
| ChiTo | and automatically the bridges will be created by OVS? | 16:10 |
| *** gillesMo has joined #openstack-ansible | 16:11 | |
| jrosser | ChiTo: there is some documentation here which may be useful https://docs.openstack.org/openstack-ansible-os_neutron/latest/app-openvswitch.html | 16:11 |
| gillesMo | Hello ! I'm trying to upgrade from Rocky to Stein on Ubuntu 18.04. I don't use openstack-ansible to deploy Ceph, but just to configure the client part. But the setup-infrastructure.yml playbbok, launches ceph-install.yml wich fails with "ERROR! 'always_run' is not a valid attribute for a Task" in /etc/ansible/roles/ceph-defaults/tasks/check_socket_container.yml | 16:11 |
| gillesMo | I can't find a related bug. Aare the ceph roles always upgraded during the ansible bootstrap ? | 16:12 |
| ChiTo | jrosser: Thanks, I have followed it, but since I am on CentOS I don't know if I have to configure my interfaces with OVS previously on the network-scripts/* | 16:12 |
| recyclehero | guys I changed the lb vip ip, before that on the task "python_venv_build : Upgrade pip/setuptools/wheel to the versions we want" I would get no route to host | 16:16 |
| recyclehero | now I get connection refused | 16:16 |
| recyclehero | when I attach to the container which the task is being run against I can ping the IP which is said the connection is refures | 16:17 |
| recyclehero | d | 16:17 |
| jrosser | recyclehero: to get some context it's really helpful if you paste the error and surrounding output to paste.openstack.org | 16:17 |
| recyclehero | ok, will do. | 16:18 |
| recyclehero | http://paste.openstack.org/show/798701/ | 16:18 |
| jrosser | recyclehero: 172.29.236.11 is your internal vip? | 16:21 |
| recyclehero | yes | 16:21 |
| recyclehero | also infra1 | 16:21 |
| jrosser | normal debug flow for this would be to try to curl the url from the utility container, we probably expect that to fail | 16:21 |
| jrosser | then go look at haproxy and see if the backend for the repo server is up or down (hatop is useful for this) | 16:22 |
| *** tosky has quit IRC | 16:22 | |
| jrosser | then from the infra host try the same curl direct to the repo server IP rather than the vip | 16:22 |
| jrosser | so work backwards from the error toward the source | 16:22 |
| recyclehero | jrosser: tnx | 16:23 |
| recyclehero | jrosser: it also get refused on the same host | 16:30 |
| jrosser | ok well that’s Nginx I think, so see if it’s running and look at logs | 16:35 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-rabbitmq_server master: Require the use of community.rabbitmq ansible collection https://review.opendev.org/754657 | 16:36 |
| recyclehero | jrosser: I dont even have nginx on infra1 | 16:39 |
| jrosser | the request is being made to the repo server container | 16:40 |
| recyclehero | ok I have nginx on the repo container. but the ip is for infra1 the host machine(infra1) for the repo container | 16:43 |
| recyclehero | nginx doesnt have any error logs, empty | 16:44 |
| *** mgariepy has joined #openstack-ansible | 16:46 | |
| recyclehero | I see the connection you pointed out in /etc/haproxy/haproxy.cfg | 16:47 |
| recyclehero | frontend repo_all-front-1 | 16:47 |
| recyclehero | bind 172.29.236.11:8181 | 16:47 |
| recyclehero | shoudnt haproxy be listneing on 8181 on the infra1? | 16:48 |
| openstackgerrit | Merged openstack/openstack-ansible-nspawn_hosts master: Fix CI jobs https://review.opendev.org/755322 | 16:49 |
| *** maharg101 has quit IRC | 16:50 | |
| openstackgerrit | Merged openstack/openstack-ansible-lxc_container_create master: Fix linter errors https://review.opendev.org/755700 | 16:54 |
| openstackgerrit | Merged openstack/openstack-ansible-nspawn_hosts master: Add CI jobs for ubuntu focal https://review.opendev.org/755305 | 16:54 |
| recyclehero | is there a way I could see haproxy log in /var/lib/haproxy/dev/log | 16:54 |
| recyclehero | ? | 16:54 |
| jrosser | it's in the journal | 16:55 |
| jrosser | you should be able to see haproxy listening with netstat or ss type of tool | 16:55 |
| openstackgerrit | Merged openstack/openstack-ansible-nspawn_hosts master: Update supported operating systems https://review.opendev.org/755306 | 16:59 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-lxc_container_create master: Add centos-8/focal/bionic zuul jobs for the different storage backends https://review.opendev.org/755996 | 17:00 |
| openstackgerrit | Erik Berg proposed openstack/openstack-ansible-lxc_container_create master: Allow user to override UseDNS in template https://review.opendev.org/756096 | 17:01 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-lxc_container_create master: Add centos-8/focal/bionic zuul jobs for the different storage backends https://review.opendev.org/755996 | 17:04 |
| openstackgerrit | Merged openstack/openstack-ansible-tests master: Trace execution of test-ansible-syntax.sh https://review.opendev.org/756003 | 17:07 |
| *** andrewbonney has quit IRC | 17:08 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-lxc_container_create master: Remove support for Centos-7 https://review.opendev.org/742120 | 17:09 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-lxc_container_create master: Remove support for LXC2 configuration keys https://review.opendev.org/742121 | 17:09 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-nspawn_hosts master: Updated from OpenStack Ansible Tests https://review.opendev.org/754158 | 17:15 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-os_senlin master: Updated from OpenStack Ansible Tests https://review.opendev.org/752892 | 17:21 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_senlin master: Use the utility host for db setup tasks https://review.opendev.org/756039 | 17:23 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_senlin master: Updated from OpenStack Ansible Tests https://review.opendev.org/752892 | 17:23 |
| *** MickyMan77 has quit IRC | 17:24 | |
| *** recyclehero has quit IRC | 17:28 | |
| *** cyberpear has joined #openstack-ansible | 17:31 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: Use haproxy for metal deployments https://review.opendev.org/733408 | 17:33 |
| *** cshen has quit IRC | 17:35 | |
| *** recycleh1ro has joined #openstack-ansible | 17:35 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: Use haproxy for metal deployments https://review.opendev.org/733408 | 17:35 |
| *** cshen has joined #openstack-ansible | 17:40 | |
| recycleh1ro | hey, i get passed that. that was cuz I though it would work with the lb_exteranl ip for now. so didnt have the ip that I set in config file on the host | 17:41 |
| *** recycleh1ro is now known as recyckehero | 17:41 | |
| *** maharg101 has joined #openstack-ansible | 17:42 | |
| recyckehero | now I have this | 17:43 |
| recyckehero | http://paste.openstack.org/show/798706/ | 17:43 |
| *** cshen has quit IRC | 17:45 | |
| *** gillesMo has quit IRC | 17:46 | |
| *** gillesMo has joined #openstack-ansible | 17:47 | |
| *** maharg101 has quit IRC | 17:49 | |
| *** recyckehero has quit IRC | 17:51 | |
| *** alistar has joined #openstack-ansible | 17:52 | |
| *** alistar is now known as recyclehero | 17:52 | |
| *** MickyMan77 has joined #openstack-ansible | 18:03 | |
| openstackgerrit | Merged openstack/openstack-ansible-nspawn_hosts master: Updated from OpenStack Ansible Tests https://review.opendev.org/754158 | 18:07 |
| *** MickyMan77 has quit IRC | 18:12 | |
| fridtjof[m] | ..... i just accidentally deleted the admin project | 18:37 |
| fridtjof[m] | i feel stupid now :D | 18:37 |
| fridtjof[m] | while i'm at it, how do I nuke any state from my openstack environment? basically, how would I revert it to just after initial deployment (with the service and admin projects) | 18:38 |
| openstackgerrit | Merged openstack/openstack-ansible master: Update ansible-lint==4.3.5, flake8==3.8.3, bashate>=0.5.1 https://review.opendev.org/755065 | 18:47 |
| recyclehero | finally get to the final round setup-openstack.yml | 18:56 |
| recyclehero | whats this? | 18:56 |
| recyclehero | http://paste.openstack.org/show/798708/ | 18:56 |
| jrosser | recyclehero: which branch are you installing? | 18:57 |
| recyclehero | ha? where have I specified that? | 18:57 |
| recyclehero | master? | 18:58 |
| jrosser | the branch you checkout from your openstack-ansible repo decides which release of openstack you get installed | 18:58 |
| recyclehero | let me check | 18:58 |
| recyclehero | this is latest git log | 18:59 |
| recyclehero | commit eb44c5d05cf02a8f3add7c3c31ddb9fad8235a5a (HEAD -> master, origin/master, origin/HEAD) | 18:59 |
| recyclehero | master and the url is opendev openstack-ansible | 19:00 |
| recyclehero | latest commit is at Date: Mon Sep 28 21:06:16 2020 +0000 | 19:00 |
| jrosser | ok so you are installing master branch, which is bleeding edge of what will become the next release | 19:00 |
| recyclehero | jrosser: I should go find a release tag | 19:01 |
| recyclehero | ? | 19:01 |
| jrosser | if you want something more stable you'll see that there are tags on the stable/ussuri branch | 19:01 |
| jrosser | about every 2 weeks we have a process that creates new tag which has to pass an integration test | 19:01 |
| recyclehero | then do the 3 playbooks from start, or do I need do change configs ? | 19:01 |
| jrosser | in your openstack-ansible repo you should checkout the latest tag on the ussuri branch | 19:02 |
| *** viks____ has quit IRC | 19:02 | |
| jrosser | then run scripts/bootstrap-ansible.sh again, that will sort out the contents of /etc/ansible/roles to be as you need | 19:02 |
| recyclehero | ok I forgot git for tag git checkout tag ussuri ? | 19:03 |
| jrosser | you can then try to re-deploy, but an in-place downgrade is something quite unusual | 19:03 |
| recyclehero | so what? reinstall the target hosts? | 19:03 |
| recyclehero | i mean the underlying debian? | 19:03 |
| recyclehero | is there some cleanup scripts? | 19:04 |
| jrosser | 21.0.1 would be the latest tag on ussuri https://github.com/openstack/openstack-ansible/tree/21.0.1 | 19:04 |
| jrosser | as you've only run as far as keystone it'll probably be ok | 19:04 |
| jrosser | worst will be destroy/recreate the containers | 19:04 |
| recyclehero | i need to copy the files openstack_user_config and user_variables If they have changed/have diffrent structure? | 19:05 |
| jrosser | those should be OK | 19:06 |
| recyclehero | great thanks | 19:06 |
| fridtjof[m] | on that topic: what kind of state/facts are cached on the deployment hosts? suppose I want to make OSA completely reinitialize all my services (basically, as if I was installing OSA for the first time, setting up DBs, creating the admin + service projects, etc etc) - when does it do that? | 19:07 |
| jrosser | fridtjof[m]: each role carries a copy of https://github.com/openstack/openstack-ansible-os_glance/blob/master/tasks/db_setup.yml | 19:09 |
| jrosser | and https://github.com/openstack/openstack-ansible-os_glance/blob/master/tasks/service_setup.yml | 19:10 |
| jrosser | thats from glance but it's identical for each | 19:10 |
| jrosser | keystone role has the stuff for bootstrapping the admin project | 19:10 |
| fridtjof[m] | ohh, i was just assuming they were all gated behind some magic "this is the first setup" variable | 19:12 |
| jrosser | ansible idempotency helps there, only does what needs to be done | 19:13 |
| fridtjof[m] | background is that the nova-placement -> placement migration together with the haproxy config mishap seem to have corrupted the database in a way that now makes it impossible to start instances | 19:13 |
| fridtjof[m] | (where ansible didn't delete the old placement config from haproxy anymore) | 19:14 |
| fridtjof[m] | I assume some other services were failing to talk to placement after the upgrade then, and something got out of sync leading to other errors further down the line | 19:14 |
| fridtjof[m] | so... I guess dropping all the databases should probably do the trick? | 19:15 |
| jrosser | thats pretty much where all the state is | 19:16 |
| *** idlemind_ has quit IRC | 19:16 | |
| fridtjof[m] | alright, i'll report on how well that went later then :D | 19:17 |
| recyclehero | jrosser: I am getting lots of reference is not a tree on clone git repos | 19:18 |
| jrosser | ok, clean out everything from /etc/ansible/roles | 19:18 |
| recyclehero | ok | 19:18 |
| jrosser | the ansible git module has some really odd behaviour | 19:18 |
| recyclehero | just asking, the ansbile git module is git written in python? | 19:20 |
| jrosser | it's the cli wrapped in python https://github.com/ansible/ansible/blob/devel/lib/ansible/modules/git.py | 19:22 |
| *** tosky has joined #openstack-ansible | 19:29 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_senlin master: Use the utility host for db setup tasks https://review.opendev.org/756039 | 19:46 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_senlin master: Updated from OpenStack Ansible Tests https://review.opendev.org/752892 | 19:46 |
| *** maharg101 has joined #openstack-ansible | 19:46 | |
| *** maharg101 has quit IRC | 19:51 | |
| *** jungleboyj_ has joined #openstack-ansible | 20:20 | |
| *** CeeMac_ has joined #openstack-ansible | 20:20 | |
| *** jungleboyj has quit IRC | 20:25 | |
| *** fridtjof[m] has quit IRC | 20:25 | |
| *** jroll has quit IRC | 20:25 | |
| *** CeeMac has quit IRC | 20:25 | |
| *** jungleboyj_ is now known as jungleboyj | 20:25 | |
| *** CeeMac_ is now known as CeeMac | 20:25 | |
| *** jroll has joined #openstack-ansible | 20:27 | |
| *** fridtjof[m] has joined #openstack-ansible | 20:28 | |
| *** spatel has quit IRC | 20:32 | |
| fridtjof[m] | why could ansible include this file, but not run any tasks from it? | 20:32 |
| fridtjof[m] | https://github.com/openstack/openstack-ansible-galera_server/blob/stable/train/tasks/galera_setup.yml | 20:32 |
| fridtjof[m] | I don't see any when directives that would skip these | 20:34 |
| fridtjof[m] | nvm, i'll just recreate the galera containers | 20:41 |
| *** rfolco has quit IRC | 21:04 | |
| openstackgerrit | Merged openstack/openstack-ansible-lxc_container_create master: Updated from OpenStack Ansible Tests https://review.opendev.org/754154 | 21:06 |
| *** jbadiapa has quit IRC | 21:18 | |
| *** cshen has joined #openstack-ansible | 21:31 | |
| *** cshen has quit IRC | 21:36 | |
| *** maharg101 has joined #openstack-ansible | 21:47 | |
| *** d34dh0r53 has quit IRC | 21:52 | |
| *** maharg101 has quit IRC | 21:55 | |
| *** MickyMan77 has joined #openstack-ansible | 22:13 | |
| *** MickyMan77 has quit IRC | 22:21 | |
| *** PrinzElvis has quit IRC | 22:24 | |
| *** PrinzElvis has joined #openstack-ansible | 22:27 | |
| *** MickyMan77 has joined #openstack-ansible | 22:53 | |
| *** gshippey has quit IRC | 22:59 | |
| *** MickyMan77 has quit IRC | 23:02 | |
| *** tosky has quit IRC | 23:04 | |
| *** rfolco has joined #openstack-ansible | 23:09 | |
| *** cshen has joined #openstack-ansible | 23:32 | |
| *** cshen has quit IRC | 23:36 | |
| *** macz_ has quit IRC | 23:36 | |
| *** MickyMan77 has joined #openstack-ansible | 23:37 | |
| *** rfolco has quit IRC | 23:42 | |
| *** MickyMan77 has quit IRC | 23:45 | |
| *** maharg101 has joined #openstack-ansible | 23:52 | |
| *** maharg101 has quit IRC | 23:57 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!