| admin1 | hi experts .. in codesearch, how do I search for a term,, but limit it to openstack-ansible only ? | 12:22 |
|---|---|---|
| noonedeadpunk | admin1: you can select projects to look at | 12:47 |
| noonedeadpunk | there's "advanced" below search bar | 12:48 |
| noonedeadpunk | so, we can merge https://review.opendev.org/q/topic:%22osa%252Fcore-2.12%22+(status:open%20OR%20status:merged) I guess? | 12:55 |
| noonedeadpunk | I thought it would be harder tbh... | 12:55 |
| admin1 | if we want to have all urls under 443 .. like nova.domain.com, neutron.domain.com , etc under *.domain.com SSL cert, how/where are such things defined ? | 13:11 |
| admin1 | the 443 is because in some orgs only 22 and 443 outbound is allowed .. so other ports are blocked | 13:11 |
| noonedeadpunk | I think you would need to set haproxy acls for that | 13:13 |
| noonedeadpunk | but actually it's good question, and we don't have doc for it | 13:13 |
| noonedeadpunk | we actually want to look for support of that one day, bu we haven't yet | 13:19 |
| admin1 | its just a matter for public endpoint (haproxy) and the corresponding entry in keystone | 13:20 |
| admin1 | i am trying to check how to do this .. | 13:20 |
| noonedeadpunk | I think you would need override each <service>_service_publicuri | 13:25 |
| noonedeadpunk | (and keep an eye on _service_publicurl) | 13:25 |
| admin1 | gnocchi failed to upgrade when upgrading from 23.1.0 > 23.2.0 .. https://paste.opendev.org/show/bpI276IGrhQ7TUtE0901/ 2nd run gives contraints not found .. how do i force it to rebuild again for gnocchi only | 13:26 |
| noonedeadpunk | It sounds like upper-constraints are not present on repo.... or we just broke smth for minor upgrades... | 13:27 |
| noonedeadpunk | but actually, you can run os-gnocchi-install.yml -e venv_rebuild=true | 13:28 |
| noonedeadpunk | (have you run repo-server role while upgrading? | 13:29 |
| admin1 | i copy paste from here: https://docs.openstack.org/openstack-ansible/wallaby/admin/upgrades/minor-upgrades.html :) | 13:30 |
| admin1 | it did have the setup infra setp | 13:30 |
| admin1 | i put a # on gnocchi and above and ran it again .. so that the rest can upgrade .. then will work on gnocchi separately | 13:30 |
| admin1 | i found the overrides .. thanks noonedeadpunk .. i will setup a new aio with the publicurl override and see how good it goes | 13:34 |
| admin1 | and after that, will try to do it in production .. and i guess i have to manually update existing public endpoints in the db | 13:34 |
| noonedeadpunk | well, playbook will create more emndpoints, but you ould need to delete old ones | 13:36 |
| admin1 | i plan to override the variables before the aio runs | 13:37 |
| noonedeadpunk | but you will need to have haproxy acls defined as well | 13:38 |
| admin1 | i did not know about those | 13:38 |
| noonedeadpunk | https://www.haproxy.com/blog/how-to-map-domain-names-to-backend-server-pools-with-haproxy/ | 13:41 |
| noonedeadpunk | haproxy role has ACL support, but you would need to redefine all services as well to add ACL there | 13:42 |
| admin1 | found that in /etc/ansible/roles/haproxy_server/templates/service.j2 | 13:46 |
| noonedeadpunk | https://docs.openstack.org/openstack-ansible-haproxy_server/latest/configure-haproxy.html#adding-access-control-lists-to-haproxy-front-end | 13:46 |
| admin1 | for gnocchi, i think something wrong with one dependency: https://paste.opendev.org/show/811830/ | 13:50 |
| admin1 | python-rados | 13:50 |
| noonedeadpunk | oh, it is | 13:50 |
| noonedeadpunk | check this out https://opendev.org/openstack/openstack-ansible-os_gnocchi/commit/2938fadcf3bc662495c5a135ba3fcd63b1e2040b | 13:51 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_gnocchi stable/wallaby: Do not provide ceph_alternative extra for ceph https://review.opendev.org/c/openstack/openstack-ansible-os_gnocchi/+/822793 | 13:51 |
| noonedeadpunk | or that ^ | 13:52 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_glance master: Add support for TLS to Glance https://review.opendev.org/c/openstack/openstack-ansible-os_glance/+/821011 | 13:57 |
| admin1 | another thing noticed during upgrade is it kind of hangs/stuck out on this [os_octavia Download image from artefact server ] .. waiting for it to timeout .. ( maybe for hours ) | 14:09 |
| opendevreview | James Gibson proposed openstack/openstack-ansible master: [WIP] Add support for TLS to Glance backends https://review.opendev.org/c/openstack/openstack-ansible/+/821090 | 14:17 |
| noonedeadpunk | well, I'd say there might be some connectivity issues... Basically this task downloads http://tarballs.openstack.org/octavia/test-images/test-only-amphora-x64-haproxy-ubuntu-bionic.qcow2 | 14:18 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_octavia master: Use focal amphora test image by default https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/822834 | 14:20 |
| *** dviroel is now known as dviroel|afk | 14:22 | |
| opendevreview | James Denton proposed openstack/openstack-ansible-os_ironic master: Update Ironic Documentation https://review.opendev.org/c/openstack/openstack-ansible-os_ironic/+/822203 | 14:37 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_nova master: Disable shell for nova when tunneled migration not used https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/822838 | 14:37 |
| opendevreview | James Denton proposed openstack/openstack-ansible-os_ironic master: Remove glance_api_servers from ironic.conf https://review.opendev.org/c/openstack/openstack-ansible-os_ironic/+/822839 | 15:02 |
| admin1 | i don't recall selecting rally .. its a test suite isn't it ? .. but uprade fails on ERROR rally ModuleNotFoundError: No module named 'pymysql'", "2021-12-23 14:43:44.971 37185 ERROR rally \u001b [00m"]} | 15:22 |
| noonedeadpunk | yep, it is | 15:22 |
| admin1 | os_rally : Check for db - fails in this task | 15:23 |
| noonedeadpunk | it's weird, as we run rally for all ci | 15:23 |
| admin1 | this is all on ubuntu-focal .. previous version was 23.1.2 .. being upgrded to 23.2.0 | 15:24 |
| noonedeadpunk | oh well https://opendev.org/openstack/openstack-ansible-os_rally/commit/e1b13a1e448d99363217d49da3fef194b5a91c09 | 15:24 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_rally stable/wallaby: Install PyMySQL as rally commands may not work without it https://review.opendev.org/c/openstack/openstack-ansible-os_rally/+/822802 | 15:24 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_rally stable/victoria: Install PyMySQL as rally commands may not work without it https://review.opendev.org/c/openstack/openstack-ansible-os_rally/+/822803 | 15:24 |
| noonedeadpunk | I wonder if we should add another label, like backport-candidate | 15:25 |
| noonedeadpunk | so we could keep track on things that worth backporting | 15:26 |
| admin1 | i am going to add it manually now and rerun that playbook to continue .. | 15:26 |
| *** dviroel|afk is now known as dviroel|afk|lunch | 15:29 | |
| kleini | Does review.opendev.org not accept RSA keys any more? I get 'send_pubkey_test: no mutual signature algorithm' for my 4096 RSA key. | 15:40 |
| noonedeadpunk | Um, there were some issues with git-review module and git 2.34 | 15:41 |
| noonedeadpunk | my rsa works fwiw | 15:42 |
| noonedeadpunk | but might be set of ciphers limited | 15:42 |
| kleini | SSH login does not work at all for me. but it can be some month ago, I used that. To all my other servers this SSH key still works and the Gerrit frontend accepts it when removing and re-adding it. | 15:48 |
| kleini | oh, it is a client setting. good to know | 15:50 |
| kleini | PubkeyAcceptedKeyTypes +ssh-rsa | 15:51 |
| noonedeadpunk | you have ubuntu xenial ?:) | 15:51 |
| kleini | manjaro stable | 15:51 |
| noonedeadpunk | It's too stable imo... | 15:51 |
| noonedeadpunk | I can recall need to set that like 5 years ago.... | 15:52 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible master: Remove references to unsupported operating systems https://review.opendev.org/c/openstack/openstack-ansible/+/782557 | 16:05 |
| *** dviroel|afk|lunch is now known as dviroel | 16:10 | |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_zun master: Update Zun api-paste https://review.opendev.org/c/openstack/openstack-ansible-os_zun/+/822847 | 16:30 |
| opendevreview | Merged openstack/openstack-ansible-plugins master: Add pkcs11_provider defenition https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/822255 | 16:32 |
| opendevreview | James Gibson proposed openstack/openstack-ansible-specs master: Add proposal for enabling TLS on all internal communications https://review.opendev.org/c/openstack/openstack-ansible-specs/+/822850 | 16:50 |
| admin1 | my gnocchi upgrade is stuck on os_gnocchi : Perform a Gnocchi DB sync .. for ages ( like 1+hour ) .. any ideas on how to move ahead | 17:07 |
| opendevreview | Merged openstack/ansible-role-python_venv_build master: Use the native python module to create virtual environments https://review.opendev.org/c/openstack/ansible-role-python_venv_build/+/822274 | 17:25 |
| opendevreview | Merged openstack/openstack-ansible-os_adjutant master: Filter out Django version https://review.opendev.org/c/openstack/openstack-ansible-os_adjutant/+/822745 | 17:30 |
| opendevreview | Merged openstack/openstack-ansible-os_adjutant master: Remove static parameter for import https://review.opendev.org/c/openstack/openstack-ansible-os_adjutant/+/822256 | 17:32 |
| opendevreview | Merged openstack/openstack-ansible master: Replace obsoleted include with import_task/include_task https://review.opendev.org/c/openstack/openstack-ansible/+/822227 | 17:53 |
| *** akahat|ruck is now known as akahat|out | 17:57 | |
| opendevreview | Merged openstack/openstack-ansible master: Use the python venv module to build the ansible runtime venv https://review.opendev.org/c/openstack/openstack-ansible/+/822273 | 17:58 |
| spatel | anyone here build openstack for HPC environment? I meant work on infiniband network? | 18:05 |
| spatel | i am getting involved to build university HPC cluster using Openstack so collecting information | 18:06 |
| opendevreview | Merged openstack/openstack-ansible master: Use python3.8 for CentOS 8 https://review.opendev.org/c/openstack/openstack-ansible/+/822260 | 18:19 |
| admin1 | i have this in my log .. '<r1c2_gnocchi_container-33d80ba5> Task "Perform a Gnocchi DB sync" has been omitted from the job because the conditional "["(gnocchi_storage_driver == 'file') | ternary(True, _gnocchi_is_first_play_host)", 'not gnocchi_identity_only | bool']" was evaluated as "False" -- does this mean its not going to do a db sync .. as | 18:39 |
| admin1 | the process gets stuck at this state and does not even move ahead .. for hours | 18:39 |
| admin1 | i don't suppose nuking the gnocchi containers and the db and restarting might help ? | 18:52 |
| admin1 | nuking the containers is also the same .. stuck in the db sync ... Task "Perform a Gnocchi DB sync" has been omitted from the job because the conditional "["(gnocchi_storage_driver == 'file') | ternary(True, _gnocchi_is_first_play_host)", 'not gnocchi_identity_only | bool']" was evaluated as "False" | 19:38 |
| admin1 | i have one queestion .. if i set db storage driver = file , there are 3 controllers .. does gnocchi save the files in the container itself ? | 19:38 |
| admin1 | and if that is the case, won't the files be in one and not in another based on which api server creates it | 19:38 |
| admin1 | unless the gnocchi fs is on nfs mount or something | 19:38 |
| admin1 | i opened up a bug report .. https://bugs.launchpad.net/openstack-ansible/+bug/1955676 | 19:42 |
| *** dviroel is now known as dviroel|brb | 19:57 | |
| *** dviroel|brb is now known as dviroel | 20:20 | |
| *** dviroel is now known as dviroel|out | 20:23 | |
| admin1 | noonedeadpunk, when you have time, can you please view this ? https://bugs.launchpad.net/openstack-ansible/+bug/1955676 ... i am kind of stuck | 20:57 |
| admin1 | well, not kind of stuck . but really stuck :) | 20:57 |
| jrosser_ | admin1: you’ve followed this? https://docs.openstack.org/openstack-ansible-ceph_client/latest/configure-ceph.html#configure-os-gnocchi-with-ceph-client | 21:03 |
| admin1 | jrosser_, yes and ceph itself is not an issue .. its failing to create database when installing | 21:11 |
| jrosser_ | then I would try running the db setup command manually | 21:12 |
| jrosser_ | these usually produce output, or have verbose flags, or write stuff to the system log | 21:12 |
| admin1 | doing it manually you mean ? | 21:13 |
| admin1 | first it got stuck here, so i took the gnocchi db backup, and then deleted the gnocchi user and database .. and then deleted the containers .. so that everything is like new .. but it gets stuck in the same place .. like its not even trying to do anything | 21:14 |
| admin1 | i will check how to do a manual db setup .. and see if its stuck in something | 21:14 |
| admin1 | the error says that step has been omitted .. if that is what it says its doing .. | 21:15 |
| jrosser_ | not quite | 21:16 |
| jrosser_ | it is only omitted on your second and third controllers | 21:17 |
| jrosser_ | “is_first_play_host” is your clue there | 21:18 |
| jrosser_ | this should be done once, on the first host that is targeted | 21:18 |
| admin1 | the file where this is done is /etc/ansible/roles/os_gnocchi/tasks/gnocchi_db_sync.yml . . .. i will try to capture the output and then display it | 21:19 |
| jrosser_ | well that’s just one command it runs | 21:20 |
| jrosser_ | that you can do easily yourself in a terminal to try to see why it does not work | 21:21 |
| admin1 | well, i do not know fully what this is supposed to be .. {{ gnocchi_db_sync_options }} | 21:21 |
| jrosser_ | use codesearch | 21:21 |
| admin1 | RuntimeError: Redis Python module is unavailable | 21:29 |
| admin1 | ok .. so i found my culprit | 21:29 |
| admin1 | codesearch is in my bookmarks now :) | 21:31 |
| admin1 | i updated the bug to mark it as invalid | 21:33 |
| admin1 | actually, i am going to mark it as a bug and submit a patch for it | 21:55 |
| *** sshnaidm is now known as sshnaidm|afk | 21:57 | |
| opendevreview | Sashi Dahal proposed openstack/openstack-ansible-os_gnocchi master: when incoming driver used is redis - which is typical in big/public cloud deployments, without this package, the installation is stuck on db sync operation and never times out https://review.opendev.org/c/openstack/openstack-ansible-os_gnocchi/+/822860 | 22:17 |
| opendevreview | Sashi Dahal proposed openstack/openstack-ansible-os_gnocchi master: add redis package to gnocchi. https://review.opendev.org/c/openstack/openstack-ansible-os_gnocchi/+/822860 | 22:21 |
| opendevreview | James Denton proposed openstack/openstack-ansible-os_ironic master: Remove glance_api_servers from ironic.conf https://review.opendev.org/c/openstack/openstack-ansible-os_ironic/+/822839 | 22:24 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!