| opendevreview | Merged openstack/openstack-ansible-ceph_client master: Remove conditional code for ubuntu version earlier than 20.x https://review.opendev.org/c/openstack/openstack-ansible-ceph_client/+/882826 | 00:32 |
|---|---|---|
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-ceph_client master: Add config and documentation for ceph perisistent write log cache https://review.opendev.org/c/openstack/openstack-ansible-ceph_client/+/882849 | 07:36 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-ceph_client master: Add releasenote for ceph immutable object cache and persistent write log cache https://review.opendev.org/c/openstack/openstack-ansible-ceph_client/+/882850 | 07:36 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-os_cinder master: Add way to periodically trim Cinder DB https://review.opendev.org/c/openstack/openstack-ansible-os_cinder/+/880975 | 07:45 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-os_nova master: Add way to periodically trim Nova DB https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/880971 | 07:46 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_cinder master: Add way to periodically trim Cinder DB https://review.opendev.org/c/openstack/openstack-ansible-os_cinder/+/880975 | 08:10 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_nova master: Add way to periodically trim Nova DB https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/880971 | 08:11 |
| jrosser | ^ thanks :) | 08:13 |
| jrosser | doh | 08:13 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/ansible-role-python_venv_build master: Fix venv_build_targets when used with multi-arch https://review.opendev.org/c/openstack/ansible-role-python_venv_build/+/881848 | 08:23 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_zun master: Install kata containers from source https://review.opendev.org/c/openstack/openstack-ansible-os_zun/+/880288 | 08:46 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Move repo_packages to group_vars https://review.opendev.org/c/openstack/openstack-ansible/+/881824 | 08:49 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Switch ubuntu upgrade jobs to Jammy https://review.opendev.org/c/openstack/openstack-ansible/+/879890 | 09:08 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Rename container_address to management_address https://review.opendev.org/c/openstack/openstack-ansible/+/883148 | 10:04 |
| opendevreview | Bjoern Teipel proposed openstack/openstack-ansible-rabbitmq_server stable/wallaby: Fix no longer existing version https://review.opendev.org/c/openstack/openstack-ansible-rabbitmq_server/+/883183 | 10:17 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-ceph_client master: Add ceph client and configuration for immutable object cache https://review.opendev.org/c/openstack/openstack-ansible-ceph_client/+/882829 | 10:17 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-ceph_client master: Add ceph client and configuration for immutable object cache https://review.opendev.org/c/openstack/openstack-ansible-ceph_client/+/882829 | 10:20 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-ceph_client master: Add immutable object cache documentation https://review.opendev.org/c/openstack/openstack-ansible-ceph_client/+/882830 | 10:20 |
| noonedeadpunk | I kinda wonder if focal failure is intermittent or not | 10:26 |
| opendevreview | Merged openstack/openstack-ansible-os_magnum master: Ensure service is restarted on unit file changes https://review.opendev.org/c/openstack/openstack-ansible-os_magnum/+/879970 | 10:30 |
| opendevreview | Merged openstack/openstack-ansible master: Populate scenario properly in CI for N-2 upgrade job https://review.opendev.org/c/openstack/openstack-ansible/+/883377 | 10:30 |
| jrosser | noonedeadpunk: focal ceph failure? | 10:40 |
| noonedeadpunk | here https://review.opendev.org/c/openstack/openstack-ansible-ceph_client/+/882829 | 10:41 |
| noonedeadpunk | but yes, seems like failures were different | 10:41 |
| jrosser | yes i don't understand that at all as the code in those patches is not actually used | 10:42 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-ceph_client master: Add config and documentation for ceph perisistent write log cache https://review.opendev.org/c/openstack/openstack-ansible-ceph_client/+/882849 | 11:27 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-ceph_client master: Add releasenote for ceph immutable object cache and persistent write log cache https://review.opendev.org/c/openstack/openstack-ansible-ceph_client/+/882850 | 11:27 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: [doc] Update upgrade guide to mention SLURP https://review.opendev.org/c/openstack/openstack-ansible/+/883488 | 11:28 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: [doc] Add Ubuntu 20.04 as supported in AIO docs https://review.opendev.org/c/openstack/openstack-ansible/+/883489 | 11:30 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: [doc] Add Ubuntu 22.04 as supported in AIO docs https://review.opendev.org/c/openstack/openstack-ansible/+/883489 | 11:30 |
| noonedeadpunk | btw. wrt to https://review.opendev.org/c/openstack/openstack-ansible/+/881968 - should we add `tls` to stepca jobs? | 11:31 |
| noonedeadpunk | also, do we really need both metal and lxc stepca jobs? | 11:32 |
| noonedeadpunk | jrosser damiandabrowski ^ | 11:32 |
| jrosser | can't remember why i did both actually | 11:33 |
| noonedeadpunk | metal one is quite annoyingly (intermitently) failing | 11:33 |
| noonedeadpunk | ah, no, they both fail intermitently | 11:34 |
| noonedeadpunk | but I assume stepca makes most sence when we have TLS for internal endpoints? or it's fine only if we have public as it's testing haproxy let's encrypt path? | 11:34 |
| jrosser | it only deals with the public endpoint, nothing else | 11:35 |
| noonedeadpunk | aha, ok | 11:35 |
| jrosser | so really just the LE parts of haproxy | 11:36 |
| noonedeadpunk | then just maybe drop 1 scenario... like leave only metal as it's faster? | 11:36 |
| noonedeadpunk | as haproxy still runs only on metal | 11:36 |
| noonedeadpunk | eventually that could be just infra job rather then aio? | 11:36 |
| jrosser | i was just thinking about that | 11:37 |
| jrosser | if we were to add something that hit keystone API in healthcheck playbook thats probably good enough | 11:38 |
| jrosser | from public endpoint i mean | 11:38 |
| jrosser | even just using uri module and getting 401 rather than 503 is enough | 11:39 |
| noonedeadpunk | yeah, should be trivial thing to do/add | 11:39 |
| noonedeadpunk | like this https://opendev.org/openstack/openstack-ansible-os_keystone/src/branch/master/tasks/main.yml#L209-L226 | 11:40 |
| noonedeadpunk | eventually... | 11:41 |
| jrosser | yeah | 11:41 |
| noonedeadpunk | why we do internal/admin uri there? | 11:41 |
| noonedeadpunk | wouldn't it make more sense to check public/internal... | 11:41 |
| jrosser | if public is accessible | 11:42 |
| jrosser | which it doesnt have to be | 11:42 |
| noonedeadpunk | ah, yeah, true | 11:42 |
| noonedeadpunk | makes sense | 11:42 |
| jrosser | hrrm another stepca job failed but it seems totally unrelated | 11:51 |
| jrosser | https://e4f24ff392476089898b-1b8cb229048be7e5cad61c89881df784.ssl.cf1.rackcdn.com/881824/9/check/openstack-ansible-deploy-aio_metal_stepca-ubuntu-jammy/4e42aa7/logs/openstack/aio1-utility/stestr_results.html | 11:51 |
| opendevreview | Merged openstack/openstack-ansible-ceph_client master: Allow ceph client keyring files to have custom owner/group/mode https://review.opendev.org/c/openstack/openstack-ansible-ceph_client/+/882827 | 12:30 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Run healthcheck-openstack from utility host https://review.opendev.org/c/openstack/openstack-ansible/+/883496 | 12:30 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Reduce stepca scenario to minimum setup https://review.opendev.org/c/openstack/openstack-ansible/+/883497 | 12:34 |
| opendevreview | Merged openstack/openstack-ansible-openstack_hosts master: Revert pinning rdo-deps for openvswitch 2.17 for rocky https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/883294 | 12:39 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible stable/xena: Bump OpenStack-Ansible for Xena EM https://review.opendev.org/c/openstack/openstack-ansible/+/883500 | 12:45 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Reduce stepca scenario to minimum setup https://review.opendev.org/c/openstack/openstack-ansible/+/883497 | 12:52 |
| noonedeadpunk | damn, jammy upgrade fails on networking for some another reason then hostname I guess... | 13:03 |
| noonedeadpunk | https://zuul.opendev.org/t/openstack/build/8e8c6eba00954587b339bcb77ed5495f/log/logs/host/neutron-server.service.journal-11-26-43.log.txt?severity=0#10551 | 13:05 |
| noonedeadpunk | `Refusing to bind port 10e6b042-f91b-454b-a650-1131f9653ff7 to dead agent` | 13:10 |
| noonedeadpunk | trying to reproduce.... | 13:11 |
| spatel | is Zed ready to upgrade on production? Last week I have upgraded my stack to Yoga and thinking go to zed now | 13:11 |
| noonedeadpunk | I'd say should be for quite a while | 13:11 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/ansible-role-python_venv_build master: Fix venv_build_targets when used with multi-arch https://review.opendev.org/c/openstack/ansible-role-python_venv_build/+/881848 | 14:19 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_zun master: Install kata containers from source https://review.opendev.org/c/openstack/openstack-ansible-os_zun/+/880288 | 14:24 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Reduce stepca scenario to minimum setup https://review.opendev.org/c/openstack/openstack-ansible/+/883497 | 14:27 |
| opendevreview | Merged openstack/openstack-ansible-os_magnum master: Add TLS support to magnum backends https://review.opendev.org/c/openstack/openstack-ansible-os_magnum/+/879918 | 14:35 |
| noonedeadpunk | damn, also distro install is broken now... | 14:36 |
| noonedeadpunk | ok, that's related to recent OSSA | 14:40 |
| noonedeadpunk | seems we had to make patches for this one... https://docs.openstack.org/nova/latest/admin/configuration/service-user-token.html | 14:43 |
| jrosser | did we miss that | 14:44 |
| noonedeadpunk | yup | 14:44 |
| jrosser | i guess we did not do a master sha bump for some time to notice this | 14:46 |
| noonedeadpunk | I thought that `service_token_roles_required` was covering that | 14:48 |
| noonedeadpunk | To be frank I'm not sure what the difference is between them | 14:48 |
| noonedeadpunk | yup, exactly | 14:49 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_nova master: Define service_user for nova services https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/883520 | 14:53 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_nova master: Define service_user for nova services https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/883520 | 14:57 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_nova master: Define service_user for nova services https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/883520 | 15:00 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_nova master: Use auth_section for service auth https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/883522 | 15:03 |
| jrosser | one think i never made work was application credentials limitied to a particular service | 15:04 |
| jrosser | i think that was related maybe to matching the configured service type against what was in the token | 15:04 |
| noonedeadpunk | aha, yeah, that would be sweet to get working... Another thing I'd love to have though, is that catalog would be fetched only for the endpoint you're reaqching it | 15:09 |
| noonedeadpunk | So if you're checking catalog through public - you don't get internal endpoints in output for example | 15:10 |
| noonedeadpunk | As at some point I was thinking about "reselling" perspectives. Like add set of public2 endpoints, provide domain admin privileges to someone, and then they could provide cloud as their own, while it will be shared with other orgs | 15:16 |
| jrosser | it is a bit odd that internal data is leaked through the service catalog like that | 15:21 |
| noonedeadpunk | btw, that's bigger re-work we talked about yestarday for renaming container_address to management_address https://review.opendev.org/c/openstack/openstack-ansible/+/883148 | 15:21 |
| noonedeadpunk | oh yes, it is just wrong IMO | 15:22 |
| noonedeadpunk | like I was quite sure that point of catalog (comparting to the endpoint list) is to limit provided data to what's required/allowed for specific user | 15:22 |
| noonedeadpunk | as endpoint list is for some reason is admin-only | 15:23 |
| noonedeadpunk | maybe it's a bug ofc.... | 15:23 |
| opendevreview | Merged openstack/openstack-ansible master: [doc] Add Ubuntu 22.04 as supported in AIO docs https://review.opendev.org/c/openstack/openstack-ansible/+/883489 | 15:24 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible stable/zed: [doc] Add Ubuntu 22.04 as supported in AIO docs https://review.opendev.org/c/openstack/openstack-ansible/+/883540 | 15:24 |
| *** lowercas_ is now known as lowercase | 15:34 | |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_tempest stable/wallaby: Fix tmepest plugin versions https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/883528 | 15:38 |
| noonedeadpunk | and yeah, seems distro jobs are brocken back to W or smth | 16:12 |
| noonedeadpunk | so seems we'd need to backport service roles back... | 16:12 |
| jrosser | this is all on service token? | 16:12 |
| noonedeadpunk | at least this is, yes https://zuul.opendev.org/t/openstack/build/3f93a3e30a7d4865a6a5672ee32703fb | 16:13 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible stable/xena: Bump OpenStack-Ansible for Xena EM https://review.opendev.org/c/openstack/openstack-ansible/+/883500 | 16:14 |
| jrosser | right, so whenever we do that ^ on a stable branch the source installs will break too | 16:15 |
| noonedeadpunk | yup | 16:15 |
| jrosser | doh | 16:15 |
| noonedeadpunk | Except with case of Xena, EM was before backport... But yeah | 16:15 |
| noonedeadpunk | Timing is super nasty as well | 16:16 |
| noonedeadpunk | btw I've seen that ovs collection was fixed regards installation from git | 16:20 |
| noonedeadpunk | but quite scared to change collection versions now... | 16:21 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Bump upstream SHAs for Antelope https://review.opendev.org/c/openstack/openstack-ansible/+/883550 | 16:24 |
| jrosser | sorry i'm not being much use atm to fix all this | 16:27 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/ansible-role-python_venv_build master: Fix venv_build_targets when used with multi-arch https://review.opendev.org/c/openstack/ansible-role-python_venv_build/+/881848 | 16:33 |
| noonedeadpunk | I think main focus still should be on merging stuff to master and branching roles | 16:33 |
| noonedeadpunk | And yeah, fixing that ossa stuff on master | 16:33 |
| noonedeadpunk | And then after release do backporting. otherwise we'll drown in reviews... | 16:34 |
| noonedeadpunk | But no worries, I'll take care of that | 16:34 |
| noonedeadpunk | The only thing I have worries about is failing jammy job from zed wrt OVN... | 16:35 |
| noonedeadpunk | And I kinda fed up with plenty of intermittent things we're having lately | 16:41 |
| noonedeadpunk | though, zun job on centos is passing at least :D | 16:43 |
| noonedeadpunk | but not ubuntu one :( | 16:46 |
| noonedeadpunk | oh, no, ubuntu did as well | 16:47 |
| noonedeadpunk | ٩(^ᴗ^)۶ | 16:47 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Bump down etcd version for zun https://review.opendev.org/c/openstack/openstack-ansible/+/883194 | 16:52 |
| noonedeadpunk | this passes now :) https://review.opendev.org/c/openstack/openstack-ansible-os_zun/+/880288 | 16:52 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_zun master: Install kata containers from source https://review.opendev.org/c/openstack/openstack-ansible-os_zun/+/880288 | 16:53 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_zun master: Ensure service is restarted on unit file changes https://review.opendev.org/c/openstack/openstack-ansible-os_zun/+/880043 | 16:54 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_zun master: Add TLS support to zun backends https://review.opendev.org/c/openstack/openstack-ansible-os_zun/+/881140 | 16:54 |
| opendevreview | Merged openstack/openstack-ansible stable/zed: [doc] Add Ubuntu 22.04 as supported in AIO docs https://review.opendev.org/c/openstack/openstack-ansible/+/883540 | 16:58 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_zun master: Add my_ip to the zun config https://review.opendev.org/c/openstack/openstack-ansible-os_zun/+/883554 | 17:12 |
| noonedeadpunk | But upstream zun service is in suuuuper crappy state at the moment, to have that said | 17:15 |
| noonedeadpunk | It's so hard and tricky to find with which versions of what it's ready to cooperate... But partially it's on docker side to be frank (like etcd/zookeeper kv storage) | 17:15 |
| noonedeadpunk | but overall impression is weird... | 17:16 |
| noonedeadpunk | SHA bump is very-very-very red https://review.opendev.org/c/openstack/openstack-ansible/+/883550 | 18:01 |
| noonedeadpunk | * https://zuul.openstack.org/status/change/883550,1 | 18:01 |
| jrosser | oh yes thats not going well is it | 18:04 |
| noonedeadpunk | I'm even not sure at this point what exactly is broken though | 18:06 |
| jrosser | `tempest.exceptions.BuildErrorException: Server 9fa517a4-6939-476c-a2e5-1875047dd7f8 failed to build and is in ERROR status | 18:08 |
| jrosser | Details: Fault: {'code': 500, 'created': '2023-05-18T17:52:13Z', 'message': 'NoSuchOptError'}. Server boot request ID: req-676c1068-e25a-4e75-8203-1ec4c5a0a175. | 18:08 |
| jrosser | ` | 18:08 |
| jrosser | what even is that | 18:08 |
| noonedeadpunk | But yeah, likely it's that https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/883520 the root cause | 18:08 |
| noonedeadpunk | will check on that tomorrow.... | 18:09 |
| jrosser | oh well is it chicken / egg somehow | 18:10 |
| noonedeadpunk | I guess unlickely, as then bump will pass - it's depending already on this nova one | 18:10 |
| opendevreview | Merged openstack/ansible-config_template master: Fix usage of {% raw %} tags and Jinja2 headers https://review.opendev.org/c/openstack/ansible-config_template/+/881887 | 18:10 |
| noonedeadpunk | so it's just I did smth wrong I guess | 18:11 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/ansible-config_template master: Bump collection version in metafile https://review.opendev.org/c/openstack/ansible-config_template/+/881929 | 18:11 |
| noonedeadpunk | btw I've also reproduced upgrade jammy issue | 18:16 |
| noonedeadpunk | anbd it's basically what's wrong https://paste.openstack.org/show/bFfiAn0Y6xrf5HASIfM3/ | 18:17 |
| noonedeadpunk | though services look fine... | 18:17 |
| jrosser | where are all the service logs https://zuul.opendev.org/t/openstack/build/8a4a834988494d1eba7b807fa7c89026/logs | 18:18 |
| jrosser | oh of course that job has failed in setup hosts | 18:22 |
| opendevreview | Merged openstack/openstack-ansible-os_nova master: Ensure ipxe-qemu is always installed https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/882244 | 18:32 |
| opendevreview | Merged openstack/openstack-ansible-os_ceilometer master: Fix logic of defining polling_namespaces https://review.opendev.org/c/openstack/openstack-ansible-os_ceilometer/+/882466 | 19:22 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_ceilometer stable/zed: Fix logic of defining polling_namespaces https://review.opendev.org/c/openstack/openstack-ansible-os_ceilometer/+/883548 | 19:46 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_ceilometer stable/yoga: Fix logic of defining polling_namespaces https://review.opendev.org/c/openstack/openstack-ansible-os_ceilometer/+/883549 | 19:46 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_ceilometer stable/xena: Fix logic of defining polling_namespaces https://review.opendev.org/c/openstack/openstack-ansible-os_ceilometer/+/883570 | 19:46 |
| opendevreview | Merged openstack/openstack-ansible-os_nova master: Add way to periodically trim Nova DB https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/880971 | 21:33 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!