Friday, 2023-10-20

noonedeadpunkWould be awesome if someone could take a look at https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/89874906:48
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible stable/2023.1: Define install_method default when hosts resolution depend on it  https://review.opendev.org/c/openstack/openstack-ansible/+/89807207:43
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_designate master: Fix example playbook linters  https://review.opendev.org/c/openstack/openstack-ansible-os_designate/+/89890608:47
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_cloudkitty master: Fix example playbook linters  https://review.opendev.org/c/openstack/openstack-ansible-os_cloudkitty/+/89890708:49
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_cloudkitty master: Add quorum queues support for service  https://review.opendev.org/c/openstack/openstack-ansible-os_cloudkitty/+/89881608:49
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_heat master: Add quorum queues support for service  https://review.opendev.org/c/openstack/openstack-ansible-os_heat/+/89890808:59
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_ironic master: Add quorum queues support for service  https://review.opendev.org/c/openstack/openstack-ansible-os_ironic/+/89890909:04
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_magnum master: Add quorum queues support for service  https://review.opendev.org/c/openstack/openstack-ansible-os_magnum/+/89891109:11
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_masakari master: Add quorum queues support for service  https://review.opendev.org/c/openstack/openstack-ansible-os_masakari/+/89891209:17
opendevreviewMerged openstack/openstack-ansible-os_nova master: Fix logic of discovering hosts by service  https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/89874909:17
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_nova stable/2023.1: Fix logic of discovering hosts by service  https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/89877909:19
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_nova stable/2023.1: Fix logic of discovering hosts by service  https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/89877909:20
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_nova stable/zed: Fix logic of discovering hosts by service  https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/89878009:20
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_mistral master: Add quorum queues support for service  https://review.opendev.org/c/openstack/openstack-ansible-os_mistral/+/89891309:26
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_manila master: Add quorum queues support for service  https://review.opendev.org/c/openstack/openstack-ansible-os_manila/+/89891409:31
anskiynoonedeadpunk: hey! so is this: https://review.opendev.org/c/openstack/openstack-ansible-os_ceilometer/+/888032 broken by some ansible-lint things or is it something in openstack.osa.service_setup role? 10:29
anskiyalso, what else should be done to finally push this thing: https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/858271? Maybe you (or jamesdenton) could lay out some questions for me in the Change so I could answer them?..10:30
noonedeadpunkanskiy: I think it's both10:30
noonedeadpunkanskiy: regarding AZ-s - what I currently "suspect" is that added variables are not reflecting possibility for AZ setup of OVS/LXB10:31
noonedeadpunkAs we do have AZs there, and they're having quite different logic then with OVS10:31
noonedeadpunk*OVN10:31
noonedeadpunkSo to implement these new vars we need to ensure they make sense outside of ovn as well10:33
noonedeadpunkOr make them more OVN specific in their names, and then add another set of vars for non-ovn, which also sucks10:33
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_ceilometer master: Enable Ceilometer resource cache  https://review.opendev.org/c/openstack/openstack-ansible-os_ceilometer/+/88803210:34
anskiyokay, got it, thank you :)10:34
noonedeadpunkAnd I really didn't find time yet to come up with smth that will cover both, despite having that in my backlog...10:35
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_murano master: Add quorum queues support for service  https://review.opendev.org/c/openstack/openstack-ansible-os_murano/+/89892210:42
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_octavia master: Drop Neutron oslomsg configuration  https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/89892310:48
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_octavia master: Drop Neutron oslomsg configuration  https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/89892310:48
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_octavia master: Add quorum queues support for service  https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/89892410:53
opendevreviewMerged openstack/openstack-ansible-os_nova stable/2023.1: Run nova_db_post_setup from playbook directly  https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/89849510:59
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_senlin master: Add quorum queues support for service  https://review.opendev.org/c/openstack/openstack-ansible-os_senlin/+/89892611:05
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_sahara master: Add quorum queues support for service  https://review.opendev.org/c/openstack/openstack-ansible-os_sahara/+/89892911:45
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_cloudkitty master: Add quorum queues support for service  https://review.opendev.org/c/openstack/openstack-ansible-os_cloudkitty/+/89881611:53
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_aodh master: Add quorum support for service  https://review.opendev.org/c/openstack/openstack-ansible-os_aodh/+/89569011:54
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_heat master: Add quorum queues support for service  https://review.opendev.org/c/openstack/openstack-ansible-os_heat/+/89890811:56
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_tacker master: Add quorum queues support for service  https://review.opendev.org/c/openstack/openstack-ansible-os_tacker/+/89893011:57
andrewbonneyjonher: I heard via jrosser that you had found OIDC issues in newer apache mod_auth_oidc12:00
andrewbonneyIn case you haven't found it yet, it's caused by commit ac5686495a51bc93e257e42bfdc9c9c46252feb112:00
andrewbonneyI'm just looking into whether the issue can be resolved via config tweaks12:00
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_trove master: Add quorum queues support for service  https://review.opendev.org/c/openstack/openstack-ansible-os_trove/+/89893112:00
jonhercorrect! i had that tab open to try and compile the module pre and post that commit but then it sounds like i don't have to :)12:01
jonherinitial diagnosis was it works on focal but not on jammy. apache mod_auth_oidc v2.4.8.4 works, v2.4.9 and newer does not. One of the last lines in the log was the debug log of it comparing the OS-FEDERATION url paarm and then it didn't seem to do much after that as if the request was more or less just dropped12:03
andrewbonneyYes, that commit adds an explicit return where originally I believe it passed on to the ProxyPass set up for keystone12:04
jonheryes, even though the Keystone API docs does not even mention POST being a valid request at all on that endpoint (which also confused me during the initial troubleshooting). https://docs.openstack.org/api-ref/identity/v3-ext/#apis12:06
jonherthanks for checking on it as well and updating me on the status here, saves me one step of troubleshooting12:06
opendevreviewMerged openstack/openstack-ansible master: Stop ignoring hostnames without underscores  https://review.opendev.org/c/openstack/openstack-ansible/+/89800212:08
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_zun master: Add quorum queues support for service  https://review.opendev.org/c/openstack/openstack-ansible-os_zun/+/89893412:17
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_ironic master: Add quorum queues support for service  https://review.opendev.org/c/openstack/openstack-ansible-os_ironic/+/89890912:19
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_masakari master: Fix example playbook linters  https://review.opendev.org/c/openstack/openstack-ansible-os_masakari/+/89893612:31
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_masakari master: Add quorum queues support for service  https://review.opendev.org/c/openstack/openstack-ansible-os_masakari/+/89891212:31
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_masakari master: Add quorum queues support for service  https://review.opendev.org/c/openstack/openstack-ansible-os_masakari/+/89891212:32
opendevreviewStuart Grace proposed openstack/openstack-ansible-os_nova master: Use internal endpoint for barbican API  https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/89893712:33
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_sahara master: Add quorum queues support for service  https://review.opendev.org/c/openstack/openstack-ansible-os_sahara/+/89892912:33
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_senlin master: Add quorum queues support for service  https://review.opendev.org/c/openstack/openstack-ansible-os_senlin/+/89892612:34
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_octavia master: Add quorum queues support for service  https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/89892412:34
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_manila master: Add quorum queues support for service  https://review.opendev.org/c/openstack/openstack-ansible-os_manila/+/89891412:35
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_murano master: Add quorum queues support for service  https://review.opendev.org/c/openstack/openstack-ansible-os_murano/+/89892212:35
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_mistral master: Add quorum queues support for service  https://review.opendev.org/c/openstack/openstack-ansible-os_mistral/+/89891312:35
opendevreviewAndrew Bonney proposed openstack/openstack-ansible-os_keystone master: oidc: fix overloading of redirect_uri for cli client  https://review.opendev.org/c/openstack/openstack-ansible-os_keystone/+/89896213:05
andrewbonneyjonher: could you see if https://review.opendev.org/c/openstack/openstack-ansible-os_keystone/+/898962 fixes it for you?13:05
jonherandrewbonney: that works for me on Yoga AIO running 22.04 with libapache2-mod-auth-openidc 2.4.11-113:34
andrewbonneyGreat, thanks for confirming13:35
noonedeadpunklet's try to merge that fast then13:46
opendevreviewMerged openstack/openstack-ansible-os_nova stable/2023.1: Fix logic of discovering hosts by service  https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/89877913:54
noonedeadpunkandrewbonney: do you think we should keep compatability with previous iodc version? or it's supposed to work in both cases?13:57
noonedeadpunkas I guess I'm mainly thinking about how to backport that13:58
opendevreviewMerged openstack/openstack-ansible-os_cloudkitty master: Fix example playbook linters  https://review.opendev.org/c/openstack/openstack-ansible-os_cloudkitty/+/89890713:58
andrewbonneyI believe it would work with both, but I haven't tested that explicitly. I think it was working more as a happy accident up to now13:58
noonedeadpunkaha, I see13:58
andrewbonneyI'll roll back the module in my test environment to make sure13:59
andrewbonneyYes, it works with the focal version too14:03
noonedeadpunkawesome14:03
opendevreviewMerged openstack/openstack-ansible-openstack_hosts stable/2023.1: Add ability to define a config for journald  https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/89876914:19
admin1i get this "fatal: [c1_repo_container-83f07d5e -> localhost]: FAILED! => {"changed": false, "dest": "/etc/openstack_deploy/upper-constraints/upper_constraints_2710414b4663b85b48ecbbba21f4f0ea42dc3df1.txt", "elapsed": 10, "gid": 0, "group": "root", "mode": "0644", "msg": "Request failed: <urlopen error [Errno -3] Temporary failure in name15:05
admin1resolution>", "owner": "root", "size": 12136, "state": "file", "uid": 0, "url": "https://releases.openstack.org/constraints/upper/2710414b4663b85b48ecbbba21f4f0ea42dc3df1"} " but there is nothing wrong with resolving/dns in the container ? 15:05
noonedeadpunkI'm not sure what exactly you're doing, but that task was delegated to the `localhost`15:16
noonedeadpunkso it's localhost which failed to fetch the url15:16
admin1oh .. the deploy host 15:17
admin1thanks for the pointer .. i will  check further .. 15:17
admin1i am getting this error on glance .. https://gist.githubusercontent.com/a1git/df375d2607f9057f4c057aa226c0771f/raw/32d75f740e6f6f90fea85d40d702fda391c46a74/gistfile1.txt       doing an upgrade from 26.2.0 -> 27.1.0 ..  i don't see any issues on the nfs mount 16:01
admin1'mount_var' is undefined  -- maybe there is a new syntax in 27.1.0 .. 16:03
admin1grep -ri mount_var /opt/openstack-ansible/etc/openstack_deploy/*  returns null, so not able to see examples on it 16:04
noonedeadpunkadmin1: is it using nfs?16:07
noonedeadpunkas it;s basically about format of `glance_mount_points`16:07
admin1yeah .. using nfs for this one16:08
noonedeadpunkwhich indeed did changed syntax a bit16:08
noonedeadpunkadmin1: I think it's this bug you;re hitting https://bugs.launchpad.net/openstack-ansible/+bug/203277116:10
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_glance master: Use correct default for glance_mount_points  https://review.opendev.org/c/openstack/openstack-ansible-os_glance/+/89248916:10
noonedeadpunkand that's the fix ^16:10
noonedeadpunkbut I would suggest updating glance_mount_points if possible16:12
admin1thanks .. changed and re-running16:13
admin1i removed all lxc except galera, so it think i hit this now and not before 16:14
opendevreviewMerged openstack/openstack-ansible-os_keystone master: oidc: fix overloading of redirect_uri for cli client  https://review.opendev.org/c/openstack/openstack-ansible-os_keystone/+/89896217:44
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_keystone stable/2023.1: oidc: fix overloading of redirect_uri for cli client  https://review.opendev.org/c/openstack/openstack-ansible-os_keystone/+/89894718:14
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_keystone stable/2023.1: oidc: fix overloading of redirect_uri for cli client  https://review.opendev.org/c/openstack/openstack-ansible-os_keystone/+/89894718:15
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_keystone stable/zed: oidc: fix overloading of redirect_uri for cli client  https://review.opendev.org/c/openstack/openstack-ansible-os_keystone/+/89894818:15
opendevreviewMerged openstack/openstack-ansible-os_nova master: Use internal endpoint for barbican API  https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/89893721:33
jrosserlooks like we might need to bump zk role sha for 2023.121:41
opendevreviewMerged openstack/openstack-ansible-os_keystone stable/zed: oidc: fix overloading of redirect_uri for cli client  https://review.opendev.org/c/openstack/openstack-ansible-os_keystone/+/89894822:16
noonedeadpunkyup, right22:53
noonedeadpunkand we need to make a new release of 2023.1 finally22:53
noonedeadpunkthough that's one more bug backport to fix: https://review.opendev.org/c/openstack/openstack-ansible/+/89807222:55
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible stable/2023.1: Bump SHAs for 2023.1  https://review.opendev.org/c/openstack/openstack-ansible/+/89899323:08
noonedeadpunkand that's sha bump^23:08
noonedeadpunkdamn, missed https://review.opendev.org/c/openstack/openstack-ansible-os_keystone/+/898947 - it's merged on Zed and I thought it's 2023.123:09
noonedeadpunkbut other then that I don't see really outstanding things for https://review.opendev.org/q/parentproject:openstack/openstack-ansible+branch:%255Estable/2023.1+status:open+23:11

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!