Monday, 2024-07-22

spatelFolks, I am trying to upgrade my one of wallaby cloud to Xena-em and encounter this error - https://paste.opendev.org/show/bXyVvR5aARkEz4ypH7pr/02:14
spatelfound this, will try and see - https://bugs.launchpad.net/openstack-ansible/+bug/197160602:19
spatelLook like this is something else.. 02:25
spatelAfter this bug report solution it move little bit and got this error now - https://bugs.launchpad.net/openstack-ansible/+bug/197160602:32
noonedeadpunkI've replied to the bug06:44
jrossero/ good morning07:20
jrossernoonedeadpunk: https://review.opendev.org/c/openstack/openstack-ansible/+/923596 looks good - did you have an example of where that is helpful? we have an l3 deployment.......07:22
jrosserandrewbonney: did you see this? https://review.opendev.org/c/openstack/openstack-ansible-os_keystone/+/92447407:33
andrewbonneyI'd seen the issue, hadn't looked a the fix yet07:34
jrosseri think that affects some of our internal code too07:37
andrewbonneyYeah, I've added a note to review07:37
noonedeadpunkjrosser: what I did is smth like that: https://paste.openstack.org/show/bycWEM0cveqUWWxRv4DQ/07:40
noonedeadpunkthe only thing I miss is kinda jinja parsing of file, to be able to use variables to replace variables, but I kinda get why it's not possible 07:41
jrosserah right, were previously you could only do things like network nodes07:41
noonedeadpunkas otherwise I'd need to make a separate env.d for cinder/nova/etc...07:42
noonedeadpunk(I guess)07:42
noonedeadpunkbut also for net nodes it makes kind of limited sense07:43
noonedeadpunkas you can define neutron_provider_networks in group_vars at all07:43
jrosserok looks like ours is slightly different as we have kind of a centralised control plane (it's not distributed L3, it's in its own 'pod')07:49
jrosserbut we do need something very much like what you show for br-mgmt, and we have something like https://paste.opendev.org/show/bspusBHP5zbne2fw9sv9/07:51
noonedeadpunkand does it work today?07:52
jrosserseems to07:52
noonedeadpunkhm.. then maybe this patch is not needed....07:52
jrosserwell, "all_containers" is very blunt though, and you want to be specific07:53
noonedeadpunkor well, it should filter out all_containers07:53
jrosseras br-mgmt is really everywhere, always07:53
noonedeadpunkyeah07:53
noonedeadpunkbut maybe I can instead to do instead of az1_all az1_hosts...07:54
noonedeadpunkbut iirc, it would leave cinder_volume without storage network as of today07:54
noonedeadpunkbut then maybe it would be fine to bind to storage_hosts instead of cinder_volume...07:54
noonedeadpunkbut then I do have more containers on storage_hosts then cinder :D07:55
jrossertbh i think we have not tried something quite like yours, as actually there are no lxc involved in compute hosts07:55
noonedeadpunkyeah, anyway, I'd say that including containers to filtering list makes some sense at least...07:55
opendevreviewMerged openstack/openstack-ansible master: reno: Update master for unmaintained/zed  https://review.opendev.org/c/openstack/openstack-ansible/+/92414011:16
opendevreviewJonathan Rosser proposed openstack/openstack-ansible stable/2024.1: Use UCA mirror in CI for ubuntu  https://review.opendev.org/c/openstack/openstack-ansible/+/92460211:20
opendevreviewJonathan Rosser proposed openstack/openstack-ansible stable/2023.2: Use UCA mirror in CI for ubuntu  https://review.opendev.org/c/openstack/openstack-ansible/+/92460311:21
opendevreviewJonathan Rosser proposed openstack/openstack-ansible stable/2023.1: Use UCA mirror in CI for ubuntu  https://review.opendev.org/c/openstack/openstack-ansible/+/92460411:21
jrosserhmmm gerrit ui seems suuuuuper slow to make cherry picks11:21
noonedeadpunkit seems just very slow now overall11:26
noonedeadpunktakes half a minute to save a comment11:26
noonedeadpunkbut yes, cherry-picking itself got really bad for quite some time now11:26
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-plugins master: Add hosts setup playbooks to openstack-ansible-plugins collection  https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/92425711:31
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_keystone master: Combine Ubuntu/Debian vars together  https://review.opendev.org/c/openstack/openstack-ansible-os_keystone/+/92414611:32
jrossermnaser: would you have time to look at https://github.com/vexxhost/ansible-collection-kubernetes/pull/127 ? we need something like this in OSA to support mcapi on debian-12/ ubuntu noble11:51
opendevreviewJonathan Rosser proposed openstack/openstack-ansible master: Test on Ubuntu Noble  https://review.opendev.org/c/openstack/openstack-ansible/+/92434212:04
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_adjutant master: Ensure that first/last host detection is deterministic  https://review.opendev.org/c/openstack/openstack-ansible-os_adjutant/+/92460812:22
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_aodh master: Ensure that first/last host detection is deterministic  https://review.opendev.org/c/openstack/openstack-ansible-os_aodh/+/92460912:26
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_barbican master: Ensure that first/last host detection is deterministic  https://review.opendev.org/c/openstack/openstack-ansible-os_barbican/+/92461012:27
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_blazar master: Ensure that first/last host detection is deterministic  https://review.opendev.org/c/openstack/openstack-ansible-os_blazar/+/92461112:32
jrossernoonedeadpunk: can you do me a sanity check - if you clone osa from opendev.org is master what you expect it to be?12:33
noonedeadpunkwait, what?12:36
noonedeadpunkyou mean sha?12:37
noonedeadpunkhttps://paste.openstack.org/show/bvJ3ms4M4rcQ4JTHBRhR/12:38
opendevreviewMerged openstack/openstack-ansible-os_keystone master: Ensure that first/last host detection is deterministic  https://review.opendev.org/c/openstack/openstack-ansible-os_keystone/+/92447412:39
jrossernoonedeadpunk i see this https://paste.opendev.org/show/bW0YDYFVBZc6eOpJmeY8/ 12:44
* jrosser uses github clone for now12:52
noonedeadpunkI don't think I have that in tree12:52
noonedeadpunkah, I do12:53
noonedeadpunkbut it's quite down the line12:53
noonedeadpunklike one pagedown below12:54
jrossersee #opendev btw12:54
noonedeadpunkah12:55
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_ceilometer master: Ensure that first/last host detection is deterministic  https://review.opendev.org/c/openstack/openstack-ansible-os_ceilometer/+/92461613:07
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_cinder master: Ensure that first/last host detection is deterministic  https://review.opendev.org/c/openstack/openstack-ansible-os_cinder/+/92461713:11
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_cloudkitty master: Ensure that first/last host detection is deterministic  https://review.opendev.org/c/openstack/openstack-ansible-os_cloudkitty/+/92461813:16
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_designate master: Ensure that first/last host detection is deterministic  https://review.opendev.org/c/openstack/openstack-ansible-os_designate/+/92462113:18
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_glance master: Ensure that first/last host detection is deterministic  https://review.opendev.org/c/openstack/openstack-ansible-os_glance/+/92462213:22
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_gnocchi master: Ensure that first/last host detection is deterministic  https://review.opendev.org/c/openstack/openstack-ansible-os_gnocchi/+/92462413:27
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_heat master: Ensure that first/last host detection is deterministic  https://review.opendev.org/c/openstack/openstack-ansible-os_heat/+/92462513:31
jrosserok so noble lxc issues are down to the `lxc-openstack` profile that we drop and use by default13:33
jrossersticking to what the upstream noble lxc image uses `lxc.apparmor.profile = generated` then the containers can start just fine13:34
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_ironic master: Ensure that first/last host detection is deterministic  https://review.opendev.org/c/openstack/openstack-ansible-os_ironic/+/92462613:37
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_magnum master: Ensure that first/last host detection is deterministic  https://review.opendev.org/c/openstack/openstack-ansible-os_magnum/+/92462713:38
noonedeadpunkI bet  Isaw patch for that?13:40
noonedeadpunkor depends-on doesn't work?13:40
jrosserso there is two things13:40
jrosserthis is how it is setup out-of-the-box https://paste.opendev.org/show/bRJN51j0g8E6IpnkDn7D/13:41
jrosserand i have a patch to duplicate that in /etc/lxc/lxc-openstack.conf https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/924340/213:42
jrosserbut then we come along and do this later https://github.com/openstack/openstack-ansible/blob/master/inventory/group_vars/all_containers.yml#L1913:43
noonedeadpunkI guess the question here if we do need anything from our own template13:43
jrosserand this is pretty gross, because for some time the apparmor stuff never worked on debian13:43
jrosserso we just make it "unconfined"13:44
jrosseryes so thats totally the question, if anything here is actually needed https://github.com/openstack/openstack-ansible-lxc_hosts/blob/master/templates/lxc-openstack.apparmor.j213:44
noonedeadpunkeventually, even if we do, we can likely place override/extend the default profile rather then just use our own13:45
jrosserso the changes in that file are really quite ancient, for things like allowing nfs mount inside the container13:46
noonedeadpunkwell, that might be still needed for cinder-volumes13:47
jrosseri just remade my AIO from scratch13:47
jrosserso tht i can test if this is the root cause https://github.com/lxc/lxc/commit/32f88c8fecaa1f909d0aeb5ff3132932138fe69213:48
noonedeadpunkfrankly - I'm really thinking of what it would take to get nova-compute and ovn-controller to work inside lxc as well....13:49
noonedeadpunkthough might be it's quite useless idea, at least regarding ovn13:50
noonedeadpunkso maybe having a way to extend lxc apparmor profile is reasonable at least13:51
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_masakari master: Ensure that first/last host detection is deterministic  https://review.opendev.org/c/openstack/openstack-ansible-os_masakari/+/92462913:53
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_mistral master: Ensure that first/last host detection is deterministic  https://review.opendev.org/c/openstack/openstack-ansible-os_mistral/+/92463213:59
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_manila master: Ensure that first/last host detection is deterministic  https://review.opendev.org/c/openstack/openstack-ansible-os_manila/+/92463314:05
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_neutron master: Ensure that first/last host detection is deterministic  https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/92463514:07
noonedeadpunkso we have plenty of intersects/unions, but in almost all cases we really don't care about order14:08
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_nova master: Ensure that first/last host detection is deterministic  https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/92463614:10
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_octavia master: Ensure that first/last host detection is deterministic  https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/92463714:11
noonedeadpunkthough will need to check integrated repo one more time....14:12
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_placement master: Ensure that first/last host detection is deterministic  https://review.opendev.org/c/openstack/openstack-ansible-os_placement/+/92463814:16
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_swift master: Ensure that first/last host detection is deterministic  https://review.opendev.org/c/openstack/openstack-ansible-os_swift/+/92463914:18
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_tacker master: Ensure that first/last host detection is deterministic  https://review.opendev.org/c/openstack/openstack-ansible-os_tacker/+/92464014:19
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_tempest master: Ensure tempest enclude/exclude lists are idempotent  https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/92464114:23
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_trove master: Ensure that first/last host detection is deterministic  https://review.opendev.org/c/openstack/openstack-ansible-os_trove/+/92464214:25
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_zun master: Ensure that first/last host detection is deterministic  https://review.opendev.org/c/openstack/openstack-ansible-os_zun/+/92464314:34
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_barbican master: Move database configuration to it's own section  https://review.opendev.org/c/openstack/openstack-ansible-os_barbican/+/92464915:03
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_barbican master: Ensure that first/last host detection is deterministic  https://review.opendev.org/c/openstack/openstack-ansible-os_barbican/+/92461015:03
opendevreviewJonathan Rosser proposed openstack/openstack-ansible-os_tempest master: Ensure tempest enclude/exclude lists are idempotent  https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/92464115:54
jrosserlooks like tacker is a db migrate mess15:55
opendevreviewMerged openstack/ansible-hardening master: Rename internal parameter user_list to hardening_user_list  https://review.opendev.org/c/openstack/ansible-hardening/+/92182716:29
jrosseroh my /o\ https://wiki.debian.org/LXC/SystemdMountsAndAppArmor16:31
opendevreviewJonathan Rosser proposed openstack/openstack-ansible master: Use the 'generated' apparmor profile for all containers  https://review.opendev.org/c/openstack/openstack-ansible/+/92466116:51
opendevreviewJonathan Rosser proposed openstack/openstack-ansible master: DNM - test ubuntu noble with generated apparmor profile  https://review.opendev.org/c/openstack/openstack-ansible/+/92466316:55
opendevreviewJimmy McCrory proposed openstack/openstack-ansible-os_neutron master: Correct 'neutron-policy-override' tag  https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/92468121:32

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!