| jrosser | WireLost: the way we install openstack from distro packages for ubuntu LTS releases is from UCA (ubuntu cloud archive) https://wiki.ubuntu.com/OpenStack/CloudArchive | 08:00 |
|---|---|---|
| noonedeadpunk | WireLost: are you sure that it's the "new path"? As local is an override folder which should be respected by apparmor and afiak that didn't change for 24.04 https://ubuntu.com/server/docs/apparmor#profile-customisation | 08:00 |
| noonedeadpunk | good morning :) | 08:00 |
| jrosser | morning o/ | 08:01 |
| jrosser | looks like there is actually some sort of UCA content now for noble http://ubuntu-cloud.archive.canonical.com/ubuntu/dists/noble-updates/dalmatian/main/binary-amd64/Packages | 08:01 |
| jrosser | but ummmm thats supposedly dalmation but with git sources from a couple weeks ago | 08:02 |
| jrosser | WireLost: also just another thing :) as you've managed to deploy onto noble, that means you're using the "master" branch, which is the unreleased version of openstack-ansible that we will finalise some time after the rest of openstack makes its 2024.2 release | 08:03 |
| jrosser | for developing the next release this is fine, but for a stable installation for production use it is best to use one of the stable/<release> branches | 08:04 |
| noonedeadpunk | well, that means we can try out distro isntall for noble on dalmatian Iassume | 08:06 |
| noonedeadpunk | jrosser: should this be still wip? https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/907752/9 | 08:08 |
| WireLost | Morning! Yes, I'm using OSA `master` branch. This is a lab, I'm learning about it! | 08:09 |
| WireLost | It did work, BTW! OSA `master`, Ubuntu 24.04, all set to `distro`, so far, so good! | 08:09 |
| noonedeadpunk | yeah, that's also about managing expectations, as since we iterate over some topics, we can land half-implemented stuff with goal to fix them with follow-ups on master | 08:10 |
| noonedeadpunk | like moving playbooks to collection | 08:10 |
| noonedeadpunk | so it might contain bugs we aware about, but not yet having time to work on them | 08:11 |
| WireLost | Perhaps I should had just `mkdir -p /etc/apparmor.d/local/abstractions ; touch /etc/apparmor.d/local/abstractions/libvirt-qemu` | 08:13 |
| noonedeadpunk | so the failure is that directory does not exist? | 08:14 |
| noonedeadpunk | as it could be really a bug in code that we've missed to create the folder... | 08:14 |
| WireLost | Well, in noble: `file /etc/apparmor.d/local/abstractions = cannot open `/etc/apparmor.d/local/abstractions' (No such file or directory)` | 08:16 |
| WireLost | This is a fresh install | 08:17 |
| noonedeadpunk | WireLost: so that;s where ansible fails? can you please paste full error with the task name if that's possible? | 08:26 |
| WireLost | noonedeadpunk, sure thing, it failed with this error: https://pastebin.com/9Z3yrtAR | 08:31 |
| gillesMo | Hello ! I've just upgrade to 2023.1 (from Wallaby, trough all releases), and my controllers are dying... I see rabbitmq /event.sample in /ceilometer increase. What I found is that panko was reading those messages, and as there is no more panko... How can I tell ceilometer not to post messages in /event.sample ? | 08:33 |
| noonedeadpunk | gillesMo: that's a great question - no idea, never used panko.... But also I'm not sure what puts notifications there to be frank | 08:37 |
| gillesMo | It seems it is ceilometer, but I don't know for sure | 08:38 |
| gillesMo | I also never used aodh/panko/ceilometer/heat... I think I really should not deploy them, but as it is by default, I feared that something use it somwhere... | 08:39 |
| noonedeadpunk | neither of them are actually default | 08:39 |
| noonedeadpunk | but heat is used by some services, at very least by magnum | 08:40 |
| noonedeadpunk | aodh/panko/ceilometer/gnocchi are kinda self-contained as telemetry services | 08:40 |
| noonedeadpunk | but I'd guess it should be potentially aodh pushing to events... | 08:41 |
| gillesMo | Don't use magnum for now (Rancher instead), perhaps magnum later but with cluster API backend | 08:42 |
| noonedeadpunk | that would make total sense | 08:42 |
| noonedeadpunk | but I really can find now what exactly spawns messages to the queue :( | 08:47 |
| noonedeadpunk | but I'd really gues s that's not ceilometer | 08:47 |
| noonedeadpunk | or dunno... | 08:48 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-ceph_client master: Ensure apparmor folder exists for ceph caching https://review.opendev.org/c/openstack/openstack-ansible-ceph_client/+/929606 | 08:58 |
| noonedeadpunk | WireLost: can you check if this helps? ^ | 08:58 |
| opendevreview | Jonathan Rosser proposed openstack/ansible-role-uwsgi master: Add libpython definition for ubuntu noble distro install https://review.opendev.org/c/openstack/ansible-role-uwsgi/+/929609 | 09:08 |
| jrosser | WireLost: ^ also another fix for you there | 09:08 |
| WireLost | You guys rock! =D | 09:12 |
| jrosser | have you seen how to easily download and test those patches? those will not merge for a while | 09:13 |
| WireLost | It's okay... And no, I haven't see how to test specific branches, but willing to learn! I'm being lazy and manually changing the files on disk before running it... lol | 09:16 |
| jrosser | if you click one of those links | 09:16 |
| jrosser | press the 3 dots top right of the gerrit window | 09:16 |
| jrosser | choose download patch / press the 'copy' button to the right of cherry-pick | 09:17 |
| jrosser | then you can navigate to the directory on your system for that repo, paste the command and run it | 09:17 |
| jrosser | that will cherry pick the commit for you | 09:17 |
| WireLost | Sounds simple, thank you! | 09:18 |
| jrosser | you would lose those changes if you did bootstrap-ansible again though | 09:18 |
| WireLost | Sure, thanks for the heads up! I do have a simple Bash which I can run on top of a fresh Ubuntu, and it'll perform all OSA AIO steps in sequence... Clone it, bootstrap it, set things under `/etc/openstack_deploy/`, set git branches under `/etc/ansible/roles/*` as needed (steps you just recommended), and run the playbooks. It's very neat, and I can call it via cloud-init too... | 09:30 |
| noonedeadpunk | WireLost: fwiw, there's a scripts/gate-check-commit.sh which does all aio steps, except clonning/checkout repo | 09:32 |
| noonedeadpunk | but it's tough to pull in patches with it... | 09:33 |
| WireLost | Cool! | 09:33 |
| noonedeadpunk | though it's the thing we use in CI to spawn environment | 09:33 |
| jrosser | one of the things you can do is prepare forks of repos on github or somewhere that include the patches you need, then set variables to use those instead of the normal ones | 09:33 |
| noonedeadpunk | so you can do `./scripts/gate-check-commit.sh aio_lxc_ceph deploy source` | 09:34 |
| WireLost | Nice, that's more or less what I'm doing... I can quickly launch Ubuntu and fire up OSA AIO in one shot | 09:34 |
| noonedeadpunk | ++ | 09:34 |
| jrosser | thats exactly how you would manage introducing fixes for a production deployment (also for openstack services themselves if you use a source install method) | 09:34 |
| WireLost | Yeah! :-D | 09:35 |
| WireLost | So, noonedeadpunk, I tested https://review.opendev.org/c/openstack/openstack-ansible-ceph_client/+/929606 - Still: `fatal: [aio1]: FAILED! => {"changed": false, "msg": "Path /etc/apparmor.d/local/abstractions/libvirt-qemu does not exist !", "rc": 257}` | 09:35 |
| noonedeadpunk | I assume you also saw https://docs.openstack.org/openstack-ansible/latest/reference/configuration/extending-osa.html on how you can use user-<>-requirements.yml for adding/overriding roles/collections | 09:36 |
| noonedeadpunk | huh | 09:36 |
| * noonedeadpunk spawning a fresh sandbox | 09:37 | |
| WireLost | Missed, that... My assumption was that the patch would essentially do: `mkdir -p /etc/apparmor.d/local/abstractions ; touch /etc/apparmor.d/local/abstractions/libvirt-qemu` =P | 09:39 |
| noonedeadpunk | yeah, that what I kinda saw in my old sandbox and noop playbook | 09:41 |
| noonedeadpunk | and would expect to happen | 09:41 |
| noonedeadpunk | so quite surprise it didn't do that | 09:44 |
| noonedeadpunk | WireLost: oh, wait... have you set `ceph_immutable_object_cache_enabled` as override? As I thought you probably did? | 09:45 |
| WireLost | No, I didn't =P | 09:45 |
| noonedeadpunk | oh, ok, that explains it | 09:45 |
| WireLost | Sorry about that, I'll try again. | 09:46 |
| noonedeadpunk | nah, it's issue with the patch | 09:46 |
| noonedeadpunk | it fixes different scenario | 09:46 |
| noonedeadpunk | I'd need to come up with smth smarter then | 09:46 |
| WireLost | No worries | 09:49 |
| noonedeadpunk | or dumber :D | 09:50 |
| WireLost | lol | 09:51 |
| WireLost | After setting `ceph_immutable_object_cache_enabled: true` in `user_variables.yml`, the playbook failed someplace else: | 09:51 |
| WireLost | TASK [ceph_client : Set permissions on immutable object cache directory] | 09:51 |
| WireLost | fatal: [aio1-glance-container-ef5c103d]: FAILED! => {"changed": false, "msg": "file (/ceph-immutable-object-cache) is absent, cannot continue", "path": "/ceph-immutable-object-cache", "state": "absent"} | 09:52 |
| noonedeadpunk | it could be that it needs some extra configuration though | 09:52 |
| WireLost | Ok | 09:52 |
| noonedeadpunk | I will come up with smth shortly, sorry | 09:52 |
| WireLost | It's okay! Thank you folks for this work! I'm mostly learning, no rush at all | 09:54 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-ceph_client master: Ensure apparmor folder exists for ceph caching https://review.opendev.org/c/openstack/openstack-ansible-ceph_client/+/929606 | 09:59 |
| noonedeadpunk | actually, can't come up with anything really smarter, so dumb version ^ | 09:59 |
| noonedeadpunk | or we really need to accept that changes to apparmor won't be reverted when ceph_immutable_object_cache_enabled is flipped from True to it's default - False | 10:00 |
| amarao | When a new version of Openstack Ansible collection will be released? I've send a PR 9 month ago (it is merged in master), and still waiting to release to see my fix available... | 10:19 |
| noonedeadpunk | amarao: you meant to https://opendev.org/openstack/ansible-collections-openstack ? | 10:21 |
| noonedeadpunk | as we're not maintainers of it and don't have any control over it | 10:22 |
| noonedeadpunk | worth asking in #openstack-ansible-sig | 10:23 |
| noonedeadpunk | which is a completely different thing (which is confusing) | 10:23 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-ceph_client master: Manage apt repositores and keys using deb822_repository module https://review.opendev.org/c/openstack/openstack-ansible-ceph_client/+/929622 | 11:12 |
| jrosser | noonedeadpunk: do you think we should improve this as a follow up? https://github.com/openstack/openstack-ansible-ceph_client/blob/33f8ad519f64d28f410e856aa129060e3a80f27c/meta/main.yml#L42-L47 | 11:52 |
| jrosser | that is probably also a place we can use `state` to control removing the pins, if we have a suitble condition | 11:53 |
| jrosser | this might be more complicated than the other roles though | 11:53 |
| noonedeadpunk | I'm doing way more messy follow up now | 11:53 |
| noonedeadpunk | the big problem though is that we don't test ceph for EL at all right now | 11:54 |
| jrosser | i think we have two places that the ceph pins are set as well | 11:54 |
| jrosser | no you're right we don't | 11:55 |
| noonedeadpunk | I just trying to align how el vs deb are behaving in terms of repo setup | 11:55 |
| noonedeadpunk | and unify vars | 11:55 |
| noonedeadpunk | and then yeah - pins and improvements to drop them | 11:55 |
| jrosser | this also is likley needing a `state` adding https://github.com/openstack/openstack-ansible-openstack_hosts/blob/525f1ab88abf2db7c5e2f211c2d195579be78670/defaults/main.yml#L195-L204 | 11:57 |
| noonedeadpunk | depends... | 11:58 |
| noonedeadpunk | as do we have uca as a source option | 11:58 |
| jrosser | right - and at the moment we make UCA lower priority than the ubuntu repo | 11:59 |
| noonedeadpunk | like distro should be jsut default repo, and community - download.ceph.com | 11:59 |
| noonedeadpunk | uca is a third thing we can enable though | 11:59 |
| noonedeadpunk | but just as an another feature kinda? | 11:59 |
| jrosser | yeah, it's all way too many options to test though | 11:59 |
| noonedeadpunk | so I'd leave uca as is I guess, unless we really need it for noble | 12:00 |
| jrosser | yup - i guess i can make a patch to enable uca in openstack-hosts for noble now the repo is there | 12:00 |
| noonedeadpunk | yeah, it's not in download.ceph.com for sure | 12:01 |
| jrosser | oh well i guess two different things | 12:02 |
| jrosser | there is now some openstack in uca for noble/dalmation | 12:02 |
| noonedeadpunk | oh, yes | 12:02 |
| jrosser | but it looks like there are not ceph packages there just now | 12:03 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-openstack_hosts master: Enable UCA repo for ubuntu noble https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/929631 | 12:05 |
| noonedeadpunk | but how WireLost did went the ceph path? or the same way? | 12:19 |
| noonedeadpunk | or ceph wasn't jsut deployed with aio? | 12:19 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Add Ceph test for Rocky Linux https://review.opendev.org/c/openstack/openstack-ansible/+/929636 | 12:30 |
| elinux | Is anyone online here now | 12:31 |
| opendevreview | Merged openstack/openstack-ansible-os_octavia master: Provide better flexability for SSH keypair options https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/927728 | 12:39 |
| WireLost | There isn't a UCA repo for 'noble' yet, maybe after 24.10 release. I'm using all packages straight from 24.04 without any extra apt repos with current OSA `master`, and I get Nova 29.0.1, and Ceph 19 Debian packages. | 12:46 |
| WireLost | Maybe that 929631 patch will simplify logic, consolidating Ubuntu stull into 'vars/ubuntu.yaml', magically enabling UCA for 'noble' when it becomes available? =P | 12:48 |
| jrosser | WireLost: http://ubuntu-cloud.archive.canonical.com/ubuntu/dists/noble-updates/dalmatian/main/binary-amd64/Packages ? | 12:51 |
| jrosser | this tells you that the “Dalmatian” release of openstack will be installable from UCA once it’s released | 12:53 |
| jrosser | but I would still suggest you use the source install method | 12:56 |
| noonedeadpunk | elinux: hey! what's up? | 12:58 |
| noonedeadpunk | WireLost: coverage of projects that support distro install method is not very wide - mostly it's limited to core services right now due to lack of maintainers for this to evolve | 12:59 |
| f0o | Hey is there any known issue with setting keystone_sp after the initial setup was done? Currently wondering if the missing `schema_version` column is an openstack-ansible (missing migrations) issue or a keystone bug... | 12:59 |
| f0o | https://github.com/openstack/keystone/blob/master/keystone/common/sql/migrations/versions/2024.01/expand/47147121_add_identity_federation_attribute_mapping_schema_version.py << well.. seems like this wasnt applied when I updated to stable/2024.1... | 13:03 |
| WireLost | jrosser, no worries! I want to test `distro` packages =P | 13:04 |
| WireLost | So, first UCA for 24.04 will be Dalmatian, got it... | 13:05 |
| WireLost | current OSA master deploys Caracal with Ceph 19 on 24.04 when all is set to distro. Which is kinda cool | 13:05 |
| jrosser | that’s why it’s not cool | 13:06 |
| WireLost | lol | 13:06 |
| jrosser | our master branch is supposed to be Dalmatian | 13:06 |
| WireLost | Oh, got it | 13:06 |
| WireLost | Ceph will remain at 19, it seems... Right? | 13:07 |
| noonedeadpunk | f0o: well there're 2 patches which were made faaaar after 2024.1 release | 13:09 |
| noonedeadpunk | it could be they\re not functional ofc.... | 13:09 |
| f0o | yeah I feel like I'm venturing into new grounds once again hah | 13:10 |
| f0o | should've just kept 2023.2 | 13:10 |
| jrosser | WireLost: ceph will remain as it is currently defined, as we test it | 13:11 |
| noonedeadpunk | frankly - I'm not using federation yet, so have vague idea about keystone_sp.... | 13:12 |
| f0o | this was an easy fix, just re-ran keystone-manage db_sync and viola the column appeared | 13:12 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-ceph_client master: Unify approaches for repo setup between apt/dnf https://review.opendev.org/c/openstack/openstack-ansible-ceph_client/+/929645 | 13:52 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-ceph_client master: Improve handling of ceph_pkg_source changing https://review.opendev.org/c/openstack/openstack-ansible-ceph_client/+/929648 | 13:59 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-ceph_client master: Unify approaches for repo setup between apt/dnf https://review.opendev.org/c/openstack/openstack-ansible-ceph_client/+/929645 | 13:59 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-ceph_client master: Improve handling of ceph_pkg_source changing https://review.opendev.org/c/openstack/openstack-ansible-ceph_client/+/929648 | 13:59 |
| noonedeadpunk | jrosser: so these are follow-ups just in case | 13:59 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_octavia stable/2024.1: Provide better flexability for SSH keypair options https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/929649 | 14:02 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible stable/2024.1: Verify OS for containers installation https://review.opendev.org/c/openstack/openstack-ansible/+/928589 | 14:07 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-repo_server master: Improve role idempotency https://review.opendev.org/c/openstack/openstack-ansible-repo_server/+/929657 | 14:59 |
| noonedeadpunk | #startmeeting openstack_ansible_meeting | 15:00 |
| opendevmeet | Meeting started Tue Sep 17 15:00:20 2024 UTC and is due to finish in 60 minutes. The chair is noonedeadpunk. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
| opendevmeet | The meeting name has been set to 'openstack_ansible_meeting' | 15:00 |
| noonedeadpunk | #topic rollcall | 15:00 |
| noonedeadpunk | o/ | 15:00 |
| noonedeadpunk | #topic office hours | 15:06 |
| noonedeadpunk | so, we're quite long overdue with the first minor release of Caracal | 15:06 |
| noonedeadpunk | while we do really have plenty of fixes already merge - I think the biggest one is still Apache MPM which are inconsistent with Skyline on metal | 15:07 |
| noonedeadpunk | I'm already about to have a patch (based on repo container), which should cover all others | 15:07 |
| NeilHanlon | hiya | 15:08 |
| noonedeadpunk | and this I assume also blocks us with testing of upgrade from the proper branch | 15:08 |
| noonedeadpunk | (now tests run from 2023.2) | 15:08 |
| noonedeadpunk | then I've also proposed testing Ceph for Rocky as well in https://review.opendev.org/c/openstack/openstack-ansible/+/929636 | 15:09 |
| noonedeadpunk | though it fails :( | 15:09 |
| noonedeadpunk | and I _think_ I already saw that some time ago | 15:11 |
| noonedeadpunk | and we even discussed that like couple of years ago with yu NeilHanlon | 15:11 |
| noonedeadpunk | `The error was: 'ansible.vars.hostvars.HostVarsVars object' has no attribute 'discovered_interpreter_python'` | 15:12 |
| noonedeadpunk | would need to revive in my memory wtf is wrong... I can recall ansible having some mapping for python by distros, but I kinda thought they got rid of it or smth. | 15:14 |
| noonedeadpunk | regarding upcoming dalmatian release - we need to switch to 2024.2 branch for tracking | 15:14 |
| noonedeadpunk | though, there's a batch right before branching as well: https://review.opendev.org/c/openstack/openstack-ansible/+/927841 | 15:15 |
| NeilHanlon | ah yeah.. i vaguely recall that interpreter thing.. python and ansible in EL has been ... fun | 15:15 |
| noonedeadpunk | which fails for metal installs | 15:15 |
| noonedeadpunk | we had some progress with ladning deb822 migrations | 15:19 |
| noonedeadpunk | I wonder what else do we miss covering with it, except openstack_hosts, rabbitmq and galera | 15:20 |
| noonedeadpunk | And ceph_client | 15:20 |
| NeilHanlon | are there downsides to missing some conversions? | 15:23 |
| noonedeadpunk | well, apt issues a warning of storing gpg keys in shared storage which is deprecated | 15:26 |
| noonedeadpunk | as then each repo can use any gpg key basically, which is fixed by this new format | 15:27 |
| NeilHanlon | ah, i see | 15:29 |
| NeilHanlon | i tried to do some research on what it all was about but got lost | 15:30 |
| noonedeadpunk | so nothing particulary bad, I guess, but as change is quite breaking, would bee good to do tis one time | 15:31 |
| noonedeadpunk | I also need to deprecate couple of repos, ie: senlin, murano, sahara as underlying projects were also deprecated | 15:31 |
| NeilHanlon | anything I can do to help? I've got some time I can spend on reviews and other things | 15:35 |
| noonedeadpunk | um.. any updates on repo mirroring?:) | 15:39 |
| noonedeadpunk | as that is smth which would be totally nice to have/improve on | 15:40 |
| NeilHanlon | i did start working on diving through grafana | 15:40 |
| NeilHanlon | err, opensearch | 15:40 |
| NeilHanlon | https://opensearch.logs.openstack.org/_dashboards/app/data-explorer/discover?security_tenant=global#?_a=(discover:(columns:!(_source),isDirty:!t,sort:!()),metadata:(indexPattern:'94869730-aea8-11ec-9e6a-83741af3fdcd',view:discover))&_g=(filters:!(),refreshInterval:(pause:!t,value:0),time:(from:now-1M,to:now))&_q=(filters:!(('$state':(store:appState | 15:42 |
| NeilHanlon | ),meta:(alias:!n,disabled:!f,index:'94869730-aea8-11ec-9e6a-83741af3fdcd',key:build_status,negate:!f,params:(query:FAILURE),type:phrase),query:(match_phrase:(build_status:FAILURE))),('$state':(store:appState),meta:(alias:'build_name%20~%20rocky',disabled:!f,index:'94869730-aea8-11ec-9e6a-83741af3fdcd',key:query,negate:!f,type:custom,value:'%7B%22wi | 15:42 |
| NeilHanlon | ldcard%22:%7B%22build_name%22:%22*rocky*%22%7D%7D'),query:(wildcard:(build_name:'*rocky*')))),query:(language:kuery,query:'project:%20(%22openstack%2Fopenstack-ansible*%22%20OR%20%22openstack%2Fkolla*%22)%20AND%20message:%20(%22*cannot%20install*%22%20OR%20%22*Depsolve%20Error*%22)')) | 15:42 |
| NeilHanlon | .. bleh | 15:42 |
| NeilHanlon | https://drop1.neilhanlon.me/irc/uploads/f810495797312453/image.png there | 15:43 |
| NeilHanlon | i need to spend some more time finding other failures as 9 seems low | 15:44 |
| NeilHanlon | but, yeah.. progress | 15:44 |
| noonedeadpunk | well, 8 of them were during one day? | 15:46 |
| NeilHanlon | true.. | 15:46 |
| NeilHanlon | i bet i can correlate that with rocky releaseing stuff... | 15:47 |
| noonedeadpunk | and probably worth checking for couple of month or smth... | 15:47 |
| noonedeadpunk | yeah, true | 15:47 |
| noonedeadpunk | but then also worth checking amount of jobs in total maybe? | 15:47 |
| NeilHanlon | i think opensearch only has ~1week of logs | 15:47 |
| NeilHanlon | err, i guess two | 15:47 |
| noonedeadpunk | as local mirrors for sure would reduce latency/throughput to the external mirrors | 15:47 |
| NeilHanlon | farthest back being the 4th | 15:48 |
| noonedeadpunk | which is already a win as well, if there're enough jobs running to justify that | 15:48 |
| noonedeadpunk | but dunno | 15:48 |
| NeilHanlon | yeah i will make some pretty graph showing total jobs vs failed /timeout/etc | 15:48 |
| noonedeadpunk | as low error rate can be used to promote using rocky in PTI instead of CentOS :D | 15:51 |
| noonedeadpunk | #endmeeting | 16:01 |
| opendevmeet | Meeting ended Tue Sep 17 16:01:23 2024 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:01 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/openstack_ansible_meeting/2024/openstack_ansible_meeting.2024-09-17-15.00.html | 16:01 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/openstack_ansible_meeting/2024/openstack_ansible_meeting.2024-09-17-15.00.txt | 16:01 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/openstack_ansible_meeting/2024/openstack_ansible_meeting.2024-09-17-15.00.log.html | 16:01 |
| NeilHanlon | ahhh i found some others... | 16:07 |
| NeilHanlon | that 8 was actually more like 24 across kolla and OSA | 16:07 |
| NeilHanlon | some are not FAILURE but RETRY_EXCEEDED | 16:07 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-ceph_client master: Unify approaches for repo setup between apt/dnf https://review.opendev.org/c/openstack/openstack-ansible-ceph_client/+/929645 | 17:07 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-ceph_client master: Improve handling of ceph_pkg_source changing https://review.opendev.org/c/openstack/openstack-ansible-ceph_client/+/929648 | 17:07 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-repo_server master: Ensure that selected Apache MPM is enforced https://review.opendev.org/c/openstack/openstack-ansible-repo_server/+/929690 | 17:56 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_keystone master: Ensure that selected Apache MPM is enforced https://review.opendev.org/c/openstack/openstack-ansible-os_keystone/+/929691 | 18:07 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_keystone master: Ensure that selected Apache MPM is enforced https://review.opendev.org/c/openstack/openstack-ansible-os_keystone/+/929691 | 18:12 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_keystone master: Ensure that selected Apache MPM is enforced https://review.opendev.org/c/openstack/openstack-ansible-os_keystone/+/929691 | 18:13 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_keystone master: Ensure that selected Apache MPM is enforced https://review.opendev.org/c/openstack/openstack-ansible-os_keystone/+/929691 | 18:15 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_horizon master: Ensure that selected Apache MPM is enforced https://review.opendev.org/c/openstack/openstack-ansible-os_horizon/+/929695 | 18:19 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_skyline master: Ensure that selected Apache MPM is enforced https://review.opendev.org/c/openstack/openstack-ansible-os_skyline/+/929697 | 18:24 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-repo_server master: Ensure that selected Apache MPM is enforced https://review.opendev.org/c/openstack/openstack-ansible-repo_server/+/929690 | 19:52 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_skyline master: Ensure that selected Apache MPM is enforced https://review.opendev.org/c/openstack/openstack-ansible-os_skyline/+/929697 | 19:52 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_keystone master: Ensure that selected Apache MPM is enforced https://review.opendev.org/c/openstack/openstack-ansible-os_keystone/+/929691 | 19:52 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_horizon master: Ensure that selected Apache MPM is enforced https://review.opendev.org/c/openstack/openstack-ansible-os_horizon/+/929695 | 19:52 |
| WireLost | jrosser, so, yeah, I still can't 'add-apt-repository cloud-archive:dalmation' on 24.04 - https://bugs.launchpad.net/ubuntu/+source/software-properties/+bug/2073742 - Not seeing that fix yet, even if I enable 'noble-proposed' - Have to wait a bit more hehe | 20:26 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!
