| opendevreview | OpenStack Proposal Bot proposed openstack/project-config master: Normalize projects.yaml https://review.opendev.org/c/openstack/project-config/+/940092 | 02:40 |
|---|---|---|
| opendevreview | Merged openstack/project-config master: Normalize projects.yaml https://review.opendev.org/c/openstack/project-config/+/940092 | 07:18 |
| opendevreview | Dr. Jens Harbott proposed openstack/project-config master: Revert "Use ubuntu-noble for test-release-openstack" https://review.opendev.org/c/openstack/project-config/+/940105 | 08:08 |
| frickler | elodilles: infra-root: ^^ since fixing ensure-twine seems to take longer, let's go with ^^ for now? | 08:10 |
| *** tosky_ is now known as tosky | 08:53 | |
| opendevreview | Merged openstack/project-config master: Revert "Use ubuntu-noble for test-release-openstack" https://review.opendev.org/c/openstack/project-config/+/940105 | 10:49 |
| *** tosky is now known as Guest6863 | 13:19 | |
| *** tosky_ is now known as tosky | 13:19 | |
| drchanmp | drchanmp | 13:21 |
| opendevreview | Merged openstack/project-config master: [Neutron] Update dashboard with latest job renames https://review.opendev.org/c/openstack/project-config/+/940065 | 13:56 |
| opendevreview | Jeremy Stanley proposed opendev/bindep master: Evacuate most metadata out of setup.cfg https://review.opendev.org/c/opendev/bindep/+/938520 | 14:51 |
| opendevreview | Jeremy Stanley proposed opendev/bindep master: Drop support for Python 3.6 https://review.opendev.org/c/opendev/bindep/+/938568 | 14:51 |
| opendevreview | Jeremy Stanley proposed opendev/bindep master: Drop requirements.txt https://review.opendev.org/c/opendev/bindep/+/938570 | 14:51 |
| opendevreview | Jeremy Stanley proposed opendev/bindep master: Evacuate most metadata out of setup.cfg https://review.opendev.org/c/opendev/bindep/+/938520 | 15:21 |
| opendevreview | Jeremy Stanley proposed opendev/bindep master: Drop support for Python 3.6 https://review.opendev.org/c/opendev/bindep/+/938568 | 15:21 |
| opendevreview | Jeremy Stanley proposed opendev/bindep master: Drop requirements.txt https://review.opendev.org/c/opendev/bindep/+/938570 | 15:21 |
| clarkb | infra-root in prep for cleaning up paste01 I'ev realized it had a volume attached to ti dedicated to mariadb storage. I did not set that up on paste02... Thankfully the db appears small enough that it doesn't matter all that much for this service. I can add a volume to paste02, shut the service down, copy data around and remount it if we'd like though probably not today as I have a | 16:08 |
| clarkb | meeting midday | 16:08 |
| clarkb | I'm out of practice on rebuilding servers... | 16:08 |
| clarkb | the paste01 volume is 75GB large and the consumpotion there is only 4.4GB | 16:09 |
| clarkb | additionally, are we ready to delete paste01 and retire its backups? | 16:09 |
| clarkb | I've noticed that our system-config grafana job doesn't take screenshots of our actual dashboards like the project-config job does. I'm working on fixing that as part of the 10.4.14 bump change | 16:28 |
| opendevreview | Clark Boylan proposed opendev/system-config master: Update grafana to 10.4.14 https://review.opendev.org/c/opendev/system-config/+/940073 | 16:40 |
| opendevreview | Clark Boylan proposed opendev/system-config master: Take screenshots of all grafana dashboards https://review.opendev.org/c/opendev/system-config/+/940154 | 16:40 |
| opendevreview | Clark Boylan proposed opendev/system-config master: Take screenshots of all grafana dashboards https://review.opendev.org/c/opendev/system-config/+/940154 | 16:59 |
| opendevreview | Clark Boylan proposed opendev/system-config master: Update grafana to 10.4.14 https://review.opendev.org/c/opendev/system-config/+/940073 | 16:59 |
| opendevreview | Jeremy Stanley proposed zuul/zuul-jobs master: ensure-python: Skip "t" versions in pyenv https://review.opendev.org/c/zuul/zuul-jobs/+/940158 | 17:06 |
| frickler | clarkb: I assume the idea about the extra volume may have been to be able to migrate it to a new server and avoiding having to dump and transfer the DB? seems with that db size it doesn't matter much, so I'm fine with leaving the setup as it is | 17:25 |
| clarkb | frickler: or maybe we were concerned the DB was larger than it actually is. I'm not sure | 17:26 |
| clarkb | but ya seems we have plenty of headroom | 17:26 |
| opendevreview | Clark Boylan proposed opendev/system-config master: Take screenshots of all grafana dashboards https://review.opendev.org/c/opendev/system-config/+/940154 | 17:27 |
| opendevreview | Clark Boylan proposed opendev/system-config master: Update grafana to 10.4.14 https://review.opendev.org/c/opendev/system-config/+/940073 | 17:27 |
| fungi | comparing the list of commits since bindep 2.11.0 against the release notes, it looks like we missed adding one in 1d4f511 Drop Python 2.7/3.5 testing and support | 17:27 |
| fungi | https://paste.opendev.org/show/bClElYVzVSF3FiL2jBkJ/ | 17:28 |
| fungi | i don't think anything else in there is in glaring need of a release note but lacks one | 17:28 |
| fungi | we have a release note for the added dependency on the distro lib | 17:29 |
| opendevreview | Jeremy Stanley proposed opendev/bindep master: Add a release note about dropping Python 2.7/3.5 https://review.opendev.org/c/opendev/bindep/+/940161 | 17:37 |
| fungi | anybody else spot any commits there that could stand a release note? | 17:45 |
| clarkb | might want to add one for popos support | 17:46 |
| clarkb | but I'm not seeing anythine else | 17:46 |
| fungi | oh, yep! good catch | 17:46 |
| opendevreview | Jeremy Stanley proposed opendev/bindep master: Add a release note about adding PopOS support https://review.opendev.org/c/opendev/bindep/+/940163 | 17:50 |
| opendevreview | Merged opendev/bindep master: Add a release note about dropping Python 2.7/3.5 https://review.opendev.org/c/opendev/bindep/+/940161 | 17:54 |
| clarkb | screenshots worked in the parent change against the current grafana version. Still waiting for the job to run against the version bump | 18:06 |
| opendevreview | Merged opendev/bindep master: Add a release note about adding PopOS support https://review.opendev.org/c/opendev/bindep/+/940163 | 18:21 |
| fungi | now that ^ has landed, should i proceed with a 2.12.0 tag (or do we want 3.0.0 because we dropped python 2.7/3.5 support)? and on a friday, or should we not be "those people" for a change? ;) | 18:23 |
| clarkb | I'm good with 2.12.0. I think we set up python requires so python2.7 should keep working just with older versions. | 18:24 |
| clarkb | I'm ok with a friday release but also I'll be gone for a good chunk of the day starting in about an hour | 18:24 |
| fungi | i too am okay with a friday release, and have no plans because i'm a homebody and everything outside is still coated in slippery white goop anyway | 18:26 |
| fungi | if nobody objects by, let's say, 20:00 utc i'll push a tag for bindep 2.12.0 and maybe herald its arrival on service-announce | 18:27 |
| clarkb | wfm | 18:27 |
| clarkb | https://e1d223c4122f43bb19d4-ad192bc6f0ac3935f353a68c30c209c2.ssl.cf5.rackcdn.com/940073/4/check/system-config-run-grafana/b828993/bridge99.opendev.org/screenshots/ screenshots of grafana 10.4.14 | 18:30 |
| clarkb | It seems to be working there so not sure where the CORS problems could be. I guess if we want to be very careful we can hold a node and interact with it dynamically to try and reproduce | 18:30 |
| clarkb | some of the nodepool graphs show no data | 18:31 |
| clarkb | oh ya they have network errors when attempting to fetch the resource. Could that be due to CORS? | 18:31 |
| clarkb | could be query specific if so. I guess we should hold a node | 18:32 |
| clarkb | the pre upgrade screenshots don't have that problem for nodepool graphs | 18:32 |
| clarkb | its possible the solution here is to update the queries to make them happier, but ya probably need to hold a node to figure that out unless we have some good logs on the server side | 18:33 |
| clarkb | hrm doesn't look like we grab service logs at all :/ | 18:33 |
| fungi | infra-root: this is what i'm planning to push for bindep in ~1.5 hours, speak now or forever hold your reverts: 5e1de7f99d887c55e7f46990ec3f52822ad60180 refs/tags/2.12.0 | 18:33 |
| fungi | commit bc577f778963234a5d971dfa6e7be5fe9196c4c0 (HEAD, tag: 2.12.0, origin/master, origin/HEAD, gerrit/master) | 18:34 |
| fungi | that's probably more useful | 18:34 |
| clarkb | both the commit has (bc577f...) and the tag (2.12.0) lgtm | 18:36 |
| clarkb | *commit hash. I can type. | 18:36 |
| fungi | thanks! | 18:36 |
| clarkb | the change to take grafana screenshots should be good to go. I applied it first under the upgrade change | 18:37 |
| clarkb | I brought up how deleting the cache files made gerrit start up faster and was able to serve file diffs quicker post restart with upstream. And they agreed that would be likely but then pointed out that not having the cache does slow down accesses to those files until they are cached | 18:39 |
| clarkb | so its a tradeoff. Do we want faster startups or better performance over longer periods of runtime | 18:40 |
| clarkb | gerrit master has a change proposed that takes advantage of new h2 to do bloomfilter generation in parallel with cache reads for file diffs. I think you still won't get file diffs if they aren't ached because those have to be written first but if the file is already in the cache it should be available immediately ish on startup with gerrit 3.12 | 18:41 |
| fungi | probably comes down to the ratio of frequencies for cold vs warm cache hits we expect | 18:41 |
| opendevreview | Clark Boylan proposed opendev/system-config master: Update grafana to 10.4.14 https://review.opendev.org/c/opendev/system-config/+/940073 | 18:52 |
| opendevreview | Clark Boylan proposed opendev/system-config master: Log grafana to /var/log/containers with journald/syslog https://review.opendev.org/c/opendev/system-config/+/940166 | 18:52 |
| clarkb | trying to add better logging to grafana now too | 18:52 |
| clarkb | https://www.linuxserver.io/blog/we-need-to-talk-about-docker-hub | 19:13 |
| fungi | hah | 19:13 |
| fungi | this seems like a strange decision: https://nodejs.org/en/blog/vulnerability/upcoming-cve-for-eol-versions | 20:06 |
| fungi | #status log Released bindep 2.12.0 | 20:10 |
| fungi | https://zuul.opendev.org/t/opendev/build/b50aef86067a4df9a8496f3108fde048 seems to be problematic | 20:10 |
| opendevstatus | fungi: finished logging | 20:11 |
| fungi | https://docs.opendev.org/opendev/bindep/latest/releasenotes.html does seem to have updated though | 20:11 |
| clarkb | I'm not sure i understand that failure particularly if publishing worked anyway | 22:02 |
| clarkb | in the grafana stuff I see request origin not allowed messages but those seem to be related to selenium making requests to localhost | 22:08 |
| clarkb | I suspect that we could have selenium make requests to the actual name somehow but miught have to set up certs | 22:08 |
| clarkb | its interesting though that I see those messages on the old and new side os I don't think ti is directly related to the lack of data in some graphs | 22:08 |
| clarkb | is the docker hub web ui not loading for anyone else? | 22:37 |
| clarkb | I'm trying to figure out the GF_SERVER_DOMAIN option and was hoping to find the dockerfile via docker hub ... | 22:37 |
| clarkb | what I'm realizing is that if I set the url to grafana.opendev.org I can do that if I edit /etc/hosts but then there are fewer belts and suspenders that we're actually screenshotting the test node and not production | 22:42 |
| clarkb | probably best to keep screenshotting localhost and maybe hold a node to understand the errors better before making any other choices/decisions | 22:42 |
| opendevreview | Brian Haley proposed zuul/zuul-jobs master: Update ensure-twine role https://review.opendev.org/c/zuul/zuul-jobs/+/940074 | 23:08 |
| opendevreview | Brian Haley proposed zuul/zuul-jobs master: Update ensure-twine role https://review.opendev.org/c/zuul/zuul-jobs/+/940074 | 23:18 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!