| -@gerrit:opendev.org- Zuul merged on behalf of Ian Wienand: [zuul/zuul-jobs] 812272: ensure-rust: rework global install https://review.opendev.org/c/zuul/zuul-jobs/+/812272 | 01:41 | |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul-jobs] 813034: WIP: Implement role for limiting zuul log file size https://review.opendev.org/c/zuul/zuul-jobs/+/813034 | 05:33 | |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul-jobs] 813034: WIP: Implement role for limiting zuul log file size https://review.opendev.org/c/zuul/zuul-jobs/+/813034 | 05:46 | |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul-jobs] 813034: WIP: Implement role for limiting zuul log file size https://review.opendev.org/c/zuul/zuul-jobs/+/813034 | 05:51 | |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul-jobs] 813034: WIP: Implement role for limiting zuul log file size https://review.opendev.org/c/zuul/zuul-jobs/+/813034 | 06:07 | |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul-jobs] 813034: WIP: Implement role for limiting zuul log file size https://review.opendev.org/c/zuul/zuul-jobs/+/813034 | 06:46 | |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul-jobs] 813034: WIP: Implement role for limiting zuul log file size https://review.opendev.org/c/zuul/zuul-jobs/+/813034 | 06:57 | |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul-jobs] 813034: WIP: Implement role for limiting zuul log file size https://review.opendev.org/c/zuul/zuul-jobs/+/813034 | 07:33 | |
| -@gerrit:opendev.org- Artem Goncharov proposed: [zuul/zuul] 813136: Check for blocking_discussions_resolved in gitlab driver https://review.opendev.org/c/zuul/zuul/+/813136 | 07:33 | |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul-jobs] 813034: WIP: Implement role for limiting zuul log file size https://review.opendev.org/c/zuul/zuul-jobs/+/813034 | 07:42 | |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul-jobs] 813034: WIP: Implement role for limiting zuul log file size https://review.opendev.org/c/zuul/zuul-jobs/+/813034 | 07:57 | |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul-jobs] 813034: WIP: Implement role for limiting zuul log file size https://review.opendev.org/c/zuul/zuul-jobs/+/813034 | 08:08 | |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul-jobs] 813034: WIP: Implement role for limiting zuul log file size https://review.opendev.org/c/zuul/zuul-jobs/+/813034 | 08:26 | |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul-jobs] 813034: WIP: Implement role for limiting zuul log file size https://review.opendev.org/c/zuul/zuul-jobs/+/813034 | 08:36 | |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul-jobs] 813034: WIP: Implement role for limiting zuul log file size https://review.opendev.org/c/zuul/zuul-jobs/+/813034 | 08:55 | |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul-jobs] 813034: WIP: Implement role for limiting zuul log file size https://review.opendev.org/c/zuul/zuul-jobs/+/813034 | 09:01 | |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul-jobs] 813034: WIP: Implement role for limiting zuul log file size https://review.opendev.org/c/zuul/zuul-jobs/+/813034 | 09:14 | |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul-jobs] 813034: WIP: Implement role for limiting zuul log file size https://review.opendev.org/c/zuul/zuul-jobs/+/813034 | 09:19 | |
| -@gerrit:opendev.org- Artem Goncharov proposed: [zuul/zuul] 813136: Check blocking_discussions_resolved in gitlab driver https://review.opendev.org/c/zuul/zuul/+/813136 | 09:37 | |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul-jobs] 813034: WIP: Implement role for limiting zuul log file size https://review.opendev.org/c/zuul/zuul-jobs/+/813034 | 09:47 | |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul-jobs] 813034: WIP: Implement role for limiting zuul log file size https://review.opendev.org/c/zuul/zuul-jobs/+/813034 | 10:04 | |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul-jobs] 813034: WIP: Implement role for limiting zuul log file size https://review.opendev.org/c/zuul/zuul-jobs/+/813034 | 10:31 | |
| -@gerrit:opendev.org- Albin Vass proposed on behalf of Monty Taylor https://matrix.to/#/@mordred:inaugust.com: [zuul/zuul] 541434: Rework log streaming to use python logging https://review.opendev.org/c/zuul/zuul/+/541434 | 11:05 | |
| @avass:vassast.org | mordred: ^ probably not a perfect rebase but that's gonna make it a bit easier to work with 🙂 | 11:06 |
|---|---|---|
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul-jobs] 813034: WIP: Implement role for limiting zuul log file size https://review.opendev.org/c/zuul/zuul-jobs/+/813034 | 11:36 | |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul-jobs] 813034: WIP: Implement role for limiting zuul log file size https://review.opendev.org/c/zuul/zuul-jobs/+/813034 | 11:45 | |
| @avass:vassast.org | and I can't figure out how to set up the test environment. I'm getting `WARNING Connection dropped: socket connection error: EOF occurred in violation of protocol (_ssl.c:1131)` even though I've set up the containers | 11:51 |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul-jobs] 813034: WIP: Implement role for limiting zuul log file size https://review.opendev.org/c/zuul/zuul-jobs/+/813034 | 11:57 | |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul-jobs] 813034: WIP: Implement role for limiting zuul log file size https://review.opendev.org/c/zuul/zuul-jobs/+/813034 | 12:09 | |
| -@gerrit:opendev.org- Albin Vass proposed on behalf of Monty Taylor https://matrix.to/#/@mordred:inaugust.com: [zuul/zuul] 541434: Rework log streaming to use python logging https://review.opendev.org/c/zuul/zuul/+/541434 | 12:27 | |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul-jobs] 813034: Implement role for limiting zuul log file size https://review.opendev.org/c/zuul/zuul-jobs/+/813034 | 12:32 | |
| -@gerrit:opendev.org- Albin Vass proposed on behalf of Monty Taylor https://matrix.to/#/@mordred:inaugust.com: [zuul/zuul] 541434: Rework log streaming to use python logging https://review.opendev.org/c/zuul/zuul/+/541434 | 12:47 | |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul-jobs] 813034: Implement role for limiting zuul log file size https://review.opendev.org/c/zuul/zuul-jobs/+/813034 | 12:58 | |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul-jobs] 813034: Implement role for limiting zuul log file size https://review.opendev.org/c/zuul/zuul-jobs/+/813034 | 13:13 | |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul-jobs] 813034: Implement role for limiting zuul log file size https://review.opendev.org/c/zuul/zuul-jobs/+/813034 | 13:23 | |
| -@gerrit:opendev.org- Simon Westphahl proposed: [zuul/zuul] 813189: Use correct variable for build request stats https://review.opendev.org/c/zuul/zuul/+/813189 | 13:24 | |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul-jobs] 813034: Implement role for limiting zuul log file size https://review.opendev.org/c/zuul/zuul-jobs/+/813034 | 13:46 | |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul-jobs] 813034: Implement role for limiting zuul log file size https://review.opendev.org/c/zuul/zuul-jobs/+/813034 | 14:00 | |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul-jobs] 813034: Implement role for limiting zuul log file size https://review.opendev.org/c/zuul/zuul-jobs/+/813034 | 14:21 | |
| @goneri:matrix.org | What is the best way to keep trace of the jobs that fail during the pre step? Right now they retry 3 times and if I want to figure out what happens for the failed attempts, I need to deep dive in the log of the right zuul-executor. | 14:28 |
| @jim:acmegating.com | goneri: try the builds page; eg https://zuul.opendev.org/t/openstack/builds?result=RETRY_LIMIT | 14:30 |
| @goneri:matrix.org | When I reach the RETRY_LIMIT, it means we're already at the 3rd failure. Sometime just the 2 first ones are failing and the 3rd is good. In this case, I've pretty much zero log. | 14:31 |
| @jim:acmegating.com | goneri: click on one of those, and click through to its buildset page and you can see them all: https://zuul.opendev.org/t/openstack/buildset/738e66efc32147dfa1a6a8d8b9c8d4b4 | 14:31 |
| @jim:acmegating.com | goneri: then search for RETRY to find the first 2: https://zuul.opendev.org/t/openstack/builds?result=RETRY | 14:32 |
| @jim:acmegating.com | search for both to get all 3: https://zuul.opendev.org/t/openstack/builds?result=RETRY&result=RETRY_LIMIT | 14:32 |
| @goneri:matrix.org | Holycow! This is exactly what I was looking for. | 14:33 |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul-jobs] 813034: Implement role for limiting zuul log file size https://review.opendev.org/c/zuul/zuul-jobs/+/813034 | 14:33 | |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul-jobs] 813034: Implement role for limiting zuul log file size https://review.opendev.org/c/zuul/zuul-jobs/+/813034 | 14:52 | |
| -@gerrit:opendev.org- Clark Boylan proposed: [zuul/zuul] 813113: Make url an attribute of the base Ref class https://review.opendev.org/c/zuul/zuul/+/813113 | 15:33 | |
| @clarkb:matrix.org | corvus: swest ^ that updates a test to assert change_url: None in api responses (I theorized earlier that this would be a new fallback case for some changes) | 15:34 |
| @jim:acmegating.com | Clark: lgtm | 15:35 |
| @clarkb:matrix.org | corvus: looking at opendev's znode count I think it is possible we may still be leaking nodes. We have a similar periodic job induced jump. However it is possible we just have to incur that cost once? Worth continuing to keep an eye on it | 15:48 |
| @jim:acmegating.com | Clark: yeah, let's see what happens after 24h.... we may be looking at periodic jump, plus as it fades that's canceled out by typical workday increase. | 15:50 |
| @jim:acmegating.com | the cache should go down to near zero over the weekend | 15:51 |
| -@gerrit:opendev.org- Artem Goncharov proposed: [zuul/zuul] 813136: Check blocking_discussions_resolved in gitlab driver https://review.opendev.org/c/zuul/zuul/+/813136 | 16:04 | |
| @clarkb:matrix.org | corvus: is https://review.opendev.org/c/zuul/zuul/+/812761 the fix for the test issue that the cache cleanup change hit? | 16:12 |
| @clarkb:matrix.org | if so it too seems to have a test problem. | 16:13 |
| @clarkb:matrix.org | The test it aims to fix is one that failed so possibly related to the change or it is an incomplete fix | 16:15 |
| @jim:acmegating.com | oh, yeah, i see what we should do | 16:15 |
| @jim:acmegating.com | it's incomplete | 16:15 |
| @jim:acmegating.com | implementation as-is improves the odds but doesn't bring them to 100%; will fix | 16:15 |
| -@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 812761: Fix race in test_node_request_canceled https://review.opendev.org/c/zuul/zuul/+/812761 | 16:29 | |
| @clarkb:matrix.org | zuulians https://review.opendev.org/c/zuul/zuul/+/812761 and https://review.opendev.org/c/zuul/zuul/+/813113 are two bugfixes that would probably be good to land | 20:15 |
| @jim:acmegating.com | once those merge, i'll look at doing an opendev restart this weekend and maybe that can be the basis for the next point release | 20:24 |
| @clarkb:matrix.org | corvus: do we need a release note for that? | 20:33 |
| @jim:acmegating.com | Clark: probably not a bad idea. | 20:34 |
| @clarkb:matrix.org | Maybe the release note should be fixing the cache cleanup routine? | 20:35 |
| @clarkb:matrix.org | Since I think that is the biggest bug fixed since the last release | 20:35 |
| -@gerrit:opendev.org- Douglas Viroel proposed: [zuul/zuul-jobs] 813253: WIP - Add FIPS enable role to multi-node job https://review.opendev.org/c/zuul/zuul-jobs/+/813253 | 20:36 | |
| -@gerrit:opendev.org- Clark Boylan proposed: [zuul/zuul] 813254: Add a release notes for cache cleanup fix https://review.opendev.org/c/zuul/zuul/+/813254 | 20:39 | |
| @clarkb:matrix.org | Something like ^ | 20:39 |
| @clarkb:matrix.org | feel free to update that change or replace it. I'm goign to try and get a bike ride in so won't be able to edit it for a bit | 20:39 |
| @jim:acmegating.com | Clark: yeah. we have release notes for new features, but this is maybe something that's worth an explicit note. | 20:40 |
| -@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: | 20:40 | |
| - [zuul/zuul] 813255: Perform actual HTTP requests in gitlab tests https://review.opendev.org/c/zuul/zuul/+/813255 | ||
| - [zuul/zuul] 813256: Add gitlab disable_connection_pool option https://review.opendev.org/c/zuul/zuul/+/813256 | ||
| -@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed on behalf of Clark Boylan: [zuul/zuul] 813254: Add a release notes for cache cleanup fix https://review.opendev.org/c/zuul/zuul/+/813254 | 20:41 | |
| @jim:acmegating.com | Clark: ^ updated typo and approved | 20:41 |
| @clarkb:matrix.org | cool and tahnks | 20:42 |
| @jim:acmegating.com | Clark, fungi, tobiash: an update to our tcp keepalive conversation: the folks i'm working with saw an improvement with keepalives, but still not 100% reliable, so i'm suspecting there's more variables at play and in their environment they may just need to avoid reusing connections entirely. so that's the idea behind disableconnectionpool. at this point i do still think keepalives are a net positive and we should keep them in and expand that to other drivers. | 20:44 |
| -@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/zuul] 812761: Fix race in test_node_request_canceled https://review.opendev.org/c/zuul/zuul/+/812761 | 21:39 | |
| -@gerrit:opendev.org- Zuul merged on behalf of Clark Boylan: [zuul/zuul] 813113: Make url an attribute of the base Ref class https://review.opendev.org/c/zuul/zuul/+/813113 | 21:47 | |
| -@gerrit:opendev.org- Zuul merged on behalf of Clark Boylan: [zuul/zuul] 813254: Add a release notes for cache cleanup fix https://review.opendev.org/c/zuul/zuul/+/813254 | 22:02 | |
| @clarkb:matrix.org | corvus: ya I think keepalives don't really hurt as long as your network can keep up with them. And even with the fairly aggressive setup you proposed thats only a few extra packets every couple of minutes | 23:02 |
| @clarkb:matrix.org | I wonder if anyone has written down why tcp doesn't just do keepalives by default everywhere | 23:03 |
| @jim:acmegating.com | yeah i was wondering that too | 23:56 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!