opendevreview | Ian Wienand proposed openstack/openstack-zuul-jobs master: [dnm] testing grafana https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/847128 | 00:03 |
---|---|---|
opendevreview | Ian Wienand proposed openstack/openstack-zuul-jobs master: [dnm] testing grafana https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/847128 | 00:33 |
*** rlandy|bbl is now known as rlandy | 01:33 | |
opendevreview | Ian Wienand proposed openstack/openstack-zuul-jobs master: [dnm] testing grafana https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/847128 | 01:40 |
*** rlandy is now known as rlandy|out | 01:40 | |
*** ysandeep|out is now known as ysandeep | 01:59 | |
opendevreview | Ian Wienand proposed openstack/openstack-zuul-jobs master: [WIP] grafana : import and screenshot project-config graphs https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/847128 | 03:22 |
opendevreview | Ian Wienand proposed openstack/openstack-zuul-jobs master: grafana : import and screenshot project-config graphs https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/847128 | 03:56 |
opendevreview | Ian Wienand proposed openstack/project-config master: grafana: import graphs and take screenshots https://review.opendev.org/c/openstack/project-config/+/847129 | 03:56 |
*** akahat is now known as akahat|ruck | 04:39 | |
opendevreview | daniel.pawlik proposed openstack/ci-log-processing master: Add Prometheus monitoring metrics into logscraper https://review.opendev.org/c/openstack/ci-log-processing/+/846965 | 06:24 |
opendevreview | daniel.pawlik proposed openstack/ci-log-processing master: Add Prometheus monitoring metrics into logscraper https://review.opendev.org/c/openstack/ci-log-processing/+/846965 | 06:31 |
opendevreview | Merged openstack/ci-log-processing master: Move options into config file https://review.opendev.org/c/openstack/ci-log-processing/+/845494 | 06:40 |
opendevreview | daniel.pawlik proposed openstack/ci-log-processing master: Fix typos; add download dir into the diagram https://review.opendev.org/c/openstack/ci-log-processing/+/847527 | 06:48 |
opendevreview | Merged openstack/ci-log-processing master: Do not try to get new job results when none available https://review.opendev.org/c/openstack/ci-log-processing/+/845267 | 06:54 |
*** arxcruz|rover is now known as arxcruz | 06:55 | |
opendevreview | daniel.pawlik proposed openstack/ci-log-processing master: Move upload image job to post step https://review.opendev.org/c/openstack/ci-log-processing/+/847528 | 06:59 |
*** jpena|off is now known as jpena | 07:06 | |
*** ysandeep is now known as ysandeep|afk | 07:11 | |
opendevreview | daniel.pawlik proposed openstack/ci-log-processing master: Push container image "latest" after merge https://review.opendev.org/c/openstack/ci-log-processing/+/847528 | 07:16 |
opendevreview | daniel.pawlik proposed openstack/ci-log-processing master: Parse performance.json file and send to separate index https://review.opendev.org/c/openstack/ci-log-processing/+/840466 | 07:58 |
*** ysandeep|afk is now known as ysandeep | 09:00 | |
*** rlandy|out is now known as rlandy | 10:21 | |
*** ysandeep is now known as ysandeep|brb | 11:01 | |
*** ysandeep|brb is now known as ysandeep | 11:18 | |
*** dviroel|out is now known as dviroel | 11:19 | |
opendevreview | daniel.pawlik proposed openstack/ci-log-processing master: Add missing file_list config parameter https://review.opendev.org/c/openstack/ci-log-processing/+/847575 | 11:40 |
*** rlandy is now known as rlandy|dr_appt | 11:48 | |
*** ysandeep is now known as ysandeep|afk | 12:12 | |
*** rlandy|dr_appt is now known as rlandy | 12:51 | |
*** ysandeep|afk is now known as ysandeep | 12:58 | |
opendevreview | daniel.pawlik proposed openstack/ci-log-processing master: Parse performance.json file and send to separate index https://review.opendev.org/c/openstack/ci-log-processing/+/840466 | 13:17 |
*** dasm|off is now known as dasm | 13:33 | |
opendevreview | daniel.pawlik proposed openstack/ci-log-processing master: Parse performance.json file and send to separate index https://review.opendev.org/c/openstack/ci-log-processing/+/840466 | 14:03 |
dpawlik | dansmith: hey, I will let you know when we merge https://review.opendev.org/c/openstack/ci-log-processing/+/840466 and deploy the new version on production | 14:25 |
dpawlik | Probably it will be on Monday | 14:25 |
*** ysandeep is now known as ysandeep|out | 15:00 | |
elodilles | clarkb fungi : fyi, i'm planning to run the usual EOL'd branch clean-up script. as i see gerrit & zuul are OK | 15:07 |
*** dviroel is now known as dviroel|lunch | 15:19 | |
clarkb | elodilles: yes, ntoe that this is the first run since the gerrit 3.5 upgrade. I don't anticipate problems but you might want to do one first and double check it is happy | 15:42 |
elodilles | clarkb: ack, thanks, the script asks for confirmation before every branch delete, so it's easy to check after the 1st delete :) | 15:44 |
fungi | sounds good, thanks elodilles! | 15:48 |
elodilles | it looks like working as expected: "Branch stable/victoria successfully deleted from openstack/os-apply-config!" | 15:49 |
fungi | excellent | 15:49 |
elodilles | vs https://opendev.org/openstack/os-apply-config | 15:49 |
elodilles | stable/victoria is not visible anymore \o/ | 15:50 |
*** jpena is now known as jpena|off | 16:02 | |
*** dviroel|lunch is now known as dviroel | 16:18 | |
elodilles | here is the list of deleted EOL'd branches from today: https://paste.opendev.org/show/bAck9bp9XVCWUTngn6rS/ | 17:39 |
fungi | excellent. i hope this results in a significant reduction in failing periodic pipeline jobs | 17:51 |
fungi | otherwise i think we need to start looking harder at disabling a lot of those jobs which keep running every day and nobody's working on fixing | 17:52 |
elodilles | it will reduce somewhat, but the most failing things are oslo's old stable branches, so until those are not EOL'd we will see quite some failures :/ | 18:01 |
elodilles | also, *-powervm + murano repos are quite inactive. those could be disabled i think | 18:03 |
fungi | if nobody in the oslo team has time to fix those failing stable periodic jobs, can we just stop running them for now? | 18:03 |
fungi | i get something like 120 e-mails from the stable periodic failures ml every day | 18:03 |
elodilles | yepp, i know, i'm getting them too | 18:05 |
elodilles | more than half of them are coming from oslo | 18:06 |
elodilles | 8 is coming from murano | 18:07 |
elodilles | which is a dead project basically | 18:07 |
elodilles | 8 is coming from *-powervm, which repos are also completely inactive ones | 18:08 |
elodilles | actually oslo team was already thinking of EOLing their old stable branches: http://lists.openstack.org/pipermail/openstack-discuss/2021-October/thread.html#25180 | 18:17 |
elodilles | i don't know where it got stucked | 18:17 |
elodilles | if those branches are EOL'd we'd get rid of the majority of the dailybuild failures | 18:18 |
fungi | oh, cool. yes that would be very nice | 18:22 |
elodilles | fungi: i've sent out this mail, this might also help somewhat on the situation if noone objects: http://lists.openstack.org/pipermail/openstack-discuss/2022-June/029250.html | 18:30 |
fungi | thanks! | 18:30 |
fungi | and yeah, whatever we can do to reduce unnecessary load on our test resources is much appreciated | 18:31 |
fungi | continually running jobs we know are broken and nobody cares to fix is a massive waste | 18:31 |
elodilles | also sent this mail towards oslo team: http://lists.openstack.org/pipermail/openstack-discuss/2022-June/029252.html | 18:40 |
elodilles | fungi: though i'd say that periodic stable jobs should not be so resource greedy. i mean, they are mostly simple unit test jobs + docs jobs. either they fail or they run successfully they consume less node time than tempest and other tests | 18:41 |
elodilles | fungi: though i understand any waste is still a waste | 18:42 |
elodilles | anyway, hopefully these EOL proposals will help :) | 18:43 |
elodilles | about murano + powervm I think the best is to switch off the periodic stable jobs as soon as possible | 18:44 |
elodilles | I can propose stable-only patches to remove periodic-stable template from their old, failing branches | 18:46 |
elodilles | fungi: if i do this, then can you force-merge those patches? ^^^ | 18:46 |
elodilles | (i don't know when TC will force-retire them) | 18:48 |
fungi | elodilles: sure, i can bypass testing to merge configuration removing failing jobs | 19:14 |
fungi | some of those jobs are quick, but some are devstack/tempest based jobs that run for an hour or twi | 19:14 |
fungi | s/twi/two/ | 19:14 |
fungi | and unit tests for nova are even upwards of an hour to complete these days | 19:15 |
elodilles | fungi: ack, i'll push then those patches | 19:17 |
fungi | also i wouldn't mind setting a limit on extended maintenance for this reason... stable/queens is close to five years old at this point | 19:18 |
fungi | but certainly we can be more aggressive about removing jobs which stop working on extended maintenance branches | 19:19 |
fungi | adding them back is a simple revert as soon as someone gets them working again | 19:19 |
fungi | add them to the experimental pipeline, make sure they succeed, revert the removal | 19:20 |
fungi | having them fail constantly is of no use to anyone | 19:20 |
elodilles | fungi: the patches for *-powervm repos: https://review.opendev.org/q/topic:unmaintained-stable-periodic | 19:46 |
elodilles | these will eliminate: 8 mails / 15 failing jobs + some non-failing but unnecessarily running passing periodic jobs | 19:47 |
*** dviroel is now known as dviroel|out | 20:50 | |
opendevreview | Gage Hugo proposed openstack/project-config master: End project gating for openstack-helm deployments https://review.opendev.org/c/openstack/project-config/+/847621 | 21:45 |
opendevreview | Gage Hugo proposed openstack/project-config master: Retire openstack-helm-deployments repo https://review.opendev.org/c/openstack/project-config/+/847414 | 21:46 |
opendevreview | Gage Hugo proposed openstack/project-config master: Retire openstack-helm-deployments repo https://review.opendev.org/c/openstack/project-config/+/847414 | 21:47 |
opendevreview | Gage Hugo proposed openstack/project-config master: End project gating for openstack-helm deployments https://review.opendev.org/c/openstack/project-config/+/847621 | 21:56 |
opendevreview | Gage Hugo proposed openstack/project-config master: Retire openstack-helm-deployments repo https://review.opendev.org/c/openstack/project-config/+/847414 | 21:56 |
opendevreview | Gage Hugo proposed openstack/project-config master: Retire openstack-helm-deployments repo https://review.opendev.org/c/openstack/project-config/+/847414 | 21:56 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!