opendevreview | Merged opendev/system-config master: mirror: add Fedora 36 https://review.opendev.org/c/opendev/system-config/+/845226 | 01:06 |
---|---|---|
*** rlandy|bbl is now known as rlandy | 01:07 | |
*** rlandy is now known as rlandy|out | 01:21 | |
ianw | ^ i have a lock and am running that manually on mirror-update now in a root screen | 02:19 |
ianw | Everything/x86_64/os/Packages/0/0ad-data-0.0.25b-3.fc36.noarch.rpm ... not sure this is the greatest use of space, but anyway... | 02:21 |
ianw | Cloning into '/opt/stack/neutron'... | 03:58 |
ianw | fatal: unable to access 'https://opendev.org/openstack/neutron.git/': GnuTLS recv error (-110): The TLS connection was non-properly terminated. | 03:58 |
ianw | https://zuul.opendev.org/t/openstack/build/e3edf704775a4ee0920275d74116df1e | 03:59 |
ianw | https://zuul.opendev.org/t/openstack/build/bec5b0eeef3147f19f8da595f75764a7 | 03:59 |
ianw | three failed, all in inmotion | 04:01 |
ianw | something happend ~ 12:00 UTC that sent most of the hosts into overdrive | 04:06 |
ianw | e.g. http://cacti.openstack.org/cacti/graph.php?action=zoom&local_graph_id=66790&rra_id=2&view_type=&graph_start=1654229088&graph_end=1654833888 | 04:06 |
ianw | it looks at the same time as the periodic jobs that happen daily, but something spiked memory usage across the board | 04:06 |
ianw | swap hit 8g on gitea02 http://cacti.openstack.org/cacti/graph.php?action=zoom&local_graph_id=66658&rra_id=1&view_type=&graph_start=1654747693&graph_end=1654834093 | 04:08 |
ianw | the lb bounced a bunch of servers in and out after 2s non-responsive periods | 04:10 |
ianw | between 01:44 and 01:53 | 04:11 |
ianw | https://grafana.opendev.org/d/1f6dfd6769/opendev-load-balancer?orgId=1&from=1654229771708&to=1654834571708&viewPanel=5 | 04:16 |
ianw | similar thing with the incoming rate going right up, but really at the time of the periodic jobs. it's also ramping down | 04:16 |
ianw | i don't know, this seems to be something to keep an eye on | 04:17 |
opendevreview | Ian Wienand proposed opendev/system-config master: haproxy: redirectly logs to separate file https://review.opendev.org/c/opendev/system-config/+/845316 | 04:40 |
ianw | one to keep an eye on. there doesn't seem to be an immediate problem now, but definitely we should be aware especially around periodic kick off | 04:41 |
*** pojadhav|afk is now known as pojadhav | 04:52 | |
*** soniya29 is now known as soniya29|ruck | 05:09 | |
opendevreview | Ian Wienand proposed opendev/system-config master: haproxy: redirectly logs to separate file https://review.opendev.org/c/opendev/system-config/+/845316 | 05:21 |
opendevreview | Merged openstack/diskimage-builder master: CentOS 9-stream : work around selinux permissions issue https://review.opendev.org/c/openstack/diskimage-builder/+/845189 | 05:30 |
opendevreview | Ian Wienand proposed opendev/system-config master: haproxy: redirectly logs to separate file https://review.opendev.org/c/opendev/system-config/+/845316 | 06:05 |
*** jpena|off is now known as jpena | 07:14 | |
opendevreview | Dr. Jens Harbott proposed opendev/system-config master: Replace zuul cli command with zuul-admin https://review.opendev.org/c/opendev/system-config/+/845324 | 07:17 |
*** ysandeep|out is now known as ysandeep | 08:05 | |
*** soniya is now known as soniya|ruck | 08:18 | |
*** soniya|ruck is now known as soniya|ruck|lunch | 09:01 | |
*** marios is now known as marios|waiting_room | 09:46 | |
*** rlandy|out is now known as rlandy | 10:29 | |
*** soniya|ruck|lunch is now known as soniya|ruck | 10:46 | |
*** dviroel_ is now known as dviroel | 11:30 | |
opendevreview | Dr. Jens Harbott proposed openstack/diskimage-builder master: Stop using openstack upper constraints https://review.opendev.org/c/openstack/diskimage-builder/+/845218 | 11:38 |
opendevreview | Dr. Jens Harbott proposed openstack/diskimage-builder master: Use plain tox jobs instead of openstack ones https://review.opendev.org/c/openstack/diskimage-builder/+/845349 | 11:38 |
*** ysandeep is now known as ysandeep|break | 13:02 | |
*** ysandeep|break is now known as ysandeep | 13:44 | |
*** dasm is now known as dasm|ruck | 13:45 | |
*** soniya|ruck is now known as soniya|ruck|dinner | 14:45 | |
frickler | infra-root: all arm64 builds seem to be failing | 14:47 |
*** dviroel is now known as dviroel|lunch | 15:02 | |
*** ysandeep is now known as ysandeep|out | 15:21 | |
*** soniya|ruck|dinner is now known as soniya|ruck | 15:49 | |
*** dasm|ruck is now known as dasm|ruck|afk | 16:02 | |
*** dviroel|lunch is now known as dviroel | 16:13 | |
*** marios is now known as marios|out | 16:17 | |
*** rlandy is now known as rlandy|afk | 16:55 | |
*** jpena is now known as jpena|off | 17:11 | |
*** dasm|ruck|afk is now known as dasm|ruck | 17:15 | |
*** soniya|ruck is now known as soniya|ruck|out | 18:05 | |
*** rlandy|afk is now known as rlandy | 18:21 | |
*** dviroel is now known as dviroel|afk | 19:20 | |
slittle | please review https://review.opendev.org/c/openstack/project-config/+/845021 | 19:30 |
*** dasm|ruck is now known as dasm|off | 21:55 | |
opendevreview | Merged openstack/project-config master: Add KubeVirt app to StarlingX https://review.opendev.org/c/openstack/project-config/+/845021 | 21:59 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!