opendevreview | Ian Wienand proposed openstack/openstack-zuul-jobs master: build-wheel-cache: Don't use virtualenv on python3 platforms https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/828217 | 00:14 |
---|---|---|
opendevreview | Ian Wienand proposed openstack/openstack-zuul-jobs master: wheel-cache: build python3 wheels for CentOS 7 https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/828218 | 00:14 |
*** rlandy|ruck is now known as rlandy|out | 00:52 | |
*** ysandeep|out is now known as ysandeep | 05:36 | |
*** ykarel_ is now known as ykarel | 06:49 | |
*** amoralej|off is now known as amoralej | 08:03 | |
*** jpena|off is now known as jpena | 08:33 | |
frickler | maintain-github-openstack-mirror passed \o/ | 08:40 |
frickler | https://github.com/openstack/charm-cinder-nimblestorage has been created but is still empty, likely the next sync will only happen when the repo is updated? | 08:40 |
frickler | https://github.com/openstack/skyline-apiserver looks fine | 08:42 |
*** ysandeep is now known as ysandeep|lunch | 08:59 | |
*** ysandeep|lunch is now known as ysandeep | 10:03 | |
*** ykarel_ is now known as ykarel | 10:31 | |
opendevreview | Daniel Bengtsson proposed openstack/pbr master: Changed minversion in tox to 3.18.0. https://review.opendev.org/c/openstack/pbr/+/829521 | 11:05 |
*** rlandy|out is now known as rlandy|ruck | 11:08 | |
*** dviroel|out is now known as dviroel | 11:21 | |
opendevreview | Merged openstack/project-config master: Add Rocky Linux to nodepool elements tooling https://review.opendev.org/c/openstack/project-config/+/829405 | 11:26 |
*** mzijdemans_ is now known as mzijdemans | 11:54 | |
*** amoralej is now known as amoralej|lunch | 13:02 | |
*** amoralej|lunch is now known as amoralej | 14:01 | |
opendevreview | Neil Hanlon proposed openstack/project-config master: Add rockylinux-8 to nodepool configuration https://review.opendev.org/c/openstack/project-config/+/828435 | 14:33 |
*** weechat1 is now known as amorin | 15:02 | |
*** ysandeep is now known as ysandeep|out | 15:26 | |
*** dviroel is now known as dviroel|lunch | 15:31 | |
*** ysandeep|out is now known as ysandeep | 16:00 | |
*** ysandeep is now known as ysandeep|out | 16:04 | |
*** rlandy|ruck is now known as rlandy|ruck|mtg | 16:22 | |
*** rlandy|ruck|mtg is now known as rlandy|ruck | 16:37 | |
*** dviroel|lunch is now known as dviroel | 16:39 | |
*** jpena is now known as jpena|off | 17:32 | |
abhishekk | is zuul down? | 18:21 |
fungi | abhishekk: i do seem to be having trouble reaching it | 18:22 |
abhishekk | fungi, ack, since 15 minutes I am facing it | 18:23 |
clarkb | I wonder if this is fallout from corvus' debugging of zuul web | 18:23 |
fungi | apache is responsive, but doesn't return the status page once i make the request | 18:24 |
fungi | oh, hah, if i `GET /` on the https socket, i'm rewarded with a directory listing of the container's root dir. that's also suboptimal | 18:25 |
fungi | takes a minute to return though | 18:25 |
fungi | no, i'm wrong | 18:26 |
fungi | apparently that landed on my command shell, it wasn't returned by the server | 18:26 |
clarkb | ah ok | 18:26 |
abhishekk | restart will help? | 18:26 |
clarkb | fwiw zuul-web is spinnign a cpu | 18:26 |
clarkb | I highly suspect this si related to corvus debugging | 18:26 |
clarkb | I suspect that zuul is still operating we just aren't getting a dashboard | 18:28 |
clarkb | I've asked corvus about it in #opendev | 18:28 |
abhishekk | jobs are not triggered after patch approval as well | 18:29 |
clarkb | abhishekk: how do you know? | 18:30 |
clarkb | zuul's gerrit integration is independent of the web component. I believe they are being triggered | 18:30 |
abhishekk | we have approved 3-4 patches in last 15 minutes | 18:30 |
fungi | presumably lack of review comments from zuul about enqueuing into the gate? that can also just be delayed by queue processing though | 18:31 |
abhishekk | and none of the patch has triggered gate job ( I don't see message "verified starting job") | 18:31 |
clarkb | anyway it looks like it is reloading its config and is near done? Once that is done we can see if it is happy again before we do anything else | 18:31 |
abhishekk | https://review.opendev.org/c/openstack/glance/+/826731 | 18:32 |
fungi | if zuul has a backlog of queued events to process, particularly reconfiguration events, that can result in delays writing comments to gerrit | 18:32 |
abhishekk | this one approved 30 mins before | 18:32 |
abhishekk | ack | 18:32 |
clarkb | the log shows it is responding to requests now | 18:33 |
clarkb | but maybe slowly as apache lets them trickle through | 18:33 |
fungi | i guess once we get a second zuul-web and the haproxy deployed, this sort of thing will be less of an issue | 18:33 |
clarkb | I've not yet been able to get requests from my end to go through | 18:33 |
clarkb | fungi: ya and spinning up a server for that is on my todo list. I just keep finding other things to have on the todo list :? | 18:34 |
fungi | that's the problem with todo lists, they always have things on them | 18:34 |
fungi | and yeah, apache is still timing out communicating with zuul-web for me | 18:34 |
fungi | it takes a while to even open a socket to apache now | 18:35 |
clarkb | we might be able to accelerate things by restarting apache? | 18:35 |
clarkb | I just got a response with curl but not in my browser yet. The profiler was enabled which does slow things down | 18:36 |
clarkb | and there is the status | 18:36 |
abhishekk | I think it is back on track | 18:36 |
abhishekk | wondering whether I need to re +w the patches | 18:37 |
clarkb | abhishekk: you shouldn't. Notice the backlog of events at the top left of the status page. Your event is very likely in that queue and just needs to be processed | 18:37 |
abhishekk | clarkb, cool,thank you | 18:37 |
clarkb | abhishekk: if we see the queue go to 0 and you haven't enqueued then you may need to reapply the +w | 18:38 |
abhishekk | ack | 18:39 |
abhishekk | will keep an eye | 18:39 |
fungi | abhishekk: 826731 is in the gate now | 18:40 |
abhishekk | I do see couple of patches in gate list | 18:40 |
abhishekk | yeah | 18:40 |
abhishekk | it's sorted now | 18:40 |
abhishekk | thank you all | 18:40 |
*** rlandy|ruck is now known as rlandy|ruck|mtg | 19:00 | |
*** rlandy|ruck|mtg is now known as rlandy|ruck | 20:14 | |
*** rlandy|ruck is now known as rlandy|ruck|mtg | 20:43 | |
*** rlandy|ruck|mtg is now known as rlandy|ruck | 21:04 | |
*** amoralej is now known as amoralej|off | 21:10 | |
*** dviroel is now known as dviroel|out | 21:26 | |
*** prometheanfire is now known as Guest2 | 22:59 | |
*** Guest2 is now known as prometheanfire | 23:05 | |
*** diablo_rojo_phone is now known as Guest7 | 23:36 | |
*** rlandy|ruck is now known as rlandy|out | 23:56 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!