| *** betherly has joined #openstack-release | 00:00 | |
| *** stevebaker has quit IRC | 00:01 | |
| *** bobh has joined #openstack-release | 00:02 | |
| *** melwitt has joined #openstack-release | 00:02 | |
| *** melwitt is now known as Guest85869 | 00:03 | |
| *** sree has joined #openstack-release | 00:04 | |
| *** mwhahaha has joined #openstack-release | 00:05 | |
| *** bobh_ has joined #openstack-release | 00:07 | |
| *** bobh has quit IRC | 00:07 | |
| *** spzala has joined #openstack-release | 00:10 | |
| *** sree has quit IRC | 00:11 | |
| *** bobh_ has quit IRC | 00:12 | |
| openstackgerrit | Matt Riedemann proposed openstack/releases master: nova: release pike 16.0.4 https://review.openstack.org/527275 | 00:14 |
|---|---|---|
| *** spzala has quit IRC | 00:14 | |
| *** bobh has joined #openstack-release | 00:16 | |
| *** bobh has quit IRC | 00:21 | |
| *** spzala has joined #openstack-release | 00:23 | |
| *** iyamahat has quit IRC | 00:23 | |
| *** Guest85869 is now known as melwitt | 00:26 | |
| *** sree has joined #openstack-release | 00:28 | |
| *** spzala has quit IRC | 00:28 | |
| *** sree has quit IRC | 00:32 | |
| *** spzala has joined #openstack-release | 00:34 | |
| *** spzala has quit IRC | 00:38 | |
| *** diablo_rojo has quit IRC | 00:39 | |
| *** bobh has joined #openstack-release | 00:41 | |
| *** spzala has joined #openstack-release | 00:42 | |
| *** sdague has quit IRC | 00:42 | |
| *** stevebaker has joined #openstack-release | 00:43 | |
| *** bobh has quit IRC | 00:46 | |
| *** spzala has quit IRC | 00:46 | |
| *** stevebaker has quit IRC | 00:56 | |
| *** spzala has joined #openstack-release | 00:57 | |
| *** spzala has quit IRC | 01:02 | |
| *** spzala has joined #openstack-release | 01:05 | |
| *** spzala has quit IRC | 01:09 | |
| *** yamahata has joined #openstack-release | 01:09 | |
| *** spzala has joined #openstack-release | 01:10 | |
| *** kumarmn has joined #openstack-release | 01:11 | |
| *** bobh has joined #openstack-release | 01:15 | |
| *** spzala has quit IRC | 01:20 | |
| *** bobh has quit IRC | 01:20 | |
| *** yamahata has quit IRC | 01:21 | |
| *** spzala has joined #openstack-release | 01:23 | |
| *** spzala has quit IRC | 01:28 | |
| *** spzala has joined #openstack-release | 01:30 | |
| *** spzala has quit IRC | 01:35 | |
| *** spzala has joined #openstack-release | 01:38 | |
| *** bobh has joined #openstack-release | 01:39 | |
| *** stevebaker has joined #openstack-release | 01:39 | |
| *** yamamoto has joined #openstack-release | 01:41 | |
| *** spzala has quit IRC | 01:42 | |
| *** bobh has quit IRC | 01:43 | |
| *** stevebaker has quit IRC | 01:44 | |
| *** spzala has joined #openstack-release | 01:45 | |
| *** spzala has quit IRC | 01:50 | |
| *** spzala has joined #openstack-release | 01:52 | |
| *** stevebaker has joined #openstack-release | 01:53 | |
| *** kumarmn has quit IRC | 01:56 | |
| *** spzala has quit IRC | 01:56 | |
| *** bobh has joined #openstack-release | 01:57 | |
| *** jhesketh has quit IRC | 01:59 | |
| *** bobh has quit IRC | 02:01 | |
| *** spzala has joined #openstack-release | 02:04 | |
| *** spzala has quit IRC | 02:09 | |
| *** bobh has joined #openstack-release | 02:09 | |
| *** stevebaker has quit IRC | 02:10 | |
| *** bobh has quit IRC | 02:13 | |
| *** stevebaker has joined #openstack-release | 02:14 | |
| *** mriedem has quit IRC | 02:15 | |
| *** ekcs has quit IRC | 02:16 | |
| *** bobh has joined #openstack-release | 02:17 | |
| *** spzala has joined #openstack-release | 02:18 | |
| *** bobh has quit IRC | 02:21 | |
| *** stevebaker has quit IRC | 02:21 | |
| *** zhurong has joined #openstack-release | 02:21 | |
| *** spzala has quit IRC | 02:22 | |
| *** bobh has joined #openstack-release | 02:27 | |
| *** spzala has joined #openstack-release | 02:31 | |
| *** stevebaker has joined #openstack-release | 02:33 | |
| *** stevebaker has quit IRC | 02:33 | |
| *** bobh has quit IRC | 02:33 | |
| *** stevebaker has joined #openstack-release | 02:33 | |
| openstackgerrit | ChangBo Guo(gcb) proposed openstack/releases master: Add oslo releases for queens Dec 11, 2017 https://review.openstack.org/527107 | 02:37 |
| *** stevebaker has quit IRC | 02:38 | |
| *** bobh has joined #openstack-release | 02:38 | |
| *** stevebaker has joined #openstack-release | 02:39 | |
| *** bobh has quit IRC | 02:42 | |
| *** stevebaker has quit IRC | 02:43 | |
| openstackgerrit | Feilong Wang proposed openstack/releases master: Release Zaqar Queens-2 https://review.openstack.org/527290 | 03:05 |
| *** bobh has joined #openstack-release | 03:06 | |
| openstackgerrit | Feilong Wang proposed openstack/releases master: Release Zaqar-UI Queens-2 https://review.openstack.org/527291 | 03:08 |
| *** ianychoi has joined #openstack-release | 03:08 | |
| *** bobh has quit IRC | 03:10 | |
| *** kumarmn has joined #openstack-release | 03:13 | |
| *** bobh has joined #openstack-release | 03:19 | |
| *** bobh has quit IRC | 03:23 | |
| *** kumarmn has quit IRC | 03:24 | |
| *** kumarmn has joined #openstack-release | 03:24 | |
| *** kumarmn has quit IRC | 03:29 | |
| *** kumarmn has joined #openstack-release | 03:29 | |
| *** ricolin_ has joined #openstack-release | 03:43 | |
| *** zhurong has quit IRC | 03:47 | |
| *** bobh has joined #openstack-release | 03:48 | |
| *** armax has quit IRC | 03:53 | |
| *** ykarel has joined #openstack-release | 03:53 | |
| *** kumarmn has quit IRC | 03:53 | |
| *** edmondsw has joined #openstack-release | 03:53 | |
| *** armax has joined #openstack-release | 03:53 | |
| *** armax has quit IRC | 03:54 | |
| *** bobh has quit IRC | 03:54 | |
| *** udesale has joined #openstack-release | 04:00 | |
| *** bobh has joined #openstack-release | 04:02 | |
| *** edmondsw has quit IRC | 04:02 | |
| *** bobh has quit IRC | 04:06 | |
| *** bobh has joined #openstack-release | 04:09 | |
| *** bobh has quit IRC | 04:14 | |
| *** bobh has joined #openstack-release | 04:19 | |
| *** kumarmn has joined #openstack-release | 04:20 | |
| *** kumarmn has quit IRC | 04:23 | |
| *** bobh has quit IRC | 04:24 | |
| *** coolsvap has joined #openstack-release | 04:29 | |
| *** bobh has joined #openstack-release | 04:37 | |
| *** bobh has quit IRC | 04:41 | |
| *** bobh has joined #openstack-release | 04:59 | |
| *** bobh has quit IRC | 05:04 | |
| *** spzala has quit IRC | 05:09 | |
| *** spzala has joined #openstack-release | 05:11 | |
| *** spzala has quit IRC | 05:16 | |
| *** bobh has joined #openstack-release | 05:17 | |
| *** edmondsw has joined #openstack-release | 05:18 | |
| *** bobh has quit IRC | 05:22 | |
| *** edmondsw has quit IRC | 05:23 | |
| *** spzala has joined #openstack-release | 05:24 | |
| *** iyamahat has joined #openstack-release | 05:25 | |
| *** iyamahat has quit IRC | 05:26 | |
| *** bobh has joined #openstack-release | 05:26 | |
| *** spzala has quit IRC | 05:29 | |
| *** spzala has joined #openstack-release | 05:30 | |
| *** bobh has quit IRC | 05:32 | |
| *** spzala has quit IRC | 05:34 | |
| *** robcresswell has quit IRC | 05:39 | |
| *** fungi has quit IRC | 05:45 | |
| *** fungi has joined #openstack-release | 05:47 | |
| *** yamahata has joined #openstack-release | 05:56 | |
| *** ykarel has quit IRC | 06:03 | |
| *** ykarel has joined #openstack-release | 06:03 | |
| *** bobh has joined #openstack-release | 06:05 | |
| *** spzala has joined #openstack-release | 06:10 | |
| *** zhurong has joined #openstack-release | 06:11 | |
| *** bobh has quit IRC | 06:11 | |
| *** ykarel_ has joined #openstack-release | 06:12 | |
| *** spzala has quit IRC | 06:14 | |
| *** ykarel has quit IRC | 06:15 | |
| *** bobh has joined #openstack-release | 06:16 | |
| *** bobh has quit IRC | 06:22 | |
| *** kumarmn has joined #openstack-release | 06:24 | |
| *** kumarmn has quit IRC | 06:28 | |
| *** dtantsur|afk is now known as dtantsur | 06:52 | |
| *** udesale__ has joined #openstack-release | 07:03 | |
| *** udesale__ has quit IRC | 07:04 | |
| *** udesale__ has joined #openstack-release | 07:04 | |
| *** udesale has quit IRC | 07:04 | |
| *** bobh has joined #openstack-release | 07:06 | |
| *** edmondsw has joined #openstack-release | 07:07 | |
| *** bobh has quit IRC | 07:11 | |
| *** edmondsw has quit IRC | 07:12 | |
| *** bobh has joined #openstack-release | 07:30 | |
| *** bobh has quit IRC | 07:34 | |
| *** robcresswell has joined #openstack-release | 07:39 | |
| *** bobh has joined #openstack-release | 07:41 | |
| *** bobh has quit IRC | 07:47 | |
| *** d0ugal has quit IRC | 07:51 | |
| *** sree has joined #openstack-release | 07:51 | |
| *** d0ugal has joined #openstack-release | 07:58 | |
| *** bobh has joined #openstack-release | 08:02 | |
| *** bobh has quit IRC | 08:06 | |
| *** ykarel_ has quit IRC | 08:13 | |
| *** ykarel_ has joined #openstack-release | 08:14 | |
| *** bobh has joined #openstack-release | 08:27 | |
| *** bobh has quit IRC | 08:32 | |
| *** bobh has joined #openstack-release | 08:39 | |
| *** amoralej|off is now known as amoralej | 08:41 | |
| *** ykarel_ is now known as ykarel|away | 08:42 | |
| *** bobh has quit IRC | 08:44 | |
| *** ykarel|away has quit IRC | 08:47 | |
| -openstackstatus- NOTICE: Our CI system Zuul is currently not accessible. Wait with approving changes and rechecks until it's back online. Currently waiting for an admin to investigate. | 08:48 | |
| *** bobh has joined #openstack-release | 08:49 | |
| *** ykarel has joined #openstack-release | 08:50 | |
| *** linkmark has joined #openstack-release | 08:51 | |
| *** bobh has quit IRC | 08:53 | |
| *** edmondsw has joined #openstack-release | 08:56 | |
| *** edmondsw has quit IRC | 09:00 | |
| -openstackstatus- NOTICE: Zuul is back online, looks like a temporary network problem. | 09:09 | |
| *** bobh has joined #openstack-release | 09:10 | |
| *** shardy has joined #openstack-release | 09:12 | |
| *** jpich has joined #openstack-release | 09:13 | |
| *** bobh has quit IRC | 09:15 | |
| *** strigazi_ is now known as strigazi | 09:17 | |
| openstackgerrit | Witold Bedyk proposed openstack/releases master: Release monasca-grafana-datasource 1.2.1 https://review.openstack.org/527167 | 09:22 |
| *** bobh has joined #openstack-release | 09:23 | |
| *** bobh has quit IRC | 09:27 | |
| *** bobh has joined #openstack-release | 09:32 | |
| *** lucas-afk is now known as lucasagomes | 09:35 | |
| *** bobh has quit IRC | 09:37 | |
| *** pbandark has joined #openstack-release | 09:45 | |
| *** bobh has joined #openstack-release | 09:48 | |
| *** bobh has quit IRC | 09:53 | |
| *** zhurong has quit IRC | 09:57 | |
| *** jhesketh has joined #openstack-release | 10:04 | |
| *** spzala has joined #openstack-release | 10:11 | |
| *** bobh has joined #openstack-release | 10:11 | |
| *** ykarel_ has joined #openstack-release | 10:12 | |
| *** spzala has quit IRC | 10:15 | |
| *** ykarel has quit IRC | 10:16 | |
| *** bobh has quit IRC | 10:17 | |
| *** bobh has joined #openstack-release | 10:22 | |
| *** zhurong has joined #openstack-release | 10:26 | |
| *** ykarel__ has joined #openstack-release | 10:26 | |
| *** bobh has quit IRC | 10:27 | |
| *** bobh has joined #openstack-release | 10:29 | |
| *** ykarel_ has quit IRC | 10:30 | |
| *** bobh has quit IRC | 10:34 | |
| *** yamamoto has quit IRC | 10:35 | |
| *** alexchadin has joined #openstack-release | 10:36 | |
| *** bobh has joined #openstack-release | 10:39 | |
| *** alexchadin has quit IRC | 10:39 | |
| *** sree has quit IRC | 10:39 | |
| *** alexchadin has joined #openstack-release | 10:39 | |
| *** sdague has joined #openstack-release | 10:39 | |
| *** alexchadin has quit IRC | 10:40 | |
| *** alexchadin has joined #openstack-release | 10:40 | |
| *** alexchadin has quit IRC | 10:42 | |
| *** alexchadin has joined #openstack-release | 10:43 | |
| *** bobh has quit IRC | 10:44 | |
| *** yamamoto has joined #openstack-release | 10:48 | |
| *** bobh has joined #openstack-release | 10:57 | |
| *** bobh has quit IRC | 11:01 | |
| *** stephenfin_ is now known as stephenfin | 11:05 | |
| *** bobh has joined #openstack-release | 11:12 | |
| *** bobh has quit IRC | 11:16 | |
| *** bobh has joined #openstack-release | 11:17 | |
| *** bobh has quit IRC | 11:21 | |
| *** zhurong has quit IRC | 11:25 | |
| *** alexchadin has quit IRC | 11:28 | |
| *** alexchadin has joined #openstack-release | 11:28 | |
| *** ricolin_ has quit IRC | 11:31 | |
| *** wolverineav has joined #openstack-release | 11:35 | |
| *** bobh has joined #openstack-release | 11:37 | |
| *** ykarel__ is now known as ykarel | 11:38 | |
| *** bobh has quit IRC | 11:42 | |
| *** bobh has joined #openstack-release | 11:46 | |
| *** bobh has quit IRC | 11:51 | |
| *** yamamoto has quit IRC | 11:54 | |
| *** yamamoto has joined #openstack-release | 11:58 | |
| *** bobh has joined #openstack-release | 11:58 | |
| *** pkovar has joined #openstack-release | 11:59 | |
| *** bobh has quit IRC | 12:03 | |
| *** yamamoto has quit IRC | 12:03 | |
| *** bobh has joined #openstack-release | 12:06 | |
| *** lucasagomes is now known as lucas-hungry | 12:11 | |
| *** bobh has quit IRC | 12:11 | |
| *** bobh has joined #openstack-release | 12:13 | |
| *** bobh has quit IRC | 12:17 | |
| *** bobh has joined #openstack-release | 12:19 | |
| *** spzala has joined #openstack-release | 12:19 | |
| *** bobh has quit IRC | 12:23 | |
| *** spzala has quit IRC | 12:25 | |
| *** bobh has joined #openstack-release | 12:25 | |
| *** bobh has quit IRC | 12:30 | |
| *** yamamoto has joined #openstack-release | 12:35 | |
| *** bobh has joined #openstack-release | 12:37 | |
| *** pkovar has quit IRC | 12:39 | |
| *** bobh has quit IRC | 12:41 | |
| *** alexchadin has quit IRC | 12:56 | |
| *** alexchadin has joined #openstack-release | 12:57 | |
| *** bobh has joined #openstack-release | 12:57 | |
| *** zhurong has joined #openstack-release | 12:59 | |
| *** bobh has quit IRC | 13:02 | |
| *** rosmaita has joined #openstack-release | 13:04 | |
| *** zhurong has quit IRC | 13:14 | |
| *** edmondsw has joined #openstack-release | 13:16 | |
| *** lucas-hungry is now known as lucasagomes | 13:17 | |
| *** ricolin_ has joined #openstack-release | 13:17 | |
| *** bobh has joined #openstack-release | 13:17 | |
| *** pkovar has joined #openstack-release | 13:19 | |
| *** bobh has quit IRC | 13:22 | |
| *** amoralej is now known as amoralej|lunch | 13:23 | |
| *** kumarmn has joined #openstack-release | 13:25 | |
| *** alexchadin has quit IRC | 13:25 | |
| *** kumarmn has quit IRC | 13:29 | |
| *** alexchadin has joined #openstack-release | 13:39 | |
| openstackgerrit | Merged openstack/releases master: Add oslo releases for queens Dec 11, 2017 https://review.openstack.org/527107 | 13:40 |
| *** dave-mccowan has joined #openstack-release | 13:45 | |
| *** dave-mccowan has quit IRC | 13:48 | |
| *** coolsvap has quit IRC | 13:49 | |
| *** bobh has joined #openstack-release | 13:52 | |
| *** dave-mccowan has joined #openstack-release | 13:56 | |
| *** spzala has joined #openstack-release | 13:57 | |
| *** bobh has quit IRC | 13:57 | |
| *** dave-mccowan has quit IRC | 14:00 | |
| *** bobh has joined #openstack-release | 14:01 | |
| *** spzala has quit IRC | 14:01 | |
| *** spzala has joined #openstack-release | 14:02 | |
| *** mriedem has joined #openstack-release | 14:03 | |
| *** amoralej|lunch is now known as amoralej | 14:04 | |
| *** bobh has quit IRC | 14:05 | |
| dhellmann | smcginnis , ttx, dims : are we still processing q-2 tags? I see zaqar has theirs up | 14:05 |
| *** spzala has quit IRC | 14:06 | |
| ttx | dhellmann: I don't know if we made the call on that | 14:07 |
| *** sree has joined #openstack-release | 14:07 | |
| dhellmann | I thought we might be, since we were traveling last week | 14:07 |
| dhellmann | the patches look good so I +2 but didn't +W for now | 14:08 |
| *** toabctl has quit IRC | 14:10 | |
| *** toabctl has joined #openstack-release | 14:11 | |
| *** sree has quit IRC | 14:12 | |
| ttx | I'm good either way. i think the benefit from tagging the milestones is now limited (not much beyond reminding PTLs that there is a schedule) | 14:13 |
| *** sree has joined #openstack-release | 14:15 | |
| *** bobh has joined #openstack-release | 14:20 | |
| *** ykarel is now known as ykarel|afk | 14:23 | |
| *** yamamoto has quit IRC | 14:24 | |
| *** yamamoto has joined #openstack-release | 14:24 | |
| *** bobh has quit IRC | 14:25 | |
| *** v12aml has quit IRC | 14:25 | |
| *** v12aml has joined #openstack-release | 14:26 | |
| *** ykarel|afk has quit IRC | 14:28 | |
| *** bobh has joined #openstack-release | 14:33 | |
| *** bobh has quit IRC | 14:37 | |
| -openstackstatus- NOTICE: We're currently seeing an elevated rate of timeouts in jobs and the zuulv3.openstack.org dashboard is intermittently unresponsive, please stand by while we troubleshoot the issues. | 14:39 | |
| *** sree_ has joined #openstack-release | 14:40 | |
| *** sree_ is now known as Guest17406 | 14:40 | |
| fungi | dhellmann: ttx: smcginnis: dims: you probably want to pause approving any more releases. we're going to try to wait for the current release pipeline contents to clear but then we probably need to restart the zuul scheduler to free up some memory | 14:41 |
| *** alexchadin has quit IRC | 14:41 | |
| smcginnis | fungi: Ack, staying away from reviews until I hear otherwise. | 14:41 |
| smcginnis | ttx, dhellmann: Yeah, I did a few yesterday. I was going to give a little extra time. | 14:42 |
| smcginnis | I think I was mostly able to keep up last week, but I didn't see a need to do a hard cut off if there were a few stragglers. | 14:42 |
| *** sree has quit IRC | 14:43 | |
| *** kumarmn has joined #openstack-release | 14:43 | |
| *** spzala has joined #openstack-release | 14:47 | |
| *** bobh has joined #openstack-release | 14:56 | |
| *** mriedem has quit IRC | 14:58 | |
| *** jtomasek has joined #openstack-release | 14:59 | |
| *** bobh has quit IRC | 15:01 | |
| *** mriedem has joined #openstack-release | 15:09 | |
| *** dave-mccowan has joined #openstack-release | 15:09 | |
| *** bobh has joined #openstack-release | 15:27 | |
| dhellmann | we usually do cut things off because it's supposed to be a time-based event, but I'm OK with being lenient since we were less available than usual for a milestone deadline | 15:30 |
| * smcginnis has a feeling we are not going to like what we see when I run list of missed projects | 15:31 | |
| *** bobh has quit IRC | 15:32 | |
| *** bobh has joined #openstack-release | 15:35 | |
| dhellmann | smcginnis : designate, murano, trove, and zaqar (proposed) | 15:36 |
| smcginnis | Oh, not bad. | 15:38 |
| smcginnis | mugsie: Do we have a delayed Q-2 for designate? Or is it being skipped for some reason? | 15:39 |
| *** bobh has quit IRC | 15:41 | |
| *** bobh has joined #openstack-release | 15:47 | |
| *** Guest17406 has quit IRC | 15:47 | |
| *** sree has joined #openstack-release | 15:48 | |
| *** bobh has quit IRC | 15:51 | |
| *** sree has quit IRC | 15:53 | |
| *** bobh has joined #openstack-release | 15:56 | |
| *** diablo_rojo has joined #openstack-release | 15:57 | |
| *** yamahata has quit IRC | 15:58 | |
| dhellmann | I notice some release announcement and release note build failures in that oslo batch. fungi, could those have been related to the memory issue somehow? | 16:00 |
| *** sree has joined #openstack-release | 16:00 | |
| fungi | dhellmann: it's possible. i'll look into them once we have the last running release job wrapped up and can restart the scheduler | 16:00 |
| *** bobh has quit IRC | 16:00 | |
| *** bobh has joined #openstack-release | 16:01 | |
| dhellmann | fungi : ack, thanks | 16:02 |
| *** dave-mccowan has quit IRC | 16:02 | |
| mugsie | smcginnis: I was waiting for a change to land, then ended up out of the office, and completely forgot -_- | 16:04 |
| mugsie | sorry - I can do one now, if that is OK ? | 16:05 |
| *** sree has quit IRC | 16:16 | |
| smcginnis | mugsie: Yeah, we're being a little flexible since most of us were not around much last week. Let's get one through quick while we can. | 16:17 |
| mugsie | smcginnis: ack. thanks | 16:17 |
| openstackgerrit | Graham Hayes proposed openstack/releases master: Release Designate 6.0.0.0b2 https://review.openstack.org/527452 | 16:22 |
| *** jtomasek has quit IRC | 16:23 | |
| *** jtomasek has joined #openstack-release | 16:23 | |
| openstackgerrit | Graham Hayes proposed openstack/releases master: Release Designate Dashboard 6.0.0.0b2 https://review.openstack.org/527453 | 16:24 |
| *** armax has joined #openstack-release | 16:26 | |
| *** dtantsur is now known as dtantsur|afk | 16:28 | |
| *** sree has joined #openstack-release | 16:31 | |
| *** sree has quit IRC | 16:36 | |
| *** dave-mccowan has joined #openstack-release | 16:49 | |
| *** dave-mccowan has quit IRC | 17:05 | |
| *** edmondsw has quit IRC | 17:06 | |
| *** lucasagomes is now known as lucas-afk | 17:07 | |
| *** jtomasek has quit IRC | 17:20 | |
| *** dave-mccowan has joined #openstack-release | 17:38 | |
| *** jpich has quit IRC | 17:53 | |
| *** edmondsw has joined #openstack-release | 17:56 | |
| *** shardy has quit IRC | 18:01 | |
| *** edmondsw has quit IRC | 18:04 | |
| *** udesale__ has quit IRC | 18:17 | |
| *** yamahata has joined #openstack-release | 18:18 | |
| *** electrofelix has quit IRC | 18:20 | |
| *** ricolin_ has quit IRC | 18:21 | |
| *** sree has joined #openstack-release | 18:27 | |
| *** sree has quit IRC | 18:32 | |
| *** ekcs has joined #openstack-release | 18:36 | |
| *** yamahata has quit IRC | 18:43 | |
| *** yamahata has joined #openstack-release | 18:45 | |
| *** sree has joined #openstack-release | 18:48 | |
| *** yamahata has quit IRC | 18:51 | |
| *** sree has quit IRC | 18:52 | |
| *** wolverineav has quit IRC | 18:57 | |
| *** wolverineav has joined #openstack-release | 18:57 | |
| *** edmondsw has joined #openstack-release | 18:59 | |
| *** pkovar has quit IRC | 19:02 | |
| *** sree has joined #openstack-release | 19:07 | |
| *** sree has quit IRC | 19:11 | |
| *** sree has joined #openstack-release | 19:27 | |
| *** sree has quit IRC | 19:31 | |
| *** BryanS68 has joined #openstack-release | 19:45 | |
| *** tonyb_ has quit IRC | 19:52 | |
| *** tonyb has joined #openstack-release | 19:52 | |
| *** dave-mccowan has quit IRC | 19:56 | |
| *** sree has joined #openstack-release | 20:07 | |
| *** wolverineav has quit IRC | 20:10 | |
| *** sree has quit IRC | 20:11 | |
| *** wolverineav has joined #openstack-release | 20:11 | |
| fungi | dhellmann: ttx: smcginnis: dims: the zuul scheduler restart is out of the way now, so feel free to approve more releases. i'm going to start looking through the failures to see if we need any reenqueued | 20:15 |
| -openstackstatus- NOTICE: The zuul scheduler has been restarted after lengthy troubleshooting for a memory consumption issue; earlier changes have been reenqueued but if you notice jobs not running for a new or approved change you may want to leave a recheck comment or a new approval vote | 20:16 | |
| smcginnis | fungi: Thanks. Of the failure emails I saw this morning, all were on acceptable things like release_notes or the announcement email. | 20:30 |
| *** bobh_ has joined #openstack-release | 20:32 | |
| *** openstackgerrit has quit IRC | 20:34 | |
| *** notmyname has quit IRC | 20:34 | |
| *** bswartz has quit IRC | 20:34 | |
| *** bobh has quit IRC | 20:35 | |
| *** masayukig has quit IRC | 20:35 | |
| *** amrith has quit IRC | 20:35 | |
| fungi | ahh, okay | 20:35 |
| fungi | for the record, the zuul scheduler being under extreme memory pressure was resulting in batching cycles with big delays in between, so it kept slamming the executors with a thundering herd of new builds which spiked memory/load on them in turn and resulted in them taking a really long time to register results from playbooks, leading to timeouts, retry limits and post failures | 20:37 |
| fungi | so that likely explains the failures we saw for release jobs | 20:38 |
| *** masayukig has joined #openstack-release | 20:40 | |
| *** bswartz has joined #openstack-release | 20:41 | |
| *** notmyname has joined #openstack-release | 20:41 | |
| *** amrith has joined #openstack-release | 20:43 | |
| *** rakhmerov has quit IRC | 20:45 | |
| *** kmalloc has quit IRC | 20:45 | |
| *** clarkb has quit IRC | 20:45 | |
| *** andymccr has quit IRC | 20:45 | |
| *** clarkb has joined #openstack-release | 20:45 | |
| *** andymccr has joined #openstack-release | 20:45 | |
| *** rakhmerov has joined #openstack-release | 20:45 | |
| *** kmalloc has joined #openstack-release | 20:45 | |
| dhellmann | makes sense | 20:46 |
| *** amoralej is now known as amoralej|off | 20:54 | |
| fungi | yeah, we have a governor in the executors to prevent taking on new builds if the load average exceeds a configured threshold, vut that doesn't help in spiking situations like this because by the time it measures load it's already at 2-3x the threshold | 20:54 |
| fungi | works rather well if the builds trickle in somewhat evenly (like when the scheduler isn't having trouble) | 20:55 |
| *** dave-mccowan has joined #openstack-release | 20:55 | |
| fungi | was designed for the usual case where we just have more ci volume than we have capacity, so it defers starting new builds until load average on at least one executor falls low enough to pick it up | 20:56 |
| fungi | and to make sure that executors with lower load pick up new builds instead of having them land on already loaded executors | 20:57 |
| *** dave-mcc_ has joined #openstack-release | 20:59 | |
| *** dave-mccowan has quit IRC | 20:59 | |
| *** kumarmn has quit IRC | 21:01 | |
| *** sree has joined #openstack-release | 21:07 | |
| *** wolverineav has quit IRC | 21:09 | |
| *** wolverineav has joined #openstack-release | 21:11 | |
| *** sree has quit IRC | 21:11 | |
| *** bobh_ has quit IRC | 21:13 | |
| *** bobh has joined #openstack-release | 21:17 | |
| *** linkmark has quit IRC | 21:20 | |
| *** bobh has quit IRC | 21:22 | |
| *** sree has joined #openstack-release | 21:27 | |
| *** bobh has joined #openstack-release | 21:28 | |
| *** sree has quit IRC | 21:32 | |
| *** bobh has quit IRC | 21:32 | |
| *** bobh has joined #openstack-release | 21:38 | |
| *** bobh has quit IRC | 21:43 | |
| *** sree has joined #openstack-release | 21:47 | |
| *** bobh has joined #openstack-release | 21:49 | |
| *** sree has quit IRC | 21:51 | |
| *** bobh has quit IRC | 21:54 | |
| *** bobh has joined #openstack-release | 22:01 | |
| *** bobh has quit IRC | 22:07 | |
| *** sree has joined #openstack-release | 22:07 | |
| *** bobh has joined #openstack-release | 22:08 | |
| *** wolverineav has quit IRC | 22:09 | |
| *** sree has quit IRC | 22:12 | |
| *** bobh has quit IRC | 22:12 | |
| *** bobh has joined #openstack-release | 22:19 | |
| *** bobh has quit IRC | 22:24 | |
| *** sree has joined #openstack-release | 22:27 | |
| *** bobh has joined #openstack-release | 22:27 | |
| *** sree has quit IRC | 22:31 | |
| *** bobh has quit IRC | 22:33 | |
| *** BryanS68 has quit IRC | 22:35 | |
| *** bobh has joined #openstack-release | 22:36 | |
| *** openstackgerrit has joined #openstack-release | 22:38 | |
| openstackgerrit | Matt Riedemann proposed openstack/releases master: nova: release pike 16.0.4 https://review.openstack.org/527275 | 22:38 |
| smcginnis | Hey! | 22:41 |
| smcginnis | Nova wants to be part of queens. Great. :P | 22:41 |
| *** bobh has quit IRC | 22:42 | |
| *** spzala has quit IRC | 22:48 | |
| *** spzala has joined #openstack-release | 22:48 | |
| openstackgerrit | Merged openstack/releases master: Release monasca-grafana-datasource 1.2.1 https://review.openstack.org/527167 | 22:51 |
| *** spzala has quit IRC | 22:53 | |
| *** bobh has joined #openstack-release | 22:57 | |
| *** edmondsw has quit IRC | 23:02 | |
| *** bobh has quit IRC | 23:03 | |
| *** edmondsw has joined #openstack-release | 23:05 | |
| *** edmondsw has quit IRC | 23:10 | |
| *** bobh has joined #openstack-release | 23:12 | |
| *** bobh has quit IRC | 23:16 | |
| *** bobh has joined #openstack-release | 23:21 | |
| *** bobh has quit IRC | 23:26 | |
| *** bobh has joined #openstack-release | 23:36 | |
| *** bobh has quit IRC | 23:41 | |
| *** bobh has joined #openstack-release | 23:43 | |
| *** edmondsw has joined #openstack-release | 23:44 | |
| *** bobh has quit IRC | 23:46 | |
| *** bobh has joined #openstack-release | 23:47 | |
| *** edmondsw has quit IRC | 23:48 | |
| *** bobh has quit IRC | 23:51 | |
| *** bobh has joined #openstack-release | 23:58 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!