*** clenimar_ has quit IRC | 00:00 | |
*** shashank_hegde has quit IRC | 00:01 | |
*** eezhova has quit IRC | 00:03 | |
*** [1]Thelo has joined #openstack-infra | 00:03 | |
*** ddieterly has quit IRC | 00:05 | |
*** Thelo has quit IRC | 00:05 | |
*** [1]Thelo is now known as Thelo | 00:05 | |
*** phschwartz has quit IRC | 00:10 | |
*** clenimar_ has joined #openstack-infra | 00:13 | |
*** sputnik13 has quit IRC | 00:13 | |
*** davidlenwell has quit IRC | 00:15 | |
*** karthikp_ has joined #openstack-infra | 00:16 | |
*** davidlenwell has joined #openstack-infra | 00:17 | |
*** berendt has quit IRC | 00:17 | |
*** yamamoto has joined #openstack-infra | 00:18 | |
*** asettle has joined #openstack-infra | 00:22 | |
*** karthikp_ has quit IRC | 00:26 | |
*** yamamoto has quit IRC | 00:27 | |
*** asettle has quit IRC | 00:27 | |
*** yamamoto has joined #openstack-infra | 00:27 | |
*** amitgandhinz has joined #openstack-infra | 00:27 | |
*** xarses has joined #openstack-infra | 00:28 | |
*** amitgandhinz has quit IRC | 00:31 | |
*** yamamoto has quit IRC | 00:32 | |
*** Liuqing has joined #openstack-infra | 00:33 | |
*** tonytan4ever has joined #openstack-infra | 00:35 | |
*** tonytan4ever has quit IRC | 00:41 | |
*** Sukhdev has quit IRC | 00:41 | |
*** adrian_otto has quit IRC | 00:42 | |
*** Liuqing has quit IRC | 01:02 | |
*** tonytan4ever has joined #openstack-infra | 01:05 | |
*** ddieterly has joined #openstack-infra | 01:10 | |
*** lascii is now known as alaski | 01:10 | |
*** thorst has joined #openstack-infra | 01:16 | |
*** roxanagh_ has quit IRC | 01:19 | |
*** roxanagh_ has joined #openstack-infra | 01:19 | |
*** thorst has quit IRC | 01:22 | |
*** roxanagh_ has quit IRC | 01:24 | |
*** armax has quit IRC | 01:26 | |
*** amitgandhinz has joined #openstack-infra | 01:28 | |
*** markvoelker has quit IRC | 01:28 | |
*** armax has joined #openstack-infra | 01:28 | |
*** amitgandhinz has quit IRC | 01:32 | |
*** asettle has joined #openstack-infra | 01:32 | |
*** yamamoto has joined #openstack-infra | 01:32 | |
*** asettle has quit IRC | 01:37 | |
*** yamamoto has quit IRC | 01:38 | |
*** gouthamr has joined #openstack-infra | 01:43 | |
*** jianghuaw has joined #openstack-infra | 01:51 | |
openstackgerrit | Christopher Aedo proposed openstack-infra/infra-specs: Add spec for hosted IRC client https://review.openstack.org/319506 | 01:51 |
---|---|---|
*** tphummel has quit IRC | 01:52 | |
*** piet has joined #openstack-infra | 01:56 | |
*** kzaitsev_mb has quit IRC | 01:57 | |
*** roxanagh_ has joined #openstack-infra | 02:00 | |
*** EricGonczer_ has joined #openstack-infra | 02:01 | |
*** julim has joined #openstack-infra | 02:02 | |
*** yamamoto has joined #openstack-infra | 02:02 | |
*** claudiub has quit IRC | 02:05 | |
*** gouthamr has quit IRC | 02:10 | |
*** piet has quit IRC | 02:15 | |
*** ddieterly has quit IRC | 02:19 | |
*** roxanagh_ has quit IRC | 02:20 | |
*** ddieterly has joined #openstack-infra | 02:21 | |
*** ddieterly has quit IRC | 02:23 | |
*** ramishra has quit IRC | 02:24 | |
*** ramishra has joined #openstack-infra | 02:26 | |
*** EricGonczer_ has quit IRC | 02:27 | |
*** amitgandhinz has joined #openstack-infra | 02:28 | |
*** tonytan4ever has quit IRC | 02:32 | |
*** amitgandhinz has quit IRC | 02:34 | |
*** yamamoto has quit IRC | 02:35 | |
*** ddieterly has joined #openstack-infra | 02:36 | |
*** tonytan4ever has joined #openstack-infra | 02:36 | |
*** karthikp_ has joined #openstack-infra | 02:36 | |
*** ddieterly has quit IRC | 02:37 | |
*** ddieterly has joined #openstack-infra | 02:37 | |
*** thorst has joined #openstack-infra | 02:41 | |
*** thorst has quit IRC | 02:42 | |
*** thorst has joined #openstack-infra | 02:42 | |
*** yamamoto has joined #openstack-infra | 02:43 | |
*** tkelsey has joined #openstack-infra | 02:43 | |
*** thorst has quit IRC | 02:47 | |
*** gouthamr has joined #openstack-infra | 02:47 | |
*** tkelsey has quit IRC | 02:48 | |
*** yamahata has quit IRC | 02:54 | |
*** julim has quit IRC | 03:03 | |
*** SumitNaiksatam_ has joined #openstack-infra | 03:09 | |
*** SumitNaiksatam has quit IRC | 03:09 | |
*** SumitNaiksatam_ is now known as SumitNaiksatam | 03:09 | |
*** asettle has joined #openstack-infra | 03:12 | |
*** ddieterly has quit IRC | 03:13 | |
*** ddieterly has joined #openstack-infra | 03:14 | |
*** kzaitsev_mb has joined #openstack-infra | 03:14 | |
*** roxanagh_ has joined #openstack-infra | 03:15 | |
*** asettle has quit IRC | 03:16 | |
*** ddieterly has quit IRC | 03:19 | |
*** roxanagh_ has quit IRC | 03:26 | |
*** cody-somerville has quit IRC | 03:26 | |
*** treaki_ has joined #openstack-infra | 03:26 | |
*** EricGonczer_ has joined #openstack-infra | 03:28 | |
*** adrian_otto has joined #openstack-infra | 03:29 | |
*** EricGonczer_ has quit IRC | 03:29 | |
*** treaki__ has quit IRC | 03:30 | |
*** amitgandhinz has joined #openstack-infra | 03:30 | |
*** piet has joined #openstack-infra | 03:31 | |
openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack-infra/project-config: Update REVIEWING.rst for check-requirements job https://review.openstack.org/343134 | 03:31 |
openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack-infra/project-config: Update REVIEWING.rst for check-requirements job https://review.openstack.org/343134 | 03:34 |
*** adrian_otto has quit IRC | 03:35 | |
*** amitgandhinz has quit IRC | 03:35 | |
Nakato | AJaeger: \o/ Thanks for testing that! | 03:36 |
*** markvoelker has joined #openstack-infra | 03:37 | |
dmsimard | Any particular problems going on ? It seems like some jobs have been queued for longer than they should.. | 03:37 |
*** yamamoto has quit IRC | 03:41 | |
*** nixpenguin has joined #openstack-infra | 03:46 | |
*** acoles_ has quit IRC | 03:49 | |
*** hieulq has joined #openstack-infra | 03:59 | |
*** coolsvap has quit IRC | 03:59 | |
*** jamespage has quit IRC | 04:01 | |
*** gnuoy has quit IRC | 04:01 | |
*** gnuoy` has joined #openstack-infra | 04:01 | |
*** jamespag` has joined #openstack-infra | 04:01 | |
*** asettle has joined #openstack-infra | 04:02 | |
*** EricGonczer_ has joined #openstack-infra | 04:04 | |
*** hieulq has quit IRC | 04:05 | |
*** piet has quit IRC | 04:05 | |
*** karthikp_ has quit IRC | 04:06 | |
*** asettle has quit IRC | 04:07 | |
*** hparekh has quit IRC | 04:08 | |
*** EricGonczer_ has quit IRC | 04:08 | |
*** nixpenguin has quit IRC | 04:09 | |
*** hieulq has joined #openstack-infra | 04:11 | |
*** hieulq has quit IRC | 04:14 | |
dmsimard | Looks like Zuul is stuck and not launching jobs :( | 04:15 |
*** hparekh has joined #openstack-infra | 04:20 | |
*** piet has joined #openstack-infra | 04:21 | |
*** shashank_hegde has joined #openstack-infra | 04:28 | |
*** armax has quit IRC | 04:29 | |
*** amitgandhinz has joined #openstack-infra | 04:31 | |
*** amitgandhinz has quit IRC | 04:36 | |
*** markvoelker has quit IRC | 04:37 | |
*** acoles has joined #openstack-infra | 04:48 | |
*** SumitNaiksatam has quit IRC | 04:51 | |
*** nadya has joined #openstack-infra | 04:55 | |
*** sputnik13 has joined #openstack-infra | 05:01 | |
*** pcrews has quit IRC | 05:01 | |
*** shashank_hegde has quit IRC | 05:10 | |
*** gouthamr has quit IRC | 05:12 | |
*** shashank_hegde has joined #openstack-infra | 05:29 | |
*** rcernin has joined #openstack-infra | 05:31 | |
*** kzaitsev_mb has quit IRC | 05:31 | |
*** amitgandhinz has joined #openstack-infra | 05:32 | |
*** piet has quit IRC | 05:32 | |
*** psachin has joined #openstack-infra | 05:33 | |
*** kzaitsev_mb has joined #openstack-infra | 05:35 | |
*** shashank_hegde has quit IRC | 05:36 | |
*** amitgandhinz has quit IRC | 05:36 | |
*** shashank_hegde has joined #openstack-infra | 05:37 | |
*** bhavik has joined #openstack-infra | 05:42 | |
*** tkelsey has joined #openstack-infra | 05:45 | |
*** bhavik has quit IRC | 05:48 | |
*** d0ugal has joined #openstack-infra | 05:50 | |
*** tkelsey has quit IRC | 05:50 | |
*** psachin has quit IRC | 05:55 | |
openstackgerrit | Andreas Florath proposed openstack/diskimage-builder: Spec for changing the block device handling https://review.openstack.org/336946 | 06:05 |
*** d0ugal has quit IRC | 06:09 | |
*** bhavik has joined #openstack-infra | 06:12 | |
*** psachin has joined #openstack-infra | 06:25 | |
*** nadya has quit IRC | 06:27 | |
*** amitgandhinz has joined #openstack-infra | 06:33 | |
*** sputnik13 has quit IRC | 06:33 | |
*** sputnik13 has joined #openstack-infra | 06:35 | |
*** xarses has quit IRC | 06:37 | |
*** xarses has joined #openstack-infra | 06:38 | |
*** amitgandhinz has quit IRC | 06:38 | |
*** shashank_hegde has quit IRC | 06:39 | |
*** rcernin has quit IRC | 06:42 | |
*** rcernin has joined #openstack-infra | 06:42 | |
*** savihou has joined #openstack-infra | 06:48 | |
*** sputnik13 has quit IRC | 06:53 | |
*** cryptarium has quit IRC | 06:57 | |
*** sputnik13 has joined #openstack-infra | 06:57 | |
*** cryptarium has joined #openstack-infra | 06:57 | |
*** yamahata has joined #openstack-infra | 07:00 | |
*** clayton has quit IRC | 07:05 | |
*** clayton has joined #openstack-infra | 07:05 | |
*** cryptarium has quit IRC | 07:08 | |
*** cryptarium has joined #openstack-infra | 07:09 | |
*** cryptarium has quit IRC | 07:13 | |
*** cryptarium has joined #openstack-infra | 07:13 | |
*** hieulq has joined #openstack-infra | 07:16 | |
*** sputnik13 has quit IRC | 07:18 | |
*** shashank_hegde has joined #openstack-infra | 07:18 | |
*** yolanda has joined #openstack-infra | 07:19 | |
*** hieulq has quit IRC | 07:19 | |
*** gongysh has quit IRC | 07:19 | |
*** yamahata has quit IRC | 07:21 | |
*** ihrachys has joined #openstack-infra | 07:23 | |
*** ihrachys has quit IRC | 07:26 | |
*** nadya has joined #openstack-infra | 07:27 | |
*** tonytan4ever has quit IRC | 07:30 | |
*** amitgandhinz has joined #openstack-infra | 07:33 | |
*** rajinir has quit IRC | 07:35 | |
*** asettle has joined #openstack-infra | 07:35 | |
*** amitgandhinz has quit IRC | 07:38 | |
*** sputnik13 has joined #openstack-infra | 07:39 | |
*** rwsu has quit IRC | 07:40 | |
*** asettle has quit IRC | 07:40 | |
*** tkelsey has joined #openstack-infra | 07:47 | |
*** shashank_hegde has quit IRC | 07:51 | |
*** tkelsey has quit IRC | 07:52 | |
*** coolsvap_ has joined #openstack-infra | 07:52 | |
*** hieulq has joined #openstack-infra | 07:54 | |
*** cryptarium has quit IRC | 07:56 | |
*** cryptarium has joined #openstack-infra | 07:57 | |
*** cryptarium has quit IRC | 07:58 | |
*** coolsvap_ has quit IRC | 07:58 | |
*** zzzeek has quit IRC | 08:00 | |
*** zzzeek has joined #openstack-infra | 08:00 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Add userstory-dashboard repos https://review.openstack.org/343095 | 08:01 |
*** savihou has quit IRC | 08:01 | |
*** savihou has joined #openstack-infra | 08:01 | |
*** hieulq has quit IRC | 08:09 | |
*** bhavik has quit IRC | 08:11 | |
*** tkelsey has joined #openstack-infra | 08:12 | |
*** Nikolay_St has quit IRC | 08:19 | |
*** tkelsey has quit IRC | 08:19 | |
*** savihou has quit IRC | 08:21 | |
*** savihou has joined #openstack-infra | 08:21 | |
*** Jeffrey4l has joined #openstack-infra | 08:25 | |
*** claudiub has joined #openstack-infra | 08:30 | |
*** amitgandhinz has joined #openstack-infra | 08:34 | |
*** hieulq has joined #openstack-infra | 08:35 | |
*** nadya has quit IRC | 08:37 | |
*** kzaitsev_mb has quit IRC | 08:37 | |
*** Nikolay_St has joined #openstack-infra | 08:37 | |
*** nadya has joined #openstack-infra | 08:37 | |
*** amitgandhinz has quit IRC | 08:39 | |
*** nadya has quit IRC | 08:39 | |
openstackgerrit | Sascha Grunert proposed openstack-infra/git-review: Stash and unstash changes during download https://review.openstack.org/340024 | 08:40 |
*** d0ugal has joined #openstack-infra | 08:43 | |
openstackgerrit | Sascha Grunert proposed openstack-infra/git-review: Stash and unstash changes during download https://review.openstack.org/340024 | 08:45 |
*** eric_lopez has joined #openstack-infra | 08:47 | |
*** hieulq has quit IRC | 08:48 | |
*** elo has quit IRC | 08:49 | |
*** d0ugal has quit IRC | 08:53 | |
*** elo has joined #openstack-infra | 08:54 | |
*** eric_lopez has quit IRC | 08:57 | |
*** cryptarium has joined #openstack-infra | 08:57 | |
*** cryptarium has quit IRC | 08:58 | |
*** sputnik13 has quit IRC | 08:59 | |
*** cryptarium has joined #openstack-infra | 08:59 | |
*** cryptarium has quit IRC | 09:01 | |
*** nijaba has quit IRC | 09:05 | |
*** bhavik has joined #openstack-infra | 09:07 | |
*** coolsvap_ has joined #openstack-infra | 09:08 | |
*** coolsvap_ has quit IRC | 09:08 | |
*** nijaba has joined #openstack-infra | 09:12 | |
*** sshnaidm|afk has quit IRC | 09:14 | |
*** tkelsey has joined #openstack-infra | 09:21 | |
*** tdurakov has quit IRC | 09:26 | |
*** tkelsey has quit IRC | 09:26 | |
*** tdurakov has joined #openstack-infra | 09:27 | |
*** bhavik has quit IRC | 09:27 | |
*** bhavik has joined #openstack-infra | 09:28 | |
*** xgerman has quit IRC | 09:29 | |
*** xgerman has joined #openstack-infra | 09:31 | |
*** ewindisch has quit IRC | 09:32 | |
*** amitgandhinz has joined #openstack-infra | 09:35 | |
*** ewindisch has joined #openstack-infra | 09:35 | |
*** amitgandhinz has quit IRC | 09:40 | |
*** rossella_s has joined #openstack-infra | 09:41 | |
*** pcaruana has joined #openstack-infra | 09:43 | |
*** zxiiro has quit IRC | 09:43 | |
*** eric_lopez has joined #openstack-infra | 09:44 | |
*** elo has quit IRC | 09:45 | |
*** zxiiro has joined #openstack-infra | 09:45 | |
*** jpmaxman has quit IRC | 09:48 | |
*** aviau has quit IRC | 09:49 | |
*** aviau has joined #openstack-infra | 09:49 | |
*** jpmaxman has joined #openstack-infra | 09:50 | |
*** snarwade has joined #openstack-infra | 09:51 | |
*** tonytan4ever has joined #openstack-infra | 10:01 | |
*** sshnaidm|afk has joined #openstack-infra | 10:04 | |
*** tonytan4ever has quit IRC | 10:06 | |
*** Thelo has quit IRC | 10:06 | |
*** sshnaidm|afk has quit IRC | 10:08 | |
*** sshnaidm has joined #openstack-infra | 10:08 | |
*** Thelo has joined #openstack-infra | 10:08 | |
*** amitgandhinz has joined #openstack-infra | 10:36 | |
*** amitgandhinz has quit IRC | 10:40 | |
*** eezhova has joined #openstack-infra | 10:56 | |
openstackgerrit | Sascha Grunert proposed openstack-infra/git-review: Stash and unstash changes during download https://review.openstack.org/340024 | 10:59 |
*** adreznec has quit IRC | 11:04 | |
*** Nikolay_St has quit IRC | 11:05 | |
*** markvoelker has joined #openstack-infra | 11:07 | |
*** ddieterly has joined #openstack-infra | 11:07 | |
*** elo has joined #openstack-infra | 11:08 | |
*** anthonyper has quit IRC | 11:10 | |
*** eric_lopez has quit IRC | 11:10 | |
*** adreznec has joined #openstack-infra | 11:11 | |
*** anthonyper has joined #openstack-infra | 11:11 | |
*** ddieterly has quit IRC | 11:17 | |
*** acoles is now known as acoles_ | 11:19 | |
*** sputnik13 has joined #openstack-infra | 11:24 | |
*** tkelsey has joined #openstack-infra | 11:25 | |
*** ddieterly has joined #openstack-infra | 11:25 | |
*** eezhova has quit IRC | 11:25 | |
*** ddieterly has quit IRC | 11:26 | |
*** tkelsey has quit IRC | 11:29 | |
*** Goneri has joined #openstack-infra | 11:33 | |
*** sputnik13 has quit IRC | 11:34 | |
openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/project-config: networking-midonet: switch to python-db-jobs https://review.openstack.org/335551 | 11:36 |
*** amitgandhinz has joined #openstack-infra | 11:36 | |
*** dims has quit IRC | 11:37 | |
*** ddieterly has joined #openstack-infra | 11:40 | |
*** Goneri has quit IRC | 11:40 | |
*** eric_lopez has joined #openstack-infra | 11:40 | |
*** elo has quit IRC | 11:40 | |
*** asettle has joined #openstack-infra | 11:41 | |
*** amitgandhinz has quit IRC | 11:41 | |
*** yonglihe has quit IRC | 11:44 | |
*** yonglihe has joined #openstack-infra | 11:45 | |
*** asettle has quit IRC | 11:45 | |
*** markvoelker has quit IRC | 11:48 | |
*** tonytan4ever has joined #openstack-infra | 12:02 | |
odyssey4me | it appears that the zuul status isn't accurately reflecting jobs in progress - I'm getting events being processed by evidence of the review comment log, but nothing showing up in the zuul status queue on http://status.openstack.org/zuul/ | 12:04 |
*** yanyanhu has joined #openstack-infra | 12:06 | |
*** pt_15 has quit IRC | 12:06 | |
*** tonytan4ever has quit IRC | 12:06 | |
*** ddieterly has quit IRC | 12:07 | |
*** itisha has quit IRC | 12:10 | |
*** EricGonczer_ has joined #openstack-infra | 12:14 | |
*** julim has joined #openstack-infra | 12:15 | |
*** phschwartz has joined #openstack-infra | 12:17 | |
*** claudiub has quit IRC | 12:20 | |
*** yanyanhu has quit IRC | 12:22 | |
*** julim has quit IRC | 12:28 | |
*** bhavik has quit IRC | 12:31 | |
*** ddieterly has joined #openstack-infra | 12:32 | |
*** Jeffrey4l has quit IRC | 12:33 | |
*** Jeffrey4l has joined #openstack-infra | 12:33 | |
*** krtaylor has quit IRC | 12:34 | |
*** amitgandhinz has joined #openstack-infra | 12:37 | |
*** amitgandhinz has quit IRC | 12:42 | |
*** eric_lopez has quit IRC | 12:45 | |
*** thorst has joined #openstack-infra | 12:50 | |
*** eric_lopez has joined #openstack-infra | 12:51 | |
*** tonytan4ever has joined #openstack-infra | 13:03 | |
*** tonytan4ever has quit IRC | 13:08 | |
*** Srinu has quit IRC | 13:08 | |
*** ddieterly has quit IRC | 13:10 | |
*** pt_15 has joined #openstack-infra | 13:19 | |
*** elo has joined #openstack-infra | 13:23 | |
*** ddieterly has joined #openstack-infra | 13:23 | |
*** ddieterly is now known as ddieterly[away] | 13:23 | |
*** eric_lopez has quit IRC | 13:24 | |
*** ddieterly[away] is now known as ddieterly | 13:27 | |
*** kzaitsev_mb has joined #openstack-infra | 13:28 | |
*** ddieterly is now known as ddieterly[away] | 13:35 | |
*** amitgandhinz has joined #openstack-infra | 13:38 | |
*** amitgandhinz has quit IRC | 13:43 | |
*** ddieterly[away] is now known as ddieterly | 13:44 | |
*** jsavak has joined #openstack-infra | 13:46 | |
*** dims has joined #openstack-infra | 13:47 | |
*** ddieterly has quit IRC | 13:48 | |
*** jsavak has quit IRC | 13:50 | |
*** r-mibu has quit IRC | 13:54 | |
*** r-mibu has joined #openstack-infra | 13:55 | |
*** Adri2000 has quit IRC | 13:56 | |
*** Adri2000 has joined #openstack-infra | 13:57 | |
*** nixpenguin has joined #openstack-infra | 13:57 | |
*** thorst has quit IRC | 14:03 | |
*** thorst has joined #openstack-infra | 14:04 | |
*** tonytan4ever has joined #openstack-infra | 14:04 | |
*** bhavik has joined #openstack-infra | 14:04 | |
*** jsavak has joined #openstack-infra | 14:06 | |
*** ddieterly has joined #openstack-infra | 14:08 | |
*** tonytan4ever has quit IRC | 14:08 | |
*** savihou has quit IRC | 14:10 | |
*** savihou has joined #openstack-infra | 14:11 | |
*** jsavak has quit IRC | 14:11 | |
*** jsavak has joined #openstack-infra | 14:12 | |
*** thorst has quit IRC | 14:13 | |
*** tonytan4ever has joined #openstack-infra | 14:16 | |
*** adrian_otto has joined #openstack-infra | 14:17 | |
*** armax has joined #openstack-infra | 14:21 | |
fungi | apparently we missed cleaning up orphaned ready nodes. there was an ubuntu-precise node (2555672 for zl06) in a ready state for ~18 hours, satisfying the min-ready for that label. i've deleted it now so hopefully we'll build a working one and start to knock out the waiting jobs | 14:22 |
AJaeger | fungi, good morning! What about the proposal nodes? | 14:23 |
fungi | looks like proposal.slave.o.o may also not be running any jobs for at least the past 15 hours | 14:23 |
fungi | AJaeger: yep, just spotted that | 14:23 |
AJaeger | fungi, messages crossed ;) | 14:23 |
fungi | also some of the multi-node jobs are waiting a similar length of time | 14:24 |
fungi | and fedora-23 jobs | 14:24 |
fungi | i should probably read scrollback from while i was asleep and see if there is an unresolved gearman issue or something | 14:25 |
fungi | looks like clarkb and jeblair were working on something with zuul/nodepool after i dropped off for the night | 14:25 |
*** ddieterly has quit IRC | 14:26 | |
jeblair | fungi: hrm, zlstatic01 may need restarting.. maybe there's a bug with geard restarts that's usually masked by all the dynamic nodes | 14:27 |
jeblair | i'll put it on my list | 14:27 |
*** shahid_ has joined #openstack-infra | 14:30 | |
*** clenimar_ has quit IRC | 14:31 | |
AJaeger | mmh, zuul does not move jobs into the gate queue - https://review.openstack.org/#/c/325617/ was approved nearly an hour ago and has not a Jenkins message that it's moving itno gate | 14:33 |
*** clenimar_ has joined #openstack-infra | 14:34 | |
*** armax has left #openstack-infra | 14:34 | |
*** eeiden has quit IRC | 14:37 | |
*** wcriswell_ has quit IRC | 14:37 | |
*** wcriswell has joined #openstack-infra | 14:38 | |
*** pcrews has joined #openstack-infra | 14:38 | |
*** amitgandhinz has joined #openstack-infra | 14:39 | |
*** rossella_s has quit IRC | 14:40 | |
*** rossella_s has joined #openstack-infra | 14:41 | |
jeblair | hrm, i'm looking into it | 14:41 |
*** eeiden has joined #openstack-infra | 14:41 | |
*** ddieterly has joined #openstack-infra | 14:42 | |
*** admcleod_ has joined #openstack-infra | 14:42 | |
*** admcleod has quit IRC | 14:42 | |
AJaeger | thanks, jeblair | 14:43 |
*** amitgandhinz has quit IRC | 14:43 | |
jeblair | i think zuul's connection with gerrit may be stuck/dead | 14:45 |
jeblair | and it's stuck reading from it, which is why nothings happening | 14:45 |
*** adrian_otto has quit IRC | 14:46 | |
*** ddieterly has quit IRC | 14:46 | |
jeblair | er, actually... it seems like the gerrit-reading thread is stuck in the prettyprinter debug statement | 14:47 |
jeblair | that's weird. | 14:48 |
jeblair | i will restart zuul | 14:48 |
*** nixpenguin has quit IRC | 14:50 | |
*** amrith has quit IRC | 14:50 | |
openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack-infra/project-config: Update REVIEWING.rst for check-requirements job https://review.openstack.org/343134 | 14:51 |
*** amrith has joined #openstack-infra | 14:51 | |
*** coolsvap has joined #openstack-infra | 14:51 | |
jeblair | AJaeger, fungi: i restarted zuul and the launcher on zlstatic01 | 14:51 |
AJaeger | thanks, jeblair. should we inform users to reapprove changes? Some have not gone in the gate... | 14:52 |
* AJaeger reapproves that change now | 14:52 | |
*** claudiub has joined #openstack-infra | 14:54 | |
AJaeger | the change 325617 is now in the gate, took a bit... | 14:55 |
*** shahid_ has quit IRC | 14:55 | |
*** monester has quit IRC | 14:55 | |
*** monester has joined #openstack-infra | 14:57 | |
fungi | thanks jeblair! i didn't want to restart anything until you had a chance to look it over, in case i destroyed any evidence of the underlying issue | 14:57 |
fungi | especially since it's saturday, it's not like it's inconveniencing a ton of people if it's stuck a little longer | 14:58 |
jeblair | fungi: yeah, i have no idea why we'd be spending so long in prettyprint. maybe malformed data from gerrit or something? we should keep an eye out for it again though | 14:59 |
jeblair | i used sigusr2 to get a pair of backtraces | 14:59 |
AJaeger | zuul seems slow, moving the job into gate and from gate to post took long. | 15:01 |
*** rcarrillocruz has quit IRC | 15:02 | |
jeblair | it's usually slow after a restart as it has to query gerrit for a lot of uncached data | 15:02 |
AJaeger | ah, ok then | 15:02 |
*** markvoelker has joined #openstack-infra | 15:06 | |
*** jsavak has quit IRC | 15:07 | |
*** bhavik has quit IRC | 15:08 | |
*** rcarrillocruz has joined #openstack-infra | 15:08 | |
*** ccamacho|out has left #openstack-infra | 15:09 | |
*** ccamacho|out has quit IRC | 15:09 | |
openstackgerrit | Sascha Grunert proposed openstack-infra/git-review: Stash and unstash changes during download https://review.openstack.org/340024 | 15:10 |
*** thorst has joined #openstack-infra | 15:10 | |
*** ociuhandu has joined #openstack-infra | 15:12 | |
*** sdake has joined #openstack-infra | 15:15 | |
*** gouthamr has joined #openstack-infra | 15:16 | |
openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Add userstory-dashboard repos https://review.openstack.org/343095 | 15:16 |
*** thorst has quit IRC | 15:18 | |
*** rfolco has joined #openstack-infra | 15:26 | |
*** pt_15 has quit IRC | 15:26 | |
openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Document signing key management https://review.openstack.org/339248 | 15:26 |
*** sarob has joined #openstack-infra | 15:29 | |
*** rfolco has quit IRC | 15:29 | |
*** kzaitsev_mb has quit IRC | 15:31 | |
*** nixpenguin has joined #openstack-infra | 15:34 | |
*** amitgandhinz has joined #openstack-infra | 15:39 | |
*** amitgandhinz has quit IRC | 15:44 | |
*** sdake has quit IRC | 15:48 | |
*** gouthamr_ has joined #openstack-infra | 15:50 | |
*** david-lyle has joined #openstack-infra | 15:50 | |
*** gouthamr has quit IRC | 15:53 | |
*** rhallisey has joined #openstack-infra | 15:55 | |
*** david-lyle has quit IRC | 15:57 | |
*** piet has joined #openstack-infra | 15:59 | |
*** sdake has joined #openstack-infra | 16:03 | |
*** piet has quit IRC | 16:12 | |
*** claudiub has quit IRC | 16:12 | |
*** piet has joined #openstack-infra | 16:13 | |
*** thorst has joined #openstack-infra | 16:15 | |
openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Add userstory-dashboard repos https://review.openstack.org/343095 | 16:15 |
*** adrian_otto has joined #openstack-infra | 16:19 | |
*** sarob has quit IRC | 16:22 | |
*** thorst has quit IRC | 16:22 | |
*** roxanagh_ has joined #openstack-infra | 16:23 | |
*** kzaitsev_mb has joined #openstack-infra | 16:26 | |
*** e0ne has joined #openstack-infra | 16:30 | |
*** kzaitsev_mb has quit IRC | 16:30 | |
pabelanger | fungi: have we documented the new gpg key id for signing01.ci.o.o any place? | 16:31 |
*** esberglu has joined #openstack-infra | 16:31 | |
*** sdake has quit IRC | 16:34 | |
fungi | pabelanger: not yet. i figured we'd get some infra-root signatures on it first once that key management process documentation merges | 16:35 |
pabelanger | fungi: ack | 16:35 |
fungi | since _we_ should be verifying it by logging into the server, not trusting something displayed in a web browser | 16:35 |
*** bhavik has joined #openstack-infra | 16:36 | |
openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Move reprepro to signing_node.pp https://review.openstack.org/343225 | 16:36 |
pabelanger | looks like the 2nd step for reprepro signing packages is just adding: SignWith: 123456 to our configuration file | 16:37 |
pabelanger | I'll hold off on that for now | 16:37 |
*** clenimar_ has quit IRC | 16:37 | |
*** psachin has quit IRC | 16:38 | |
*** esberglu has quit IRC | 16:39 | |
fungi | pabelanger: well, we'll need to do the signing separately | 16:39 |
fungi | we wouldn't run reprepro on the same machine where the signing key is available | 16:40 |
pabelanger | fungi: Hmm, I'm not sure you can sign a package after it has already been imported into reprepro | 16:40 |
*** amitgandhinz has joined #openstack-infra | 16:40 | |
fungi | so need to figure out how to extract the signing to a separate step and then we can retrieve, sign and return the file(s) that need it before doing vos release | 16:40 |
pabelanger | ya | 16:41 |
fungi | i'm not super familiar with reprepro, but with apt-ftparchive i just separately sign my Release file | 16:41 |
pabelanger | Right, maybe that is what we need to do | 16:42 |
pabelanger | however, I am not sure how reprepro will react to something external signing the packages | 16:42 |
pabelanger | I'll give it some testing and see what the results are | 16:43 |
*** roxanagh_ has quit IRC | 16:43 | |
*** amitgandhinz has quit IRC | 16:45 | |
*** rhallisey has quit IRC | 16:45 | |
fungi | specifically, i do `gpg --armor --detach-sign --output Release.gpg Release` and that seems to satisfy apt-get's expectations | 16:48 |
*** ddieterly has joined #openstack-infra | 16:48 | |
*** piet has quit IRC | 16:48 | |
*** snarwade has quit IRC | 16:50 | |
*** ociuhandu has quit IRC | 16:50 | |
*** clenimar_ has joined #openstack-infra | 16:51 | |
*** sdake has joined #openstack-infra | 16:53 | |
*** ddieterly has quit IRC | 16:54 | |
*** shashank_hegde has joined #openstack-infra | 16:55 | |
*** sdake has quit IRC | 16:57 | |
*** kzaitsev_mb has joined #openstack-infra | 16:57 | |
*** sdake has joined #openstack-infra | 16:59 | |
fungi | weird. gerrit says i uploaded 343095,4 45 minutes ago, but zuul status says it's only been in the check pipeline for 10 minutes | 17:00 |
fungi | no idea if its events queue was backlogged since i wasn't watching | 17:01 |
*** ociuhandu has joined #openstack-infra | 17:03 | |
*** kzaitsev_mb has quit IRC | 17:03 | |
*** nixpenguin has quit IRC | 17:03 | |
fungi | oh yeah. picking another example from check at random, 336188,8 (a neutron change) was uploaded to gerrit at 16:18 but zuul only has it in the check pipeline for 9 minutes so far | 17:04 |
fungi | 342932,7 (for fuel-library) was uploaded at 16:20 and has been in check for 7 minutes | 17:05 |
fungi | so it looks like zuul may be taking 45-50 minutes to act on gerrit events | 17:06 |
fungi | er, 35-40 minutes i mean | 17:06 |
*** markvoelker has quit IRC | 17:07 | |
fungi | i guess this could still be zuul warming its caches | 17:07 |
fungi | no idea how long we should expect that to persist after a restart during a low-activity period | 17:07 |
fungi | guess i'll check again in a few hours and see if it's still happening | 17:08 |
*** gouthamr_ has quit IRC | 17:11 | |
*** nt has quit IRC | 17:11 | |
*** nt has joined #openstack-infra | 17:12 | |
jeblair | fungi: no, it's not warming caches anymore | 17:14 |
*** thorst has joined #openstack-infra | 17:20 | |
jeblair | fungi, AJaeger: i think i know the problem | 17:21 |
jeblair | and actually the 'stuck in prettyprint' from earlier should have been a clue | 17:21 |
*** ddieterly has joined #openstack-infra | 17:22 | |
jeblair | it's change 294830 (don't load it up). microsoft manila ci is in a comment loop. | 17:22 |
*** piet has joined #openstack-infra | 17:23 | |
stevemar | o/ | 17:23 |
*** shashank_hegde has quit IRC | 17:23 | |
stevemar | whats up with some projects installing u-c with pip install and others with "tox_install" ? | 17:23 |
stevemar | it looks like mainly the clients do the latter | 17:23 |
jeblair | i'm going to disable Microsoft Manila CI, account id 18128 | 17:25 |
*** adrian_otto has quit IRC | 17:27 | |
AJaeger | stevemar: some want to install another repo directly from git - and that breaks with u-c apparently | 17:27 |
AJaeger | jeblair: thanks for finding | 17:27 |
*** thorst has quit IRC | 17:28 | |
*** adrian_otto has joined #openstack-infra | 17:28 | |
*** e0ne has quit IRC | 17:28 | |
stevemar | AJaeger: fun times | 17:28 |
jeblair | i think i may have succeeding in disabling the account and closing the connections; i'm not seeing any more comments from it | 17:29 |
jeblair | i'm going to go about cleaning up the comments now | 17:29 |
AJaeger | stevemar: see the comment at top of python-neutronclient/tools/tox_install.sh - I didn't check the logic, just noticed it... | 17:29 |
AJaeger | jeblair: how many changes did it produce? | 17:29 |
AJaeger | s/changes/comments/ | 17:30 |
jeblair | AJaeger: that account has left 28764 comments | 17:30 |
stevemar | AJaeger: yeah, i was just looking there | 17:30 |
stevemar | :) | 17:30 |
stevemar | seems to work now | 17:30 |
jeblair | 22292 of them on that change | 17:31 |
AJaeger | wow, new record? ;( | 17:31 |
jeblair | i have deleted those now | 17:32 |
jeblair | zuul is moving more quickly now | 17:32 |
jeblair | though it's mostly currently working through its backlog of queries for 294830 | 17:32 |
AJaeger | fungi, do you want to approve the coverage post job now - or wait until Monday? It's https://review.openstack.org/343014 | 17:33 |
*** gouthamr has joined #openstack-infra | 17:33 | |
jeblair | #status log disabled "Microsoft Manila CI", account id 18128 because it was in a comment loop on change 294830 | 17:34 |
openstackstatus | jeblair: finished logging | 17:34 |
*** snarwade has joined #openstack-infra | 17:34 | |
jeblair | AJaeger, fungi: zuul seems happy now | 17:34 |
AJaeger | thanks, jeblair ! | 17:34 |
jeblair | clarkb: i believe i have a solution to our problem partially coded. i'm optimistic we can proceed again on monday. | 17:35 |
jeblair | now back to weekend, already in progress. | 17:35 |
AJaeger | enjoy, jeblair ! | 17:38 |
*** ddieterly has quit IRC | 17:40 | |
*** amitgandhinz has joined #openstack-infra | 17:41 | |
*** adrian_otto has quit IRC | 17:45 | |
*** amitgandhinz has quit IRC | 17:46 | |
*** pt_15 has joined #openstack-infra | 17:49 | |
*** itisha has joined #openstack-infra | 17:50 | |
*** kzaitsev_mb has joined #openstack-infra | 17:54 | |
*** maishsk has joined #openstack-infra | 17:56 | |
*** maishsk has quit IRC | 17:56 | |
*** thorst has joined #openstack-infra | 18:01 | |
*** thorst has quit IRC | 18:01 | |
*** thorst has joined #openstack-infra | 18:02 | |
*** psachin has joined #openstack-infra | 18:04 | |
*** markvoelker has joined #openstack-infra | 18:07 | |
*** thorst has quit IRC | 18:10 | |
*** sdake has quit IRC | 18:11 | |
*** markvoelker has quit IRC | 18:13 | |
*** sputnik13 has joined #openstack-infra | 18:18 | |
*** savihou has quit IRC | 18:20 | |
*** savihou has joined #openstack-infra | 18:21 | |
*** EricGonczer_ has quit IRC | 18:24 | |
clarkb | jeblair: that is excellent news | 18:30 |
*** Na3iL has joined #openstack-infra | 18:34 | |
*** shashank_hegde has joined #openstack-infra | 18:36 | |
*** eezhova has joined #openstack-infra | 18:38 | |
*** sputnik13 has quit IRC | 18:41 | |
*** rossella_s has quit IRC | 18:41 | |
*** rossella_s has joined #openstack-infra | 18:41 | |
*** amitgandhinz has joined #openstack-infra | 18:42 | |
*** thorst has joined #openstack-infra | 18:45 | |
*** amitgandhinz has quit IRC | 18:46 | |
*** piet has quit IRC | 18:53 | |
*** EricGonczer_ has joined #openstack-infra | 18:53 | |
*** tphummel has joined #openstack-infra | 18:56 | |
*** rfolco has joined #openstack-infra | 18:58 | |
*** Goneri has joined #openstack-infra | 18:59 | |
*** shashank_hegde has quit IRC | 19:00 | |
*** tonytan4ever has quit IRC | 19:02 | |
*** bhunter71 has quit IRC | 19:04 | |
*** sarob has joined #openstack-infra | 19:04 | |
*** hogepodge has quit IRC | 19:04 | |
*** hogepodge has joined #openstack-infra | 19:05 | |
*** tphummel has quit IRC | 19:06 | |
*** ddieterly has joined #openstack-infra | 19:12 | |
*** shashank_hegde has joined #openstack-infra | 19:12 | |
*** karthikp_ has joined #openstack-infra | 19:18 | |
*** Nikolay_St has joined #openstack-infra | 19:18 | |
*** rfolco has quit IRC | 19:20 | |
*** EricGonczer_ has quit IRC | 19:23 | |
*** clenimar_ has quit IRC | 19:25 | |
*** tonytan4ever has joined #openstack-infra | 19:25 | |
*** eezhova has quit IRC | 19:28 | |
*** Jeffrey4l_ has joined #openstack-infra | 19:32 | |
*** Jeffrey4l has quit IRC | 19:34 | |
*** ddieterly has quit IRC | 19:37 | |
*** sarob has quit IRC | 19:39 | |
*** sarob has joined #openstack-infra | 19:39 | |
*** amitgandhinz has joined #openstack-infra | 19:43 | |
*** karthikp_ has quit IRC | 19:44 | |
*** Goneri has quit IRC | 19:44 | |
*** sarob has quit IRC | 19:46 | |
openstackgerrit | Andreas Florath proposed openstack/diskimage-builder: Spec for changing the block device handling: partitioning https://review.openstack.org/343232 | 19:46 |
*** amitgandhinz has quit IRC | 19:47 | |
fungi | jeblair: oh, fun, i should have thought to check gerrit logs for spammy bots | 19:54 |
fungi | AJaeger: now seems fine. looking over it one last time now | 19:55 |
*** yamahata has joined #openstack-infra | 20:00 | |
*** dims has quit IRC | 20:02 | |
*** [1]Thelo has joined #openstack-infra | 20:03 | |
*** dims has joined #openstack-infra | 20:04 | |
*** tkelsey has joined #openstack-infra | 20:04 | |
*** abregman has joined #openstack-infra | 20:05 | |
*** Thelo has quit IRC | 20:05 | |
*** [1]Thelo is now known as Thelo | 20:05 | |
*** karthikp_ has joined #openstack-infra | 20:08 | |
*** e0ne has joined #openstack-infra | 20:09 | |
*** thorst has quit IRC | 20:09 | |
*** tkelsey has quit IRC | 20:09 | |
*** thorst has joined #openstack-infra | 20:09 | |
*** markvoelker has joined #openstack-infra | 20:10 | |
openstackgerrit | Merged openstack-infra/project-config: Use zuul-cloner for coverage job https://review.openstack.org/343014 | 20:11 |
*** rfolco has joined #openstack-infra | 20:11 | |
*** markvoelker has quit IRC | 20:14 | |
*** savihou has quit IRC | 20:16 | |
*** ddieterly has joined #openstack-infra | 20:17 | |
*** thorst has quit IRC | 20:18 | |
*** karthikp_ has quit IRC | 20:20 | |
*** dkehn_ has quit IRC | 20:25 | |
*** dkehn has quit IRC | 20:25 | |
*** yamahata has quit IRC | 20:25 | |
*** shashank_hegde has quit IRC | 20:27 | |
fungi | AJaeger: ^ | 20:31 |
*** dkehn has joined #openstack-infra | 20:32 | |
*** sputnik13 has joined #openstack-infra | 20:34 | |
*** e0ne has quit IRC | 20:34 | |
*** Nikolay_St has quit IRC | 20:35 | |
*** ddieterly has quit IRC | 20:36 | |
*** dkehn_ has joined #openstack-infra | 20:38 | |
*** amitgandhinz has joined #openstack-infra | 20:43 | |
*** amitgandhinz has quit IRC | 20:48 | |
*** eric_lopez has joined #openstack-infra | 20:53 | |
*** claudiub has joined #openstack-infra | 20:53 | |
*** elo has quit IRC | 20:55 | |
*** rfolco has quit IRC | 21:01 | |
*** clenimar_ has joined #openstack-infra | 21:02 | |
*** ihrachys has joined #openstack-infra | 21:06 | |
*** ddieterly has joined #openstack-infra | 21:07 | |
*** markvoelker has joined #openstack-infra | 21:10 | |
*** ddieterly has quit IRC | 21:11 | |
*** rackertom has quit IRC | 21:13 | |
*** rackertom has joined #openstack-infra | 21:15 | |
*** markvoelker has quit IRC | 21:15 | |
*** thorst has joined #openstack-infra | 21:15 | |
*** thorst has quit IRC | 21:23 | |
*** jianghuaw has quit IRC | 21:29 | |
*** jianghuaw has joined #openstack-infra | 21:30 | |
*** amitgandhinz has joined #openstack-infra | 21:44 | |
*** gouthamr has quit IRC | 21:46 | |
*** amitgandhinz has quit IRC | 21:49 | |
*** thorst has joined #openstack-infra | 21:50 | |
*** ihrachys_ has joined #openstack-infra | 21:50 | |
*** ihrachys has quit IRC | 21:50 | |
*** sdake has joined #openstack-infra | 21:53 | |
*** tonytan4ever has quit IRC | 21:55 | |
*** sputnik13 has quit IRC | 21:55 | |
*** sputnik13 has joined #openstack-infra | 21:57 | |
*** thorst has quit IRC | 21:58 | |
openstackgerrit | Ihar Hrachyshka proposed openstack-infra/devstack-gate: Always set br-ex mtu including for grenade runs https://review.openstack.org/343024 | 22:04 |
*** ihrachys has joined #openstack-infra | 22:04 | |
*** ihrachys_ has quit IRC | 22:05 | |
openstackgerrit | Ihar Hrachyshka proposed openstack-infra/devstack-gate: Always set br-ex mtu including for grenade runs https://review.openstack.org/343024 | 22:06 |
*** ddieterly has joined #openstack-infra | 22:18 | |
*** rkukura has quit IRC | 22:18 | |
*** ociuhandu has quit IRC | 22:19 | |
*** peterstac has quit IRC | 22:19 | |
*** rkukura has joined #openstack-infra | 22:19 | |
*** peterstac has joined #openstack-infra | 22:20 | |
*** markvoelker has joined #openstack-infra | 22:22 | |
*** Na3iL has quit IRC | 22:22 | |
*** ddieterly has quit IRC | 22:23 | |
*** markvoelker has quit IRC | 22:26 | |
*** rossella_s has quit IRC | 22:40 | |
*** rossella_s has joined #openstack-infra | 22:41 | |
*** ociuhandu has joined #openstack-infra | 22:42 | |
*** amitgandhinz has joined #openstack-infra | 22:45 | |
*** sputnik13 has quit IRC | 22:47 | |
*** julim has joined #openstack-infra | 22:49 | |
*** amitgandhinz has quit IRC | 22:50 | |
*** clenimar_ has quit IRC | 22:52 | |
*** berendt has joined #openstack-infra | 22:54 | |
*** sputnik13 has joined #openstack-infra | 22:55 | |
*** tonytan4ever has joined #openstack-infra | 22:56 | |
*** thorst has joined #openstack-infra | 22:56 | |
*** tonytan4ever has quit IRC | 23:01 | |
*** thorst has quit IRC | 23:03 | |
*** clenimar_ has joined #openstack-infra | 23:04 | |
*** elo has joined #openstack-infra | 23:04 | |
*** ihrachys has quit IRC | 23:06 | |
*** eric_lopez has quit IRC | 23:07 | |
*** abregman has quit IRC | 23:08 | |
*** bhavik has quit IRC | 23:09 | |
*** ihrachys has joined #openstack-infra | 23:12 | |
*** shashank_hegde has joined #openstack-infra | 23:18 | |
*** dkehn has quit IRC | 23:30 | |
*** dkehn_ has quit IRC | 23:31 | |
*** ihrachys has quit IRC | 23:36 | |
*** ihrachys has joined #openstack-infra | 23:38 | |
*** clenimar_ has quit IRC | 23:44 | |
*** amitgandhinz has joined #openstack-infra | 23:46 | |
*** clenimar_ has joined #openstack-infra | 23:46 | |
*** amitgandhinz has quit IRC | 23:50 | |
*** dims has quit IRC | 23:50 | |
*** dims has joined #openstack-infra | 23:52 | |
*** dkehn has joined #openstack-infra | 23:53 | |
*** dims has quit IRC | 23:57 | |
*** dkehn has quit IRC | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!