| *** Julien-zte has quit IRC | 00:01 | |
| *** Julien-zte has joined #openstack-infra | 00:01 | |
| *** Goneri has joined #openstack-infra | 00:08 | |
| *** markvoelker has joined #openstack-infra | 00:14 | |
| *** markvoelker has quit IRC | 00:19 | |
| *** ym200 has joined #openstack-infra | 00:24 | |
| *** thorst has joined #openstack-infra | 00:25 | |
| *** larainema has joined #openstack-infra | 00:27 | |
| *** ym200 has quit IRC | 00:28 | |
| *** yamahata has quit IRC | 00:29 | |
| *** thorst has quit IRC | 00:29 | |
| *** baoli has joined #openstack-infra | 00:31 | |
| *** ym200 has joined #openstack-infra | 00:35 | |
| *** yolanda has joined #openstack-infra | 00:38 | |
| *** ym200 has quit IRC | 00:40 | |
| *** Goneri has quit IRC | 00:43 | |
| *** ym200 has joined #openstack-infra | 01:10 | |
| *** Julien-zte has quit IRC | 01:12 | |
| *** baoli has quit IRC | 01:13 | |
| *** ym200 has quit IRC | 01:14 | |
| *** zz_dimtruck is now known as dimtruck | 01:16 | |
| *** EricGonczer_ has joined #openstack-infra | 01:16 | |
| *** baoli has joined #openstack-infra | 01:23 | |
| *** john-davidge has joined #openstack-infra | 01:23 | |
| *** dimtruck is now known as zz_dimtruck | 01:26 | |
| *** john-davidge has quit IRC | 01:28 | |
| *** BharatK has joined #openstack-infra | 01:30 | |
| *** BharatK__ has quit IRC | 01:32 | |
| *** Julien-zte has joined #openstack-infra | 01:33 | |
| *** esberglu has joined #openstack-infra | 01:38 | |
| *** ym200 has joined #openstack-infra | 01:42 | |
| *** esberglu has quit IRC | 01:42 | |
| *** cody-somerville has joined #openstack-infra | 01:43 | |
| *** cody-somerville has joined #openstack-infra | 01:43 | |
| *** csomerville has quit IRC | 01:45 | |
| *** ym200 has quit IRC | 01:46 | |
| *** ym200 has joined #openstack-infra | 01:48 | |
| *** yamamoto has joined #openstack-infra | 01:50 | |
| *** EricGonczer_ has quit IRC | 01:51 | |
| *** ym200 has quit IRC | 01:53 | |
| *** yamamoto has quit IRC | 01:59 | |
| *** yamahata has joined #openstack-infra | 02:03 | |
| *** zz_dimtruck is now known as dimtruck | 02:15 | |
| *** ym200 has joined #openstack-infra | 02:17 | |
| *** ym200 has quit IRC | 02:22 | |
| *** ym200 has joined #openstack-infra | 02:23 | |
| *** ym200 has quit IRC | 02:23 | |
| *** dimtruck is now known as zz_dimtruck | 02:24 | |
| *** ym200 has joined #openstack-infra | 02:25 | |
| *** psedlak has quit IRC | 02:29 | |
| *** funzo has joined #openstack-infra | 02:29 | |
| *** zz_dimtruck is now known as dimtruck | 02:31 | |
| *** thorst has joined #openstack-infra | 02:31 | |
| *** Julien-zte has quit IRC | 02:32 | |
| *** esberglu has joined #openstack-infra | 02:32 | |
| *** psedlak has joined #openstack-infra | 02:35 | |
| *** esberglu has quit IRC | 02:37 | |
| *** skelso has joined #openstack-infra | 02:37 | |
| *** sekelso has joined #openstack-infra | 02:39 | |
| *** skelso has quit IRC | 02:43 | |
| *** baoli has quit IRC | 02:47 | |
| *** thorst has quit IRC | 02:50 | |
| *** yamamoto has joined #openstack-infra | 03:00 | |
| *** nicolasbock has quit IRC | 03:02 | |
| *** dougshelley66 has joined #openstack-infra | 03:05 | |
| *** yamamoto has quit IRC | 03:12 | |
| *** gk_1wm_su has joined #openstack-infra | 03:22 | |
| *** gk_1wm_su has left #openstack-infra | 03:23 | |
| *** Kevin_Zheng has quit IRC | 03:23 | |
| *** vikrant has joined #openstack-infra | 03:37 | |
| *** gk_1wm_su has joined #openstack-infra | 03:46 | |
| *** gk_1wm_su has left #openstack-infra | 03:47 | |
| *** cody-somerville has quit IRC | 03:55 | |
| *** dimtruck is now known as zz_dimtruck | 03:58 | |
| *** thorst has joined #openstack-infra | 04:07 | |
| *** zz_dimtruck is now known as dimtruck | 04:09 | |
| *** armax has quit IRC | 04:10 | |
| *** thorst has quit IRC | 04:11 | |
| *** sekelso has quit IRC | 04:24 | |
| *** john-davidge has joined #openstack-infra | 05:02 | |
| *** funzo has quit IRC | 05:04 | |
| *** john-davidge has quit IRC | 05:07 | |
| *** thorst has joined #openstack-infra | 05:08 | |
| *** jascott1_ has quit IRC | 05:11 | |
| *** jascott1_ has joined #openstack-infra | 05:11 | |
| *** thorst has quit IRC | 05:12 | |
| *** jascott1_ has quit IRC | 05:16 | |
| *** funzo has joined #openstack-infra | 05:17 | |
| *** jascott1_ has joined #openstack-infra | 05:26 | |
| *** ym200 has quit IRC | 05:41 | |
| *** ym200 has joined #openstack-infra | 05:44 | |
| *** ym200_ has joined #openstack-infra | 05:45 | |
| *** jascott1_ has joined #openstack-infra | 05:46 | |
| *** ym200 has quit IRC | 05:48 | |
| *** ym200_ has quit IRC | 05:50 | |
| *** jascott1_ has quit IRC | 05:50 | |
| *** chkumar|off is now known as chandankumar | 05:51 | |
| *** gouthamr has quit IRC | 05:55 | |
| *** funzo has quit IRC | 06:09 | |
| AJaeger | rm_work: which guide did you follow? Let's fix that one to point to our location | 06:11 |
|---|---|---|
| *** yamahata has quit IRC | 06:12 | |
| AJaeger | team, https://github.com/openstack-infra/puppet-mqtt_stats is not setup correctly (still empty) while http://git.openstack.org/cgit/openstack-infra/puppet-mqtt_statsd/ looks fine. | 06:15 |
| *** esikache1 has joined #openstack-infra | 06:15 | |
| *** ym200 has joined #openstack-infra | 06:22 | |
| *** ym200 has quit IRC | 06:26 | |
| *** esikache1 has quit IRC | 06:49 | |
| *** DFFlanders has joined #openstack-infra | 06:55 | |
| *** ym200 has joined #openstack-infra | 06:56 | |
| *** kzaitsev_mb has joined #openstack-infra | 06:59 | |
| *** ym200 has quit IRC | 07:01 | |
| *** john-davidge has joined #openstack-infra | 07:02 | |
| *** yamamoto has joined #openstack-infra | 07:04 | |
| *** yamamoto has quit IRC | 07:04 | |
| *** yamamoto has joined #openstack-infra | 07:05 | |
| *** john-davidge has quit IRC | 07:07 | |
| *** ym200 has joined #openstack-infra | 07:08 | |
| *** ralonsoh has joined #openstack-infra | 07:08 | |
| *** yamamoto has quit IRC | 07:09 | |
| *** thorst has joined #openstack-infra | 07:09 | |
| *** jianghuaw_ has quit IRC | 07:09 | |
| *** GnomeKing has quit IRC | 07:10 | |
| *** ym200 has quit IRC | 07:12 | |
| *** thorst has quit IRC | 07:14 | |
| *** dimtruck is now known as zz_dimtruck | 07:20 | |
| *** xarses has joined #openstack-infra | 07:24 | |
| *** andreww has joined #openstack-infra | 07:25 | |
| *** xarses has quit IRC | 07:28 | |
| *** andreww has quit IRC | 07:29 | |
| *** john-davidge has joined #openstack-infra | 07:33 | |
| *** ym200 has joined #openstack-infra | 07:34 | |
| *** DFFlanders has quit IRC | 07:36 | |
| *** john-davidge has quit IRC | 07:38 | |
| *** ym200 has quit IRC | 07:38 | |
| *** sshnaidm|afk has quit IRC | 07:41 | |
| *** ym200 has joined #openstack-infra | 07:46 | |
| *** nadya has joined #openstack-infra | 07:48 | |
| *** nadya has quit IRC | 07:48 | |
| *** ym200 has quit IRC | 07:50 | |
| *** esikache1 has joined #openstack-infra | 07:58 | |
| *** zzzeek has quit IRC | 08:00 | |
| *** zzzeek has joined #openstack-infra | 08:00 | |
| *** esikache1 has quit IRC | 08:03 | |
| *** yamamoto has joined #openstack-infra | 08:08 | |
| *** thorst has joined #openstack-infra | 08:10 | |
| *** yamamoto has quit IRC | 08:15 | |
| *** ym200 has joined #openstack-infra | 08:18 | |
| *** ym200 has quit IRC | 08:23 | |
| *** ym200 has joined #openstack-infra | 08:25 | |
| *** neiljerram has joined #openstack-infra | 08:29 | |
| *** thorst has quit IRC | 08:30 | |
| *** ym200 has quit IRC | 08:30 | |
| *** john-davidge has joined #openstack-infra | 08:34 | |
| *** esikache1 has joined #openstack-infra | 08:37 | |
| *** john-davidge has quit IRC | 08:38 | |
| *** esikache1 has quit IRC | 08:41 | |
| *** esberglu has joined #openstack-infra | 08:51 | |
| *** BharatK has quit IRC | 08:53 | |
| *** BharatK has joined #openstack-infra | 08:54 | |
| *** ym200 has joined #openstack-infra | 08:54 | |
| *** esikache1 has joined #openstack-infra | 08:54 | |
| *** esberglu has quit IRC | 08:55 | |
| *** ym200 has quit IRC | 08:58 | |
| *** pbourke has quit IRC | 08:59 | |
| *** ym200 has joined #openstack-infra | 09:00 | |
| *** winggundamth has joined #openstack-infra | 09:01 | |
| *** pbourke has joined #openstack-infra | 09:01 | |
| *** john-davidge has joined #openstack-infra | 09:02 | |
| *** ym200 has quit IRC | 09:04 | |
| *** john-davidge has quit IRC | 09:06 | |
| *** ralonsoh has quit IRC | 09:10 | |
| *** ssbarnea has joined #openstack-infra | 09:11 | |
| *** BharatK_ has joined #openstack-infra | 09:13 | |
| *** ralonsoh has joined #openstack-infra | 09:14 | |
| *** BharatK has quit IRC | 09:17 | |
| *** BharatK__ has joined #openstack-infra | 09:23 | |
| *** kzaitsev_mb has quit IRC | 09:25 | |
| *** BharatK_ has quit IRC | 09:27 | |
| *** sshnaidm|afk has joined #openstack-infra | 09:32 | |
| *** sputnik13_ has quit IRC | 09:34 | |
| *** sputnik13 has joined #openstack-infra | 09:35 | |
| *** sputnik13 has quit IRC | 09:36 | |
| *** sputnik13 has joined #openstack-infra | 09:37 | |
| *** sputnik13 has quit IRC | 09:37 | |
| *** sputnik13 has joined #openstack-infra | 09:39 | |
| *** sputnik13 has quit IRC | 09:40 | |
| *** sputnik13 has joined #openstack-infra | 09:42 | |
| *** sputnik13 has quit IRC | 09:44 | |
| *** esberglu has joined #openstack-infra | 09:45 | |
| *** esikachev has joined #openstack-infra | 09:48 | |
| *** esberglu has quit IRC | 09:49 | |
| *** esikache1 has quit IRC | 09:51 | |
| *** esikachev has quit IRC | 10:08 | |
| *** ym200 has joined #openstack-infra | 10:11 | |
| *** ym200 has quit IRC | 10:16 | |
| *** ym200 has joined #openstack-infra | 10:17 | |
| *** tosky has joined #openstack-infra | 10:21 | |
| *** ym200 has quit IRC | 10:22 | |
| *** sputnik13 has joined #openstack-infra | 10:22 | |
| *** esikachev has joined #openstack-infra | 10:24 | |
| *** ssbarnea has quit IRC | 10:27 | |
| *** ssbarnea has joined #openstack-infra | 10:30 | |
| *** ralonsoh has quit IRC | 10:31 | |
| *** esberglu has joined #openstack-infra | 10:39 | |
| *** nicolasbock has joined #openstack-infra | 10:40 | |
| *** esberglu has quit IRC | 10:43 | |
| *** ym200 has joined #openstack-infra | 10:58 | |
| *** dmellado has quit IRC | 11:01 | |
| *** john-davidge has joined #openstack-infra | 11:03 | |
| *** yamamoto has joined #openstack-infra | 11:03 | |
| *** ym200 has quit IRC | 11:03 | |
| *** john-davidge has quit IRC | 11:08 | |
| *** kzaitsev_mb has joined #openstack-infra | 11:12 | |
| *** eranrom has quit IRC | 11:25 | |
| *** yamamoto has quit IRC | 11:27 | |
| *** john-davidge has joined #openstack-infra | 11:29 | |
| *** ym200 has joined #openstack-infra | 11:32 | |
| *** sekelso has joined #openstack-infra | 11:33 | |
| *** esberglu has joined #openstack-infra | 11:33 | |
| *** john-davidge has quit IRC | 11:34 | |
| *** ralonsoh has joined #openstack-infra | 11:37 | |
| *** ym200 has quit IRC | 11:37 | |
| *** esberglu has quit IRC | 11:37 | |
| fungi | checking | 11:38 |
| *** eranrom has joined #openstack-infra | 11:41 | |
| fungi | same missing permission for gerrit. obviously the new caching code didn't solve github's api instability | 11:44 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Collect /var/lib/pacemaker/cib with logs https://review.openstack.org/436537 | 11:46 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Compress logs to tar.gz archive https://review.openstack.org/434143 | 11:46 |
| *** ralonsoh has quit IRC | 11:51 | |
| *** jascott1_ has joined #openstack-infra | 11:51 | |
| *** kzaitsev_mb has quit IRC | 11:51 | |
| fungi | odd, it didn't replicate on its own, i had to retrigger replication for that repo through the gerrit api | 11:52 |
| *** jascott1_ has quit IRC | 11:55 | |
| *** sshnaidm|afk has quit IRC | 12:04 | |
| *** neiljerram has quit IRC | 12:14 | |
| *** neiljerram has joined #openstack-infra | 12:14 | |
| *** yamamoto has joined #openstack-infra | 12:15 | |
| *** yamamoto has quit IRC | 12:15 | |
| *** kzaitsev_mb has joined #openstack-infra | 12:17 | |
| *** kzaitsev_mb has quit IRC | 12:22 | |
| *** ssbarnea has quit IRC | 12:24 | |
| *** vikrant has quit IRC | 12:28 | |
| *** john-davidge has joined #openstack-infra | 12:30 | |
| *** john-davidge has quit IRC | 12:35 | |
| *** rhallisey has joined #openstack-infra | 12:36 | |
| *** jkilpatr has joined #openstack-infra | 12:39 | |
| *** ym200 has joined #openstack-infra | 12:39 | |
| *** john-davidge has joined #openstack-infra | 12:42 | |
| *** ym200 has quit IRC | 12:44 | |
| *** sekelso has quit IRC | 12:46 | |
| *** john-davidge has quit IRC | 12:47 | |
| *** esberglu has joined #openstack-infra | 12:48 | |
| *** zz_dimtruck is now known as dimtruck | 12:49 | |
| *** winggundamth_ has joined #openstack-infra | 12:50 | |
| *** esberglu has quit IRC | 12:53 | |
| *** winggundamth has quit IRC | 12:53 | |
| *** ym200 has joined #openstack-infra | 12:55 | |
| *** ym200 has quit IRC | 12:59 | |
| *** BharatK__ has quit IRC | 13:05 | |
| *** BharatK has joined #openstack-infra | 13:06 | |
| AJaeger | thanks, fungi! | 13:08 |
| *** markvoelker has joined #openstack-infra | 13:11 | |
| *** markvoelker has quit IRC | 13:16 | |
| *** yamamoto has joined #openstack-infra | 13:16 | |
| *** kzaitsev_mb has joined #openstack-infra | 13:19 | |
| openstackgerrit | Merged openstack-infra/project-config master: Normalize projects.yaml https://review.openstack.org/454977 | 13:19 |
| *** esberglu has joined #openstack-infra | 13:24 | |
| *** yamamoto has quit IRC | 13:24 | |
| *** ssbarnea has joined #openstack-infra | 13:26 | |
| *** EricGonczer_ has joined #openstack-infra | 13:27 | |
| *** esberglu has quit IRC | 13:28 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/infra-manual master: Document RETRY_LIMIT https://review.openstack.org/455059 | 13:30 |
| *** rhallisey has quit IRC | 13:34 | |
| *** ym200 has joined #openstack-infra | 13:37 | |
| *** nicolasbock has quit IRC | 13:39 | |
| *** ym200 has quit IRC | 13:41 | |
| *** kzaitsev_mb has quit IRC | 13:47 | |
| openstackgerrit | Paul Belanger proposed openstack/diskimage-builder master: Stop using install_test_deps.sh for package requirements https://review.openstack.org/391931 | 13:50 |
| *** sshnaidm|afk has joined #openstack-infra | 13:52 | |
| *** ym200 has joined #openstack-infra | 14:13 | |
| *** sekelso has joined #openstack-infra | 14:16 | |
| *** ym200 has quit IRC | 14:17 | |
| *** thorst has joined #openstack-infra | 14:17 | |
| *** esberglu has joined #openstack-infra | 14:17 | |
| *** thorst has quit IRC | 14:18 | |
| *** sekelso has quit IRC | 14:20 | |
| *** esberglu has quit IRC | 14:22 | |
| *** BharatK has quit IRC | 14:29 | |
| openstackgerrit | Paul Belanger proposed openstack/diskimage-builder master: Split debootstrap into debootstrap-minimal https://review.openstack.org/413103 | 14:31 |
| openstackgerrit | Paul Belanger proposed openstack/diskimage-builder master: Clean out apt index caches at end of image build https://review.openstack.org/455062 | 14:38 |
| pabelanger | ianw: clarkb: ^we should just add that directly into DIB, that was the issue we had at the PTG if you remember | 14:40 |
| *** john-davidge has joined #openstack-infra | 14:43 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Update APT indexes before bringing node online https://review.openstack.org/455063 | 14:43 |
| pabelanger | ianw: clarkb: likely want ^ too | 14:43 |
| *** rhallisey has joined #openstack-infra | 14:45 | |
| *** john-davidge has quit IRC | 14:48 | |
| *** thorst has joined #openstack-infra | 14:48 | |
| *** armax has joined #openstack-infra | 14:50 | |
| *** ym200 has joined #openstack-infra | 14:50 | |
| *** esikachev has quit IRC | 14:51 | |
| pabelanger | ianw: who is maintaining the 3rd party CI for DIB? It seems broken | 14:52 |
| pabelanger | We're sorry, we hit a bug! | 14:53 |
| pabelanger | Mailman experienced a very low level failure and could not even generate a useful traceback for you. Please report this to the Mailman administrator at this site. | 14:53 |
| pabelanger | infra-root: there appears to be an issue with lists.o.o^ | 14:54 |
| *** ym200 has quit IRC | 14:55 | |
| pabelanger | [637874.277394] EXT4-fs (xvda1): Remounting filesystem read-only | 14:58 |
| pabelanger | going to try and put the server into rescue mode | 15:03 |
| *** armax has quit IRC | 15:06 | |
| *** beslemon has joined #openstack-infra | 15:07 | |
| *** thorst has quit IRC | 15:07 | |
| *** EricGonczer_ has quit IRC | 15:12 | |
| *** kzaitsev_mb has joined #openstack-infra | 15:13 | |
| pabelanger | # status notice We are preforming unscheduled maintenance on lists.openstack.org, the service is currently down. We'll post a follow up shortly | 15:14 |
| pabelanger | #status notice We are preforming unscheduled maintenance on lists.openstack.org, the service is currently down. We'll post a follow up shortly | 15:15 |
| openstackstatus | pabelanger: sending notice | 15:15 |
| *** mtanino has joined #openstack-infra | 15:15 | |
| -openstackstatus- NOTICE: We are preforming unscheduled maintenance on lists.openstack.org, the service is currently down. We'll post a follow up shortly | 15:16 | |
| *** rhallisey has quit IRC | 15:16 | |
| *** esberglu has joined #openstack-infra | 15:17 | |
| openstackstatus | pabelanger: finished sending notice | 15:18 |
| *** esberglu has quit IRC | 15:21 | |
| *** esikachev has joined #openstack-infra | 15:22 | |
| *** beslemon has quit IRC | 15:22 | |
| *** ssbarnea has quit IRC | 15:24 | |
| *** esikachev has quit IRC | 15:27 | |
| *** thorst has joined #openstack-infra | 15:37 | |
| *** thorst has quit IRC | 15:37 | |
| pabelanger | Hmm, this might be more work then expected | 15:38 |
| *** ogalush has joined #openstack-infra | 15:41 | |
| mnaser | pabelanger fsck time? :x | 15:42 |
| *** gouthamr has joined #openstack-infra | 15:42 | |
| *** kzaitsev_mb has quit IRC | 15:43 | |
| clarkb | slowly waking up here. You mean getting it mounted under recovery instance is more work? | 15:43 |
| pabelanger | Ya, have it under recovery now | 15:44 |
| *** esikachev has joined #openstack-infra | 15:46 | |
| pabelanger | fsck -f /dev/xvdb1 going now | 15:47 |
| *** gouthamr has quit IRC | 15:49 | |
| clarkb | woo just had chrome OOM my desktop... let us know ow that fsck goes | 15:51 |
| pabelanger | phase 2 now | 15:52 |
| pabelanger | we should get some docs up explain the steps for this | 15:53 |
| clarkb | ++ guessing you had to get an ssh key loaded into rax so that you could get onto recovery instance? | 15:56 |
| openstackgerrit | Paul Belanger proposed openstack/diskimage-builder master: Clean out apt index caches at end of image build https://review.openstack.org/455062 | 15:57 |
| pabelanger | clarkb: I had to fight with my browser to load the console in the web | 15:57 |
| pabelanger | clarkb: however, I eventually read the message that pops up saying you could SSH | 15:58 |
| pabelanger | don't need to setup a key, root / pw worked | 15:58 |
| clarkb | ah cooll | 15:58 |
| *** mat128 has joined #openstack-infra | 16:00 | |
| *** dimtruck is now known as zz_dimtruck | 16:01 | |
| *** mat128 has quit IRC | 16:02 | |
| pabelanger | k, looks done | 16:02 |
| clarkb | no crazy errors? | 16:03 |
| pabelanger | nope, just some unattached inodes | 16:04 |
| pabelanger | server, rebooted | 16:05 |
| pabelanger | lists.o.o online | 16:05 |
| pabelanger | checking logs now | 16:05 |
| pabelanger | mailman running again | 16:05 |
| clarkb | pabelanger: should I send a test email? | 16:05 |
| pabelanger | clarkb: sure | 16:05 |
| clarkb | ok sent in response to jeblair's test message from after upgrade | 16:06 |
| pabelanger | I believe mailman is working, but not familiar enough to check the queue stats | 16:07 |
| clarkb | it looks like I may have received what I sent, have you gotten it? | 16:07 |
| pabelanger | offlineimap running now | 16:07 |
| clarkb | pabelanger: `mailq` is the command iirc. Not sure what flags are useful though | 16:07 |
| mnaser | is this exim? | 16:08 |
| clarkb | mnaser: yes | 16:08 |
| mnaser | if so exim -bpc will show the # of emails in the queue | 16:08 |
| *** mat128 has joined #openstack-infra | 16:08 | |
| pabelanger | 84 | 16:08 |
| clarkb | ya I think mailq is just an alias in front of various exim/sendmail/postfix commands depending on what you've got installed | 16:08 |
| mnaser | that seems reasonable. im not sure if the tool exists on that machine but you can type "exiqgrep" to get a list of things which are in queue as well | 16:09 |
| *** kzaitsev_mb has joined #openstack-infra | 16:09 | |
| *** mat128 has quit IRC | 16:09 | |
| clarkb | http://lists.openstack.org/pipermail/openstack-infra/2017-April/005290.html shows up in the archive so its getting that far at least | 16:09 |
| AJaeger | clarkb's test message is in the archive at http://lists.openstack.org/pipermail/openstack-infra/2017-April/005290.html | 16:09 |
| * AJaeger leaves again instead of sending more duplicates ;) | 16:10 | |
| AJaeger | thanks, pabelanger for taking care of this | 16:10 |
| clarkb | AJaeger: :) did you receive the message? | 16:10 |
| AJaeger | clarkb: not yet | 16:11 |
| clarkb | my gmail account which is also subscribed got it so I think its working | 16:11 |
| * cmurphy sees it | 16:11 | |
| *** mriedem has joined #openstack-infra | 16:12 | |
| pabelanger | still waiting here | 16:12 |
| *** kzaitsev_mb has quit IRC | 16:14 | |
| *** EricGonczer_ has joined #openstack-infra | 16:14 | |
| * AJaeger received it | 16:17 | |
| pabelanger | just now too | 16:17 |
| clarkb | awesome, thanks for jumping on this pabelanger, anything else you think we should do before we return to regularly scheduled weekending? | 16:18 |
| pabelanger | clarkb: nope, I think it is a waiting game now for mailq to clear out | 16:19 |
| pabelanger | I think we can wrap things up | 16:19 |
| pabelanger | #status notice lists.openstack.org is back online. Thanks for your patience. | 16:19 |
| openstackstatus | pabelanger: sending notice | 16:19 |
| -openstackstatus- NOTICE: lists.openstack.org is back online. Thanks for your patience. | 16:21 | |
| openstackstatus | pabelanger: finished sending notice | 16:23 |
| *** EricGonczer_ has quit IRC | 16:33 | |
| *** d0ugal has quit IRC | 16:36 | |
| *** d0ugal has joined #openstack-infra | 16:36 | |
| openstackgerrit | Tom Barron proposed openstack-infra/project-config master: Add experimental manila cephfs CentOS jobs https://review.openstack.org/453910 | 16:37 |
| *** thorst has joined #openstack-infra | 16:38 | |
| *** nadya has joined #openstack-infra | 16:39 | |
| *** thorst has quit IRC | 16:43 | |
| *** ogalush has quit IRC | 16:45 | |
| *** EricGonczer_ has joined #openstack-infra | 16:54 | |
| *** cshastri has joined #openstack-infra | 17:00 | |
| *** esberglu has joined #openstack-infra | 17:05 | |
| *** cshastri has quit IRC | 17:06 | |
| *** EricGonczer_ has quit IRC | 17:06 | |
| *** ociuhandu has quit IRC | 17:08 | |
| *** ociuhandu has joined #openstack-infra | 17:08 | |
| *** esberglu has quit IRC | 17:10 | |
| *** kzaitsev_mb has joined #openstack-infra | 17:11 | |
| *** nadya has quit IRC | 17:13 | |
| *** ssbarnea has joined #openstack-infra | 17:16 | |
| *** ym200 has joined #openstack-infra | 17:18 | |
| *** nadya has joined #openstack-infra | 17:19 | |
| *** knangia has joined #openstack-infra | 17:20 | |
| *** ym200 has quit IRC | 17:22 | |
| *** nadya has quit IRC | 17:25 | |
| *** ym200 has joined #openstack-infra | 17:26 | |
| *** zz_dimtruck is now known as dimtruck | 17:27 | |
| *** ym200 has quit IRC | 17:30 | |
| *** thorst has joined #openstack-infra | 17:39 | |
| *** kzaitsev_mb has quit IRC | 17:42 | |
| *** thorst has quit IRC | 17:43 | |
| *** rvba has quit IRC | 17:48 | |
| *** nadya has joined #openstack-infra | 17:53 | |
| *** rvba has joined #openstack-infra | 17:58 | |
| *** rvba has quit IRC | 17:58 | |
| *** rvba has joined #openstack-infra | 17:58 | |
| *** nadya has quit IRC | 17:59 | |
| *** kzaitsev_mb has joined #openstack-infra | 18:08 | |
| *** EricGonczer_ has joined #openstack-infra | 18:08 | |
| *** nadya has joined #openstack-infra | 18:11 | |
| *** kzaitsev_mb has quit IRC | 18:13 | |
| *** EricGonczer_ has quit IRC | 18:14 | |
| *** nadya has quit IRC | 18:25 | |
| *** gouthamr has joined #openstack-infra | 18:43 | |
| fungi | back from errands now. is there any indication of what triggered the incident? | 18:44 |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Remove RDO AFS mirror https://review.openstack.org/455081 | 18:46 |
| pabelanger | fungi: I didn't see much in the logs. However, I also didn't dive deep into it. | 18:46 |
| fungi | rootfs corruption makes me think it was something in the service provider | 18:47 |
| pabelanger | yes, that is my thoughts too | 18:47 |
| fungi | the only open tickets for that tenant are about trove connectivity outages for maintenances scheduled april 11-14 | 18:48 |
| fungi | logs in /var likely won't be much help if the filesystem was remounted read-only due to errors | 18:49 |
| fungi | did you happen to grab anything useful out of dmesg? | 18:49 |
| fungi | nothing current alarming on status.r.c except their load-balancer service which is obviously unrelated | 18:50 |
| pabelanger | not much, as an example: | 18:51 |
| pabelanger | EXT4-fs error (device xvda1): ext4_lookup:1430: inode #123083 | 18:51 |
| pabelanger | Aborting journal on device xvda1-8 | 18:51 |
| *** esikachev has quit IRC | 18:52 | |
| *** esikachev has joined #openstack-infra | 18:53 | |
| *** esberglu has joined #openstack-infra | 18:53 | |
| *** rfolco has joined #openstack-infra | 18:55 | |
| *** esberglu has quit IRC | 18:59 | |
| *** kzaitsev_mb has joined #openstack-infra | 19:10 | |
| *** dimtruck is now known as zz_dimtruck | 19:15 | |
| *** wolverineav has joined #openstack-infra | 19:16 | |
| *** zz_dimtruck is now known as dimtruck | 19:18 | |
| *** ociuhandu has quit IRC | 19:22 | |
| *** ociuhandu has joined #openstack-infra | 19:25 | |
| *** ym200 has joined #openstack-infra | 19:26 | |
| *** esikachev has quit IRC | 19:28 | |
| *** ym200 has quit IRC | 19:30 | |
| *** knangia has quit IRC | 19:31 | |
| *** gouthamr has quit IRC | 19:37 | |
| *** esikachev has joined #openstack-infra | 19:39 | |
| *** HeOS has joined #openstack-infra | 19:40 | |
| *** mtanino has quit IRC | 19:40 | |
| *** kzaitsev_mb has quit IRC | 19:41 | |
| *** mriedem has quit IRC | 19:41 | |
| *** thorst has joined #openstack-infra | 19:41 | |
| *** rhallisey has joined #openstack-infra | 19:41 | |
| *** esikachev has quit IRC | 19:44 | |
| *** thorst has quit IRC | 19:45 | |
| *** EricGonczer_ has joined #openstack-infra | 19:47 | |
| openstackgerrit | Andreas Florath proposed openstack/diskimage-builder master: DNM: testing fedora problem https://review.openstack.org/455084 | 19:48 |
| *** EricGonczer_ has quit IRC | 19:51 | |
| *** esikachev has joined #openstack-infra | 19:54 | |
| *** gouthamr has joined #openstack-infra | 19:55 | |
| *** esikachev has quit IRC | 20:00 | |
| *** ociuhandu has quit IRC | 20:01 | |
| *** HeOS has quit IRC | 20:02 | |
| *** gouthamr has quit IRC | 20:03 | |
| *** Hal has joined #openstack-infra | 20:03 | |
| *** kzaitsev_mb has joined #openstack-infra | 20:06 | |
| *** gouthamr has joined #openstack-infra | 20:07 | |
| *** kzaitsev_mb has quit IRC | 20:11 | |
| *** ociuhandu has joined #openstack-infra | 20:12 | |
| *** HeOS has joined #openstack-infra | 20:16 | |
| *** erikmwilson has quit IRC | 20:16 | |
| openstackgerrit | Andreas Florath proposed openstack/diskimage-builder master: Easy DIB development: add dibdevel-run element https://review.openstack.org/444666 | 20:22 |
| *** jesusaur has quit IRC | 20:24 | |
| *** jesusaur has joined #openstack-infra | 20:27 | |
| *** erikmwilson has joined #openstack-infra | 20:31 | |
| *** gouthamr has quit IRC | 20:33 | |
| *** gouthamr has joined #openstack-infra | 20:35 | |
| *** HeOS has quit IRC | 20:36 | |
| *** esberglu has joined #openstack-infra | 20:42 | |
| *** thorst has joined #openstack-infra | 20:42 | |
| *** esberglu has quit IRC | 20:46 | |
| *** gouthamr has quit IRC | 20:55 | |
| *** e0ne has joined #openstack-infra | 20:58 | |
| *** gouthamr has joined #openstack-infra | 20:59 | |
| *** ssbarnea has quit IRC | 21:00 | |
| *** thorst has quit IRC | 21:01 | |
| openstackgerrit | Andreas Florath proposed openstack/diskimage-builder master: Easy DIB development: add dibdevel-run element https://review.openstack.org/444666 | 21:03 |
| *** e0ne has quit IRC | 21:04 | |
| *** rfolco has quit IRC | 21:11 | |
| *** kzaitsev_mb has joined #openstack-infra | 21:12 | |
| *** aeng has joined #openstack-infra | 21:14 | |
| *** knangia has joined #openstack-infra | 21:24 | |
| *** wolverineav has quit IRC | 21:25 | |
| *** wolverineav has joined #openstack-infra | 21:26 | |
| *** ym200 has joined #openstack-infra | 21:27 | |
| *** sekelso has joined #openstack-infra | 21:28 | |
| *** ym200 has quit IRC | 21:32 | |
| *** EricGonczer_ has joined #openstack-infra | 21:35 | |
| *** esberglu has joined #openstack-infra | 21:36 | |
| *** kzaitsev_mb has quit IRC | 21:37 | |
| ianw | hello, look like a missed a bunch of fun | 21:39 |
| *** esberglu has quit IRC | 21:40 | |
| *** EricGonczer_ has quit IRC | 21:40 | |
| *** thorst has joined #openstack-infra | 21:58 | |
| *** esikachev has joined #openstack-infra | 21:58 | |
| *** thorst has quit IRC | 22:02 | |
| *** esikachev has quit IRC | 22:02 | |
| *** kzaitsev_mb has joined #openstack-infra | 22:04 | |
| *** wolverineav has quit IRC | 22:09 | |
| *** kzaitsev_mb has quit IRC | 22:09 | |
| *** wolverineav has joined #openstack-infra | 22:10 | |
| *** askb has joined #openstack-infra | 22:16 | |
| *** mriedem has joined #openstack-infra | 22:19 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Move do_extra_package_install to run in install phase https://review.openstack.org/452653 | 22:21 |
| *** ym200 has joined #openstack-infra | 22:27 | |
| *** sshnaidm|afk has quit IRC | 22:28 | |
| *** pradk has joined #openstack-infra | 22:31 | |
| *** ym200 has quit IRC | 22:32 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Move do_extra_package_install to run in install phase https://review.openstack.org/452653 | 22:33 |
| *** ym200 has joined #openstack-infra | 22:34 | |
| *** dingyichen has quit IRC | 22:34 | |
| ianw | pabelanger: previously re dib 3rd party -- you mean the power testing? yes, unfortunately it is broken right now ... working on it. it's a known issue with it's bootloader | 22:35 |
| *** dingyichen has joined #openstack-infra | 22:35 | |
| *** esikachev has joined #openstack-infra | 22:38 | |
| *** ym200 has quit IRC | 22:38 | |
| *** esikachev has quit IRC | 22:42 | |
| *** rfolco has joined #openstack-infra | 22:49 | |
| *** sekelso has quit IRC | 22:50 | |
| *** armax has joined #openstack-infra | 22:50 | |
| *** tosky has quit IRC | 22:53 | |
| *** gouthamr has quit IRC | 22:56 | |
| *** dimtruck is now known as zz_dimtruck | 23:01 | |
| *** ym200 has joined #openstack-infra | 23:05 | |
| *** kzaitsev_mb has joined #openstack-infra | 23:06 | |
| *** esikachev has joined #openstack-infra | 23:07 | |
| *** ym200 has quit IRC | 23:09 | |
| *** esikachev has quit IRC | 23:11 | |
| *** EricGonczer_ has joined #openstack-infra | 23:15 | |
| *** esikachev has joined #openstack-infra | 23:16 | |
| *** esikachev has quit IRC | 23:21 | |
| *** esberglu has joined #openstack-infra | 23:24 | |
| *** gouthamr has joined #openstack-infra | 23:25 | |
| *** esberglu has quit IRC | 23:29 | |
| *** pahuang has joined #openstack-infra | 23:29 | |
| *** zz_dimtruck is now known as dimtruck | 23:29 | |
| *** thorst has joined #openstack-infra | 23:30 | |
| *** kzaitsev_mb has quit IRC | 23:38 | |
| *** ym200 has joined #openstack-infra | 23:41 | |
| *** ym200 has quit IRC | 23:45 | |
| *** wolverineav has quit IRC | 23:45 | |
| *** eharney has quit IRC | 23:54 | |
| *** rfolco has quit IRC | 23:58 | |
| *** pradk has quit IRC | 23:58 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!