*** sdake_ is now known as sdake | 00:21 | |
*** ianychoi has joined #openstack-infra | 00:30 | |
*** winggundamth has quit IRC | 00:31 | |
*** baoli has quit IRC | 00:34 | |
*** salv-orlando has joined #openstack-infra | 00:43 | |
*** markvoelker has joined #openstack-infra | 00:46 | |
*** rbuzatu has joined #openstack-infra | 00:48 | |
*** salv-orlando has quit IRC | 00:48 | |
*** markvoelker has quit IRC | 00:51 | |
*** baoli has joined #openstack-infra | 01:03 | |
*** baoli has quit IRC | 01:04 | |
*** rbuzatu has quit IRC | 01:14 | |
*** rbuzatu has joined #openstack-infra | 01:15 | |
*** baoli has joined #openstack-infra | 01:16 | |
*** baoli has quit IRC | 01:16 | |
*** askb has quit IRC | 01:27 | |
*** hongbin has quit IRC | 01:42 | |
*** salv-orlando has joined #openstack-infra | 01:44 | |
*** markvoelker has joined #openstack-infra | 01:47 | |
*** salv-orlando has quit IRC | 01:48 | |
*** benj_ has quit IRC | 01:50 | |
*** baoli has joined #openstack-infra | 01:51 | |
*** markvoelker has quit IRC | 01:51 | |
*** baoli has quit IRC | 01:51 | |
*** sdake_ has joined #openstack-infra | 01:52 | |
*** benj_ has joined #openstack-infra | 01:52 | |
*** sdake has quit IRC | 01:54 | |
*** benj_ has quit IRC | 02:02 | |
*** baoli has joined #openstack-infra | 02:04 | |
*** benj_ has joined #openstack-infra | 02:04 | |
*** sdake_ has quit IRC | 02:08 | |
*** jeckersb_gone is now known as jeckersb | 02:10 | |
*** baoli has quit IRC | 02:12 | |
*** jeckersb is now known as jeckersb_gone | 02:12 | |
*** baoli has joined #openstack-infra | 02:13 | |
*** baoli has quit IRC | 02:13 | |
*** hongbin has joined #openstack-infra | 02:17 | |
*** benj_ has quit IRC | 02:17 | |
*** sdake has joined #openstack-infra | 02:18 | |
*** benj_ has joined #openstack-infra | 02:19 | |
*** wolverineav has joined #openstack-infra | 02:19 | |
*** wolverineav has quit IRC | 02:24 | |
*** benj_ has quit IRC | 02:30 | |
*** david-lyle has joined #openstack-infra | 02:35 | |
*** benj_ has joined #openstack-infra | 02:35 | |
*** david-lyle has quit IRC | 02:39 | |
*** Julien-zte has joined #openstack-infra | 02:44 | |
*** salv-orlando has joined #openstack-infra | 02:44 | |
*** halprin has left #openstack-infra | 02:47 | |
*** markvoelker has joined #openstack-infra | 02:48 | |
*** salv-orlando has quit IRC | 02:49 | |
*** markvoelker has quit IRC | 02:52 | |
*** baoli has joined #openstack-infra | 02:58 | |
*** baoli has quit IRC | 02:58 | |
*** Jeffrey4l__ has joined #openstack-infra | 03:05 | |
*** Jeffrey4l_ has quit IRC | 03:09 | |
*** hongbin has quit IRC | 03:11 | |
*** ramishra has joined #openstack-infra | 03:13 | |
*** rbuzatu has quit IRC | 03:28 | |
*** links has joined #openstack-infra | 03:36 | |
*** vikrant has joined #openstack-infra | 03:38 | |
*** baoli has joined #openstack-infra | 03:40 | |
*** salv-orlando has joined #openstack-infra | 03:45 | |
*** markvoelker has joined #openstack-infra | 03:48 | |
*** psachin has joined #openstack-infra | 03:49 | |
*** salv-orlando has quit IRC | 03:50 | |
*** markvoelker has quit IRC | 03:53 | |
*** sdake has quit IRC | 04:07 | |
*** zz_dimtruck is now known as dimtruck | 04:09 | |
*** hongbin has joined #openstack-infra | 04:18 | |
*** dimtruck is now known as zz_dimtruck | 04:28 | |
*** zz_dimtruck is now known as dimtruck | 04:28 | |
*** rbuzatu has joined #openstack-infra | 04:29 | |
timrc_ | Happy New Year, everyone! | 04:31 |
---|---|---|
*** sdake has joined #openstack-infra | 04:33 | |
*** sdake_ has joined #openstack-infra | 04:36 | |
*** david-lyle has joined #openstack-infra | 04:36 | |
*** dimtruck is now known as zz_dimtruck | 04:37 | |
*** baoli has quit IRC | 04:39 | |
*** sdake has quit IRC | 04:40 | |
*** david-lyle has quit IRC | 04:41 | |
*** salv-orlando has joined #openstack-infra | 04:46 | |
*** markvoelker has joined #openstack-infra | 04:49 | |
*** snarwade has joined #openstack-infra | 04:50 | |
*** salv-orlando has quit IRC | 04:51 | |
*** markvoelker has quit IRC | 04:53 | |
*** baoli has joined #openstack-infra | 04:53 | |
*** rbuzatu has quit IRC | 05:03 | |
*** hongbin has quit IRC | 05:03 | |
*** gus has quit IRC | 05:05 | |
*** baoli has quit IRC | 05:11 | |
*** lindycoder has joined #openstack-infra | 05:15 | |
*** lindycoder has quit IRC | 05:19 | |
*** winggundamth has joined #openstack-infra | 05:23 | |
*** coolsvap has joined #openstack-infra | 05:24 | |
*** zz_dimtruck is now known as dimtruck | 05:28 | |
*** dimtruck is now known as zz_dimtruck | 05:38 | |
*** salv-orlando has joined #openstack-infra | 05:47 | |
*** sdake has joined #openstack-infra | 05:47 | |
*** markvoelker has joined #openstack-infra | 05:50 | |
*** sdake_ has quit IRC | 05:51 | |
*** salv-orlando has quit IRC | 05:51 | |
*** markvoelker has quit IRC | 05:54 | |
*** gouthamr has joined #openstack-infra | 05:55 | |
*** Ravikiran_K has joined #openstack-infra | 05:59 | |
*** rbuzatu has joined #openstack-infra | 06:00 | |
*** abregman has joined #openstack-infra | 06:12 | |
*** gouthamr has quit IRC | 06:19 | |
*** winggundamth has quit IRC | 06:28 | |
*** zz_dimtruck is now known as dimtruck | 06:29 | |
*** salv-orlando has joined #openstack-infra | 06:29 | |
*** sdake has quit IRC | 06:31 | |
*** rbuzatu has quit IRC | 06:34 | |
*** sdake has joined #openstack-infra | 06:38 | |
*** dimtruck is now known as zz_dimtruck | 06:39 | |
*** winggundamth has joined #openstack-infra | 06:40 | |
*** nadya has joined #openstack-infra | 06:57 | |
*** hurgleburgler has quit IRC | 07:02 | |
*** zz_dimtruck is now known as dimtruck | 07:09 | |
*** Guest71130 has quit IRC | 07:10 | |
*** salv-orl_ has joined #openstack-infra | 07:13 | |
*** salv-orlando has quit IRC | 07:16 | |
openstackgerrit | Khai Do proposed openstack-infra/puppet-gerrit: Refactor how puppet sets Gerrit's gitweb configs https://review.openstack.org/416015 | 07:18 |
*** dimtruck is now known as zz_dimtruck | 07:19 | |
clarkb | Because I just noticed but its too late at night for me to deal wiht it right this moment, it looks like journald on our d-g runs may be dropping older messages | 07:21 |
clarkb | basically job starts at 1700 ish but syslog starts at 1800 ish | 07:21 |
*** nadya has quit IRC | 07:21 | |
clarkb | I do not think this is related to any of the ansibly changes | 07:22 |
*** pcaruana has joined #openstack-infra | 07:23 | |
*** pgadiya has joined #openstack-infra | 07:23 | |
*** slaweq_ has joined #openstack-infra | 07:27 | |
openstackgerrit | Khai Do proposed openstack-infra/system-config: Define Gerrit's gitweb configs as a dict https://review.openstack.org/416018 | 07:27 |
*** sdake has quit IRC | 07:28 | |
*** nadya has joined #openstack-infra | 07:30 | |
*** rbuzatu has joined #openstack-infra | 07:31 | |
*** cemason1 is now known as cemason | 07:33 | |
*** yuli_s has quit IRC | 07:33 | |
*** florianf has joined #openstack-infra | 07:36 | |
flip214_ | Hi. The gate-tempest-dsvm-full-drbd-devstack-ubuntu-xenial-nv CI job has been failing for some time, and the only thing I could see in the log files was | 07:36 |
flip214_ | hat "lvcreate" and similar commands took much too long (eg. 90 seconds). | 07:36 |
flip214_ | here's no kern.log archived any more (with Trusty it was saved, too); so I'd like to ask for SSH access to a node running this check, to find out what's going wrong. | 07:36 |
flip214_ | My SSH pubkey is available on request. | 07:36 |
*** sdake has joined #openstack-infra | 07:37 | |
*** rcernin has joined #openstack-infra | 07:37 | |
*** rcernin has quit IRC | 07:39 | |
*** coolsvap has quit IRC | 07:39 | |
clarkb | flip214_: there is no kern.log because we dump all the messages from journald since the time the job started | 07:41 |
clarkb | you'll find all of those messages in the single syslog file now (though if the issue above that I mention is prevalent you may not get them from the beginning of jobs) | 07:41 |
*** rcernin has joined #openstack-infra | 07:41 | |
clarkb | I'd start by checking that log file though | 07:41 |
openstackgerrit | Khai Do proposed openstack-infra/system-config: Fix gitweb configuration on review-dev.o.o https://review.openstack.org/416020 | 07:42 |
*** jtomasek has joined #openstack-infra | 07:44 | |
*** nadya has quit IRC | 07:47 | |
openstackgerrit | Khai Do proposed openstack-infra/puppet-gerrit: Refactor how puppet sets Gerrit's gitweb configs https://review.openstack.org/416015 | 07:51 |
*** rcernin has quit IRC | 07:51 | |
*** rcernin has joined #openstack-infra | 07:52 | |
flip214_ | clarkb: I looked at that one, of course. | 07:58 |
flip214_ | but there's stuff missing, as far as I can say. | 07:58 |
clarkb | ya I think journald may be circularly buffering and dropping older messages | 07:59 |
clarkb | will have to dig into that tomorrow | 07:59 |
*** zz_dimtruck is now known as dimtruck | 08:00 | |
*** bhavik1 has joined #openstack-infra | 08:01 | |
*** yuval has joined #openstack-infra | 08:02 | |
*** rbuzatu has quit IRC | 08:04 | |
*** bhavik1 has quit IRC | 08:07 | |
*** markus_z has joined #openstack-infra | 08:08 | |
*** dimtruck is now known as zz_dimtruck | 08:10 | |
*** Hal has joined #openstack-infra | 08:12 | |
*** Hal is now known as Guest75274 | 08:12 | |
openstackgerrit | Steven Dake proposed openstack-infra/reviewday: Add kolla deliverables to reviewday https://review.openstack.org/376685 | 08:16 |
openstackgerrit | Khai Do proposed openstack-infra/puppet-gerrit: Refactor how puppet sets Gerrit's gitweb configs https://review.openstack.org/416015 | 08:17 |
*** rbuzatu has joined #openstack-infra | 08:19 | |
*** abregman has quit IRC | 08:27 | |
*** abregman has joined #openstack-infra | 08:30 | |
*** salv-orl_ has quit IRC | 08:30 | |
*** nmagnezi has joined #openstack-infra | 08:33 | |
*** sdake has quit IRC | 08:38 | |
*** nadya has joined #openstack-infra | 08:41 | |
*** nmagnezi has quit IRC | 08:43 | |
*** rbuzatu has quit IRC | 08:46 | |
*** nmagnezi has joined #openstack-infra | 08:46 | |
*** arxcruz has joined #openstack-infra | 08:51 | |
*** flepied has joined #openstack-infra | 08:51 | |
*** Guest75274 has quit IRC | 08:58 | |
*** Hal has joined #openstack-infra | 08:58 | |
*** Hal is now known as Guest82351 | 08:59 | |
*** zzzeek has quit IRC | 09:00 | |
*** zzzeek has joined #openstack-infra | 09:00 | |
*** pgadiya has quit IRC | 09:00 | |
*** Guest82351 has quit IRC | 09:01 | |
*** zz_dimtruck is now known as dimtruck | 09:01 | |
*** rbuzatu has joined #openstack-infra | 09:01 | |
*** salv-orlando has joined #openstack-infra | 09:02 | |
*** pgadiya has joined #openstack-infra | 09:05 | |
*** abregman has quit IRC | 09:05 | |
*** hashar has joined #openstack-infra | 09:09 | |
*** dimtruck is now known as zz_dimtruck | 09:11 | |
*** d0ugal has joined #openstack-infra | 09:14 | |
*** abregman has joined #openstack-infra | 09:14 | |
*** pgadiya has quit IRC | 09:20 | |
*** dtantsur|afk is now known as dtantsur | 09:26 | |
*** pgadiya has joined #openstack-infra | 09:26 | |
*** mat128_ has quit IRC | 09:28 | |
*** aviau has quit IRC | 09:29 | |
*** zul has quit IRC | 09:30 | |
*** cschwede has quit IRC | 09:30 | |
*** rbuzatu has quit IRC | 09:30 | |
*** mat128 has joined #openstack-infra | 09:31 | |
*** cschwede has joined #openstack-infra | 09:31 | |
*** aviau has joined #openstack-infra | 09:31 | |
*** SotK_ has quit IRC | 09:31 | |
*** zul has joined #openstack-infra | 09:31 | |
*** SotK has joined #openstack-infra | 09:32 | |
*** askb has joined #openstack-infra | 09:37 | |
flip214_ | clarkb: I don't think it's older messages; I believe that not all kernel log levels are being stored somehow. | 09:40 |
*** fbo has joined #openstack-infra | 09:52 | |
*** zz_dimtruck is now known as dimtruck | 10:01 | |
*** d0ugal has quit IRC | 10:06 | |
*** dimtruck is now known as zz_dimtruck | 10:13 | |
*** tosky has joined #openstack-infra | 10:27 | |
*** Ravikiran_K has quit IRC | 10:36 | |
*** dargains has joined #openstack-infra | 10:47 | |
*** dmellado has joined #openstack-infra | 10:56 | |
*** zz_dimtruck is now known as dimtruck | 11:04 | |
*** dargains has quit IRC | 11:07 | |
*** askb has quit IRC | 11:11 | |
*** mptacekx has joined #openstack-infra | 11:11 | |
*** nadya has quit IRC | 11:13 | |
*** dimtruck is now known as zz_dimtruck | 11:14 | |
mptacekx | Hi, happy new year :-) Can someone from devstack-gate core's take a look on https://review.openstack.org/#/c/407424/ please ... | 11:14 |
*** dargains has joined #openstack-infra | 11:14 | |
*** Hal has joined #openstack-infra | 11:15 | |
*** Hal is now known as Guest54702 | 11:16 | |
*** rossella_s has joined #openstack-infra | 11:19 | |
*** lseki has joined #openstack-infra | 11:28 | |
*** cdent has joined #openstack-infra | 11:32 | |
openstackgerrit | Dmitry Tantsur proposed openstack-infra/project-config: Fix ordering in the ironic-inspector grenade job definition https://review.openstack.org/416035 | 11:40 |
flip214_ | clarkb: http://logs.openstack.org/56/415956/1/check/gate-tempest-dsvm-full-drbd-devstack-ubuntu-xenial-nv/d05f4ca/logs/syslog.txt.gz#_Jan_01_12_55_30 | 11:45 |
flip214_ | shows that something strange happens with the loop device that is used as a VG | 11:45 |
flip214_ | and then the worker gets killed: http://logs.openstack.org/56/415956/1/check/gate-tempest-dsvm-full-drbd-devstack-ubuntu-xenial-nv/d05f4ca/logs/syslog.txt.gz#_Jan_01_13_29_05 | 11:46 |
flip214_ | but no kernel messages with more details about that | 11:47 |
dtantsur | hi! can somebody please check https://review.openstack.org/#/c/414109/? it will hopefully fix our grenade finally.. | 11:48 |
*** rossella_s has quit IRC | 11:54 | |
*** wolverineav has joined #openstack-infra | 11:57 | |
*** bhavik1 has joined #openstack-infra | 11:57 | |
*** ccamacho is now known as ccamacho|lunch | 11:58 | |
*** wolverin_ has joined #openstack-infra | 11:59 | |
*** bhavik1 has quit IRC | 12:00 | |
*** wolverineav has quit IRC | 12:03 | |
*** florianf has quit IRC | 12:03 | |
*** salv-orlando has quit IRC | 12:04 | |
*** zz_dimtruck is now known as dimtruck | 12:05 | |
*** dargains has quit IRC | 12:06 | |
*** asettle has joined #openstack-infra | 12:07 | |
*** dargains has joined #openstack-infra | 12:09 | |
*** hashar is now known as hasharLunch | 12:09 | |
*** pgadiya has quit IRC | 12:10 | |
*** dimtruck is now known as zz_dimtruck | 12:14 | |
*** asettle has quit IRC | 12:17 | |
*** florianf has joined #openstack-infra | 12:19 | |
*** asettle has joined #openstack-infra | 12:21 | |
*** dargains has quit IRC | 12:23 | |
*** yamamoto has joined #openstack-infra | 12:32 | |
*** snarwade has quit IRC | 12:38 | |
*** vikrant has quit IRC | 12:40 | |
*** vikrant has joined #openstack-infra | 12:41 | |
*** salv-orlando has joined #openstack-infra | 12:41 | |
*** vikrant has quit IRC | 12:42 | |
*** jaypipes has joined #openstack-infra | 12:44 | |
*** rbuzatu has joined #openstack-infra | 12:49 | |
*** chem has joined #openstack-infra | 12:52 | |
*** rfolco has joined #openstack-infra | 12:54 | |
*** markvoelker has joined #openstack-infra | 12:55 | |
*** markvoelker has quit IRC | 13:00 | |
*** pcaruana has quit IRC | 13:00 | |
*** pcaruana has joined #openstack-infra | 13:04 | |
*** zz_dimtruck is now known as dimtruck | 13:05 | |
*** oomichi has quit IRC | 13:07 | |
openstackgerrit | Merged openstack-infra/openstackid: Removed TLD validation https://review.openstack.org/415582 | 13:08 |
*** oomichi has joined #openstack-infra | 13:08 | |
*** oomichi has quit IRC | 13:13 | |
*** nadya has joined #openstack-infra | 13:13 | |
*** salv-orl_ has joined #openstack-infra | 13:13 | |
*** baoli has joined #openstack-infra | 13:13 | |
*** baoli has quit IRC | 13:14 | |
*** oomichi has joined #openstack-infra | 13:14 | |
*** hasharLunch is now known as hashar | 13:14 | |
openstackgerrit | Simon proposed openstack-infra/jenkins-job-builder: Prevent creation of empty parameters for Repo https://review.openstack.org/416050 | 13:14 |
*** salv-orl_ has quit IRC | 13:15 | |
*** dimtruck is now known as zz_dimtruck | 13:15 | |
*** salv-orlando has quit IRC | 13:16 | |
*** yamamoto has quit IRC | 13:18 | |
*** nadya has quit IRC | 13:18 | |
*** rbuzatu has quit IRC | 13:19 | |
*** oomichi has quit IRC | 13:19 | |
*** shu-mutou-OFF has quit IRC | 13:20 | |
*** oomichi has joined #openstack-infra | 13:20 | |
*** oomichi has quit IRC | 13:22 | |
*** rbuzatu has joined #openstack-infra | 13:23 | |
*** oomichi has joined #openstack-infra | 13:25 | |
*** dargains has joined #openstack-infra | 13:26 | |
*** oomichi has quit IRC | 13:27 | |
*** oomichi has joined #openstack-infra | 13:30 | |
*** sdake has joined #openstack-infra | 13:33 | |
*** rbuzatu has quit IRC | 13:35 | |
*** ccamacho|lunch is now known as ccamacho | 13:37 | |
openstackgerrit | Dmitry Tantsur proposed openstack-infra/tripleo-ci: Run automated cleaning in the non-HA job on Ocata and newer https://review.openstack.org/408010 | 13:38 |
*** rbuzatu has joined #openstack-infra | 13:40 | |
*** tphummel has joined #openstack-infra | 13:43 | |
*** david-lyle has joined #openstack-infra | 13:43 | |
*** baoli has joined #openstack-infra | 13:46 | |
*** zul has quit IRC | 13:47 | |
*** david-lyle has quit IRC | 13:47 | |
*** zul has joined #openstack-infra | 13:51 | |
*** markvoelker has joined #openstack-infra | 13:56 | |
openstackgerrit | Steven Dake proposed openstack-infra/reviewday: Fix pep8 check gate fails completely https://review.openstack.org/416057 | 13:57 |
*** bhavik1 has joined #openstack-infra | 13:57 | |
sdake | hey folks if anyone is around - reviewday has failed to build for going on 6 weeks :) | 13:59 |
sdake | https://review.openstack.org/#/c/400227/ | 13:59 |
*** rlandy has joined #openstack-infra | 13:59 | |
sdake | rather the gate has been blocked | 14:00 |
*** markvoelker has quit IRC | 14:00 | |
*** baoli has quit IRC | 14:02 | |
*** baoli has joined #openstack-infra | 14:06 | |
*** zz_dimtruck is now known as dimtruck | 14:06 | |
*** links has quit IRC | 14:09 | |
*** rcernin has quit IRC | 14:09 | |
*** rcernin has joined #openstack-infra | 14:11 | |
*** bhavik1 has quit IRC | 14:11 | |
*** baoli has quit IRC | 14:12 | |
*** rbuzatu has quit IRC | 14:13 | |
*** e0ne has joined #openstack-infra | 14:14 | |
*** rbuzatu has joined #openstack-infra | 14:14 | |
*** salv-orlando has joined #openstack-infra | 14:15 | |
*** dimtruck is now known as zz_dimtruck | 14:16 | |
*** dtantsur is now known as dtantsur|bbl | 14:18 | |
*** yamamoto has joined #openstack-infra | 14:19 | |
*** e0ne has quit IRC | 14:20 | |
*** salv-orlando has quit IRC | 14:21 | |
*** psachin has quit IRC | 14:21 | |
*** e0ne has joined #openstack-infra | 14:24 | |
*** e0ne has quit IRC | 14:26 | |
*** yamamoto has quit IRC | 14:29 | |
*** e0ne has joined #openstack-infra | 14:30 | |
*** berendt has joined #openstack-infra | 14:32 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: DONT MERGE: test periodic with swap https://review.openstack.org/416065 | 14:33 |
berendt | When running gate jobs, is it possible to exclude a specific cloud provider? | 14:34 |
*** e0ne has quit IRC | 14:34 | |
*** e0ne has joined #openstack-infra | 14:38 | |
*** e0ne has quit IRC | 14:40 | |
*** ansiwen_ is now known as ansiwen | 14:50 | |
openstackgerrit | Merged openstack-infra/storyboard: H803 hacking have been deprecated https://review.openstack.org/413560 | 14:53 |
*** baoli has joined #openstack-infra | 14:56 | |
*** baoli has quit IRC | 14:56 | |
*** markvoelker has joined #openstack-infra | 14:57 | |
AJaeger | berendt: no. | 14:57 |
AJaeger | berendt: see also http://docs.openstack.org/infra/manual/testing.html | 14:58 |
*** markvoelker has quit IRC | 15:01 | |
*** baoli has joined #openstack-infra | 15:01 | |
*** baoli has quit IRC | 15:01 | |
*** asettle has quit IRC | 15:06 | |
*** zz_dimtruck is now known as dimtruck | 15:07 | |
*** dargains has quit IRC | 15:11 | |
openstackgerrit | Zara proposed openstack-infra/storyboard: Make it impossible to create a userless private story https://review.openstack.org/416070 | 15:11 |
*** hurgleburgler has joined #openstack-infra | 15:14 | |
*** links has joined #openstack-infra | 15:16 | |
*** salv-orlando has joined #openstack-infra | 15:17 | |
*** rbuzatu has quit IRC | 15:18 | |
*** rbuzatu has joined #openstack-infra | 15:18 | |
*** rbuzatu has quit IRC | 15:18 | |
*** rbuzatu has joined #openstack-infra | 15:18 | |
*** dargains has joined #openstack-infra | 15:21 | |
*** salv-orlando has quit IRC | 15:21 | |
*** baoli has joined #openstack-infra | 15:23 | |
*** baoli has quit IRC | 15:25 | |
*** dargains has quit IRC | 15:26 | |
*** mptacekx has quit IRC | 15:29 | |
openstackgerrit | Merged openstack-infra/project-config: Fix Inspector grenade: enable devstack plugin once https://review.openstack.org/414109 | 15:34 |
*** baoli has joined #openstack-infra | 15:38 | |
openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Enable ask-staging.openstack.org puppet run https://review.openstack.org/276656 | 15:41 |
*** salv-orlando has joined #openstack-infra | 15:41 | |
*** baoli has quit IRC | 15:43 | |
*** links has quit IRC | 15:44 | |
mrmartin | hi fungi | 15:44 |
*** david-lyle has joined #openstack-infra | 15:45 | |
mrmartin | the stackalytics.openstack.org not answering the http requests, is it happens due a maintenance, or just simply gone away? | 15:47 |
fungi | mrmartin: hey there. i was about to check in with you and find out if you're okay with me approving 408657 (i didn't want to approve that and disappear for days on end, but now that i'm around i'm happy to keep an eye on it) | 15:48 |
*** nmagnezi has quit IRC | 15:48 | |
fungi | mrmartin: not sure about stackalyics.o.o, i know there are some funky restart operations that happen when it updates which take it offline for long periods. maybe one of them got stuck | 15:48 |
fungi | i'll take a look | 15:48 |
*** david-lyle has quit IRC | 15:49 | |
AJaeger | happy new year, infra! | 15:49 |
fungi | mrmartin: since that site hasn't gone into production yet, i doubt anyone's been keeping a close watch on it | 15:50 |
mrmartin | I'm around today and tomorrow. May I get an ssh access, so I can help if something is going wrong? I did the tests, and the patchset is running well in my local dev instance, but who knows, askbot upgrades can be tricky. | 15:50 |
fungi | happy new year AJaeger! | 15:50 |
AJaeger | fungi, clarkb, pabelanger : There're quite a few open requests for project-config that have one +2 - if either of you have a few minutes to review this week, it would be great. Also, I have two changes that need review love: https://review.openstack.org/415285 and https://review.openstack.org/411469 . thanks! | 15:51 |
AJaeger | thanks, fungi ! | 15:51 |
fungi | mrmartin: propose a change adding ssh access for your account to the ask.o.o server and i'll see if i can convince the team, but seem reasonable | 15:51 |
mrmartin | ok. let's do it as a first step before the approval. | 15:51 |
fungi | works for me | 15:52 |
dmellado | AJaeger: happy new year ;) | 15:53 |
AJaeger | fungi, infra-root, regarding docs.o.o (see http://lists.openstack.org/pipermail/openstack-docs/2016-December/009430.html ) - do you want to move docs.o.o to AFS published docs this week while it's still a bit silent? | 15:53 |
AJaeger | dmellado: thanks | 15:53 |
AJaeger | Or shall I put it on the infra team agenda for tomorrow? | 15:54 |
fungi | AJaeger: i haven't finished catching up on e-mail yet, but it seems like an appropriate topic for tomorrow's meeting since it's a major step for one of our priority efforts | 15:55 |
AJaeger | fungi: ok, will put it up later - just got called away | 15:55 |
openstackgerrit | Merged openstack-infra/project-config: Add scenario test for neutron-dynamic-routing https://review.openstack.org/407778 | 15:55 |
*** markvoelker has joined #openstack-infra | 15:58 | |
*** rhallisey has joined #openstack-infra | 15:59 | |
*** rbuzatu has quit IRC | 15:59 | |
*** dtantsur|bbl is now known as dtantsur | 16:00 | |
*** rbuzatu has joined #openstack-infra | 16:00 | |
openstackgerrit | Marton Kiss proposed openstack-infra/system-config: Adding user 'mkiss' to ask.o.o https://review.openstack.org/416072 | 16:02 |
*** markvoelker has quit IRC | 16:02 | |
mrmartin | fungi , this one ^^ | 16:02 |
fungi | thanks, mrmartin! | 16:03 |
*** yuval has quit IRC | 16:05 | |
fungi | infra-root: https://review.openstack.org/416072 would grant mrmartin a shell account on ask.openstack.org (production). we want to perform a major upgrade and while some production-like upgrade testing has been done in staging, it's a fragile process and getting him direct access to view logs and inspect the state on disk would be very helpful if this second upgrade attempt also fails | 16:06 |
*** hongbin has joined #openstack-infra | 16:08 | |
*** panda is now known as panda|pto | 16:13 | |
*** dimtruck is now known as zz_dimtruck | 16:13 | |
*** asettle has joined #openstack-infra | 16:13 | |
*** matrohon has joined #openstack-infra | 16:15 | |
*** rcernin has quit IRC | 16:16 | |
* fungi sighs at "nokogiri-1.7.0 requires ruby version >= 2.1.0, which is incompatible with the current version, ruby 2.0.0p648" | 16:16 | |
fungi | gate-openstackci-beaker-centos-7 seems to be broken by a dep | 16:16 |
fungi | nokogiri tagged v1.7.0 a week ago | 16:18 |
*** abregman has quit IRC | 16:20 | |
*** sdake has quit IRC | 16:23 | |
AJaeger | fungi, there's a change up for that... | 16:25 |
fungi | oh, awesome, i'll stop writing mine | 16:25 |
AJaeger | fungi, https://review.openstack.org/415710 | 16:25 |
fungi | thanks! approved | 16:26 |
fungi | interesting we don't run gate-openstackci-beaker-.* jobs against that repo | 16:27 |
AJaeger | fungi, should I remove the agenda items from last time from the infra team meeting agenda for tomorrow - or do you want to do it yourself? | 16:27 |
fungi | AJaeger: i'll clean it up just to make sure i don't accidentally remove any new stuff, just add your sub-bullet in "Docs Publishing via AFS" | 16:27 |
AJaeger | ok | 16:28 |
*** liusheng has quit IRC | 16:29 | |
*** liusheng has joined #openstack-infra | 16:29 | |
openstackgerrit | Merged openstack-infra/puppet-openstack_infra_spec_helper: Pin nokogiri to fix centos 7 jobs https://review.openstack.org/415710 | 16:30 |
*** dargains has joined #openstack-infra | 16:35 | |
*** rcernin has joined #openstack-infra | 16:39 | |
*** baoli has joined #openstack-infra | 16:39 | |
*** dargains has quit IRC | 16:40 | |
*** markus_z has quit IRC | 16:41 | |
*** baoli has quit IRC | 16:44 | |
*** sdake has joined #openstack-infra | 16:50 | |
*** dave-mccowan has joined #openstack-infra | 16:53 | |
*** pcrews has quit IRC | 16:54 | |
*** cdent has quit IRC | 16:54 | |
*** sdake has quit IRC | 16:55 | |
clarkb | to pick up from last night journald's default is to only persistent logs if /var/log/journald exists or if /etc/systemd/journald.conf has storage set to persistent | 16:56 |
clarkb | now I need to check if our images do either one of these things | 16:56 |
clarkb | flip214_: journald by default is supposed to print kernel messages | 16:56 |
clarkb | flip214_: if the time range is captured then I think its possible that nothing is being logged there? | 16:57 |
*** markvoelker has joined #openstack-infra | 16:58 | |
*** jamesdenton has joined #openstack-infra | 17:03 | |
*** markvoelker has quit IRC | 17:03 | |
clarkb | flip214_: perhaps 'Jan 01 13:29:05 ubuntu-xenial-rax-ord-6436518 systemd-journald[312]: Suppressed 247 messages from /system.slice/dbus.service' is where this would have been logged? | 17:06 |
*** dargains has joined #openstack-infra | 17:11 | |
*** baoli has joined #openstack-infra | 17:12 | |
*** baoli has quit IRC | 17:12 | |
clarkb | mrmartin: fungi I have rechecked that ask.o.o access' change now that the infra spec helper change has merged | 17:12 |
*** dargains has quit IRC | 17:15 | |
*** bhavik1 has joined #openstack-infra | 17:18 | |
*** dmellado has quit IRC | 17:19 | |
*** dtantsur is now known as dtantsur|afk | 17:19 | |
*** zz_dimtruck is now known as dimtruck | 17:21 | |
*** rattboi_ has quit IRC | 17:31 | |
*** rattboi has joined #openstack-infra | 17:31 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Don't remove swap file https://review.openstack.org/416078 | 17:32 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Don't remove swap file https://review.openstack.org/416078 | 17:33 |
*** tinwood has quit IRC | 17:39 | |
fungi | thanks clarkb | 17:39 |
*** hashar has quit IRC | 17:39 | |
clarkb | I have confirmed that our xenial iamges do not have a /var/log/journald so will not have their logs stored on disk | 17:40 |
clarkb | which probably explains why on longer running jobs we get that circular buffer behavior | 17:40 |
*** d0ugal has joined #openstack-infra | 17:40 | |
*** d0ugal has quit IRC | 17:40 | |
*** d0ugal has joined #openstack-infra | 17:40 | |
*** rossella_s has joined #openstack-infra | 17:41 | |
clarkb | fedora has a /var/log/journal but centos does not | 17:43 |
clarkb | I thought system was going to fix all of these problems | 17:43 |
*** dargains has joined #openstack-infra | 17:43 | |
fungi | clearly these are systemic problems ;) | 17:44 |
clarkb | translate-dev.o.o which was booted on a rax xenial image also does not have a /var/log/journal | 17:45 |
clarkb | and neither does git01.o.o booted on the rax centos 7 image | 17:45 |
*** rossella_s has quit IRC | 17:47 | |
*** d0ugal has quit IRC | 17:49 | |
*** dougwig has quit IRC | 17:51 | |
*** andrewbogott has quit IRC | 17:51 | |
*** MarkAtwood has quit IRC | 17:51 | |
*** tdurakov has quit IRC | 17:51 | |
*** briancurtin has quit IRC | 17:51 | |
*** fdegir has quit IRC | 17:52 | |
*** ildikov has quit IRC | 17:52 | |
*** Ng has quit IRC | 17:52 | |
*** tomhambleton has quit IRC | 17:52 | |
*** mgkwill has quit IRC | 17:52 | |
*** johnsom has quit IRC | 17:52 | |
*** vdrok has quit IRC | 17:52 | |
*** dirk has quit IRC | 17:52 | |
*** ogelbukh has quit IRC | 17:52 | |
*** puiterwijk|cld has quit IRC | 17:52 | |
*** jraim has quit IRC | 17:52 | |
*** ewindisch has quit IRC | 17:52 | |
*** betherly has quit IRC | 17:53 | |
*** Kevin_Zheng has quit IRC | 17:53 | |
*** gmann has quit IRC | 17:53 | |
*** TheJulia has quit IRC | 17:53 | |
*** sripriya has quit IRC | 17:53 | |
*** iremizov has quit IRC | 17:53 | |
*** boris-42 has quit IRC | 17:53 | |
*** rpodolyaka has quit IRC | 17:53 | |
*** rguillebert has quit IRC | 17:53 | |
*** nikhil has quit IRC | 17:53 | |
*** csatari has quit IRC | 17:53 | |
*** scottda has quit IRC | 17:53 | |
*** samueldmq has quit IRC | 17:54 | |
*** tphummel has quit IRC | 17:54 | |
*** tomhambleton has joined #openstack-infra | 17:55 | |
*** baoli has joined #openstack-infra | 17:55 | |
*** MarkAtwood has joined #openstack-infra | 17:55 | |
*** andrewbogott has joined #openstack-infra | 17:55 | |
*** dougwig has joined #openstack-infra | 17:55 | |
*** baoli has quit IRC | 17:55 | |
flip214_ | clarkb: possibly. I would like to know what happens during the time when the dbus communication is blocked. | 17:55 |
*** jamesdenton has quit IRC | 17:56 | |
*** tphummel has joined #openstack-infra | 17:56 | |
*** baoli has joined #openstack-infra | 17:56 | |
*** ildikov has joined #openstack-infra | 17:56 | |
*** ewindisch has joined #openstack-infra | 17:56 | |
*** mgkwill has joined #openstack-infra | 17:56 | |
*** Kevin_Zheng has joined #openstack-infra | 17:56 | |
*** sripriya has joined #openstack-infra | 17:56 | |
*** csatari has joined #openstack-infra | 17:56 | |
*** bhavik1 has quit IRC | 17:56 | |
*** ogelbukh has joined #openstack-infra | 17:57 | |
*** boris-42 has joined #openstack-infra | 17:57 | |
*** iremizov has joined #openstack-infra | 17:57 | |
flip214_ | it seems that lvchange and other commands are blocked during that time | 17:57 |
flip214_ | and I'd have hoped for the kernel log to explain why | 17:57 |
*** samueldmq has joined #openstack-infra | 17:57 | |
*** nikhil has joined #openstack-infra | 17:57 | |
*** dave-mccowan has quit IRC | 17:57 | |
clarkb | flip214_: right, and the kernel log is that file | 17:57 |
clarkb | so either 1) there isn't anything logging or 2) its hidden in that suppression | 17:58 |
*** vdrok has joined #openstack-infra | 17:58 | |
clarkb | or 3) its logged to some level that we don't print by default for some reason | 17:58 |
*** rguillebert has joined #openstack-infra | 17:58 | |
*** betherly has joined #openstack-infra | 17:58 | |
*** TheJulia has joined #openstack-infra | 17:58 | |
*** rpodolyaka has joined #openstack-infra | 17:59 | |
*** markvoelker has joined #openstack-infra | 17:59 | |
*** fdegir has joined #openstack-infra | 17:59 | |
*** johnsom has joined #openstack-infra | 17:59 | |
*** gmann has joined #openstack-infra | 18:00 | |
*** scottda has joined #openstack-infra | 18:00 | |
*** tdurakov has joined #openstack-infra | 18:00 | |
*** jraim has joined #openstack-infra | 18:00 | |
*** markvoelker has quit IRC | 18:04 | |
*** salv-orlando has quit IRC | 18:04 | |
*** salv-orlando has joined #openstack-infra | 18:05 | |
*** tphummel has quit IRC | 18:06 | |
*** srobert has joined #openstack-infra | 18:07 | |
*** srobert has quit IRC | 18:07 | |
*** briancurtin has joined #openstack-infra | 18:07 | |
*** srobert has joined #openstack-infra | 18:07 | |
openstackgerrit | Clark Boylan proposed openstack-infra/project-config: Make journald log collection persistent https://review.openstack.org/416080 | 18:11 |
clarkb | dib cores may have better ideas for ^ | 18:11 |
clarkb | ianw ^ | 18:11 |
EmilienM | hi! can someone review https://review.openstack.org/#/c/414606/ please? (project-config) | 18:14 |
EmilienM | and review on https://review.openstack.org/#/c/414585/ | 18:14 |
EmilienM | (and happy new year infra folks :-)) | 18:15 |
*** pono has quit IRC | 18:21 | |
*** dargains has quit IRC | 18:23 | |
*** gouthamr has joined #openstack-infra | 18:27 | |
*** asettle has quit IRC | 18:28 | |
*** asettle has joined #openstack-infra | 18:28 | |
*** asettle has quit IRC | 18:33 | |
*** pcrews has joined #openstack-infra | 18:37 | |
*** hongbin has quit IRC | 18:39 | |
*** pcrews has quit IRC | 18:39 | |
*** tphummel has joined #openstack-infra | 18:47 | |
*** dave-mccowan has joined #openstack-infra | 18:51 | |
*** gouthamr has quit IRC | 18:53 | |
*** flepied has quit IRC | 18:56 | |
*** tphummel has quit IRC | 18:57 | |
*** markvoelker has joined #openstack-infra | 19:00 | |
AJaeger | fungi, just reading your reply to my email on docs.o.o. Do you have a few minutes to chat? | 19:02 |
fungi | AJaeger: sure | 19:02 |
AJaeger | great. | 19:03 |
AJaeger | docs.o.o has some historic data and we (=docs team) fear that we might need some data later. That's why the question for an archive came up. | 19:04 |
*** markvoelker has quit IRC | 19:05 | |
AJaeger | An alternative I envison would be to download all files and create an extra infra server docs-archive.o.o that we would keep for some months up. | 19:05 |
AJaeger | Or just download the files to some location so that we can access them if needed. | 19:05 |
fungi | AJaeger: yep, that's an option i was considering as well, though we probably need to have more people involved in that discussion (which is why tomorrow's meeting is probably a good time to bring it up) | 19:05 |
fungi | did you have any numbers on the size of that archive? | 19:06 |
AJaeger | fungi: according to line 22 of https://etherpad.openstack.org/p/afs-docs ianw has done such an archive already - not sure where | 19:07 |
AJaeger | ah, it's at /afs/.openstack.org/docs-old/ | 19:08 |
clarkb | AJaeger: you should be able to drop the . and get public read access | 19:09 |
AJaeger | clarkb: http://files.openstack.org/docs-old/ works as well | 19:09 |
AJaeger | my local archive from August was 10 GB. | 19:09 |
*** pcrews has joined #openstack-infra | 19:10 | |
AJaeger | So, we could resync to that location and add a public IP to it. | 19:10 |
AJaeger | so, with that we should be fine - I forgot about that ;( | 19:11 |
AJaeger | will answer now to that email... | 19:12 |
*** salv-orl_ has joined #openstack-infra | 19:14 | |
*** ianychoi has quit IRC | 19:15 | |
fungi | AJaeger: cool, yes i have no issue with the idea of serving that archived docs tree for as long as we can reasonably manage to do so. i'm also not opposed to refreshing it but that may be fairly time intensive due to lack of rsync support on the cloudsites end (we likely have to crawl and retransfer a lot of files via ftp) | 19:16 |
*** salv-orlando has quit IRC | 19:17 | |
clarkb | how did we do it the first time around? | 19:17 |
clarkb | I guess first time you copy everything anwyays so didn't matter | 19:17 |
*** rbuzatu has quit IRC | 19:18 | |
AJaeger | clarkb: see line 50 in the etherpad | 19:18 |
AJaeger | recursive lftp | 19:18 |
*** rbuzatu has joined #openstack-infra | 19:18 | |
AJaeger | fungi, yes, it will run over a day I fear. | 19:18 |
clarkb | if we use lftp mirror -n it should do an incremental update based on timestamps looks like | 19:20 |
clarkb | which should be quicker? | 19:20 |
AJaeger | clarkb: worth trying ;) | 19:20 |
fungi | yeah, not as fast as rsync but hopefully way faster than starting from scratch | 19:20 |
* AJaeger just removed the WIP from https://review.openstack.org/#/c/415506 - the change to stop publishing to the old developer site | 19:22 | |
*** dimtruck is now known as zz_dimtruck | 19:22 | |
clarkb | ugh I should figure out why logstash/ES are unhappy | 19:22 |
clarkb | seems like they do that more often now | 19:22 |
*** rbuzatu has quit IRC | 19:23 | |
AJaeger | ok, answered via email. | 19:23 |
AJaeger | talk to you again tomorrow! | 19:23 |
fungi | thanks AJaeger! | 19:24 |
*** rbuzatu has joined #openstack-infra | 19:24 | |
*** salv-orl_ has quit IRC | 19:25 | |
AJaeger | fungi, clarkb if any of you has time to rerun the mirror, it would be nice - then we can switch sooner... | 19:25 |
clarkb | looks like the workers are blocking sending data to logstash which implies logstash is unhapppy but nothing in the lgostash logs since novemeber | 19:25 |
AJaeger | ;( | 19:25 |
* AJaeger signs off | 19:25 | |
clarkb | fungi: if you have a moment to review https://review.openstack.org/#/c/388122/1 I can get services restarted today. Otherwise I may just self approve (jeblair has reviewed it so its not unreviewed) | 19:27 |
clarkb | I do see exceptions about the crm114 processor so its possible ^ is biting us | 19:27 |
clarkb | fungi: and I think I see an issue with that change... its actually a noop | 19:34 |
clarkb | I WIP'd it | 19:34 |
fungi | unapproved | 19:34 |
clarkb | we generate new_filters for every log event so it won't carry over any "bad" state between events | 19:35 |
clarkb | ES looks happy (its actually not doing much because all the old indexes have timed out and been deleted as no new data is going into the lcuster...) | 19:37 |
*** e0ne has joined #openstack-infra | 19:37 | |
clarkb | so going to start with restarting logstash daemons then logstash worker daemons (if necessary) | 19:37 |
*** rbuzatu has quit IRC | 19:39 | |
*** e0ne has quit IRC | 19:39 | |
openstackgerrit | Merged openstack-infra/system-config: Enable ask-staging.openstack.org puppet run https://review.openstack.org/276656 | 19:39 |
clarkb | ok restarting the logstash daemon on logstash-worker02 made stuff start happening | 19:41 |
clarkb | will do the otehrs now | 19:41 |
clarkb | (also had to be kill -9'd so likely in a bad way for some reason) | 19:42 |
*** e0ne has joined #openstack-infra | 19:43 | |
*** nadya has joined #openstack-infra | 19:44 | |
*** e0ne has quit IRC | 19:45 | |
clarkb | probably worht investigating taking the laep to elasticsearch 2.x and updating logstash to whatever is current | 19:47 |
clarkb | will have to look at what the API changes are in 2.x | 19:47 |
*** e0ne has joined #openstack-infra | 19:50 | |
*** nadya has quit IRC | 19:50 | |
*** e0ne has quit IRC | 19:52 | |
*** dave-mccowan has quit IRC | 19:58 | |
*** florianf has quit IRC | 19:59 | |
*** pcaruana has quit IRC | 20:00 | |
fungi | mrmartin: reviewing the logs on stackalytics.o.o, apache was complaining about "AH00485: scoreboard is full, not at MaxRequestWorkers" going back as far as september. an apache restart seems to have solved it | 20:00 |
*** cemason has quit IRC | 20:00 | |
clarkb | Things seem to be moving now. Will check in on e-r status pages to make sure it is happy againtoo | 20:00 |
*** markvoelker has joined #openstack-infra | 20:01 | |
fungi | mrmartin: looks like it may be an occurrence of https://bz.apache.org/bugzilla/show_bug.cgi?id=53555 | 20:01 |
openstack | bz.apache.org bug 53555 in mpm_event "Scoreboard full error with event/ssl" [Major,Resolved: fixed] - Assigned to bugs | 20:01 |
mrmartin | sounds nice | 20:01 |
clarkb | heh except we are going to try and index the last weeks worth of logs :/ | 20:02 |
mrmartin | I'm just trying to deploy stackalytics into a dev instance. | 20:02 |
clarkb | load drops over the holidays so gonna let it run for a bit and see if it catches up at all | 20:02 |
clarkb | oh wait even better | 20:02 |
clarkb | its indexing things it thinks are from december 23rd 2017... | 20:03 |
*** Ng has joined #openstack-infra | 20:03 | |
*** dirk has joined #openstack-infra | 20:03 | |
clarkb | Is it syslog that doesn't record the year? | 20:03 |
fungi | clarkb: yes, looks like it | 20:03 |
*** puiterwijk|cld has joined #openstack-infra | 20:04 | |
fungi | ugh. recent vim upgrade seems to have unexpectedly enabled x11 pointer integration | 20:04 |
clarkb | :set mouse="" | 20:05 |
*** markvoelker has quit IRC | 20:06 | |
clarkb | or maybe its mouse= ? | 20:06 |
fungi | the latter seems to have worked, thanks | 20:06 |
fungi | i suspect this was due to the debian package for it starting to ship a global default vimrc | 20:07 |
*** yamahata has joined #openstack-infra | 20:07 | |
fungi | aha, yes it's only happening when i `sudo vi ...` or similar, so "...now ships with a defaults.vim file which, when the user has no vimrc, enables some options..." in /usr/share/doc/vim/NEWS.Debian.gz looks likely | 20:10 |
fungi | kicking in because i have no ~root/.vimrc apparently | 20:11 |
*** jamesdenton has joined #openstack-infra | 20:12 | |
fungi | started in vim 8.0 apparently | 20:12 |
*** rbuzatu has joined #openstack-infra | 20:13 | |
*** asettle has joined #openstack-infra | 20:14 | |
*** asettle has quit IRC | 20:14 | |
*** srobert has quit IRC | 20:15 | |
*** asettle has joined #openstack-infra | 20:15 | |
*** asettle has quit IRC | 20:15 | |
*** asettle has joined #openstack-infra | 20:15 | |
*** asettle has quit IRC | 20:15 | |
*** asettle has joined #openstack-infra | 20:16 | |
*** asettle has quit IRC | 20:16 | |
*** asettle has joined #openstack-infra | 20:17 | |
*** asettle has quit IRC | 20:17 | |
*** e0ne has joined #openstack-infra | 20:22 | |
*** e0ne has quit IRC | 20:24 | |
*** rfolco has quit IRC | 20:26 | |
yankcrime | if in doubt, :smile | 20:27 |
*** spligak has joined #openstack-infra | 20:28 | |
*** yamahata has quit IRC | 20:29 | |
fungi | (and don't panic!) | 20:34 |
*** david-lyle has joined #openstack-infra | 20:48 | |
*** david-lyle has quit IRC | 20:52 | |
*** rbuzatu_ has joined #openstack-infra | 20:54 | |
*** asettle has joined #openstack-infra | 20:54 | |
*** rbuzatu has quit IRC | 20:55 | |
*** salv-orlando has joined #openstack-infra | 20:55 | |
*** flepied has joined #openstack-infra | 20:56 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Remove docs publishing from networking-calico https://review.openstack.org/416087 | 20:56 |
*** pcaruana has joined #openstack-infra | 21:00 | |
*** salv-orlando has quit IRC | 21:00 | |
*** asettle has quit IRC | 21:01 | |
*** salv-orlando has joined #openstack-infra | 21:01 | |
*** markvoelker has joined #openstack-infra | 21:01 | |
*** rcernin has quit IRC | 21:02 | |
*** markvoelker has quit IRC | 21:06 | |
*** pcrews has quit IRC | 21:06 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: TEST: DONT RECHECK: periodic jobs https://review.openstack.org/359215 | 21:08 |
*** asettle has joined #openstack-infra | 21:09 | |
*** asettle has quit IRC | 21:10 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Remove docs publishing from legacy repos https://review.openstack.org/416087 | 21:11 |
*** rbuzatu_ has quit IRC | 21:13 | |
*** pcaruana has quit IRC | 21:20 | |
openstackgerrit | Andreas Florath proposed openstack/diskimage-builder: Fixes dib-init-system for Debian Jessie and Debian Stretch https://review.openstack.org/416091 | 21:22 |
clarkb | #status log logstash daemons were 'stuck' and have been restarted on logstash-worker0X.o.o hosts. Events are being processed and indexed again as a result. Should probably look into upgrading logstash install (and possibly elasticsearch | 21:30 |
openstackstatus | clarkb: finished logging | 21:30 |
*** Jeffrey4l__ has quit IRC | 21:34 | |
*** Jeffrey4l__ has joined #openstack-infra | 21:36 | |
clarkb | I think we should upgrade ES to https://www.elastic.co/downloads/past-releases/elasticsearch-1-7-6 and logstash to https://www.elastic.co/downloads/past-releases/logstash-2-4-1 | 21:40 |
clarkb | I am going to start testing the logstash 2.4.1 upgrade as its a bit easier to do | 21:40 |
*** ianychoi has joined #openstack-infra | 21:41 | |
*** pcaruana has joined #openstack-infra | 21:42 | |
clarkb | (I went ahead and updated logstash-worker01 to 2.4.1 as it was already disabled in puppet due to the mqtt issues. If it holds up I will push a change later this week to update the rest of the logstash workers) | 21:45 |
*** sdake has joined #openstack-infra | 21:51 | |
*** aviau has quit IRC | 21:53 | |
*** aviau has joined #openstack-infra | 21:53 | |
*** sdake has quit IRC | 21:56 | |
jhesketh | Morning | 21:59 |
*** markvoelker has joined #openstack-infra | 22:02 | |
*** markvoelker has quit IRC | 22:07 | |
openstackgerrit | Dirk Mueller proposed openstack-dev/pbr: Don't raise exception on missing man pages https://review.openstack.org/413795 | 22:09 |
*** pcaruana has quit IRC | 22:13 | |
*** hurgleburgler has quit IRC | 22:18 | |
*** zz_dimtruck is now known as dimtruck | 22:20 | |
*** rbuzatu has joined #openstack-infra | 22:27 | |
*** umeshksingla has joined #openstack-infra | 22:29 | |
*** rbuzatu has quit IRC | 22:29 | |
*** wolverin_ has quit IRC | 22:46 | |
*** wolverineav has joined #openstack-infra | 22:47 | |
*** wolverineav has quit IRC | 22:49 | |
*** david-lyle has joined #openstack-infra | 22:49 | |
*** askb has joined #openstack-infra | 22:49 | |
*** wolverineav has joined #openstack-infra | 22:49 | |
*** jerryz has joined #openstack-infra | 22:53 | |
*** david-lyle has quit IRC | 22:54 | |
*** wolverineav has quit IRC | 22:54 | |
*** jerryz has quit IRC | 22:54 | |
*** rbuzatu has joined #openstack-infra | 22:54 | |
*** wolverineav has joined #openstack-infra | 22:55 | |
*** hurgleburgler has joined #openstack-infra | 22:57 | |
*** dimtruck is now known as zz_dimtruck | 22:58 | |
*** zz_dimtruck is now known as dimtruck | 22:58 | |
*** wolverineav has quit IRC | 23:00 | |
*** hurgleburgler has quit IRC | 23:00 | |
*** markvoelker has joined #openstack-infra | 23:03 | |
*** pahuang has joined #openstack-infra | 23:07 | |
*** dimtruck is now known as zz_dimtruck | 23:07 | |
*** markvoelker has quit IRC | 23:08 | |
*** hurgleburgler has joined #openstack-infra | 23:12 | |
*** hurgleburgler has quit IRC | 23:17 | |
*** umeshksingla has quit IRC | 23:23 | |
*** umeshksingla has joined #openstack-infra | 23:23 | |
*** Julien-zte has quit IRC | 23:24 | |
*** jaypipes has quit IRC | 23:27 | |
*** salv-orlando has quit IRC | 23:29 | |
*** lseki has quit IRC | 23:30 | |
*** pabelanger has quit IRC | 23:31 | |
*** migi has quit IRC | 23:32 | |
*** pabelanger has joined #openstack-infra | 23:32 | |
*** migi has joined #openstack-infra | 23:33 | |
*** gnuoy has quit IRC | 23:38 | |
*** rbuzatu has quit IRC | 23:38 | |
*** rbuzatu has joined #openstack-infra | 23:39 | |
*** rbuzatu has quit IRC | 23:41 | |
*** rbuzatu has joined #openstack-infra | 23:41 | |
*** rfolco has joined #openstack-infra | 23:44 | |
*** umeshksingla has left #openstack-infra | 23:50 | |
*** umeshksingla has joined #openstack-infra | 23:50 | |
*** adreznec has quit IRC | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!