*** _alastor_ has joined #openstack-infra | 00:00 | |
*** woojay has quit IRC | 00:05 | |
*** yamamoto has joined #openstack-infra | 00:13 | |
*** bobh has joined #openstack-infra | 00:15 | |
clarkb | this ansible bug seems to exist in 2.5 and 2.6 as well | 00:18 |
---|---|---|
*** bobh has quit IRC | 00:18 | |
clarkb | and is present on tip of devel | 00:20 |
*** sthussey has quit IRC | 00:21 | |
*** yamamoto has quit IRC | 00:22 | |
*** yamamoto has joined #openstack-infra | 00:22 | |
clarkb | at this point I think I'm just waiting to confirm that logstash apache is running again then I'm calling it a week | 00:22 |
*** wolverineav has quit IRC | 00:25 | |
*** wolverineav has joined #openstack-infra | 00:26 | |
*** wolverineav has quit IRC | 00:27 | |
*** wolverineav has joined #openstack-infra | 00:27 | |
*** betherly has joined #openstack-infra | 00:27 | |
*** wolverineav has quit IRC | 00:30 | |
*** betherly has quit IRC | 00:32 | |
*** wolverineav has joined #openstack-infra | 00:34 | |
*** jento has joined #openstack-infra | 00:35 | |
*** Swami has quit IRC | 00:38 | |
*** gyee has quit IRC | 00:39 | |
*** _alastor_ has quit IRC | 00:45 | |
*** yamamoto has quit IRC | 01:15 | |
fungi | great work! | 01:15 |
*** yamamoto has joined #openstack-infra | 01:15 | |
clarkb | change will merge shortly and we are currently 20 minutes from puppet run | 01:17 |
openstackgerrit | Merged openstack-infra/puppet-kibana master: Use full lookup path for serveradmin in template https://review.openstack.org/625374 | 01:22 |
fungi | there you fo | 01:22 |
fungi | er, you go | 01:22 |
clarkb | now just ~12 minutes away from applying | 01:25 |
*** betherly has joined #openstack-infra | 01:30 | |
*** betherly has quit IRC | 01:34 | |
*** wolverineav has quit IRC | 01:36 | |
clarkb | bah the way we update modules is at the very beginning of the run so I actually have to wait another half hour | 01:38 |
fungi | or check on it some other time when you don't have a friday evening to enjoy | 01:39 |
fungi | or i can keep an eye on it for you, as i'm a boring old fuddy-duddy anyway | 01:40 |
fungi | this _is_ my exciting friday night | 01:40 |
clarkb | its fine I mostly want to see if this fixes it and if not maybe emergency file it and edit the vhost | 01:40 |
*** hwoarang has quit IRC | 01:41 | |
*** eernst has quit IRC | 01:41 | |
*** hwoarang has joined #openstack-infra | 01:43 | |
*** mrsoul has joined #openstack-infra | 02:03 | |
clarkb | itworks! http://logstash.openstack.org/#/dashboard/file/logstash.json | 02:08 |
*** hwoarang has quit IRC | 02:10 | |
*** hwoarang has joined #openstack-infra | 02:11 | |
*** betherly has joined #openstack-infra | 02:12 | |
*** haleyb has quit IRC | 02:14 | |
*** betherly has quit IRC | 02:17 | |
*** persia has quit IRC | 02:24 | |
*** persia has joined #openstack-infra | 02:24 | |
*** dayou has quit IRC | 02:39 | |
*** dayou has joined #openstack-infra | 02:40 | |
*** gagehugo has joined #openstack-infra | 02:44 | |
*** yamamoto has quit IRC | 02:47 | |
*** yamamoto has joined #openstack-infra | 02:50 | |
*** wolverineav has joined #openstack-infra | 02:51 | |
*** yamamoto has quit IRC | 02:51 | |
*** dklyle has joined #openstack-infra | 02:54 | |
*** hwoarang has quit IRC | 02:56 | |
*** wolverineav has quit IRC | 02:56 | |
*** hwoarang has joined #openstack-infra | 02:57 | |
*** apetrich has quit IRC | 03:16 | |
*** ramishra has quit IRC | 03:31 | |
*** yamamoto has joined #openstack-infra | 03:32 | |
*** ykarel|away has joined #openstack-infra | 03:34 | |
*** betherly has joined #openstack-infra | 03:36 | |
*** betherly has quit IRC | 03:40 | |
*** dklyle has quit IRC | 03:42 | |
*** bhavikdbavishi has joined #openstack-infra | 03:44 | |
*** yamamoto has quit IRC | 03:44 | |
*** ykarel|away has quit IRC | 03:50 | |
*** ykarel has joined #openstack-infra | 03:52 | |
*** jamesmcarthur has joined #openstack-infra | 03:52 | |
*** sean-k-mooney has quit IRC | 03:57 | |
*** jamesmcarthur has quit IRC | 03:58 | |
*** sean-k-mooney has joined #openstack-infra | 04:04 | |
*** ykarel has quit IRC | 04:07 | |
*** ykarel has joined #openstack-infra | 04:13 | |
*** yamamoto has joined #openstack-infra | 04:18 | |
*** agopi has quit IRC | 04:23 | |
*** agopi has joined #openstack-infra | 04:27 | |
*** bj_lyk has joined #openstack-infra | 04:44 | |
*** bhavikdbavishi has quit IRC | 04:47 | |
*** rh-jelabarre has quit IRC | 04:49 | |
*** Bhujay has joined #openstack-infra | 04:52 | |
*** Bhujay has quit IRC | 04:53 | |
*** psachin has joined #openstack-infra | 04:53 | |
*** Bhujay has joined #openstack-infra | 04:53 | |
*** Bhujay has quit IRC | 04:54 | |
*** Bhujay has joined #openstack-infra | 04:55 | |
*** Bhujay has quit IRC | 04:56 | |
*** Bhujay has joined #openstack-infra | 04:56 | |
*** ykarel has quit IRC | 05:08 | |
*** bhavikdbavishi has joined #openstack-infra | 05:13 | |
*** prometheanfire has quit IRC | 05:15 | |
*** bhavikdbavishi has quit IRC | 05:18 | |
*** agopi has quit IRC | 05:19 | |
*** prometheanfire has joined #openstack-infra | 05:23 | |
*** betherly has joined #openstack-infra | 05:30 | |
*** prometheanfire has quit IRC | 05:33 | |
*** betherly has quit IRC | 05:35 | |
*** yamamoto has quit IRC | 05:36 | |
*** yamamoto has joined #openstack-infra | 05:36 | |
*** dklyle has joined #openstack-infra | 05:37 | |
*** lpetrut has joined #openstack-infra | 05:38 | |
*** ramishra has joined #openstack-infra | 05:39 | |
*** prometheanfire has joined #openstack-infra | 05:40 | |
*** yamamoto has quit IRC | 05:41 | |
*** bhavikdbavishi has joined #openstack-infra | 05:52 | |
*** yamamoto has joined #openstack-infra | 05:53 | |
*** jamesmcarthur has joined #openstack-infra | 05:58 | |
*** betherly has joined #openstack-infra | 06:02 | |
*** ykarel has joined #openstack-infra | 06:02 | |
*** jamesmcarthur has quit IRC | 06:04 | |
*** bhavikdbavishi has quit IRC | 06:04 | |
*** betherly has quit IRC | 06:07 | |
*** bhavikdbavishi has joined #openstack-infra | 06:08 | |
*** yamamoto has quit IRC | 06:09 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config master: Normalize projects.yaml https://review.openstack.org/625149 | 06:10 |
*** ykarel has quit IRC | 06:13 | |
*** yamamoto has joined #openstack-infra | 06:14 | |
*** dklyle has quit IRC | 06:19 | |
*** lpetrut has quit IRC | 06:20 | |
*** bj_lyk has quit IRC | 06:23 | |
*** bj_lyk has joined #openstack-infra | 06:24 | |
*** agopi has joined #openstack-infra | 06:27 | |
*** ykarel has joined #openstack-infra | 06:30 | |
*** ykarel has quit IRC | 06:34 | |
*** Bhujay has quit IRC | 06:41 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool master: Implement an OpenShift resource provider https://review.openstack.org/570667 | 06:41 |
*** yamamoto has quit IRC | 06:43 | |
*** hwoarang has quit IRC | 06:47 | |
*** yboaron_ has joined #openstack-infra | 06:48 | |
*** hwoarang has joined #openstack-infra | 06:49 | |
*** agopi has quit IRC | 06:54 | |
*** betherly has joined #openstack-infra | 06:54 | |
*** betherly has quit IRC | 06:59 | |
*** lpetrut has joined #openstack-infra | 07:00 | |
*** agopi has joined #openstack-infra | 07:01 | |
*** agopi has quit IRC | 07:02 | |
*** agopi has joined #openstack-infra | 07:03 | |
*** lpetrut has quit IRC | 07:04 | |
*** agopi has quit IRC | 07:11 | |
*** dklyle has joined #openstack-infra | 07:12 | |
*** agopi has joined #openstack-infra | 07:15 | |
*** ramishra has quit IRC | 07:17 | |
*** agopi has quit IRC | 07:22 | |
*** dklyle has quit IRC | 07:23 | |
*** yamamoto has joined #openstack-infra | 07:23 | |
*** bhavikdbavishi has quit IRC | 07:35 | |
openstackgerrit | melissaml proposed openstack-infra/storyboard-webclient master: Change openstack-dev to openstack-discuss https://review.openstack.org/625388 | 07:52 |
*** pcaruana has joined #openstack-infra | 08:00 | |
openstackgerrit | melissaml proposed openstack-infra/system-config master: Change openstack-dev to openstack-discuss https://review.openstack.org/625389 | 08:02 |
openstackgerrit | melissaml proposed openstack-dev/pbr master: Change openstack-dev to openstack-discuss https://review.openstack.org/625390 | 08:09 |
*** yamamoto has quit IRC | 08:17 | |
*** wolverineav has joined #openstack-infra | 08:17 | |
*** yamamoto has joined #openstack-infra | 08:17 | |
*** wolverineav has quit IRC | 08:22 | |
*** imacdonn has quit IRC | 08:24 | |
*** imacdonn has joined #openstack-infra | 08:25 | |
*** slaweq has joined #openstack-infra | 08:32 | |
*** yamamoto has quit IRC | 08:35 | |
*** agopi has joined #openstack-infra | 08:35 | |
*** bhavikdbavishi has joined #openstack-infra | 08:36 | |
*** yboaron_ has quit IRC | 08:37 | |
*** yamamoto has joined #openstack-infra | 08:37 | |
*** yamamoto has quit IRC | 08:43 | |
*** yamamoto has joined #openstack-infra | 08:44 | |
*** slaweq has quit IRC | 08:44 | |
*** yamamoto has quit IRC | 08:45 | |
*** yamamoto has joined #openstack-infra | 08:52 | |
*** yamamoto has quit IRC | 08:52 | |
*** Bhujay has joined #openstack-infra | 09:00 | |
*** e0ne has joined #openstack-infra | 09:02 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/storyboard master: Imported Translations from Zanata https://review.openstack.org/625393 | 09:03 |
*** agopi has quit IRC | 09:06 | |
*** e0ne has quit IRC | 09:06 | |
*** e0ne has joined #openstack-infra | 09:14 | |
*** yamamoto has joined #openstack-infra | 09:16 | |
*** e0ne has quit IRC | 09:19 | |
*** yamamoto has quit IRC | 09:21 | |
*** ramishra has joined #openstack-infra | 09:26 | |
*** bhavikdbavishi has quit IRC | 09:30 | |
*** e0ne has joined #openstack-infra | 09:39 | |
*** e0ne has quit IRC | 09:41 | |
*** yamamoto has joined #openstack-infra | 09:50 | |
ssbarnea|rover | I seen some unexplained POST_FAILUREs since yesterday does anyone knows what happened? | 10:05 |
*** pbourke has quit IRC | 10:31 | |
*** pbourke has joined #openstack-infra | 10:33 | |
*** agopi has joined #openstack-infra | 10:38 | |
*** jtomasek has joined #openstack-infra | 10:39 | |
*** jtomasek has quit IRC | 10:40 | |
*** e0ne has joined #openstack-infra | 10:49 | |
*** e0ne has quit IRC | 10:53 | |
*** bhavikdbavishi has joined #openstack-infra | 10:58 | |
*** Bhujay has quit IRC | 11:01 | |
*** yamamoto has quit IRC | 11:02 | |
*** jbadiapa has quit IRC | 11:16 | |
*** yamamoto has joined #openstack-infra | 11:25 | |
*** smarcet has joined #openstack-infra | 11:25 | |
*** yamamoto has quit IRC | 11:25 | |
*** bhavikdbavishi has quit IRC | 11:34 | |
*** agopi has quit IRC | 11:43 | |
*** agopi has joined #openstack-infra | 11:46 | |
*** yamamoto has joined #openstack-infra | 11:50 | |
*** yamamoto has quit IRC | 11:50 | |
*** wolverineav has joined #openstack-infra | 11:54 | |
*** dkehn has quit IRC | 11:54 | |
*** wolverineav has quit IRC | 11:58 | |
*** yamamoto has joined #openstack-infra | 11:59 | |
*** smarcet has quit IRC | 12:14 | |
*** bhavikdbavishi has joined #openstack-infra | 12:20 | |
*** smarcet has joined #openstack-infra | 12:22 | |
*** dkehn has joined #openstack-infra | 12:23 | |
*** smarcet has quit IRC | 12:30 | |
*** yboaron_ has joined #openstack-infra | 12:31 | |
*** yboaron_ has quit IRC | 12:35 | |
*** Bhujay has joined #openstack-infra | 12:39 | |
*** ykarel has joined #openstack-infra | 12:41 | |
*** tosky has joined #openstack-infra | 12:45 | |
*** ykarel has quit IRC | 13:06 | |
*** efried has joined #openstack-infra | 13:26 | |
*** bhavikdbavishi has quit IRC | 13:28 | |
fungi | ssbarnea|rover: and no logs? | 13:53 |
ssbarnea|rover | fungi: yep. | 13:54 |
fungi | logs volume has plenty of space still, and nothing in dmesg to indicate fs write errors there | 13:56 |
*** Bhujay has quit IRC | 13:59 | |
fungi | i don't see any indication any of the executors is unhealthy grafana.openstack.org/d/T6vSHcSik/zuul-status | 13:59 |
*** Bhujay has joined #openstack-infra | 13:59 | |
fungi | er, http://grafana.openstack.org/d/T6vSHcSik/zuul-status | 13:59 |
*** Bhujay has quit IRC | 14:00 | |
*** Bhujay has joined #openstack-infra | 14:01 | |
*** Bhujay has quit IRC | 14:02 | |
*** Bhujay has joined #openstack-infra | 14:02 | |
*** Bhujay has quit IRC | 14:03 | |
*** Bhujay has joined #openstack-infra | 14:04 | |
*** Bhujay has quit IRC | 14:05 | |
*** Bhujay has joined #openstack-infra | 14:05 | |
*** bj_lyk has quit IRC | 14:06 | |
*** hwoarang has quit IRC | 14:18 | |
*** hwoarang has joined #openstack-infra | 14:18 | |
*** betherly has joined #openstack-infra | 14:20 | |
*** betherly has quit IRC | 14:24 | |
*** ssbarnea|rover has quit IRC | 14:28 | |
*** ssbarnea|rover has joined #openstack-infra | 14:30 | |
*** efried has quit IRC | 14:32 | |
*** bobh has joined #openstack-infra | 14:35 | |
*** betherly has joined #openstack-infra | 14:50 | |
*** slaweq has joined #openstack-infra | 14:50 | |
*** betherly has quit IRC | 14:55 | |
*** hwoarang has quit IRC | 14:57 | |
*** ykarel has joined #openstack-infra | 15:00 | |
*** hwoarang has joined #openstack-infra | 15:01 | |
*** slaweq has quit IRC | 15:04 | |
*** agopi has quit IRC | 15:08 | |
*** Bhujay has quit IRC | 15:13 | |
*** hwoarang has quit IRC | 15:17 | |
*** hwoarang has joined #openstack-infra | 15:18 | |
*** bobh has quit IRC | 15:24 | |
*** yamamoto has quit IRC | 15:34 | |
*** bhavikdbavishi has joined #openstack-infra | 15:40 | |
scas | i was able to avoid terrible ideas. once it came to me where that compatibility needed to come in, it made short work out of things without any egregious overrides like admin force-pushes, or anything in the realm of janky | 15:50 |
scas | my exciting friday night was chasing down where some super vague error message was throwing errors, with seemingly random edits to get all angles of testing working consistently | 15:56 |
*** bhavikdbavishi has quit IRC | 15:58 | |
*** betherly has joined #openstack-infra | 16:00 | |
*** betherly has quit IRC | 16:05 | |
*** ramishra has quit IRC | 16:09 | |
*** yamamoto has joined #openstack-infra | 16:11 | |
*** tosky has quit IRC | 16:33 | |
*** ykarel has quit IRC | 16:34 | |
*** bhavikdbavishi has joined #openstack-infra | 16:34 | |
*** betherly has joined #openstack-infra | 16:40 | |
*** betherly has quit IRC | 16:45 | |
*** bhavikdbavishi has quit IRC | 16:46 | |
*** notmyname has quit IRC | 16:46 | |
*** notmyname has joined #openstack-infra | 16:47 | |
*** betherly has joined #openstack-infra | 17:00 | |
*** jamesmcarthur has joined #openstack-infra | 17:01 | |
*** betherly has quit IRC | 17:05 | |
*** agopi has joined #openstack-infra | 17:13 | |
*** betherly has joined #openstack-infra | 17:20 | |
*** e0ne has joined #openstack-infra | 17:22 | |
*** betherly has quit IRC | 17:25 | |
*** jamesmcarthur has quit IRC | 17:33 | |
*** e0ne has quit IRC | 17:38 | |
*** e0ne has joined #openstack-infra | 17:39 | |
*** e0ne has quit IRC | 17:40 | |
*** betherly has joined #openstack-infra | 17:41 | |
*** psachin has quit IRC | 17:43 | |
*** betherly has quit IRC | 17:45 | |
fungi | ssbarnea|rover: still not spotting any post_failure results (checked all the failing changes currently being tested too), so whatever it was hopefully was short-lived. best guess is we had connectivity issues in/to rax-dfw where most of our control plane resides | 17:46 |
clarkb | if you have job uuids you can grep for them in the executor logs | 17:58 |
fungi | yeah, i'm not worried enough to spend time digging those out of the scheduler log | 17:59 |
fungi | if it's not still going on even with utilization ramping up | 18:00 |
*** betherly has joined #openstack-infra | 18:01 | |
*** betherly has quit IRC | 18:05 | |
*** yboaron_ has joined #openstack-infra | 18:06 | |
*** yboaron_ has quit IRC | 18:08 | |
*** yboaron_ has joined #openstack-infra | 18:09 | |
*** yboaron_ has quit IRC | 18:17 | |
*** markvoelker has joined #openstack-infra | 18:36 | |
*** betherly has joined #openstack-infra | 18:41 | |
*** markvoelker has quit IRC | 18:41 | |
*** betherly has quit IRC | 18:45 | |
*** betherly has joined #openstack-infra | 19:01 | |
*** betherly has quit IRC | 19:06 | |
*** lbragstad has joined #openstack-infra | 19:32 | |
*** jamesmcarthur has joined #openstack-infra | 19:34 | |
*** slaweq has joined #openstack-infra | 19:34 | |
*** jamesmcarthur has quit IRC | 19:38 | |
*** yboaron_ has joined #openstack-infra | 19:39 | |
*** betherly has joined #openstack-infra | 19:41 | |
*** rossella_s has quit IRC | 19:44 | |
*** yboaron_ has quit IRC | 19:44 | |
*** betherly has quit IRC | 19:46 | |
*** hongbin has joined #openstack-infra | 19:55 | |
*** markvoelker has joined #openstack-infra | 20:37 | |
*** betherly has joined #openstack-infra | 21:01 | |
*** betherly has quit IRC | 21:06 | |
*** betherly has joined #openstack-infra | 21:21 | |
*** betherly has quit IRC | 21:26 | |
*** betherly has joined #openstack-infra | 21:41 | |
*** betherly has quit IRC | 21:46 | |
*** wolverineav has joined #openstack-infra | 21:48 | |
*** dpawlik has joined #openstack-infra | 21:56 | |
*** lbragstad has quit IRC | 21:58 | |
*** dpawlik has quit IRC | 21:59 | |
*** betherly has joined #openstack-infra | 22:01 | |
*** betherly has quit IRC | 22:06 | |
*** dpawlik has joined #openstack-infra | 22:15 | |
*** dpawlik has quit IRC | 22:19 | |
*** agopi has quit IRC | 22:23 | |
*** wolverineav has quit IRC | 22:34 | |
*** crank has joined #openstack-infra | 23:01 | |
*** betherly has joined #openstack-infra | 23:02 | |
*** crank has joined #openstack-infra | 23:04 | |
*** betherly has quit IRC | 23:06 | |
*** wolverineav has joined #openstack-infra | 23:40 | |
*** wolverineav has quit IRC | 23:45 | |
*** crank has quit IRC | 23:47 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!