clarkb | fungi: logstash-worker08 failed to resolve git.openstack.org to pull down project-config | 00:00 |
---|---|---|
clarkb | er not project-config, logstash-filters | 00:00 |
clarkb | unbound is not running on it | 00:01 |
fungi | that explains that at least | 00:01 |
fungi | also git.openstack.org failed? | 00:01 |
fungi | unreachable | 00:01 |
clarkb | no unbound so no dns resolution | 00:02 |
clarkb | trying to start unbound doesn't seem to work | 00:02 |
clarkb | looks like it died without systemd noticing so I had to stop start it | 00:03 |
clarkb | dig works now | 00:03 |
fungi | oh, on git.o.o itself? | 00:03 |
clarkb | no on logstash-worker08 | 00:03 |
fungi | ahh | 00:03 |
clarkb | I think I've resolved that problem by stop starting unbound | 00:04 |
fungi | also git.openstack.org as marked unreachable by ansible though | 00:04 |
clarkb | oh | 00:04 |
clarkb | fungi: it doesnt' have the updated ssh key with bridge's ip addr on it | 00:05 |
clarkb | it isn't in the emergency file list so it must not have had puppet run there for some other reason | 00:05 |
clarkb | we will probably just need to update the key by hand and have ansible tell us what is wrong from there | 00:05 |
*** jamesmcarthur has joined #openstack-infra | 00:06 | |
fungi | maybe it's part of the git and gerrit playbook but that got run piecemeal and git.o.o ended up missed? | 00:06 |
fungi | oh, before then | 00:06 |
clarkb | mordred: tl;dr to followup there is a non zero numbr of hosts that need that cleanup. Also we should figure out why ansible doesn't timeout to hosts like ethercalc02 whcih have the ssh key with the right ip addr but do not have the host key trusted on bridge.o.o | 00:06 |
clarkb | fungi: ya puppet should've done this a few days back | 00:07 |
clarkb | I've since fixed ethercalc02's host key issue on bridge.o.o | 00:07 |
clarkb | with that I think I am going to call it a week. Thanks again | 00:07 |
fungi | me too, for the most part. thanks! | 00:08 |
*** felipemonteiro has joined #openstack-infra | 00:12 | |
*** rpioso is now known as rpioso|afk | 00:13 | |
*** masayukig has joined #openstack-infra | 00:14 | |
*** rosmaita has quit IRC | 00:18 | |
*** felipemonteiro has quit IRC | 00:21 | |
*** bobh has joined #openstack-infra | 00:26 | |
*** bobh has quit IRC | 00:37 | |
*** bobh has joined #openstack-infra | 00:38 | |
*** mrsoul has joined #openstack-infra | 01:25 | |
*** mschuppert has quit IRC | 01:28 | |
*** armax has quit IRC | 01:51 | |
*** jamesmcarthur has quit IRC | 02:02 | |
*** bobh has quit IRC | 02:03 | |
*** yamahata has quit IRC | 02:53 | |
*** SteelyDan is now known as superdan | 02:58 | |
*** dave-mccowan has quit IRC | 03:08 | |
*** felipemonteiro has joined #openstack-infra | 03:50 | |
*** jamesmcarthur has joined #openstack-infra | 04:02 | |
*** jamesmcarthur has quit IRC | 04:07 | |
*** felipemonteiro has quit IRC | 04:15 | |
*** oanson has quit IRC | 04:26 | |
*** yamahata has joined #openstack-infra | 04:30 | |
*** ianychoi has quit IRC | 04:41 | |
*** ianychoi has joined #openstack-infra | 04:47 | |
*** Bhujay has joined #openstack-infra | 05:03 | |
*** ykarel has joined #openstack-infra | 05:10 | |
*** toabctl has quit IRC | 05:36 | |
*** ykarel has quit IRC | 05:37 | |
*** graphene has quit IRC | 06:02 | |
*** graphene has joined #openstack-infra | 06:04 | |
openstackgerrit | Nguyen Hai proposed openstack-infra/project-config master: remove job settings for mistral repositories https://review.openstack.org/593264 | 06:06 |
*** e0ne has joined #openstack-infra | 06:24 | |
*** jesusaur has quit IRC | 06:58 | |
*** e0ne has quit IRC | 07:05 | |
*** SteffanW has joined #openstack-infra | 07:34 | |
*** apetrich has joined #openstack-infra | 07:42 | |
*** raissa has joined #openstack-infra | 08:02 | |
*** jistr is now known as jistr|off | 08:44 | |
*** zhangfei has joined #openstack-infra | 09:12 | |
*** slaweq has joined #openstack-infra | 09:44 | |
*** raissa has quit IRC | 09:47 | |
*** raissa has joined #openstack-infra | 09:47 | |
*** raissa has quit IRC | 09:48 | |
*** raissa has joined #openstack-infra | 09:48 | |
*** raissa has joined #openstack-infra | 09:49 | |
*** raissa has quit IRC | 09:49 | |
*** raissa has joined #openstack-infra | 09:50 | |
*** raissa has quit IRC | 09:50 | |
*** raissa has joined #openstack-infra | 09:51 | |
*** raissa has quit IRC | 09:51 | |
*** raissa has joined #openstack-infra | 09:51 | |
*** raissa has quit IRC | 09:52 | |
*** raissa has joined #openstack-infra | 09:52 | |
*** raissa has quit IRC | 09:52 | |
*** raissa has joined #openstack-infra | 09:53 | |
*** raissa has quit IRC | 09:53 | |
*** raissa has joined #openstack-infra | 09:57 | |
*** raissa has quit IRC | 10:08 | |
*** raissa has joined #openstack-infra | 10:08 | |
*** raissa has quit IRC | 10:11 | |
*** raissa has joined #openstack-infra | 10:24 | |
*** raissa has quit IRC | 10:24 | |
*** raissa has joined #openstack-infra | 10:25 | |
*** jesusaur has joined #openstack-infra | 10:26 | |
*** apetrich has quit IRC | 10:42 | |
*** slaweq has quit IRC | 11:06 | |
*** dingyichen has quit IRC | 11:23 | |
*** egonzalez has joined #openstack-infra | 11:49 | |
egonzalez | Hi, ask.openstack.org is down | 11:50 |
*** SteffanW has quit IRC | 12:19 | |
*** raissa has quit IRC | 12:28 | |
*** raissa has joined #openstack-infra | 12:29 | |
*** raissa has quit IRC | 12:29 | |
*** raissa has joined #openstack-infra | 12:30 | |
*** raissa has quit IRC | 12:30 | |
*** raissa has joined #openstack-infra | 12:31 | |
*** raissa has quit IRC | 12:31 | |
*** roman_g_ has joined #openstack-infra | 12:31 | |
*** raissa has joined #openstack-infra | 12:31 | |
*** raissa has quit IRC | 12:32 | |
*** raissa has joined #openstack-infra | 12:32 | |
*** raissa has quit IRC | 12:32 | |
*** raissa has joined #openstack-infra | 12:33 | |
*** raissa has quit IRC | 12:33 | |
*** raissa has joined #openstack-infra | 12:34 | |
*** raissa has quit IRC | 12:34 | |
*** rkukura has quit IRC | 12:36 | |
*** roman_g_ has quit IRC | 12:42 | |
fungi | egonzalez: it's back up now. looks like apache died during log rotation leaving its pidfile behind. no corresponding errors in the apache log nor dmesg/syslog, and no coredump so not much of a trail to follow unfortunately | 12:58 |
fungi | #status log removed stale pidfile and started apache on ask.o.o after it died silently during log rotation | 12:58 |
openstackstatus | fungi: finished logging | 12:58 |
*** toabctl has joined #openstack-infra | 13:21 | |
*** bobh has joined #openstack-infra | 13:25 | |
*** pbourke has quit IRC | 14:01 | |
*** pbourke has joined #openstack-infra | 14:03 | |
*** slaweq has joined #openstack-infra | 14:11 | |
*** graphene has quit IRC | 14:15 | |
*** slaweq has quit IRC | 14:16 | |
*** graphene has joined #openstack-infra | 14:17 | |
*** dhill_ has quit IRC | 14:17 | |
*** bobh has quit IRC | 14:24 | |
*** jamesdenton has joined #openstack-infra | 14:34 | |
*** bobh has joined #openstack-infra | 14:38 | |
*** bobh has quit IRC | 14:38 | |
*** bobh has joined #openstack-infra | 14:38 | |
*** ianychoi has quit IRC | 14:54 | |
*** zhangfei has quit IRC | 15:00 | |
*** Bhujay has quit IRC | 15:05 | |
*** felipemonteiro has joined #openstack-infra | 15:08 | |
*** graphene has quit IRC | 15:09 | |
*** graphene has joined #openstack-infra | 15:11 | |
openstackgerrit | Nguyen Hai proposed openstack-infra/project-config master: remove job settings for designate repositories https://review.openstack.org/592865 | 15:22 |
*** dave-mccowan has joined #openstack-infra | 15:25 | |
openstackgerrit | Nguyen Hai proposed openstack-infra/project-config master: remove job settings for designate repositories https://review.openstack.org/592865 | 15:26 |
*** dave-mccowan has quit IRC | 15:30 | |
openstackgerrit | Nguyen Hai proposed openstack-infra/project-config master: remove job settings for solum repositories https://review.openstack.org/592923 | 15:34 |
*** felipemonteiro has quit IRC | 15:42 | |
*** ianychoi has joined #openstack-infra | 15:47 | |
*** jamesdenton has quit IRC | 15:52 | |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul master: Add IPv6 support for statsd https://review.openstack.org/556327 | 15:53 |
openstackgerrit | Nguyen Hai proposed openstack-infra/project-config master: remove job settings for watcher repositories https://review.openstack.org/593340 | 16:07 |
*** bobh has quit IRC | 16:21 | |
*** bobh has joined #openstack-infra | 16:36 | |
*** bobh has quit IRC | 16:40 | |
*** bobh has joined #openstack-infra | 16:45 | |
*** felipemonteiro has joined #openstack-infra | 16:46 | |
*** bobh has quit IRC | 16:49 | |
*** felipemonteiro has quit IRC | 16:53 | |
*** bobh has joined #openstack-infra | 16:57 | |
*** bobh has quit IRC | 17:02 | |
*** felipemonteiro has joined #openstack-infra | 17:02 | |
*** bobh has joined #openstack-infra | 17:06 | |
*** bobh has quit IRC | 17:10 | |
*** felipemonteiro has quit IRC | 17:15 | |
*** apetrich has joined #openstack-infra | 17:15 | |
*** bobh has joined #openstack-infra | 17:17 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/infra-manual master: Give examples for master only jobs https://review.openstack.org/593344 | 17:22 |
*** bobh has quit IRC | 17:22 | |
*** bobh has joined #openstack-infra | 17:24 | |
*** dave-mccowan has joined #openstack-infra | 17:24 | |
AJaeger | pabelanger: is the dox repo still used - or time to retire it? | 17:26 |
* fungi refreshes his memory re: dox | 17:26 | |
*** felipemonteiro has joined #openstack-infra | 17:27 | |
fungi | "tool for using docker containers to run local tests" (last commit ~1.5 years ago) | 17:27 |
fungi | tox on docker i guess | 17:27 |
fungi | pabelanger: ^ you seem to be the last regular contributor on that | 17:28 |
*** bobh has quit IRC | 17:29 | |
fungi | not an official deliverable repo of openstack | 17:29 |
*** armax has joined #openstack-infra | 17:30 | |
*** felipemonteiro has quit IRC | 17:30 | |
AJaeger | fungi: there are lots of those with no commits for over a year - like fuel-ccp, astara. just stumpled upon dox... | 17:32 |
AJaeger | if anybody wants to remove some infra-manual changes, please look at https://review.openstack.org/593344 and https://review.openstack.org/593138 . Those improve docs for the move to in-repo jobs. | 17:34 |
fungi | skimming http://codesearch.openstack.org/?q=dox i don't think anything we're hosting is actively using it (on master branches at least) | 17:36 |
fungi | AJaeger: yeah, i was lamenting in #openstack-tc last week that we cut fuel loose due to lack of activity rather than retiring it, so now a year or two later people are still trying to use it and finding out it's basically abandoned | 17:37 |
* fungi is working on a proposal to add the tc group from gerrit as a core reviewer to all projects we drop due to low activity | 17:38 | |
fungi | basically we need a compromise between forcing low-activity teams to retire projects and retiring projects which drop to no activity after we do that | 17:39 |
fungi | so that we still have some recourse to retire them at that point | 17:39 |
AJaeger | fungi: glad to see that you're on it. | 17:40 |
*** bobh has joined #openstack-infra | 17:40 | |
* AJaeger just looked at openstack-zuul-jobs and some old jobs there - helping teams convert job is nice but not worth if those projects are dead ;( | 17:40 | |
*** Bhujay has joined #openstack-infra | 17:40 | |
fungi | completely agree | 17:41 |
* AJaeger wonders whether we should at least remove those jobs - far less jobs to maintain... | 17:41 | |
AJaeger | fungi: I look forward to your proposal! Thanks for looking into that. | 17:41 |
*** bobh has quit IRC | 17:44 | |
fungi | an infra proposal to drop centrally-configured jobs which are used by projects which haven't merged a commit in over a year might be interesting, though i wonder how many of our own repos fall into that category | 17:44 |
fungi | then again, i suppose most of those don't have unique jobs | 17:45 |
*** bobh has joined #openstack-infra | 17:46 | |
AJaeger | fungi: infra spec? Or proposal to TC? | 17:47 |
*** dave-mccowan has quit IRC | 17:48 | |
*** bobh has quit IRC | 17:51 | |
*** bauzas has quit IRC | 17:52 | |
*** bobh has joined #openstack-infra | 17:54 | |
*** bauzas has joined #openstack-infra | 17:54 | |
*** graphene has quit IRC | 17:58 | |
*** bobh has quit IRC | 17:59 | |
*** graphene has joined #openstack-infra | 17:59 | |
*** felipemonteiro has joined #openstack-infra | 18:00 | |
fungi | separate. don't know | 18:02 |
fungi | tc resolution would be about continuance of control over repositories which are removed from governance due to lack of activity so they can still be properly retired once abandoned | 18:03 |
fungi | infra proposal would be more about whether and how we set policy about removing unused repos from our configuration when they're purely dead weight | 18:03 |
*** Bhujay has quit IRC | 18:04 | |
*** bobh has joined #openstack-infra | 18:04 | |
AJaeger | no urgency - let's see whether I bring it up one irc meeting... | 18:06 |
AJaeger | thanks, fungi. enjoy the weekend! | 18:06 |
*** bobh has quit IRC | 18:08 | |
*** dave-mccowan has joined #openstack-infra | 18:08 | |
*** armax has quit IRC | 18:10 | |
*** felipemonteiro has quit IRC | 18:13 | |
*** bobh has joined #openstack-infra | 18:14 | |
*** bobh has quit IRC | 18:18 | |
*** bobh has joined #openstack-infra | 18:24 | |
fungi | you too! | 18:28 |
*** bobh has quit IRC | 18:28 | |
*** graphene has quit IRC | 18:29 | |
*** bobh has joined #openstack-infra | 18:35 | |
*** bobh has quit IRC | 18:39 | |
*** Miouge- has quit IRC | 18:42 | |
*** Miouge has joined #openstack-infra | 18:42 | |
*** bobh has joined #openstack-infra | 18:45 | |
*** bobh has quit IRC | 18:49 | |
*** e0ne has joined #openstack-infra | 18:53 | |
*** bobh has joined #openstack-infra | 18:55 | |
*** SteffanW has joined #openstack-infra | 18:58 | |
*** bobh has quit IRC | 19:00 | |
*** apetrich has quit IRC | 19:01 | |
*** bobh has joined #openstack-infra | 19:05 | |
*** zul has quit IRC | 19:09 | |
*** bobh has quit IRC | 19:09 | |
*** apetrich has joined #openstack-infra | 19:22 | |
*** SteffanW has quit IRC | 19:28 | |
*** bobh has joined #openstack-infra | 19:38 | |
*** bobh has quit IRC | 19:43 | |
*** bobh has joined #openstack-infra | 19:43 | |
*** apetrich has quit IRC | 19:55 | |
*** bobh has quit IRC | 19:55 | |
*** bobh has joined #openstack-infra | 20:05 | |
*** slagle has joined #openstack-infra | 20:08 | |
*** bobh has quit IRC | 20:09 | |
*** bobh has joined #openstack-infra | 20:13 | |
*** apetrich has joined #openstack-infra | 20:18 | |
*** bobh has quit IRC | 20:18 | |
*** rf0lc0 has joined #openstack-infra | 20:23 | |
*** rtjure has quit IRC | 20:24 | |
*** rfolco has quit IRC | 20:25 | |
*** rtjure has joined #openstack-infra | 20:26 | |
*** bobh has joined #openstack-infra | 20:33 | |
*** bobh has quit IRC | 20:37 | |
*** owalsh has quit IRC | 20:39 | |
*** owalsh has joined #openstack-infra | 20:40 | |
*** bobh has joined #openstack-infra | 20:45 | |
*** bobh has quit IRC | 20:50 | |
*** bobh has joined #openstack-infra | 21:00 | |
*** owalsh_ has joined #openstack-infra | 21:00 | |
*** owalsh has quit IRC | 21:00 | |
*** bobh_ has joined #openstack-infra | 21:04 | |
*** bobh has quit IRC | 21:05 | |
*** bobh_ has quit IRC | 21:08 | |
*** e0ne has quit IRC | 21:10 | |
*** felipemonteiro has joined #openstack-infra | 21:11 | |
*** bobh has joined #openstack-infra | 21:13 | |
*** graphene has joined #openstack-infra | 21:15 | |
*** graphene has quit IRC | 21:34 | |
*** graphene has joined #openstack-infra | 21:35 | |
*** ijw has joined #openstack-infra | 21:42 | |
*** apetrich has quit IRC | 21:46 | |
*** efried_pto1 has joined #openstack-infra | 21:48 | |
*** efried_pto has quit IRC | 21:50 | |
*** efried_pto1 is now known as efried_pto | 21:50 | |
*** ijw has quit IRC | 21:50 | |
*** owalsh has joined #openstack-infra | 22:06 | |
*** owalsh- has joined #openstack-infra | 22:09 | |
*** owalsh_ has quit IRC | 22:09 | |
*** owalsh has quit IRC | 22:12 | |
*** felipemonteiro has quit IRC | 22:17 | |
*** dave-mccowan has quit IRC | 22:36 | |
dhellmann | are there any examples of tools that know how to round-trip zuul config files that contain !encrypted/pkcs1-oaep items? | 22:37 |
dhellmann | I figured out how to turn those into a list, but the elements of the list come out formatted differently (the newlines are lost) | 22:37 |
*** owalsh has joined #openstack-infra | 22:56 | |
*** owalsh- has quit IRC | 22:57 | |
*** armax has joined #openstack-infra | 23:23 | |
*** bobh has quit IRC | 23:25 | |
*** owalsh has quit IRC | 23:28 | |
*** owalsh has joined #openstack-infra | 23:32 | |
*** Hunner has quit IRC | 23:32 | |
*** owalsh_ has joined #openstack-infra | 23:42 | |
*** owalsh has quit IRC | 23:43 | |
*** owalsh_ is now known as owalsh | 23:44 | |
*** bobh has joined #openstack-infra | 23:51 | |
*** bobh has quit IRC | 23:51 | |
*** bobh has joined #openstack-infra | 23:52 | |
*** bobh has quit IRC | 23:57 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!